2023-11-28T11:40:22.258 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T11:40:22.258 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} --name neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi --owner scheduled_neesingh@teuthology --archive /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469965 --verbose -- /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469965/orig.config.yaml 2023-11-28T11:40:22.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T11:40:22.389 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469965 branch: wip-neesingh-testing-231123 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} email: neesingh@redhat.com first_in_suite: false job_id: '7469965' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-neesingh-testing-231123 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: issue_54557 sha1: 17c45c858c4cb3105f973d12c6c74f8d5037aa89 owner: scheduled_neesingh@teuthology priority: 10 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4140 sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 sleep_before_teardown: 0 suite: fs suite_branch: issue_54557 suite_path: /home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa suite_relpath: qa suite_repo: https://github.com/neesingh-rh/ceph suite_sha1: 17c45c858c4cb3105f973d12c6c74f8d5037aa89 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 5ae09a5cc7064ca2bf994df19f3006b79794789a timestamp: 2023-11-28_11:27:19 tube: smithi user: neesingh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-28T11:40:22.389 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa; will attempt to use it 2023-11-28T11:40:22.389 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks 2023-11-28T11:40:22.390 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-28T11:40:22.391 INFO:teuthology.task.internal:Checking packages... 2023-11-28T11:40:22.414 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '2f5f6028b893ad41357cd06e827373f0fe2a1232' 2023-11-28T11:40:22.414 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-28T11:40:22.414 INFO:teuthology.packaging:ref: None 2023-11-28T11:40:22.414 INFO:teuthology.packaging:tag: None 2023-11-28T11:40:22.414 INFO:teuthology.packaging:branch: wip-neesingh-testing-231123 2023-11-28T11:40:22.414 INFO:teuthology.packaging:sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T11:40:22.415 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-neesingh-testing-231123 2023-11-28T11:40:22.554 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:40:22.554 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-28T11:40:22.561 INFO:teuthology.task.internal:no buildpackages task found 2023-11-28T11:40:22.561 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-28T11:40:22.578 INFO:teuthology.task.internal:Saving configuration 2023-11-28T11:40:22.599 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-28T11:40:22.605 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T11:40:22.632 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469965', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 11:34:29.431802', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-11-28T11:40:22.656 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469965', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 11:34:29.429743', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-11-28T11:40:22.656 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-28T11:40:22.714 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-28T11:40:22.715 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-28T11:40:22.715 INFO:teuthology.run_tasks:Running task console_log... 2023-11-28T11:40:22.786 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fba1aed2160>, signals=[15]) 2023-11-28T11:40:22.787 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-28T11:40:22.793 INFO:teuthology.task.internal:Opening connections... 2023-11-28T11:40:22.793 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T11:40:22.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:40:22.844 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T11:40:22.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:40:22.892 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-28T11:40:22.898 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2023-11-28T11:40:22.926 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2023-11-28T11:40:22.926 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-11-28T11:40:22.975 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Ubuntu" 2023-11-28T11:40:22.975 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-28T11:40:22.975 INFO:teuthology.orchestra.run.smithi050.stdout:ID=ubuntu 2023-11-28T11:40:22.975 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE=debian 2023-11-28T11:40:22.976 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-28T11:40:22.976 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="20.04" 2023-11-28T11:40:22.976 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T11:40:22.976 INFO:teuthology.orchestra.run.smithi050.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T11:40:22.976 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T11:40:22.976 INFO:teuthology.orchestra.run.smithi050.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T11:40:22.976 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_CODENAME=focal 2023-11-28T11:40:22.976 INFO:teuthology.orchestra.run.smithi050.stdout:UBUNTU_CODENAME=focal 2023-11-28T11:40:22.977 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-11-28T11:40:23.005 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-11-28T11:40:23.012 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-11-28T11:40:23.012 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-11-28T11:40:23.058 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Ubuntu" 2023-11-28T11:40:23.058 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-28T11:40:23.059 INFO:teuthology.orchestra.run.smithi192.stdout:ID=ubuntu 2023-11-28T11:40:23.059 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE=debian 2023-11-28T11:40:23.059 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-28T11:40:23.059 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="20.04" 2023-11-28T11:40:23.059 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T11:40:23.059 INFO:teuthology.orchestra.run.smithi192.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T11:40:23.059 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T11:40:23.059 INFO:teuthology.orchestra.run.smithi192.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T11:40:23.059 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_CODENAME=focal 2023-11-28T11:40:23.059 INFO:teuthology.orchestra.run.smithi192.stdout:UBUNTU_CODENAME=focal 2023-11-28T11:40:23.060 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-11-28T11:40:23.080 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-28T11:40:23.089 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-28T11:40:23.094 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-28T11:40:23.095 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2023-11-28T11:40:23.097 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2023-11-28T11:40:23.102 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-28T11:40:23.108 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-28T11:40:23.108 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2023-11-28T11:40:23.143 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2023-11-28T11:40:23.171 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-28T11:40:23.229 INFO:teuthology.run_tasks:Running task kernel... 2023-11-28T11:40:23.243 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-28T11:40:23.243 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-28T11:40:23.244 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T11:40:23.245 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T11:40:23.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:40:23.250 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-11-28T11:40:23.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:40:23.252 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2023-11-28T11:40:23.258 INFO:teuthology.orchestra.run.smithi192.stdout:5.4.0-124-generic 2023-11-28T11:40:23.259 INFO:teuthology.task.kernel:Running kernel on smithi192: 5.4.0-124-generic 2023-11-28T11:40:23.259 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get clean 2023-11-28T11:40:23.299 INFO:teuthology.orchestra.run.smithi050.stdout:5.4.0-124-generic 2023-11-28T11:40:23.299 INFO:teuthology.task.kernel:Running kernel on smithi050: 5.4.0-124-generic 2023-11-28T11:40:23.300 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get clean 2023-11-28T11:40:23.369 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get update 2023-11-28T11:40:23.444 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2023-11-28T11:40:23.526 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-28T11:40:23.536 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-11-28T11:40:23.537 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-11-28T11:40:23.612 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-11-28T11:40:23.636 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-11-28T11:40:23.742 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-28T11:40:23.824 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-11-28T11:40:23.914 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [679 kB] 2023-11-28T11:40:23.942 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,593 kB] 2023-11-28T11:40:23.999 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,593 kB] 2023-11-28T11:40:24.040 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [401 kB] 2023-11-28T11:40:24.042 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-11-28T11:40:24.042 INFO:teuthology.orchestra.run.smithi192.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,398 kB] 2023-11-28T11:40:24.058 INFO:teuthology.orchestra.run.smithi192.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [34.7 kB] 2023-11-28T11:40:24.059 INFO:teuthology.orchestra.run.smithi192.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [335 kB] 2023-11-28T11:40:24.060 INFO:teuthology.orchestra.run.smithi192.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,981 kB] 2023-11-28T11:40:24.062 INFO:teuthology.orchestra.run.smithi192.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2023-11-28T11:40:24.062 INFO:teuthology.orchestra.run.smithi192.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [623 kB] 2023-11-28T11:40:24.066 INFO:teuthology.orchestra.run.smithi192.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [901 kB] 2023-11-28T11:40:24.074 INFO:teuthology.orchestra.run.smithi192.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [189 kB] 2023-11-28T11:40:24.075 INFO:teuthology.orchestra.run.smithi192.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2023-11-28T11:40:24.076 INFO:teuthology.orchestra.run.smithi192.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-11-28T11:40:24.076 INFO:teuthology.orchestra.run.smithi192.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2023-11-28T11:40:24.082 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [679 kB] 2023-11-28T11:40:24.092 INFO:teuthology.orchestra.run.smithi192.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-11-28T11:40:24.093 INFO:teuthology.orchestra.run.smithi192.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-11-28T11:40:24.093 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [401 kB] 2023-11-28T11:40:24.099 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-11-28T11:40:24.099 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [34.7 kB] 2023-11-28T11:40:24.099 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,398 kB] 2023-11-28T11:40:24.122 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [335 kB] 2023-11-28T11:40:24.126 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2023-11-28T11:40:24.126 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [623 kB] 2023-11-28T11:40:24.134 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [901 kB] 2023-11-28T11:40:24.145 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [189 kB] 2023-11-28T11:40:24.147 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2023-11-28T11:40:24.155 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2023-11-28T11:40:24.156 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-11-28T11:40:24.156 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-11-28T11:40:24.156 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-11-28T11:40:24.167 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-11-28T11:40:24.227 INFO:teuthology.orchestra.run.smithi192.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [912 kB] 2023-11-28T11:40:24.240 INFO:teuthology.orchestra.run.smithi192.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [484 kB] 2023-11-28T11:40:24.244 INFO:teuthology.orchestra.run.smithi192.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2023-11-28T11:40:24.244 INFO:teuthology.orchestra.run.smithi192.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,516 kB] 2023-11-28T11:40:24.308 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [912 kB] 2023-11-28T11:40:24.314 INFO:teuthology.orchestra.run.smithi192.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.0 kB] 2023-11-28T11:40:24.315 INFO:teuthology.orchestra.run.smithi192.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [351 kB] 2023-11-28T11:40:24.319 INFO:teuthology.orchestra.run.smithi192.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2023-11-28T11:40:24.320 INFO:teuthology.orchestra.run.smithi192.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [757 kB] 2023-11-28T11:40:24.325 INFO:teuthology.orchestra.run.smithi192.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,134 kB] 2023-11-28T11:40:24.332 INFO:teuthology.orchestra.run.smithi192.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [270 kB] 2023-11-28T11:40:24.334 INFO:teuthology.orchestra.run.smithi192.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2023-11-28T11:40:24.334 INFO:teuthology.orchestra.run.smithi192.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2023-11-28T11:40:24.335 INFO:teuthology.orchestra.run.smithi192.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-11-28T11:40:24.335 INFO:teuthology.orchestra.run.smithi192.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-11-28T11:40:24.335 INFO:teuthology.orchestra.run.smithi192.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-11-28T11:40:24.354 INFO:teuthology.orchestra.run.smithi192.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-11-28T11:40:24.355 INFO:teuthology.orchestra.run.smithi192.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-11-28T11:40:24.355 INFO:teuthology.orchestra.run.smithi192.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-11-28T11:40:24.355 INFO:teuthology.orchestra.run.smithi192.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-11-28T11:40:24.374 INFO:teuthology.orchestra.run.smithi192.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-11-28T11:40:24.374 INFO:teuthology.orchestra.run.smithi192.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-11-28T11:40:24.564 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,981 kB] 2023-11-28T11:40:24.728 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [484 kB] 2023-11-28T11:40:24.741 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2023-11-28T11:40:24.742 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,516 kB] 2023-11-28T11:40:24.819 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.0 kB] 2023-11-28T11:40:24.819 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [351 kB] 2023-11-28T11:40:24.825 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2023-11-28T11:40:24.990 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,134 kB] 2023-11-28T11:40:25.626 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [757 kB] 2023-11-28T11:40:25.664 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [270 kB] 2023-11-28T11:40:25.677 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2023-11-28T11:40:25.679 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-11-28T11:40:25.680 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2023-11-28T11:40:25.681 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-11-28T11:40:25.681 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-11-28T11:40:25.681 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-11-28T11:40:25.683 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-11-28T11:40:25.708 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-11-28T11:40:25.872 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-11-28T11:40:26.036 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-11-28T11:40:26.087 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-11-28T11:40:28.005 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 18.2 MB in 3s (7,049 kB/s) 2023-11-28T11:40:28.246 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 18.2 MB in 3s (6,820 kB/s) 2023-11-28T11:40:29.439 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-11-28T11:40:29.465 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-28T11:40:29.530 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-11-28T11:40:29.733 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2023-11-28T11:40:29.734 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2023-11-28T11:40:29.734 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2023-11-28T11:40:29.759 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-28T11:40:29.827 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2023-11-28T11:40:29.918 INFO:teuthology.orchestra.run.smithi192.stdout:The following additional packages will be installed: 2023-11-28T11:40:29.918 INFO:teuthology.orchestra.run.smithi192.stdout: linux-generic linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-11-28T11:40:29.918 INFO:teuthology.orchestra.run.smithi192.stdout: linux-headers-generic linux-image-5.4.0-167-generic 2023-11-28T11:40:29.918 INFO:teuthology.orchestra.run.smithi192.stdout: linux-modules-5.4.0-167-generic linux-modules-extra-5.4.0-167-generic 2023-11-28T11:40:29.919 INFO:teuthology.orchestra.run.smithi192.stdout:Suggested packages: 2023-11-28T11:40:29.919 INFO:teuthology.orchestra.run.smithi192.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-11-28T11:40:29.920 INFO:teuthology.orchestra.run.smithi192.stdout:Recommended packages: 2023-11-28T11:40:29.920 INFO:teuthology.orchestra.run.smithi192.stdout: thermald 2023-11-28T11:40:29.979 INFO:teuthology.orchestra.run.smithi192.stdout:The following NEW packages will be installed: 2023-11-28T11:40:29.979 INFO:teuthology.orchestra.run.smithi192.stdout: linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-11-28T11:40:29.979 INFO:teuthology.orchestra.run.smithi192.stdout: linux-image-5.4.0-167-generic linux-modules-5.4.0-167-generic 2023-11-28T11:40:29.980 INFO:teuthology.orchestra.run.smithi192.stdout: linux-modules-extra-5.4.0-167-generic 2023-11-28T11:40:29.981 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages will be upgraded: 2023-11-28T11:40:29.981 INFO:teuthology.orchestra.run.smithi192.stdout: linux-generic linux-headers-generic linux-image-generic 2023-11-28T11:40:30.037 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2023-11-28T11:40:30.038 INFO:teuthology.orchestra.run.smithi192.stdout:3 upgraded, 5 newly installed, 0 to remove and 278 not upgraded. 2023-11-28T11:40:30.038 INFO:teuthology.orchestra.run.smithi192.stdout:Need to get 77.0 MB of archives. 2023-11-28T11:40:30.039 INFO:teuthology.orchestra.run.smithi192.stdout:After this operation, 380 MB of additional disk space will be used. 2023-11-28T11:40:30.039 INFO:teuthology.orchestra.run.smithi192.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-167-generic amd64 5.4.0-167.184 [15.0 MB] 2023-11-28T11:40:30.039 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2023-11-28T11:40:30.242 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2023-11-28T11:40:30.242 INFO:teuthology.orchestra.run.smithi050.stdout: linux-generic linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-11-28T11:40:30.243 INFO:teuthology.orchestra.run.smithi050.stdout: linux-headers-generic linux-image-5.4.0-167-generic 2023-11-28T11:40:30.243 INFO:teuthology.orchestra.run.smithi050.stdout: linux-modules-5.4.0-167-generic linux-modules-extra-5.4.0-167-generic 2023-11-28T11:40:30.243 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2023-11-28T11:40:30.243 INFO:teuthology.orchestra.run.smithi050.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-11-28T11:40:30.244 INFO:teuthology.orchestra.run.smithi050.stdout:Recommended packages: 2023-11-28T11:40:30.244 INFO:teuthology.orchestra.run.smithi050.stdout: thermald 2023-11-28T11:40:30.302 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2023-11-28T11:40:30.302 INFO:teuthology.orchestra.run.smithi050.stdout: linux-headers-5.4.0-167 linux-headers-5.4.0-167-generic 2023-11-28T11:40:30.302 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.4.0-167-generic linux-modules-5.4.0-167-generic 2023-11-28T11:40:30.302 INFO:teuthology.orchestra.run.smithi050.stdout: linux-modules-extra-5.4.0-167-generic 2023-11-28T11:40:30.303 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages will be upgraded: 2023-11-28T11:40:30.303 INFO:teuthology.orchestra.run.smithi050.stdout: linux-generic linux-headers-generic linux-image-generic 2023-11-28T11:40:30.356 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-167-generic amd64 5.4.0-167.184 [10.5 MB] 2023-11-28T11:40:30.361 INFO:teuthology.orchestra.run.smithi050.stdout:3 upgraded, 5 newly installed, 0 to remove and 278 not upgraded. 2023-11-28T11:40:30.361 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 77.0 MB of archives. 2023-11-28T11:40:30.361 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 380 MB of additional disk space will be used. 2023-11-28T11:40:30.361 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-167-generic amd64 5.4.0-167.184 [15.0 MB] 2023-11-28T11:40:30.451 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-167-generic amd64 5.4.0-167.184 [39.2 MB] 2023-11-28T11:40:30.845 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-167-generic amd64 5.4.0-167.184 [10.5 MB] 2023-11-28T11:40:30.981 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.167.164 [1,900 B] 2023-11-28T11:40:30.981 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.167.164 [2,564 B] 2023-11-28T11:40:30.982 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167 all 5.4.0-167.184 [11.0 MB] 2023-11-28T11:40:31.025 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-167-generic amd64 5.4.0-167.184 [39.2 MB] 2023-11-28T11:40:31.078 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167-generic amd64 5.4.0-167.184 [1,367 kB] 2023-11-28T11:40:31.088 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.167.164 [2,428 B] 2023-11-28T11:40:31.790 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 77.0 MB in 1s (69.9 MB/s) 2023-11-28T11:40:31.997 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-modules-5.4.0-167-generic. 2023-11-28T11:40:32.119 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.167.164 [1,900 B] 2023-11-28T11:40:32.119 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.167.164 [2,564 B] 2023-11-28T11:40:32.119 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167 all 5.4.0-167.184 [11.0 MB] 2023-11-28T11:40:32.271 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-167-generic amd64 5.4.0-167.184 [1,367 kB] 2023-11-28T11:40:32.295 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.167.164 [2,428 B] 2023-11-28T11:40:33.030 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 77.0 MB in 2s (38.8 MB/s) 2023-11-28T11:40:33.195 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-modules-5.4.0-167-generic. 2023-11-28T11:40:33.712 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-11-28T11:40:33.717 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../0-linux-modules-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-28T11:40:33.819 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:34.912 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-11-28T11:40:34.917 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../0-linux-modules-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-28T11:40:35.059 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:35.760 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-image-5.4.0-167-generic. 2023-11-28T11:40:35.774 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../1-linux-image-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-28T11:40:35.874 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:36.927 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-image-5.4.0-167-generic. 2023-11-28T11:40:36.940 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../1-linux-image-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-28T11:40:36.971 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-167-generic. 2023-11-28T11:40:36.986 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-28T11:40:37.030 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:37.043 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:38.181 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-167-generic. 2023-11-28T11:40:38.194 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-28T11:40:38.230 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:41.714 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../3-linux-generic_5.4.0.167.164_amd64.deb ... 2023-11-28T11:40:41.850 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-28T11:40:42.211 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.167.164_amd64.deb ... 2023-11-28T11:40:42.337 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-image-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-28T11:40:42.681 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-headers-5.4.0-167. 2023-11-28T11:40:42.695 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../5-linux-headers-5.4.0-167_5.4.0-167.184_all.deb ... 2023-11-28T11:40:42.739 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-11-28T11:40:43.204 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../3-linux-generic_5.4.0.167.164_amd64.deb ... 2023-11-28T11:40:43.347 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-28T11:40:43.722 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.167.164_amd64.deb ... 2023-11-28T11:40:43.892 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-image-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-28T11:40:44.229 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-headers-5.4.0-167. 2023-11-28T11:40:44.242 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../5-linux-headers-5.4.0-167_5.4.0-167.184_all.deb ... 2023-11-28T11:40:44.289 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-11-28T11:40:48.277 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-headers-5.4.0-167-generic. 2023-11-28T11:40:48.297 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../6-linux-headers-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-28T11:40:48.335 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:49.895 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-headers-5.4.0-167-generic. 2023-11-28T11:40:49.918 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../6-linux-headers-5.4.0-167-generic_5.4.0-167.184_amd64.deb ... 2023-11-28T11:40:49.953 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:51.029 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.167.164_amd64.deb ... 2023-11-28T11:40:51.165 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-headers-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-28T11:40:51.527 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:52.763 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-11-28T11:40:52.890 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:53.024 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:53.294 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.167.164_amd64.deb ... 2023-11-28T11:40:53.391 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-generic (5.4.0.167.164) over (5.4.0.124.125) ... 2023-11-28T11:40:53.744 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-modules-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:54.211 INFO:teuthology.orchestra.run.smithi192.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-167-generic 2023-11-28T11:40:54.212 INFO:teuthology.orchestra.run.smithi192.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-167-generic 2023-11-28T11:40:54.351 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:55.025 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-5.4.0-167 (5.4.0-167.184) ... 2023-11-28T11:40:55.151 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:55.310 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:55.511 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-image-generic (5.4.0.167.164) ... 2023-11-28T11:40:55.637 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-headers-generic (5.4.0.167.164) ... 2023-11-28T11:40:55.763 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-generic (5.4.0.167.164) ... 2023-11-28T11:40:55.915 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:55.990 INFO:teuthology.orchestra.run.smithi192.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-11-28T11:40:55.990 INFO:teuthology.orchestra.run.smithi192.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-167-generic 2023-11-28T11:40:56.928 INFO:teuthology.orchestra.run.smithi050.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-167-generic 2023-11-28T11:40:56.928 INFO:teuthology.orchestra.run.smithi050.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-167-generic 2023-11-28T11:40:57.079 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-modules-extra-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:58.342 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-image-generic (5.4.0.167.164) ... 2023-11-28T11:40:58.474 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-generic (5.4.0.167.164) ... 2023-11-28T11:40:58.625 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-generic (5.4.0.167.164) ... 2023-11-28T11:40:58.751 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for linux-image-5.4.0-167-generic (5.4.0-167.184) ... 2023-11-28T11:40:58.826 INFO:teuthology.orchestra.run.smithi050.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-11-28T11:40:58.826 INFO:teuthology.orchestra.run.smithi050.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-167-generic 2023-11-28T11:41:18.457 INFO:teuthology.orchestra.run.smithi192.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-11-28T11:41:18.457 INFO:teuthology.orchestra.run.smithi192.stdout:Sourcing file `/etc/default/grub' 2023-11-28T11:41:18.470 INFO:teuthology.orchestra.run.smithi192.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T11:41:18.490 INFO:teuthology.orchestra.run.smithi192.stdout:Generating grub configuration file ... 2023-11-28T11:41:18.819 INFO:teuthology.orchestra.run.smithi192.stdout:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-11-28T11:41:18.850 INFO:teuthology.orchestra.run.smithi192.stdout:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-11-28T11:41:19.243 INFO:teuthology.orchestra.run.smithi192.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-28T11:41:19.253 INFO:teuthology.orchestra.run.smithi192.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-28T11:41:21.506 INFO:teuthology.orchestra.run.smithi050.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-11-28T11:41:21.506 INFO:teuthology.orchestra.run.smithi050.stdout:Sourcing file `/etc/default/grub' 2023-11-28T11:41:21.532 INFO:teuthology.orchestra.run.smithi050.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T11:41:21.554 INFO:teuthology.orchestra.run.smithi050.stdout:Generating grub configuration file ... 2023-11-28T11:41:21.969 INFO:teuthology.orchestra.run.smithi192.stdout:done 2023-11-28T11:41:21.985 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-11-28T11:41:22.009 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-11-28T11:41:22.424 DEBUG:teuthology.orchestra.run.smithi192:> dpkg -s linux-image-generic 2023-11-28T11:41:22.427 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-28T11:41:22.438 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-28T11:41:22.491 INFO:teuthology.orchestra.run.smithi192.stdout:Package: linux-image-generic 2023-11-28T11:41:22.491 INFO:teuthology.orchestra.run.smithi192.stdout:Status: install ok installed 2023-11-28T11:41:22.491 INFO:teuthology.orchestra.run.smithi192.stdout:Priority: optional 2023-11-28T11:41:22.491 INFO:teuthology.orchestra.run.smithi192.stdout:Section: kernel 2023-11-28T11:41:22.492 INFO:teuthology.orchestra.run.smithi192.stdout:Installed-Size: 20 2023-11-28T11:41:22.492 INFO:teuthology.orchestra.run.smithi192.stdout:Maintainer: Ubuntu Kernel Team 2023-11-28T11:41:22.492 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: amd64 2023-11-28T11:41:22.492 INFO:teuthology.orchestra.run.smithi192.stdout:Source: linux-meta 2023-11-28T11:41:22.492 INFO:teuthology.orchestra.run.smithi192.stdout:Version: 5.4.0.167.164 2023-11-28T11:41:22.492 INFO:teuthology.orchestra.run.smithi192.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-28T11:41:22.492 INFO:teuthology.orchestra.run.smithi192.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-28T11:41:22.492 INFO:teuthology.orchestra.run.smithi192.stdout:Recommends: thermald 2023-11-28T11:41:22.492 INFO:teuthology.orchestra.run.smithi192.stdout:Description: Generic Linux kernel image 2023-11-28T11:41:22.492 INFO:teuthology.orchestra.run.smithi192.stdout: This package will always depend on the latest generic kernel image 2023-11-28T11:41:22.492 INFO:teuthology.orchestra.run.smithi192.stdout: available. 2023-11-28T11:41:22.493 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-167-generic 2023-11-28T11:41:22.493 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-28T11:41:22.493 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-28T11:41:22.493 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-28T11:41:22.493 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi192.front.sepia.ceph.com, path=None, version=distro) 2023-11-28T11:41:22.493 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get clean 2023-11-28T11:41:22.562 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get update 2023-11-28T11:41:22.692 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-28T11:41:22.699 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-28T11:41:22.716 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-28T11:41:22.812 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-28T11:41:24.442 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-11-28T11:41:24.466 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-28T11:41:24.536 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-11-28T11:41:24.715 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2023-11-28T11:41:24.715 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2023-11-28T11:41:24.925 INFO:teuthology.orchestra.run.smithi192.stdout:linux-image-generic is already the newest version (5.4.0.167.164). 2023-11-28T11:41:24.925 INFO:teuthology.orchestra.run.smithi192.stdout:0 upgraded, 0 newly installed, 0 to remove and 278 not upgraded. 2023-11-28T11:41:24.927 DEBUG:teuthology.orchestra.run.smithi192:> dpkg -s linux-image-generic 2023-11-28T11:41:24.946 INFO:teuthology.orchestra.run.smithi192.stdout:Package: linux-image-generic 2023-11-28T11:41:24.946 INFO:teuthology.orchestra.run.smithi192.stdout:Status: install ok installed 2023-11-28T11:41:24.946 INFO:teuthology.orchestra.run.smithi192.stdout:Priority: optional 2023-11-28T11:41:24.946 INFO:teuthology.orchestra.run.smithi192.stdout:Section: kernel 2023-11-28T11:41:24.947 INFO:teuthology.orchestra.run.smithi192.stdout:Installed-Size: 20 2023-11-28T11:41:24.947 INFO:teuthology.orchestra.run.smithi192.stdout:Maintainer: Ubuntu Kernel Team 2023-11-28T11:41:24.947 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: amd64 2023-11-28T11:41:24.947 INFO:teuthology.orchestra.run.smithi192.stdout:Source: linux-meta 2023-11-28T11:41:24.947 INFO:teuthology.orchestra.run.smithi192.stdout:Version: 5.4.0.167.164 2023-11-28T11:41:24.947 INFO:teuthology.orchestra.run.smithi192.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-28T11:41:24.947 INFO:teuthology.orchestra.run.smithi192.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-28T11:41:24.947 INFO:teuthology.orchestra.run.smithi192.stdout:Recommends: thermald 2023-11-28T11:41:24.947 INFO:teuthology.orchestra.run.smithi192.stdout:Description: Generic Linux kernel image 2023-11-28T11:41:24.947 INFO:teuthology.orchestra.run.smithi192.stdout: This package will always depend on the latest generic kernel image 2023-11-28T11:41:24.947 INFO:teuthology.orchestra.run.smithi192.stdout: available. 2023-11-28T11:41:24.948 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2023-11-28T11:41:24.952 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.WRBp0I7R88 2023-11-28T11:41:24.952 DEBUG:teuthology.orchestra.run.smithi192:> sudo cp /boot/grub/grub.cfg /tmp/tmp.WRBp0I7R88 2023-11-28T11:41:24.969 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.WRBp0I7R88 2023-11-28T11:41:25.051 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.WRBp0I7R88 is 9KB 2023-11-28T11:41:25.064 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.WRBp0I7R88 2023-11-28T11:41:25.070 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-11-28T11:41:25.128 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:41:25.128 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-11-28T11:41:25.128 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-11-28T11:41:25.134 INFO:teuthology.orchestra.run.smithi050.stdout:done 2023-11-28T11:41:25.159 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-167-generic 2023-11-28T11:41:25.160 DEBUG:teuthology.orchestra.run.smithi192:> sudo update-grub 2023-11-28T11:41:25.573 DEBUG:teuthology.orchestra.run.smithi050:> dpkg -s linux-image-generic 2023-11-28T11:41:25.614 INFO:teuthology.orchestra.run.smithi050.stdout:Package: linux-image-generic 2023-11-28T11:41:25.615 INFO:teuthology.orchestra.run.smithi050.stdout:Status: install ok installed 2023-11-28T11:41:25.615 INFO:teuthology.orchestra.run.smithi050.stdout:Priority: optional 2023-11-28T11:41:25.615 INFO:teuthology.orchestra.run.smithi050.stdout:Section: kernel 2023-11-28T11:41:25.615 INFO:teuthology.orchestra.run.smithi050.stdout:Installed-Size: 20 2023-11-28T11:41:25.615 INFO:teuthology.orchestra.run.smithi050.stdout:Maintainer: Ubuntu Kernel Team 2023-11-28T11:41:25.615 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: amd64 2023-11-28T11:41:25.615 INFO:teuthology.orchestra.run.smithi050.stdout:Source: linux-meta 2023-11-28T11:41:25.615 INFO:teuthology.orchestra.run.smithi050.stdout:Version: 5.4.0.167.164 2023-11-28T11:41:25.615 INFO:teuthology.orchestra.run.smithi050.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-28T11:41:25.616 INFO:teuthology.orchestra.run.smithi050.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-28T11:41:25.616 INFO:teuthology.orchestra.run.smithi050.stdout:Recommends: thermald 2023-11-28T11:41:25.616 INFO:teuthology.orchestra.run.smithi050.stdout:Description: Generic Linux kernel image 2023-11-28T11:41:25.616 INFO:teuthology.orchestra.run.smithi050.stdout: This package will always depend on the latest generic kernel image 2023-11-28T11:41:25.616 INFO:teuthology.orchestra.run.smithi050.stdout: available. 2023-11-28T11:41:25.616 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-167-generic 2023-11-28T11:41:25.616 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-28T11:41:25.616 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-28T11:41:25.616 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-28T11:41:25.616 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=None, version=distro) 2023-11-28T11:41:25.617 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get clean 2023-11-28T11:41:25.752 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2023-11-28T11:41:25.952 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-28T11:41:25.953 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-28T11:41:25.991 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-28T11:41:26.041 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-28T11:41:26.506 INFO:teuthology.orchestra.run.smithi192.stderr:Sourcing file `/etc/default/grub' 2023-11-28T11:41:26.511 INFO:teuthology.orchestra.run.smithi192.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T11:41:26.518 INFO:teuthology.orchestra.run.smithi192.stderr:Generating grub configuration file ... 2023-11-28T11:41:26.817 INFO:teuthology.orchestra.run.smithi192.stderr:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-11-28T11:41:26.829 INFO:teuthology.orchestra.run.smithi192.stderr:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-11-28T11:41:27.223 INFO:teuthology.orchestra.run.smithi192.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-28T11:41:27.234 INFO:teuthology.orchestra.run.smithi192.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-28T11:41:27.759 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2023-11-28T11:41:27.784 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-28T11:41:27.857 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2023-11-28T11:41:28.043 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2023-11-28T11:41:28.044 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2023-11-28T11:41:28.266 INFO:teuthology.orchestra.run.smithi050.stdout:linux-image-generic is already the newest version (5.4.0.167.164). 2023-11-28T11:41:28.266 INFO:teuthology.orchestra.run.smithi050.stdout:0 upgraded, 0 newly installed, 0 to remove and 278 not upgraded. 2023-11-28T11:41:28.268 DEBUG:teuthology.orchestra.run.smithi050:> dpkg -s linux-image-generic 2023-11-28T11:41:28.289 INFO:teuthology.orchestra.run.smithi050.stdout:Package: linux-image-generic 2023-11-28T11:41:28.289 INFO:teuthology.orchestra.run.smithi050.stdout:Status: install ok installed 2023-11-28T11:41:28.289 INFO:teuthology.orchestra.run.smithi050.stdout:Priority: optional 2023-11-28T11:41:28.289 INFO:teuthology.orchestra.run.smithi050.stdout:Section: kernel 2023-11-28T11:41:28.289 INFO:teuthology.orchestra.run.smithi050.stdout:Installed-Size: 20 2023-11-28T11:41:28.289 INFO:teuthology.orchestra.run.smithi050.stdout:Maintainer: Ubuntu Kernel Team 2023-11-28T11:41:28.289 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: amd64 2023-11-28T11:41:28.289 INFO:teuthology.orchestra.run.smithi050.stdout:Source: linux-meta 2023-11-28T11:41:28.289 INFO:teuthology.orchestra.run.smithi050.stdout:Version: 5.4.0.167.164 2023-11-28T11:41:28.289 INFO:teuthology.orchestra.run.smithi050.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-28T11:41:28.289 INFO:teuthology.orchestra.run.smithi050.stdout:Depends: linux-image-5.4.0-167-generic, linux-modules-extra-5.4.0-167-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-28T11:41:28.290 INFO:teuthology.orchestra.run.smithi050.stdout:Recommends: thermald 2023-11-28T11:41:28.290 INFO:teuthology.orchestra.run.smithi050.stdout:Description: Generic Linux kernel image 2023-11-28T11:41:28.290 INFO:teuthology.orchestra.run.smithi050.stdout: This package will always depend on the latest generic kernel image 2023-11-28T11:41:28.290 INFO:teuthology.orchestra.run.smithi050.stdout: available. 2023-11-28T11:41:28.290 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-11-28T11:41:28.296 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.T5nuucicZY 2023-11-28T11:41:28.296 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub/grub.cfg /tmp/tmp.T5nuucicZY 2023-11-28T11:41:28.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.T5nuucicZY 2023-11-28T11:41:28.413 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.T5nuucicZY is 9KB 2023-11-28T11:41:28.428 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.T5nuucicZY 2023-11-28T11:41:28.434 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-11-28T11:41:28.493 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:41:28.493 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-11-28T11:41:28.493 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-11-28T11:41:28.531 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-167-generic 2023-11-28T11:41:28.531 DEBUG:teuthology.orchestra.run.smithi050:> sudo update-grub 2023-11-28T11:41:28.857 INFO:teuthology.orchestra.run.smithi192.stderr:done 2023-11-28T11:41:28.859 DEBUG:teuthology.orchestra.run.smithi192:> sudo shutdown -r now 2023-11-28T11:41:29.949 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub' 2023-11-28T11:41:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T11:41:29.978 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2023-11-28T11:41:30.316 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.4.0-167-generic 2023-11-28T11:41:30.328 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.4.0-167-generic 2023-11-28T11:41:30.748 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-28T11:41:30.760 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-28T11:41:32.401 INFO:teuthology.orchestra.run.smithi050.stderr:done 2023-11-28T11:41:32.403 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2023-11-28T11:41:58.886 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-28T11:41:58.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-11-28T11:41:58.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:42:02.410 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-28T11:42:02.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-11-28T11:42:02.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:42:58.946 DEBUG:teuthology.orchestra.remote:timed out 2023-11-28T11:43:02.414 DEBUG:teuthology.orchestra.remote:timed out 2023-11-28T11:43:07.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-11-28T11:43:07.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:43:08.408 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-11-28T11:43:09.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-11-28T11:43:09.091 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-167-generic"... 2023-11-28T11:43:09.091 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2023-11-28T11:43:09.097 INFO:teuthology.orchestra.run.smithi192.stdout:5.4.0-167-generic 2023-11-28T11:43:09.098 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-167-generic vs 5.4.0-167-generic 2023-11-28T11:43:09.098 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T11:43:09.098 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T11:43:10.099 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-28T11:43:10.099 DEBUG:teuthology.orchestra.run.smithi192:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-28T11:43:10.197 INFO:teuthology.orchestra.run.smithi192.stdout:ttyS1 2023-11-28T11:43:10.224 DEBUG:teuthology.parallel:result is None 2023-11-28T11:43:11.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-11-28T11:43:11.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:43:12.422 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-11-28T11:43:24.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-11-28T11:43:24.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:43:24.641 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-11-28T11:43:25.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-11-28T11:43:25.190 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-167-generic"... 2023-11-28T11:43:25.191 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-11-28T11:43:25.197 INFO:teuthology.orchestra.run.smithi050.stdout:5.4.0-167-generic 2023-11-28T11:43:25.197 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-167-generic vs 5.4.0-167-generic 2023-11-28T11:43:25.197 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T11:43:25.197 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T11:43:26.198 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-28T11:43:26.198 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-28T11:43:26.297 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2023-11-28T11:43:26.324 DEBUG:teuthology.parallel:result is None 2023-11-28T11:43:26.324 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-28T11:43:26.331 INFO:teuthology.task.internal:Creating test directory... 2023-11-28T11:43:26.331 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T11:43:26.333 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T11:43:26.341 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-28T11:43:26.399 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-28T11:43:26.407 INFO:teuthology.task.internal:Creating archive directory... 2023-11-28T11:43:26.407 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T11:43:26.410 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T11:43:26.434 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-28T11:43:26.442 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-28T11:43:26.443 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T11:43:26.471 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T11:43:26.500 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T11:43:26.502 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T11:43:26.511 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T11:43:26.513 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T11:43:26.514 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-28T11:43:26.520 INFO:teuthology.task.internal:Configuring sudo... 2023-11-28T11:43:26.520 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T11:43:26.523 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T11:43:26.537 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-28T11:43:26.545 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-28T11:43:26.546 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T11:43:26.575 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T11:43:26.587 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T11:43:26.594 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T11:43:26.644 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:43:26.644 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T11:43:26.663 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T11:43:26.670 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T11:43:26.719 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:43:26.720 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T11:43:26.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2023-11-28T11:43:26.751 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2023-11-28T11:43:26.800 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-28T11:43:26.807 INFO:teuthology.task.internal:Starting timer... 2023-11-28T11:43:26.807 INFO:teuthology.run_tasks:Running task pcp... 2023-11-28T11:43:26.820 INFO:teuthology.run_tasks:Running task selinux... 2023-11-28T11:43:26.828 DEBUG:teuthology.task.selinux:Excluding smithi050: OS 'ubuntu' does not support SELinux 2023-11-28T11:43:26.828 DEBUG:teuthology.task.selinux:Excluding smithi192: OS 'ubuntu' does not support SELinux 2023-11-28T11:43:26.828 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-28T11:43:26.828 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-28T11:43:26.828 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-28T11:43:26.828 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-28T11:43:26.836 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-28T11:43:26.837 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-28T11:43:26.853 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-28T11:43:26.854 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-28T11:49:21.451 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2023-11-28T11:49:21.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-11-28T11:49:21.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:49:21.504 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-11-28T11:49:21.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-11-28T11:49:21.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-11-28T11:49:21.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:49:21.670 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-11-28T11:49:21.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-11-28T11:49:21.792 INFO:teuthology.run_tasks:Running task clock... 2023-11-28T11:49:21.803 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-28T11:49:21.803 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T11:49:21.803 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T11:49:21.806 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T11:49:21.806 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T11:49:21.837 INFO:teuthology.orchestra.run.smithi192.stdout:28 Nov 11:49:21 ntpd[23653]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-11-28T11:49:21.838 INFO:teuthology.orchestra.run.smithi192.stdout:28 Nov 11:49:21 ntpd[23653]: Command line: ntpd -gq 2023-11-28T11:49:21.839 INFO:teuthology.orchestra.run.smithi192.stdout:28 Nov 11:49:21 ntpd[23653]: proto: precision = 0.066 usec (-24) 2023-11-28T11:49:21.840 INFO:teuthology.orchestra.run.smithi192.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T11:49:21.840 INFO:teuthology.orchestra.run.smithi192.stdout:28 Nov 11:49:21 ntpd[23653]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T11:49:21.840 INFO:teuthology.orchestra.run.smithi192.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T11:49:21.841 INFO:teuthology.orchestra.run.smithi192.stdout:28 Nov 11:49:21 ntpd[23653]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T11:49:21.841 INFO:teuthology.orchestra.run.smithi192.stdout:28 Nov 11:49:21 ntpd[23653]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T11:49:21.841 INFO:teuthology.orchestra.run.smithi192.stdout:28 Nov 11:49:21 ntpd[23653]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T11:49:21.841 INFO:teuthology.orchestra.run.smithi192.stdout:28 Nov 11:49:21 ntpd[23653]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T11:49:21.842 INFO:teuthology.orchestra.run.smithi192.stdout:28 Nov 11:49:21 ntpd[23653]: Listen normally on 3 enp3s0f1 172.21.15.192:123 2023-11-28T11:49:21.842 INFO:teuthology.orchestra.run.smithi192.stdout:28 Nov 11:49:21 ntpd[23653]: Listen normally on 4 lo [::1]:123 2023-11-28T11:49:21.842 INFO:teuthology.orchestra.run.smithi192.stdout:28 Nov 11:49:21 ntpd[23653]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8049%5]:123 2023-11-28T11:49:21.842 INFO:teuthology.orchestra.run.smithi192.stdout:28 Nov 11:49:21 ntpd[23653]: Listening on routing socket on fd #22 for interface updates 2023-11-28T11:49:21.842 INFO:teuthology.orchestra.run.smithi050.stdout:28 Nov 11:49:21 ntpd[23456]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-11-28T11:49:21.843 INFO:teuthology.orchestra.run.smithi050.stdout:28 Nov 11:49:21 ntpd[23456]: Command line: ntpd -gq 2023-11-28T11:49:21.843 INFO:teuthology.orchestra.run.smithi050.stdout:28 Nov 11:49:21 ntpd[23456]: proto: precision = 0.123 usec (-23) 2023-11-28T11:49:21.843 INFO:teuthology.orchestra.run.smithi050.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T11:49:21.843 INFO:teuthology.orchestra.run.smithi050.stdout:28 Nov 11:49:21 ntpd[23456]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T11:49:21.844 INFO:teuthology.orchestra.run.smithi050.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T11:49:21.844 INFO:teuthology.orchestra.run.smithi050.stdout:28 Nov 11:49:21 ntpd[23456]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T11:49:21.845 INFO:teuthology.orchestra.run.smithi050.stdout:28 Nov 11:49:21 ntpd[23456]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T11:49:21.845 INFO:teuthology.orchestra.run.smithi050.stdout:28 Nov 11:49:21 ntpd[23456]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T11:49:21.845 INFO:teuthology.orchestra.run.smithi050.stdout:28 Nov 11:49:21 ntpd[23456]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T11:49:21.845 INFO:teuthology.orchestra.run.smithi050.stdout:28 Nov 11:49:21 ntpd[23456]: Listen normally on 3 ens1f0 172.21.15.50:123 2023-11-28T11:49:21.845 INFO:teuthology.orchestra.run.smithi050.stdout:28 Nov 11:49:21 ntpd[23456]: Listen normally on 4 lo [::1]:123 2023-11-28T11:49:21.845 INFO:teuthology.orchestra.run.smithi050.stdout:28 Nov 11:49:21 ntpd[23456]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1584%3]:123 2023-11-28T11:49:21.845 INFO:teuthology.orchestra.run.smithi050.stdout:28 Nov 11:49:21 ntpd[23456]: Listening on routing socket on fd #22 for interface updates 2023-11-28T11:49:22.839 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:22 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:22.839 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:22 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:22.839 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:22 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:22.839 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:22 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:22.839 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:22 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:22.839 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:22 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:22.839 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:22 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:22.839 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:22 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:23 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:23 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:23 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:23 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:23 ntpd[23456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:23 ntpd[23456]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:24.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:24 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:24.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:24 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:24.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:24 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:24.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:24 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:24.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:24 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:24.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:24 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:24 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:24 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:24 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:24 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:24 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:24 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:24.843 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:24 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:24.843 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:24 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:24.843 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:24 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:24.843 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:24 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:24.843 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:24 ntpd[23456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:24.843 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:24 ntpd[23456]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:25.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:25 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:25 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:25 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:25 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:25 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:25 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:25 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:25 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:25 ntpd[23456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:25 ntpd[23456]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:25.843 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:25 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:25.843 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:25 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:25.843 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:25 ntpd[23456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:25.843 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:25 ntpd[23456]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:26.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:26.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:26.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:26.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:26.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:26.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:26.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:26.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:26.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:26.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:26.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:26.842 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:26.842 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:26.842 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:26.842 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:26.842 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:26.842 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:26.842 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:26 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:26.843 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:26 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:26.844 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:26 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:26.844 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:26 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:26.844 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:26 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:26.844 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:26 ntpd[23456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:26.844 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:26 ntpd[23456]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:27.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:27 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:27.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:27 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:27.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:27 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:27.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:27 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:27.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:27 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:27.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:27 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:27.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:27 ntpd[23456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:27.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:27 ntpd[23456]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:27.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:27 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:27.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:27 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:27.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:27 ntpd[23456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:27.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:27 ntpd[23456]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:28.839 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:28.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:28.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:28.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:28.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:28.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:28.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:28.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:28.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:28.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:28.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:28.840 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:28.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:28.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:28.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:28.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:28.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:28.841 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:28.841 INFO:teuthology.orchestra.run.smithi192.stdout:28 Nov 11:49:28 ntpd[23653]: ntpd: time slew -0.000498 s 2023-11-28T11:49:28.841 INFO:teuthology.orchestra.run.smithi192.stdout:ntpd: time slew -0.000498s 2023-11-28T11:49:28.842 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T11:49:28.842 INFO:teuthology.orchestra.run.smithi192.stderr:28 Nov 11:49:28 ntpd[23653]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T11:49:28.843 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:28 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:28.843 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:28 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:28.843 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:28 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:28.843 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:28 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:28.843 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:28 ntpd[23456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:28.843 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:28 ntpd[23456]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:28.902 INFO:teuthology.orchestra.run.smithi192.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T11:49:28.903 INFO:teuthology.orchestra.run.smithi192.stdout:============================================================================== 2023-11-28T11:49:28.903 INFO:teuthology.orchestra.run.smithi192.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T11:49:28.903 INFO:teuthology.orchestra.run.smithi192.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T11:49:28.903 INFO:teuthology.orchestra.run.smithi192.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T11:49:28.903 INFO:teuthology.orchestra.run.smithi192.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T11:49:29.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:29 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:29.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:29 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:29.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:29 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:29.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:29 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:29.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:29 ntpd[23456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T11:49:29.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:29 ntpd[23456]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T11:49:29.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:29 ntpd[23456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T11:49:29.841 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:29 ntpd[23456]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T11:49:29.842 INFO:teuthology.orchestra.run.smithi050.stdout:28 Nov 11:49:29 ntpd[23456]: ntpd: time slew +0.000280 s 2023-11-28T11:49:29.842 INFO:teuthology.orchestra.run.smithi050.stdout:ntpd: time slew +0.000280s 2023-11-28T11:49:29.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:29 ntpd[23456]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T11:49:29.842 INFO:teuthology.orchestra.run.smithi050.stderr:28 Nov 11:49:29 ntpd[23456]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T11:49:29.912 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T11:49:29.912 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2023-11-28T11:49:29.912 INFO:teuthology.orchestra.run.smithi050.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T11:49:29.912 INFO:teuthology.orchestra.run.smithi050.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T11:49:29.912 INFO:teuthology.orchestra.run.smithi050.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T11:49:29.912 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-28T11:49:29.913 INFO:teuthology.run_tasks:Running task install... 2023-11-28T11:49:29.922 DEBUG:teuthology.task.install:project ceph 2023-11-28T11:49:29.922 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}} 2023-11-28T11:49:29.922 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'} 2023-11-28T11:49:29.922 INFO:teuthology.task.install:Using flavor: default 2023-11-28T11:49:29.929 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-28T11:49:29.929 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-28T11:49:29.929 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-key list | grep Ceph 2023-11-28T11:49:29.930 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-key list | grep Ceph 2023-11-28T11:49:30.028 INFO:teuthology.orchestra.run.smithi192.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-11-28T11:49:30.059 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-11-28T11:49:30.085 INFO:teuthology.orchestra.run.smithi192.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T11:49:30.086 INFO:teuthology.orchestra.run.smithi192.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T11:49:30.087 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T11:49:30.087 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T11:49:30.087 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T11:49:30.119 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T11:49:30.120 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T11:49:30.120 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T11:49:30.121 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T11:49:30.121 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T11:49:30.238 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default/ 2023-11-28T11:49:30.238 INFO:teuthology.task.install.deb:Package version is 18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:49:30.393 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default/ 2023-11-28T11:49:30.393 INFO:teuthology.task.install.deb:Package version is 18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:49:30.508 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:49:30.509 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T11:49:30.525 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get update 2023-11-28T11:49:30.615 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:49:30.615 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T11:49:30.631 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2023-11-28T11:49:30.669 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-28T11:49:30.671 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-28T11:49:30.680 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-28T11:49:30.701 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-28T11:49:30.744 INFO:teuthology.orchestra.run.smithi192.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal InRelease 2023-11-28T11:49:30.769 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-28T11:49:30.769 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-28T11:49:30.774 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-28T11:49:30.786 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-11-28T11:49:30.791 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-28T11:49:30.809 INFO:teuthology.orchestra.run.smithi192.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal Release.gpg 2023-11-28T11:49:30.833 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-11-28T11:49:30.834 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal InRelease 2023-11-28T11:49:30.862 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-11-28T11:49:30.880 INFO:teuthology.orchestra.run.smithi192.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main i386 Packages [3,418 B] 2023-11-28T11:49:30.881 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal Release.gpg 2023-11-28T11:49:30.903 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main i386 Packages [3,418 B] 2023-11-28T11:49:30.944 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-11-28T11:49:31.334 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 28.4 kB in 1s (44.2 kB/s) 2023-11-28T11:49:31.440 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 28.4 kB in 1s (44.1 kB/s) 2023-11-28T11:49:32.397 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-11-28T11:49:32.421 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-2697-g2f5f6028-1focal cephadm=18.0.0-2697-g2f5f6028-1focal ceph-mds=18.0.0-2697-g2f5f6028-1focal ceph-mgr=18.0.0-2697-g2f5f6028-1focal ceph-common=18.0.0-2697-g2f5f6028-1focal ceph-fuse=18.0.0-2697-g2f5f6028-1focal ceph-test=18.0.0-2697-g2f5f6028-1focal ceph-volume=18.0.0-2697-g2f5f6028-1focal radosgw=18.0.0-2697-g2f5f6028-1focal python3-rados=18.0.0-2697-g2f5f6028-1focal python3-rgw=18.0.0-2697-g2f5f6028-1focal python3-cephfs=18.0.0-2697-g2f5f6028-1focal python3-rbd=18.0.0-2697-g2f5f6028-1focal libcephfs2=18.0.0-2697-g2f5f6028-1focal libcephfs-dev=18.0.0-2697-g2f5f6028-1focal librados2=18.0.0-2697-g2f5f6028-1focal librbd1=18.0.0-2697-g2f5f6028-1focal rbd-fuse=18.0.0-2697-g2f5f6028-1focal python3-cephfs=18.0.0-2697-g2f5f6028-1focal cephfs-shell=18.0.0-2697-g2f5f6028-1focal cephfs-top=18.0.0-2697-g2f5f6028-1focal cephfs-mirror=18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:49:32.489 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-11-28T11:49:32.538 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2023-11-28T11:49:32.564 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-2697-g2f5f6028-1focal cephadm=18.0.0-2697-g2f5f6028-1focal ceph-mds=18.0.0-2697-g2f5f6028-1focal ceph-mgr=18.0.0-2697-g2f5f6028-1focal ceph-common=18.0.0-2697-g2f5f6028-1focal ceph-fuse=18.0.0-2697-g2f5f6028-1focal ceph-test=18.0.0-2697-g2f5f6028-1focal ceph-volume=18.0.0-2697-g2f5f6028-1focal radosgw=18.0.0-2697-g2f5f6028-1focal python3-rados=18.0.0-2697-g2f5f6028-1focal python3-rgw=18.0.0-2697-g2f5f6028-1focal python3-cephfs=18.0.0-2697-g2f5f6028-1focal python3-rbd=18.0.0-2697-g2f5f6028-1focal libcephfs2=18.0.0-2697-g2f5f6028-1focal libcephfs-dev=18.0.0-2697-g2f5f6028-1focal librados2=18.0.0-2697-g2f5f6028-1focal librbd1=18.0.0-2697-g2f5f6028-1focal rbd-fuse=18.0.0-2697-g2f5f6028-1focal python3-cephfs=18.0.0-2697-g2f5f6028-1focal cephfs-shell=18.0.0-2697-g2f5f6028-1focal cephfs-top=18.0.0-2697-g2f5f6028-1focal cephfs-mirror=18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:49:32.635 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2023-11-28T11:49:32.690 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2023-11-28T11:49:32.691 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2023-11-28T11:49:32.822 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2023-11-28T11:49:32.823 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2023-11-28T11:49:32.873 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T11:49:32.874 INFO:teuthology.orchestra.run.smithi192.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-28T11:49:32.874 INFO:teuthology.orchestra.run.smithi192.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T11:49:32.875 INFO:teuthology.orchestra.run.smithi192.stdout:The following additional packages will be installed: 2023-11-28T11:49:32.875 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T11:49:32.875 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-11-28T11:49:32.875 INFO:teuthology.orchestra.run.smithi192.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-11-28T11:49:32.875 INFO:teuthology.orchestra.run.smithi192.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-11-28T11:49:32.875 INFO:teuthology.orchestra.run.smithi192.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-11-28T11:49:32.876 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-11-28T11:49:32.876 INFO:teuthology.orchestra.run.smithi192.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-28T11:49:32.876 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-28T11:49:32.876 INFO:teuthology.orchestra.run.smithi192.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-28T11:49:32.876 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-28T11:49:32.876 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-11-28T11:49:32.876 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-11-28T11:49:32.876 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-11-28T11:49:32.876 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-11-28T11:49:32.876 INFO:teuthology.orchestra.run.smithi192.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T11:49:32.876 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-28T11:49:32.877 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T11:49:32.877 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-11-28T11:49:32.877 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-28T11:49:32.877 INFO:teuthology.orchestra.run.smithi192.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-28T11:49:32.877 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-28T11:49:32.877 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-28T11:49:32.877 INFO:teuthology.orchestra.run.smithi192.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-28T11:49:32.877 INFO:teuthology.orchestra.run.smithi192.stdout:Suggested packages: 2023-11-28T11:49:32.878 INFO:teuthology.orchestra.run.smithi192.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-11-28T11:49:32.878 INFO:teuthology.orchestra.run.smithi192.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-11-28T11:49:32.878 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-11-28T11:49:32.878 INFO:teuthology.orchestra.run.smithi192.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-11-28T11:49:32.878 INFO:teuthology.orchestra.run.smithi192.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-11-28T11:49:32.878 INFO:teuthology.orchestra.run.smithi192.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-11-28T11:49:32.878 INFO:teuthology.orchestra.run.smithi192.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-11-28T11:49:32.878 INFO:teuthology.orchestra.run.smithi192.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T11:49:32.878 INFO:teuthology.orchestra.run.smithi192.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-11-28T11:49:32.878 INFO:teuthology.orchestra.run.smithi192.stdout:Recommended packages: 2023-11-28T11:49:32.878 INFO:teuthology.orchestra.run.smithi192.stdout: btrfs-tools 2023-11-28T11:49:32.996 INFO:teuthology.orchestra.run.smithi192.stdout:The following NEW packages will be installed: 2023-11-28T11:49:32.996 INFO:teuthology.orchestra.run.smithi192.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T11:49:32.996 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T11:49:32.997 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T11:49:32.997 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-11-28T11:49:32.997 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-11-28T11:49:32.997 INFO:teuthology.orchestra.run.smithi192.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-11-28T11:49:32.997 INFO:teuthology.orchestra.run.smithi192.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-11-28T11:49:32.998 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-11-28T11:49:32.998 INFO:teuthology.orchestra.run.smithi192.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-28T11:49:32.998 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-28T11:49:32.998 INFO:teuthology.orchestra.run.smithi192.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-28T11:49:32.998 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-11-28T11:49:32.998 INFO:teuthology.orchestra.run.smithi192.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-11-28T11:49:32.999 INFO:teuthology.orchestra.run.smithi192.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-11-28T11:49:32.999 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-11-28T11:49:32.999 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-11-28T11:49:32.999 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-11-28T11:49:32.999 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-11-28T11:49:32.999 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-11-28T11:49:32.999 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-11-28T11:49:32.999 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T11:49:32.999 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-28T11:49:32.999 INFO:teuthology.orchestra.run.smithi192.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-28T11:49:32.999 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-28T11:49:32.999 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-28T11:49:32.999 INFO:teuthology.orchestra.run.smithi192.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-11-28T11:49:33.000 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages will be upgraded: 2023-11-28T11:49:33.000 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 librbd1 2023-11-28T11:49:33.006 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T11:49:33.008 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-28T11:49:33.008 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T11:49:33.008 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2023-11-28T11:49:33.008 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T11:49:33.008 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-11-28T11:49:33.008 INFO:teuthology.orchestra.run.smithi050.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-11-28T11:49:33.008 INFO:teuthology.orchestra.run.smithi050.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-11-28T11:49:33.008 INFO:teuthology.orchestra.run.smithi050.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-11-28T11:49:33.010 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-11-28T11:49:33.010 INFO:teuthology.orchestra.run.smithi050.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-28T11:49:33.010 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-28T11:49:33.010 INFO:teuthology.orchestra.run.smithi050.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-28T11:49:33.010 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-28T11:49:33.011 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-11-28T11:49:33.011 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-11-28T11:49:33.011 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-11-28T11:49:33.011 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-11-28T11:49:33.011 INFO:teuthology.orchestra.run.smithi050.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T11:49:33.011 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-28T11:49:33.011 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T11:49:33.011 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-11-28T11:49:33.011 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-28T11:49:33.011 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-28T11:49:33.011 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-28T11:49:33.011 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-28T11:49:33.011 INFO:teuthology.orchestra.run.smithi050.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-28T11:49:33.012 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2023-11-28T11:49:33.012 INFO:teuthology.orchestra.run.smithi050.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-11-28T11:49:33.012 INFO:teuthology.orchestra.run.smithi050.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-11-28T11:49:33.012 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-11-28T11:49:33.012 INFO:teuthology.orchestra.run.smithi050.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-11-28T11:49:33.012 INFO:teuthology.orchestra.run.smithi050.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-11-28T11:49:33.012 INFO:teuthology.orchestra.run.smithi050.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-11-28T11:49:33.012 INFO:teuthology.orchestra.run.smithi050.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-11-28T11:49:33.012 INFO:teuthology.orchestra.run.smithi050.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T11:49:33.012 INFO:teuthology.orchestra.run.smithi050.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-11-28T11:49:33.012 INFO:teuthology.orchestra.run.smithi050.stdout:Recommended packages: 2023-11-28T11:49:33.012 INFO:teuthology.orchestra.run.smithi050.stdout: btrfs-tools 2023-11-28T11:49:33.064 INFO:teuthology.orchestra.run.smithi192.stdout:2 upgraded, 116 newly installed, 0 to remove and 257 not upgraded. 2023-11-28T11:49:33.065 INFO:teuthology.orchestra.run.smithi192.stdout:Need to get 207 MB of archives. 2023-11-28T11:49:33.065 INFO:teuthology.orchestra.run.smithi192.stdout:After this operation, 1,026 MB of additional disk space will be used. 2023-11-28T11:49:33.065 INFO:teuthology.orchestra.run.smithi192.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-11-28T11:49:33.083 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-11-28T11:49:33.091 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-11-28T11:49:33.117 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-11-28T11:49:33.140 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2023-11-28T11:49:33.140 INFO:teuthology.orchestra.run.smithi050.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T11:49:33.141 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T11:49:33.141 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T11:49:33.141 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-11-28T11:49:33.141 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-11-28T11:49:33.141 INFO:teuthology.orchestra.run.smithi050.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-11-28T11:49:33.141 INFO:teuthology.orchestra.run.smithi050.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-11-28T11:49:33.143 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-11-28T11:49:33.143 INFO:teuthology.orchestra.run.smithi050.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-28T11:49:33.143 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-28T11:49:33.143 INFO:teuthology.orchestra.run.smithi050.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-28T11:49:33.143 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-11-28T11:49:33.143 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-11-28T11:49:33.143 INFO:teuthology.orchestra.run.smithi050.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-11-28T11:49:33.143 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-11-28T11:49:33.143 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-11-28T11:49:33.144 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-11-28T11:49:33.144 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-11-28T11:49:33.144 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-11-28T11:49:33.144 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-11-28T11:49:33.144 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T11:49:33.144 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-28T11:49:33.144 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-28T11:49:33.144 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-28T11:49:33.144 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-28T11:49:33.144 INFO:teuthology.orchestra.run.smithi050.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-11-28T11:49:33.144 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages will be upgraded: 2023-11-28T11:49:33.145 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 librbd1 2023-11-28T11:49:33.146 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-11-28T11:49:33.150 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-11-28T11:49:33.163 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-11-28T11:49:33.205 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-11-28T11:49:33.207 INFO:teuthology.orchestra.run.smithi192.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-11-28T11:49:33.213 INFO:teuthology.orchestra.run.smithi192.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-11-28T11:49:33.215 INFO:teuthology.orchestra.run.smithi192.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-11-28T11:49:33.215 INFO:teuthology.orchestra.run.smithi192.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-11-28T11:49:33.216 INFO:teuthology.orchestra.run.smithi192.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-11-28T11:49:33.217 INFO:teuthology.orchestra.run.smithi192.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-11-28T11:49:33.220 INFO:teuthology.orchestra.run.smithi192.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-11-28T11:49:33.220 INFO:teuthology.orchestra.run.smithi192.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-11-28T11:49:33.224 INFO:teuthology.orchestra.run.smithi192.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-11-28T11:49:33.241 INFO:teuthology.orchestra.run.smithi192.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-11-28T11:49:33.241 INFO:teuthology.orchestra.run.smithi192.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-11-28T11:49:33.242 INFO:teuthology.orchestra.run.smithi192.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-11-28T11:49:33.243 INFO:teuthology.orchestra.run.smithi192.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T11:49:33.243 INFO:teuthology.orchestra.run.smithi192.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-11-28T11:49:33.244 INFO:teuthology.orchestra.run.smithi192.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-11-28T11:49:33.245 INFO:teuthology.orchestra.run.smithi192.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-11-28T11:49:33.246 INFO:teuthology.orchestra.run.smithi192.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-11-28T11:49:33.247 INFO:teuthology.orchestra.run.smithi192.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-11-28T11:49:33.260 INFO:teuthology.orchestra.run.smithi192.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-11-28T11:49:33.261 INFO:teuthology.orchestra.run.smithi192.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-11-28T11:49:33.273 INFO:teuthology.orchestra.run.smithi192.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-2697-g2f5f6028-1focal [3,431 kB] 2023-11-28T11:49:33.278 INFO:teuthology.orchestra.run.smithi192.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-11-28T11:49:33.279 INFO:teuthology.orchestra.run.smithi192.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-11-28T11:49:33.279 INFO:teuthology.orchestra.run.smithi192.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-11-28T11:49:33.280 INFO:teuthology.orchestra.run.smithi192.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-11-28T11:49:33.281 INFO:teuthology.orchestra.run.smithi192.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-11-28T11:49:33.283 INFO:teuthology.orchestra.run.smithi192.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-11-28T11:49:33.286 INFO:teuthology.orchestra.run.smithi192.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-11-28T11:49:33.286 INFO:teuthology.orchestra.run.smithi192.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-11-28T11:49:33.297 INFO:teuthology.orchestra.run.smithi192.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-11-28T11:49:33.298 INFO:teuthology.orchestra.run.smithi192.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-11-28T11:49:33.313 INFO:teuthology.orchestra.run.smithi192.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-11-28T11:49:33.314 INFO:teuthology.orchestra.run.smithi192.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-11-28T11:49:33.315 INFO:teuthology.orchestra.run.smithi192.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-11-28T11:49:33.316 INFO:teuthology.orchestra.run.smithi192.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-11-28T11:49:33.317 INFO:teuthology.orchestra.run.smithi192.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-11-28T11:49:33.317 INFO:teuthology.orchestra.run.smithi192.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-11-28T11:49:33.318 INFO:teuthology.orchestra.run.smithi192.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-11-28T11:49:33.321 INFO:teuthology.orchestra.run.smithi192.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T11:49:33.331 INFO:teuthology.orchestra.run.smithi192.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-11-28T11:49:33.333 INFO:teuthology.orchestra.run.smithi192.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-11-28T11:49:33.336 INFO:teuthology.orchestra.run.smithi050.stdout:2 upgraded, 116 newly installed, 0 to remove and 257 not upgraded. 2023-11-28T11:49:33.337 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 207 MB of archives. 2023-11-28T11:49:33.337 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 1,026 MB of additional disk space will be used. 2023-11-28T11:49:33.337 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-11-28T11:49:33.349 INFO:teuthology.orchestra.run.smithi192.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-11-28T11:49:33.350 INFO:teuthology.orchestra.run.smithi192.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-11-28T11:49:33.351 INFO:teuthology.orchestra.run.smithi192.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-11-28T11:49:33.352 INFO:teuthology.orchestra.run.smithi192.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-11-28T11:49:33.372 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-2697-g2f5f6028-1focal [3,431 kB] 2023-11-28T11:49:33.420 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-11-28T11:49:33.437 INFO:teuthology.orchestra.run.smithi192.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-11-28T11:49:33.452 INFO:teuthology.orchestra.run.smithi192.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-11-28T11:49:33.454 INFO:teuthology.orchestra.run.smithi192.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-11-28T11:49:33.454 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-11-28T11:49:33.517 INFO:teuthology.orchestra.run.smithi192.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-11-28T11:49:33.517 INFO:teuthology.orchestra.run.smithi192.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-11-28T11:49:33.518 INFO:teuthology.orchestra.run.smithi192.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-11-28T11:49:33.519 INFO:teuthology.orchestra.run.smithi192.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-11-28T11:49:33.519 INFO:teuthology.orchestra.run.smithi192.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-11-28T11:49:33.520 INFO:teuthology.orchestra.run.smithi192.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-11-28T11:49:33.520 INFO:teuthology.orchestra.run.smithi192.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-11-28T11:49:33.522 INFO:teuthology.orchestra.run.smithi192.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-11-28T11:49:33.522 INFO:teuthology.orchestra.run.smithi192.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-11-28T11:49:33.534 INFO:teuthology.orchestra.run.smithi192.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-11-28T11:49:33.536 INFO:teuthology.orchestra.run.smithi192.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-11-28T11:49:33.551 INFO:teuthology.orchestra.run.smithi192.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-11-28T11:49:33.554 INFO:teuthology.orchestra.run.smithi192.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-11-28T11:49:33.555 INFO:teuthology.orchestra.run.smithi192.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-11-28T11:49:33.559 INFO:teuthology.orchestra.run.smithi192.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-11-28T11:49:33.563 INFO:teuthology.orchestra.run.smithi192.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-11-28T11:49:33.563 INFO:teuthology.orchestra.run.smithi192.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-11-28T11:49:33.578 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-11-28T11:49:33.578 INFO:teuthology.orchestra.run.smithi192.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-11-28T11:49:33.580 INFO:teuthology.orchestra.run.smithi192.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-11-28T11:49:33.582 INFO:teuthology.orchestra.run.smithi192.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-11-28T11:49:33.616 INFO:teuthology.orchestra.run.smithi192.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-2697-g2f5f6028-1focal [3,982 kB] 2023-11-28T11:49:33.617 INFO:teuthology.orchestra.run.smithi192.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-11-28T11:49:33.618 INFO:teuthology.orchestra.run.smithi192.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-11-28T11:49:33.618 INFO:teuthology.orchestra.run.smithi192.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-11-28T11:49:33.619 INFO:teuthology.orchestra.run.smithi192.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-11-28T11:49:33.631 INFO:teuthology.orchestra.run.smithi192.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T11:49:33.631 INFO:teuthology.orchestra.run.smithi192.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-11-28T11:49:33.632 INFO:teuthology.orchestra.run.smithi192.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-11-28T11:49:33.632 INFO:teuthology.orchestra.run.smithi192.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-11-28T11:49:33.632 INFO:teuthology.orchestra.run.smithi192.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-11-28T11:49:33.716 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-11-28T11:49:33.733 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-11-28T11:49:33.774 INFO:teuthology.orchestra.run.smithi192.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-2697-g2f5f6028-1focal [721 kB] 2023-11-28T11:49:33.795 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-11-28T11:49:33.797 INFO:teuthology.orchestra.run.smithi192.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-2697-g2f5f6028-1focal [376 kB] 2023-11-28T11:49:33.809 INFO:teuthology.orchestra.run.smithi192.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-2697-g2f5f6028-1focal [22.4 kB] 2023-11-28T11:49:33.809 INFO:teuthology.orchestra.run.smithi192.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-2697-g2f5f6028-1focal [184 kB] 2023-11-28T11:49:33.819 INFO:teuthology.orchestra.run.smithi192.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-2697-g2f5f6028-1focal [47.7 kB] 2023-11-28T11:49:33.825 INFO:teuthology.orchestra.run.smithi192.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-2697-g2f5f6028-1focal [353 kB] 2023-11-28T11:49:33.847 INFO:teuthology.orchestra.run.smithi192.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-2697-g2f5f6028-1focal [6,529 kB] 2023-11-28T11:49:33.973 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-2697-g2f5f6028-1focal [3,982 kB] 2023-11-28T11:49:33.993 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-11-28T11:49:34.004 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-11-28T11:49:34.030 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-11-28T11:49:34.039 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-11-28T11:49:34.152 INFO:teuthology.orchestra.run.smithi192.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-2697-g2f5f6028-1focal [103 kB] 2023-11-28T11:49:34.153 INFO:teuthology.orchestra.run.smithi192.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-2697-g2f5f6028-1focal [468 kB] 2023-11-28T11:49:34.156 INFO:teuthology.orchestra.run.smithi192.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-2697-g2f5f6028-1focal [25.0 MB] 2023-11-28T11:49:34.224 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-11-28T11:49:34.327 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-2697-g2f5f6028-1focal [721 kB] 2023-11-28T11:49:34.367 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-2697-g2f5f6028-1focal [376 kB] 2023-11-28T11:49:34.400 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-2697-g2f5f6028-1focal [22.4 kB] 2023-11-28T11:49:34.402 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-2697-g2f5f6028-1focal [184 kB] 2023-11-28T11:49:34.406 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-2697-g2f5f6028-1focal [47.7 kB] 2023-11-28T11:49:34.430 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-2697-g2f5f6028-1focal [353 kB] 2023-11-28T11:49:34.440 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-2697-g2f5f6028-1focal [6,529 kB] 2023-11-28T11:49:34.582 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-11-28T11:49:34.600 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-11-28T11:49:34.778 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-11-28T11:49:34.788 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-11-28T11:49:34.823 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-11-28T11:49:34.829 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-11-28T11:49:34.832 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-11-28T11:49:34.834 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-11-28T11:49:34.843 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T11:49:34.844 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-11-28T11:49:34.906 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-2697-g2f5f6028-1focal [103 kB] 2023-11-28T11:49:34.930 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-2697-g2f5f6028-1focal [468 kB] 2023-11-28T11:49:34.964 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-2697-g2f5f6028-1focal [25.0 MB] 2023-11-28T11:49:35.009 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-11-28T11:49:35.329 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-11-28T11:49:35.349 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-11-28T11:49:35.419 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-11-28T11:49:35.481 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-11-28T11:49:35.489 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-11-28T11:49:35.609 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-11-28T11:49:35.609 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-11-28T11:49:35.613 INFO:teuthology.orchestra.run.smithi050.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-11-28T11:49:35.617 INFO:teuthology.orchestra.run.smithi050.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-11-28T11:49:35.629 INFO:teuthology.orchestra.run.smithi050.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-11-28T11:49:35.815 INFO:teuthology.orchestra.run.smithi050.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-11-28T11:49:36.234 INFO:teuthology.orchestra.run.smithi192.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-2697-g2f5f6028-1focal [10.9 MB] 2023-11-28T11:49:36.250 INFO:teuthology.orchestra.run.smithi050.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-11-28T11:49:36.262 INFO:teuthology.orchestra.run.smithi050.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-11-28T11:49:36.307 INFO:teuthology.orchestra.run.smithi050.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-11-28T11:49:36.350 INFO:teuthology.orchestra.run.smithi050.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-11-28T11:49:36.359 INFO:teuthology.orchestra.run.smithi050.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-11-28T11:49:36.365 INFO:teuthology.orchestra.run.smithi050.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-11-28T11:49:36.374 INFO:teuthology.orchestra.run.smithi050.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-11-28T11:49:36.379 INFO:teuthology.orchestra.run.smithi050.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-11-28T11:49:36.397 INFO:teuthology.orchestra.run.smithi050.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-11-28T11:49:36.398 INFO:teuthology.orchestra.run.smithi050.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-11-28T11:49:36.568 INFO:teuthology.orchestra.run.smithi050.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-11-28T11:49:36.866 INFO:teuthology.orchestra.run.smithi192.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-2697-g2f5f6028-1focal [221 kB] 2023-11-28T11:49:36.870 INFO:teuthology.orchestra.run.smithi192.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-2697-g2f5f6028-1focal [133 kB] 2023-11-28T11:49:36.874 INFO:teuthology.orchestra.run.smithi192.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-2697-g2f5f6028-1focal [1,547 kB] 2023-11-28T11:49:36.886 INFO:teuthology.orchestra.run.smithi192.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-2697-g2f5f6028-1focal [9,378 kB] 2023-11-28T11:49:36.979 INFO:teuthology.orchestra.run.smithi050.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T11:49:36.982 INFO:teuthology.orchestra.run.smithi050.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-11-28T11:49:37.016 INFO:teuthology.orchestra.run.smithi050.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-11-28T11:49:37.067 INFO:teuthology.orchestra.run.smithi050.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-11-28T11:49:37.096 INFO:teuthology.orchestra.run.smithi050.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-11-28T11:49:37.100 INFO:teuthology.orchestra.run.smithi050.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-11-28T11:49:37.110 INFO:teuthology.orchestra.run.smithi050.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-11-28T11:49:37.351 INFO:teuthology.orchestra.run.smithi192.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-2697-g2f5f6028-1focal [31.3 MB] 2023-11-28T11:49:37.633 INFO:teuthology.orchestra.run.smithi050.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-11-28T11:49:37.656 INFO:teuthology.orchestra.run.smithi050.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-11-28T11:49:37.658 INFO:teuthology.orchestra.run.smithi050.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-11-28T11:49:37.892 INFO:teuthology.orchestra.run.smithi050.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-11-28T11:49:37.977 INFO:teuthology.orchestra.run.smithi050.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-11-28T11:49:38.121 INFO:teuthology.orchestra.run.smithi050.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-11-28T11:49:38.188 INFO:teuthology.orchestra.run.smithi050.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-11-28T11:49:38.253 INFO:teuthology.orchestra.run.smithi050.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-11-28T11:49:38.254 INFO:teuthology.orchestra.run.smithi050.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-2697-g2f5f6028-1focal [10.9 MB] 2023-11-28T11:49:38.254 INFO:teuthology.orchestra.run.smithi050.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-11-28T11:49:38.255 INFO:teuthology.orchestra.run.smithi050.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-11-28T11:49:38.303 INFO:teuthology.orchestra.run.smithi050.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-11-28T11:49:38.310 INFO:teuthology.orchestra.run.smithi050.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-11-28T11:49:38.325 INFO:teuthology.orchestra.run.smithi050.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-11-28T11:49:38.405 INFO:teuthology.orchestra.run.smithi050.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-11-28T11:49:38.594 INFO:teuthology.orchestra.run.smithi050.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-11-28T11:49:38.957 INFO:teuthology.orchestra.run.smithi050.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-11-28T11:49:38.982 INFO:teuthology.orchestra.run.smithi050.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-11-28T11:49:39.133 INFO:teuthology.orchestra.run.smithi050.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-11-28T11:49:39.187 INFO:teuthology.orchestra.run.smithi050.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-11-28T11:49:39.191 INFO:teuthology.orchestra.run.smithi050.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-11-28T11:49:39.300 INFO:teuthology.orchestra.run.smithi192.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-2697-g2f5f6028-1focal [3,812 B] 2023-11-28T11:49:39.301 INFO:teuthology.orchestra.run.smithi192.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-2697-g2f5f6028-1focal [831 kB] 2023-11-28T11:49:39.316 INFO:teuthology.orchestra.run.smithi192.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-2697-g2f5f6028-1focal [2,284 kB] 2023-11-28T11:49:39.358 INFO:teuthology.orchestra.run.smithi050.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-11-28T11:49:39.368 INFO:teuthology.orchestra.run.smithi050.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-11-28T11:49:39.377 INFO:teuthology.orchestra.run.smithi050.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-11-28T11:49:39.382 INFO:teuthology.orchestra.run.smithi192.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-2697-g2f5f6028-1focal [96.8 kB] 2023-11-28T11:49:39.384 INFO:teuthology.orchestra.run.smithi192.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-2697-g2f5f6028-1focal [117 kB] 2023-11-28T11:49:39.386 INFO:teuthology.orchestra.run.smithi192.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-2697-g2f5f6028-1focal [1,795 kB] 2023-11-28T11:49:39.461 INFO:teuthology.orchestra.run.smithi050.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-2697-g2f5f6028-1focal [221 kB] 2023-11-28T11:49:39.466 INFO:teuthology.orchestra.run.smithi050.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-2697-g2f5f6028-1focal [133 kB] 2023-11-28T11:49:39.467 INFO:teuthology.orchestra.run.smithi192.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-2697-g2f5f6028-1focal [7,878 kB] 2023-11-28T11:49:39.497 INFO:teuthology.orchestra.run.smithi050.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-2697-g2f5f6028-1focal [1,547 kB] 2023-11-28T11:49:39.531 INFO:teuthology.orchestra.run.smithi050.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-11-28T11:49:39.533 INFO:teuthology.orchestra.run.smithi050.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-11-28T11:49:39.646 INFO:teuthology.orchestra.run.smithi050.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-2697-g2f5f6028-1focal [9,378 kB] 2023-11-28T11:49:39.697 INFO:teuthology.orchestra.run.smithi050.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-11-28T11:49:39.857 INFO:teuthology.orchestra.run.smithi192.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-2697-g2f5f6028-1focal [3,936 B] 2023-11-28T11:49:39.857 INFO:teuthology.orchestra.run.smithi192.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-2697-g2f5f6028-1focal [49.9 MB] 2023-11-28T11:49:40.014 INFO:teuthology.orchestra.run.smithi050.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-11-28T11:49:40.380 INFO:teuthology.orchestra.run.smithi050.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T11:49:40.384 INFO:teuthology.orchestra.run.smithi050.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-11-28T11:49:40.396 INFO:teuthology.orchestra.run.smithi050.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-11-28T11:49:40.398 INFO:teuthology.orchestra.run.smithi050.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-11-28T11:49:40.402 INFO:teuthology.orchestra.run.smithi050.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-11-28T11:49:40.599 INFO:teuthology.orchestra.run.smithi050.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-2697-g2f5f6028-1focal [31.3 MB] 2023-11-28T11:49:43.008 INFO:teuthology.orchestra.run.smithi192.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-2697-g2f5f6028-1focal [225 kB] 2023-11-28T11:49:43.013 INFO:teuthology.orchestra.run.smithi192.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-2697-g2f5f6028-1focal [253 kB] 2023-11-28T11:49:43.018 INFO:teuthology.orchestra.run.smithi192.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-2697-g2f5f6028-1focal [23.3 kB] 2023-11-28T11:49:43.019 INFO:teuthology.orchestra.run.smithi192.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-2697-g2f5f6028-1focal [13.0 kB] 2023-11-28T11:49:43.019 INFO:teuthology.orchestra.run.smithi192.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-2697-g2f5f6028-1focal [27.4 kB] 2023-11-28T11:49:43.020 INFO:teuthology.orchestra.run.smithi192.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-2697-g2f5f6028-1focal [13.3 MB] 2023-11-28T11:49:43.759 INFO:teuthology.orchestra.run.smithi050.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-2697-g2f5f6028-1focal [3,812 B] 2023-11-28T11:49:43.759 INFO:teuthology.orchestra.run.smithi050.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-2697-g2f5f6028-1focal [831 kB] 2023-11-28T11:49:43.782 INFO:teuthology.orchestra.run.smithi050.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-2697-g2f5f6028-1focal [2,284 kB] 2023-11-28T11:49:43.835 INFO:teuthology.orchestra.run.smithi192.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-2697-g2f5f6028-1focal [97.4 kB] 2023-11-28T11:49:44.006 INFO:teuthology.orchestra.run.smithi050.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-2697-g2f5f6028-1focal [96.8 kB] 2023-11-28T11:49:44.009 INFO:teuthology.orchestra.run.smithi050.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-2697-g2f5f6028-1focal [117 kB] 2023-11-28T11:49:44.015 INFO:teuthology.orchestra.run.smithi050.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-2697-g2f5f6028-1focal [1,795 kB] 2023-11-28T11:49:44.203 INFO:teuthology.orchestra.run.smithi050.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-2697-g2f5f6028-1focal [7,878 kB] 2023-11-28T11:49:44.476 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 207 MB in 11s (19.1 MB/s) 2023-11-28T11:49:44.600 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T11:49:44.657 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141728 files and directories currently installed.) 2023-11-28T11:49:44.662 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-11-28T11:49:44.706 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-11-28T11:49:45.034 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T11:49:45.050 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-11-28T11:49:45.092 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-28T11:49:45.242 INFO:teuthology.orchestra.run.smithi050.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-2697-g2f5f6028-1focal [3,936 B] 2023-11-28T11:49:45.247 INFO:teuthology.orchestra.run.smithi050.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-2697-g2f5f6028-1focal [49.9 MB] 2023-11-28T11:49:45.370 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T11:49:45.387 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-11-28T11:49:45.428 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-11-28T11:49:45.807 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-11-28T11:49:45.823 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-11-28T11:49:45.907 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-28T11:49:46.285 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T11:49:46.302 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-11-28T11:49:46.343 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-28T11:49:46.688 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T11:49:46.705 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-11-28T11:49:46.746 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-28T11:49:47.233 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T11:49:47.250 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T11:49:47.301 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:49:47.786 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T11:49:47.803 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T11:49:47.844 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:49:48.197 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T11:49:48.214 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T11:49:48.255 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:49:48.659 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-11-28T11:49:48.677 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-11-28T11:49:48.718 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-28T11:49:49.095 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../010-librbd1_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:49:49.221 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librbd1 (18.0.0-2697-g2f5f6028-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-28T11:49:49.936 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../011-librados2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:49:50.150 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librados2 (18.0.0-2697-g2f5f6028-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-28T11:49:50.392 INFO:teuthology.orchestra.run.smithi050.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-2697-g2f5f6028-1focal [225 kB] 2023-11-28T11:49:50.397 INFO:teuthology.orchestra.run.smithi050.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-2697-g2f5f6028-1focal [253 kB] 2023-11-28T11:49:50.402 INFO:teuthology.orchestra.run.smithi050.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-2697-g2f5f6028-1focal [23.3 kB] 2023-11-28T11:49:50.403 INFO:teuthology.orchestra.run.smithi050.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-2697-g2f5f6028-1focal [13.0 kB] 2023-11-28T11:49:50.403 INFO:teuthology.orchestra.run.smithi050.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-2697-g2f5f6028-1focal [27.4 kB] 2023-11-28T11:49:50.404 INFO:teuthology.orchestra.run.smithi050.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-2697-g2f5f6028-1focal [13.3 MB] 2023-11-28T11:49:50.897 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T11:49:50.914 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:49:50.954 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libcephfs2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:49:51.169 INFO:teuthology.orchestra.run.smithi050.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-2697-g2f5f6028-1focal [97.4 kB] 2023-11-28T11:49:51.301 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rados. 2023-11-28T11:49:51.314 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../013-python3-rados_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:49:51.357 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rados (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:49:51.693 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T11:49:51.712 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:49:51.751 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-ceph-argparse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:49:51.821 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 207 MB in 18s (11.5 MB/s) 2023-11-28T11:49:51.979 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T11:49:52.003 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T11:49:52.019 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:49:52.035 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141728 files and directories currently installed.) 2023-11-28T11:49:52.041 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-11-28T11:49:52.061 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cephfs (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:49:52.068 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-11-28T11:49:52.390 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T11:49:52.394 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T11:49:52.406 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:49:52.411 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-11-28T11:49:52.448 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:49:52.452 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-28T11:49:52.755 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T11:49:52.772 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-11-28T11:49:52.775 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T11:49:52.791 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-11-28T11:49:52.813 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-11-28T11:49:52.834 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-11-28T11:49:53.086 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T11:49:53.104 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:49:53.146 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rbd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:49:53.169 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-11-28T11:49:53.185 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-11-28T11:49:53.278 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-28T11:49:53.514 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-11-28T11:49:53.530 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-11-28T11:49:53.572 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-28T11:49:53.648 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T11:49:53.666 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-11-28T11:49:53.706 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-28T11:49:53.925 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-11-28T11:49:53.942 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-11-28T11:49:53.983 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-11-28T11:49:53.994 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T11:49:54.010 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-11-28T11:49:54.042 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-28T11:49:54.345 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T11:49:54.362 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-11-28T11:49:54.403 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-28T11:49:54.529 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T11:49:54.545 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T11:49:54.598 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:49:54.789 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package librgw2. 2023-11-28T11:49:54.808 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../022-librgw2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:49:54.847 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librgw2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:49:55.124 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T11:49:55.140 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T11:49:55.182 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:49:55.536 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T11:49:55.553 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-28T11:49:55.585 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:49:55.725 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T11:49:55.745 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:49:55.774 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:49:55.972 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-11-28T11:49:55.988 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-11-28T11:49:56.030 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-28T11:49:56.119 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liboath0. 2023-11-28T11:49:56.134 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-11-28T11:49:56.177 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-11-28T11:49:56.386 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../010-librbd1_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:49:56.497 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T11:49:56.508 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librbd1 (18.0.0-2697-g2f5f6028-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-28T11:49:56.512 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:49:56.555 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libradosstriper1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:49:57.025 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-common. 2023-11-28T11:49:57.041 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../026-ceph-common_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:49:57.083 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:49:57.170 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../011-librados2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:49:57.321 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librados2 (18.0.0-2697-g2f5f6028-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-28T11:49:58.009 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T11:49:58.026 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:49:58.067 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:49:58.370 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rados. 2023-11-28T11:49:58.389 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../013-python3-rados_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:49:58.428 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rados (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:49:58.806 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T11:49:58.823 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:49:58.864 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-argparse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:49:59.125 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T11:49:59.145 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:49:59.183 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cephfs (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:49:59.486 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T11:49:59.505 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:49:59.530 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-base. 2023-11-28T11:49:59.544 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:49:59.546 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../027-ceph-base_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:49:59.598 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-base (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:49:59.897 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T11:49:59.913 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-11-28T11:49:59.955 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-11-28T11:50:00.208 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T11:50:00.226 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:00.266 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rbd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:00.653 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-11-28T11:50:00.668 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-11-28T11:50:00.710 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-28T11:50:01.001 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T11:50:01.020 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-11-28T11:50:01.059 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-11-28T11:50:01.097 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-11-28T11:50:01.115 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-11-28T11:50:01.155 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-11-28T11:50:01.422 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T11:50:01.440 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-11-28T11:50:01.475 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T11:50:01.478 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-11-28T11:50:01.494 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-11-28T11:50:01.533 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-28T11:50:01.798 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T11:50:01.814 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-11-28T11:50:01.878 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librgw2. 2023-11-28T11:50:01.879 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-11-28T11:50:01.897 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../022-librgw2_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:01.936 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librgw2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:02.184 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T11:50:02.202 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-11-28T11:50:02.242 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-11-28T11:50:02.528 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-mako. 2023-11-28T11:50:03.099 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T11:50:03.099 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:03.099 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:03.099 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-11-28T11:50:03.099 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-28T11:50:03.099 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T11:50:03.099 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T11:50:03.100 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T11:50:03.175 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liboath0. 2023-11-28T11:50:03.191 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-11-28T11:50:03.233 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-11-28T11:50:03.309 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T11:50:03.328 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-11-28T11:50:03.367 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-11-28T11:50:03.670 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-webob. 2023-11-28T11:50:03.686 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-11-28T11:50:03.728 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-11-28T11:50:04.090 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-soupsieve. 2023-11-28T11:50:04.106 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-11-28T11:50:04.148 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-28T11:50:04.370 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T11:50:04.387 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:04.428 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libradosstriper1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:04.451 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-bs4. 2023-11-28T11:50:04.469 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-11-28T11:50:04.509 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-11-28T11:50:04.856 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-common. 2023-11-28T11:50:04.875 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../026-ceph-common_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:04.895 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T11:50:04.905 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:04.913 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-11-28T11:50:04.956 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-28T11:50:05.265 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T11:50:05.282 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-11-28T11:50:05.323 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-11-28T11:50:06.134 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-paste. 2023-11-28T11:50:06.153 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-11-28T11:50:06.400 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-11-28T11:50:06.720 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T11:50:06.740 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-11-28T11:50:06.780 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-11-28T11:50:07.083 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T11:50:07.101 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-11-28T11:50:07.141 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-11-28T11:50:07.403 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-base. 2023-11-28T11:50:07.420 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../027-ceph-base_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:07.444 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T11:50:07.462 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-11-28T11:50:07.472 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-base (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:07.502 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-11-28T11:50:07.838 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T11:50:07.854 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-11-28T11:50:07.897 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-11-28T11:50:08.235 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T11:50:08.253 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-11-28T11:50:08.293 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-28T11:50:08.612 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T11:50:08.630 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:50:08.670 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-modules-core (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:08.974 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T11:50:08.991 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-11-28T11:50:08.992 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T11:50:09.008 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:09.032 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-11-28T11:50:09.083 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:09.402 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T11:50:09.412 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cryptography. 2023-11-28T11:50:09.419 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-11-28T11:50:09.427 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-11-28T11:50:09.460 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-11-28T11:50:09.469 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-28T11:50:09.797 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T11:50:09.813 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-11-28T11:50:09.855 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-11-28T11:50:09.856 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T11:50:09.874 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-11-28T11:50:09.914 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-11-28T11:50:10.133 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T11:50:10.150 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-11-28T11:50:10.191 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-11-28T11:50:10.234 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T11:50:10.253 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:10.292 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:10.469 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-mako. 2023-11-28T11:50:10.488 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-11-28T11:50:10.527 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-28T11:50:10.820 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T11:50:10.838 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:10.847 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T11:50:10.866 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T11:50:10.878 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mon (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:10.905 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T11:50:11.233 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T11:50:11.253 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-11-28T11:50:11.291 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-11-28T11:50:11.611 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webob. 2023-11-28T11:50:11.628 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-11-28T11:50:11.669 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-11-28T11:50:11.980 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-soupsieve. 2023-11-28T11:50:11.996 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-11-28T11:50:12.038 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-28T11:50:12.182 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T11:50:12.198 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:12.240 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-osd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:12.358 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-bs4. 2023-11-28T11:50:12.377 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-11-28T11:50:12.416 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-11-28T11:50:12.830 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T11:50:12.846 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-11-28T11:50:12.889 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-28T11:50:13.214 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T11:50:13.231 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-11-28T11:50:13.272 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-11-28T11:50:13.608 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-paste. 2023-11-28T11:50:13.624 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-11-28T11:50:13.666 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-11-28T11:50:13.986 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T11:50:14.003 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-11-28T11:50:14.078 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-11-28T11:50:14.381 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T11:50:14.397 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-11-28T11:50:14.439 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-11-28T11:50:14.750 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T11:50:14.770 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-11-28T11:50:14.800 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-11-28T11:50:15.078 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T11:50:15.098 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-11-28T11:50:15.136 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-11-28T11:50:15.334 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph. 2023-11-28T11:50:15.350 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../053-ceph_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:15.392 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:15.533 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T11:50:15.549 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-11-28T11:50:15.591 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-28T11:50:15.696 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T11:50:15.713 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:15.745 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:15.877 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T11:50:15.896 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:50:15.968 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-modules-core (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:16.156 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T11:50:16.174 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:16.214 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mds (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:16.349 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T11:50:16.365 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:16.406 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:16.759 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephadm. 2023-11-28T11:50:16.760 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cryptography. 2023-11-28T11:50:16.776 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-11-28T11:50:16.777 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../056-cephadm_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:16.817 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:16.818 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-28T11:50:17.162 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T11:50:17.178 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-11-28T11:50:17.180 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T11:50:17.196 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-11-28T11:50:17.219 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-11-28T11:50:17.238 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-11-28T11:50:17.581 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T11:50:17.598 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-11-28T11:50:17.599 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T11:50:17.616 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:17.639 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-11-28T11:50:17.657 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:17.984 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T11:50:18.004 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:50:18.042 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:18.152 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T11:50:18.168 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:18.210 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mon (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:18.387 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T11:50:18.403 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-11-28T11:50:18.461 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-28T11:50:18.765 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-jwt. 2023-11-28T11:50:18.781 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-11-28T11:50:18.814 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-28T11:50:19.142 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-attr. 2023-11-28T11:50:19.161 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2023-11-28T11:50:19.200 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-11-28T11:50:19.506 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T11:50:19.519 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T11:50:19.526 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:19.535 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2023-11-28T11:50:19.577 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-11-28T11:50:19.680 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-osd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:19.905 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-py. 2023-11-28T11:50:19.922 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-11-28T11:50:19.963 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-11-28T11:50:20.291 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-atomicwrites. 2023-11-28T11:50:20.310 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-11-28T11:50:20.349 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-11-28T11:50:20.669 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-packaging. 2023-11-28T11:50:20.688 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2023-11-28T11:50:20.727 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-packaging (20.3-1) ... 2023-11-28T11:50:21.004 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T11:50:21.024 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2023-11-28T11:50:21.062 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-11-28T11:50:21.425 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T11:50:21.444 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T11:50:21.483 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T11:50:21.685 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libjs-underscore. 2023-11-28T11:50:21.702 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-11-28T11:50:21.840 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-28T11:50:22.321 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-11-28T11:50:22.338 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-11-28T11:50:22.379 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-28T11:50:22.708 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-routes. 2023-11-28T11:50:22.723 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2023-11-28T11:50:22.765 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-11-28T11:50:22.834 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph. 2023-11-28T11:50:22.851 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../053-ceph_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:22.893 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:23.110 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T11:50:23.127 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:50:23.168 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-dashboard (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:23.219 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T11:50:23.236 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:23.278 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:23.672 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T11:50:23.688 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-decorator. 2023-11-28T11:50:23.689 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:23.704 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-11-28T11:50:23.731 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mds (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:23.746 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-11-28T11:50:24.040 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-11-28T11:50:24.056 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-11-28T11:50:24.098 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-28T11:50:24.275 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephadm. 2023-11-28T11:50:24.292 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../056-cephadm_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:24.333 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:24.401 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-scipy. 2023-11-28T11:50:24.418 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-11-28T11:50:24.451 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-11-28T11:50:24.653 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T11:50:24.673 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-11-28T11:50:24.703 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-11-28T11:50:25.073 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T11:50:25.092 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-11-28T11:50:25.131 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-11-28T11:50:25.484 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T11:50:25.500 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:50:25.542 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:25.756 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-11-28T11:50:25.773 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-11-28T11:50:25.806 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-28T11:50:25.895 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T11:50:25.912 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-11-28T11:50:25.953 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-28T11:50:26.256 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jwt. 2023-11-28T11:50:26.273 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-11-28T11:50:26.314 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-28T11:50:26.353 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T11:50:26.372 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2023-11-28T11:50:26.409 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-11-28T11:50:26.634 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-attr. 2023-11-28T11:50:26.654 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2023-11-28T11:50:26.692 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-11-28T11:50:26.771 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T11:50:26.790 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-11-28T11:50:26.829 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-28T11:50:27.070 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T11:50:27.088 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2023-11-28T11:50:27.128 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-11-28T11:50:27.414 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-py. 2023-11-28T11:50:27.431 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-11-28T11:50:27.464 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-11-28T11:50:27.604 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T11:50:27.622 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:50:27.662 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:27.801 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-atomicwrites. 2023-11-28T11:50:27.817 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-11-28T11:50:27.858 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-11-28T11:50:28.161 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-packaging. 2023-11-28T11:50:28.179 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2023-11-28T11:50:28.219 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-packaging (20.3-1) ... 2023-11-28T11:50:28.556 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T11:50:28.572 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2023-11-28T11:50:28.614 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-11-28T11:50:28.815 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T11:50:28.834 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2023-11-28T11:50:28.882 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-11-28T11:50:28.951 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T11:50:28.970 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T11:50:29.008 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T11:50:29.270 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjs-underscore. 2023-11-28T11:50:29.290 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-11-28T11:50:29.299 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T11:50:29.315 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-11-28T11:50:29.319 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-28T11:50:29.357 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-11-28T11:50:29.605 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-11-28T11:50:29.622 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-11-28T11:50:29.663 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-28T11:50:29.694 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T11:50:29.713 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-11-28T11:50:29.744 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-28T11:50:29.966 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-routes. 2023-11-28T11:50:29.983 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2023-11-28T11:50:30.024 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-11-28T11:50:30.046 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T11:50:30.064 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2023-11-28T11:50:30.096 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rsa (4.0-3) ... 2023-11-28T11:50:30.361 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T11:50:30.378 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:50:30.399 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T11:50:30.417 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2023-11-28T11:50:30.418 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-dashboard (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:30.457 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-11-28T11:50:30.802 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-blinker. 2023-11-28T11:50:30.819 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-11-28T11:50:30.860 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-28T11:50:30.947 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-decorator. 2023-11-28T11:50:30.964 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-11-28T11:50:31.005 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-11-28T11:50:31.139 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-oauthlib. 2023-11-28T11:50:31.157 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-11-28T11:50:31.188 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-28T11:50:31.308 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-11-28T11:50:31.324 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-11-28T11:50:31.358 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-28T11:50:31.517 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T11:50:31.534 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-11-28T11:50:31.567 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-28T11:50:31.702 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-scipy. 2023-11-28T11:50:31.718 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-11-28T11:50:31.760 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-11-28T11:50:31.870 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T11:50:31.886 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-11-28T11:50:31.928 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-11-28T11:50:32.264 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T11:50:32.282 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-11-28T11:50:32.322 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-11-28T11:50:32.878 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T11:50:32.897 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:50:32.935 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:33.111 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-11-28T11:50:33.128 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-11-28T11:50:33.169 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-28T11:50:33.255 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T11:50:33.271 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2023-11-28T11:50:33.313 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-11-28T11:50:33.658 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T11:50:33.677 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:50:33.698 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T11:50:33.717 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2023-11-28T11:50:33.724 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-28T11:50:33.755 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-11-28T11:50:33.994 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package jq. 2023-11-28T11:50:34.011 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:50:34.052 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-11-28T11:50:34.159 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T11:50:34.176 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-11-28T11:50:34.217 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-28T11:50:34.330 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package socat. 2023-11-28T11:50:34.346 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2023-11-28T11:50:34.387 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking socat (1.7.3.3-2) ... 2023-11-28T11:50:34.691 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T11:50:34.709 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-11-28T11:50:34.740 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-11-28T11:50:34.908 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T11:50:34.924 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:50:34.958 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:35.087 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-test. 2023-11-28T11:50:35.104 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../096-ceph-test_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:35.145 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-test (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:36.086 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T11:50:36.104 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2023-11-28T11:50:36.135 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-11-28T11:50:36.524 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T11:50:36.541 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-11-28T11:50:36.582 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-11-28T11:50:36.895 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T11:50:36.912 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-11-28T11:50:36.953 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-28T11:50:37.258 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T11:50:37.276 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2023-11-28T11:50:37.306 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rsa (4.0-3) ... 2023-11-28T11:50:37.614 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T11:50:37.631 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2023-11-28T11:50:37.688 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-11-28T11:50:38.025 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-blinker. 2023-11-28T11:50:38.043 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-11-28T11:50:38.083 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-28T11:50:38.402 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-oauthlib. 2023-11-28T11:50:38.422 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-11-28T11:50:38.460 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-28T11:50:38.777 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T11:50:38.790 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-11-28T11:50:38.832 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-28T11:50:39.183 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T11:50:39.201 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-11-28T11:50:39.242 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-11-28T11:50:39.425 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T11:50:39.442 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../097-ceph-volume_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:50:39.483 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-volume (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:39.578 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T11:50:39.596 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-11-28T11:50:39.636 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-11-28T11:50:39.838 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T11:50:39.854 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../098-cephfs-mirror_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:39.895 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephfs-mirror (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:40.225 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T11:50:40.245 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:50:40.256 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T11:50:40.272 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2023-11-28T11:50:40.283 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:40.314 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-11-28T11:50:40.602 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T11:50:40.617 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T11:50:40.620 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2023-11-28T11:50:40.637 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../100-cephfs-shell_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:50:40.660 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-11-28T11:50:40.675 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephfs-shell (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:40.929 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T11:50:40.944 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../101-cephfs-top_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:50:40.986 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephfs-top (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:41.047 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T11:50:41.064 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:50:41.105 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-28T11:50:41.271 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package fonts-mathjax. 2023-11-28T11:50:41.291 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-28T11:50:41.329 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-28T11:50:41.408 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package jq. 2023-11-28T11:50:41.427 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:50:41.466 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-11-28T11:50:41.719 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package socat. 2023-11-28T11:50:41.738 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2023-11-28T11:50:41.777 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking socat (1.7.3.3-2) ... 2023-11-28T11:50:41.842 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T11:50:41.858 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../103-libcephfs-dev_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:41.900 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libcephfs-dev (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:42.130 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T11:50:42.147 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-11-28T11:50:42.188 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-11-28T11:50:42.320 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T11:50:42.336 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-11-28T11:50:42.395 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-11-28T11:50:42.534 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-test. 2023-11-28T11:50:42.552 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../096-ceph-test_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:42.592 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-test (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:42.740 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T11:50:42.758 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-11-28T11:50:42.798 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-11-28T11:50:43.170 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libjs-mathjax. 2023-11-28T11:50:43.190 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-28T11:50:43.228 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-28T11:50:44.966 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python-natsort-doc. 2023-11-28T11:50:44.984 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2023-11-28T11:50:45.024 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-11-28T11:50:45.360 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-webencodings. 2023-11-28T11:50:45.376 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-11-28T11:50:45.417 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-28T11:50:45.729 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-html5lib. 2023-11-28T11:50:45.749 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2023-11-28T11:50:45.787 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-11-28T11:50:46.132 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-11-28T11:50:46.150 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-11-28T11:50:46.215 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-28T11:50:46.661 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T11:50:46.681 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T11:50:46.718 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T11:50:47.039 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T11:50:47.055 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-11-28T11:50:47.079 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T11:50:47.097 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-11-28T11:50:47.099 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../097-ceph-volume_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:50:47.137 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-volume (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:47.384 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T11:50:47.402 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-11-28T11:50:47.433 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-28T11:50:47.467 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T11:50:47.487 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../098-cephfs-mirror_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:47.525 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-mirror (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:47.781 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T11:50:47.798 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-11-28T11:50:47.839 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-28T11:50:47.869 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T11:50:47.887 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2023-11-28T11:50:47.929 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-11-28T11:50:48.109 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T11:50:48.127 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-11-28T11:50:48.167 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-28T11:50:48.223 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T11:50:48.243 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../100-cephfs-shell_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:50:48.282 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-shell (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:48.543 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T11:50:48.560 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../101-cephfs-top_18.0.0-2697-g2f5f6028-1focal_all.deb ... 2023-11-28T11:50:48.601 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephfs-top (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:48.821 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package radosgw. 2023-11-28T11:50:48.839 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../116-radosgw_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:48.878 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package fonts-mathjax. 2023-11-28T11:50:48.879 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking radosgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:48.896 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-28T11:50:48.936 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-28T11:50:49.415 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T11:50:49.433 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../103-libcephfs-dev_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:49.498 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs-dev (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:49.893 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T11:50:49.911 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-11-28T11:50:49.969 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-11-28T11:50:50.277 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T11:50:50.294 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:50.314 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T11:50:50.331 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-11-28T11:50:50.335 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking rbd-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:50.372 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-11-28T11:50:50.674 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-attr (19.3.0-2) ... 2023-11-28T11:50:50.949 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-11-28T11:50:51.017 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjs-mathjax. 2023-11-28T11:50:51.037 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-28T11:50:51.067 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-28T11:50:51.078 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-28T11:50:51.229 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-11-28T11:50:51.422 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:51.992 INFO:teuthology.orchestra.run.smithi192.stdout:Adding system user cephadm....done 2023-11-28T11:50:52.145 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-28T11:50:52.254 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-28T11:50:52.615 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T11:50:52.737 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-natsort-doc. 2023-11-28T11:50:52.758 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2023-11-28T11:50:52.803 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-11-28T11:50:53.142 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webencodings. 2023-11-28T11:50:53.149 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-28T11:50:53.160 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-11-28T11:50:53.199 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-28T11:50:53.300 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-11-28T11:50:53.426 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-11-28T11:50:53.536 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-html5lib. 2023-11-28T11:50:53.553 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2023-11-28T11:50:53.594 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-11-28T11:50:53.745 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-11-28T11:50:53.880 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-11-28T11:50:53.897 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-11-28T11:50:53.946 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-28T11:50:54.147 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-28T11:50:54.408 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T11:50:54.425 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T11:50:54.440 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-11-28T11:50:54.466 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T11:50:54.733 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-11-28T11:50:54.795 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T11:50:54.813 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-11-28T11:50:54.854 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-11-28T11:50:55.018 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-28T11:50:55.172 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T11:50:55.191 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-11-28T11:50:55.222 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-28T11:50:55.302 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-28T11:50:55.525 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T11:50:55.544 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-11-28T11:50:55.583 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-28T11:50:55.611 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-ceph-argparse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:55.894 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T11:50:55.896 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-28T11:50:55.912 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-11-28T11:50:56.022 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-11-28T11:50:56.052 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-28T11:50:56.323 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-11-28T11:50:56.608 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-28T11:50:56.748 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package radosgw. 2023-11-28T11:50:56.765 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../116-radosgw_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:56.806 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking radosgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:56.892 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-28T11:50:57.018 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-11-28T11:50:57.378 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-11-28T11:50:57.679 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-11-28T11:50:57.955 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-28T11:50:58.243 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T11:50:58.263 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-2697-g2f5f6028-1focal_amd64.deb ... 2023-11-28T11:50:58.296 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking rbd-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:58.306 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-11-28T11:50:58.596 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-attr (19.3.0-2) ... 2023-11-28T11:50:58.599 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-11-28T11:50:58.886 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-11-28T11:50:58.933 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-11-28T11:50:59.021 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-28T11:50:59.147 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-11-28T11:50:59.210 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-packaging (20.3-1) ... 2023-11-28T11:50:59.360 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:50:59.494 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-11-28T11:50:59.645 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-28T11:50:59.755 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-28T11:50:59.947 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user cephadm....done 2023-11-28T11:51:00.022 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-11-28T11:51:00.108 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-28T11:51:00.234 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-28T11:51:00.416 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-11-28T11:51:00.588 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T11:51:00.717 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-28T11:51:00.914 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-28T11:51:01.040 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-11-28T11:51:01.077 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-28T11:51:01.166 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-11-28T11:51:01.437 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up socat (1.7.3.3-2) ... 2023-11-28T11:51:01.510 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-11-28T11:51:01.563 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:01.873 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:51:01.962 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-28T11:51:02.007 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-11-28T11:51:02.255 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-11-28T11:51:02.359 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-28T11:51:02.501 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-11-28T11:51:02.556 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-11-28T11:51:02.627 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-11-28T11:51:02.849 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-28T11:51:02.937 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-28T11:51:03.167 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-28T11:51:03.246 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:51:03.372 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-28T11:51:03.460 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-argparse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:03.498 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-11-28T11:51:03.794 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-28T11:51:03.834 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-11-28T11:51:03.921 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-11-28T11:51:04.102 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-11-28T11:51:04.214 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-11-28T11:51:04.394 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-28T11:51:04.473 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-28T11:51:04.554 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T11:51:04.782 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-28T11:51:04.830 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-11-28T11:51:04.908 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-11-28T11:51:05.106 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-28T11:51:05.301 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-11-28T11:51:05.440 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-11-28T11:51:05.577 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-11-28T11:51:05.863 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-11-28T11:51:05.912 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-28T11:51:06.118 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-11-28T11:51:06.244 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-28T11:51:06.289 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-11-28T11:51:06.570 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-11-28T11:51:06.599 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-11-28T11:51:06.949 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-11-28T11:51:06.964 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-28T11:51:07.101 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-28T11:51:07.227 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-11-28T11:51:07.242 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-packaging (20.3-1) ... 2023-11-28T11:51:07.551 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-11-28T11:51:07.578 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-28T11:51:07.677 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-28T11:51:07.803 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-28T11:51:07.871 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-11-28T11:51:08.097 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-11-28T11:51:08.515 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-11-28T11:51:08.816 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-28T11:51:09.184 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-28T11:51:09.335 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-28T11:51:09.486 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-11-28T11:51:09.552 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up socat (1.7.3.3-2) ... 2023-11-28T11:51:09.678 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:09.865 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-11-28T11:51:10.031 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:51:10.149 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-11-28T11:51:10.173 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-11-28T11:51:10.458 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:51:10.508 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-28T11:51:10.586 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-11-28T11:51:10.661 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-11-28T11:51:10.784 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-11-28T11:51:10.945 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-28T11:51:11.077 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-28T11:51:11.272 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-11-28T11:51:11.395 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:51:11.530 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-28T11:51:11.639 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-11-28T11:51:11.640 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-28T11:51:11.966 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-11-28T11:51:11.966 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-28T11:51:12.250 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-11-28T11:51:12.543 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-28T11:51:12.669 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T11:51:12.970 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-11-28T11:51:13.040 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-28T11:51:13.166 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-11-28T11:51:13.272 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-28T11:51:13.292 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-11-28T11:51:13.418 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rsa (4.0-3) ... 2023-11-28T11:51:13.556 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-11-28T11:51:13.720 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-28T11:51:13.845 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-11-28T11:51:13.966 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-11-28T11:51:14.141 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-28T11:51:14.242 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-11-28T11:51:14.393 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-28T11:51:14.433 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T11:51:14.719 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-11-28T11:51:14.751 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-11-28T11:51:15.096 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-28T11:51:15.137 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librados2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:15.238 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-28T11:51:15.340 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-11-28T11:51:15.348 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-11-28T11:51:15.466 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librgw2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:15.592 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libsqlite3-mod-ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:15.682 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-28T11:51:15.718 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libcephfs2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:15.869 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-routes (2.4.1-2) ... 2023-11-28T11:51:15.975 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-11-28T11:51:16.170 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libradosstriper1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:16.296 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-11-28T11:51:16.598 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librbd1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:16.724 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-modules-core (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:16.850 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:17.072 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T11:51:17.072 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T11:51:17.506 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-28T11:51:17.526 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libcephfs-dev (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:17.633 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-11-28T11:51:17.652 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rados (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:17.778 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephfs-top (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:17.905 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-11-28T11:51:18.023 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-11-28T11:51:18.371 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-11-28T11:51:18.673 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-28T11:51:18.824 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-11-28T11:51:18.850 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rbd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:18.977 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up rbd-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:19.103 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:19.183 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-28T11:51:19.228 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cephfs (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:19.354 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephfs-shell (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:19.497 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:19.510 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-11-28T11:51:19.920 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-28T11:51:20.024 INFO:teuthology.orchestra.run.smithi192.stdout:Adding group ceph....done 2023-11-28T11:51:20.289 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-28T11:51:20.410 INFO:teuthology.orchestra.run.smithi192.stdout:Adding system user ceph....done 2023-11-28T11:51:20.586 INFO:teuthology.orchestra.run.smithi192.stdout:Setting system user ceph properties....done 2023-11-28T11:51:20.610 INFO:teuthology.orchestra.run.smithi192.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T11:51:20.760 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T11:51:21.065 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T11:51:21.371 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-28T11:51:21.498 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-11-28T11:51:21.540 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephfs-mirror (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:21.666 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-test (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:21.792 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up radosgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:22.040 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-11-28T11:51:22.055 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T11:51:22.055 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T11:51:22.158 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rsa (4.0-3) ... 2023-11-28T11:51:22.442 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-28T11:51:22.568 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-11-28T11:51:22.702 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-base (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:22.911 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-28T11:51:23.046 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T11:51:23.238 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T11:51:23.504 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mds (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:23.539 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-11-28T11:51:23.775 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T11:51:23.775 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T11:51:23.893 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librados2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:24.113 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-11-28T11:51:24.222 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librgw2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:24.223 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:24.323 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libsqlite3-mod-ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:24.466 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs2 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:24.478 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T11:51:24.479 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T11:51:24.592 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-routes (2.4.1-2) ... 2023-11-28T11:51:24.893 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libradosstriper1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:24.924 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-osd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:25.019 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-11-28T11:51:25.363 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librbd1 (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:25.450 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T11:51:25.450 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T11:51:25.481 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-modules-core (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:25.581 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:25.825 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T11:51:25.825 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T11:51:25.892 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-k8sevents (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:26.018 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:26.153 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mon (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:26.291 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs-dev (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:26.363 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T11:51:26.363 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T11:51:26.417 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rados (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:26.543 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-top (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:26.670 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-11-28T11:51:26.804 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:26.938 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:27.064 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-dashboard (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:27.249 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-volume (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:27.376 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-28T11:51:27.527 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-28T11:51:27.624 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rbd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:27.733 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up rbd-fuse (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:27.804 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-28T11:51:27.859 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:27.985 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cephfs (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:28.136 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-shell (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:28.262 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-common (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:28.799 INFO:teuthology.orchestra.run.smithi050.stdout:Adding group ceph....done 2023-11-28T11:51:29.167 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user ceph....done 2023-11-28T11:51:29.360 INFO:teuthology.orchestra.run.smithi050.stdout:Setting system user ceph properties....done 2023-11-28T11:51:29.384 INFO:teuthology.orchestra.run.smithi050.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T11:51:29.533 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T11:51:29.852 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T11:51:30.323 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephfs-mirror (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:30.424 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-test (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:30.542 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up radosgw (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:30.824 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-11-28T11:51:30.857 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T11:51:30.857 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T11:51:31.412 INFO:teuthology.orchestra.run.smithi192.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T11:51:31.414 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T11:51:31.488 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-11-28T11:51:31.502 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-base (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:31.691 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2023-11-28T11:51:31.692 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2023-11-28T11:51:31.878 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T11:51:31.894 INFO:teuthology.orchestra.run.smithi192.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-11-28T11:51:31.895 INFO:teuthology.orchestra.run.smithi192.stdout:flex is already the newest version (2.6.4-6.2). 2023-11-28T11:51:31.895 INFO:teuthology.orchestra.run.smithi192.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-11-28T11:51:31.895 INFO:teuthology.orchestra.run.smithi192.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-11-28T11:51:31.895 INFO:teuthology.orchestra.run.smithi192.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-11-28T11:51:31.895 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T11:51:31.896 INFO:teuthology.orchestra.run.smithi192.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-28T11:51:31.896 INFO:teuthology.orchestra.run.smithi192.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T11:51:31.896 INFO:teuthology.orchestra.run.smithi192.stdout:The following additional packages will be installed: 2023-11-28T11:51:31.896 INFO:teuthology.orchestra.run.smithi192.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-11-28T11:51:31.897 INFO:teuthology.orchestra.run.smithi192.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-11-28T11:51:31.897 INFO:teuthology.orchestra.run.smithi192.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-11-28T11:51:31.897 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-11-28T11:51:31.897 INFO:teuthology.orchestra.run.smithi192.stdout: usb-modeswitch-data wpasupplicant 2023-11-28T11:51:31.898 INFO:teuthology.orchestra.run.smithi192.stdout:Suggested packages: 2023-11-28T11:51:31.898 INFO:teuthology.orchestra.run.smithi192.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-11-28T11:51:31.898 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-11-28T11:51:31.898 INFO:teuthology.orchestra.run.smithi192.stdout: libengine-pkcs11-openssl 2023-11-28T11:51:31.959 INFO:teuthology.orchestra.run.smithi192.stdout:The following NEW packages will be installed: 2023-11-28T11:51:31.959 INFO:teuthology.orchestra.run.smithi192.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-11-28T11:51:31.960 INFO:teuthology.orchestra.run.smithi192.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-11-28T11:51:31.960 INFO:teuthology.orchestra.run.smithi192.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-11-28T11:51:31.960 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-11-28T11:51:31.961 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-11-28T11:51:31.961 INFO:teuthology.orchestra.run.smithi192.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T11:51:31.961 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages will be upgraded: 2023-11-28T11:51:31.962 INFO:teuthology.orchestra.run.smithi192.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-11-28T11:51:32.017 INFO:teuthology.orchestra.run.smithi192.stdout:6 upgraded, 31 newly installed, 0 to remove and 251 not upgraded. 2023-11-28T11:51:32.017 INFO:teuthology.orchestra.run.smithi192.stdout:Need to get 25.3 MB of archives. 2023-11-28T11:51:32.017 INFO:teuthology.orchestra.run.smithi192.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-11-28T11:51:32.017 INFO:teuthology.orchestra.run.smithi192.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-11-28T11:51:32.145 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-11-28T11:51:32.146 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-11-28T11:51:32.147 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-11-28T11:51:32.152 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-11-28T11:51:32.154 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-11-28T11:51:32.169 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-11-28T11:51:32.169 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-11-28T11:51:32.171 INFO:teuthology.orchestra.run.smithi192.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-11-28T11:51:32.172 INFO:teuthology.orchestra.run.smithi192.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-11-28T11:51:32.172 INFO:teuthology.orchestra.run.smithi192.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-11-28T11:51:32.179 INFO:teuthology.orchestra.run.smithi192.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-11-28T11:51:32.179 INFO:teuthology.orchestra.run.smithi192.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-11-28T11:51:32.181 INFO:teuthology.orchestra.run.smithi192.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-11-28T11:51:32.181 INFO:teuthology.orchestra.run.smithi192.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-11-28T11:51:32.195 INFO:teuthology.orchestra.run.smithi192.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-11-28T11:51:32.195 INFO:teuthology.orchestra.run.smithi192.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-11-28T11:51:32.201 INFO:teuthology.orchestra.run.smithi192.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-11-28T11:51:32.203 INFO:teuthology.orchestra.run.smithi192.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-11-28T11:51:32.210 INFO:teuthology.orchestra.run.smithi192.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-11-28T11:51:32.210 INFO:teuthology.orchestra.run.smithi192.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-11-28T11:51:32.224 INFO:teuthology.orchestra.run.smithi192.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-11-28T11:51:32.225 INFO:teuthology.orchestra.run.smithi192.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-11-28T11:51:32.232 INFO:teuthology.orchestra.run.smithi192.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-11-28T11:51:32.242 INFO:teuthology.orchestra.run.smithi192.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-11-28T11:51:32.258 INFO:teuthology.orchestra.run.smithi192.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-11-28T11:51:32.260 INFO:teuthology.orchestra.run.smithi192.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-11-28T11:51:32.261 INFO:teuthology.orchestra.run.smithi192.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-11-28T11:51:32.261 INFO:teuthology.orchestra.run.smithi192.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-11-28T11:51:32.262 INFO:teuthology.orchestra.run.smithi192.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-11-28T11:51:32.270 INFO:teuthology.orchestra.run.smithi192.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-11-28T11:51:32.272 INFO:teuthology.orchestra.run.smithi192.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-11-28T11:51:32.322 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mds (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:32.382 INFO:teuthology.orchestra.run.smithi192.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-11-28T11:51:32.382 INFO:teuthology.orchestra.run.smithi192.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-11-28T11:51:32.455 INFO:teuthology.orchestra.run.smithi192.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-11-28T11:51:32.455 INFO:teuthology.orchestra.run.smithi192.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-11-28T11:51:32.456 INFO:teuthology.orchestra.run.smithi192.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-11-28T11:51:32.573 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T11:51:32.574 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T11:51:32.842 INFO:teuthology.orchestra.run.smithi192.stdout:Preconfiguring packages ... 2023-11-28T11:51:33.015 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:33.029 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 25.3 MB in 0s (51.9 MB/s) 2023-11-28T11:51:33.275 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T11:51:33.275 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T11:51:33.306 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-28T11:51:33.311 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T11:51:33.467 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T11:51:33.733 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-osd (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:34.235 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T11:51:34.235 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T11:51:34.659 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-11-28T11:51:34.710 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-k8sevents (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:34.836 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:35.004 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mon (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:35.234 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T11:51:35.235 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T11:51:35.682 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-cephadm (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:35.824 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:35.949 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-dashboard (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:36.061 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-28T11:51:36.065 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T11:51:36.092 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-volume (18.0.0-2697-g2f5f6028-1focal) ... 2023-11-28T11:51:36.174 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T11:51:36.244 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-28T11:51:36.395 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-28T11:51:36.604 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T11:51:36.688 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-28T11:51:36.788 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T11:51:37.106 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-28T11:51:37.550 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-28T11:51:37.554 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T11:51:37.687 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-28T11:51:38.184 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T11:51:38.318 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-28T11:51:38.825 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-28T11:51:38.964 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-11-28T11:51:39.691 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-11-28T11:51:39.836 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T11:51:39.857 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-11-28T11:51:39.894 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-11-28T11:51:40.230 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package dump. 2023-11-28T11:51:40.250 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-11-28T11:51:40.288 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking dump (0.4b46-6) ... 2023-11-28T11:51:40.315 INFO:teuthology.orchestra.run.smithi050.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T11:51:40.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T11:51:40.391 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2023-11-28T11:51:40.592 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package indent. 2023-11-28T11:51:40.603 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2023-11-28T11:51:40.604 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2023-11-28T11:51:40.610 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:51:40.667 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-28T11:51:40.811 INFO:teuthology.orchestra.run.smithi050.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-11-28T11:51:40.811 INFO:teuthology.orchestra.run.smithi050.stdout:flex is already the newest version (2.6.4-6.2). 2023-11-28T11:51:40.811 INFO:teuthology.orchestra.run.smithi050.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-11-28T11:51:40.811 INFO:teuthology.orchestra.run.smithi050.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-11-28T11:51:40.811 INFO:teuthology.orchestra.run.smithi050.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-11-28T11:51:40.811 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T11:51:40.812 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-28T11:51:40.812 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T11:51:40.812 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2023-11-28T11:51:40.813 INFO:teuthology.orchestra.run.smithi050.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-11-28T11:51:40.813 INFO:teuthology.orchestra.run.smithi050.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-11-28T11:51:40.813 INFO:teuthology.orchestra.run.smithi050.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-11-28T11:51:40.813 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-11-28T11:51:40.813 INFO:teuthology.orchestra.run.smithi050.stdout: usb-modeswitch-data wpasupplicant 2023-11-28T11:51:40.814 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2023-11-28T11:51:40.814 INFO:teuthology.orchestra.run.smithi050.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-11-28T11:51:40.814 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-11-28T11:51:40.814 INFO:teuthology.orchestra.run.smithi050.stdout: libengine-pkcs11-openssl 2023-11-28T11:51:40.874 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2023-11-28T11:51:40.874 INFO:teuthology.orchestra.run.smithi050.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-11-28T11:51:40.874 INFO:teuthology.orchestra.run.smithi050.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-11-28T11:51:40.875 INFO:teuthology.orchestra.run.smithi050.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-11-28T11:51:40.875 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-11-28T11:51:40.875 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-11-28T11:51:40.875 INFO:teuthology.orchestra.run.smithi050.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T11:51:40.875 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages will be upgraded: 2023-11-28T11:51:40.876 INFO:teuthology.orchestra.run.smithi050.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-11-28T11:51:40.936 INFO:teuthology.orchestra.run.smithi050.stdout:6 upgraded, 31 newly installed, 0 to remove and 251 not upgraded. 2023-11-28T11:51:40.937 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 25.3 MB of archives. 2023-11-28T11:51:40.937 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-11-28T11:51:40.937 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-11-28T11:51:40.962 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T11:51:40.979 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-11-28T11:51:41.011 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-11-28T11:51:41.091 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-11-28T11:51:41.093 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-11-28T11:51:41.095 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-11-28T11:51:41.102 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-11-28T11:51:41.104 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-11-28T11:51:41.120 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-11-28T11:51:41.120 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-11-28T11:51:41.122 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-11-28T11:51:41.123 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-11-28T11:51:41.124 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-11-28T11:51:41.130 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-11-28T11:51:41.131 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-11-28T11:51:41.132 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-11-28T11:51:41.133 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-11-28T11:51:41.150 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-11-28T11:51:41.151 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-11-28T11:51:41.156 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-11-28T11:51:41.158 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-11-28T11:51:41.165 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-11-28T11:51:41.165 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-11-28T11:51:41.179 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-11-28T11:51:41.179 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-11-28T11:51:41.187 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-11-28T11:51:41.198 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-11-28T11:51:41.214 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-11-28T11:51:41.217 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-11-28T11:51:41.218 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-11-28T11:51:41.218 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-11-28T11:51:41.219 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-11-28T11:51:41.228 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-11-28T11:51:41.230 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-11-28T11:51:41.332 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T11:51:41.353 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-11-28T11:51:41.365 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-11-28T11:51:41.365 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-11-28T11:51:41.398 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-28T11:51:41.444 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-11-28T11:51:41.444 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-11-28T11:51:41.447 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-11-28T11:51:41.667 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T11:51:41.687 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T11:51:41.726 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T11:51:41.856 INFO:teuthology.orchestra.run.smithi050.stdout:Preconfiguring packages ... 2023-11-28T11:51:42.059 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 25.3 MB in 1s (45.0 MB/s) 2023-11-28T11:51:42.095 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T11:51:42.117 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:51:42.154 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T11:51:42.390 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T11:51:42.410 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:51:42.448 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T11:51:42.464 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-28T11:51:42.468 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T11:51:42.662 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T11:51:42.809 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T11:51:42.827 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:51:42.868 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T11:51:43.229 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T11:51:43.247 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-11-28T11:51:43.287 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-28T11:51:43.598 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T11:51:43.618 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-28T11:51:43.648 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-28T11:51:43.844 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-11-28T11:51:44.018 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T11:51:44.038 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:51:44.076 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:51:44.471 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T11:51:44.488 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:51:44.529 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T11:51:44.848 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T11:51:44.868 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:51:44.914 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T11:51:45.322 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-28T11:51:45.326 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T11:51:45.460 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T11:51:45.636 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T11:51:45.654 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-28T11:51:45.693 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T11:51:45.884 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-28T11:51:46.050 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-28T11:51:46.189 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T11:51:46.205 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-11-28T11:51:46.247 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-11-28T11:51:46.403 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-28T11:51:46.659 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package modemmanager. 2023-11-28T11:51:46.675 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:51:46.727 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T11:51:46.862 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152830 files and directories currently installed.) 2023-11-28T11:51:46.866 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T11:51:47.000 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-28T11:51:47.348 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T11:51:47.368 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-11-28T11:51:47.406 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-28T11:51:47.480 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T11:51:47.598 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-28T11:51:47.961 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package network-manager. 2023-11-28T11:51:47.979 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-28T11:51:48.044 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-11-28T11:51:48.801 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ppp. 2023-11-28T11:51:48.819 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-11-28T11:51:49.015 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-28T11:51:49.083 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-28T11:51:49.153 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-11-28T11:51:49.440 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T11:51:49.456 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-11-28T11:51:49.498 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-11-28T11:51:49.666 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T11:51:49.684 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-11-28T11:51:49.724 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-11-28T11:51:49.893 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T11:51:49.914 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-11-28T11:51:49.969 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-11-28T11:51:50.103 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package dump. 2023-11-28T11:51:50.120 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-11-28T11:51:50.161 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking dump (0.4b46-6) ... 2023-11-28T11:51:50.271 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T11:51:50.288 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-11-28T11:51:50.329 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-11-28T11:51:50.486 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package indent. 2023-11-28T11:51:50.506 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:51:50.550 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-28T11:51:50.834 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-client-12. 2023-11-28T11:51:50.854 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:51:50.869 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T11:51:50.888 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-11-28T11:51:50.928 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-11-28T11:51:51.101 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:51:51.281 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T11:51:51.299 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-11-28T11:51:51.339 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-28T11:51:51.600 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T11:51:51.621 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-28T11:51:51.659 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T11:51:51.774 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T11:51:51.791 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-11-28T11:51:51.857 INFO:teuthology.orchestra.run.smithi192.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T11:51:51.884 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-11-28T11:51:52.037 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T11:51:52.054 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:51:52.095 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T11:51:52.372 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-12. 2023-11-28T11:51:52.389 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:51:52.398 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T11:51:52.415 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:51:52.433 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:51:52.456 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T11:51:52.784 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T11:51:52.801 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:51:52.842 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T11:51:53.212 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T11:51:53.229 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-11-28T11:51:53.270 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-28T11:51:53.581 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T11:51:53.599 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-28T11:51:53.664 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-28T11:51:54.084 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql. 2023-11-28T11:51:54.103 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-11-28T11:51:54.166 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-11-28T11:51:54.402 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T11:51:54.422 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-11-28T11:51:54.460 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-11-28T11:51:54.704 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T11:51:54.721 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-11-28T11:51:54.762 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-11-28T11:51:55.056 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T11:51:55.077 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-11-28T11:51:55.099 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T11:51:55.114 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-11-28T11:51:55.118 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:51:55.428 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:51:55.476 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T11:51:55.496 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-11-28T11:51:55.545 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-28T11:51:55.831 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T11:51:55.851 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:51:55.855 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-11-28T11:51:55.881 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T11:51:56.065 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T11:51:56.242 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T11:51:56.262 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:51:56.301 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T11:51:56.554 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T11:51:56.575 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-28T11:51:56.611 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T11:51:56.708 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:51:56.835 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-11-28T11:51:56.961 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-11-28T11:51:57.112 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-28T11:51:57.157 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T11:51:57.176 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-11-28T11:51:57.214 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-11-28T11:51:57.503 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T11:51:57.503 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T11:51:57.568 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package modemmanager. 2023-11-28T11:51:57.585 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T11:51:57.628 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T11:51:57.972 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:51:58.265 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T11:51:58.284 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-11-28T11:51:58.323 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-28T11:51:58.850 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T11:51:58.879 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package network-manager. 2023-11-28T11:51:58.896 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-28T11:51:58.936 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-28T11:51:58.960 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-11-28T11:51:59.037 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-11-28T11:51:59.172 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-11-28T11:51:59.611 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ppp. 2023-11-28T11:51:59.629 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-11-28T11:51:59.886 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-28T11:52:00.195 INFO:teuthology.orchestra.run.smithi192.stdout:Adding user postgres to group ssl-cert 2023-11-28T11:52:00.249 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T11:52:00.267 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-11-28T11:52:00.316 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-11-28T11:52:00.470 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:00.470 INFO:teuthology.orchestra.run.smithi192.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T11:52:00.744 INFO:teuthology.orchestra.run.smithi192.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T11:52:00.744 INFO:teuthology.orchestra.run.smithi192.stdout:Removing obsolete dictionary files: 2023-11-28T11:52:00.870 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T11:52:00.891 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-11-28T11:52:01.069 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T11:52:01.208 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-11-28T11:52:01.658 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T11:52:01.679 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-11-28T11:52:01.724 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-11-28T11:52:02.028 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-client-12. 2023-11-28T11:52:02.049 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:52:02.076 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T11:52:02.086 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:52:02.202 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-11-28T11:52:02.328 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-28T11:52:02.437 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-28T11:52:02.674 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T11:52:02.694 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-11-28T11:52:02.757 INFO:teuthology.orchestra.run.smithi050.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T11:52:02.785 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-11-28T11:52:03.289 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-12. 2023-11-28T11:52:03.308 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-28T11:52:03.351 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:52:03.377 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-11-28T11:52:03.610 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up dump (0.4b46-6) ... 2023-11-28T11:52:03.707 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T11:52:03.770 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T11:52:03.896 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-28T11:52:04.022 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-28T11:52:04.173 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-28T11:52:04.349 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-28T11:52:04.475 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:52:04.839 INFO:teuthology.orchestra.run.smithi192.stdout:Creating new PostgreSQL cluster 12/main ... 2023-11-28T11:52:04.855 INFO:teuthology.orchestra.run.smithi192.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-11-28T11:52:04.921 INFO:teuthology.orchestra.run.smithi192.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T11:52:04.922 INFO:teuthology.orchestra.run.smithi192.stdout:This user must also own the server process. 2023-11-28T11:52:04.922 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:04.922 INFO:teuthology.orchestra.run.smithi192.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T11:52:04.922 INFO:teuthology.orchestra.run.smithi192.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T11:52:04.922 INFO:teuthology.orchestra.run.smithi192.stdout:The default text search configuration will be set to "english". 2023-11-28T11:52:04.923 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:04.923 INFO:teuthology.orchestra.run.smithi192.stdout:Data page checksums are disabled. 2023-11-28T11:52:04.923 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:04.923 INFO:teuthology.orchestra.run.smithi192.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-11-28T11:52:04.923 INFO:teuthology.orchestra.run.smithi192.stdout:creating subdirectories ... ok 2023-11-28T11:52:04.923 INFO:teuthology.orchestra.run.smithi192.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T11:52:04.941 INFO:teuthology.orchestra.run.smithi192.stdout:selecting default max_connections ... 100 2023-11-28T11:52:04.968 INFO:teuthology.orchestra.run.smithi192.stdout:selecting default shared_buffers ... 128MB 2023-11-28T11:52:04.977 INFO:teuthology.orchestra.run.smithi192.stdout:selecting default time zone ... Etc/UTC 2023-11-28T11:52:04.978 INFO:teuthology.orchestra.run.smithi192.stdout:creating configuration files ... ok 2023-11-28T11:52:05.001 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql. 2023-11-28T11:52:05.020 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-11-28T11:52:05.059 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-11-28T11:52:05.081 INFO:teuthology.orchestra.run.smithi192.stdout:running bootstrap script ... ok 2023-11-28T11:52:05.287 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T11:52:05.307 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-11-28T11:52:05.345 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-11-28T11:52:05.590 INFO:teuthology.orchestra.run.smithi192.stdout:performing post-bootstrap initialization ... ok 2023-11-28T11:52:05.622 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T11:52:05.640 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-11-28T11:52:05.680 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-11-28T11:52:05.899 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T11:52:05.919 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-11-28T11:52:05.957 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-11-28T11:52:06.426 INFO:teuthology.orchestra.run.smithi192.stdout:syncing data to disk ... ok 2023-11-28T11:52:06.426 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:06.426 INFO:teuthology.orchestra.run.smithi192.stdout:Success. You can now start the database server using: 2023-11-28T11:52:06.427 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:06.427 INFO:teuthology.orchestra.run.smithi192.stdout: pg_ctlcluster 12 main start 2023-11-28T11:52:06.427 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:06.482 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T11:52:06.503 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-11-28T11:52:06.605 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-28T11:52:06.746 INFO:teuthology.orchestra.run.smithi192.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-11-28T11:52:06.747 INFO:teuthology.orchestra.run.smithi192.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-11-28T11:52:06.832 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T11:52:06.941 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-11-28T11:52:07.167 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T11:52:07.460 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:52:07.561 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-11-28T11:52:07.662 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-11-28T11:52:07.788 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-28T11:52:08.215 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T11:52:08.216 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T11:52:08.683 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:52:09.591 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T11:52:09.680 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-28T11:52:09.815 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T11:52:09.839 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-11-28T11:52:09.941 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T11:52:09.965 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-11-28T11:52:10.067 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-11-28T11:52:10.235 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T11:52:10.361 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-11-28T11:52:10.529 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-11-28T11:52:10.954 INFO:teuthology.orchestra.run.smithi050.stdout:Adding user postgres to group ssl-cert 2023-11-28T11:52:11.227 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:11.227 INFO:teuthology.orchestra.run.smithi050.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T11:52:11.237 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:11.237 INFO:teuthology.orchestra.run.smithi192.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T11:52:11.237 INFO:teuthology.orchestra.run.smithi192.stdout:which means they are currently configured by ifupdown: 2023-11-28T11:52:11.237 INFO:teuthology.orchestra.run.smithi192.stdout:- enp3s0f1 2023-11-28T11:52:11.237 INFO:teuthology.orchestra.run.smithi192.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T11:52:11.237 INFO:teuthology.orchestra.run.smithi192.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T11:52:11.238 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:11.396 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T11:52:11.469 INFO:teuthology.orchestra.run.smithi050.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T11:52:11.469 INFO:teuthology.orchestra.run.smithi050.stdout:Removing obsolete dictionary files: 2023-11-28T11:52:11.735 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T11:52:11.799 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T11:52:12.237 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T11:52:12.568 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-28T11:52:12.710 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-11-28T11:52:12.756 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T11:52:12.870 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-28T11:52:12.900 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-11-28T11:52:12.996 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-28T11:52:13.043 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T11:52:13.168 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-11-28T11:52:13.328 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-11-28T11:52:13.454 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T11:52:13.580 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T11:52:13.705 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T11:52:13.977 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T11:52:13.977 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T11:52:13.985 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-11-28T11:52:14.244 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up dump (0.4b46-6) ... 2023-11-28T11:52:14.342 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T11:52:14.404 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T11:52:14.492 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-11-28T11:52:14.592 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T11:52:14.744 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-28T11:52:14.887 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-28T11:52:14.906 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-28T11:52:15.032 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-28T11:52:15.158 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-28T11:52:15.180 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-28T11:52:15.343 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-28T11:52:15.477 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-28T11:52:15.860 INFO:teuthology.orchestra.run.smithi050.stdout:Creating new PostgreSQL cluster 12/main ... 2023-11-28T11:52:15.875 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-11-28T11:52:15.922 INFO:teuthology.orchestra.run.smithi050.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T11:52:15.922 INFO:teuthology.orchestra.run.smithi050.stdout:This user must also own the server process. 2023-11-28T11:52:15.923 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:15.923 INFO:teuthology.orchestra.run.smithi050.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T11:52:15.923 INFO:teuthology.orchestra.run.smithi050.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T11:52:15.923 INFO:teuthology.orchestra.run.smithi050.stdout:The default text search configuration will be set to "english". 2023-11-28T11:52:15.923 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:15.923 INFO:teuthology.orchestra.run.smithi050.stdout:Data page checksums are disabled. 2023-11-28T11:52:15.923 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:15.923 INFO:teuthology.orchestra.run.smithi050.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-11-28T11:52:15.924 INFO:teuthology.orchestra.run.smithi050.stdout:creating subdirectories ... ok 2023-11-28T11:52:15.924 INFO:teuthology.orchestra.run.smithi050.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T11:52:15.941 INFO:teuthology.orchestra.run.smithi050.stdout:selecting default max_connections ... 100 2023-11-28T11:52:15.964 INFO:teuthology.orchestra.run.smithi050.stdout:selecting default shared_buffers ... 128MB 2023-11-28T11:52:15.981 INFO:teuthology.orchestra.run.smithi050.stdout:selecting default time zone ... Etc/UTC 2023-11-28T11:52:15.981 INFO:teuthology.orchestra.run.smithi050.stdout:creating configuration files ... ok 2023-11-28T11:52:16.094 INFO:teuthology.orchestra.run.smithi050.stdout:running bootstrap script ... ok 2023-11-28T11:52:16.635 INFO:teuthology.orchestra.run.smithi050.stdout:performing post-bootstrap initialization ... ok 2023-11-28T11:52:17.366 INFO:teuthology.orchestra.run.smithi050.stdout:syncing data to disk ... ok 2023-11-28T11:52:17.366 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:17.366 INFO:teuthology.orchestra.run.smithi050.stdout:Success. You can now start the database server using: 2023-11-28T11:52:17.367 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:17.367 INFO:teuthology.orchestra.run.smithi050.stdout: pg_ctlcluster 12 main start 2023-11-28T11:52:17.367 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:17.688 INFO:teuthology.orchestra.run.smithi050.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-11-28T11:52:17.688 INFO:teuthology.orchestra.run.smithi050.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-11-28T11:52:17.781 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T11:52:20.867 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T11:52:20.993 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T11:52:21.119 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-11-28T11:52:21.287 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T11:52:21.414 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-11-28T11:52:21.563 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-11-28T11:52:22.285 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:22.285 INFO:teuthology.orchestra.run.smithi050.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T11:52:22.285 INFO:teuthology.orchestra.run.smithi050.stdout:which means they are currently configured by ifupdown: 2023-11-28T11:52:22.285 INFO:teuthology.orchestra.run.smithi050.stdout:- ens1f0 2023-11-28T11:52:22.286 INFO:teuthology.orchestra.run.smithi050.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T11:52:22.286 INFO:teuthology.orchestra.run.smithi050.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T11:52:22.286 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:22.434 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-11-28T11:52:22.450 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T11:52:22.551 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-11-28T11:52:22.773 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T11:52:23.316 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T11:52:23.412 INFO:teuthology.orchestra.run.smithi192.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T11:52:23.415 DEBUG:teuthology.parallel:result is None 2023-11-28T11:52:23.809 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-28T11:52:23.952 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-11-28T11:52:24.129 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-28T11:52:24.254 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-11-28T11:52:24.380 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-11-28T11:52:24.506 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T11:52:24.658 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-28T11:52:24.770 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-28T11:52:25.035 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T11:52:25.035 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T11:52:25.553 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-11-28T11:52:25.662 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T11:52:25.789 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-28T11:52:25.973 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-28T11:52:26.266 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-28T11:52:33.813 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-11-28T11:52:34.661 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-11-28T11:52:34.770 INFO:teuthology.orchestra.run.smithi050.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T11:52:34.773 DEBUG:teuthology.parallel:result is None 2023-11-28T11:52:34.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T11:52:34.939 DEBUG:teuthology.orchestra.run.smithi050:> dpkg-query -W -f '${Version}' ceph 2023-11-28T11:52:34.964 INFO:teuthology.orchestra.run.smithi050.stdout:18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:52:34.965 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:52:34.965 INFO:teuthology.task.install:The correct ceph version 18.0.0-2697-g2f5f6028-1focal is installed. 2023-11-28T11:52:34.965 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T11:52:35.179 DEBUG:teuthology.orchestra.run.smithi192:> dpkg-query -W -f '${Version}' ceph 2023-11-28T11:52:35.204 INFO:teuthology.orchestra.run.smithi192.stdout:18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:52:35.204 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2697-g2f5f6028-1focal 2023-11-28T11:52:35.204 INFO:teuthology.task.install:The correct ceph version 18.0.0-2697-g2f5f6028-1focal is installed. 2023-11-28T11:52:35.204 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-28T11:52:35.205 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:52:35.205 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T11:52:35.221 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:52:35.222 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T11:52:35.260 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-28T11:52:35.261 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:52:35.261 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T11:52:35.281 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T11:52:35.294 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:52:35.294 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T11:52:35.308 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T11:52:35.323 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-28T11:52:35.323 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:52:35.323 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T11:52:35.339 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T11:52:35.398 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:52:35.398 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T11:52:35.413 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T11:52:35.422 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-28T11:52:35.422 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:52:35.422 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T11:52:35.436 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T11:52:35.452 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:52:35.452 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T11:52:35.466 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T11:52:35.521 INFO:teuthology.run_tasks:Running task ceph... 2023-11-28T11:52:35.592 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-28T11:52:35.592 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2023-11-28T11:52:35.596 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /var/log/ceph 2023-11-28T11:52:35.610 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-28T11:52:35.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T11:52:35.653 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T11:52:35.668 INFO:tasks.ceph:Creating extra log directories... 2023-11-28T11:52:35.668 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T11:52:35.670 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T11:52:35.690 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-28T11:52:35.690 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-28T11:52:35.690 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-28T11:52:35.691 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:52:35.691 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T11:52:35.696 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T11:52:35.779 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:52:35.779 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T11:52:35.785 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T11:52:35.829 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-28T11:52:35.829 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-28T11:52:35.829 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469965', 'branch': 'wip-neesingh-testing-231123', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}', 'email': 'neesingh@redhat.com', 'first_in_suite': False, 'job_id': '7469965', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-neesingh-testing-231123'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'issue_54557', 'sha1': '17c45c858c4cb3105f973d12c6c74f8d5037aa89'}}, 'owner': 'scheduled_neesingh@teuthology', 'priority': 10, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4140, 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'issue_54557', 'suite_path': '/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/neesingh-rh/ceph', 'suite_sha1': '17c45c858c4cb3105f973d12c6c74f8d5037aa89', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi192.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '5ae09a5cc7064ca2bf994df19f3006b79794789a', 'timestamp': '2023-11-28_11:27:19', 'tube': 'smithi', 'user': 'neesingh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-28T11:52:35.830 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T11:52:35.832 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T11:52:35.838 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T11:52:35.881 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T11:52:35.896 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:52:35.897 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T11:52:35.901 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T11:52:35.901 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2023-11-28T11:52:35.950 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T11:52:35.950 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:52:35.950 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 361 Links: 1 2023-11-28T11:52:35.951 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:52:35.951 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-11-28 11:47:50.245525443 +0000 2023-11-28T11:52:35.951 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-11-28 11:47:49.917532991 +0000 2023-11-28T11:52:35.951 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-11-28 11:47:49.917532991 +0000 2023-11-28T11:52:35.951 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-11-28T11:52:35.951 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T11:52:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-11-28T11:52:35.962 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-11-28T11:52:35.962 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000305591 s, 1.7 MB/s 2023-11-28T11:52:35.962 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T11:52:35.971 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2023-11-28T11:52:36.018 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T11:52:36.018 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:52:36.018 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 366 Links: 1 2023-11-28T11:52:36.018 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:52:36.018 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-11-28 11:47:50.757513661 +0000 2023-11-28T11:52:36.019 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-11-28 11:47:50.473520196 +0000 2023-11-28T11:52:36.019 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-11-28 11:47:50.473520196 +0000 2023-11-28T11:52:36.019 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-11-28T11:52:36.019 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T11:52:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-11-28T11:52:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-11-28T11:52:36.030 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000302563 s, 1.7 MB/s 2023-11-28T11:52:36.031 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T11:52:36.039 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2023-11-28T11:52:36.091 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T11:52:36.091 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:52:36.091 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 373 Links: 1 2023-11-28T11:52:36.091 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:52:36.091 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-11-28 11:47:51.253502247 +0000 2023-11-28T11:52:36.091 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-11-28 11:47:50.985508414 +0000 2023-11-28T11:52:36.091 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-11-28 11:47:50.985508414 +0000 2023-11-28T11:52:36.092 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-11-28T11:52:36.092 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T11:52:36.106 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-11-28T11:52:36.106 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-11-28T11:52:36.106 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000305307 s, 1.7 MB/s 2023-11-28T11:52:36.108 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T11:52:36.116 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2023-11-28T11:52:36.166 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T11:52:36.166 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:52:36.167 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 380 Links: 1 2023-11-28T11:52:36.167 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:52:36.167 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-11-28 11:47:51.749490833 +0000 2023-11-28T11:52:36.167 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-11-28 11:47:51.457497553 +0000 2023-11-28T11:52:36.167 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-11-28 11:47:51.457497553 +0000 2023-11-28T11:52:36.167 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2023-11-28T11:52:36.167 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T11:52:36.180 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-11-28T11:52:36.180 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-11-28T11:52:36.180 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000291841 s, 1.8 MB/s 2023-11-28T11:52:36.182 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T11:52:36.191 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T11:52:36.191 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:52:36.191 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T11:52:36.198 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T11:52:36.198 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 2023-11-28T11:52:36.208 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T11:52:36.209 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:52:36.209 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 361 Links: 1 2023-11-28T11:52:36.209 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:52:36.209 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-11-28 11:47:51.407660538 +0000 2023-11-28T11:52:36.209 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-11-28 11:47:51.119667164 +0000 2023-11-28T11:52:36.209 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-11-28 11:47:51.119667164 +0000 2023-11-28T11:52:36.209 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-11-28T11:52:36.209 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T11:52:36.265 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-11-28T11:52:36.265 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-11-28T11:52:36.265 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000423585 s, 1.2 MB/s 2023-11-28T11:52:36.266 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T11:52:36.274 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 2023-11-28T11:52:36.281 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T11:52:36.281 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:52:36.281 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 365 Links: 1 2023-11-28T11:52:36.281 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:52:36.281 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-11-28 11:47:51.959647834 +0000 2023-11-28T11:52:36.281 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-11-28 11:47:51.647655015 +0000 2023-11-28T11:52:36.281 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-11-28 11:47:51.647655015 +0000 2023-11-28T11:52:36.282 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-11-28T11:52:36.282 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T11:52:36.338 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-11-28T11:52:36.338 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-11-28T11:52:36.338 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000400978 s, 1.3 MB/s 2023-11-28T11:52:36.339 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T11:52:36.346 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 2023-11-28T11:52:36.352 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T11:52:36.352 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:52:36.352 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 373 Links: 1 2023-11-28T11:52:36.352 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:52:36.352 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-11-28 11:47:52.507635224 +0000 2023-11-28T11:52:36.352 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-11-28 11:47:52.199642311 +0000 2023-11-28T11:52:36.352 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-11-28 11:47:52.199642311 +0000 2023-11-28T11:52:36.352 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-11-28T11:52:36.352 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T11:52:36.409 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-11-28T11:52:36.409 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-11-28T11:52:36.409 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000389602 s, 1.3 MB/s 2023-11-28T11:52:36.410 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T11:52:36.418 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 2023-11-28T11:52:36.424 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T11:52:36.425 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T11:52:36.425 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 380 Links: 1 2023-11-28T11:52:36.425 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T11:52:36.425 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-11-28 11:47:52.959624822 +0000 2023-11-28T11:52:36.425 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-11-28 11:47:52.707630622 +0000 2023-11-28T11:52:36.425 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-11-28 11:47:52.707630622 +0000 2023-11-28T11:52:36.425 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-11-28T11:52:36.425 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T11:52:36.481 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-11-28T11:52:36.481 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-11-28T11:52:36.481 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000411975 s, 1.2 MB/s 2023-11-28T11:52:36.482 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T11:52:36.489 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T11:52:36.489 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T11:52:36.489 INFO:tasks.ceph:Generating config... 2023-11-28T11:52:36.490 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-28T11:52:36.490 INFO:tasks.ceph:[client] debug client = 20 2023-11-28T11:52:36.490 INFO:tasks.ceph:[client] debug ms = 1 2023-11-28T11:52:36.490 INFO:tasks.ceph:[client] pid file = 2023-11-28T11:52:36.491 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-28T11:52:36.491 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-28T11:52:36.491 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-28T11:52:36.491 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-28T11:52:36.491 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-28T11:52:36.491 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-28T11:52:36.491 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-28T11:52:36.491 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-28T11:52:36.491 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-28T11:52:36.491 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-28T11:52:36.491 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-28T11:52:36.491 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-28T11:52:36.492 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-28T11:52:36.492 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-28T11:52:36.492 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-28T11:52:36.492 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-28T11:52:36.492 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-28T11:52:36.492 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-28T11:52:36.492 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-28T11:52:36.492 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-28T11:52:36.492 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-28T11:52:36.492 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-28T11:52:36.492 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-28T11:52:36.492 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-28T11:52:36.492 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-28T11:52:36.492 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-28T11:52:36.492 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-28T11:52:36.493 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-28T11:52:36.493 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-28T11:52:36.493 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-28T11:52:36.493 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-28T11:52:36.493 INFO:tasks.ceph:Setting up mon.a... 2023-11-28T11:52:36.493 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-28T11:52:36.534 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.keyring 2023-11-28T11:52:36.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-28T11:52:36.685 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T11:52:36.695 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.50'), ('mon.b', '172.21.15.192'), ('mon.c', '[v2:172.21.15.192:3301,v1:172.21.15.192:6790]')] 2023-11-28T11:52:36.696 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.50,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-28T11:52:36.697 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:52:36.697 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T11:52:36.703 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.50 --add b 172.21.15.192 --addv c '[v2:172.21.15.192:3301,v1:172.21.15.192:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:52:36.791 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:52:36.791 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: generated fsid cfe07b6e-9334-49cb-bc97-5dba7caa4ff8 2023-11-28T11:52:36.791 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = pacific 2023-11-28T11:52:36.791 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 0 2023-11-28T11:52:36.792 INFO:teuthology.orchestra.run.smithi050.stdout:fsid cfe07b6e-9334-49cb-bc97-5dba7caa4ff8 2023-11-28T11:52:36.792 INFO:teuthology.orchestra.run.smithi050.stdout:last_changed 2023-11-28T11:52:36.792054+0000 2023-11-28T11:52:36.792 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-11-28T11:52:36.792054+0000 2023-11-28T11:52:36.792 INFO:teuthology.orchestra.run.smithi050.stdout:min_mon_release 16 (pacific) 2023-11-28T11:52:36.792 INFO:teuthology.orchestra.run.smithi050.stdout:election_strategy: 1 2023-11-28T11:52:36.792 INFO:teuthology.orchestra.run.smithi050.stdout:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2023-11-28T11:52:36.792 INFO:teuthology.orchestra.run.smithi050.stdout:1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.b 2023-11-28T11:52:36.792 INFO:teuthology.orchestra.run.smithi050.stdout:2: [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] mon.c 2023-11-28T11:52:36.792 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-28T11:52:36.794 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T11:52:36.798 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cfe07b6e-9334-49cb-bc97-5dba7caa4ff8... 2023-11-28T11:52:36.799 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T11:52:36.801 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T11:52:36.831 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2023-11-28T11:52:36.831 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2023-11-28T11:52:36.831 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T11:52:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2023-11-28T11:52:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2023-11-28T11:52:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2023-11-28T11:52:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2023-11-28T11:52:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2023-11-28T11:52:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2023-11-28T11:52:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2023-11-28T11:52:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T11:52:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2023-11-28T11:52:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T11:52:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T11:52:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2023-11-28T11:52:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2023-11-28T11:52:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2023-11-28T11:52:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2023-11-28T11:52:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2023-11-28T11:52:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2023-11-28T11:52:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2023-11-28T11:52:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2023-11-28T11:52:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T11:52:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T11:52:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2023-11-28T11:52:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T11:52:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2023-11-28T11:52:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2023-11-28T11:52:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2023-11-28T11:52:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2023-11-28T11:52:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2023-11-28T11:52:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.50,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]" 2023-11-28T11:52:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = cfe07b6e-9334-49cb-bc97-5dba7caa4ff8 2023-11-28T11:52:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.836 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2023-11-28T11:52:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2023-11-28T11:52:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2023-11-28T11:52:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2023-11-28T11:52:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2023-11-28T11:52:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2023-11-28T11:52:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2023-11-28T11:52:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2023-11-28T11:52:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2023-11-28T11:52:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2023-11-28T11:52:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2023-11-28T11:52:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2023-11-28T11:52:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2023-11-28T11:52:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2023-11-28T11:52:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2023-11-28T11:52:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2023-11-28T11:52:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2023-11-28T11:52:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2023-11-28T11:52:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2023-11-28T11:52:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2023-11-28T11:52:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 20 2023-11-28T11:52:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 20 2023-11-28T11:52:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-11-28T11:52:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2023-11-28T11:52:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 10 2023-11-28T11:52:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T11:52:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2023-11-28T11:52:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2023-11-28T11:52:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2023-11-28T11:52:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2023-11-28T11:52:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2023-11-28T11:52:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.839 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2023-11-28T11:52:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-11-28T11:52:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2023-11-28T11:52:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-11-28T11:52:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-11-28T11:52:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-11-28T11:52:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-11-28T11:52:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2023-11-28T11:52:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.840 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2023-11-28T11:52:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-11-28T11:52:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-11-28T11:52:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2023-11-28T11:52:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-11-28T11:52:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2023-11-28T11:52:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2023-11-28T11:52:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-11-28T11:52:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2023-11-28T11:52:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2023-11-28T11:52:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-11-28T11:52:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T11:52:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T11:52:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T11:52:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T11:52:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T11:52:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T11:52:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2023-11-28T11:52:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2023-11-28T11:52:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2023-11-28T11:52:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2023-11-28T11:52:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:52:36.843 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2023-11-28T11:52:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2023-11-28T11:52:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2023-11-28T11:52:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2023-11-28T11:52:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T11:52:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T11:52:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2023-11-28T11:52:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2023-11-28T11:52:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-11-28T11:52:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = "" 2023-11-28T11:52:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2023-11-28T11:52:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2023-11-28T11:52:36.844 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2023-11-28T11:52:36.844 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2023-11-28T11:52:36.844 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2023-11-28T11:52:36.844 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2023-11-28T11:52:36.844 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2023-11-28T11:52:36.844 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2023-11-28T11:52:36.844 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2023-11-28T11:52:36.844 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2023-11-28T11:52:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2023-11-28T11:52:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds balancer = 20 2023-11-28T11:52:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-11-28T11:52:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2023-11-28T11:52:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = True 2023-11-28T11:52:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2023-11-28T11:52:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = True 2023-11-28T11:52:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2023-11-28T11:52:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2023-11-28T11:52:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2023-11-28T11:52:36.846 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2023-11-28T11:52:36.846 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2023-11-28T11:52:36.846 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T11:52:36.846 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2023-11-28T11:52:36.846 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.846 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2023-11-28T11:52:36.846 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.846 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2023-11-28T11:52:36.847 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.847 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2023-11-28T11:52:36.847 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2023-11-28T11:52:36.847 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.847 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2023-11-28T11:52:36.847 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2023-11-28T11:52:36.847 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.847 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T11:52:36.847 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2023-11-28T11:52:36.847 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.848 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T11:52:36.848 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T11:52:36.848 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.848 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2023-11-28T11:52:36.848 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.848 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2023-11-28T11:52:36.848 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2023-11-28T11:52:36.848 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2023-11-28T11:52:36.848 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2023-11-28T11:52:36.848 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2023-11-28T11:52:36.848 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2023-11-28T11:52:36.849 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2023-11-28T11:52:36.849 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T11:52:36.849 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T11:52:36.849 INFO:teuthology.orchestra.run.smithi192.stdout: mon_allow_pool_size_one = true 2023-11-28T11:52:36.849 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.849 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T11:52:36.849 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.849 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2023-11-28T11:52:36.849 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.849 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2023-11-28T11:52:36.849 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.849 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2023-11-28T11:52:36.850 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2023-11-28T11:52:36.850 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2023-11-28T11:52:36.850 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = "172.21.15.50,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]" 2023-11-28T11:52:36.850 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = cfe07b6e-9334-49cb-bc97-5dba7caa4ff8 2023-11-28T11:52:36.850 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.850 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2023-11-28T11:52:36.850 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2023-11-28T11:52:36.850 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.850 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2023-11-28T11:52:36.850 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2023-11-28T11:52:36.851 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.851 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2023-11-28T11:52:36.851 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2023-11-28T11:52:36.851 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.851 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2023-11-28T11:52:36.851 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2023-11-28T11:52:36.851 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2023-11-28T11:52:36.851 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.851 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2023-11-28T11:52:36.851 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2023-11-28T11:52:36.851 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.851 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2023-11-28T11:52:36.852 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.852 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2023-11-28T11:52:36.852 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.852 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2023-11-28T11:52:36.852 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.852 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2023-11-28T11:52:36.852 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2023-11-28T11:52:36.852 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.852 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2023-11-28T11:52:36.853 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2023-11-28T11:52:36.853 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore block size = 96636764160 2023-11-28T11:52:36.853 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore fsck on mount = True 2023-11-28T11:52:36.853 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluefs = 20 2023-11-28T11:52:36.853 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluestore = 20 2023-11-28T11:52:36.853 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-11-28T11:52:36.853 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 20 2023-11-28T11:52:36.853 INFO:teuthology.orchestra.run.smithi192.stdout: debug rocksdb = 10 2023-11-28T11:52:36.853 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T11:52:36.853 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.9 2023-11-28T11:52:36.854 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.8 2023-11-28T11:52:36.854 INFO:teuthology.orchestra.run.smithi192.stdout: osd failsafe full ratio = 0.95 2023-11-28T11:52:36.854 INFO:teuthology.orchestra.run.smithi192.stdout: osd objectstore = bluestore 2023-11-28T11:52:36.854 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2023-11-28T11:52:36.854 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.854 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2023-11-28T11:52:36.854 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-11-28T11:52:36.854 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2023-11-28T11:52:36.854 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-11-28T11:52:36.854 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-11-28T11:52:36.854 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-11-28T11:52:36.854 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-11-28T11:52:36.855 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2023-11-28T11:52:36.855 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.855 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2023-11-28T11:52:36.855 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-11-28T11:52:36.855 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-11-28T11:52:36.856 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2023-11-28T11:52:36.856 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-11-28T11:52:36.856 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2023-11-28T11:52:36.856 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2023-11-28T11:52:36.856 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-11-28T11:52:36.856 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2023-11-28T11:52:36.856 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2023-11-28T11:52:36.856 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-11-28T11:52:36.856 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.857 INFO:teuthology.orchestra.run.smithi192.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T11:52:36.857 INFO:teuthology.orchestra.run.smithi192.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T11:52:36.857 INFO:teuthology.orchestra.run.smithi192.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T11:52:36.857 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.857 INFO:teuthology.orchestra.run.smithi192.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T11:52:36.857 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T11:52:36.857 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T11:52:36.857 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.857 INFO:teuthology.orchestra.run.smithi192.stdout: # 1m isn't quite enough 2023-11-28T11:52:36.858 INFO:teuthology.orchestra.run.smithi192.stdout: mon_down_mkfs_grace = 2m 2023-11-28T11:52:36.858 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.858 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_filestore_osds = false 2023-11-28T11:52:36.858 INFO:teuthology.orchestra.run.smithi192.stdout: mon op complaint time = 120 2023-11-28T11:52:36.858 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-28T11:52:36.858 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2023-11-28T11:52:36.858 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2023-11-28T11:52:36.858 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2023-11-28T11:52:36.858 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2023-11-28T11:52:36.858 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T11:52:36.858 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T11:52:36.859 INFO:teuthology.orchestra.run.smithi192.stdout: client mount timeout = 600 2023-11-28T11:52:36.859 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2023-11-28T11:52:36.859 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-11-28T11:52:36.859 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = "" 2023-11-28T11:52:36.859 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2023-11-28T11:52:36.859 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2023-11-28T11:52:36.859 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2023-11-28T11:52:36.859 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.b] 2023-11-28T11:52:36.859 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.c] 2023-11-28T11:52:36.859 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2023-11-28T11:52:36.859 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2023-11-28T11:52:36.859 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2023-11-28T11:52:36.860 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.d] 2023-11-28T11:52:36.860 INFO:teuthology.orchestra.run.smithi192.stdout:[mds] 2023-11-28T11:52:36.860 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds = 20 2023-11-28T11:52:36.860 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds balancer = 20 2023-11-28T11:52:36.860 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-11-28T11:52:36.860 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug frag = True 2023-11-28T11:52:36.860 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug scatterstat = True 2023-11-28T11:52:36.860 INFO:teuthology.orchestra.run.smithi192.stdout: mds op complaint time = 180 2023-11-28T11:52:36.860 INFO:teuthology.orchestra.run.smithi192.stdout: mds verify scatter = True 2023-11-28T11:52:36.860 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2023-11-28T11:52:36.860 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2023-11-28T11:52:36.861 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2023-11-28T11:52:36.862 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-28T11:52:36.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-28T11:52:36.963 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-28T11:52:36.963 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:52:36.963 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-28T11:52:36.971 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:52:36.971 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-28T11:52:36.977 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T11:52:36.978 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:52:36.978 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T11:52:36.978 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T11:52:37.044 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:52:37.044 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:52:37.050 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T11:52:37.050 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:52:37.050 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T11:52:37.050 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T11:52:37.076 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:52:37.076 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:52:37.125 INFO:tasks.ceph:Setting up mon nodes... 2023-11-28T11:52:37.125 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-28T11:52:37.125 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T11:52:37.180 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T11:52:37.183 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T11:52:37.233 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T11:52:37.248 INFO:tasks.ceph:Setting up mds nodes... 2023-11-28T11:52:37.248 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T11:52:37.302 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T11:52:37.305 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-28T11:52:37.315 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T11:52:37.363 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T11:52:37.366 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-28T11:52:37.424 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T11:52:37.480 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T11:52:37.483 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-28T11:52:37.497 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T11:52:37.543 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T11:52:37.547 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-28T11:52:37.560 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-28T11:52:37.560 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-28T11:52:37.602 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-28T11:52:37.616 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-28T11:52:37.703 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-28T11:52:37.718 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-28T11:52:37.764 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-28T11:52:37.778 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-28T11:52:37.817 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-28T11:52:37.830 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-28T11:52:37.830 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T11:52:37.830 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-28T11:52:37.847 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T11:52:37.847 INFO:tasks.ceph:role: osd.0 2023-11-28T11:52:37.847 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T11:52:37.847 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T11:52:37.889 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:52:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:52:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:52:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2023-11-28T11:52:37.889 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:52:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:52:37.889 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:52:37.890 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:52:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:52:37.890 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:52:37.985 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-11-28T11:52:37.986 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-28T11:52:38.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-28T11:52:38.059 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T11:52:38.060 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:52:38.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-28T11:52:38.074 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T11:52:38.074 INFO:tasks.ceph:role: osd.1 2023-11-28T11:52:38.074 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T11:52:38.074 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T11:52:38.158 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:52:38.158 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:52:38.158 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:52:38.159 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2023-11-28T11:52:38.159 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:52:38.159 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:52:38.159 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:52:38.159 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:52:38.159 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:52:38.159 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:52:38.160 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-11-28T11:52:38.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-28T11:52:38.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-28T11:52:38.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:52:38.190 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T11:52:38.191 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-28T11:52:38.201 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T11:52:38.201 INFO:tasks.ceph:role: osd.2 2023-11-28T11:52:38.201 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T11:52:38.201 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T11:52:38.240 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:52:38.240 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:52:38.240 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:52:38.240 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2023-11-28T11:52:38.240 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:52:38.241 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:52:38.241 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:52:38.241 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:52:38.241 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:52:38.241 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:52:38.242 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-11-28T11:52:38.242 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-28T11:52:38.259 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-28T11:52:38.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:52:38.316 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T11:52:38.316 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-28T11:52:38.333 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T11:52:38.333 INFO:tasks.ceph:role: osd.3 2023-11-28T11:52:38.333 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T11:52:38.333 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T11:52:38.375 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:52:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:52:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:52:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2023-11-28T11:52:38.375 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:52:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:52:38.375 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:52:38.375 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:52:38.376 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:52:38.376 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:52:38.377 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-11-28T11:52:38.377 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-28T11:52:38.399 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-28T11:52:38.408 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T11:52:38.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:52:38.409 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:52:38.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:38.483+0000 7fb4a5146700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-28T11:52:38.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:38.483+0000 7fb4a5146700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-28T11:52:38.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:38.483+0000 7fb4a5146700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T11:52:38.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:38.483+0000 7fb4a5146700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T11:52:38.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:38.483+0000 7fb4a5146700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T11:52:38.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:38.483+0000 7fb4a5146700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-28T11:52:41.488 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-28T11:52:41.504 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:52:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:41.543+0000 7fd13ec90700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-28T11:52:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:41.547+0000 7fd13ec90700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-28T11:52:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:41.547+0000 7fd13ec90700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T11:52:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:41.547+0000 7fd13ec90700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T11:52:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:41.547+0000 7fd13ec90700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T11:52:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:41.547+0000 7fd13ec90700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-28T11:52:44.579 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-28T11:52:44.594 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:52:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:44.683+0000 7f4996b4a700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-28T11:52:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:44.683+0000 7f4996b4a700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-28T11:52:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:44.683+0000 7f4996b4a700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T11:52:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:44.683+0000 7f4996b4a700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T11:52:44.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:44.683+0000 7f4996b4a700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T11:52:44.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:44.683+0000 7f4996b4a700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-28T11:52:47.670 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-28T11:52:47.687 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:52:47.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:47.734+0000 7f94e9d79700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-28T11:52:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:47.734+0000 7f94e9d79700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-28T11:52:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:47.734+0000 7f94e9d79700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T11:52:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:47.734+0000 7f94e9d79700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T11:52:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:47.734+0000 7f94e9d79700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T11:52:47.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:52:47.734+0000 7f94e9d79700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-28T11:52:50.754 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-28T11:52:50.771 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-28T11:52:50.788 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T11:52:50.788 INFO:tasks.ceph:role: osd.4 2023-11-28T11:52:50.789 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T11:52:50.789 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T11:52:51.356 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:52:51.357 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:52:51.357 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:52:51.357 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 2023-11-28T11:52:51.357 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:52:51.357 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:52:51.357 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:52:51.357 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:52:51.357 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:52:51.357 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:52:51.359 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-11-28T11:52:51.359 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-28T11:52:51.449 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-28T11:52:51.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:52:51.461 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T11:52:51.461 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-28T11:52:51.472 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T11:52:51.472 INFO:tasks.ceph:role: osd.5 2023-11-28T11:52:51.472 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T11:52:51.472 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T11:52:51.988 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:52:51.988 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:52:51.988 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:52:51.988 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 2023-11-28T11:52:51.988 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:52:51.988 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:52:51.988 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:52:51.988 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:52:51.989 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:52:51.989 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:52:51.990 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-11-28T11:52:51.990 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-28T11:52:52.048 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-28T11:52:52.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:52:52.060 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T11:52:52.060 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-28T11:52:52.069 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T11:52:52.069 INFO:tasks.ceph:role: osd.6 2023-11-28T11:52:52.070 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T11:52:52.070 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T11:52:52.517 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:52:52.517 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:52:52.517 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:52:52.517 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 2023-11-28T11:52:52.518 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:52:52.518 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:52:52.518 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:52:52.518 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:52:52.518 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:52:52.518 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:52:52.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-11-28T11:52:52.519 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-28T11:52:52.583 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-28T11:52:52.596 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T11:52:52.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:52:52.597 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-28T11:52:52.606 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T11:52:52.606 INFO:tasks.ceph:role: osd.7 2023-11-28T11:52:52.606 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T11:52:52.607 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T11:52:53.102 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T11:52:53.102 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T11:52:53.102 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T11:52:53.102 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 2023-11-28T11:52:53.102 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T11:52:53.102 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-11-28T11:52:53.103 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T11:52:53.103 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T11:52:53.103 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T11:52:53.103 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T11:52:53.104 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-11-28T11:52:53.104 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-28T11:52:53.156 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-28T11:52:53.167 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:52:53.168 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T11:52:53.168 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:52:53.252 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:53.248+0000 7efc8cd64700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-28T11:52:53.255 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:53.252+0000 7efc8cd64700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-28T11:52:53.255 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:53.252+0000 7efc8cd64700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T11:52:53.255 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:53.252+0000 7efc8cd64700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T11:52:53.255 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:53.252+0000 7efc8cd64700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T11:52:53.255 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:53.252+0000 7efc8cd64700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-28T11:52:56.512 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-28T11:52:56.527 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:52:56.615 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:56.612+0000 7f4fcd6a7700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-28T11:52:56.615 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:56.612+0000 7f4fcd6a7700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-28T11:52:56.616 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:56.612+0000 7f4fcd6a7700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T11:52:56.616 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:56.612+0000 7f4fcd6a7700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T11:52:56.616 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:56.612+0000 7f4fcd6a7700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T11:52:56.616 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:56.612+0000 7f4fcd6a7700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-28T11:52:59.627 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-28T11:52:59.642 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:52:59.690 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:59.684+0000 7f255b6e5700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-28T11:52:59.691 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:59.688+0000 7f255b6e5700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-28T11:52:59.691 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:59.688+0000 7f255b6e5700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T11:52:59.691 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:59.688+0000 7f255b6e5700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T11:52:59.691 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:59.688+0000 7f255b6e5700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T11:52:59.691 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:52:59.688+0000 7f255b6e5700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-28T11:53:02.705 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-28T11:53:02.720 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:53:02.762 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:02.756+0000 7f0d4dcbb700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-28T11:53:02.763 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:02.756+0000 7f0d4dcbb700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-28T11:53:02.763 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:02.760+0000 7f0d4dcbb700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T11:53:02.763 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:02.760+0000 7f0d4dcbb700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T11:53:02.763 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:02.760+0000 7f0d4dcbb700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T11:53:02.763 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:02.760+0000 7f0d4dcbb700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-28T11:53:05.753 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-28T11:53:05.767 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-28T11:53:05.767 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:53:05.767 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-28T11:53:05.784 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:53:05.784 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-28T11:53:05.799 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:53:05.799 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-28T11:53:05.812 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:53:05.812 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-28T11:53:05.831 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:53:05.858 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:53:05.869 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:53:05.869 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-28T11:53:05.881 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:53:05.881 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-28T11:53:05.892 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:53:05.892 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-28T11:53:05.904 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:53:05.904 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-28T11:53:05.921 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:53:05.921 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-28T11:53:05.930 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:53:05.930 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-28T11:53:05.990 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:53:05.990 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-28T11:53:06.000 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:53:06.000 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-28T11:53:06.014 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:53:06.015 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-28T11:53:06.072 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:53:06.072 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-28T11:53:06.087 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:53:06.087 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-28T11:53:06.095 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:53:06.095 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-28T11:53:06.102 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:53:06.102 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-28T11:53:06.107 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:53:06.107 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-28T11:53:06.114 INFO:tasks.ceph:Adding keys to all mons... 2023-11-28T11:53:06.114 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T11:53:06.145 DEBUG:teuthology.orchestra.run.smithi192:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T11:53:06.161 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2023-11-28T11:53:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCF1GVlkx3HChAAps/lgazBLgFHSJJI81Zstg== 2023-11-28T11:53:06.161 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2023-11-28T11:53:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCF1GVlxEENEhAA6uZF6YtncUs7dCDzIg5HbQ== 2023-11-28T11:53:06.161 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2023-11-28T11:53:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCF1GVl6ny0FRAAQgysr6oovp/2rDO2QIMXzw== 2023-11-28T11:53:06.161 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2023-11-28T11:53:06.161 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCG1GVl1DHxHBAAMp735odHBA/poSyyfvSYpQ== 2023-11-28T11:53:06.161 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2023-11-28T11:53:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCJ1GVlxoqwIBAAnUjVFlMfRBksZ6XYz47T9Q== 2023-11-28T11:53:06.162 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2023-11-28T11:53:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCM1GVlRf7iKBAAxyR/SK4psHpRinUXgEFWVQ== 2023-11-28T11:53:06.162 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2023-11-28T11:53:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCP1GVlsV/wKxAAvVIJRCRq4uLf16aZE9Y7vw== 2023-11-28T11:53:06.162 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2023-11-28T11:53:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCF1GVlGibYDRAAkIMRzwJqRzmiXvmizp2vBA== 2023-11-28T11:53:06.162 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2023-11-28T11:53:06.162 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCF1GVlI0OKHBAADvJfgEbXc9Afy6aG4gVoXA== 2023-11-28T11:53:06.162 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2023-11-28T11:53:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCF1GVlWutSIBAALVMWVV7ccbh3GllfVc1p3Q== 2023-11-28T11:53:06.163 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.4] 2023-11-28T11:53:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCV1GVlTQT5DhAAx8BnPWKTw75FEfwY4QW1eg== 2023-11-28T11:53:06.163 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.5] 2023-11-28T11:53:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCY1GVlYiehJBAA9fB7aokSkcuqUIrdCT4AVQ== 2023-11-28T11:53:06.163 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.6] 2023-11-28T11:53:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCb1GVlx8AcKRAAyyFUzBGKYgqFZTCjrzWfTQ== 2023-11-28T11:53:06.163 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.7] 2023-11-28T11:53:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCe1GVl8dJlLRAA3CbH6oyPSGBufsdUzrNqqg== 2023-11-28T11:53:06.163 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-11-28T11:53:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCF1GVlGwP8IxAAH+0SIBXHi15FUfxG3kL6CQ== 2023-11-28T11:53:06.163 INFO:teuthology.orchestra.run.smithi050.stdout:[client.2] 2023-11-28T11:53:06.163 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCF1GVlXn7/KRAAEPpLgrFMHsa7/ok0jPzaAw== 2023-11-28T11:53:06.164 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2023-11-28T11:53:06.164 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCF1GVlBPqBLRAA5NUjqXl9G+lXnEItcBKO0Q== 2023-11-28T11:53:06.164 INFO:teuthology.orchestra.run.smithi050.stdout:[client.3] 2023-11-28T11:53:06.164 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCF1GVly52uMBAAkzwG3hsY3hpSoc6tEbzs/w== 2023-11-28T11:53:06.170 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.y] 2023-11-28T11:53:06.171 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCF1GVlkx3HChAAps/lgazBLgFHSJJI81Zstg== 2023-11-28T11:53:06.171 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2023-11-28T11:53:06.171 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCF1GVlxEENEhAA6uZF6YtncUs7dCDzIg5HbQ== 2023-11-28T11:53:06.171 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2023-11-28T11:53:06.171 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCF1GVl6ny0FRAAQgysr6oovp/2rDO2QIMXzw== 2023-11-28T11:53:06.171 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.0] 2023-11-28T11:53:06.171 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCG1GVl1DHxHBAAMp735odHBA/poSyyfvSYpQ== 2023-11-28T11:53:06.171 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.1] 2023-11-28T11:53:06.171 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCJ1GVlxoqwIBAAnUjVFlMfRBksZ6XYz47T9Q== 2023-11-28T11:53:06.171 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.2] 2023-11-28T11:53:06.171 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCM1GVlRf7iKBAAxyR/SK4psHpRinUXgEFWVQ== 2023-11-28T11:53:06.172 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.3] 2023-11-28T11:53:06.172 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCP1GVlsV/wKxAAvVIJRCRq4uLf16aZE9Y7vw== 2023-11-28T11:53:06.172 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.x] 2023-11-28T11:53:06.172 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCF1GVlGibYDRAAkIMRzwJqRzmiXvmizp2vBA== 2023-11-28T11:53:06.172 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2023-11-28T11:53:06.172 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCF1GVlI0OKHBAADvJfgEbXc9Afy6aG4gVoXA== 2023-11-28T11:53:06.172 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.d] 2023-11-28T11:53:06.172 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCF1GVlWutSIBAALVMWVV7ccbh3GllfVc1p3Q== 2023-11-28T11:53:06.172 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.4] 2023-11-28T11:53:06.172 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCV1GVlTQT5DhAAx8BnPWKTw75FEfwY4QW1eg== 2023-11-28T11:53:06.172 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.5] 2023-11-28T11:53:06.173 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCY1GVlYiehJBAA9fB7aokSkcuqUIrdCT4AVQ== 2023-11-28T11:53:06.173 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.6] 2023-11-28T11:53:06.173 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCb1GVlx8AcKRAAyyFUzBGKYgqFZTCjrzWfTQ== 2023-11-28T11:53:06.173 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.7] 2023-11-28T11:53:06.173 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCe1GVl8dJlLRAA3CbH6oyPSGBufsdUzrNqqg== 2023-11-28T11:53:06.173 INFO:teuthology.orchestra.run.smithi192.stdout:[client.0] 2023-11-28T11:53:06.173 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCF1GVlGwP8IxAAH+0SIBXHi15FUfxG3kL6CQ== 2023-11-28T11:53:06.173 INFO:teuthology.orchestra.run.smithi192.stdout:[client.2] 2023-11-28T11:53:06.173 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCF1GVlXn7/KRAAEPpLgrFMHsa7/ok0jPzaAw== 2023-11-28T11:53:06.173 INFO:teuthology.orchestra.run.smithi192.stdout:[client.1] 2023-11-28T11:53:06.173 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCF1GVlBPqBLRAA5NUjqXl9G+lXnEItcBKO0Q== 2023-11-28T11:53:06.174 INFO:teuthology.orchestra.run.smithi192.stdout:[client.3] 2023-11-28T11:53:06.174 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCF1GVly52uMBAAkzwG3hsY3hpSoc6tEbzs/w== 2023-11-28T11:53:06.175 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T11:53:06.177 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T11:53:06.225 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:53:06.228 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:53:06.284 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:53:06.287 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:53:06.340 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:53:06.343 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:53:06.392 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:53:06.394 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:53:06.443 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:53:06.445 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:53:06.495 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:53:06.497 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:53:06.544 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T11:53:06.546 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T11:53:06.593 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:53:06.596 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:53:06.691 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:53:06.693 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T11:53:06.746 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:53:06.748 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:53:06.797 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:53:06.799 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:53:06.849 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:53:06.851 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:53:06.897 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:53:06.937 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T11:53:06.993 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:53:06.995 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:53:07.050 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:53:07.052 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:53:07.104 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:53:07.106 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:53:07.157 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:53:07.159 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T11:53:07.208 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-28T11:53:07.209 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-28T11:53:07.223 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T11:53:07.304 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-28T11:53:07.322 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-28T11:53:07.339 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T11:53:07.424 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-28T11:53:07.439 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-28T11:53:07.455 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T11:53:07.586 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-28T11:53:07.601 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:53:07.603 DEBUG:teuthology.orchestra.run.smithi192:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T11:53:07.609 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-28T11:53:07.610 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T11:53:07.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T11:53:07.612 INFO:tasks.ceph.mon.a:Started 2023-11-28T11:53:07.612 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T11:53:07.613 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T11:53:07.652 INFO:tasks.ceph.mon.b:Started 2023-11-28T11:53:07.652 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T11:53:07.652 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T11:53:07.655 INFO:tasks.ceph.mon.c:Started 2023-11-28T11:53:07.655 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-28T11:53:07.655 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-28T11:53:07.656 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-28T11:53:07.662 INFO:tasks.ceph.mgr.y:Started 2023-11-28T11:53:07.663 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-28T11:53:07.663 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-28T11:53:07.666 INFO:tasks.ceph.mgr.x:Started 2023-11-28T11:53:07.666 INFO:tasks.ceph:Setting crush tunables to default 2023-11-28T11:53:07.667 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd crush tunables default 2023-11-28T11:53:07.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.774+0000 7f7b0bfff700 1 Processor -- start 2023-11-28T11:53:07.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.774+0000 7f7b0bfff700 1 -- start start 2023-11-28T11:53:07.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.774+0000 7f7b0bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7b0c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:07.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.774+0000 7f7b0bfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0c06a4d0 con 0x7f7b0c158850 2023-11-28T11:53:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.774+0000 7f7b0bfff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0c0cc1f0 con 0x7f7b0c0cd3a0 2023-11-28T11:53:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.774+0000 7f7b0bfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b0c0cc490 con 0x7f7b0c158480 2023-11-28T11:53:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.774+0000 7f7b027fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7b0c158850 0x7f7b0c0c9410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51122/0 (socket says 172.21.15.50:51122) 2023-11-28T11:53:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.774+0000 7f7b027fc700 1 -- 172.21.15.50:0/2535935387 learned_addr learned my addr 172.21.15.50:0/2535935387 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.774+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7b0c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.778+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7b0c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.778+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7b0c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.778+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7b0c0cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.778+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7b0c0cbcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T11:53:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7b0c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.982+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7b0c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.982+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7b0c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7b0c0cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:07.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7b0c0cbcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T11:53:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:08.386+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7b0c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:08.386+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7b0c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:08.386+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7b0c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:08.386+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7b0c0cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:08.386+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7b0c0cbcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T11:53:09.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:09.190+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7b0c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:09.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:09.190+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7b0c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:09.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:09.190+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7b0c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:09.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:09.190+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7b0c0cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:09.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:09.190+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7b0c0cbcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T11:53:10.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.774+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7b0c0cbcb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:53:10.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.774+0000 7f7b097fa700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7b0c0cbcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:10.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.774+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 >> v1:172.21.15.192:6789/0 conn(0x7f7b0c0cd3a0 legacy=0x7f7b0c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:10.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.774+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 >> v1:172.21.15.50:6789/0 conn(0x7f7b0c158850 legacy=0x7f7b0c0c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:10.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.774+0000 7f7b097fa700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 0x7f7aec005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:10.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.774+0000 7f7b097fa700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 0x7f7aec008710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:10.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.774+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b0c0cc490 con 0x7f7aec006260 2023-11-28T11:53:10.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.774+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec008dd0 con 0x7f7aec0037b0 2023-11-28T11:53:10.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.778+0000 7f7b027fc700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 0x7f7aec008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:10.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.778+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 0x7f7aec005bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:10.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.778+0000 7f7b027fc700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 msgr2=0x7f7aec008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T11:53:10.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.778+0000 7f7b027fc700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 msgr2=0x7f7aec008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:10.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.778+0000 7f7b027fc700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 0x7f7aec008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:10.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.778+0000 7f7b027fc700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 0x7f7aec008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T11:53:10.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.778+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 msgr2=0x7f7aec005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:10.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.778+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 msgr2=0x7f7aec005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:10.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.778+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 0x7f7aec005bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:10.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.778+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 0x7f7aec005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T11:53:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 0x7f7aec005bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.982+0000 7f7b027fc700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 0x7f7aec008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.982+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 msgr2=0x7f7aec005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.982+0000 7f7b027fc700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 msgr2=0x7f7aec008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T11:53:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.982+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 msgr2=0x7f7aec005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.982+0000 7f7b027fc700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 msgr2=0x7f7aec008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.982+0000 7f7b027fc700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 0x7f7aec008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 0x7f7aec005bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.982+0000 7f7b027fc700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 0x7f7aec008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T11:53:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:10.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 0x7f7aec005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T11:53:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:11.386+0000 7f7b027fc700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 0x7f7aec008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:11.386+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 0x7f7aec005bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:11.386+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 msgr2=0x7f7aec005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T11:53:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:11.386+0000 7f7b027fc700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 msgr2=0x7f7aec008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:11.386+0000 7f7b027fc700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 msgr2=0x7f7aec008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:11.386+0000 7f7b027fc700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 0x7f7aec008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:11.386+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 msgr2=0x7f7aec005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:11.386+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 0x7f7aec005bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:11.386+0000 7f7b027fc700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 0x7f7aec008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T11:53:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:11.386+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 0x7f7aec005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T11:53:12.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:12.190+0000 7f7b027fc700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 0x7f7aec008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:12.190+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 0x7f7aec005bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:12.190+0000 7f7b027fc700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 msgr2=0x7f7aec008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:12.190+0000 7f7b027fc700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 msgr2=0x7f7aec008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:12.190+0000 7f7b027fc700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 0x7f7aec008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:12.190+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 msgr2=0x7f7aec005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T11:53:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:12.190+0000 7f7b027fc700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 0x7f7aec008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T11:53:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:12.190+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 msgr2=0x7f7aec005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:12.190+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 0x7f7aec005bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:12.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:12.190+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 0x7f7aec005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T11:53:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.774+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 msgr2=0x7f7aec005bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:53:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.774+0000 7f7b097fa700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0037b0 0x7f7aec005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.774+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 msgr2=0x7f7aec008710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:53:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.774+0000 7f7b097fa700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec006260 0x7f7aec008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.778+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 reap_dead start 2023-11-28T11:53:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.778+0000 7f7b097fa700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7aec00b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.778+0000 7f7b097fa700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 0x7f7aec008220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0c06a720 con 0x7f7aec003ba0 2023-11-28T11:53:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b0c0cc490 con 0x7f7b0c158480 2023-11-28T11:53:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aec008dd0 con 0x7f7aec007da0 2023-11-28T11:53:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.778+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7aec00b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.778+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 0x7f7aec008220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.778+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7aec00b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.778+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7aec00b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.778+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7aec00b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.778+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7aec00b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T11:53:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.778+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T11:53:13.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.778+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:13.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.778+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 0x7f7aec008220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:13.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.778+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 0x7f7aec008220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T11:53:13.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7aec00b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:13.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.982+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7aec00b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:13.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.982+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7aec00b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:13.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7aec00b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:13.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.982+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 0x7f7aec008220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:13.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7aec00b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T11:53:13.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.982+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T11:53:13.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.982+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:13.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.982+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 0x7f7aec008220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:13.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:13.982+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 0x7f7aec008220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T11:53:14.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:14.386+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7aec00b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:14.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:14.386+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 0x7f7aec008220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:14.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:14.386+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7aec00b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T11:53:14.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:14.386+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7aec00b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:14.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:14.386+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7aec00b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:14.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:14.386+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7aec00b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T11:53:14.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:14.386+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:14.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:14.386+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:14.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:14.386+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 0x7f7aec008220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:14.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:14.386+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 0x7f7aec008220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T11:53:15.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:15.190+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7aec00b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:15.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:15.190+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 0x7f7aec008220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:15.190+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7aec00b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:15.190+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7aec00b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:15.190+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7aec00b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:15.190+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7aec00b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T11:53:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:15.190+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T11:53:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:15.190+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:15.190+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 0x7f7aec008220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:15.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:15.190+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 0x7f7aec008220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T11:53:16.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:53:16.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.778+0000 7f7b097fa700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec007da0 0x7f7aec008220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:16.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 msgr2=0x7f7aec00b1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:53:16.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.778+0000 7f7b097fa700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7b0c158480 0x7f7aec00b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:16.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 >> v1:172.21.15.192:6789/0 conn(0x7f7aec003ba0 legacy=0x7f7aec006680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.778+0000 7f7b097fa700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 0x7f7aec00fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aec008970 con 0x7f7aec010270 2023-11-28T11:53:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0cc490 con 0x7f7aec00d7b0 2023-11-28T11:53:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.778+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 0x7f7aec00fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.778+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 msgr2=0x7f7aec00fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:16.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.778+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 msgr2=0x7f7aec00fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:16.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.778+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 0x7f7aec00fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:16.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.778+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 0x7f7aec00fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T11:53:16.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 0x7f7aec00fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:16.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.982+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 msgr2=0x7f7aec00fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:16.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.982+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 msgr2=0x7f7aec00fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:16.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 0x7f7aec00fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:16.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:16.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 0x7f7aec00fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T11:53:17.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:17.386+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 0x7f7aec00fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:17.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:17.386+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 msgr2=0x7f7aec00fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:17.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:17.386+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 msgr2=0x7f7aec00fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:17.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:17.386+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 0x7f7aec00fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:17.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:17.386+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 0x7f7aec00fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T11:53:18.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:18.190+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 0x7f7aec00fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:18.190+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 msgr2=0x7f7aec00fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:18.190+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 msgr2=0x7f7aec00fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:18.190+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 0x7f7aec00fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:18.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:18.190+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 0x7f7aec00fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T11:53:19.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 msgr2=0x7f7aec00fb90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:53:19.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b097fa700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec00d7b0 0x7f7aec00fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:19.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 >> v1:172.21.15.50:6789/0 conn(0x7f7aec010270 legacy=0x7f7aec012680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:19.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 reap_dead start 2023-11-28T11:53:19.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b097fa700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 0x7f7aec008220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:19.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b097fa700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 0x7f7aec012680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:19.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aec014fc0 con 0x7f7aec013ff0 2023-11-28T11:53:19.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b0c0cc490 con 0x7f7aec00fb90 2023-11-28T11:53:19.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aec008dd0 con 0x7f7aec003ba0 2023-11-28T11:53:19.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 0x7f7aec012680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:19.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 0x7f7aec008220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:19.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 msgr2=0x7f7aec012680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T11:53:19.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 msgr2=0x7f7aec012680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:19.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 0x7f7aec012680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:19.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 0x7f7aec012680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T11:53:19.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:19.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:19.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 0x7f7aec008220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:19.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.778+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 0x7f7aec008220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T11:53:19.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.982+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 0x7f7aec012680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:19.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 0x7f7aec008220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:19.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.982+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 msgr2=0x7f7aec012680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T11:53:19.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.982+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 msgr2=0x7f7aec012680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:19.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.982+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 0x7f7aec012680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:19.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.982+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 0x7f7aec012680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T11:53:19.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.982+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:19.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.982+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:19.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 0x7f7aec008220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:19.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:19.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 0x7f7aec008220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T11:53:20.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:20.386+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 0x7f7aec012680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:20.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:20.386+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 0x7f7aec008220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:20.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:20.386+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 msgr2=0x7f7aec012680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T11:53:20.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:20.386+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 msgr2=0x7f7aec012680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:20.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:20.386+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 0x7f7aec012680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:20.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:20.386+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 0x7f7aec012680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T11:53:20.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:20.386+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:20.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:20.386+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:20.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:20.386+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 0x7f7aec008220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:20.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:20.386+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 0x7f7aec008220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T11:53:21.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:21.190+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 0x7f7aec012680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:21.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:21.190+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 0x7f7aec008220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:21.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:21.190+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 msgr2=0x7f7aec012680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T11:53:21.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:21.190+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 msgr2=0x7f7aec012680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:21.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:21.190+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 0x7f7aec012680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:21.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:21.190+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 0x7f7aec012680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T11:53:21.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:21.190+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:21.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:21.190+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:21.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:21.190+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 0x7f7aec008220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:21.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:21.190+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 0x7f7aec008220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T11:53:22.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 msgr2=0x7f7aec008220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:53:22.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.778+0000 7f7b097fa700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.192:3300/0 conn(0x7f7aec003ba0 0x7f7aec008220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:22.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 msgr2=0x7f7aec012680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:53:22.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.778+0000 7f7b097fa700 1 --2- 172.21.15.50:0/2535935387 >> v2:172.21.15.50:3300/0 conn(0x7f7aec00fb90 0x7f7aec012680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:22.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 >> v1:172.21.15.50:6789/0 conn(0x7f7aec013ff0 legacy=0x7f7aec0143c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:22.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.778+0000 7f7b097fa700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec006680 0x7f7aec006a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:22.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aec012bc0 con 0x7f7aec006f90 2023-11-28T11:53:22.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.778+0000 7f7b097fa700 1 -- 172.21.15.50:0/2535935387 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0cc490 con 0x7f7aec006680 2023-11-28T11:53:22.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.778+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec006680 0x7f7aec006a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:22.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.778+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec006680 msgr2=0x7f7aec006a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:22.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.778+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec006680 msgr2=0x7f7aec006a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:22.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.778+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec006680 0x7f7aec006a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:22.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.778+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec006680 0x7f7aec006a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T11:53:22.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec006680 0x7f7aec006a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:22.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.982+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec006680 msgr2=0x7f7aec006a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T11:53:22.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.982+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec006680 msgr2=0x7f7aec006a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T11:53:22.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec006680 0x7f7aec006a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T11:53:22.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:22.982+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec006680 0x7f7aec006a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T11:53:23.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.078+0000 7f7b0a7fc700 1 -- 172.21.15.50:0/2535935387 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243970457 0 0) 0x7f7aec012bc0 con 0x7f7aec006f90 2023-11-28T11:53:23.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.078+0000 7f7b0a7fc700 1 -- 172.21.15.50:0/2535935387 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7af80035d0 con 0x7f7aec006f90 2023-11-28T11:53:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0a7fc700 1 -- 172.21.15.50:0/2535935387 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2203942270 0 0) 0x7f7af80035d0 con 0x7f7aec006f90 2023-11-28T11:53:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0a7fc700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec006680 msgr2=0x7f7aec006a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:53:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0a7fc700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec006680 0x7f7aec006a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0a7fc700 1 -- 172.21.15.50:0/2535935387 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec00d1f0 con 0x7f7aec006f90 2023-11-28T11:53:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0a7fc700 1 -- 172.21.15.50:0/2535935387 <== mon.1 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f7af4001620 con 0x7f7aec006f90 2023-11-28T11:53:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0a7fc700 1 -- 172.21.15.50:0/2535935387 >> v1:172.21.15.192:6789/0 conn(0x7f7aec006f90 legacy=0x7f7aec007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0b7fe700 1 -- 172.21.15.50:0/2535935387 reap_dead start 2023-11-28T11:53:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0a7fc700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af8003a20 0x7f7af8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0a7fc700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8004870 0x7f7af8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0a7fc700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7af8005270 0x7f7af800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0a7fc700 1 -- 172.21.15.50:0/2535935387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0cc490 con 0x7f7af8004870 2023-11-28T11:53:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0a7fc700 1 -- 172.21.15.50:0/2535935387 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af800c180 con 0x7f7af8003a20 2023-11-28T11:53:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0a7fc700 1 -- 172.21.15.50:0/2535935387 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af800c340 con 0x7f7af8005270 2023-11-28T11:53:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af8003a20 0x7f7af8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b027fc700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8004870 0x7f7af8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7af8005270 0x7f7af800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7af8005270 msgr2=0x7f7af800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7af8005270 0x7f7af800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8004870 msgr2=0x7f7af8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8004870 0x7f7af8004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0affd700 1 -- 172.21.15.50:0/2535935387 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af80035d0 con 0x7f7af8003a20 2023-11-28T11:53:23.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b027fc700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8004870 0x7f7af8004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:53:23.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.086+0000 7f7b0affd700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af8003a20 0x7f7af8003e10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7afc01c710 tx=0x7f7af80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4de3979b7a5fbbf1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:23.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.090+0000 7f7b0a7fc700 1 -- 172.21.15.50:0/2535935387 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc01c310 con 0x7f7af8003a20 2023-11-28T11:53:23.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.090+0000 7f7b0a7fc700 1 -- 172.21.15.50:0/2535935387 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc020040 con 0x7f7af8003a20 2023-11-28T11:53:23.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.090+0000 7f7b0a7fc700 1 -- 172.21.15.50:0/2535935387 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc003780 con 0x7f7af8003a20 2023-11-28T11:53:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.090+0000 7f7b0bfff700 1 -- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af8003a20 msgr2=0x7f7af8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.090+0000 7f7b0bfff700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af8003a20 0x7f7af8003e10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7afc01c710 tx=0x7f7af80058a0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.090+0000 7f7b0bfff700 1 -- 172.21.15.50:0/2535935387 shutdown_connections 2023-11-28T11:53:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.090+0000 7f7b0bfff700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7af8005270 0x7f7af800ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.090+0000 7f7b0bfff700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8004870 0x7f7af8004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.090+0000 7f7b0bfff700 1 --2- 172.21.15.50:0/2535935387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af8003a20 0x7f7af8003e10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.090+0000 7f7b0bfff700 1 -- 172.21.15.50:0/2535935387 >> 172.21.15.50:0/2535935387 conn(0x7f7b0c06c660 msgr2=0x7f7b0c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:23.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.090+0000 7f7b0bfff700 1 -- 172.21.15.50:0/2535935387 shutdown_connections 2023-11-28T11:53:23.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.090+0000 7f7b0bfff700 1 -- 172.21.15.50:0/2535935387 wait complete. 2023-11-28T11:53:23.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.094+0000 7f7b0bfff700 1 Processor -- start 2023-11-28T11:53:23.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.094+0000 7f7b0bfff700 1 -- start start 2023-11-28T11:53:23.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.094+0000 7f7b0bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8003a20 0x7f7b0c148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.094+0000 7f7b0bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af8004870 0x7f7b0c0b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.094+0000 7f7b0bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7af8005270 0x7f7b0c0cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.094+0000 7f7b0bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0c3850 con 0x7f7af8003a20 2023-11-28T11:53:23.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.094+0000 7f7b0bfff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0c28f0 con 0x7f7af8004870 2023-11-28T11:53:23.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.094+0000 7f7b0bfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0c2bd0 con 0x7f7af8005270 2023-11-28T11:53:23.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b0affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8003a20 0x7f7b0c148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b0affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8003a20 0x7f7b0c148180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40222/0 (socket says 172.21.15.50:40222) 2023-11-28T11:53:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b0affd700 1 -- 172.21.15.50:0/1393095489 learned_addr learned my addr 172.21.15.50:0/1393095489 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b0b7fe700 1 --2- 172.21.15.50:0/1393095489 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7af8005270 0x7f7b0c0cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b027fc700 1 --2- 172.21.15.50:0/1393095489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af8004870 0x7f7b0c0b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b0affd700 1 -- 172.21.15.50:0/1393095489 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7af8005270 msgr2=0x7f7b0c0cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b0affd700 1 --2- 172.21.15.50:0/1393095489 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7af8005270 0x7f7b0c0cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b0affd700 1 -- 172.21.15.50:0/1393095489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af8004870 msgr2=0x7f7b0c0b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b0affd700 1 --2- 172.21.15.50:0/1393095489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af8004870 0x7f7b0c0b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b0affd700 1 -- 172.21.15.50:0/1393095489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c06ace0 con 0x7f7af8003a20 2023-11-28T11:53:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b0affd700 1 --2- 172.21.15.50:0/1393095489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8003a20 0x7f7b0c148180 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7afc01cd00 tx=0x7f7afc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:23.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b08ff9700 1 -- 172.21.15.50:0/1393095489 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc006c80 con 0x7f7af8003a20 2023-11-28T11:53:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b08ff9700 1 -- 172.21.15.50:0/1393095489 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc00c040 con 0x7f7af8003a20 2023-11-28T11:53:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b0bfff700 1 -- 172.21.15.50:0/1393095489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0c06aa00 con 0x7f7af8003a20 2023-11-28T11:53:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b08ff9700 1 -- 172.21.15.50:0/1393095489 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc0039c0 con 0x7f7af8003a20 2023-11-28T11:53:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b0bfff700 1 -- 172.21.15.50:0/1393095489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b0c0cbcb0 con 0x7f7af8003a20 2023-11-28T11:53:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b08ff9700 1 -- 172.21.15.50:0/1393095489 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f7afc03a020 con 0x7f7af8003a20 2023-11-28T11:53:23.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b08ff9700 1 -- 172.21.15.50:0/1393095489 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7afc026760 con 0x7f7af8003a20 2023-11-28T11:53:23.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.098+0000 7f7b0bfff700 1 -- 172.21.15.50:0/1393095489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b0c0c3ac0 con 0x7f7af8003a20 2023-11-28T11:53:23.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.106+0000 7f7b08ff9700 1 -- 172.21.15.50:0/1393095489 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f7afc00f040 con 0x7f7af8003a20 2023-11-28T11:53:23.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.182+0000 7f7b0bfff700 1 -- 172.21.15.50:0/1393095489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7b0c072c20 con 0x7f7af8003a20 2023-11-28T11:53:23.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.190+0000 7f7b08ff9700 1 -- 172.21.15.50:0/1393095489 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7afc04a090 con 0x7f7af8003a20 2023-11-28T11:53:23.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.194+0000 7f7b0bfff700 1 -- 172.21.15.50:0/1393095489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8003a20 msgr2=0x7f7b0c148180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.194+0000 7f7b0bfff700 1 --2- 172.21.15.50:0/1393095489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8003a20 0x7f7b0c148180 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7afc01cd00 tx=0x7f7afc004770 comp rx=0 tx=0).stop 2023-11-28T11:53:23.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.194+0000 7f7b0bfff700 1 -- 172.21.15.50:0/1393095489 shutdown_connections 2023-11-28T11:53:23.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.194+0000 7f7b0bfff700 1 --2- 172.21.15.50:0/1393095489 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7af8005270 0x7f7b0c0cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.194+0000 7f7b0bfff700 1 --2- 172.21.15.50:0/1393095489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af8004870 0x7f7b0c0b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.194+0000 7f7b0bfff700 1 --2- 172.21.15.50:0/1393095489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8003a20 0x7f7b0c148180 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.194+0000 7f7b0bfff700 1 -- 172.21.15.50:0/1393095489 >> 172.21.15.50:0/1393095489 conn(0x7f7b0c06c660 msgr2=0x7f7b0c1565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:23.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.194+0000 7f7b0bfff700 1 -- 172.21.15.50:0/1393095489 shutdown_connections 2023-11-28T11:53:23.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:23.194+0000 7f7b0bfff700 1 -- 172.21.15.50:0/1393095489 wait complete. 2023-11-28T11:53:23.199 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2023-11-28T11:53:23.212 INFO:tasks.ceph:check_enable_crimson: False 2023-11-28T11:53:23.212 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-28T11:53:23.212 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:53:23.213 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-28T11:53:23.223 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:53:23.223 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-28T11:53:23.234 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:53:23.234 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-28T11:53:23.291 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:53:23.291 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-28T11:53:23.301 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:53:23.302 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-28T11:53:23.319 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:53:23.319 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-28T11:53:23.376 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:53:23.376 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-28T11:53:23.387 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:53:23.388 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-28T11:53:23.399 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b 0 2023-11-28T11:53:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52cb4ba700 1 Processor -- start 2023-11-28T11:53:23.519 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52cb4ba700 1 -- start start 2023-11-28T11:53:23.520 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52cb4ba700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52c40c9c00 0x7f52c406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.520 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52cb4ba700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c415c160 0x7f52c406ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.520 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52cb4ba700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c406f990 con 0x7f52c40c9fd0 2023-11-28T11:53:23.520 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52cb4ba700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c406a4d0 con 0x7f52c40c9c00 2023-11-28T11:53:23.520 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52cb4ba700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c406f0f0 con 0x7f52c415c160 2023-11-28T11:53:23.520 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52c9cb7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c415c160 0x7f52c406ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.520 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52c9cb7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c415c160 0x7f52c406ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38066/0 (socket says 172.21.15.192:38066) 2023-11-28T11:53:23.520 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52c9cb7700 1 -- 172.21.15.192:0/3934650434 learned_addr learned my addr 172.21.15.192:0/3934650434 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-28T11:53:23.521 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52ca4b8700 1 --2- 172.21.15.192:0/3934650434 >> v2:172.21.15.50:3300/0 conn(0x7f52c40c9c00 0x7f52c406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.521 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52c9cb7700 1 -- 172.21.15.192:0/3934650434 >> v2:172.21.15.50:3300/0 conn(0x7f52c40c9c00 msgr2=0x7f52c406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:23.521 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52c9cb7700 1 --2- 172.21.15.192:0/3934650434 >> v2:172.21.15.50:3300/0 conn(0x7f52c40c9c00 0x7f52c406cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.521 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52c9cb7700 1 -- 172.21.15.192:0/3934650434 >> v1:172.21.15.50:6789/0 conn(0x7f52c40c9fd0 legacy=0x7f52c415fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.521 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52c9cb7700 1 -- 172.21.15.192:0/3934650434 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c406f3d0 con 0x7f52c415c160 2023-11-28T11:53:23.523 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52c9cb7700 1 --2- 172.21.15.192:0/3934650434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c415c160 0x7f52c406ea10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009900 tx=0x7f52b4009c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc08c00e74d25178 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:23.523 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52c94b6700 1 -- 172.21.15.192:0/3934650434 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4011830 con 0x7f52c415c160 2023-11-28T11:53:23.523 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52c94b6700 1 -- 172.21.15.192:0/3934650434 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b4011990 con 0x7f52c415c160 2023-11-28T11:53:23.523 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52c94b6700 1 -- 172.21.15.192:0/3934650434 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4011d40 con 0x7f52c415c160 2023-11-28T11:53:23.523 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52cb4ba700 1 -- 172.21.15.192:0/3934650434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c415c160 msgr2=0x7f52c406ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.523 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52cb4ba700 1 --2- 172.21.15.192:0/3934650434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c415c160 0x7f52c406ea10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009900 tx=0x7f52b4009c10 comp rx=0 tx=0).stop 2023-11-28T11:53:23.523 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52cb4ba700 1 -- 172.21.15.192:0/3934650434 shutdown_connections 2023-11-28T11:53:23.523 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52cb4ba700 1 --2- 172.21.15.192:0/3934650434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c415c160 0x7f52c406ea10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.523 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52cb4ba700 1 --2- 172.21.15.192:0/3934650434 >> v2:172.21.15.50:3300/0 conn(0x7f52c40c9c00 0x7f52c406cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.523 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52cb4ba700 1 -- 172.21.15.192:0/3934650434 >> 172.21.15.192:0/3934650434 conn(0x7f52c40d0240 msgr2=0x7f52c40cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:23.524 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52cb4ba700 1 -- 172.21.15.192:0/3934650434 shutdown_connections 2023-11-28T11:53:23.524 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.516+0000 7f52cb4ba700 1 -- 172.21.15.192:0/3934650434 wait complete. 2023-11-28T11:53:23.524 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52cb4ba700 1 Processor -- start 2023-11-28T11:53:23.524 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52cb4ba700 1 -- start start 2023-11-28T11:53:23.528 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52cb4ba700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c40c9c00 0x7f52c4145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.529 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52cb4ba700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52c40c9fd0 0x7f52c40aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.529 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52cb4ba700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c415c160 0x7f52c40af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.529 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52cb4ba700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40b2420 con 0x7f52c40c9c00 2023-11-28T11:53:23.529 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52cb4ba700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40b2fa0 con 0x7f52c40c9fd0 2023-11-28T11:53:23.529 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52cb4ba700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40b2670 con 0x7f52c415c160 2023-11-28T11:53:23.529 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52cacb9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c415c160 0x7f52c40af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.530 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52c9cb7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52c40c9fd0 0x7f52c40aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.530 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52cacb9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c415c160 0x7f52c40af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38078/0 (socket says 172.21.15.192:38078) 2023-11-28T11:53:23.530 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52cacb9700 1 -- 172.21.15.192:0/3999805859 learned_addr learned my addr 172.21.15.192:0/3999805859 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-28T11:53:23.530 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52ca4b8700 1 --2- 172.21.15.192:0/3999805859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c40c9c00 0x7f52c4145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.530 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52c9cb7700 1 -- 172.21.15.192:0/3999805859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c415c160 msgr2=0x7f52c40af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.530 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52c9cb7700 1 --2- 172.21.15.192:0/3999805859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c415c160 0x7f52c40af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.530 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52c9cb7700 1 -- 172.21.15.192:0/3999805859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c40c9c00 msgr2=0x7f52c4145880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.531 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52c9cb7700 1 --2- 172.21.15.192:0/3999805859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c40c9c00 0x7f52c4145880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.531 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52c9cb7700 1 -- 172.21.15.192:0/3999805859 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b4009510 con 0x7f52c40c9fd0 2023-11-28T11:53:23.531 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52cacb9700 1 --2- 172.21.15.192:0/3999805859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c415c160 0x7f52c40af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:53:23.531 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.520+0000 7f52c9cb7700 1 --2- 172.21.15.192:0/3999805859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52c40c9fd0 0x7f52c40aeb50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f52b4016000 tx=0x7f52b4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:23.531 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.524+0000 7f52baffd700 1 -- 172.21.15.192:0/3999805859 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4004500 con 0x7f52c40c9fd0 2023-11-28T11:53:23.532 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.524+0000 7f52baffd700 1 -- 172.21.15.192:0/3999805859 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b40036c0 con 0x7f52c40c9fd0 2023-11-28T11:53:23.532 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.524+0000 7f52cb4ba700 1 -- 172.21.15.192:0/3999805859 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c40cd910 con 0x7f52c40c9fd0 2023-11-28T11:53:23.532 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.524+0000 7f52baffd700 1 -- 172.21.15.192:0/3999805859 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4003a70 con 0x7f52c40c9fd0 2023-11-28T11:53:23.532 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.524+0000 7f52cb4ba700 1 -- 172.21.15.192:0/3999805859 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c406f6b0 con 0x7f52c40c9fd0 2023-11-28T11:53:23.532 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.524+0000 7f52baffd700 1 -- 172.21.15.192:0/3999805859 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f52b400f050 con 0x7f52c40c9fd0 2023-11-28T11:53:23.532 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.524+0000 7f52baffd700 1 -- 172.21.15.192:0/3999805859 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f52b4021030 con 0x7f52c40c9fd0 2023-11-28T11:53:23.532 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.524+0000 7f52cb4ba700 1 -- 172.21.15.192:0/3999805859 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c40ca450 con 0x7f52c40c9fd0 2023-11-28T11:53:23.532 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.528+0000 7f52baffd700 1 -- 172.21.15.192:0/3999805859 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f52b402b060 con 0x7f52c40c9fd0 2023-11-28T11:53:23.582 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:23.578+0000 7fdfede0f2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T11:53:23.587 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:23.584+0000 7f601c5c52c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T11:53:23.635 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.632+0000 7f52cb4ba700 1 -- 172.21.15.192:0/3999805859 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b", "id": 0} v 0) v1 -- 0x7f52c4072c20 con 0x7f52c40c9fd0 2023-11-28T11:53:23.646 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.640+0000 7f52baffd700 1 -- 172.21.15.192:0/3999805859 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f52b4015020 con 0x7f52c40c9fd0 2023-11-28T11:53:23.647 INFO:teuthology.orchestra.run.smithi192.stdout:0 2023-11-28T11:53:23.648 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.644+0000 7f52cb4ba700 1 -- 172.21.15.192:0/3999805859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52c40c9fd0 msgr2=0x7f52c40aeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.648 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.644+0000 7f52cb4ba700 1 --2- 172.21.15.192:0/3999805859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52c40c9fd0 0x7f52c40aeb50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f52b4016000 tx=0x7f52b4004770 comp rx=0 tx=0).stop 2023-11-28T11:53:23.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.644+0000 7f52cb4ba700 1 -- 172.21.15.192:0/3999805859 shutdown_connections 2023-11-28T11:53:23.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.644+0000 7f52cb4ba700 1 --2- 172.21.15.192:0/3999805859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c415c160 0x7f52c40af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.644+0000 7f52cb4ba700 1 --2- 172.21.15.192:0/3999805859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52c40c9fd0 0x7f52c40aeb50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.644+0000 7f52cb4ba700 1 --2- 172.21.15.192:0/3999805859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c40c9c00 0x7f52c4145880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.644+0000 7f52cb4ba700 1 -- 172.21.15.192:0/3999805859 >> 172.21.15.192:0/3999805859 conn(0x7f52c40d0240 msgr2=0x7f52c406a760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:23.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.644+0000 7f52cb4ba700 1 -- 172.21.15.192:0/3999805859 shutdown_connections 2023-11-28T11:53:23.650 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.644+0000 7f52cb4ba700 1 -- 172.21.15.192:0/3999805859 wait complete. 2023-11-28T11:53:23.659 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new d92f7604-4150-41e8-8401-f6a2a8f2ad5e 1 2023-11-28T11:53:23.768 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.764+0000 7ff871f47700 1 Processor -- start 2023-11-28T11:53:23.768 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.764+0000 7ff871f47700 1 -- start start 2023-11-28T11:53:23.771 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.764+0000 7ff871f47700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff86c158ee0 0x7ff86c0ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.771 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.764+0000 7ff871f47700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff86c0ce230 0x7ff86c0cab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.771 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.764+0000 7ff871f47700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff86c06d1c0 con 0x7ff86c0cd5d0 2023-11-28T11:53:23.771 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.764+0000 7ff871f47700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff86c06e000 con 0x7ff86c158ee0 2023-11-28T11:53:23.771 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.764+0000 7ff871f47700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c0ca3a0 con 0x7ff86c0ce230 2023-11-28T11:53:23.772 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff86bfff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ff86c0cd5d0 0x7ff86c0cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:35622/0 (socket says 172.21.15.192:35622) 2023-11-28T11:53:23.772 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff86bfff700 1 -- 172.21.15.192:0/265130259 learned_addr learned my addr 172.21.15.192:0/265130259 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-11-28T11:53:23.772 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871746700 1 --2- 172.21.15.192:0/265130259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff86c0ce230 0x7ff86c0cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.772 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff870f45700 1 --2- 172.21.15.192:0/265130259 >> v2:172.21.15.50:3300/0 conn(0x7ff86c158ee0 0x7ff86c0ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.772 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff86b7fe700 1 -- 172.21.15.192:0/265130259 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262961257 0 0) 0x7ff860001290 con 0x7ff86c0cd5d0 2023-11-28T11:53:23.772 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871746700 1 -- 172.21.15.192:0/265130259 >> v2:172.21.15.50:3300/0 conn(0x7ff86c158ee0 msgr2=0x7ff86c0ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:23.772 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871746700 1 --2- 172.21.15.192:0/265130259 >> v2:172.21.15.50:3300/0 conn(0x7ff86c158ee0 0x7ff86c0ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.772 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871746700 1 -- 172.21.15.192:0/265130259 >> v1:172.21.15.192:6789/0 conn(0x7ff86c0cd5d0 legacy=0x7ff86c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.772 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871746700 1 -- 172.21.15.192:0/265130259 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c06c920 con 0x7ff86c0ce230 2023-11-28T11:53:23.772 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871746700 1 --2- 172.21.15.192:0/265130259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff86c0ce230 0x7ff86c0cab60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff864009e10 tx=0x7ff86400d540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b475f1ec04e67884 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:23.772 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff86b7fe700 1 -- 172.21.15.192:0/265130259 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864011460 con 0x7ff86c0ce230 2023-11-28T11:53:23.772 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff86b7fe700 1 -- 172.21.15.192:0/265130259 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8640115c0 con 0x7ff86c0ce230 2023-11-28T11:53:23.773 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff86b7fe700 1 -- 172.21.15.192:0/265130259 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864011970 con 0x7ff86c0ce230 2023-11-28T11:53:23.776 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871f47700 1 -- 172.21.15.192:0/265130259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff86c0ce230 msgr2=0x7ff86c0cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.776 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871f47700 1 --2- 172.21.15.192:0/265130259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff86c0ce230 0x7ff86c0cab60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff864009e10 tx=0x7ff86400d540 comp rx=0 tx=0).stop 2023-11-28T11:53:23.776 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871f47700 1 -- 172.21.15.192:0/265130259 shutdown_connections 2023-11-28T11:53:23.776 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871f47700 1 --2- 172.21.15.192:0/265130259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff86c0ce230 0x7ff86c0cab60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.776 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871f47700 1 --2- 172.21.15.192:0/265130259 >> v2:172.21.15.50:3300/0 conn(0x7ff86c158ee0 0x7ff86c0ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.776 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871f47700 1 -- 172.21.15.192:0/265130259 >> 172.21.15.192:0/265130259 conn(0x7ff86c0d0240 msgr2=0x7ff86c0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:23.776 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871f47700 1 -- 172.21.15.192:0/265130259 shutdown_connections 2023-11-28T11:53:23.777 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871f47700 1 -- 172.21.15.192:0/265130259 wait complete. 2023-11-28T11:53:23.777 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871f47700 1 Processor -- start 2023-11-28T11:53:23.777 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871f47700 1 -- start start 2023-11-28T11:53:23.777 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871f47700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff86c0cd5d0 0x7ff86c1537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.777 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871f47700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff86c0ce230 0x7ff86c0c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.777 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871f47700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff86c158ee0 0x7ff86c0c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.777 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871f47700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c0c34a0 con 0x7ff86c158ee0 2023-11-28T11:53:23.777 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871f47700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c0c3780 con 0x7ff86c0ce230 2023-11-28T11:53:23.777 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff871f47700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c0c3a60 con 0x7ff86c0cd5d0 2023-11-28T11:53:23.777 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff870f45700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff86c0cd5d0 0x7ff86c1537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.777 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff870f45700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff86c0cd5d0 0x7ff86c1537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38100/0 (socket says 172.21.15.192:38100) 2023-11-28T11:53:23.777 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff870f45700 1 -- 172.21.15.192:0/4192915485 learned_addr learned my addr 172.21.15.192:0/4192915485 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-28T11:53:23.778 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.768+0000 7ff86bfff700 1 --2- 172.21.15.192:0/4192915485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff86c0ce230 0x7ff86c0c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.778 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.772+0000 7ff871746700 1 --2- 172.21.15.192:0/4192915485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff86c158ee0 0x7ff86c0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.778 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.772+0000 7ff870f45700 1 -- 172.21.15.192:0/4192915485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff86c0ce230 msgr2=0x7ff86c0c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.778 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.772+0000 7ff870f45700 1 --2- 172.21.15.192:0/4192915485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff86c0ce230 0x7ff86c0c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.778 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.772+0000 7ff870f45700 1 -- 172.21.15.192:0/4192915485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff86c158ee0 msgr2=0x7ff86c0c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.778 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.772+0000 7ff870f45700 1 --2- 172.21.15.192:0/4192915485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff86c158ee0 0x7ff86c0c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.778 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.772+0000 7ff870f45700 1 -- 172.21.15.192:0/4192915485 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff864009a70 con 0x7ff86c0cd5d0 2023-11-28T11:53:23.778 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.772+0000 7ff870f45700 1 --2- 172.21.15.192:0/4192915485 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff86c0cd5d0 0x7ff86c1537f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00e840 tx=0x7ff85c00ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:23.778 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.772+0000 7ff8697fa700 1 -- 172.21.15.192:0/4192915485 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0095a0 con 0x7ff86c0cd5d0 2023-11-28T11:53:23.778 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.772+0000 7ff8697fa700 1 -- 172.21.15.192:0/4192915485 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85c00c690 con 0x7ff86c0cd5d0 2023-11-28T11:53:23.778 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.772+0000 7ff871f47700 1 -- 172.21.15.192:0/4192915485 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff86c06cee0 con 0x7ff86c0cd5d0 2023-11-28T11:53:23.779 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.772+0000 7ff8697fa700 1 -- 172.21.15.192:0/4192915485 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c00ca00 con 0x7ff86c0cd5d0 2023-11-28T11:53:23.779 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.772+0000 7ff871f47700 1 -- 172.21.15.192:0/4192915485 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86c06cc00 con 0x7ff86c0cd5d0 2023-11-28T11:53:23.779 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.772+0000 7ff8697fa700 1 -- 172.21.15.192:0/4192915485 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7ff85c019030 con 0x7ff86c0cd5d0 2023-11-28T11:53:23.779 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.772+0000 7ff8697fa700 1 -- 172.21.15.192:0/4192915485 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7ff85c0065f0 con 0x7ff86c0cd5d0 2023-11-28T11:53:23.779 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.772+0000 7ff871f47700 1 -- 172.21.15.192:0/4192915485 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86c0ca640 con 0x7ff86c0cd5d0 2023-11-28T11:53:23.780 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.776+0000 7ff8697fa700 1 -- 172.21.15.192:0/4192915485 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7ff85c021060 con 0x7ff86c0cd5d0 2023-11-28T11:53:23.852 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.848+0000 7ff871f47700 1 -- 172.21.15.192:0/4192915485 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d92f7604-4150-41e8-8401-f6a2a8f2ad5e", "id": 1} v 0) v1 -- 0x7ff86c0b5380 con 0x7ff86c0cd5d0 2023-11-28T11:53:23.859 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.856+0000 7ff8697fa700 1 -- 172.21.15.192:0/4192915485 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d92f7604-4150-41e8-8401-f6a2a8f2ad5e", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff85c017070 con 0x7ff86c0cd5d0 2023-11-28T11:53:23.860 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-11-28T11:53:23.861 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.856+0000 7ff871f47700 1 -- 172.21.15.192:0/4192915485 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff86c0cd5d0 msgr2=0x7ff86c1537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.861 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.856+0000 7ff871f47700 1 --2- 172.21.15.192:0/4192915485 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff86c0cd5d0 0x7ff86c1537f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00e840 tx=0x7ff85c00ec00 comp rx=0 tx=0).stop 2023-11-28T11:53:23.861 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.856+0000 7ff871f47700 1 -- 172.21.15.192:0/4192915485 shutdown_connections 2023-11-28T11:53:23.861 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.856+0000 7ff871f47700 1 --2- 172.21.15.192:0/4192915485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff86c158ee0 0x7ff86c0c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.861 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.856+0000 7ff871f47700 1 --2- 172.21.15.192:0/4192915485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff86c0ce230 0x7ff86c0c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.861 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.856+0000 7ff871f47700 1 --2- 172.21.15.192:0/4192915485 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff86c0cd5d0 0x7ff86c1537f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.862 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.856+0000 7ff871f47700 1 -- 172.21.15.192:0/4192915485 >> 172.21.15.192:0/4192915485 conn(0x7ff86c0d0240 msgr2=0x7ff86c0cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:23.862 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.856+0000 7ff871f47700 1 -- 172.21.15.192:0/4192915485 shutdown_connections 2023-11-28T11:53:23.862 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.856+0000 7ff871f47700 1 -- 172.21.15.192:0/4192915485 wait complete. 2023-11-28T11:53:23.873 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new a9920662-94e8-483e-b324-fb59403d4961 2 2023-11-28T11:53:23.980 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.976+0000 7f432f59e700 1 Processor -- start 2023-11-28T11:53:23.981 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.976+0000 7f432f59e700 1 -- start start 2023-11-28T11:53:23.982 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.976+0000 7f432f59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f433006f010 0x7f4330161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.982 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.976+0000 7f432f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43300cbaf0 0x7f4330163fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.983 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.976+0000 7f432f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433015a3a0 con 0x7f433006a6e0 2023-11-28T11:53:23.983 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.976+0000 7f432f59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43300ca430 con 0x7f433006f010 2023-11-28T11:53:23.983 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.976+0000 7f432f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43300ca710 con 0x7f43300cbaf0 2023-11-28T11:53:23.983 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432dd9b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f433006f010 0x7f4330161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.983 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432ed9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43300cbaf0 0x7f4330163fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.983 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432dd9b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f433006f010 0x7f4330161a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36020/0 (socket says 172.21.15.192:36020) 2023-11-28T11:53:23.983 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432dd9b700 1 -- 172.21.15.192:0/3220115818 learned_addr learned my addr 172.21.15.192:0/3220115818 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-28T11:53:23.983 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432dd9b700 1 -- 172.21.15.192:0/3220115818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43300cbaf0 msgr2=0x7f4330163fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:23.983 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432dd9b700 1 --2- 172.21.15.192:0/3220115818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43300cbaf0 0x7f4330163fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.983 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432dd9b700 1 -- 172.21.15.192:0/3220115818 >> v1:172.21.15.50:6789/0 conn(0x7f433006a6e0 legacy=0x7f433006aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.983 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432dd9b700 1 -- 172.21.15.192:0/3220115818 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43300ca9f0 con 0x7f433006f010 2023-11-28T11:53:23.983 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432dd9b700 1 --2- 172.21.15.192:0/3220115818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f433006f010 0x7f4330161a60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4324009910 tx=0x7f4324009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93ee9c05dcd28f05 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:23.985 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432d59a700 1 -- 172.21.15.192:0/3220115818 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324005e50 con 0x7f433006f010 2023-11-28T11:53:23.985 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432d59a700 1 -- 172.21.15.192:0/3220115818 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4324006030 con 0x7f433006f010 2023-11-28T11:53:23.985 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432d59a700 1 -- 172.21.15.192:0/3220115818 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43240063e0 con 0x7f433006f010 2023-11-28T11:53:23.985 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432f59e700 1 -- 172.21.15.192:0/3220115818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f433006f010 msgr2=0x7f4330161a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.985 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432f59e700 1 --2- 172.21.15.192:0/3220115818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f433006f010 0x7f4330161a60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4324009910 tx=0x7f4324009c20 comp rx=0 tx=0).stop 2023-11-28T11:53:23.985 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432f59e700 1 -- 172.21.15.192:0/3220115818 shutdown_connections 2023-11-28T11:53:23.985 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432f59e700 1 --2- 172.21.15.192:0/3220115818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43300cbaf0 0x7f4330163fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.985 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432f59e700 1 --2- 172.21.15.192:0/3220115818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f433006f010 0x7f4330161a60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.986 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432f59e700 1 -- 172.21.15.192:0/3220115818 >> 172.21.15.192:0/3220115818 conn(0x7f43300d0240 msgr2=0x7f43300cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:23.986 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432f59e700 1 -- 172.21.15.192:0/3220115818 shutdown_connections 2023-11-28T11:53:23.986 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432f59e700 1 -- 172.21.15.192:0/3220115818 wait complete. 2023-11-28T11:53:23.986 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432f59e700 1 Processor -- start 2023-11-28T11:53:23.986 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432f59e700 1 -- start start 2023-11-28T11:53:23.988 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f433006a6e0 0x7f433015d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.988 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f433006f010 0x7f433015a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.988 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43300cbaf0 0x7f43300c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:23.988 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433015aa80 con 0x7f43300cbaf0 2023-11-28T11:53:23.988 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432f59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433015ad00 con 0x7f433006a6e0 2023-11-28T11:53:23.988 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.980+0000 7f432f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433015afe0 con 0x7f433006f010 2023-11-28T11:53:23.988 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f432e59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f433006a6e0 0x7f433015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.988 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f432dd9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f433006f010 0x7f433015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.989 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f432e59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f433006a6e0 0x7f433015d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36024/0 (socket says 172.21.15.192:36024) 2023-11-28T11:53:23.989 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f432e59c700 1 -- 172.21.15.192:0/3932328496 learned_addr learned my addr 172.21.15.192:0/3932328496 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-28T11:53:23.989 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f432ed9d700 1 --2- 172.21.15.192:0/3932328496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43300cbaf0 0x7f43300c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:23.989 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f432e59c700 1 -- 172.21.15.192:0/3932328496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f433006f010 msgr2=0x7f433015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.989 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f432e59c700 1 --2- 172.21.15.192:0/3932328496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f433006f010 0x7f433015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.989 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f432e59c700 1 -- 172.21.15.192:0/3932328496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43300cbaf0 msgr2=0x7f43300c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:23.989 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f432e59c700 1 --2- 172.21.15.192:0/3932328496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43300cbaf0 0x7f43300c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:23.989 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f432e59c700 1 -- 172.21.15.192:0/3932328496 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4324009520 con 0x7f433006a6e0 2023-11-28T11:53:23.989 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f432e59c700 1 --2- 172.21.15.192:0/3932328496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f433006a6e0 0x7f433015d140 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f432000c410 tx=0x7f432000c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:23.989 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f431effd700 1 -- 172.21.15.192:0/3932328496 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43200052d0 con 0x7f433006a6e0 2023-11-28T11:53:23.989 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f431effd700 1 -- 172.21.15.192:0/3932328496 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4320005430 con 0x7f433006a6e0 2023-11-28T11:53:23.990 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f432f59e700 1 -- 172.21.15.192:0/3932328496 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43300cafb0 con 0x7f433006a6e0 2023-11-28T11:53:23.990 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f431effd700 1 -- 172.21.15.192:0/3932328496 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43200055a0 con 0x7f433006a6e0 2023-11-28T11:53:23.990 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f432f59e700 1 -- 172.21.15.192:0/3932328496 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43300cacd0 con 0x7f433006a6e0 2023-11-28T11:53:23.990 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f431effd700 1 -- 172.21.15.192:0/3932328496 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f4320010050 con 0x7f433006a6e0 2023-11-28T11:53:23.990 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f431effd700 1 -- 172.21.15.192:0/3932328496 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f432000ce20 con 0x7f433006a6e0 2023-11-28T11:53:23.990 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.984+0000 7f432f59e700 1 -- 172.21.15.192:0/3932328496 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43300ca070 con 0x7f433006a6e0 2023-11-28T11:53:23.992 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:23.988+0000 7f431effd700 1 -- 172.21.15.192:0/3932328496 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f4320020060 con 0x7f433006a6e0 2023-11-28T11:53:24.068 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.064+0000 7f432f59e700 1 -- 172.21.15.192:0/3932328496 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a9920662-94e8-483e-b324-fb59403d4961", "id": 2} v 0) v1 -- 0x7f43300c2e60 con 0x7f433006a6e0 2023-11-28T11:53:24.075 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.072+0000 7f431effd700 1 -- 172.21.15.192:0/3932328496 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a9920662-94e8-483e-b324-fb59403d4961", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f433015a3a0 con 0x7f433006a6e0 2023-11-28T11:53:24.076 INFO:teuthology.orchestra.run.smithi192.stdout:2 2023-11-28T11:53:24.077 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.072+0000 7f432f59e700 1 -- 172.21.15.192:0/3932328496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f433006a6e0 msgr2=0x7f433015d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.077 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.072+0000 7f432f59e700 1 --2- 172.21.15.192:0/3932328496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f433006a6e0 0x7f433015d140 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f432000c410 tx=0x7f432000c720 comp rx=0 tx=0).stop 2023-11-28T11:53:24.077 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.072+0000 7f432f59e700 1 -- 172.21.15.192:0/3932328496 shutdown_connections 2023-11-28T11:53:24.077 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.072+0000 7f432f59e700 1 --2- 172.21.15.192:0/3932328496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43300cbaf0 0x7f43300c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.077 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.072+0000 7f432f59e700 1 --2- 172.21.15.192:0/3932328496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f433006f010 0x7f433015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.078 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.072+0000 7f432f59e700 1 --2- 172.21.15.192:0/3932328496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f433006a6e0 0x7f433015d140 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.078 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.072+0000 7f432f59e700 1 -- 172.21.15.192:0/3932328496 >> 172.21.15.192:0/3932328496 conn(0x7f43300d0240 msgr2=0x7f43300b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:24.078 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.072+0000 7f432f59e700 1 -- 172.21.15.192:0/3932328496 shutdown_connections 2023-11-28T11:53:24.078 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.072+0000 7f432f59e700 1 -- 172.21.15.192:0/3932328496 wait complete. 2023-11-28T11:53:24.091 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 7a446fd9-2055-4277-a9c4-be3f0f64dcca 3 2023-11-28T11:53:24.200 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e84a44700 1 Processor -- start 2023-11-28T11:53:24.200 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e84a44700 1 -- start start 2023-11-28T11:53:24.202 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e84a44700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8e80158ee0 0x7f8e800ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.202 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e84a44700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8e800cd5d0 0x7f8e800cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.202 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e84a44700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e800ce060 0x7f8e8015c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.203 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e84a44700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8006e000 con 0x7f8e80158ee0 2023-11-28T11:53:24.203 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e84a44700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8006d1c0 con 0x7f8e800cd5d0 2023-11-28T11:53:24.203 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e84a44700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800ce480 con 0x7f8e800ce060 2023-11-28T11:53:24.203 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e7e59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8e800cd5d0 0x7f8e800cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.203 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e7f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e800ce060 0x7f8e8015c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.204 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e7f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e800ce060 0x7f8e8015c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38116/0 (socket says 172.21.15.192:38116) 2023-11-28T11:53:24.204 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e7f59e700 1 -- 172.21.15.192:0/479038710 learned_addr learned my addr 172.21.15.192:0/479038710 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-28T11:53:24.204 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e7ed9d700 1 --2- 172.21.15.192:0/479038710 >> v2:172.21.15.50:3300/0 conn(0x7f8e80158ee0 0x7f8e800ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.204 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e7e59c700 1 -- 172.21.15.192:0/479038710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e800ce060 msgr2=0x7f8e8015c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:24.204 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e7e59c700 1 --2- 172.21.15.192:0/479038710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e800ce060 0x7f8e8015c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.205 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e7e59c700 1 -- 172.21.15.192:0/479038710 >> v2:172.21.15.50:3300/0 conn(0x7f8e80158ee0 msgr2=0x7f8e800ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:24.205 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e7e59c700 1 --2- 172.21.15.192:0/479038710 >> v2:172.21.15.50:3300/0 conn(0x7f8e80158ee0 0x7f8e800ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.205 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.196+0000 7f8e7e59c700 1 -- 172.21.15.192:0/479038710 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e800ca3a0 con 0x7f8e800cd5d0 2023-11-28T11:53:24.205 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e7e59c700 1 --2- 172.21.15.192:0/479038710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e800cd5d0 0x7f8e800cdb20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8e8015d8f0 tx=0x7f8e74009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fb3b8c4e180fc96 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:24.205 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e7dd9b700 1 -- 172.21.15.192:0/479038710 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e74005e50 con 0x7f8e800cd5d0 2023-11-28T11:53:24.206 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e7dd9b700 1 -- 172.21.15.192:0/479038710 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e74006030 con 0x7f8e800cd5d0 2023-11-28T11:53:24.206 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e7dd9b700 1 -- 172.21.15.192:0/479038710 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e740063c0 con 0x7f8e800cd5d0 2023-11-28T11:53:24.207 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:24.202+0000 7fdfede0f2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T11:53:24.209 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e84a44700 1 -- 172.21.15.192:0/479038710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e800cd5d0 msgr2=0x7f8e800cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.209 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e84a44700 1 --2- 172.21.15.192:0/479038710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e800cd5d0 0x7f8e800cdb20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8e8015d8f0 tx=0x7f8e74009b20 comp rx=0 tx=0).stop 2023-11-28T11:53:24.209 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e84a44700 1 -- 172.21.15.192:0/479038710 shutdown_connections 2023-11-28T11:53:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e84a44700 1 --2- 172.21.15.192:0/479038710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e800ce060 0x7f8e8015c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e84a44700 1 --2- 172.21.15.192:0/479038710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e800cd5d0 0x7f8e800cdb20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e84a44700 1 --2- 172.21.15.192:0/479038710 >> v2:172.21.15.50:3300/0 conn(0x7f8e80158ee0 0x7f8e800ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e84a44700 1 -- 172.21.15.192:0/479038710 >> 172.21.15.192:0/479038710 conn(0x7f8e800d0240 msgr2=0x7f8e800cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e84a44700 1 -- 172.21.15.192:0/479038710 shutdown_connections 2023-11-28T11:53:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e84a44700 1 -- 172.21.15.192:0/479038710 wait complete. 2023-11-28T11:53:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e84a44700 1 Processor -- start 2023-11-28T11:53:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e84a44700 1 -- start start 2023-11-28T11:53:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e84a44700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e800cd5d0 0x7f8e801565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e84a44700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e800ce060 0x7f8e801f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.211 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e84a44700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e80158ee0 0x7f8e801f11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.211 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e84a44700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e801f1700 con 0x7f8e80158ee0 2023-11-28T11:53:24.211 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e84a44700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e801406f0 con 0x7f8e800ce060 2023-11-28T11:53:24.211 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e84a44700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e801409d0 con 0x7f8e800cd5d0 2023-11-28T11:53:24.211 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e7e59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e800ce060 0x7f8e801f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.211 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e7ed9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e800cd5d0 0x7f8e801565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.211 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e7e59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e800ce060 0x7f8e801f0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36046/0 (socket says 172.21.15.192:36046) 2023-11-28T11:53:24.211 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e7e59c700 1 -- 172.21.15.192:0/1029424753 learned_addr learned my addr 172.21.15.192:0/1029424753 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-28T11:53:24.211 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e7f59e700 1 --2- 172.21.15.192:0/1029424753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e80158ee0 0x7f8e801f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.211 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e7ed9d700 1 -- 172.21.15.192:0/1029424753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e800ce060 msgr2=0x7f8e801f0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.211 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e7ed9d700 1 --2- 172.21.15.192:0/1029424753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e800ce060 0x7f8e801f0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.211 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e7ed9d700 1 -- 172.21.15.192:0/1029424753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e80158ee0 msgr2=0x7f8e801f11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e7ed9d700 1 --2- 172.21.15.192:0/1029424753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e80158ee0 0x7f8e801f11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e7ed9d700 1 -- 172.21.15.192:0/1029424753 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e74009450 con 0x7f8e800cd5d0 2023-11-28T11:53:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e7f59e700 1 --2- 172.21.15.192:0/1029424753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e80158ee0 0x7f8e801f11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:53:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.200+0000 7f8e7ed9d700 1 --2- 172.21.15.192:0/1029424753 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e800cd5d0 0x7f8e801565a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000d620 tx=0x7f8e7000d930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.204+0000 7f8e677fe700 1 -- 172.21.15.192:0/1029424753 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e700125f0 con 0x7f8e800cd5d0 2023-11-28T11:53:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.204+0000 7f8e677fe700 1 -- 172.21.15.192:0/1029424753 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e70012750 con 0x7f8e800cd5d0 2023-11-28T11:53:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.204+0000 7f8e84a44700 1 -- 172.21.15.192:0/1029424753 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8006cc00 con 0x7f8e800cd5d0 2023-11-28T11:53:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.204+0000 7f8e677fe700 1 -- 172.21.15.192:0/1029424753 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70012b00 con 0x7f8e800cd5d0 2023-11-28T11:53:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.204+0000 7f8e84a44700 1 -- 172.21.15.192:0/1029424753 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8006c920 con 0x7f8e800cd5d0 2023-11-28T11:53:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.204+0000 7f8e677fe700 1 -- 172.21.15.192:0/1029424753 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f8e70013480 con 0x7f8e800cd5d0 2023-11-28T11:53:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.204+0000 7f8e677fe700 1 -- 172.21.15.192:0/1029424753 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f8e70013ba0 con 0x7f8e800cd5d0 2023-11-28T11:53:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.204+0000 7f8e84a44700 1 -- 172.21.15.192:0/1029424753 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8006cee0 con 0x7f8e800cd5d0 2023-11-28T11:53:24.213 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.208+0000 7f8e677fe700 1 -- 172.21.15.192:0/1029424753 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f8e70013710 con 0x7f8e800cd5d0 2023-11-28T11:53:24.213 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:24.208+0000 7f601c5c52c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T11:53:24.264 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:24.262+0000 7fdfede0f2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T11:53:24.272 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:24.268+0000 7f601c5c52c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T11:53:24.290 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.284+0000 7f8e84a44700 1 -- 172.21.15.192:0/1029424753 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7a446fd9-2055-4277-a9c4-be3f0f64dcca", "id": 3} v 0) v1 -- 0x7f8e80072c20 con 0x7f8e800cd5d0 2023-11-28T11:53:24.297 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.292+0000 7f8e677fe700 1 -- 172.21.15.192:0/1029424753 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7a446fd9-2055-4277-a9c4-be3f0f64dcca", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e700139e0 con 0x7f8e800cd5d0 2023-11-28T11:53:24.298 INFO:teuthology.orchestra.run.smithi192.stdout:3 2023-11-28T11:53:24.299 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.296+0000 7f8e84a44700 1 -- 172.21.15.192:0/1029424753 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e800cd5d0 msgr2=0x7f8e801565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.299 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.296+0000 7f8e84a44700 1 --2- 172.21.15.192:0/1029424753 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e800cd5d0 0x7f8e801565a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000d620 tx=0x7f8e7000d930 comp rx=0 tx=0).stop 2023-11-28T11:53:24.299 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.296+0000 7f8e84a44700 1 -- 172.21.15.192:0/1029424753 shutdown_connections 2023-11-28T11:53:24.299 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.296+0000 7f8e84a44700 1 --2- 172.21.15.192:0/1029424753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e80158ee0 0x7f8e801f11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.299 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.296+0000 7f8e84a44700 1 --2- 172.21.15.192:0/1029424753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e800ce060 0x7f8e801f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.299 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.296+0000 7f8e84a44700 1 --2- 172.21.15.192:0/1029424753 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e800cd5d0 0x7f8e801565a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.299 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.296+0000 7f8e84a44700 1 -- 172.21.15.192:0/1029424753 >> 172.21.15.192:0/1029424753 conn(0x7f8e800d0240 msgr2=0x7f8e800caa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:24.300 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.296+0000 7f8e84a44700 1 -- 172.21.15.192:0/1029424753 shutdown_connections 2023-11-28T11:53:24.300 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.296+0000 7f8e84a44700 1 -- 172.21.15.192:0/1029424753 wait complete. 2023-11-28T11:53:24.312 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new e89c0dfe-09e0-45ac-acaf-e20e49031624 4 2023-11-28T11:53:24.384 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:24.382+0000 7fdfede0f2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T11:53:24.388 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:24.384+0000 7f601c5c52c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T11:53:24.429 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.424+0000 7f0b56e66700 1 Processor -- start 2023-11-28T11:53:24.429 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.424+0000 7f0b56e66700 1 -- start start 2023-11-28T11:53:24.431 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b56e66700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b5006e530 0x7f0b5006e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.432 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b56e66700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0b500ccbf0 0x7f0b50070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.432 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b56e66700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0b5015dbf0 0x7f0b5015e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.432 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b56e66700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b500ce810 con 0x7f0b500ccbf0 2023-11-28T11:53:24.432 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b56e66700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5006ee40 con 0x7f0b5015dbf0 2023-11-28T11:53:24.432 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b56e66700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500cc070 con 0x7f0b5006e530 2023-11-28T11:53:24.432 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b54c02700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b5006e530 0x7f0b5006e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.432 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b55403700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0b5015dbf0 0x7f0b5015e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.432 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b54c02700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b5006e530 0x7f0b5006e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38136/0 (socket says 172.21.15.192:38136) 2023-11-28T11:53:24.432 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b54c02700 1 -- 172.21.15.192:0/2938952819 learned_addr learned my addr 172.21.15.192:0/2938952819 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-28T11:53:24.432 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b4ffff700 1 --2- 172.21.15.192:0/2938952819 >> v2:172.21.15.50:3300/0 conn(0x7f0b500ccbf0 0x7f0b50070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.432 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b55403700 1 -- 172.21.15.192:0/2938952819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b5006e530 msgr2=0x7f0b5006e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:24.433 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b55403700 1 --2- 172.21.15.192:0/2938952819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b5006e530 0x7f0b5006e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.433 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b55403700 1 -- 172.21.15.192:0/2938952819 >> v2:172.21.15.50:3300/0 conn(0x7f0b500ccbf0 msgr2=0x7f0b50070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:24.433 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b55403700 1 --2- 172.21.15.192:0/2938952819 >> v2:172.21.15.50:3300/0 conn(0x7f0b500ccbf0 0x7f0b50070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.433 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b55403700 1 -- 172.21.15.192:0/2938952819 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b500cc350 con 0x7f0b5015dbf0 2023-11-28T11:53:24.433 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b54c02700 1 --2- 172.21.15.192:0/2938952819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b5006e530 0x7f0b5006e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:53:24.433 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b55403700 1 --2- 172.21.15.192:0/2938952819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b5015dbf0 0x7f0b5015e070 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009d90 tx=0x7f0b4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8a6d161dd60c8fd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:24.433 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b4f7fe700 1 -- 172.21.15.192:0/2938952819 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4800e070 con 0x7f0b5015dbf0 2023-11-28T11:53:24.433 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b4f7fe700 1 -- 172.21.15.192:0/2938952819 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4800bae0 con 0x7f0b5015dbf0 2023-11-28T11:53:24.433 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b4f7fe700 1 -- 172.21.15.192:0/2938952819 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4800be90 con 0x7f0b5015dbf0 2023-11-28T11:53:24.434 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b56e66700 1 -- 172.21.15.192:0/2938952819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b5015dbf0 msgr2=0x7f0b5015e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.434 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b56e66700 1 --2- 172.21.15.192:0/2938952819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b5015dbf0 0x7f0b5015e070 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009d90 tx=0x7f0b4800b330 comp rx=0 tx=0).stop 2023-11-28T11:53:24.434 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b56e66700 1 -- 172.21.15.192:0/2938952819 shutdown_connections 2023-11-28T11:53:24.434 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b56e66700 1 --2- 172.21.15.192:0/2938952819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b5015dbf0 0x7f0b5015e070 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.435 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b56e66700 1 --2- 172.21.15.192:0/2938952819 >> v2:172.21.15.50:3300/0 conn(0x7f0b500ccbf0 0x7f0b50070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.435 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b56e66700 1 --2- 172.21.15.192:0/2938952819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b5006e530 0x7f0b5006e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.435 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b56e66700 1 -- 172.21.15.192:0/2938952819 >> 172.21.15.192:0/2938952819 conn(0x7f0b500cdef0 msgr2=0x7f0b500d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:24.435 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b56e66700 1 -- 172.21.15.192:0/2938952819 shutdown_connections 2023-11-28T11:53:24.435 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.428+0000 7f0b56e66700 1 -- 172.21.15.192:0/2938952819 wait complete. 2023-11-28T11:53:24.435 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b56e66700 1 Processor -- start 2023-11-28T11:53:24.435 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b56e66700 1 -- start start 2023-11-28T11:53:24.437 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b56e66700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b5006e530 0x7f0b501ef610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.437 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b56e66700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b500ccbf0 0x7f0b5015d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.438 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b56e66700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5015dbf0 0x7f0b500b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.438 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b56e66700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50157860 con 0x7f0b5015dbf0 2023-11-28T11:53:24.438 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b56e66700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50157b40 con 0x7f0b500ccbf0 2023-11-28T11:53:24.438 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b56e66700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50157e20 con 0x7f0b5006e530 2023-11-28T11:53:24.438 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b54c02700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b5006e530 0x7f0b501ef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.438 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b54c02700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b5006e530 0x7f0b501ef610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38140/0 (socket says 172.21.15.192:38140) 2023-11-28T11:53:24.438 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b54c02700 1 -- 172.21.15.192:0/869382186 learned_addr learned my addr 172.21.15.192:0/869382186 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-28T11:53:24.438 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b4ffff700 1 --2- 172.21.15.192:0/869382186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b500ccbf0 0x7f0b5015d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.438 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b55403700 1 --2- 172.21.15.192:0/869382186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5015dbf0 0x7f0b500b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.438 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b54c02700 1 -- 172.21.15.192:0/869382186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b500ccbf0 msgr2=0x7f0b5015d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.439 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b54c02700 1 --2- 172.21.15.192:0/869382186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b500ccbf0 0x7f0b5015d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.439 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b54c02700 1 -- 172.21.15.192:0/869382186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5015dbf0 msgr2=0x7f0b500b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.439 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b54c02700 1 --2- 172.21.15.192:0/869382186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5015dbf0 0x7f0b500b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.439 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b54c02700 1 -- 172.21.15.192:0/869382186 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b44009570 con 0x7f0b5006e530 2023-11-28T11:53:24.439 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b54c02700 1 --2- 172.21.15.192:0/869382186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b5006e530 0x7f0b501ef610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400ebb0 tx=0x7f0b4400eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:24.439 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b4d7fa700 1 -- 172.21.15.192:0/869382186 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44004030 con 0x7f0b5006e530 2023-11-28T11:53:24.439 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b4d7fa700 1 -- 172.21.15.192:0/869382186 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b44004190 con 0x7f0b5006e530 2023-11-28T11:53:24.439 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b4d7fa700 1 -- 172.21.15.192:0/869382186 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44004520 con 0x7f0b5006e530 2023-11-28T11:53:24.439 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b56e66700 1 -- 172.21.15.192:0/869382186 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b48009a70 con 0x7f0b5006e530 2023-11-28T11:53:24.439 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b56e66700 1 -- 172.21.15.192:0/869382186 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b500cc910 con 0x7f0b5006e530 2023-11-28T11:53:24.439 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b4d7fa700 1 -- 172.21.15.192:0/869382186 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f0b44019070 con 0x7f0b5006e530 2023-11-28T11:53:24.440 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b4d7fa700 1 -- 172.21.15.192:0/869382186 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f0b4400cda0 con 0x7f0b5006e530 2023-11-28T11:53:24.440 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.432+0000 7f0b56e66700 1 -- 172.21.15.192:0/869382186 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b500cc630 con 0x7f0b5006e530 2023-11-28T11:53:24.441 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.436+0000 7f0b4d7fa700 1 -- 172.21.15.192:0/869382186 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f0b44020060 con 0x7f0b5006e530 2023-11-28T11:53:24.516 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.512+0000 7f0b56e66700 1 -- 172.21.15.192:0/869382186 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e89c0dfe-09e0-45ac-acaf-e20e49031624", "id": 4} v 0) v1 -- 0x7f0b50070990 con 0x7f0b5006e530 2023-11-28T11:53:24.523 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.520+0000 7f0b4d7fa700 1 -- 172.21.15.192:0/869382186 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e89c0dfe-09e0-45ac-acaf-e20e49031624", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0b44028020 con 0x7f0b5006e530 2023-11-28T11:53:24.523 INFO:teuthology.orchestra.run.smithi192.stdout:4 2023-11-28T11:53:24.525 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.520+0000 7f0b56e66700 1 -- 172.21.15.192:0/869382186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b5006e530 msgr2=0x7f0b501ef610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.525 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.520+0000 7f0b56e66700 1 --2- 172.21.15.192:0/869382186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b5006e530 0x7f0b501ef610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400ebb0 tx=0x7f0b4400eec0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.526 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.520+0000 7f0b56e66700 1 -- 172.21.15.192:0/869382186 shutdown_connections 2023-11-28T11:53:24.526 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.520+0000 7f0b56e66700 1 --2- 172.21.15.192:0/869382186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5015dbf0 0x7f0b500b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.526 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.520+0000 7f0b56e66700 1 --2- 172.21.15.192:0/869382186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b500ccbf0 0x7f0b5015d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.526 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.520+0000 7f0b56e66700 1 --2- 172.21.15.192:0/869382186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b5006e530 0x7f0b501ef610 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.526 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.520+0000 7f0b56e66700 1 -- 172.21.15.192:0/869382186 >> 172.21.15.192:0/869382186 conn(0x7f0b500cdef0 msgr2=0x7f0b50155c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:24.526 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.520+0000 7f0b56e66700 1 -- 172.21.15.192:0/869382186 shutdown_connections 2023-11-28T11:53:24.526 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.520+0000 7f0b56e66700 1 -- 172.21.15.192:0/869382186 wait complete. 2023-11-28T11:53:24.541 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 24415425-6f2e-476b-ac4f-2070288bf4b1 5 2023-11-28T11:53:24.616 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:24.612+0000 7f601c5c52c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T11:53:24.632 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:24.630+0000 7fdfede0f2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T11:53:24.647 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f557b59e700 1 Processor -- start 2023-11-28T11:53:24.648 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f557b59e700 1 -- start start 2023-11-28T11:53:24.648 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f557b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f557c0d31b0 0x7f557c0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.648 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f557b59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f557c0cf470 0x7f557c0cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.648 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f557b59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557c06a7f0 con 0x7f557c06ce60 2023-11-28T11:53:24.648 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f557b59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557c15c8b0 con 0x7f557c0cf470 2023-11-28T11:53:24.648 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f557b59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0d3620 con 0x7f557c0d31b0 2023-11-28T11:53:24.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f5579d9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f557c0d31b0 0x7f557c0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f557ad9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f557c0cf470 0x7f557c0cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f557a59c700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f557c06ce60 0x7f557c06d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:35638/0 (socket says 172.21.15.192:35638) 2023-11-28T11:53:24.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f557a59c700 1 -- 172.21.15.192:0/299378171 learned_addr learned my addr 172.21.15.192:0/299378171 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-11-28T11:53:24.650 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f5579d9b700 1 -- 172.21.15.192:0/299378171 >> v2:172.21.15.192:3300/0 conn(0x7f557c0cf470 msgr2=0x7f557c0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:24.650 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f5579d9b700 1 --2- 172.21.15.192:0/299378171 >> v2:172.21.15.192:3300/0 conn(0x7f557c0cf470 0x7f557c0cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.650 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f5579d9b700 1 -- 172.21.15.192:0/299378171 >> v1:172.21.15.192:6789/0 conn(0x7f557c06ce60 legacy=0x7f557c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.650 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f5579d9b700 1 -- 172.21.15.192:0/299378171 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c06aad0 con 0x7f557c0d31b0 2023-11-28T11:53:24.651 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f5579d9b700 1 --2- 172.21.15.192:0/299378171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f557c0d31b0 0x7f557c0cce60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5570009850 tx=0x7f5570009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51461e8adfe74f25 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:24.651 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f557959a700 1 -- 172.21.15.192:0/299378171 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570011830 con 0x7f557c0d31b0 2023-11-28T11:53:24.651 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f557959a700 1 -- 172.21.15.192:0/299378171 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5570011990 con 0x7f557c0d31b0 2023-11-28T11:53:24.651 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.644+0000 7f557959a700 1 -- 172.21.15.192:0/299378171 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570011d40 con 0x7f557c0d31b0 2023-11-28T11:53:24.651 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.648+0000 7f557b59e700 1 -- 172.21.15.192:0/299378171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f557c0d31b0 msgr2=0x7f557c0cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.651 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.648+0000 7f557b59e700 1 --2- 172.21.15.192:0/299378171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f557c0d31b0 0x7f557c0cce60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5570009850 tx=0x7f5570009b60 comp rx=0 tx=0).stop 2023-11-28T11:53:24.651 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.648+0000 7f557b59e700 1 -- 172.21.15.192:0/299378171 shutdown_connections 2023-11-28T11:53:24.651 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.648+0000 7f557b59e700 1 --2- 172.21.15.192:0/299378171 >> v2:172.21.15.192:3300/0 conn(0x7f557c0cf470 0x7f557c0cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.651 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.648+0000 7f557b59e700 1 --2- 172.21.15.192:0/299378171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f557c0d31b0 0x7f557c0cce60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.651 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.648+0000 7f557b59e700 1 -- 172.21.15.192:0/299378171 >> 172.21.15.192:0/299378171 conn(0x7f557c0b5760 msgr2=0x7f557c0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:24.651 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.648+0000 7f557b59e700 1 -- 172.21.15.192:0/299378171 shutdown_connections 2023-11-28T11:53:24.651 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.648+0000 7f557b59e700 1 -- 172.21.15.192:0/299378171 wait complete. 2023-11-28T11:53:24.652 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.648+0000 7f557b59e700 1 Processor -- start 2023-11-28T11:53:24.652 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.648+0000 7f557b59e700 1 -- start start 2023-11-28T11:53:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.648+0000 7f557b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557c06ce60 0x7f557c0c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.648+0000 7f557b59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f557c0cf470 0x7f557c14bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.648+0000 7f557b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f557c0d31b0 0x7f557c15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.648+0000 7f557b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c14c180 con 0x7f557c06ce60 2023-11-28T11:53:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.648+0000 7f557b59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c15f9e0 con 0x7f557c0cf470 2023-11-28T11:53:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.648+0000 7f557b59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0c79e0 con 0x7f557c0d31b0 2023-11-28T11:53:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f5579d9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f557c0cf470 0x7f557c14bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f557ad9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f557c0d31b0 0x7f557c15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f5579d9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f557c0cf470 0x7f557c14bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36084/0 (socket says 172.21.15.192:36084) 2023-11-28T11:53:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f5579d9b700 1 -- 172.21.15.192:0/3914825808 learned_addr learned my addr 172.21.15.192:0/3914825808 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-28T11:53:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f557a59c700 1 --2- 172.21.15.192:0/3914825808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557c06ce60 0x7f557c0c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f5579d9b700 1 -- 172.21.15.192:0/3914825808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f557c0d31b0 msgr2=0x7f557c15f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f5579d9b700 1 --2- 172.21.15.192:0/3914825808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f557c0d31b0 0x7f557c15f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f5579d9b700 1 -- 172.21.15.192:0/3914825808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557c06ce60 msgr2=0x7f557c0c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f5579d9b700 1 --2- 172.21.15.192:0/3914825808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557c06ce60 0x7f557c0c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f5579d9b700 1 -- 172.21.15.192:0/3914825808 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55700094b0 con 0x7f557c0cf470 2023-11-28T11:53:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f5579d9b700 1 --2- 172.21.15.192:0/3914825808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f557c0cf470 0x7f557c14bc40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f55700090b0 tx=0x7f5570004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f556affd700 1 -- 172.21.15.192:0/3914825808 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570004520 con 0x7f557c0cf470 2023-11-28T11:53:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f556affd700 1 -- 172.21.15.192:0/3914825808 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557001f070 con 0x7f557c0cf470 2023-11-28T11:53:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f556affd700 1 -- 172.21.15.192:0/3914825808 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700038e0 con 0x7f557c0cf470 2023-11-28T11:53:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f557b59e700 1 -- 172.21.15.192:0/3914825808 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557c06b090 con 0x7f557c0cf470 2023-11-28T11:53:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f557b59e700 1 -- 172.21.15.192:0/3914825808 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557c06adb0 con 0x7f557c0cf470 2023-11-28T11:53:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f556affd700 1 -- 172.21.15.192:0/3914825808 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f557000f050 con 0x7f557c0cf470 2023-11-28T11:53:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f556affd700 1 -- 172.21.15.192:0/3914825808 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f5570021070 con 0x7f557c0cf470 2023-11-28T11:53:24.658 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.652+0000 7f557b59e700 1 -- 172.21.15.192:0/3914825808 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557c0b6430 con 0x7f557c0cf470 2023-11-28T11:53:24.660 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.656+0000 7f556affd700 1 -- 172.21.15.192:0/3914825808 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f557002b020 con 0x7f557c0cf470 2023-11-28T11:53:24.675 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:24.672+0000 7f601c5c52c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T11:53:24.688 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:24.686+0000 7fdfede0f2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T11:53:24.748 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.744+0000 7f557b59e700 1 -- 172.21.15.192:0/3914825808 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "24415425-6f2e-476b-ac4f-2070288bf4b1", "id": 5} v 0) v1 -- 0x7f557c072c20 con 0x7f557c0cf470 2023-11-28T11:53:24.755 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.752+0000 7f556affd700 1 -- 172.21.15.192:0/3914825808 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "24415425-6f2e-476b-ac4f-2070288bf4b1", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5570015020 con 0x7f557c0cf470 2023-11-28T11:53:24.755 INFO:teuthology.orchestra.run.smithi192.stdout:5 2023-11-28T11:53:24.756 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.752+0000 7f557b59e700 1 -- 172.21.15.192:0/3914825808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f557c0cf470 msgr2=0x7f557c14bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.756 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.752+0000 7f557b59e700 1 --2- 172.21.15.192:0/3914825808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f557c0cf470 0x7f557c14bc40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f55700090b0 tx=0x7f5570004770 comp rx=0 tx=0).stop 2023-11-28T11:53:24.756 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.752+0000 7f557b59e700 1 -- 172.21.15.192:0/3914825808 shutdown_connections 2023-11-28T11:53:24.756 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.752+0000 7f557b59e700 1 --2- 172.21.15.192:0/3914825808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f557c0d31b0 0x7f557c15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.757 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.752+0000 7f557b59e700 1 --2- 172.21.15.192:0/3914825808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f557c0cf470 0x7f557c14bc40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.757 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.752+0000 7f557b59e700 1 --2- 172.21.15.192:0/3914825808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f557c06ce60 0x7f557c0c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.757 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.752+0000 7f557b59e700 1 -- 172.21.15.192:0/3914825808 >> 172.21.15.192:0/3914825808 conn(0x7f557c0b5760 msgr2=0x7f557c06d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:24.757 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.752+0000 7f557b59e700 1 -- 172.21.15.192:0/3914825808 shutdown_connections 2023-11-28T11:53:24.757 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.752+0000 7f557b59e700 1 -- 172.21.15.192:0/3914825808 wait complete. 2023-11-28T11:53:24.767 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 3cf7e094-dd62-4b18-ac4b-5341e17e2e61 6 2023-11-28T11:53:24.866 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bcbfff700 1 Processor -- start 2023-11-28T11:53:24.867 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bcbfff700 1 -- start start 2023-11-28T11:53:24.867 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f601c5c52c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T11:53:24.868 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bcbfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5bcc158ee0 0x7f5bcc0ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bcbfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bcc06d1c0 con 0x7f5bcc0cd5d0 2023-11-28T11:53:24.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bcbfff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bcc0ca3a0 con 0x7f5bcc0ce230 2023-11-28T11:53:24.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bcbfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc06e000 con 0x7f5bcc158ee0 2023-11-28T11:53:24.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bcaffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5bcc158ee0 0x7f5bcc0ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bcb7fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f5bcc0ce230 0x7f5bcc0cab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:35654/0 (socket says 172.21.15.192:35654) 2023-11-28T11:53:24.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bcb7fe700 1 -- 172.21.15.192:0/2271519981 learned_addr learned my addr 172.21.15.192:0/2271519981 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-11-28T11:53:24.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bcaffd700 1 -- 172.21.15.192:0/2271519981 >> v1:172.21.15.192:6789/0 conn(0x7f5bcc0ce230 legacy=0x7f5bcc0cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bcaffd700 1 -- 172.21.15.192:0/2271519981 >> v1:172.21.15.50:6789/0 conn(0x7f5bcc0cd5d0 legacy=0x7f5bcc0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:24.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bc9ffb700 1 -- 172.21.15.192:0/2271519981 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627090881 0 0) 0x7f5bcc0ca3a0 con 0x7f5bcc0ce230 2023-11-28T11:53:24.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bcaffd700 1 -- 172.21.15.192:0/2271519981 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc06c920 con 0x7f5bcc158ee0 2023-11-28T11:53:24.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bcaffd700 1 --2- 172.21.15.192:0/2271519981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5bcc158ee0 0x7f5bcc0ae760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009880 tx=0x7f5bbc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1747c0d6726bdb09 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:24.870 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bc9ffb700 1 -- 172.21.15.192:0/2271519981 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc004230 con 0x7f5bcc158ee0 2023-11-28T11:53:24.870 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bc9ffb700 1 -- 172.21.15.192:0/2271519981 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc004390 con 0x7f5bcc158ee0 2023-11-28T11:53:24.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bc9ffb700 1 -- 172.21.15.192:0/2271519981 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc0036c0 con 0x7f5bcc158ee0 2023-11-28T11:53:24.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bcbfff700 1 -- 172.21.15.192:0/2271519981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5bcc158ee0 msgr2=0x7f5bcc0ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.864+0000 7f5bcbfff700 1 --2- 172.21.15.192:0/2271519981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5bcc158ee0 0x7f5bcc0ae760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009880 tx=0x7f5bbc009b90 comp rx=0 tx=0).stop 2023-11-28T11:53:24.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcbfff700 1 -- 172.21.15.192:0/2271519981 shutdown_connections 2023-11-28T11:53:24.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcbfff700 1 --2- 172.21.15.192:0/2271519981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5bcc158ee0 0x7f5bcc0ae760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcbfff700 1 -- 172.21.15.192:0/2271519981 >> 172.21.15.192:0/2271519981 conn(0x7f5bcc0d0240 msgr2=0x7f5bcc0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:24.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcbfff700 1 -- 172.21.15.192:0/2271519981 shutdown_connections 2023-11-28T11:53:24.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcbfff700 1 -- 172.21.15.192:0/2271519981 wait complete. 2023-11-28T11:53:24.872 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcbfff700 1 Processor -- start 2023-11-28T11:53:24.872 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcbfff700 1 -- start start 2023-11-28T11:53:24.874 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcbfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5bcc0cd5d0 0x7f5bcc0c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.874 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcbfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5bcc0ce230 0x7f5bcc149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.874 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bcc158ee0 0x7f5bcc0b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:24.874 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcbfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc0c7260 con 0x7f5bcc158ee0 2023-11-28T11:53:24.874 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcbfff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc0c8710 con 0x7f5bcc0cd5d0 2023-11-28T11:53:24.874 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcbfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc0c9440 con 0x7f5bcc0ce230 2023-11-28T11:53:24.874 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcaffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5bcc0cd5d0 0x7f5bcc0c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.874 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcaffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5bcc0cd5d0 0x7f5bcc0c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36096/0 (socket says 172.21.15.192:36096) 2023-11-28T11:53:24.874 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcaffd700 1 -- 172.21.15.192:0/1202392273 learned_addr learned my addr 172.21.15.192:0/1202392273 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-28T11:53:24.875 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bca7fc700 1 --2- 172.21.15.192:0/1202392273 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5bcc0ce230 0x7f5bcc149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.875 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcb7fe700 1 --2- 172.21.15.192:0/1202392273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bcc158ee0 0x7f5bcc0b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:24.875 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcaffd700 1 -- 172.21.15.192:0/1202392273 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5bcc0ce230 msgr2=0x7f5bcc149470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.875 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcaffd700 1 --2- 172.21.15.192:0/1202392273 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5bcc0ce230 0x7f5bcc149470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.875 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcaffd700 1 -- 172.21.15.192:0/1202392273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bcc158ee0 msgr2=0x7f5bcc0b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.875 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcaffd700 1 --2- 172.21.15.192:0/1202392273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bcc158ee0 0x7f5bcc0b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.875 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcaffd700 1 -- 172.21.15.192:0/1202392273 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc0094b0 con 0x7f5bcc0cd5d0 2023-11-28T11:53:24.875 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcb7fe700 1 --2- 172.21.15.192:0/1202392273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bcc158ee0 0x7f5bcc0b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:53:24.875 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bcaffd700 1 --2- 172.21.15.192:0/1202392273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5bcc0cd5d0 0x7f5bcc0c6680 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0090b0 tx=0x7f5bbc004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:24.875 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.868+0000 7f5bb37fe700 1 -- 172.21.15.192:0/1202392273 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc006ea0 con 0x7f5bcc0cd5d0 2023-11-28T11:53:24.875 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.872+0000 7f5bb37fe700 1 -- 172.21.15.192:0/1202392273 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc01f070 con 0x7f5bcc0cd5d0 2023-11-28T11:53:24.875 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.872+0000 7f5bcbfff700 1 -- 172.21.15.192:0/1202392273 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bcc06cee0 con 0x7f5bcc0cd5d0 2023-11-28T11:53:24.876 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.872+0000 7f5bb37fe700 1 -- 172.21.15.192:0/1202392273 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc011870 con 0x7f5bcc0cd5d0 2023-11-28T11:53:24.876 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.872+0000 7f5bcbfff700 1 -- 172.21.15.192:0/1202392273 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bcc06cc00 con 0x7f5bcc0cd5d0 2023-11-28T11:53:24.876 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.872+0000 7f5bb37fe700 1 -- 172.21.15.192:0/1202392273 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f5bbc02a020 con 0x7f5bcc0cd5d0 2023-11-28T11:53:24.876 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.872+0000 7f5bb37fe700 1 -- 172.21.15.192:0/1202392273 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f5bbc01b440 con 0x7f5bcc0cd5d0 2023-11-28T11:53:24.876 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.872+0000 7f5bcbfff700 1 -- 172.21.15.192:0/1202392273 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bcc0ca640 con 0x7f5bcc0cd5d0 2023-11-28T11:53:24.879 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.876+0000 7f5bb37fe700 1 -- 172.21.15.192:0/1202392273 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f5bcc06d1c0 con 0x7f5bcc0cd5d0 2023-11-28T11:53:24.883 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:24.878+0000 7fdfede0f2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T11:53:24.935 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:24.932+0000 7f601c5c52c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T11:53:24.953 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:24.950+0000 7fdfede0f2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T11:53:24.954 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.952+0000 7f5bcbfff700 1 -- 172.21.15.192:0/1202392273 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3cf7e094-dd62-4b18-ac4b-5341e17e2e61", "id": 6} v 0) v1 -- 0x7f5bcc072c20 con 0x7f5bcc0cd5d0 2023-11-28T11:53:24.962 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.960+0000 7f5bb37fe700 1 -- 172.21.15.192:0/1202392273 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3cf7e094-dd62-4b18-ac4b-5341e17e2e61", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5bbc02d440 con 0x7f5bcc0cd5d0 2023-11-28T11:53:24.962 INFO:teuthology.orchestra.run.smithi192.stdout:6 2023-11-28T11:53:24.964 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.960+0000 7f5bcbfff700 1 -- 172.21.15.192:0/1202392273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5bcc0cd5d0 msgr2=0x7f5bcc0c6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:24.964 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.960+0000 7f5bcbfff700 1 --2- 172.21.15.192:0/1202392273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5bcc0cd5d0 0x7f5bcc0c6680 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0090b0 tx=0x7f5bbc004770 comp rx=0 tx=0).stop 2023-11-28T11:53:24.964 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.960+0000 7f5bcbfff700 1 -- 172.21.15.192:0/1202392273 shutdown_connections 2023-11-28T11:53:24.964 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.960+0000 7f5bcbfff700 1 --2- 172.21.15.192:0/1202392273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bcc158ee0 0x7f5bcc0b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.964 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.960+0000 7f5bcbfff700 1 --2- 172.21.15.192:0/1202392273 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5bcc0ce230 0x7f5bcc149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.964 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.960+0000 7f5bcbfff700 1 --2- 172.21.15.192:0/1202392273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5bcc0cd5d0 0x7f5bcc0c6680 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:24.964 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.960+0000 7f5bcbfff700 1 -- 172.21.15.192:0/1202392273 >> 172.21.15.192:0/1202392273 conn(0x7f5bcc0d0240 msgr2=0x7f5bcc070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:24.964 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.960+0000 7f5bcbfff700 1 -- 172.21.15.192:0/1202392273 shutdown_connections 2023-11-28T11:53:24.965 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:24.960+0000 7f5bcbfff700 1 -- 172.21.15.192:0/1202392273 wait complete. 2023-11-28T11:53:24.977 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 034395d2-d57d-4f96-bbef-f26ceb8ebc4b 7 2023-11-28T11:53:25.005 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:25.000+0000 7f601c5c52c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T11:53:25.024 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:25.022+0000 7fdfede0f2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T11:53:25.084 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.080+0000 7fb588811700 1 Processor -- start 2023-11-28T11:53:25.084 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.080+0000 7fb588811700 1 -- start start 2023-11-28T11:53:25.086 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.080+0000 7fb588811700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb58406e530 0x7fb58406e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:25.086 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.080+0000 7fb588811700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5840ceca0 0x7fb5840cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:25.086 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.080+0000 7fb588811700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb584070b60 con 0x7fb5840ccbf0 2023-11-28T11:53:25.087 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.080+0000 7fb588811700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5840ce810 con 0x7fb58406e530 2023-11-28T11:53:25.087 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.080+0000 7fb588811700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58406ee40 con 0x7fb5840ceca0 2023-11-28T11:53:25.087 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.080+0000 7fb581d9b700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb5840ccbf0 0x7fb584070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:35658/0 (socket says 172.21.15.192:35658) 2023-11-28T11:53:25.087 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.080+0000 7fb581d9b700 1 -- 172.21.15.192:0/2489492864 learned_addr learned my addr 172.21.15.192:0/2489492864 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-11-28T11:53:25.087 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.080+0000 7fb58259c700 1 --2- 172.21.15.192:0/2489492864 >> v2:172.21.15.192:3300/0 conn(0x7fb58406e530 0x7fb58406e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:25.087 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.080+0000 7fb582d9d700 1 --2- 172.21.15.192:0/2489492864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5840ceca0 0x7fb5840cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:25.087 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.080+0000 7fb582d9d700 1 -- 172.21.15.192:0/2489492864 >> v2:172.21.15.192:3300/0 conn(0x7fb58406e530 msgr2=0x7fb58406e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:25.087 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.080+0000 7fb582d9d700 1 --2- 172.21.15.192:0/2489492864 >> v2:172.21.15.192:3300/0 conn(0x7fb58406e530 0x7fb58406e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:25.087 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.084+0000 7fb582d9d700 1 -- 172.21.15.192:0/2489492864 >> v1:172.21.15.192:6789/0 conn(0x7fb5840ccbf0 legacy=0x7fb584070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:25.087 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.084+0000 7fb582d9d700 1 -- 172.21.15.192:0/2489492864 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5840cc070 con 0x7fb5840ceca0 2023-11-28T11:53:25.087 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.084+0000 7fb58259c700 1 --2- 172.21.15.192:0/2489492864 >> v2:172.21.15.192:3300/0 conn(0x7fb58406e530 0x7fb58406e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:53:25.088 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.084+0000 7fb582d9d700 1 --2- 172.21.15.192:0/2489492864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5840ceca0 0x7fb5840cf120 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009d90 tx=0x7fb57c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=711b59e1b0e81bf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:25.088 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.084+0000 7fb58159a700 1 -- 172.21.15.192:0/2489492864 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c00e070 con 0x7fb5840ceca0 2023-11-28T11:53:25.088 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.084+0000 7fb58159a700 1 -- 172.21.15.192:0/2489492864 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c00bb20 con 0x7fb5840ceca0 2023-11-28T11:53:25.088 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.084+0000 7fb58159a700 1 -- 172.21.15.192:0/2489492864 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c012430 con 0x7fb5840ceca0 2023-11-28T11:53:25.089 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.084+0000 7fb588811700 1 -- 172.21.15.192:0/2489492864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5840ceca0 msgr2=0x7fb5840cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:25.089 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.084+0000 7fb588811700 1 --2- 172.21.15.192:0/2489492864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5840ceca0 0x7fb5840cf120 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009d90 tx=0x7fb57c00b330 comp rx=0 tx=0).stop 2023-11-28T11:53:25.089 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.084+0000 7fb588811700 1 -- 172.21.15.192:0/2489492864 shutdown_connections 2023-11-28T11:53:25.089 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.084+0000 7fb588811700 1 --2- 172.21.15.192:0/2489492864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5840ceca0 0x7fb5840cf120 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:25.089 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.084+0000 7fb588811700 1 --2- 172.21.15.192:0/2489492864 >> v2:172.21.15.192:3300/0 conn(0x7fb58406e530 0x7fb58406e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:25.089 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.084+0000 7fb588811700 1 -- 172.21.15.192:0/2489492864 >> 172.21.15.192:0/2489492864 conn(0x7fb5840cdef0 msgr2=0x7fb5840d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:25.089 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.084+0000 7fb588811700 1 -- 172.21.15.192:0/2489492864 shutdown_connections 2023-11-28T11:53:25.089 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.084+0000 7fb588811700 1 -- 172.21.15.192:0/2489492864 wait complete. 2023-11-28T11:53:25.090 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.084+0000 7fb588811700 1 Processor -- start 2023-11-28T11:53:25.090 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.084+0000 7fb588811700 1 -- start start 2023-11-28T11:53:25.092 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb588811700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58406e530 0x7fb5840c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:25.093 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb588811700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5840ccbf0 0x7fb5840c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:25.093 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb588811700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5840ceca0 0x7fb5840c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:25.093 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb588811700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58414ab70 con 0x7fb5840ceca0 2023-11-28T11:53:25.093 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb588811700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840c6c40 con 0x7fb58406e530 2023-11-28T11:53:25.093 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb588811700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb584149ef0 con 0x7fb5840ccbf0 2023-11-28T11:53:25.093 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb58259c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58406e530 0x7fb5840c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:25.093 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb581d9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5840ccbf0 0x7fb5840c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:25.093 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb58259c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58406e530 0x7fb5840c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36116/0 (socket says 172.21.15.192:36116) 2023-11-28T11:53:25.093 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb58259c700 1 -- 172.21.15.192:0/105018002 learned_addr learned my addr 172.21.15.192:0/105018002 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-28T11:53:25.093 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb582d9d700 1 --2- 172.21.15.192:0/105018002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5840ceca0 0x7fb5840c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:25.093 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb581d9b700 1 -- 172.21.15.192:0/105018002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58406e530 msgr2=0x7fb5840c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:25.093 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb581d9b700 1 --2- 172.21.15.192:0/105018002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58406e530 0x7fb5840c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:25.094 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb581d9b700 1 -- 172.21.15.192:0/105018002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5840ceca0 msgr2=0x7fb5840c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:25.094 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb581d9b700 1 --2- 172.21.15.192:0/105018002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5840ceca0 0x7fb5840c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:25.094 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb581d9b700 1 -- 172.21.15.192:0/105018002 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5740094b0 con 0x7fb5840ccbf0 2023-11-28T11:53:25.094 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb58259c700 1 --2- 172.21.15.192:0/105018002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58406e530 0x7fb5840c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:53:25.094 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb581d9b700 1 --2- 172.21.15.192:0/105018002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5840ccbf0 0x7fb5840c8200 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb57800c480 tx=0x7fb57800c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:25.094 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb572ffd700 1 -- 172.21.15.192:0/105018002 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578005d90 con 0x7fb5840ccbf0 2023-11-28T11:53:25.094 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb572ffd700 1 -- 172.21.15.192:0/105018002 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5780070d0 con 0x7fb5840ccbf0 2023-11-28T11:53:25.094 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb588811700 1 -- 172.21.15.192:0/105018002 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c009a70 con 0x7fb5840ccbf0 2023-11-28T11:53:25.094 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb572ffd700 1 -- 172.21.15.192:0/105018002 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578007440 con 0x7fb5840ccbf0 2023-11-28T11:53:25.094 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb588811700 1 -- 172.21.15.192:0/105018002 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5840cc630 con 0x7fb5840ccbf0 2023-11-28T11:53:25.094 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb572ffd700 1 -- 172.21.15.192:0/105018002 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fb578019030 con 0x7fb5840ccbf0 2023-11-28T11:53:25.095 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb572ffd700 1 -- 172.21.15.192:0/105018002 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fb57801c440 con 0x7fb5840ccbf0 2023-11-28T11:53:25.095 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.088+0000 7fb588811700 1 -- 172.21.15.192:0/105018002 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5840cc350 con 0x7fb5840ccbf0 2023-11-28T11:53:25.097 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.092+0000 7fb572ffd700 1 -- 172.21.15.192:0/105018002 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fb578021060 con 0x7fb5840ccbf0 2023-11-28T11:53:25.168 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.164+0000 7fb588811700 1 -- 172.21.15.192:0/105018002 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "034395d2-d57d-4f96-bbef-f26ceb8ebc4b", "id": 7} v 0) v1 -- 0x7fb58414acb0 con 0x7fb5840ccbf0 2023-11-28T11:53:25.179 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.176+0000 7fb572ffd700 1 -- 172.21.15.192:0/105018002 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "034395d2-d57d-4f96-bbef-f26ceb8ebc4b", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb58414acb0 con 0x7fb5840ccbf0 2023-11-28T11:53:25.179 INFO:teuthology.orchestra.run.smithi192.stdout:7 2023-11-28T11:53:25.181 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.176+0000 7fb588811700 1 -- 172.21.15.192:0/105018002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5840ccbf0 msgr2=0x7fb5840c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:25.181 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.176+0000 7fb588811700 1 --2- 172.21.15.192:0/105018002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5840ccbf0 0x7fb5840c8200 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb57800c480 tx=0x7fb57800c790 comp rx=0 tx=0).stop 2023-11-28T11:53:25.181 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.176+0000 7fb588811700 1 -- 172.21.15.192:0/105018002 shutdown_connections 2023-11-28T11:53:25.181 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.176+0000 7fb588811700 1 --2- 172.21.15.192:0/105018002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5840ceca0 0x7fb5840c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:25.181 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.176+0000 7fb588811700 1 --2- 172.21.15.192:0/105018002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5840ccbf0 0x7fb5840c8200 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:25.181 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.176+0000 7fb588811700 1 --2- 172.21.15.192:0/105018002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58406e530 0x7fb5840c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:25.181 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.176+0000 7fb588811700 1 -- 172.21.15.192:0/105018002 >> 172.21.15.192:0/105018002 conn(0x7fb5840cdef0 msgr2=0x7fb5840d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:25.181 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.176+0000 7fb588811700 1 -- 172.21.15.192:0/105018002 shutdown_connections 2023-11-28T11:53:25.181 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-28T11:53:25.176+0000 7fb588811700 1 -- 172.21.15.192:0/105018002 wait complete. 2023-11-28T11:53:25.197 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-28T11:53:25.198 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-28T11:53:25.200 INFO:tasks.ceph.osd.0:Started 2023-11-28T11:53:25.200 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-28T11:53:25.200 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-28T11:53:25.204 INFO:tasks.ceph.osd.1:Started 2023-11-28T11:53:25.204 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-28T11:53:25.204 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-28T11:53:25.207 INFO:tasks.ceph.osd.2:Started 2023-11-28T11:53:25.207 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-28T11:53:25.207 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-28T11:53:25.209 INFO:tasks.ceph.osd.3:Started 2023-11-28T11:53:25.210 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-28T11:53:25.210 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-28T11:53:25.239 INFO:tasks.ceph.osd.4:Started 2023-11-28T11:53:25.240 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-28T11:53:25.240 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-28T11:53:25.241 INFO:tasks.ceph.osd.5:Started 2023-11-28T11:53:25.242 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-28T11:53:25.242 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-28T11:53:25.244 INFO:tasks.ceph.osd.6:Started 2023-11-28T11:53:25.244 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-28T11:53:25.244 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-28T11:53:25.246 INFO:tasks.ceph.osd.7:Started 2023-11-28T11:53:25.246 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:53:25.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f1750c9c700 1 Processor -- start 2023-11-28T11:53:25.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f1750c9c700 1 -- start start 2023-11-28T11:53:25.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f1750c9c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f174c158fc0 0x7f174c0b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:25.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f1750c9c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f174c0ce770 0x7f174c06bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:25.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f1750c9c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f174c0b1bf0 con 0x7f174c0b17a0 2023-11-28T11:53:25.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f1750c9c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c159390 con 0x7f174c158fc0 2023-11-28T11:53:25.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f1750c9c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c15d700 con 0x7f174c0ce770 2023-11-28T11:53:25.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f174a59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f174c158fc0 0x7f174c0b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:25.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f174a59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f174c158fc0 0x7f174c0b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40258/0 (socket says 172.21.15.50:40258) 2023-11-28T11:53:25.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f174a59c700 1 -- 172.21.15.50:0/1036413127 learned_addr learned my addr 172.21.15.50:0/1036413127 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:25.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f174ad9d700 1 --2- 172.21.15.50:0/1036413127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f174c0ce770 0x7f174c06bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:25.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f174a59c700 1 -- 172.21.15.50:0/1036413127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f174c0ce770 msgr2=0x7f174c06bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:25.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f174a59c700 1 --2- 172.21.15.50:0/1036413127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f174c0ce770 0x7f174c06bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:25.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f174a59c700 1 -- 172.21.15.50:0/1036413127 >> v1:172.21.15.192:6789/0 conn(0x7f174c0b17a0 legacy=0x7f174c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:25.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f174a59c700 1 -- 172.21.15.50:0/1036413127 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c15caf0 con 0x7f174c158fc0 2023-11-28T11:53:25.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f174a59c700 1 --2- 172.21.15.50:0/1036413127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174c158fc0 0x7f174c0b1260 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1744009e50 tx=0x7f174400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113524c52b2dc33f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:25.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f174959a700 1 -- 172.21.15.50:0/1036413127 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174400e070 con 0x7f174c158fc0 2023-11-28T11:53:25.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f174959a700 1 -- 172.21.15.50:0/1036413127 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174400b9c0 con 0x7f174c158fc0 2023-11-28T11:53:25.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f174959a700 1 -- 172.21.15.50:0/1036413127 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174400bd70 con 0x7f174c158fc0 2023-11-28T11:53:25.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f1750c9c700 1 -- 172.21.15.50:0/1036413127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174c158fc0 msgr2=0x7f174c0b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:25.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f1750c9c700 1 --2- 172.21.15.50:0/1036413127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174c158fc0 0x7f174c0b1260 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1744009e50 tx=0x7f174400b330 comp rx=0 tx=0).stop 2023-11-28T11:53:25.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f1750c9c700 1 -- 172.21.15.50:0/1036413127 shutdown_connections 2023-11-28T11:53:25.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f1750c9c700 1 --2- 172.21.15.50:0/1036413127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f174c0ce770 0x7f174c06bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:25.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f1750c9c700 1 --2- 172.21.15.50:0/1036413127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174c158fc0 0x7f174c0b1260 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:25.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f1750c9c700 1 -- 172.21.15.50:0/1036413127 >> 172.21.15.50:0/1036413127 conn(0x7f174c0cc260 msgr2=0x7f174c0cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:25.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f1750c9c700 1 -- 172.21.15.50:0/1036413127 shutdown_connections 2023-11-28T11:53:25.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.374+0000 7f1750c9c700 1 -- 172.21.15.50:0/1036413127 wait complete. 2023-11-28T11:53:25.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f1750c9c700 1 Processor -- start 2023-11-28T11:53:25.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f1750c9c700 1 -- start start 2023-11-28T11:53:25.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f1750c9c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174c0b17a0 0x7f174c1667d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:25.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f1750c9c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f174c0ce770 0x7f174c0af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:25.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f1750c9c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f174c158fc0 0x7f174c0af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:25.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f1750c9c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0c9470 con 0x7f174c0b17a0 2023-11-28T11:53:25.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f1750c9c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c15ba00 con 0x7f174c158fc0 2023-11-28T11:53:25.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f1750c9c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c15b0d0 con 0x7f174c0ce770 2023-11-28T11:53:25.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f174a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174c0b17a0 0x7f174c1667d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:25.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f174a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174c0b17a0 0x7f174c1667d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40260/0 (socket says 172.21.15.50:40260) 2023-11-28T11:53:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f174a59c700 1 -- 172.21.15.50:0/425080802 learned_addr learned my addr 172.21.15.50:0/425080802 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f1749d9b700 1 --2- 172.21.15.50:0/425080802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f174c0ce770 0x7f174c0af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f174ad9d700 1 --2- 172.21.15.50:0/425080802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f174c158fc0 0x7f174c0af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f174a59c700 1 -- 172.21.15.50:0/425080802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f174c0ce770 msgr2=0x7f174c0af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f174a59c700 1 --2- 172.21.15.50:0/425080802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f174c0ce770 0x7f174c0af120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f174a59c700 1 -- 172.21.15.50:0/425080802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f174c158fc0 msgr2=0x7f174c0af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f174a59c700 1 --2- 172.21.15.50:0/425080802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f174c158fc0 0x7f174c0af660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f174a59c700 1 -- 172.21.15.50:0/425080802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1744009b30 con 0x7f174c0b17a0 2023-11-28T11:53:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f174a59c700 1 --2- 172.21.15.50:0/425080802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174c0b17a0 0x7f174c1667d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f174400b370 tx=0x7f1744004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:25.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f1742ffd700 1 -- 172.21.15.50:0/425080802 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1744004800 con 0x7f174c0b17a0 2023-11-28T11:53:25.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f1742ffd700 1 -- 172.21.15.50:0/425080802 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17440092e0 con 0x7f174c0b17a0 2023-11-28T11:53:25.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f1750c9c700 1 -- 172.21.15.50:0/425080802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174c15d0b0 con 0x7f174c0b17a0 2023-11-28T11:53:25.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f1742ffd700 1 -- 172.21.15.50:0/425080802 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174401b670 con 0x7f174c0b17a0 2023-11-28T11:53:25.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f1750c9c700 1 -- 172.21.15.50:0/425080802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174c15cdd0 con 0x7f174c0b17a0 2023-11-28T11:53:25.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f1742ffd700 1 -- 172.21.15.50:0/425080802 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f174402b070 con 0x7f174c0b17a0 2023-11-28T11:53:25.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.378+0000 7f1742ffd700 1 -- 172.21.15.50:0/425080802 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1744024b20 con 0x7f174c0b17a0 2023-11-28T11:53:25.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.386+0000 7f1750c9c700 1 -- 172.21.15.50:0/425080802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174c15d390 con 0x7f174c0b17a0 2023-11-28T11:53:25.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.386+0000 7f1742ffd700 1 -- 172.21.15.50:0/425080802 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f174401f070 con 0x7f174c0b17a0 2023-11-28T11:53:25.426 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:25.424+0000 7f601c5c52c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T11:53:25.460 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:25.458+0000 7fdfede0f2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T11:53:25.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.470+0000 7f1750c9c700 1 -- 172.21.15.50:0/425080802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f174c072c20 con 0x7f174c0b17a0 2023-11-28T11:53:25.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.470+0000 7f1742ffd700 1 -- 172.21.15.50:0/425080802 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1744034090 con 0x7f174c0b17a0 2023-11-28T11:53:25.473 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:53:25.473 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":10,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:25.170780+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:53:25.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.470+0000 7f1750c9c700 1 -- 172.21.15.50:0/425080802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174c0b17a0 msgr2=0x7f174c1667d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:25.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.470+0000 7f1750c9c700 1 --2- 172.21.15.50:0/425080802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174c0b17a0 0x7f174c1667d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f174400b370 tx=0x7f1744004af0 comp rx=0 tx=0).stop 2023-11-28T11:53:25.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.470+0000 7f1750c9c700 1 -- 172.21.15.50:0/425080802 shutdown_connections 2023-11-28T11:53:25.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.470+0000 7f1750c9c700 1 --2- 172.21.15.50:0/425080802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f174c158fc0 0x7f174c0af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:25.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.470+0000 7f1750c9c700 1 --2- 172.21.15.50:0/425080802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f174c0ce770 0x7f174c0af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:25.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.470+0000 7f1750c9c700 1 --2- 172.21.15.50:0/425080802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f174c0b17a0 0x7f174c1667d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:25.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.470+0000 7f1750c9c700 1 -- 172.21.15.50:0/425080802 >> 172.21.15.50:0/425080802 conn(0x7f174c0cc260 msgr2=0x7f174c06b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:25.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.470+0000 7f1750c9c700 1 -- 172.21.15.50:0/425080802 shutdown_connections 2023-11-28T11:53:25.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:25.470+0000 7f1750c9c700 1 -- 172.21.15.50:0/425080802 wait complete. 2023-11-28T11:53:25.487 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-28T11:53:25.487 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-28T11:53:25.551 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:25.548+0000 7f601c5c52c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T11:53:25.569 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-11-28T11:53:25.566+0000 7f9d15719700 -1 Falling back to public interface 2023-11-28T11:53:25.577 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-11-28T11:53:25.574+0000 7f37e7dc5700 -1 Falling back to public interface 2023-11-28T11:53:25.591 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:25.586+0000 7fdfede0f2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T11:53:25.636 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-11-28T11:53:25.632+0000 7f2c4df08700 -1 Falling back to public interface 2023-11-28T11:53:25.636 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-11-28T11:53:25.632+0000 7f0e292f2700 -1 Falling back to public interface 2023-11-28T11:53:25.650 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-11-28T11:53:25.644+0000 7f468ec06700 -1 Falling back to public interface 2023-11-28T11:53:25.820 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-11-28T11:53:25.818+0000 7f9d30c9c700 -1 Falling back to public interface 2023-11-28T11:53:25.861 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-11-28T11:53:25.858+0000 7f7ce79ce700 -1 Falling back to public interface 2023-11-28T11:53:25.868 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-11-28T11:53:25.864+0000 7f480871b700 -1 Falling back to public interface 2023-11-28T11:53:26.131 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:26.128+0000 7f601c5c52c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T11:53:26.193 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:26.189+0000 7fdfede0f2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T11:53:26.293 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T11:53:26.302 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:26.296+0000 7f601c5c52c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T11:53:26.363 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:26.357+0000 7fdfede0f2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T11:53:26.393 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.389+0000 7fd012307700 1 Processor -- start 2023-11-28T11:53:26.394 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.389+0000 7fd012307700 1 -- start start 2023-11-28T11:53:26.394 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.389+0000 7fd012307700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd00c0c4390 0x7fd00c0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:26.395 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.389+0000 7fd012307700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00c15c5b0 con 0x7fd00c06a350 2023-11-28T11:53:26.395 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.389+0000 7fd012307700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00c071fc0 con 0x7fd00c15c1e0 2023-11-28T11:53:26.395 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.389+0000 7fd012307700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd00c0c62d0 con 0x7fd00c0c4390 2023-11-28T11:53:26.395 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.389+0000 7fd010b04700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd00c06a350 0x7fd00c0cbd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41108/0 (socket says 172.21.15.50:41108) 2023-11-28T11:53:26.395 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.389+0000 7fd010b04700 1 -- 172.21.15.50:0/688805679 learned_addr learned my addr 172.21.15.50:0/688805679 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:26.395 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.389+0000 7fd011b06700 1 --2- 172.21.15.50:0/688805679 >> v2:172.21.15.192:3300/0 conn(0x7fd00c0c4390 0x7fd00c0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:26.396 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.389+0000 7fd003fff700 1 -- 172.21.15.50:0/688805679 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013116206 0 0) 0x7fd00c15c5b0 con 0x7fd00c06a350 2023-11-28T11:53:26.396 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.389+0000 7fd003fff700 1 -- 172.21.15.50:0/688805679 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcff80035d0 con 0x7fd00c06a350 2023-11-28T11:53:26.396 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.393+0000 7fd003fff700 1 -- 172.21.15.50:0/688805679 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4121822919 0 0) 0x7fcff80035d0 con 0x7fd00c06a350 2023-11-28T11:53:26.396 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.393+0000 7fd011b06700 1 -- 172.21.15.50:0/688805679 >> v1:172.21.15.192:6789/0 conn(0x7fd00c15c1e0 legacy=0x7fd00c069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:26.396 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.393+0000 7fd011b06700 1 -- 172.21.15.50:0/688805679 >> v1:172.21.15.50:6789/0 conn(0x7fd00c06a350 legacy=0x7fd00c0cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:26.396 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.393+0000 7fd011b06700 1 -- 172.21.15.50:0/688805679 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c071690 con 0x7fd00c0c4390 2023-11-28T11:53:26.396 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.393+0000 7fd011b06700 1 --2- 172.21.15.50:0/688805679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd00c0c4390 0x7fd00c0c5c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd004009d90 tx=0x7fd00400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=997374536fe8c395 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:26.397 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.393+0000 7fd003fff700 1 -- 172.21.15.50:0/688805679 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400e070 con 0x7fd00c0c4390 2023-11-28T11:53:26.397 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.393+0000 7fd003fff700 1 -- 172.21.15.50:0/688805679 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd004003a40 con 0x7fd00c0c4390 2023-11-28T11:53:26.397 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.393+0000 7fd003fff700 1 -- 172.21.15.50:0/688805679 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc001670 con 0x7fd00c0c4390 2023-11-28T11:53:26.397 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.393+0000 7fd012307700 1 -- 172.21.15.50:0/688805679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd00c0c4390 msgr2=0x7fd00c0c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:26.397 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.393+0000 7fd012307700 1 --2- 172.21.15.50:0/688805679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd00c0c4390 0x7fd00c0c5c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd004009d90 tx=0x7fd00400b330 comp rx=0 tx=0).stop 2023-11-28T11:53:26.398 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.393+0000 7fd012307700 1 -- 172.21.15.50:0/688805679 shutdown_connections 2023-11-28T11:53:26.398 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.393+0000 7fd012307700 1 --2- 172.21.15.50:0/688805679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd00c0c4390 0x7fd00c0c5c80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:26.398 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.393+0000 7fd012307700 1 -- 172.21.15.50:0/688805679 >> 172.21.15.50:0/688805679 conn(0x7fd00c0b1120 msgr2=0x7fd00c0b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:26.398 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.393+0000 7fd012307700 1 -- 172.21.15.50:0/688805679 shutdown_connections 2023-11-28T11:53:26.398 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.393+0000 7fd012307700 1 -- 172.21.15.50:0/688805679 wait complete. 2023-11-28T11:53:26.399 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.393+0000 7fd012307700 1 Processor -- start 2023-11-28T11:53:26.399 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.393+0000 7fd012307700 1 -- start start 2023-11-28T11:53:26.402 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd012307700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd00c06a350 0x7fd00c156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:26.402 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd012307700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd00c0c4390 0x7fd00c15d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:26.402 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd012307700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd00c15c1e0 0x7fd00c0b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:26.402 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd012307700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c0b33f0 con 0x7fd00c0c4390 2023-11-28T11:53:26.402 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd012307700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c0b3660 con 0x7fd00c06a350 2023-11-28T11:53:26.402 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd012307700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c0b3940 con 0x7fd00c15c1e0 2023-11-28T11:53:26.402 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd010b04700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd00c0c4390 0x7fd00c15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:26.403 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd010b04700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd00c0c4390 0x7fd00c15d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40276/0 (socket says 172.21.15.50:40276) 2023-11-28T11:53:26.403 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd010b04700 1 -- 172.21.15.50:0/2598703762 learned_addr learned my addr 172.21.15.50:0/2598703762 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:26.403 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd011b06700 1 --2- 172.21.15.50:0/2598703762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd00c15c1e0 0x7fd00c0b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:26.403 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd011305700 1 --2- 172.21.15.50:0/2598703762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd00c06a350 0x7fd00c156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:26.403 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd010b04700 1 -- 172.21.15.50:0/2598703762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd00c15c1e0 msgr2=0x7fd00c0b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:26.403 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd010b04700 1 --2- 172.21.15.50:0/2598703762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd00c15c1e0 0x7fd00c0b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:26.403 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd010b04700 1 -- 172.21.15.50:0/2598703762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd00c06a350 msgr2=0x7fd00c156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:26.403 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd010b04700 1 --2- 172.21.15.50:0/2598703762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd00c06a350 0x7fd00c156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:26.403 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd010b04700 1 -- 172.21.15.50:0/2598703762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd004009a70 con 0x7fd00c0c4390 2023-11-28T11:53:26.403 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd010b04700 1 --2- 172.21.15.50:0/2598703762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd00c0c4390 0x7fd00c15d160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00c540 tx=0x7fcffc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:26.403 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd001ffb700 1 -- 172.21.15.50:0/2598703762 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc004ca0 con 0x7fd00c0c4390 2023-11-28T11:53:26.404 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd001ffb700 1 -- 172.21.15.50:0/2598703762 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc004e00 con 0x7fd00c0c4390 2023-11-28T11:53:26.404 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd001ffb700 1 -- 172.21.15.50:0/2598703762 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc007310 con 0x7fd00c0c4390 2023-11-28T11:53:26.404 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd012307700 1 -- 172.21.15.50:0/2598703762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00c071c50 con 0x7fd00c0c4390 2023-11-28T11:53:26.404 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd012307700 1 -- 172.21.15.50:0/2598703762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c071970 con 0x7fd00c0c4390 2023-11-28T11:53:26.404 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd001ffb700 1 -- 172.21.15.50:0/2598703762 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fcffc01a020 con 0x7fd00c0c4390 2023-11-28T11:53:26.404 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd001ffb700 1 -- 172.21.15.50:0/2598703762 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fcffc013a90 con 0x7fd00c0c4390 2023-11-28T11:53:26.404 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.397+0000 7fd012307700 1 -- 172.21.15.50:0/2598703762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00c0cd0c0 con 0x7fd00c0c4390 2023-11-28T11:53:26.406 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.401+0000 7fd001ffb700 1 -- 172.21.15.50:0/2598703762 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fcffc007660 con 0x7fd00c0c4390 2023-11-28T11:53:26.473 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.469+0000 7fd012307700 1 -- 172.21.15.50:0/2598703762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd00c067f70 con 0x7fd00c0c4390 2023-11-28T11:53:26.474 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.469+0000 7fd001ffb700 1 -- 172.21.15.50:0/2598703762 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fcffc013d00 con 0x7fd00c0c4390 2023-11-28T11:53:26.474 INFO:teuthology.misc.health.smithi050.stdout: 2023-11-28T11:53:26.474 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":10,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:25.170780+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:53:26.475 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.469+0000 7fd012307700 1 -- 172.21.15.50:0/2598703762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd00c0c4390 msgr2=0x7fd00c15d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:26.475 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.469+0000 7fd012307700 1 --2- 172.21.15.50:0/2598703762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd00c0c4390 0x7fd00c15d160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00c540 tx=0x7fcffc00c900 comp rx=0 tx=0).stop 2023-11-28T11:53:26.475 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.469+0000 7fd012307700 1 -- 172.21.15.50:0/2598703762 shutdown_connections 2023-11-28T11:53:26.475 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.469+0000 7fd012307700 1 --2- 172.21.15.50:0/2598703762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd00c15c1e0 0x7fd00c0b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:26.475 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.469+0000 7fd012307700 1 --2- 172.21.15.50:0/2598703762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd00c0c4390 0x7fd00c15d160 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:26.476 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.469+0000 7fd012307700 1 --2- 172.21.15.50:0/2598703762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd00c06a350 0x7fd00c156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:26.476 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.469+0000 7fd012307700 1 -- 172.21.15.50:0/2598703762 >> 172.21.15.50:0/2598703762 conn(0x7fd00c0b1120 msgr2=0x7fd00c15b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:26.476 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.469+0000 7fd012307700 1 -- 172.21.15.50:0/2598703762 shutdown_connections 2023-11-28T11:53:26.476 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:26.469+0000 7fd012307700 1 -- 172.21.15.50:0/2598703762 wait complete. 2023-11-28T11:53:26.478 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:26.472+0000 7f601c5c52c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T11:53:26.485 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T11:53:26.533 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:26.528+0000 7f601c5c52c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T11:53:26.538 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:26.533+0000 7fdfede0f2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T11:53:26.592 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:26.589+0000 7fdfede0f2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T11:53:27.220 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:27.216+0000 7f601c5c52c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T11:53:27.291 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:27.288+0000 7f601c5c52c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T11:53:27.343 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:27.337+0000 7fdfede0f2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T11:53:27.416 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:27.413+0000 7fdfede0f2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T11:53:27.462 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:27.460+0000 7f601c5c52c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T11:53:27.525 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:27.520+0000 7f601c5c52c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T11:53:27.587 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:27.581+0000 7fdfede0f2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T11:53:27.654 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:27.649+0000 7fdfede0f2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T11:53:27.750 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:27.744+0000 7f601c5c52c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T11:53:27.884 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:27.881+0000 7fdfede0f2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T11:53:27.927 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:27.920+0000 7f601c5c52c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T11:53:28.000 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:27.996+0000 7f601c5c52c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T11:53:28.063 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:28.057+0000 7fdfede0f2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T11:53:28.137 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:28.133+0000 7fdfede0f2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T11:53:28.825 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:28.820+0000 7f601c5c52c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T11:53:28.927 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-11-28T11:53:28.925+0000 7fdfede0f2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T11:53:28.977 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-11-28T11:53:28.973+0000 7f37e7dc5700 -1 osd.3 0 log_to_monitors true 2023-11-28T11:53:28.988 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-11-28T11:53:28.984+0000 7f468ec06700 -1 osd.4 0 log_to_monitors true 2023-11-28T11:53:28.988 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-11-28T11:53:28.984+0000 7f2c4df08700 -1 osd.7 0 log_to_monitors true 2023-11-28T11:53:29.013 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-11-28T11:53:29.008+0000 7f0e292f2700 -1 osd.5 0 log_to_monitors true 2023-11-28T11:53:29.257 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-11-28T11:53:29.253+0000 7f9d15719700 -1 osd.0 0 log_to_monitors true 2023-11-28T11:53:29.475 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-11-28T11:53:29.472+0000 7f480871b700 -1 osd.6 0 log_to_monitors true 2023-11-28T11:53:29.516 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-11-28T11:53:29.513+0000 7f7ce79ce700 -1 osd.2 0 log_to_monitors true 2023-11-28T11:53:29.710 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-11-28T11:53:29.705+0000 7f9d30c9c700 -1 osd.1 0 log_to_monitors true 2023-11-28T11:53:29.871 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:29.868+0000 7f6002e36700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-28T11:53:29.872 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-28T11:53:29.868+0000 7f6002e36700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-28T11:53:32.333 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-11-28T11:53:32.329+0000 7f37e458b700 -1 osd.3 0 waiting for initial osdmap 2023-11-28T11:53:32.339 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-11-28T11:53:32.337+0000 7f37db6b3700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:53:32.459 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-11-28T11:53:32.453+0000 7f9d2cadb700 -1 osd.1 0 waiting for initial osdmap 2023-11-28T11:53:32.466 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-11-28T11:53:32.461+0000 7f7ce4194700 -1 osd.2 0 waiting for initial osdmap 2023-11-28T11:53:32.468 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-11-28T11:53:32.465+0000 7f9d2458a700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:53:32.474 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-11-28T11:53:32.469+0000 7f7cdb2bc700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:53:32.515 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-11-28T11:53:32.509+0000 7f9d11edf700 -1 osd.0 0 waiting for initial osdmap 2023-11-28T11:53:32.526 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-11-28T11:53:32.521+0000 7f9d09007700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:53:33.093 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-11-28T11:53:33.088+0000 7f2c49d47700 -1 osd.7 0 waiting for initial osdmap 2023-11-28T11:53:33.100 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-11-28T11:53:33.096+0000 7f2c417f6700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:53:33.116 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-11-28T11:53:33.112+0000 7f0e25ab8700 -1 osd.5 0 waiting for initial osdmap 2023-11-28T11:53:33.123 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-11-28T11:53:33.120+0000 7f0e1cbe0700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:53:33.147 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-11-28T11:53:33.144+0000 7f468b3cc700 -1 osd.4 0 waiting for initial osdmap 2023-11-28T11:53:33.154 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-11-28T11:53:33.152+0000 7f46824f4700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:53:33.168 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-11-28T11:53:33.164+0000 7f480455a700 -1 osd.6 0 waiting for initial osdmap 2023-11-28T11:53:33.173 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-11-28T11:53:33.168+0000 7f47fc009700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T11:53:33.291 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T11:53:33.402 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.397+0000 7fd916122700 1 Processor -- start 2023-11-28T11:53:33.403 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.397+0000 7fd916122700 1 -- start start 2023-11-28T11:53:33.405 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd916122700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd910158c60 0x7fd91015d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:33.406 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd916122700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd9100ae6c0 0x7fd9100c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:33.406 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd916122700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9100c5050 0x7fd91006c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:33.406 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd916122700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91015d790 con 0x7fd910158c60 2023-11-28T11:53:33.406 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd916122700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9100c54d0 con 0x7fd9100ae6c0 2023-11-28T11:53:33.406 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd916122700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100719f0 con 0x7fd9100c5050 2023-11-28T11:53:33.406 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd915120700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd910158c60 0x7fd91015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:33.406 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd915120700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd910158c60 0x7fd91015d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54570/0 (socket says 172.21.15.50:54570) 2023-11-28T11:53:33.406 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd915120700 1 -- 172.21.15.50:0/2264797214 learned_addr learned my addr 172.21.15.50:0/2264797214 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:33.406 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd915921700 1 --2- 172.21.15.50:0/2264797214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9100c5050 0x7fd91006c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:33.407 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd91491f700 1 --2- 172.21.15.50:0/2264797214 >> v2:172.21.15.192:3300/0 conn(0x7fd9100ae6c0 0x7fd9100c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:33.407 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd915120700 1 -- 172.21.15.50:0/2264797214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9100c5050 msgr2=0x7fd91006c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:33.407 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd915120700 1 --2- 172.21.15.50:0/2264797214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9100c5050 0x7fd91006c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:33.407 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd915120700 1 -- 172.21.15.50:0/2264797214 >> v2:172.21.15.192:3300/0 conn(0x7fd9100ae6c0 msgr2=0x7fd9100c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:33.407 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd915120700 1 --2- 172.21.15.50:0/2264797214 >> v2:172.21.15.192:3300/0 conn(0x7fd9100ae6c0 0x7fd9100c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:33.407 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd915120700 1 -- 172.21.15.50:0/2264797214 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd910159030 con 0x7fd910158c60 2023-11-28T11:53:33.407 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd91491f700 1 --2- 172.21.15.50:0/2264797214 >> v2:172.21.15.192:3300/0 conn(0x7fd9100ae6c0 0x7fd9100c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:53:33.407 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd915921700 1 --2- 172.21.15.50:0/2264797214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9100c5050 0x7fd91006c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:53:33.407 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd915120700 1 --2- 172.21.15.50:0/2264797214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd910158c60 0x7fd91015d160 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd910070ed0 tx=0x7fd90000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9d028751afcb60 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:33.407 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd90ffff700 1 -- 172.21.15.50:0/2264797214 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90000dd90 con 0x7fd910158c60 2023-11-28T11:53:33.407 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd90ffff700 1 -- 172.21.15.50:0/2264797214 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd900010470 con 0x7fd910158c60 2023-11-28T11:53:33.407 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd90ffff700 1 -- 172.21.15.50:0/2264797214 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900010800 con 0x7fd910158c60 2023-11-28T11:53:33.408 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd916122700 1 -- 172.21.15.50:0/2264797214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd910158c60 msgr2=0x7fd91015d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:33.408 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd916122700 1 --2- 172.21.15.50:0/2264797214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd910158c60 0x7fd91015d160 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd910070ed0 tx=0x7fd90000be90 comp rx=0 tx=0).stop 2023-11-28T11:53:33.408 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd916122700 1 -- 172.21.15.50:0/2264797214 shutdown_connections 2023-11-28T11:53:33.408 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd916122700 1 --2- 172.21.15.50:0/2264797214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9100c5050 0x7fd91006c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:33.408 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd916122700 1 --2- 172.21.15.50:0/2264797214 >> v2:172.21.15.192:3300/0 conn(0x7fd9100ae6c0 0x7fd9100c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:33.408 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd916122700 1 --2- 172.21.15.50:0/2264797214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd910158c60 0x7fd91015d160 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:33.408 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd916122700 1 -- 172.21.15.50:0/2264797214 >> 172.21.15.50:0/2264797214 conn(0x7fd9100b1120 msgr2=0x7fd9100b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:33.408 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd916122700 1 -- 172.21.15.50:0/2264797214 shutdown_connections 2023-11-28T11:53:33.408 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd916122700 1 -- 172.21.15.50:0/2264797214 wait complete. 2023-11-28T11:53:33.411 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd916122700 1 Processor -- start 2023-11-28T11:53:33.411 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.401+0000 7fd916122700 1 -- start start 2023-11-28T11:53:33.411 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd916122700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9100ae6c0 0x7fd91015b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:33.411 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd916122700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9100c5050 0x7fd91014cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:33.412 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd916122700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd910158c60 0x7fd91014d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:33.412 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd916122700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91015a650 con 0x7fd9100c5050 2023-11-28T11:53:33.412 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd916122700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91015bcd0 con 0x7fd9100ae6c0 2023-11-28T11:53:33.412 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd916122700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd910159d60 con 0x7fd910158c60 2023-11-28T11:53:33.412 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd91491f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9100c5050 0x7fd91014cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:33.412 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd91491f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9100c5050 0x7fd91014cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54572/0 (socket says 172.21.15.50:54572) 2023-11-28T11:53:33.412 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd915921700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd910158c60 0x7fd91014d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:33.412 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd91491f700 1 -- 172.21.15.50:0/2222281363 learned_addr learned my addr 172.21.15.50:0/2222281363 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:33.412 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd915120700 1 --2- 172.21.15.50:0/2222281363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9100ae6c0 0x7fd91015b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:33.412 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd91491f700 1 -- 172.21.15.50:0/2222281363 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd910158c60 msgr2=0x7fd91014d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:33.412 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd91491f700 1 --2- 172.21.15.50:0/2222281363 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd910158c60 0x7fd91014d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:33.413 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd91491f700 1 -- 172.21.15.50:0/2222281363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9100ae6c0 msgr2=0x7fd91015b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:33.413 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd91491f700 1 --2- 172.21.15.50:0/2222281363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9100ae6c0 0x7fd91015b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:33.413 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd91491f700 1 -- 172.21.15.50:0/2222281363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90000b810 con 0x7fd9100c5050 2023-11-28T11:53:33.413 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd91491f700 1 --2- 172.21.15.50:0/2222281363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9100c5050 0x7fd91014cae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd90400e810 tx=0x7fd90400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:33.413 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd90dffb700 1 -- 172.21.15.50:0/2222281363 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90400c070 con 0x7fd9100c5050 2023-11-28T11:53:33.413 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd90dffb700 1 -- 172.21.15.50:0/2222281363 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd904013610 con 0x7fd9100c5050 2023-11-28T11:53:33.414 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd916122700 1 -- 172.21.15.50:0/2222281363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9100713a0 con 0x7fd9100c5050 2023-11-28T11:53:33.414 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd90dffb700 1 -- 172.21.15.50:0/2222281363 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9040139a0 con 0x7fd9100c5050 2023-11-28T11:53:33.414 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd916122700 1 -- 172.21.15.50:0/2222281363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9100710c0 con 0x7fd9100c5050 2023-11-28T11:53:33.414 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.405+0000 7fd916122700 1 -- 172.21.15.50:0/2222281363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd910071680 con 0x7fd9100c5050 2023-11-28T11:53:33.414 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.409+0000 7fd90dffb700 1 -- 172.21.15.50:0/2222281363 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7fd904023070 con 0x7fd9100c5050 2023-11-28T11:53:33.415 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.409+0000 7fd90dffb700 1 --2- 172.21.15.50:0/2222281363 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd8fc064e90 0x7fd8fc067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:33.415 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.409+0000 7fd90dffb700 1 -- 172.21.15.50:0/2222281363 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fd9040814e0 con 0x7fd9100c5050 2023-11-28T11:53:33.415 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.409+0000 7fd915120700 1 --2- 172.21.15.50:0/2222281363 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd8fc064e90 0x7fd8fc067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:33.415 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.409+0000 7fd915120700 1 --2- 172.21.15.50:0/2222281363 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd8fc064e90 0x7fd8fc067340 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd90000bfd0 tx=0x7fd900013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:33.420 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.413+0000 7fd90dffb700 1 -- 172.21.15.50:0/2222281363 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd90404fc20 con 0x7fd9100c5050 2023-11-28T11:53:33.587 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.581+0000 7fd916122700 1 -- 172.21.15.50:0/2222281363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd91015be40 con 0x7fd9100c5050 2023-11-28T11:53:33.588 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.585+0000 7fd90dffb700 1 -- 172.21.15.50:0/2222281363 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10440 (secure 0 0 0) 0x7fd904053240 con 0x7fd9100c5050 2023-11-28T11:53:33.589 INFO:teuthology.misc.health.smithi050.stdout: 2023-11-28T11:53:33.589 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":13,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:33.346012+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:53:33.591 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.585+0000 7fd916122700 1 -- 172.21.15.50:0/2222281363 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd8fc064e90 msgr2=0x7fd8fc067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:33.591 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.585+0000 7fd916122700 1 --2- 172.21.15.50:0/2222281363 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd8fc064e90 0x7fd8fc067340 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd90000bfd0 tx=0x7fd900013000 comp rx=0 tx=0).stop 2023-11-28T11:53:33.591 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.585+0000 7fd916122700 1 -- 172.21.15.50:0/2222281363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9100c5050 msgr2=0x7fd91014cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:33.592 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.585+0000 7fd916122700 1 --2- 172.21.15.50:0/2222281363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9100c5050 0x7fd91014cae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd90400e810 tx=0x7fd90400eb20 comp rx=0 tx=0).stop 2023-11-28T11:53:33.592 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.585+0000 7fd916122700 1 -- 172.21.15.50:0/2222281363 shutdown_connections 2023-11-28T11:53:33.592 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.585+0000 7fd916122700 1 --2- 172.21.15.50:0/2222281363 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd910158c60 0x7fd91014d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:33.592 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.585+0000 7fd916122700 1 --2- 172.21.15.50:0/2222281363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9100c5050 0x7fd91014cae0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:33.592 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.585+0000 7fd916122700 1 --2- 172.21.15.50:0/2222281363 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd8fc064e90 0x7fd8fc067340 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:33.592 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.585+0000 7fd916122700 1 --2- 172.21.15.50:0/2222281363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9100ae6c0 0x7fd91015b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:33.592 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.585+0000 7fd916122700 1 -- 172.21.15.50:0/2222281363 >> 172.21.15.50:0/2222281363 conn(0x7fd9100b1120 msgr2=0x7fd9101562a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:33.592 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.585+0000 7fd916122700 1 -- 172.21.15.50:0/2222281363 shutdown_connections 2023-11-28T11:53:33.592 INFO:teuthology.misc.health.smithi050.stderr:2023-11-28T11:53:33.589+0000 7fd916122700 1 -- 172.21.15.50:0/2222281363 wait complete. 2023-11-28T11:53:33.606 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-28T11:53:33.607 INFO:tasks.ceph:Creating RBD pool 2023-11-28T11:53:33.607 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd pool create rbd 8 2023-11-28T11:53:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.721+0000 7f97574d9700 1 Processor -- start 2023-11-28T11:53:33.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.721+0000 7f97574d9700 1 -- start start 2023-11-28T11:53:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.721+0000 7f97574d9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97500cf7f0 0x7f975006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.721+0000 7f97574d9700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975006a9c0 con 0x7f975006a4c0 2023-11-28T11:53:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.721+0000 7f97574d9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975006aca0 con 0x7f97500b1ae0 2023-11-28T11:53:33.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.721+0000 7f97574d9700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97500d0ab0 con 0x7f97500cf7f0 2023-11-28T11:53:33.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.721+0000 7f9756cd8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97500cf7f0 0x7f975006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:33.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.721+0000 7f9756cd8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97500cf7f0 0x7f975006d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54584/0 (socket says 172.21.15.50:54584) 2023-11-28T11:53:33.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.721+0000 7f9756cd8700 1 -- 172.21.15.50:0/144606274 learned_addr learned my addr 172.21.15.50:0/144606274 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:33.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.721+0000 7f9756cd8700 1 -- 172.21.15.50:0/144606274 >> v1:172.21.15.192:6789/0 conn(0x7f97500b1ae0 legacy=0x7f97500d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:33.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.721+0000 7f9756cd8700 1 -- 172.21.15.50:0/144606274 >> v1:172.21.15.50:6789/0 conn(0x7f975006a4c0 legacy=0x7f97500cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:33.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.721+0000 7f97554d5700 1 -- 172.21.15.50:0/144606274 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888785624 0 0) 0x7f975006a9c0 con 0x7f975006a4c0 2023-11-28T11:53:33.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.721+0000 7f9756cd8700 1 -- 172.21.15.50:0/144606274 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975006af80 con 0x7f97500cf7f0 2023-11-28T11:53:33.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.721+0000 7f9756cd8700 1 --2- 172.21.15.50:0/144606274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97500cf7f0 0x7f975006d8e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9748009e50 tx=0x7f974800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167b11f1f9c25eaa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:33.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.721+0000 7f97554d5700 1 -- 172.21.15.50:0/144606274 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974800e070 con 0x7f97500cf7f0 2023-11-28T11:53:33.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.721+0000 7f97554d5700 1 -- 172.21.15.50:0/144606274 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974800b9c0 con 0x7f97500cf7f0 2023-11-28T11:53:33.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.721+0000 7f97554d5700 1 -- 172.21.15.50:0/144606274 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974800bd70 con 0x7f97500cf7f0 2023-11-28T11:53:33.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.725+0000 7f97574d9700 1 -- 172.21.15.50:0/144606274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97500cf7f0 msgr2=0x7f975006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:33.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.725+0000 7f97574d9700 1 --2- 172.21.15.50:0/144606274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97500cf7f0 0x7f975006d8e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9748009e50 tx=0x7f974800b330 comp rx=0 tx=0).stop 2023-11-28T11:53:33.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.725+0000 7f97574d9700 1 -- 172.21.15.50:0/144606274 shutdown_connections 2023-11-28T11:53:33.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.725+0000 7f97574d9700 1 --2- 172.21.15.50:0/144606274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97500cf7f0 0x7f975006d8e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:33.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.725+0000 7f97574d9700 1 -- 172.21.15.50:0/144606274 >> 172.21.15.50:0/144606274 conn(0x7f975009bbd0 msgr2=0x7f97500b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:33.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.725+0000 7f97574d9700 1 -- 172.21.15.50:0/144606274 shutdown_connections 2023-11-28T11:53:33.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.725+0000 7f97574d9700 1 -- 172.21.15.50:0/144606274 wait complete. 2023-11-28T11:53:33.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.725+0000 7f97574d9700 1 Processor -- start 2023-11-28T11:53:33.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.725+0000 7f97574d9700 1 -- start start 2023-11-28T11:53:33.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.725+0000 7f97574d9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f975006a4c0 0x7f975009ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:33.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.725+0000 7f97574d9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97500b1ae0 0x7f97500c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:33.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.725+0000 7f97574d9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97500cf7f0 0x7f97500b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:33.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.725+0000 7f97574d9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9750156810 con 0x7f97500cf7f0 2023-11-28T11:53:33.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.725+0000 7f97574d9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975015e130 con 0x7f975006a4c0 2023-11-28T11:53:33.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.725+0000 7f97574d9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975015ef90 con 0x7f97500b1ae0 2023-11-28T11:53:33.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.725+0000 7f9756cd8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97500cf7f0 0x7f97500b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:33.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.729+0000 7f97564d7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f975006a4c0 0x7f975009ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:33.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.729+0000 7f9756cd8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97500cf7f0 0x7f97500b47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54588/0 (socket says 172.21.15.50:54588) 2023-11-28T11:53:33.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.729+0000 7f9756cd8700 1 -- 172.21.15.50:0/3224635544 learned_addr learned my addr 172.21.15.50:0/3224635544 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:33.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.729+0000 7f9755cd6700 1 --2- 172.21.15.50:0/3224635544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97500b1ae0 0x7f97500c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:33.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.729+0000 7f9756cd8700 1 -- 172.21.15.50:0/3224635544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97500b1ae0 msgr2=0x7f97500c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:33.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.729+0000 7f9756cd8700 1 --2- 172.21.15.50:0/3224635544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97500b1ae0 0x7f97500c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:33.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.729+0000 7f9756cd8700 1 -- 172.21.15.50:0/3224635544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f975006a4c0 msgr2=0x7f975009ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:33.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.729+0000 7f9756cd8700 1 --2- 172.21.15.50:0/3224635544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f975006a4c0 0x7f975009ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:33.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.729+0000 7f9756cd8700 1 -- 172.21.15.50:0/3224635544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9748009b30 con 0x7f97500cf7f0 2023-11-28T11:53:33.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.729+0000 7f9756cd8700 1 --2- 172.21.15.50:0/3224635544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97500cf7f0 0x7f97500b47a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f974800b730 tx=0x7f9748004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:33.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.729+0000 7f9742ffd700 1 -- 172.21.15.50:0/3224635544 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97480048c0 con 0x7f97500cf7f0 2023-11-28T11:53:33.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.729+0000 7f9742ffd700 1 -- 172.21.15.50:0/3224635544 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97480092e0 con 0x7f97500cf7f0 2023-11-28T11:53:33.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.729+0000 7f9742ffd700 1 -- 172.21.15.50:0/3224635544 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974801c660 con 0x7f97500cf7f0 2023-11-28T11:53:33.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.729+0000 7f97574d9700 1 -- 172.21.15.50:0/3224635544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97500b1eb0 con 0x7f97500cf7f0 2023-11-28T11:53:33.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.729+0000 7f97574d9700 1 -- 172.21.15.50:0/3224635544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97500b4380 con 0x7f97500cf7f0 2023-11-28T11:53:33.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.729+0000 7f97574d9700 1 -- 172.21.15.50:0/3224635544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97500b60e0 con 0x7f97500cf7f0 2023-11-28T11:53:33.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.729+0000 7f9742ffd700 1 -- 172.21.15.50:0/3224635544 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7f974802c070 con 0x7f97500cf7f0 2023-11-28T11:53:33.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.733+0000 7f9742ffd700 1 --2- 172.21.15.50:0/3224635544 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9734064e90 0x7f9734067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:33.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.733+0000 7f9742ffd700 1 -- 172.21.15.50:0/3224635544 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f9748083410 con 0x7f97500cf7f0 2023-11-28T11:53:33.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.733+0000 7f97564d7700 1 --2- 172.21.15.50:0/3224635544 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9734064e90 0x7f9734067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:33.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.733+0000 7f97564d7700 1 --2- 172.21.15.50:0/3224635544 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9734064e90 0x7f9734067340 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f974c000f60 tx=0x7f974c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:33.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.741+0000 7f9742ffd700 1 -- 172.21.15.50:0/3224635544 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9748051bb0 con 0x7f97500cf7f0 2023-11-28T11:53:33.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:33.905+0000 7f97574d9700 1 -- 172.21.15.50:0/3224635544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f97500c82b0 con 0x7f97500cf7f0 2023-11-28T11:53:34.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.353+0000 7f9742ffd700 1 -- 172.21.15.50:0/3224635544 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f97480551d0 con 0x7f97500cf7f0 2023-11-28T11:53:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.361+0000 7f97574d9700 1 -- 172.21.15.50:0/3224635544 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9734064e90 msgr2=0x7f9734067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.361+0000 7f97574d9700 1 --2- 172.21.15.50:0/3224635544 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9734064e90 0x7f9734067340 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f974c000f60 tx=0x7f974c009040 comp rx=0 tx=0).stop 2023-11-28T11:53:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.361+0000 7f97574d9700 1 -- 172.21.15.50:0/3224635544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97500cf7f0 msgr2=0x7f97500b47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.361+0000 7f97574d9700 1 --2- 172.21.15.50:0/3224635544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97500cf7f0 0x7f97500b47a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f974800b730 tx=0x7f9748004af0 comp rx=0 tx=0).stop 2023-11-28T11:53:34.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.361+0000 7f97574d9700 1 -- 172.21.15.50:0/3224635544 shutdown_connections 2023-11-28T11:53:34.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.361+0000 7f97574d9700 1 --2- 172.21.15.50:0/3224635544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97500cf7f0 0x7f97500b47a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:34.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.361+0000 7f97574d9700 1 --2- 172.21.15.50:0/3224635544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97500b1ae0 0x7f97500c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:34.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.361+0000 7f97574d9700 1 --2- 172.21.15.50:0/3224635544 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9734064e90 0x7f9734067340 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:34.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.361+0000 7f97574d9700 1 --2- 172.21.15.50:0/3224635544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f975006a4c0 0x7f975009ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:34.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.361+0000 7f97574d9700 1 -- 172.21.15.50:0/3224635544 >> 172.21.15.50:0/3224635544 conn(0x7f975009bbd0 msgr2=0x7f97500d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:34.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.361+0000 7f97574d9700 1 -- 172.21.15.50:0/3224635544 shutdown_connections 2023-11-28T11:53:34.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.361+0000 7f97574d9700 1 -- 172.21.15.50:0/3224635544 wait complete. 2023-11-28T11:53:34.366 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'rbd' created 2023-11-28T11:53:34.378 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-11-28T11:53:34.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.485+0000 7fd32ed6f700 1 Processor -- start 2023-11-28T11:53:34.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.485+0000 7fd32ed6f700 1 -- start start 2023-11-28T11:53:34.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.485+0000 7fd32ed6f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd3280b1ae0 0x7fd32806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:34.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.485+0000 7fd32ed6f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd32806a4c0 0x7fd3280d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:34.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.485+0000 7fd32ed6f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32806a9c0 con 0x7fd3280cf0e0 2023-11-28T11:53:34.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.485+0000 7fd32ed6f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32806aca0 con 0x7fd32806a4c0 2023-11-28T11:53:34.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.485+0000 7fd32ed6f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32806af80 con 0x7fd3280b1ae0 2023-11-28T11:53:34.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.485+0000 7fd32d56c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd32806a4c0 0x7fd3280d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:34.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.485+0000 7fd32d56c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd32806a4c0 0x7fd3280d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54598/0 (socket says 172.21.15.50:54598) 2023-11-28T11:53:34.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.485+0000 7fd32d56c700 1 -- 172.21.15.50:0/2731029133 learned_addr learned my addr 172.21.15.50:0/2731029133 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:34.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.489+0000 7fd32dd6d700 1 --2- 172.21.15.50:0/2731029133 >> v2:172.21.15.192:3300/0 conn(0x7fd3280b1ae0 0x7fd32806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.489+0000 7fd32d56c700 1 -- 172.21.15.50:0/2731029133 >> v2:172.21.15.192:3300/0 conn(0x7fd3280b1ae0 msgr2=0x7fd32806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.489+0000 7fd32d56c700 1 --2- 172.21.15.50:0/2731029133 >> v2:172.21.15.192:3300/0 conn(0x7fd3280b1ae0 0x7fd32806d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.489+0000 7fd32d56c700 1 -- 172.21.15.50:0/2731029133 >> v1:172.21.15.192:6789/0 conn(0x7fd3280cf0e0 legacy=0x7fd3280cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:34.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.489+0000 7fd32d56c700 1 -- 172.21.15.50:0/2731029133 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3280b4380 con 0x7fd32806a4c0 2023-11-28T11:53:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.489+0000 7fd32d56c700 1 --2- 172.21.15.50:0/2731029133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd32806a4c0 0x7fd3280d03a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd3280b8870 tx=0x7fd31c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea00e71a1a9988e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.489+0000 7fd32cd6b700 1 -- 172.21.15.50:0/2731029133 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00b8a0 con 0x7fd32806a4c0 2023-11-28T11:53:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.489+0000 7fd32cd6b700 1 -- 172.21.15.50:0/2731029133 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c00ba00 con 0x7fd32806a4c0 2023-11-28T11:53:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.489+0000 7fd32cd6b700 1 -- 172.21.15.50:0/2731029133 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00bd90 con 0x7fd32806a4c0 2023-11-28T11:53:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.489+0000 7fd32ed6f700 1 -- 172.21.15.50:0/2731029133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd32806a4c0 msgr2=0x7fd3280d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.489+0000 7fd32ed6f700 1 --2- 172.21.15.50:0/2731029133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd32806a4c0 0x7fd3280d03a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd3280b8870 tx=0x7fd31c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:53:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.489+0000 7fd32ed6f700 1 -- 172.21.15.50:0/2731029133 shutdown_connections 2023-11-28T11:53:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.489+0000 7fd32ed6f700 1 --2- 172.21.15.50:0/2731029133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd32806a4c0 0x7fd3280d03a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.489+0000 7fd32ed6f700 1 --2- 172.21.15.50:0/2731029133 >> v2:172.21.15.192:3300/0 conn(0x7fd3280b1ae0 0x7fd32806d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.489+0000 7fd32ed6f700 1 -- 172.21.15.50:0/2731029133 >> 172.21.15.50:0/2731029133 conn(0x7fd32809bbd0 msgr2=0x7fd3280b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.489+0000 7fd32ed6f700 1 -- 172.21.15.50:0/2731029133 shutdown_connections 2023-11-28T11:53:34.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.489+0000 7fd32ed6f700 1 -- 172.21.15.50:0/2731029133 wait complete. 2023-11-28T11:53:34.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32ed6f700 1 Processor -- start 2023-11-28T11:53:34.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32ed6f700 1 -- start start 2023-11-28T11:53:34.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32ed6f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd32806a4c0 0x7fd3281f5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:34.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32ed6f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3280b1ae0 0x7fd32809fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:34.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32ed6f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3280cf0e0 0x7fd3281f1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:34.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32ed6f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3281f50f0 con 0x7fd32806a4c0 2023-11-28T11:53:34.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32ed6f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3281f5ac0 con 0x7fd3280b1ae0 2023-11-28T11:53:34.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32ed6f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3281f2060 con 0x7fd3280cf0e0 2023-11-28T11:53:34.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32dd6d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd32806a4c0 0x7fd3281f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:34.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32dd6d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd32806a4c0 0x7fd3281f5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54606/0 (socket says 172.21.15.50:54606) 2023-11-28T11:53:34.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32dd6d700 1 -- 172.21.15.50:0/3120887756 learned_addr learned my addr 172.21.15.50:0/3120887756 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:34.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32d56c700 1 --2- 172.21.15.50:0/3120887756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3280b1ae0 0x7fd32809fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:34.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32e56e700 1 --2- 172.21.15.50:0/3120887756 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3280cf0e0 0x7fd3281f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:34.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32dd6d700 1 -- 172.21.15.50:0/3120887756 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3280cf0e0 msgr2=0x7fd3281f1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:34.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32dd6d700 1 --2- 172.21.15.50:0/3120887756 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3280cf0e0 0x7fd3281f1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:34.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32dd6d700 1 -- 172.21.15.50:0/3120887756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3280b1ae0 msgr2=0x7fd32809fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:34.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32dd6d700 1 --2- 172.21.15.50:0/3120887756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3280b1ae0 0x7fd32809fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:34.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32dd6d700 1 -- 172.21.15.50:0/3120887756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c009570 con 0x7fd32806a4c0 2023-11-28T11:53:34.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32d56c700 1 --2- 172.21.15.50:0/3120887756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3280b1ae0 0x7fd32809fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:53:34.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32e56e700 1 --2- 172.21.15.50:0/3120887756 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3280cf0e0 0x7fd3281f1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:53:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32dd6d700 1 --2- 172.21.15.50:0/3120887756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd32806a4c0 0x7fd3281f5580 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd324007e60 tx=0x7fd32400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd31a7fc700 1 -- 172.21.15.50:0/3120887756 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400eea0 con 0x7fd32806a4c0 2023-11-28T11:53:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd31a7fc700 1 -- 172.21.15.50:0/3120887756 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd324014420 con 0x7fd32806a4c0 2023-11-28T11:53:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32ed6f700 1 -- 172.21.15.50:0/3120887756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3280b60e0 con 0x7fd32806a4c0 2023-11-28T11:53:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd31a7fc700 1 -- 172.21.15.50:0/3120887756 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3240147b0 con 0x7fd32806a4c0 2023-11-28T11:53:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.493+0000 7fd32ed6f700 1 -- 172.21.15.50:0/3120887756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3280b1eb0 con 0x7fd32806a4c0 2023-11-28T11:53:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.497+0000 7fd32ed6f700 1 -- 172.21.15.50:0/3120887756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3281f2580 con 0x7fd32806a4c0 2023-11-28T11:53:34.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.497+0000 7fd31a7fc700 1 -- 172.21.15.50:0/3120887756 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7fd324012050 con 0x7fd32806a4c0 2023-11-28T11:53:34.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.497+0000 7fd31a7fc700 1 --2- 172.21.15.50:0/3120887756 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd30c064e90 0x7fd30c067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:34.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.497+0000 7fd31a7fc700 1 -- 172.21.15.50:0/3120887756 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4813+0+0 (secure 0 0 0) 0x7fd324081ff0 con 0x7fd32806a4c0 2023-11-28T11:53:34.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.497+0000 7fd32d56c700 1 --2- 172.21.15.50:0/3120887756 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd30c064e90 0x7fd30c067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:34.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.497+0000 7fd32d56c700 1 --2- 172.21.15.50:0/3120887756 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd30c064e90 0x7fd30c067340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd31c000c00 tx=0x7fd31c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:34.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.505+0000 7fd31a7fc700 1 -- 172.21.15.50:0/3120887756 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd3240506c0 con 0x7fd32806a4c0 2023-11-28T11:53:34.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:34.669+0000 7fd32ed6f700 1 -- 172.21.15.50:0/3120887756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd32809c010 con 0x7fd32806a4c0 2023-11-28T11:53:35.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.365+0000 7fd31a7fc700 1 -- 172.21.15.50:0/3120887756 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd324053ce0 con 0x7fd32806a4c0 2023-11-28T11:53:35.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.369+0000 7fd32ed6f700 1 -- 172.21.15.50:0/3120887756 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd30c064e90 msgr2=0x7fd30c067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:35.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.369+0000 7fd32ed6f700 1 --2- 172.21.15.50:0/3120887756 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd30c064e90 0x7fd30c067340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd31c000c00 tx=0x7fd31c008030 comp rx=0 tx=0).stop 2023-11-28T11:53:35.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.369+0000 7fd32ed6f700 1 -- 172.21.15.50:0/3120887756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd32806a4c0 msgr2=0x7fd3281f5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:35.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.369+0000 7fd32ed6f700 1 --2- 172.21.15.50:0/3120887756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd32806a4c0 0x7fd3281f5580 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd324007e60 tx=0x7fd32400e3c0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.369+0000 7fd32ed6f700 1 -- 172.21.15.50:0/3120887756 shutdown_connections 2023-11-28T11:53:35.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.369+0000 7fd32ed6f700 1 --2- 172.21.15.50:0/3120887756 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3280cf0e0 0x7fd3281f1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.369+0000 7fd32ed6f700 1 --2- 172.21.15.50:0/3120887756 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd30c064e90 0x7fd30c067340 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.369+0000 7fd32ed6f700 1 --2- 172.21.15.50:0/3120887756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3280b1ae0 0x7fd32809fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.369+0000 7fd32ed6f700 1 --2- 172.21.15.50:0/3120887756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd32806a4c0 0x7fd3281f5580 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.369+0000 7fd32ed6f700 1 -- 172.21.15.50:0/3120887756 >> 172.21.15.50:0/3120887756 conn(0x7fd32809bbd0 msgr2=0x7fd32815bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:35.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.373+0000 7fd32ed6f700 1 -- 172.21.15.50:0/3120887756 shutdown_connections 2023-11-28T11:53:35.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.373+0000 7fd32ed6f700 1 -- 172.21.15.50:0/3120887756 wait complete. 2023-11-28T11:53:35.377 INFO:teuthology.orchestra.run.smithi050.stderr:enabled application 'rbd' on pool 'rbd' 2023-11-28T11:53:35.390 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-28T11:53:35.390 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T11:53:35.391 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T11:53:35.393 INFO:tasks.ceph.mds.a:Started 2023-11-28T11:53:35.393 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T11:53:35.393 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T11:53:35.395 INFO:tasks.ceph.mds.c:Started 2023-11-28T11:53:35.395 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T11:53:35.395 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T11:53:35.398 INFO:tasks.ceph.mds.b:Started 2023-11-28T11:53:35.398 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T11:53:35.398 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T11:53:35.400 INFO:tasks.ceph.mds.d:Started 2023-11-28T11:53:35.401 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-28T11:53:35.401 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:53:35.477 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-11-28T11:53:35.478 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-11-28T11:53:35.478 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-11-28T11:53:35.484 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-11-28T11:53:35.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.525+0000 7fdd6e207700 1 Processor -- start 2023-11-28T11:53:35.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.525+0000 7fdd6e207700 1 -- start start 2023-11-28T11:53:35.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.525+0000 7fdd6e207700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd68158890 0x7fdd680cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:35.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.525+0000 7fdd6e207700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdd680c9590 0x7fdd6806b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:35.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.525+0000 7fdd6e207700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdd680cb890 0x7fdd680cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:35.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.525+0000 7fdd6e207700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd680cc220 con 0x7fdd680c9590 2023-11-28T11:53:35.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.525+0000 7fdd6e207700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd6806c3b0 con 0x7fdd680cb890 2023-11-28T11:53:35.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.525+0000 7fdd6e207700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6806c690 con 0x7fdd68158890 2023-11-28T11:53:35.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd5ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdd680c9590 0x7fdd6806b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:35.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd5ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdd680c9590 0x7fdd6806b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54642/0 (socket says 172.21.15.50:54642) 2023-11-28T11:53:35.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd5ffff700 1 -- 172.21.15.50:0/1042037677 learned_addr learned my addr 172.21.15.50:0/1042037677 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:35.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd677fe700 1 --2- 172.21.15.50:0/1042037677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd68158890 0x7fdd680cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:35.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd67fff700 1 --2- 172.21.15.50:0/1042037677 >> v2:172.21.15.192:3300/0 conn(0x7fdd680cb890 0x7fdd680cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:35.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd5ffff700 1 -- 172.21.15.50:0/1042037677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd68158890 msgr2=0x7fdd680cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:35.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd5ffff700 1 --2- 172.21.15.50:0/1042037677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd68158890 0x7fdd680cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd5ffff700 1 -- 172.21.15.50:0/1042037677 >> v2:172.21.15.192:3300/0 conn(0x7fdd680cb890 msgr2=0x7fdd680cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:35.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd5ffff700 1 --2- 172.21.15.50:0/1042037677 >> v2:172.21.15.192:3300/0 conn(0x7fdd680cb890 0x7fdd680cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd5ffff700 1 -- 172.21.15.50:0/1042037677 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6806c970 con 0x7fdd680c9590 2023-11-28T11:53:35.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd677fe700 1 --2- 172.21.15.50:0/1042037677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd68158890 0x7fdd680cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:53:35.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd5ffff700 1 --2- 172.21.15.50:0/1042037677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd680c9590 0x7fdd6806b9c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdd6806d5f0 tx=0x7fdd58009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7978dbca7569ece1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:35.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd66ffd700 1 -- 172.21.15.50:0/1042037677 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5800b8a0 con 0x7fdd680c9590 2023-11-28T11:53:35.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd66ffd700 1 -- 172.21.15.50:0/1042037677 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5800ba00 con 0x7fdd680c9590 2023-11-28T11:53:35.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd66ffd700 1 -- 172.21.15.50:0/1042037677 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5800bd90 con 0x7fdd680c9590 2023-11-28T11:53:35.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd6e207700 1 -- 172.21.15.50:0/1042037677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd680c9590 msgr2=0x7fdd6806b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:35.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd6e207700 1 --2- 172.21.15.50:0/1042037677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd680c9590 0x7fdd6806b9c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdd6806d5f0 tx=0x7fdd58009bf0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd6e207700 1 -- 172.21.15.50:0/1042037677 shutdown_connections 2023-11-28T11:53:35.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd6e207700 1 --2- 172.21.15.50:0/1042037677 >> v2:172.21.15.192:3300/0 conn(0x7fdd680cb890 0x7fdd680cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd6e207700 1 --2- 172.21.15.50:0/1042037677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd680c9590 0x7fdd6806b9c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd6e207700 1 --2- 172.21.15.50:0/1042037677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd68158890 0x7fdd680cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd6e207700 1 -- 172.21.15.50:0/1042037677 >> 172.21.15.50:0/1042037677 conn(0x7fdd680b0a90 msgr2=0x7fdd680b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:35.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd6e207700 1 -- 172.21.15.50:0/1042037677 shutdown_connections 2023-11-28T11:53:35.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.529+0000 7fdd6e207700 1 -- 172.21.15.50:0/1042037677 wait complete. 2023-11-28T11:53:35.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd6e207700 1 Processor -- start 2023-11-28T11:53:35.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd6e207700 1 -- start start 2023-11-28T11:53:35.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd6e207700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd680c9590 0x7fdd68151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:35.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd6e207700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd680cb890 0x7fdd680b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:35.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd6e207700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd68158890 0x7fdd680c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:35.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd6e207700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd681507c0 con 0x7fdd680c9590 2023-11-28T11:53:35.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd6e207700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd68151620 con 0x7fdd680cb890 2023-11-28T11:53:35.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd6e207700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd68150a10 con 0x7fdd68158890 2023-11-28T11:53:35.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd680c9590 0x7fdd68151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:35.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd680c9590 0x7fdd68151ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54654/0 (socket says 172.21.15.50:54654) 2023-11-28T11:53:35.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd67fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd68158890 0x7fdd680c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:35.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd677fe700 1 -- 172.21.15.50:0/2866609642 learned_addr learned my addr 172.21.15.50:0/2866609642 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:35.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd5ffff700 1 --2- 172.21.15.50:0/2866609642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd680cb890 0x7fdd680b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:35.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd67fff700 1 -- 172.21.15.50:0/2866609642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd680cb890 msgr2=0x7fdd680b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:35.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd67fff700 1 --2- 172.21.15.50:0/2866609642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd680cb890 0x7fdd680b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd67fff700 1 -- 172.21.15.50:0/2866609642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd680c9590 msgr2=0x7fdd68151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:35.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd67fff700 1 --2- 172.21.15.50:0/2866609642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd680c9590 0x7fdd68151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd67fff700 1 -- 172.21.15.50:0/2866609642 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd58009570 con 0x7fdd68158890 2023-11-28T11:53:35.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd677fe700 1 --2- 172.21.15.50:0/2866609642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd680c9590 0x7fdd68151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:53:35.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd67fff700 1 --2- 172.21.15.50:0/2866609642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd68158890 0x7fdd680c2a70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdd60007d40 tx=0x7fdd6000e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:35.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.533+0000 7fdd64ff9700 1 -- 172.21.15.50:0/2866609642 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6000ed30 con 0x7fdd68158890 2023-11-28T11:53:35.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.537+0000 7fdd64ff9700 1 -- 172.21.15.50:0/2866609642 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd60007e90 con 0x7fdd68158890 2023-11-28T11:53:35.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.537+0000 7fdd64ff9700 1 -- 172.21.15.50:0/2866609642 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd60003c80 con 0x7fdd68158890 2023-11-28T11:53:35.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.537+0000 7fdd6e207700 1 -- 172.21.15.50:0/2866609642 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6806cf30 con 0x7fdd68158890 2023-11-28T11:53:35.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.537+0000 7fdd6e207700 1 -- 172.21.15.50:0/2866609642 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6806cc50 con 0x7fdd68158890 2023-11-28T11:53:35.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.537+0000 7fdd6e207700 1 -- 172.21.15.50:0/2866609642 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6815c340 con 0x7fdd68158890 2023-11-28T11:53:35.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.537+0000 7fdd64ff9700 1 -- 172.21.15.50:0/2866609642 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7fdd6001b030 con 0x7fdd68158890 2023-11-28T11:53:35.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.537+0000 7fdd64ff9700 1 --2- 172.21.15.50:0/2866609642 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdd48064ec0 0x7fdd48067370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:35.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.537+0000 7fdd64ff9700 1 -- 172.21.15.50:0/2866609642 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fdd60081570 con 0x7fdd68158890 2023-11-28T11:53:35.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.537+0000 7fdd677fe700 1 --2- 172.21.15.50:0/2866609642 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdd48064ec0 0x7fdd48067370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:35.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.541+0000 7fdd677fe700 1 --2- 172.21.15.50:0/2866609642 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdd48064ec0 0x7fdd48067370 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000afd0 tx=0x7fdd50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:35.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.549+0000 7fdd64ff9700 1 -- 172.21.15.50:0/2866609642 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdd6004fac0 con 0x7fdd68158890 2023-11-28T11:53:35.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.717+0000 7fdd6e207700 1 -- 172.21.15.50:0/2866609642 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd68151790 con 0x7fdd68158890 2023-11-28T11:53:35.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.717+0000 7fdd64ff9700 1 -- 172.21.15.50:0/2866609642 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+14129 (secure 0 0 0) 0x7fdd600530e0 con 0x7fdd68158890 2023-11-28T11:53:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:53:35.723 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":15,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:35.353843+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:53:35.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.721+0000 7fdd6e207700 1 -- 172.21.15.50:0/2866609642 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdd48064ec0 msgr2=0x7fdd48067370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:35.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.721+0000 7fdd6e207700 1 --2- 172.21.15.50:0/2866609642 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdd48064ec0 0x7fdd48067370 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000afd0 tx=0x7fdd50008040 comp rx=0 tx=0).stop 2023-11-28T11:53:35.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.721+0000 7fdd6e207700 1 -- 172.21.15.50:0/2866609642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd68158890 msgr2=0x7fdd680c2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:35.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.721+0000 7fdd6e207700 1 --2- 172.21.15.50:0/2866609642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd68158890 0x7fdd680c2a70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdd60007d40 tx=0x7fdd6000e3c0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.721+0000 7fdd6e207700 1 -- 172.21.15.50:0/2866609642 shutdown_connections 2023-11-28T11:53:35.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.721+0000 7fdd6e207700 1 --2- 172.21.15.50:0/2866609642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd68158890 0x7fdd680c2a70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.721+0000 7fdd6e207700 1 --2- 172.21.15.50:0/2866609642 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdd48064ec0 0x7fdd48067370 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.721+0000 7fdd6e207700 1 --2- 172.21.15.50:0/2866609642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd680cb890 0x7fdd680b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.721+0000 7fdd6e207700 1 --2- 172.21.15.50:0/2866609642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd680c9590 0x7fdd68151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.721+0000 7fdd6e207700 1 -- 172.21.15.50:0/2866609642 >> 172.21.15.50:0/2866609642 conn(0x7fdd680b0a90 msgr2=0x7fdd680b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:35.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.721+0000 7fdd6e207700 1 -- 172.21.15.50:0/2866609642 shutdown_connections 2023-11-28T11:53:35.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.721+0000 7fdd6e207700 1 -- 172.21.15.50:0/2866609642 wait complete. 2023-11-28T11:53:35.738 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:53:35.739 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:53:35.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.853+0000 7f9c1624b700 1 Processor -- start 2023-11-28T11:53:35.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.853+0000 7f9c1624b700 1 -- start start 2023-11-28T11:53:35.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.853+0000 7f9c1624b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9c100b1ae0 0x7f9c1006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:35.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.853+0000 7f9c1624b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9c100cf0e0 0x7f9c100cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:35.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.853+0000 7f9c1624b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c100cfa40 con 0x7f9c1006a4c0 2023-11-28T11:53:35.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.853+0000 7f9c1624b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c100d0ab0 con 0x7f9c100cf0e0 2023-11-28T11:53:35.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.853+0000 7f9c1624b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1006a9c0 con 0x7f9c100b1ae0 2023-11-28T11:53:35.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.853+0000 7f9c15a4a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9c100cf0e0 0x7f9c100cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:35.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.853+0000 7f9c15a4a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9c100cf0e0 0x7f9c100cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54660/0 (socket says 172.21.15.50:54660) 2023-11-28T11:53:35.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.853+0000 7f9c15a4a700 1 -- 172.21.15.50:0/2029785253 learned_addr learned my addr 172.21.15.50:0/2029785253 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:35.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.853+0000 7f9c15249700 1 --2- 172.21.15.50:0/2029785253 >> v2:172.21.15.192:3300/0 conn(0x7f9c100b1ae0 0x7f9c1006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:35.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.853+0000 7f9c15a4a700 1 -- 172.21.15.50:0/2029785253 >> v2:172.21.15.192:3300/0 conn(0x7f9c100b1ae0 msgr2=0x7f9c1006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:35.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c15a4a700 1 --2- 172.21.15.50:0/2029785253 >> v2:172.21.15.192:3300/0 conn(0x7f9c100b1ae0 0x7f9c1006d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c15a4a700 1 -- 172.21.15.50:0/2029785253 >> v1:172.21.15.192:6789/0 conn(0x7f9c1006a4c0 legacy=0x7f9c100d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:35.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c15a4a700 1 -- 172.21.15.50:0/2029785253 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1006aca0 con 0x7f9c100cf0e0 2023-11-28T11:53:35.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c15a4a700 1 --2- 172.21.15.50:0/2029785253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c100cf0e0 0x7f9c100cf500 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c100b8870 tx=0x7f9c0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9edd659d3727ddd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:35.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c03fff700 1 -- 172.21.15.50:0/2029785253 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0800e070 con 0x7f9c100cf0e0 2023-11-28T11:53:35.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c03fff700 1 -- 172.21.15.50:0/2029785253 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0800b9c0 con 0x7f9c100cf0e0 2023-11-28T11:53:35.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c03fff700 1 -- 172.21.15.50:0/2029785253 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0800bd70 con 0x7f9c100cf0e0 2023-11-28T11:53:35.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c1624b700 1 -- 172.21.15.50:0/2029785253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c100cf0e0 msgr2=0x7f9c100cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:35.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c1624b700 1 --2- 172.21.15.50:0/2029785253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c100cf0e0 0x7f9c100cf500 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c100b8870 tx=0x7f9c0800b330 comp rx=0 tx=0).stop 2023-11-28T11:53:35.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c1624b700 1 -- 172.21.15.50:0/2029785253 shutdown_connections 2023-11-28T11:53:35.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c1624b700 1 --2- 172.21.15.50:0/2029785253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c100cf0e0 0x7f9c100cf500 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c1624b700 1 --2- 172.21.15.50:0/2029785253 >> v2:172.21.15.192:3300/0 conn(0x7f9c100b1ae0 0x7f9c1006d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c1624b700 1 -- 172.21.15.50:0/2029785253 >> 172.21.15.50:0/2029785253 conn(0x7f9c1009bbd0 msgr2=0x7f9c100b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:35.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c1624b700 1 -- 172.21.15.50:0/2029785253 shutdown_connections 2023-11-28T11:53:35.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c1624b700 1 -- 172.21.15.50:0/2029785253 wait complete. 2023-11-28T11:53:35.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c1624b700 1 Processor -- start 2023-11-28T11:53:35.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c1624b700 1 -- start start 2023-11-28T11:53:35.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c1624b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c1006a4c0 0x7f9c100c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:35.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c1624b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c100b1ae0 0x7f9c101f15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:35.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c1624b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c100cf0e0 0x7f9c100c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:35.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c1624b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100c91f0 con 0x7f9c100cf0e0 2023-11-28T11:53:35.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c1624b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100c8260 con 0x7f9c100b1ae0 2023-11-28T11:53:35.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c1624b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100c8820 con 0x7f9c1006a4c0 2023-11-28T11:53:35.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c15a4a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c100cf0e0 0x7f9c100c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:35.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c15a4a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c100cf0e0 0x7f9c100c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54664/0 (socket says 172.21.15.50:54664) 2023-11-28T11:53:35.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.857+0000 7f9c15a4a700 1 -- 172.21.15.50:0/3748888409 learned_addr learned my addr 172.21.15.50:0/3748888409 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:35.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c14a48700 1 --2- 172.21.15.50:0/3748888409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c100b1ae0 0x7f9c101f15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:35.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c15249700 1 --2- 172.21.15.50:0/3748888409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c1006a4c0 0x7f9c100c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:35.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c15a4a700 1 -- 172.21.15.50:0/3748888409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c1006a4c0 msgr2=0x7f9c100c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:35.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c15a4a700 1 --2- 172.21.15.50:0/3748888409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c1006a4c0 0x7f9c100c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c15a4a700 1 -- 172.21.15.50:0/3748888409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c100b1ae0 msgr2=0x7f9c101f15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:35.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c15a4a700 1 --2- 172.21.15.50:0/3748888409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c100b1ae0 0x7f9c101f15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:35.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c15a4a700 1 -- 172.21.15.50:0/3748888409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c08009b30 con 0x7f9c100cf0e0 2023-11-28T11:53:35.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c14a48700 1 --2- 172.21.15.50:0/3748888409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c100b1ae0 0x7f9c101f15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:53:35.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c15249700 1 --2- 172.21.15.50:0/3748888409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c1006a4c0 0x7f9c100c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:53:35.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c15a4a700 1 --2- 172.21.15.50:0/3748888409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c100cf0e0 0x7f9c100c6300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800b730 tx=0x7f9c08004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:35.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c01ffb700 1 -- 172.21.15.50:0/3748888409 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c080092e0 con 0x7f9c100cf0e0 2023-11-28T11:53:35.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c01ffb700 1 -- 172.21.15.50:0/3748888409 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0801c440 con 0x7f9c100cf0e0 2023-11-28T11:53:35.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c01ffb700 1 -- 172.21.15.50:0/3748888409 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0801c7f0 con 0x7f9c100cf0e0 2023-11-28T11:53:35.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c1624b700 1 -- 172.21.15.50:0/3748888409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c100b4380 con 0x7f9c100cf0e0 2023-11-28T11:53:35.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c1624b700 1 -- 172.21.15.50:0/3748888409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1006af80 con 0x7f9c100cf0e0 2023-11-28T11:53:35.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c1624b700 1 -- 172.21.15.50:0/3748888409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c100b1eb0 con 0x7f9c100cf0e0 2023-11-28T11:53:35.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c01ffb700 1 -- 172.21.15.50:0/3748888409 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7f9c08022030 con 0x7f9c100cf0e0 2023-11-28T11:53:35.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c01ffb700 1 --2- 172.21.15.50:0/3748888409 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9bf4064e90 0x7f9bf4067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:35.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.861+0000 7f9c01ffb700 1 -- 172.21.15.50:0/3748888409 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f9c080833a0 con 0x7f9c100cf0e0 2023-11-28T11:53:35.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.865+0000 7f9c15249700 1 --2- 172.21.15.50:0/3748888409 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9bf4064e90 0x7f9bf4067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:35.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.865+0000 7f9c15249700 1 --2- 172.21.15.50:0/3748888409 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9bf4064e90 0x7f9bf4067340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009a10 tx=0x7f9c04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:35.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:35.869+0000 7f9c01ffb700 1 -- 172.21.15.50:0/3748888409 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9c080518f0 con 0x7f9c100cf0e0 2023-11-28T11:53:35.928 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:53:35.931 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:53:36.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.033+0000 7f9c1624b700 1 -- 172.21.15.50:0/3748888409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9c1006b260 con 0x7f9c100cf0e0 2023-11-28T11:53:36.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.037+0000 7f9c01ffb700 1 -- 172.21.15.50:0/3748888409 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9c08054f10 con 0x7f9c100cf0e0 2023-11-28T11:53:36.040 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:53:36.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.037+0000 7f9c1624b700 1 -- 172.21.15.50:0/3748888409 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9bf4064e90 msgr2=0x7f9bf4067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.037+0000 7f9c1624b700 1 --2- 172.21.15.50:0/3748888409 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9bf4064e90 0x7f9bf4067340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009a10 tx=0x7f9c04008040 comp rx=0 tx=0).stop 2023-11-28T11:53:36.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.037+0000 7f9c1624b700 1 -- 172.21.15.50:0/3748888409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c100cf0e0 msgr2=0x7f9c100c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.037+0000 7f9c1624b700 1 --2- 172.21.15.50:0/3748888409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c100cf0e0 0x7f9c100c6300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800b730 tx=0x7f9c08004af0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.037+0000 7f9c1624b700 1 -- 172.21.15.50:0/3748888409 shutdown_connections 2023-11-28T11:53:36.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.037+0000 7f9c1624b700 1 --2- 172.21.15.50:0/3748888409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c100cf0e0 0x7f9c100c6300 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.037+0000 7f9c1624b700 1 --2- 172.21.15.50:0/3748888409 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9bf4064e90 0x7f9bf4067340 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.037+0000 7f9c1624b700 1 --2- 172.21.15.50:0/3748888409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c100b1ae0 0x7f9c101f15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.041+0000 7f9c1624b700 1 --2- 172.21.15.50:0/3748888409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c1006a4c0 0x7f9c100c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.041+0000 7f9c1624b700 1 -- 172.21.15.50:0/3748888409 >> 172.21.15.50:0/3748888409 conn(0x7f9c1009bbd0 msgr2=0x7f9c100b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:36.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.041+0000 7f9c1624b700 1 -- 172.21.15.50:0/3748888409 shutdown_connections 2023-11-28T11:53:36.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.041+0000 7f9c1624b700 1 -- 172.21.15.50:0/3748888409 wait complete. 2023-11-28T11:53:36.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:53:36.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.181+0000 7f6fbe1ec700 1 Processor -- start 2023-11-28T11:53:36.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.181+0000 7f6fbe1ec700 1 -- start start 2023-11-28T11:53:36.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.181+0000 7f6fbe1ec700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fb80b1ae0 0x7f6fb806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.181+0000 7f6fbe1ec700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fb806a4c0 0x7f6fb80d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.181+0000 7f6fbe1ec700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb806a9c0 con 0x7f6fb80cf0e0 2023-11-28T11:53:36.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbe1ec700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb806aca0 con 0x7f6fb80b1ae0 2023-11-28T11:53:36.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbe1ec700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb806af80 con 0x7f6fb806a4c0 2023-11-28T11:53:36.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbd9eb700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6fb80cf0e0 0x7f6fb80b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45912/0 (socket says 172.21.15.50:45912) 2023-11-28T11:53:36.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbd1ea700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6fb80b1ae0 0x7f6fb806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbd9eb700 1 -- 172.21.15.50:0/3789186796 learned_addr learned my addr 172.21.15.50:0/3789186796 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:36.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbc9e9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fb806a4c0 0x7f6fb80d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6faffff700 1 -- 172.21.15.50:0/3789186796 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900388719 0 0) 0x7f6fb806a9c0 con 0x7f6fb80cf0e0 2023-11-28T11:53:36.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6faffff700 1 -- 172.21.15.50:0/3789186796 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fa40035d0 con 0x7f6fb80cf0e0 2023-11-28T11:53:36.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbc9e9700 1 -- 172.21.15.50:0/3789186796 >> v2:172.21.15.50:3300/0 conn(0x7f6fb80b1ae0 msgr2=0x7f6fb806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:36.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbc9e9700 1 --2- 172.21.15.50:0/3789186796 >> v2:172.21.15.50:3300/0 conn(0x7f6fb80b1ae0 0x7f6fb806d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbc9e9700 1 -- 172.21.15.50:0/3789186796 >> v1:172.21.15.50:6789/0 conn(0x7f6fb80cf0e0 legacy=0x7f6fb80b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbc9e9700 1 -- 172.21.15.50:0/3789186796 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb80b4380 con 0x7f6fb806a4c0 2023-11-28T11:53:36.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbc9e9700 1 --2- 172.21.15.50:0/3789186796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fb806a4c0 0x7f6fb80d03a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009850 tx=0x7f6fa8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2f2674e24f28179 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:36.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6faffff700 1 -- 172.21.15.50:0/3789186796 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8011830 con 0x7f6fb806a4c0 2023-11-28T11:53:36.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6faffff700 1 -- 172.21.15.50:0/3789186796 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa8011990 con 0x7f6fb806a4c0 2023-11-28T11:53:36.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6faffff700 1 -- 172.21.15.50:0/3789186796 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8011d00 con 0x7f6fb806a4c0 2023-11-28T11:53:36.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbe1ec700 1 -- 172.21.15.50:0/3789186796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fb806a4c0 msgr2=0x7f6fb80d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbe1ec700 1 --2- 172.21.15.50:0/3789186796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fb806a4c0 0x7f6fb80d03a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009850 tx=0x7f6fa8009b60 comp rx=0 tx=0).stop 2023-11-28T11:53:36.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbe1ec700 1 -- 172.21.15.50:0/3789186796 shutdown_connections 2023-11-28T11:53:36.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbe1ec700 1 --2- 172.21.15.50:0/3789186796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fb806a4c0 0x7f6fb80d03a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbe1ec700 1 --2- 172.21.15.50:0/3789186796 >> v2:172.21.15.50:3300/0 conn(0x7f6fb80b1ae0 0x7f6fb806d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbe1ec700 1 -- 172.21.15.50:0/3789186796 >> 172.21.15.50:0/3789186796 conn(0x7f6fb809bbd0 msgr2=0x7f6fb80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:36.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbe1ec700 1 -- 172.21.15.50:0/3789186796 shutdown_connections 2023-11-28T11:53:36.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbe1ec700 1 -- 172.21.15.50:0/3789186796 wait complete. 2023-11-28T11:53:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.185+0000 7f6fbe1ec700 1 Processor -- start 2023-11-28T11:53:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbe1ec700 1 -- start start 2023-11-28T11:53:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbe1ec700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fb806a4c0 0x7f6fb809e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbe1ec700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fb80b1ae0 0x7f6fb80c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbe1ec700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb80cf0e0 0x7f6fb80c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbe1ec700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb809fd60 con 0x7f6fb80cf0e0 2023-11-28T11:53:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbe1ec700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb809f150 con 0x7f6fb806a4c0 2023-11-28T11:53:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbe1ec700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb809f430 con 0x7f6fb80b1ae0 2023-11-28T11:53:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbd9eb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb80cf0e0 0x7f6fb80c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbc9e9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fb80b1ae0 0x7f6fb80c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbd9eb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb80cf0e0 0x7f6fb80c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54680/0 (socket says 172.21.15.50:54680) 2023-11-28T11:53:36.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbd9eb700 1 -- 172.21.15.50:0/1726368694 learned_addr learned my addr 172.21.15.50:0/1726368694 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbd1ea700 1 --2- 172.21.15.50:0/1726368694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fb806a4c0 0x7f6fb809e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbc9e9700 1 -- 172.21.15.50:0/1726368694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fb806a4c0 msgr2=0x7f6fb809e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbc9e9700 1 --2- 172.21.15.50:0/1726368694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fb806a4c0 0x7f6fb809e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbc9e9700 1 -- 172.21.15.50:0/1726368694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb80cf0e0 msgr2=0x7f6fb80c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbc9e9700 1 --2- 172.21.15.50:0/1726368694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb80cf0e0 0x7f6fb80c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbc9e9700 1 -- 172.21.15.50:0/1726368694 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa80094b0 con 0x7f6fb80b1ae0 2023-11-28T11:53:36.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbd9eb700 1 --2- 172.21.15.50:0/1726368694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb80cf0e0 0x7f6fb80c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:53:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbc9e9700 1 --2- 172.21.15.50:0/1726368694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fb80b1ae0 0x7f6fb80c67d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8016000 tx=0x7f6fa8004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fadffb700 1 -- 172.21.15.50:0/1726368694 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80044d0 con 0x7f6fb80b1ae0 2023-11-28T11:53:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fadffb700 1 -- 172.21.15.50:0/1726368694 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa801e070 con 0x7f6fb80b1ae0 2023-11-28T11:53:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbe1ec700 1 -- 172.21.15.50:0/1726368694 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb80b60e0 con 0x7f6fb80b1ae0 2023-11-28T11:53:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fbe1ec700 1 -- 172.21.15.50:0/1726368694 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb80b1eb0 con 0x7f6fb80b1ae0 2023-11-28T11:53:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.189+0000 7f6fadffb700 1 -- 172.21.15.50:0/1726368694 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8003900 con 0x7f6fb80b1ae0 2023-11-28T11:53:36.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.193+0000 7f6fbe1ec700 1 -- 172.21.15.50:0/1726368694 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb80d08e0 con 0x7f6fb80b1ae0 2023-11-28T11:53:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.193+0000 7f6fadffb700 1 -- 172.21.15.50:0/1726368694 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7f6fa800f050 con 0x7f6fb80b1ae0 2023-11-28T11:53:36.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.193+0000 7f6fadffb700 1 --2- 172.21.15.50:0/1726368694 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6f9c064e90 0x7f6f9c067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.193+0000 7f6fadffb700 1 -- 172.21.15.50:0/1726368694 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f6fa8082840 con 0x7f6fb80b1ae0 2023-11-28T11:53:36.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.193+0000 7f6fbd1ea700 1 --2- 172.21.15.50:0/1726368694 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6f9c064e90 0x7f6f9c067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.197+0000 7f6fbd1ea700 1 --2- 172.21.15.50:0/1726368694 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6f9c064e90 0x7f6f9c067340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009bf0 tx=0x7f6fb4009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:36.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.201+0000 7f6fadffb700 1 -- 172.21.15.50:0/1726368694 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6fa8050d90 con 0x7f6fb80b1ae0 2023-11-28T11:53:36.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.369+0000 7f6fbe1ec700 1 -- 172.21.15.50:0/1726368694 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6fb809f570 con 0x7f6fb80b1ae0 2023-11-28T11:53:36.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.369+0000 7f6fadffb700 1 -- 172.21.15.50:0/1726368694 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6fa8020020 con 0x7f6fb80b1ae0 2023-11-28T11:53:36.373 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:53:36.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.373+0000 7f6fbe1ec700 1 -- 172.21.15.50:0/1726368694 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6f9c064e90 msgr2=0x7f6f9c067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.373+0000 7f6fbe1ec700 1 --2- 172.21.15.50:0/1726368694 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6f9c064e90 0x7f6f9c067340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009bf0 tx=0x7f6fb4009240 comp rx=0 tx=0).stop 2023-11-28T11:53:36.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.373+0000 7f6fbe1ec700 1 -- 172.21.15.50:0/1726368694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fb80b1ae0 msgr2=0x7f6fb80c67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.373+0000 7f6fbe1ec700 1 --2- 172.21.15.50:0/1726368694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fb80b1ae0 0x7f6fb80c67d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8016000 tx=0x7f6fa8004770 comp rx=0 tx=0).stop 2023-11-28T11:53:36.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.373+0000 7f6fbe1ec700 1 -- 172.21.15.50:0/1726368694 shutdown_connections 2023-11-28T11:53:36.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.373+0000 7f6fbe1ec700 1 --2- 172.21.15.50:0/1726368694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6fb80cf0e0 0x7f6fb80c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.373+0000 7f6fbe1ec700 1 --2- 172.21.15.50:0/1726368694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fb80b1ae0 0x7f6fb80c67d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.373+0000 7f6fbe1ec700 1 --2- 172.21.15.50:0/1726368694 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6f9c064e90 0x7f6f9c067340 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.373+0000 7f6fbe1ec700 1 --2- 172.21.15.50:0/1726368694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fb806a4c0 0x7f6fb809e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.373+0000 7f6fbe1ec700 1 -- 172.21.15.50:0/1726368694 >> 172.21.15.50:0/1726368694 conn(0x7f6fb809bbd0 msgr2=0x7f6fb80b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:36.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.373+0000 7f6fbe1ec700 1 -- 172.21.15.50:0/1726368694 shutdown_connections 2023-11-28T11:53:36.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.373+0000 7f6fbe1ec700 1 -- 172.21.15.50:0/1726368694 wait complete. 2023-11-28T11:53:36.392 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:53:36.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.493+0000 7f99bb6bc700 1 Processor -- start 2023-11-28T11:53:36.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.493+0000 7f99bb6bc700 1 -- start start 2023-11-28T11:53:36.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99bb6bc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f99b4153420 0x7f99b40c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99bb6bc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99b41537f0 0x7f99b40ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99bb6bc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b40cad30 con 0x7f99b415cb50 2023-11-28T11:53:36.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99bb6bc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b40cdda0 con 0x7f99b41537f0 2023-11-28T11:53:36.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99bb6bc700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b40b0cd0 con 0x7f99b4153420 2023-11-28T11:53:36.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99b8c57700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99b41537f0 0x7f99b40ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99b8c57700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99b41537f0 0x7f99b40ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54694/0 (socket says 172.21.15.50:54694) 2023-11-28T11:53:36.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99b8c57700 1 -- 172.21.15.50:0/537884796 learned_addr learned my addr 172.21.15.50:0/537884796 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:36.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99b9458700 1 --2- 172.21.15.50:0/537884796 >> v2:172.21.15.192:3300/0 conn(0x7f99b4153420 0x7f99b40c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99b8c57700 1 -- 172.21.15.50:0/537884796 >> v2:172.21.15.192:3300/0 conn(0x7f99b4153420 msgr2=0x7f99b40c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:36.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99b8c57700 1 --2- 172.21.15.50:0/537884796 >> v2:172.21.15.192:3300/0 conn(0x7f99b4153420 0x7f99b40c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99b8c57700 1 -- 172.21.15.50:0/537884796 >> v1:172.21.15.50:6789/0 conn(0x7f99b415cb50 legacy=0x7f99b415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99b8c57700 1 -- 172.21.15.50:0/537884796 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b40caa00 con 0x7f99b41537f0 2023-11-28T11:53:36.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99b8c57700 1 --2- 172.21.15.50:0/537884796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b41537f0 0x7f99b40ce050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f99b406f8e0 tx=0x7f99a400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90177bb5ab197f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:36.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99abfff700 1 -- 172.21.15.50:0/537884796 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a400dd30 con 0x7f99b41537f0 2023-11-28T11:53:36.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99abfff700 1 -- 172.21.15.50:0/537884796 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a400de90 con 0x7f99b41537f0 2023-11-28T11:53:36.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99abfff700 1 -- 172.21.15.50:0/537884796 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4010690 con 0x7f99b41537f0 2023-11-28T11:53:36.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99bb6bc700 1 -- 172.21.15.50:0/537884796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b41537f0 msgr2=0x7f99b40ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99bb6bc700 1 --2- 172.21.15.50:0/537884796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b41537f0 0x7f99b40ce050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f99b406f8e0 tx=0x7f99a400be90 comp rx=0 tx=0).stop 2023-11-28T11:53:36.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99bb6bc700 1 -- 172.21.15.50:0/537884796 shutdown_connections 2023-11-28T11:53:36.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99bb6bc700 1 --2- 172.21.15.50:0/537884796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b41537f0 0x7f99b40ce050 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99bb6bc700 1 --2- 172.21.15.50:0/537884796 >> v2:172.21.15.192:3300/0 conn(0x7f99b4153420 0x7f99b40c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99bb6bc700 1 -- 172.21.15.50:0/537884796 >> 172.21.15.50:0/537884796 conn(0x7f99b406caf0 msgr2=0x7f99b40ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:36.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99bb6bc700 1 -- 172.21.15.50:0/537884796 shutdown_connections 2023-11-28T11:53:36.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.497+0000 7f99bb6bc700 1 -- 172.21.15.50:0/537884796 wait complete. 2023-11-28T11:53:36.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99bb6bc700 1 Processor -- start 2023-11-28T11:53:36.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99bb6bc700 1 -- start start 2023-11-28T11:53:36.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99bb6bc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b4153420 0x7f99b413bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99bb6bc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99b41537f0 0x7f99b40c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99bb6bc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99b415cb50 0x7f99b41f0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99bb6bc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b4151130 con 0x7f99b4153420 2023-11-28T11:53:36.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99bb6bc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40c8810 con 0x7f99b41537f0 2023-11-28T11:53:36.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99bb6bc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b413c070 con 0x7f99b415cb50 2023-11-28T11:53:36.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99b9458700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b4153420 0x7f99b413bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99b9458700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b4153420 0x7f99b413bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54698/0 (socket says 172.21.15.50:54698) 2023-11-28T11:53:36.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99b9458700 1 -- 172.21.15.50:0/3833133377 learned_addr learned my addr 172.21.15.50:0/3833133377 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:36.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99b9c59700 1 --2- 172.21.15.50:0/3833133377 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99b415cb50 0x7f99b41f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99b8c57700 1 --2- 172.21.15.50:0/3833133377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99b41537f0 0x7f99b40c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99b9458700 1 -- 172.21.15.50:0/3833133377 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99b415cb50 msgr2=0x7f99b41f0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99b9458700 1 --2- 172.21.15.50:0/3833133377 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99b415cb50 0x7f99b41f0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99b9458700 1 -- 172.21.15.50:0/3833133377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99b41537f0 msgr2=0x7f99b40c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99b9458700 1 --2- 172.21.15.50:0/3833133377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99b41537f0 0x7f99b40c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99b9458700 1 -- 172.21.15.50:0/3833133377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a400b810 con 0x7f99b4153420 2023-11-28T11:53:36.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99b9458700 1 --2- 172.21.15.50:0/3833133377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b4153420 0x7f99b413bb30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f99b000ea00 tx=0x7f99b000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:36.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99a9ffb700 1 -- 172.21.15.50:0/3833133377 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0009720 con 0x7f99b4153420 2023-11-28T11:53:36.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99a9ffb700 1 -- 172.21.15.50:0/3833133377 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b000eea0 con 0x7f99b4153420 2023-11-28T11:53:36.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99bb6bc700 1 -- 172.21.15.50:0/3833133377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b40b0f70 con 0x7f99b4153420 2023-11-28T11:53:36.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99a9ffb700 1 -- 172.21.15.50:0/3833133377 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b000c9f0 con 0x7f99b4153420 2023-11-28T11:53:36.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99bb6bc700 1 -- 172.21.15.50:0/3833133377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b40ce590 con 0x7f99b4153420 2023-11-28T11:53:36.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.501+0000 7f99bb6bc700 1 -- 172.21.15.50:0/3833133377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b40b1250 con 0x7f99b4153420 2023-11-28T11:53:36.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.505+0000 7f99a9ffb700 1 -- 172.21.15.50:0/3833133377 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7f99b0019030 con 0x7f99b4153420 2023-11-28T11:53:36.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.505+0000 7f99a9ffb700 1 --2- 172.21.15.50:0/3833133377 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9998064e90 0x7f9998067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.505+0000 7f99a9ffb700 1 -- 172.21.15.50:0/3833133377 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f99b00818f0 con 0x7f99b4153420 2023-11-28T11:53:36.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.505+0000 7f99b8c57700 1 --2- 172.21.15.50:0/3833133377 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9998064e90 0x7f9998067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.505+0000 7f99b8c57700 1 --2- 172.21.15.50:0/3833133377 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9998064e90 0x7f9998067340 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f99b4153bf0 tx=0x7f99a4013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:36.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.513+0000 7f99a9ffb700 1 -- 172.21.15.50:0/3833133377 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f99b004fe30 con 0x7f99b4153420 2023-11-28T11:53:36.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.725+0000 7f99bb6bc700 1 -- 172.21.15.50:0/3833133377 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99b4072500 con 0x7f99b4153420 2023-11-28T11:53:36.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.725+0000 7f99a9ffb700 1 -- 172.21.15.50:0/3833133377 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f99b0017de0 con 0x7f99b4153420 2023-11-28T11:53:36.729 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:53:36.729 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2457318670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2457318670},{"type":"v1","addr":"172.21.15.192:6836","nonce":2457318670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3448258722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3448258722},{"type":"v1","addr":"172.21.15.192:6837","nonce":3448258722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/490368853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":490368853},{"type":"v1","addr":"172.21.15.50:6833","nonce":490368853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3764199418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3764199418},{"type":"v1","addr":"172.21.15.50:6835","nonce":3764199418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-11-28T11:53:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.729+0000 7f99bb6bc700 1 -- 172.21.15.50:0/3833133377 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9998064e90 msgr2=0x7f9998067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.729+0000 7f99bb6bc700 1 --2- 172.21.15.50:0/3833133377 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9998064e90 0x7f9998067340 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f99b4153bf0 tx=0x7f99a4013000 comp rx=0 tx=0).stop 2023-11-28T11:53:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.729+0000 7f99bb6bc700 1 -- 172.21.15.50:0/3833133377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b4153420 msgr2=0x7f99b413bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.729+0000 7f99bb6bc700 1 --2- 172.21.15.50:0/3833133377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b4153420 0x7f99b413bb30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f99b000ea00 tx=0x7f99b000ed10 comp rx=0 tx=0).stop 2023-11-28T11:53:36.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.729+0000 7f99bb6bc700 1 -- 172.21.15.50:0/3833133377 shutdown_connections 2023-11-28T11:53:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.729+0000 7f99bb6bc700 1 --2- 172.21.15.50:0/3833133377 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99b415cb50 0x7f99b41f0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.729+0000 7f99bb6bc700 1 --2- 172.21.15.50:0/3833133377 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9998064e90 0x7f9998067340 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.729+0000 7f99bb6bc700 1 --2- 172.21.15.50:0/3833133377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99b41537f0 0x7f99b40c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.729+0000 7f99bb6bc700 1 --2- 172.21.15.50:0/3833133377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99b4153420 0x7f99b413bb30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.729+0000 7f99bb6bc700 1 -- 172.21.15.50:0/3833133377 >> 172.21.15.50:0/3833133377 conn(0x7f99b406caf0 msgr2=0x7f99b4069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.729+0000 7f99bb6bc700 1 -- 172.21.15.50:0/3833133377 shutdown_connections 2023-11-28T11:53:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.729+0000 7f99bb6bc700 1 -- 172.21.15.50:0/3833133377 wait complete. 2023-11-28T11:53:36.733 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 3 2023-11-28T11:53:36.746 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:53:36.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.837+0000 7f6cef2e0700 1 Processor -- start 2023-11-28T11:53:36.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.837+0000 7f6cef2e0700 1 -- start start 2023-11-28T11:53:36.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cef2e0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6ce80cb340 0x7f6ce806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cef2e0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6ce806a800 0x7f6ce8162f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cef2e0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce806c6c0 con 0x7f6ce806f7c0 2023-11-28T11:53:36.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cef2e0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce806dbf0 con 0x7f6ce80cb340 2023-11-28T11:53:36.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cef2e0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce8072240 con 0x7f6ce806a800 2023-11-28T11:53:36.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cee2de700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6ce80cb340 0x7f6ce806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cedadd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6ce806f7c0 0x7f6ce806a0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45930/0 (socket says 172.21.15.50:45930) 2023-11-28T11:53:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cedadd700 1 -- 172.21.15.50:0/3249295536 learned_addr learned my addr 172.21.15.50:0/3249295536 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cee2de700 1 -- 172.21.15.50:0/3249295536 >> v2:172.21.15.192:3300/0 conn(0x7f6ce806a800 msgr2=0x7f6ce8162f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6ceeadf700 1 --2- 172.21.15.50:0/3249295536 >> v2:172.21.15.192:3300/0 conn(0x7f6ce806a800 0x7f6ce8162f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6ced2dc700 1 -- 172.21.15.50:0/3249295536 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877354704 0 0) 0x7f6ce806c6c0 con 0x7f6ce806f7c0 2023-11-28T11:53:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cee2de700 1 --2- 172.21.15.50:0/3249295536 >> v2:172.21.15.192:3300/0 conn(0x7f6ce806a800 0x7f6ce8162f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cee2de700 1 -- 172.21.15.50:0/3249295536 >> v1:172.21.15.50:6789/0 conn(0x7f6ce806f7c0 legacy=0x7f6ce806a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cee2de700 1 -- 172.21.15.50:0/3249295536 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce806c8f0 con 0x7f6ce80cb340 2023-11-28T11:53:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6ceeadf700 1 --2- 172.21.15.50:0/3249295536 >> v2:172.21.15.192:3300/0 conn(0x7f6ce806a800 0x7f6ce8162f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:53:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cee2de700 1 --2- 172.21.15.50:0/3249295536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce80cb340 0x7f6ce806d6b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ce806fc40 tx=0x7f6ce4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf62b69f7607c0f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6ced2dc700 1 -- 172.21.15.50:0/3249295536 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4011830 con 0x7f6ce80cb340 2023-11-28T11:53:36.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6ced2dc700 1 -- 172.21.15.50:0/3249295536 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce4011990 con 0x7f6ce80cb340 2023-11-28T11:53:36.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6ced2dc700 1 -- 172.21.15.50:0/3249295536 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4011d40 con 0x7f6ce80cb340 2023-11-28T11:53:36.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cef2e0700 1 -- 172.21.15.50:0/3249295536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce80cb340 msgr2=0x7f6ce806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cef2e0700 1 --2- 172.21.15.50:0/3249295536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce80cb340 0x7f6ce806d6b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ce806fc40 tx=0x7f6ce4009b30 comp rx=0 tx=0).stop 2023-11-28T11:53:36.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cef2e0700 1 -- 172.21.15.50:0/3249295536 shutdown_connections 2023-11-28T11:53:36.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cef2e0700 1 --2- 172.21.15.50:0/3249295536 >> v2:172.21.15.192:3300/0 conn(0x7f6ce806a800 0x7f6ce8162f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cef2e0700 1 --2- 172.21.15.50:0/3249295536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce80cb340 0x7f6ce806d6b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cef2e0700 1 -- 172.21.15.50:0/3249295536 >> 172.21.15.50:0/3249295536 conn(0x7f6ce80b1f90 msgr2=0x7f6ce80ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:36.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cef2e0700 1 -- 172.21.15.50:0/3249295536 shutdown_connections 2023-11-28T11:53:36.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.841+0000 7f6cef2e0700 1 -- 172.21.15.50:0/3249295536 wait complete. 2023-11-28T11:53:36.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cef2e0700 1 Processor -- start 2023-11-28T11:53:36.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cef2e0700 1 -- start start 2023-11-28T11:53:36.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cef2e0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ce806a800 0x7f6ce809b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cef2e0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce806f7c0 0x7f6ce81e2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cef2e0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ce81e0700 0x7f6ce81e32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cef2e0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce81f5f50 con 0x7f6ce806f7c0 2023-11-28T11:53:36.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cef2e0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce809bf00 con 0x7f6ce81e0700 2023-11-28T11:53:36.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cef2e0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce81df940 con 0x7f6ce806a800 2023-11-28T11:53:36.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cedadd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce806f7c0 0x7f6ce81e2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cedadd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce806f7c0 0x7f6ce81e2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54716/0 (socket says 172.21.15.50:54716) 2023-11-28T11:53:36.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cedadd700 1 -- 172.21.15.50:0/256296209 learned_addr learned my addr 172.21.15.50:0/256296209 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:36.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cee2de700 1 --2- 172.21.15.50:0/256296209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ce806a800 0x7f6ce809b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6ceeadf700 1 --2- 172.21.15.50:0/256296209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ce81e0700 0x7f6ce81e32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cedadd700 1 -- 172.21.15.50:0/256296209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ce806a800 msgr2=0x7f6ce809b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cedadd700 1 --2- 172.21.15.50:0/256296209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ce806a800 0x7f6ce809b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cedadd700 1 -- 172.21.15.50:0/256296209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ce81e0700 msgr2=0x7f6ce81e32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:36.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cedadd700 1 --2- 172.21.15.50:0/256296209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ce81e0700 0x7f6ce81e32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:36.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cedadd700 1 -- 172.21.15.50:0/256296209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce40094b0 con 0x7f6ce806f7c0 2023-11-28T11:53:36.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cedadd700 1 --2- 172.21.15.50:0/256296209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce806f7c0 0x7f6ce81e2d90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800c580 tx=0x7f6cd800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:36.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cdeffd700 1 -- 172.21.15.50:0/256296209 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8004ca0 con 0x7f6ce806f7c0 2023-11-28T11:53:36.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cef2e0700 1 -- 172.21.15.50:0/256296209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce806ceb0 con 0x7f6ce806f7c0 2023-11-28T11:53:36.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cdeffd700 1 -- 172.21.15.50:0/256296209 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd8004e20 con 0x7f6ce806f7c0 2023-11-28T11:53:36.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cdeffd700 1 -- 172.21.15.50:0/256296209 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8007310 con 0x7f6ce806f7c0 2023-11-28T11:53:36.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.845+0000 7f6cef2e0700 1 -- 172.21.15.50:0/256296209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce806cbd0 con 0x7f6ce806f7c0 2023-11-28T11:53:36.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.849+0000 7f6cef2e0700 1 -- 172.21.15.50:0/256296209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce806d190 con 0x7f6ce806f7c0 2023-11-28T11:53:36.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.849+0000 7f6cdeffd700 1 -- 172.21.15.50:0/256296209 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7f6cd801a020 con 0x7f6ce806f7c0 2023-11-28T11:53:36.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.849+0000 7f6cdeffd700 1 --2- 172.21.15.50:0/256296209 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6ccc064e90 0x7f6ccc067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:36.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.849+0000 7f6cdeffd700 1 -- 172.21.15.50:0/256296209 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6cd8081830 con 0x7f6ce806f7c0 2023-11-28T11:53:36.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.857+0000 7f6cdeffd700 1 -- 172.21.15.50:0/256296209 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6cd804fc90 con 0x7f6ce806f7c0 2023-11-28T11:53:36.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.865+0000 7f6cee2de700 1 --2- 172.21.15.50:0/256296209 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6ccc064e90 0x7f6ccc067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:36.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:36.865+0000 7f6cee2de700 1 --2- 172.21.15.50:0/256296209 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6ccc064e90 0x7f6ccc067340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6ce806e9e0 tx=0x7f6ce4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:37.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.029+0000 7f6cef2e0700 1 -- 172.21.15.50:0/256296209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ce8072500 con 0x7f6ce806f7c0 2023-11-28T11:53:37.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.029+0000 7f6cdeffd700 1 -- 172.21.15.50:0/256296209 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14124 (secure 0 0 0) 0x7f6cd80532b0 con 0x7f6ce806f7c0 2023-11-28T11:53:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:53:37.035 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":16,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:36.365428+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:53:37.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.033+0000 7f6cef2e0700 1 -- 172.21.15.50:0/256296209 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6ccc064e90 msgr2=0x7f6ccc067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.033+0000 7f6cef2e0700 1 --2- 172.21.15.50:0/256296209 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6ccc064e90 0x7f6ccc067340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6ce806e9e0 tx=0x7f6ce4008030 comp rx=0 tx=0).stop 2023-11-28T11:53:37.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.033+0000 7f6cef2e0700 1 -- 172.21.15.50:0/256296209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce806f7c0 msgr2=0x7f6ce81e2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.033+0000 7f6cef2e0700 1 --2- 172.21.15.50:0/256296209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce806f7c0 0x7f6ce81e2d90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800c580 tx=0x7f6cd800c940 comp rx=0 tx=0).stop 2023-11-28T11:53:37.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.033+0000 7f6cef2e0700 1 -- 172.21.15.50:0/256296209 shutdown_connections 2023-11-28T11:53:37.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.033+0000 7f6cef2e0700 1 --2- 172.21.15.50:0/256296209 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6ccc064e90 0x7f6ccc067340 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.033+0000 7f6cef2e0700 1 --2- 172.21.15.50:0/256296209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ce81e0700 0x7f6ce81e32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.033+0000 7f6cef2e0700 1 --2- 172.21.15.50:0/256296209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ce806f7c0 0x7f6ce81e2d90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.033+0000 7f6cef2e0700 1 --2- 172.21.15.50:0/256296209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ce806a800 0x7f6ce809b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.033+0000 7f6cef2e0700 1 -- 172.21.15.50:0/256296209 >> 172.21.15.50:0/256296209 conn(0x7f6ce80b1f90 msgr2=0x7f6ce80cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:37.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.033+0000 7f6cef2e0700 1 -- 172.21.15.50:0/256296209 shutdown_connections 2023-11-28T11:53:37.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.033+0000 7f6cef2e0700 1 -- 172.21.15.50:0/256296209 wait complete. 2023-11-28T11:53:37.049 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:53:37.049 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:53:37.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.161+0000 7ff7b5368700 1 Processor -- start 2023-11-28T11:53:37.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.161+0000 7ff7b5368700 1 -- start start 2023-11-28T11:53:37.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.161+0000 7ff7b5368700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7b00cfdd0 0x7ff7b00b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.161+0000 7ff7b5368700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff7b00b2570 0x7ff7b00cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.161+0000 7ff7b5368700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b00cac70 con 0x7ff7b00cc590 2023-11-28T11:53:37.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.161+0000 7ff7b5368700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b006c8e0 con 0x7ff7b00b2570 2023-11-28T11:53:37.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.161+0000 7ff7b5368700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00b29f0 con 0x7ff7b00cfdd0 2023-11-28T11:53:37.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.161+0000 7ff7b4b67700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff7b00b2570 0x7ff7b00cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.161+0000 7ff7b4b67700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff7b00b2570 0x7ff7b00cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54726/0 (socket says 172.21.15.50:54726) 2023-11-28T11:53:37.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.161+0000 7ff7b4b67700 1 -- 172.21.15.50:0/145718670 learned_addr learned my addr 172.21.15.50:0/145718670 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:37.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.161+0000 7ff7a77fe700 1 --2- 172.21.15.50:0/145718670 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7b00cfdd0 0x7ff7b00b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.161+0000 7ff7b4b67700 1 -- 172.21.15.50:0/145718670 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7b00cfdd0 msgr2=0x7ff7b00b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:37.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.161+0000 7ff7b4b67700 1 --2- 172.21.15.50:0/145718670 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7b00cfdd0 0x7ff7b00b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.161+0000 7ff7b4b67700 1 -- 172.21.15.50:0/145718670 >> v1:172.21.15.192:6789/0 conn(0x7ff7b00cc590 legacy=0x7ff7b00b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.161+0000 7ff7b4b67700 1 -- 172.21.15.50:0/145718670 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b00d0340 con 0x7ff7b00b2570 2023-11-28T11:53:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.161+0000 7ff7af7fe700 1 -- 172.21.15.50:0/145718670 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723025938 0 0) 0x7ff7b00cac70 con 0x7ff7b00cc590 2023-11-28T11:53:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.161+0000 7ff7b4b67700 1 --2- 172.21.15.50:0/145718670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b00b2570 0x7ff7b00cea40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009e50 tx=0x7ff7a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e41839a8548dd51 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.165+0000 7ff7af7fe700 1 -- 172.21.15.50:0/145718670 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a800e070 con 0x7ff7b00b2570 2023-11-28T11:53:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.165+0000 7ff7af7fe700 1 -- 172.21.15.50:0/145718670 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a800b910 con 0x7ff7b00b2570 2023-11-28T11:53:37.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.165+0000 7ff7af7fe700 1 -- 172.21.15.50:0/145718670 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a800bcc0 con 0x7ff7b00b2570 2023-11-28T11:53:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.165+0000 7ff7b5368700 1 -- 172.21.15.50:0/145718670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b00b2570 msgr2=0x7ff7b00cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.165+0000 7ff7b5368700 1 --2- 172.21.15.50:0/145718670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b00b2570 0x7ff7b00cea40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009e50 tx=0x7ff7a800b330 comp rx=0 tx=0).stop 2023-11-28T11:53:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.165+0000 7ff7b5368700 1 -- 172.21.15.50:0/145718670 shutdown_connections 2023-11-28T11:53:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.165+0000 7ff7b5368700 1 --2- 172.21.15.50:0/145718670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b00b2570 0x7ff7b00cea40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.165+0000 7ff7b5368700 1 --2- 172.21.15.50:0/145718670 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7b00cfdd0 0x7ff7b00b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.165+0000 7ff7b5368700 1 -- 172.21.15.50:0/145718670 >> 172.21.15.50:0/145718670 conn(0x7ff7b00cd0a0 msgr2=0x7ff7b00cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.165+0000 7ff7b5368700 1 -- 172.21.15.50:0/145718670 shutdown_connections 2023-11-28T11:53:37.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.165+0000 7ff7b5368700 1 -- 172.21.15.50:0/145718670 wait complete. 2023-11-28T11:53:37.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b5368700 1 Processor -- start 2023-11-28T11:53:37.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b5368700 1 -- start start 2023-11-28T11:53:37.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b5368700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7b00b2570 0x7ff7b00b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b5368700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7b00cfdd0 0x7ff7b01f1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b5368700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b014f250 0x7ff7b01f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b5368700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b014c910 con 0x7ff7b014f250 2023-11-28T11:53:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b5368700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b014cbf0 con 0x7ff7b00b2570 2023-11-28T11:53:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b5368700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b014ced0 con 0x7ff7b00cfdd0 2023-11-28T11:53:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b4b67700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b014f250 0x7ff7b01f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b4b67700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b014f250 0x7ff7b01f4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54742/0 (socket says 172.21.15.50:54742) 2023-11-28T11:53:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7a77fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7b00cfdd0 0x7ff7b01f1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b4b67700 1 -- 172.21.15.50:0/1802976605 learned_addr learned my addr 172.21.15.50:0/1802976605 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:37.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7affff700 1 --2- 172.21.15.50:0/1802976605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7b00b2570 0x7ff7b00b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b4b67700 1 -- 172.21.15.50:0/1802976605 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7b00cfdd0 msgr2=0x7ff7b01f1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b4b67700 1 --2- 172.21.15.50:0/1802976605 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7b00cfdd0 0x7ff7b01f1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b4b67700 1 -- 172.21.15.50:0/1802976605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7b00b2570 msgr2=0x7ff7b00b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b4b67700 1 --2- 172.21.15.50:0/1802976605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7b00b2570 0x7ff7b00b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b4b67700 1 -- 172.21.15.50:0/1802976605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8009b30 con 0x7ff7b014f250 2023-11-28T11:53:37.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b4b67700 1 --2- 172.21.15.50:0/1802976605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b014f250 0x7ff7b01f4e50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800b680 tx=0x7ff7a8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:37.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7ad7fa700 1 -- 172.21.15.50:0/1802976605 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80048b0 con 0x7ff7b014f250 2023-11-28T11:53:37.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7ad7fa700 1 -- 172.21.15.50:0/1802976605 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a80099b0 con 0x7ff7b014f250 2023-11-28T11:53:37.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7b5368700 1 -- 172.21.15.50:0/1802976605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b006d4b0 con 0x7ff7b014f250 2023-11-28T11:53:37.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.169+0000 7ff7ad7fa700 1 -- 172.21.15.50:0/1802976605 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a801b670 con 0x7ff7b014f250 2023-11-28T11:53:37.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.173+0000 7ff7b5368700 1 -- 172.21.15.50:0/1802976605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b006d1d0 con 0x7ff7b014f250 2023-11-28T11:53:37.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.173+0000 7ff7b5368700 1 -- 172.21.15.50:0/1802976605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b00ce520 con 0x7ff7b014f250 2023-11-28T11:53:37.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.173+0000 7ff7ad7fa700 1 -- 172.21.15.50:0/1802976605 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7ff7a8021030 con 0x7ff7b014f250 2023-11-28T11:53:37.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.173+0000 7ff7ad7fa700 1 --2- 172.21.15.50:0/1802976605 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff790064e90 0x7ff790067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.173+0000 7ff7ad7fa700 1 -- 172.21.15.50:0/1802976605 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff7a8082ea0 con 0x7ff7b014f250 2023-11-28T11:53:37.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.173+0000 7ff7affff700 1 --2- 172.21.15.50:0/1802976605 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff790064e90 0x7ff790067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.177+0000 7ff7affff700 1 --2- 172.21.15.50:0/1802976605 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff790064e90 0x7ff790067340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0000f60 tx=0x7ff7a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:37.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.181+0000 7ff7ad7fa700 1 -- 172.21.15.50:0/1802976605 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff7a80513e0 con 0x7ff7b014f250 2023-11-28T11:53:37.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.353+0000 7ff7b5368700 1 -- 172.21.15.50:0/1802976605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff7b0072c20 con 0x7ff7b014f250 2023-11-28T11:53:37.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.353+0000 7ff7ad7fa700 1 -- 172.21.15.50:0/1802976605 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff7a8054a00 con 0x7ff7b014f250 2023-11-28T11:53:37.356 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:53:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.353+0000 7ff7b5368700 1 -- 172.21.15.50:0/1802976605 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff790064e90 msgr2=0x7ff790067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.353+0000 7ff7b5368700 1 --2- 172.21.15.50:0/1802976605 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff790064e90 0x7ff790067340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0000f60 tx=0x7ff7a0009040 comp rx=0 tx=0).stop 2023-11-28T11:53:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.353+0000 7ff7b5368700 1 -- 172.21.15.50:0/1802976605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b014f250 msgr2=0x7ff7b01f4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.353+0000 7ff7b5368700 1 --2- 172.21.15.50:0/1802976605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b014f250 0x7ff7b01f4e50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800b680 tx=0x7ff7a8004af0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.353+0000 7ff7b5368700 1 -- 172.21.15.50:0/1802976605 shutdown_connections 2023-11-28T11:53:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.353+0000 7ff7b5368700 1 --2- 172.21.15.50:0/1802976605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7b014f250 0x7ff7b01f4e50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.353+0000 7ff7b5368700 1 --2- 172.21.15.50:0/1802976605 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7b00cfdd0 0x7ff7b01f1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.353+0000 7ff7b5368700 1 --2- 172.21.15.50:0/1802976605 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff790064e90 0x7ff790067340 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.353+0000 7ff7b5368700 1 --2- 172.21.15.50:0/1802976605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7b00b2570 0x7ff7b00b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.353+0000 7ff7b5368700 1 -- 172.21.15.50:0/1802976605 >> 172.21.15.50:0/1802976605 conn(0x7ff7b00cd0a0 msgr2=0x7ff7b006f150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.353+0000 7ff7b5368700 1 -- 172.21.15.50:0/1802976605 shutdown_connections 2023-11-28T11:53:37.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.353+0000 7ff7b5368700 1 -- 172.21.15.50:0/1802976605 wait complete. 2023-11-28T11:53:37.371 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:53:37.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35dbfff700 1 Processor -- start 2023-11-28T11:53:37.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35dbfff700 1 -- start start 2023-11-28T11:53:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35dbfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f35dc0ae270 0x7f35dc0cae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35dbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35dc0c9430 0x7f35dc0cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35dbfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35dc06c560 con 0x7f35dc0cbc00 2023-11-28T11:53:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35dbfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35dc071a30 con 0x7f35dc0c9430 2023-11-28T11:53:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35dbfff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35dc06c840 con 0x7f35dc0ae270 2023-11-28T11:53:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35da7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35dc0c9430 0x7f35dc0cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35da7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35dc0c9430 0x7f35dc0cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54746/0 (socket says 172.21.15.50:54746) 2023-11-28T11:53:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35da7fc700 1 -- 172.21.15.50:0/517043958 learned_addr learned my addr 172.21.15.50:0/517043958 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:37.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35db7fe700 1 --1- 172.21.15.50:0/517043958 >> v1:172.21.15.50:6789/0 conn(0x7f35dc0cbc00 0x7f35dc0cc9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45946/0 (socket says 172.21.15.50:45946) 2023-11-28T11:53:37.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35daffd700 1 --2- 172.21.15.50:0/517043958 >> v2:172.21.15.192:3300/0 conn(0x7f35dc0ae270 0x7f35dc0cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35d9ffb700 1 -- 172.21.15.50:0/517043958 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143206332 0 0) 0x7f35dc06c560 con 0x7f35dc0cbc00 2023-11-28T11:53:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35d9ffb700 1 -- 172.21.15.50:0/517043958 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35c40035d0 con 0x7f35dc0cbc00 2023-11-28T11:53:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35da7fc700 1 -- 172.21.15.50:0/517043958 >> v2:172.21.15.192:3300/0 conn(0x7f35dc0ae270 msgr2=0x7f35dc0cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35d9ffb700 1 -- 172.21.15.50:0/517043958 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4225149976 0 0) 0x7f35c40035d0 con 0x7f35dc0cbc00 2023-11-28T11:53:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35da7fc700 1 --2- 172.21.15.50:0/517043958 >> v2:172.21.15.192:3300/0 conn(0x7f35dc0ae270 0x7f35dc0cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35da7fc700 1 -- 172.21.15.50:0/517043958 >> v1:172.21.15.50:6789/0 conn(0x7f35dc0cbc00 legacy=0x7f35dc0cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.481+0000 7f35da7fc700 1 -- 172.21.15.50:0/517043958 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc06cb20 con 0x7f35dc0c9430 2023-11-28T11:53:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.485+0000 7f35da7fc700 1 --2- 172.21.15.50:0/517043958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35dc0c9430 0x7f35dc0cb6c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0cfee0 tx=0x7f35d0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f607befb1516e47 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.485+0000 7f35d9ffb700 1 -- 172.21.15.50:0/517043958 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc001670 con 0x7f35dc0c9430 2023-11-28T11:53:37.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.485+0000 7f35d9ffb700 1 -- 172.21.15.50:0/517043958 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d0004030 con 0x7f35dc0c9430 2023-11-28T11:53:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.485+0000 7f35d9ffb700 1 -- 172.21.15.50:0/517043958 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d00043a0 con 0x7f35dc0c9430 2023-11-28T11:53:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.485+0000 7f35dbfff700 1 -- 172.21.15.50:0/517043958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35dc0c9430 msgr2=0x7f35dc0cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.485+0000 7f35dbfff700 1 --2- 172.21.15.50:0/517043958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35dc0c9430 0x7f35dc0cb6c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0cfee0 tx=0x7f35d0009bf0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.485+0000 7f35dbfff700 1 -- 172.21.15.50:0/517043958 shutdown_connections 2023-11-28T11:53:37.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.485+0000 7f35dbfff700 1 --2- 172.21.15.50:0/517043958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35dc0c9430 0x7f35dc0cb6c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.485+0000 7f35dbfff700 1 --2- 172.21.15.50:0/517043958 >> v2:172.21.15.192:3300/0 conn(0x7f35dc0ae270 0x7f35dc0cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.485+0000 7f35dbfff700 1 -- 172.21.15.50:0/517043958 >> 172.21.15.50:0/517043958 conn(0x7f35dc0b0990 msgr2=0x7f35dc0b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:37.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.485+0000 7f35dbfff700 1 -- 172.21.15.50:0/517043958 shutdown_connections 2023-11-28T11:53:37.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.485+0000 7f35dbfff700 1 -- 172.21.15.50:0/517043958 wait complete. 2023-11-28T11:53:37.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.485+0000 7f35dbfff700 1 Processor -- start 2023-11-28T11:53:37.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.485+0000 7f35dbfff700 1 -- start start 2023-11-28T11:53:37.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35dbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35dc0ae270 0x7f35dc156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35dbfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35dc0c9430 0x7f35dc15af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35dbfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35dc0cbc00 0x7f35dc0c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35dbfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc0c7240 con 0x7f35dc0ae270 2023-11-28T11:53:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35dbfff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc15b470 con 0x7f35dc0cbc00 2023-11-28T11:53:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35dbfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc0c8c50 con 0x7f35dc0c9430 2023-11-28T11:53:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35daffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35dc0ae270 0x7f35dc156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35daffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35dc0ae270 0x7f35dc156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54758/0 (socket says 172.21.15.50:54758) 2023-11-28T11:53:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35daffd700 1 -- 172.21.15.50:0/315094567 learned_addr learned my addr 172.21.15.50:0/315094567 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35da7fc700 1 --2- 172.21.15.50:0/315094567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35dc0c9430 0x7f35dc15af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35db7fe700 1 --2- 172.21.15.50:0/315094567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35dc0cbc00 0x7f35dc0c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35daffd700 1 -- 172.21.15.50:0/315094567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35dc0c9430 msgr2=0x7f35dc15af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35daffd700 1 --2- 172.21.15.50:0/315094567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35dc0c9430 0x7f35dc15af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35daffd700 1 -- 172.21.15.50:0/315094567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35dc0cbc00 msgr2=0x7f35dc0c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35daffd700 1 --2- 172.21.15.50:0/315094567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35dc0cbc00 0x7f35dc0c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35daffd700 1 -- 172.21.15.50:0/315094567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d0009570 con 0x7f35dc0ae270 2023-11-28T11:53:37.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35daffd700 1 --2- 172.21.15.50:0/315094567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35dc0ae270 0x7f35dc156150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f35d400efc0 tx=0x7f35d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:37.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35c37fe700 1 -- 172.21.15.50:0/315094567 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4009b80 con 0x7f35dc0ae270 2023-11-28T11:53:37.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35c37fe700 1 -- 172.21.15.50:0/315094567 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d400f040 con 0x7f35dc0ae270 2023-11-28T11:53:37.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35c37fe700 1 -- 172.21.15.50:0/315094567 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4014480 con 0x7f35dc0ae270 2023-11-28T11:53:37.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35dbfff700 1 -- 172.21.15.50:0/315094567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35dc0cb3b0 con 0x7f35dc0ae270 2023-11-28T11:53:37.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35dbfff700 1 -- 172.21.15.50:0/315094567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35dc06ce00 con 0x7f35dc0ae270 2023-11-28T11:53:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35dbfff700 1 -- 172.21.15.50:0/315094567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35dc0cc000 con 0x7f35dc0ae270 2023-11-28T11:53:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.489+0000 7f35c37fe700 1 -- 172.21.15.50:0/315094567 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7f35d40145e0 con 0x7f35dc0ae270 2023-11-28T11:53:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.493+0000 7f35c37fe700 1 --2- 172.21.15.50:0/315094567 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f35c8064e90 0x7f35c8067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.493+0000 7f35c37fe700 1 -- 172.21.15.50:0/315094567 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f35d4082610 con 0x7f35dc0ae270 2023-11-28T11:53:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.493+0000 7f35da7fc700 1 --2- 172.21.15.50:0/315094567 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f35c8064e90 0x7f35c8067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.493+0000 7f35da7fc700 1 --2- 172.21.15.50:0/315094567 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f35c8064e90 0x7f35c8067340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f35d0000c00 tx=0x7f35d0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:37.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.501+0000 7f35c37fe700 1 -- 172.21.15.50:0/315094567 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f35d4050b80 con 0x7f35dc0ae270 2023-11-28T11:53:37.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.665+0000 7f35dbfff700 1 -- 172.21.15.50:0/315094567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35dc072500 con 0x7f35dc0ae270 2023-11-28T11:53:37.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.761+0000 7f35c37fe700 1 -- 172.21.15.50:0/315094567 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35d40541a0 con 0x7f35dc0ae270 2023-11-28T11:53:37.764 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:53:37.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.761+0000 7f35dbfff700 1 -- 172.21.15.50:0/315094567 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f35c8064e90 msgr2=0x7f35c8067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.761+0000 7f35dbfff700 1 --2- 172.21.15.50:0/315094567 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f35c8064e90 0x7f35c8067340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f35d0000c00 tx=0x7f35d0008030 comp rx=0 tx=0).stop 2023-11-28T11:53:37.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.761+0000 7f35dbfff700 1 -- 172.21.15.50:0/315094567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35dc0ae270 msgr2=0x7f35dc156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.761+0000 7f35dbfff700 1 --2- 172.21.15.50:0/315094567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35dc0ae270 0x7f35dc156150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f35d400efc0 tx=0x7f35d400c3a0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.761+0000 7f35dbfff700 1 -- 172.21.15.50:0/315094567 shutdown_connections 2023-11-28T11:53:37.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.761+0000 7f35dbfff700 1 --2- 172.21.15.50:0/315094567 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f35c8064e90 0x7f35c8067340 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.761+0000 7f35dbfff700 1 --2- 172.21.15.50:0/315094567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35dc0cbc00 0x7f35dc0c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.761+0000 7f35dbfff700 1 --2- 172.21.15.50:0/315094567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35dc0c9430 0x7f35dc15af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.761+0000 7f35dbfff700 1 --2- 172.21.15.50:0/315094567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35dc0ae270 0x7f35dc156150 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.761+0000 7f35dbfff700 1 -- 172.21.15.50:0/315094567 >> 172.21.15.50:0/315094567 conn(0x7f35dc0b0990 msgr2=0x7f35dc0b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:37.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.761+0000 7f35dbfff700 1 -- 172.21.15.50:0/315094567 shutdown_connections 2023-11-28T11:53:37.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.765+0000 7f35dbfff700 1 -- 172.21.15.50:0/315094567 wait complete. 2023-11-28T11:53:37.784 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T11:53:37.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.889+0000 7f7057fff700 1 Processor -- start 2023-11-28T11:53:37.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.889+0000 7f7057fff700 1 -- start start 2023-11-28T11:53:37.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f7057fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f70580ca310 0x7f705806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f7057fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f705806cd80 0x7f705815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f7057fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70580cca10 con 0x7f7058069eb0 2023-11-28T11:53:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f7057fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70580cdeb0 con 0x7f70580ca310 2023-11-28T11:53:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f7057fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705806a670 con 0x7f705806cd80 2023-11-28T11:53:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f704e7fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7058069eb0 0x7f705806c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45948/0 (socket says 172.21.15.50:45948) 2023-11-28T11:53:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f704e7fc700 1 -- 172.21.15.50:0/2690462997 learned_addr learned my addr 172.21.15.50:0/2690462997 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f7056ffd700 1 --2- 172.21.15.50:0/2690462997 >> v2:172.21.15.192:3300/0 conn(0x7f70580ca310 0x7f705806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 -- 172.21.15.50:0/2690462997 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880091109 0 0) 0x7f70580cca10 con 0x7f7058069eb0 2023-11-28T11:53:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 -- 172.21.15.50:0/2690462997 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70440035d0 con 0x7f7058069eb0 2023-11-28T11:53:37.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70577fe700 1 --2- 172.21.15.50:0/2690462997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f705806cd80 0x7f705815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 -- 172.21.15.50:0/2690462997 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 486040218 0 0) 0x7f70440035d0 con 0x7f7058069eb0 2023-11-28T11:53:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 -- 172.21.15.50:0/2690462997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f705806cd80 msgr2=0x7f705815b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 --2- 172.21.15.50:0/2690462997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f705806cd80 0x7f705815b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 -- 172.21.15.50:0/2690462997 >> v2:172.21.15.192:3300/0 conn(0x7f70580ca310 msgr2=0x7f705806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 --2- 172.21.15.50:0/2690462997 >> v2:172.21.15.192:3300/0 conn(0x7f70580ca310 0x7f705806c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 -- 172.21.15.50:0/2690462997 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705806a950 con 0x7f7058069eb0 2023-11-28T11:53:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 -- 172.21.15.50:0/2690462997 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f7048001670 con 0x7f7058069eb0 2023-11-28T11:53:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 -- 172.21.15.50:0/2690462997 >> v1:172.21.15.50:6789/0 conn(0x7f7058069eb0 legacy=0x7f705806c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 --2- 172.21.15.50:0/2690462997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7044003a20 0x7f7044003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 --2- 172.21.15.50:0/2690462997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7044004870 0x7f7044004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 --2- 172.21.15.50:0/2690462997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f705806cd80 0x7f7044005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 -- 172.21.15.50:0/2690462997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70580cdeb0 con 0x7f7044003a20 2023-11-28T11:53:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 -- 172.21.15.50:0/2690462997 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705806a670 con 0x7f7044004870 2023-11-28T11:53:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 -- 172.21.15.50:0/2690462997 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704400ba80 con 0x7f705806cd80 2023-11-28T11:53:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f7056ffd700 1 --2- 172.21.15.50:0/2690462997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7044003a20 0x7f7044003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70577fe700 1 --2- 172.21.15.50:0/2690462997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f705806cd80 0x7f7044005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f704e7fc700 1 --2- 172.21.15.50:0/2690462997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7044004870 0x7f7044004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f7056ffd700 1 -- 172.21.15.50:0/2690462997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f705806cd80 msgr2=0x7f7044005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f7056ffd700 1 --2- 172.21.15.50:0/2690462997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f705806cd80 0x7f7044005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f7056ffd700 1 -- 172.21.15.50:0/2690462997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7044004870 msgr2=0x7f7044004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f7056ffd700 1 --2- 172.21.15.50:0/2690462997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7044004870 0x7f7044004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f7056ffd700 1 -- 172.21.15.50:0/2690462997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70440035d0 con 0x7f7044003a20 2023-11-28T11:53:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f7056ffd700 1 --2- 172.21.15.50:0/2690462997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7044003a20 0x7f7044003e30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7040009b70 tx=0x7f70440058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5c7a750f6648b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 -- 172.21.15.50:0/2690462997 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704000e6c0 con 0x7f7044003a20 2023-11-28T11:53:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 -- 172.21.15.50:0/2690462997 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704000e820 con 0x7f7044003a20 2023-11-28T11:53:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.893+0000 7f70567fc700 1 -- 172.21.15.50:0/2690462997 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704000eb90 con 0x7f7044003a20 2023-11-28T11:53:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f7057fff700 1 -- 172.21.15.50:0/2690462997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7044003a20 msgr2=0x7f7044003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f7057fff700 1 --2- 172.21.15.50:0/2690462997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7044003a20 0x7f7044003e30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7040009b70 tx=0x7f70440058a0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f70577fe700 1 -- 172.21.15.50:0/2690462997 reap_dead start 2023-11-28T11:53:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f7057fff700 1 -- 172.21.15.50:0/2690462997 shutdown_connections 2023-11-28T11:53:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f7057fff700 1 -- 172.21.15.50:0/2690462997 >> 172.21.15.50:0/2690462997 conn(0x7f70580ce3e0 msgr2=0x7f70580ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:37.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f7057fff700 1 -- 172.21.15.50:0/2690462997 shutdown_connections 2023-11-28T11:53:37.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f7057fff700 1 -- 172.21.15.50:0/2690462997 wait complete. 2023-11-28T11:53:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f7057fff700 1 Processor -- start 2023-11-28T11:53:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f7057fff700 1 -- start start 2023-11-28T11:53:37.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f7057fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7044003a20 0x7f70580cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f7057fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7058155b00 0x7f705809b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f7057fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70580b33e0 0x7f70580b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f7057fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7058156c70 con 0x7f70580b33e0 2023-11-28T11:53:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f7057fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70580b3d90 con 0x7f7058155b00 2023-11-28T11:53:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f7057fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7058155ff0 con 0x7f7044003a20 2023-11-28T11:53:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f70577fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70580b33e0 0x7f70580b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f70577fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70580b33e0 0x7f70580b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54780/0 (socket says 172.21.15.50:54780) 2023-11-28T11:53:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f7056ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7044003a20 0x7f70580cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f70577fe700 1 -- 172.21.15.50:0/886400633 learned_addr learned my addr 172.21.15.50:0/886400633 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f704e7fc700 1 --2- 172.21.15.50:0/886400633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7058155b00 0x7f705809b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f70577fe700 1 -- 172.21.15.50:0/886400633 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7044003a20 msgr2=0x7f70580cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f70577fe700 1 --2- 172.21.15.50:0/886400633 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7044003a20 0x7f70580cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f70577fe700 1 -- 172.21.15.50:0/886400633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7058155b00 msgr2=0x7f705809b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f70577fe700 1 --2- 172.21.15.50:0/886400633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7058155b00 0x7f705809b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.897+0000 7f70577fe700 1 -- 172.21.15.50:0/886400633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70580c8a30 con 0x7f70580b33e0 2023-11-28T11:53:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.901+0000 7f70577fe700 1 --2- 172.21.15.50:0/886400633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70580b33e0 0x7f70580b3850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f70580cf460 tx=0x7f70500048c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.901+0000 7f704ffff700 1 -- 172.21.15.50:0/886400633 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70500078d0 con 0x7f70580b33e0 2023-11-28T11:53:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.901+0000 7f704ffff700 1 -- 172.21.15.50:0/886400633 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7050007a30 con 0x7f70580b33e0 2023-11-28T11:53:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.901+0000 7f7057fff700 1 -- 172.21.15.50:0/886400633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f705806ac30 con 0x7f70580b33e0 2023-11-28T11:53:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.901+0000 7f704ffff700 1 -- 172.21.15.50:0/886400633 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050007de0 con 0x7f70580b33e0 2023-11-28T11:53:37.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.901+0000 7f7057fff700 1 -- 172.21.15.50:0/886400633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705806af10 con 0x7f70580b33e0 2023-11-28T11:53:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.901+0000 7f7057fff700 1 -- 172.21.15.50:0/886400633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7058156db0 con 0x7f70580b33e0 2023-11-28T11:53:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.901+0000 7f704ffff700 1 -- 172.21.15.50:0/886400633 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7050015420 con 0x7f70580b33e0 2023-11-28T11:53:37.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.901+0000 7f704ffff700 1 --2- 172.21.15.50:0/886400633 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7038064f60 0x7f7038067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.905+0000 7f704ffff700 1 -- 172.21.15.50:0/886400633 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7050081ec0 con 0x7f70580b33e0 2023-11-28T11:53:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.905+0000 7f7056ffd700 1 --2- 172.21.15.50:0/886400633 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7038064f60 0x7f7038067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.905+0000 7f7056ffd700 1 --2- 172.21.15.50:0/886400633 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7038064f60 0x7f7038067410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f70400090b0 tx=0x7f704001e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:37.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:37.913+0000 7f704ffff700 1 -- 172.21.15.50:0/886400633 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7058156db0 con 0x7f70580b33e0 2023-11-28T11:53:38.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.081+0000 7f7057fff700 1 -- 172.21.15.50:0/886400633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7058072500 con 0x7f70580b33e0 2023-11-28T11:53:38.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.081+0000 7f704ffff700 1 -- 172.21.15.50:0/886400633 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f70500503f0 con 0x7f70580b33e0 2023-11-28T11:53:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:53:38.087 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-11-28T11:53:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:53:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-11-28T11:53:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2023-11-28T11:53:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:53:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:53:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2023-11-28T11:53:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-11-28T11:53:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:53:38.088 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-11-28T11:53:38.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.085+0000 7f7057fff700 1 -- 172.21.15.50:0/886400633 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7038064f60 msgr2=0x7f7038067410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:38.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.085+0000 7f7057fff700 1 --2- 172.21.15.50:0/886400633 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7038064f60 0x7f7038067410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f70400090b0 tx=0x7f704001e040 comp rx=0 tx=0).stop 2023-11-28T11:53:38.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.085+0000 7f7057fff700 1 -- 172.21.15.50:0/886400633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70580b33e0 msgr2=0x7f70580b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:38.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.085+0000 7f7057fff700 1 --2- 172.21.15.50:0/886400633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70580b33e0 0x7f70580b3850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f70580cf460 tx=0x7f70500048c0 comp rx=0 tx=0).stop 2023-11-28T11:53:38.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.085+0000 7f7057fff700 1 -- 172.21.15.50:0/886400633 shutdown_connections 2023-11-28T11:53:38.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.085+0000 7f7057fff700 1 --2- 172.21.15.50:0/886400633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70580b33e0 0x7f70580b3850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:38.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.085+0000 7f7057fff700 1 --2- 172.21.15.50:0/886400633 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7038064f60 0x7f7038067410 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:38.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.085+0000 7f7057fff700 1 --2- 172.21.15.50:0/886400633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7058155b00 0x7f705809b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:38.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.085+0000 7f7057fff700 1 --2- 172.21.15.50:0/886400633 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7044003a20 0x7f70580cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:38.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.085+0000 7f7057fff700 1 -- 172.21.15.50:0/886400633 >> 172.21.15.50:0/886400633 conn(0x7f70580ce3e0 msgr2=0x7f7058071230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:38.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.085+0000 7f7057fff700 1 -- 172.21.15.50:0/886400633 shutdown_connections 2023-11-28T11:53:38.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.085+0000 7f7057fff700 1 -- 172.21.15.50:0/886400633 wait complete. 2023-11-28T11:53:38.108 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T11:53:38.108 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T11:53:38.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.229+0000 7f58d42b0700 1 Processor -- start 2023-11-28T11:53:38.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.229+0000 7f58d42b0700 1 -- start start 2023-11-28T11:53:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d42b0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f58cc160ac0 0x7f58cc0b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d42b0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58cc0d0740 con 0x7f58cc0b45f0 2023-11-28T11:53:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d42b0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58cc0b4f00 con 0x7f58cc0cd1c0 2023-11-28T11:53:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d42b0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58cc0d0990 con 0x7f58cc160ac0 2023-11-28T11:53:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d204c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f58cc0b45f0 0x7f58cc0d1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45962/0 (socket says 172.21.15.50:45962) 2023-11-28T11:53:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d204c700 1 -- 172.21.15.50:0/1550318137 learned_addr learned my addr 172.21.15.50:0/1550318137 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d184b700 1 --2- 172.21.15.50:0/1550318137 >> v2:172.21.15.50:3300/0 conn(0x7f58cc160ac0 0x7f58cc0b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:38.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d104a700 1 -- 172.21.15.50:0/1550318137 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588653496 0 0) 0x7f58cc0d0740 con 0x7f58cc0b45f0 2023-11-28T11:53:38.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d104a700 1 -- 172.21.15.50:0/1550318137 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58b80035d0 con 0x7f58cc0b45f0 2023-11-28T11:53:38.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d184b700 1 -- 172.21.15.50:0/1550318137 >> v1:172.21.15.192:6789/0 conn(0x7f58cc0cd1c0 legacy=0x7f58cc0b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:38.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d184b700 1 -- 172.21.15.50:0/1550318137 >> v1:172.21.15.50:6789/0 conn(0x7f58cc0b45f0 legacy=0x7f58cc0d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:38.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d184b700 1 -- 172.21.15.50:0/1550318137 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc0d0c70 con 0x7f58cc160ac0 2023-11-28T11:53:38.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d184b700 1 --2- 172.21.15.50:0/1550318137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58cc160ac0 0x7f58cc0b49c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009850 tx=0x7f58c0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f4f8f28236d04d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:38.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d104a700 1 -- 172.21.15.50:0/1550318137 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0011830 con 0x7f58cc160ac0 2023-11-28T11:53:38.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d104a700 1 -- 172.21.15.50:0/1550318137 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c0011990 con 0x7f58cc160ac0 2023-11-28T11:53:38.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d104a700 1 -- 172.21.15.50:0/1550318137 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0011d40 con 0x7f58cc160ac0 2023-11-28T11:53:38.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d42b0700 1 -- 172.21.15.50:0/1550318137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58cc160ac0 msgr2=0x7f58cc0b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:38.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d42b0700 1 --2- 172.21.15.50:0/1550318137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58cc160ac0 0x7f58cc0b49c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009850 tx=0x7f58c0009b60 comp rx=0 tx=0).stop 2023-11-28T11:53:38.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d42b0700 1 -- 172.21.15.50:0/1550318137 shutdown_connections 2023-11-28T11:53:38.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d42b0700 1 --2- 172.21.15.50:0/1550318137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58cc160ac0 0x7f58cc0b49c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:38.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d42b0700 1 -- 172.21.15.50:0/1550318137 >> 172.21.15.50:0/1550318137 conn(0x7f58cc06cb40 msgr2=0x7f58cc0cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:38.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d42b0700 1 -- 172.21.15.50:0/1550318137 shutdown_connections 2023-11-28T11:53:38.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.233+0000 7f58d42b0700 1 -- 172.21.15.50:0/1550318137 wait complete. 2023-11-28T11:53:38.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.237+0000 7f58d42b0700 1 Processor -- start 2023-11-28T11:53:38.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.237+0000 7f58d42b0700 1 -- start start 2023-11-28T11:53:38.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.237+0000 7f58d42b0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58cc0b45f0 0x7f58cc0b7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:38.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.237+0000 7f58d42b0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc0cd1c0 0x7f58cc0c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:38.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d42b0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58cc160ac0 0x7f58cc0cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:38.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d42b0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc1f1cb0 con 0x7f58cc160ac0 2023-11-28T11:53:38.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d42b0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc15c880 con 0x7f58cc0cd1c0 2023-11-28T11:53:38.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d42b0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc0c5e80 con 0x7f58cc0b45f0 2023-11-28T11:53:38.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d284d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58cc160ac0 0x7f58cc0cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:38.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d284d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58cc160ac0 0x7f58cc0cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54796/0 (socket says 172.21.15.50:54796) 2023-11-28T11:53:38.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d284d700 1 -- 172.21.15.50:0/1935909314 learned_addr learned my addr 172.21.15.50:0/1935909314 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:38.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d204c700 1 --2- 172.21.15.50:0/1935909314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58cc0b45f0 0x7f58cc0b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:38.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d184b700 1 --2- 172.21.15.50:0/1935909314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc0cd1c0 0x7f58cc0c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:38.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d284d700 1 -- 172.21.15.50:0/1935909314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58cc0b45f0 msgr2=0x7f58cc0b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:38.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d284d700 1 --2- 172.21.15.50:0/1935909314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58cc0b45f0 0x7f58cc0b7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:38.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d284d700 1 -- 172.21.15.50:0/1935909314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc0cd1c0 msgr2=0x7f58cc0c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:38.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d284d700 1 --2- 172.21.15.50:0/1935909314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc0cd1c0 0x7f58cc0c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:38.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d284d700 1 -- 172.21.15.50:0/1935909314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c00094b0 con 0x7f58cc160ac0 2023-11-28T11:53:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d284d700 1 --2- 172.21.15.50:0/1935909314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58cc160ac0 0x7f58cc0cb5b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f58c400cc50 tx=0x7f58c400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58beffd700 1 -- 172.21.15.50:0/1935909314 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4003c20 con 0x7f58cc160ac0 2023-11-28T11:53:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58beffd700 1 -- 172.21.15.50:0/1935909314 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c4003d80 con 0x7f58cc160ac0 2023-11-28T11:53:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d42b0700 1 -- 172.21.15.50:0/1935909314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58cc0d1230 con 0x7f58cc160ac0 2023-11-28T11:53:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58beffd700 1 -- 172.21.15.50:0/1935909314 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c400aab0 con 0x7f58cc160ac0 2023-11-28T11:53:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d42b0700 1 -- 172.21.15.50:0/1935909314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58cc0d0f50 con 0x7f58cc160ac0 2023-11-28T11:53:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.241+0000 7f58d42b0700 1 -- 172.21.15.50:0/1935909314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58cc15c660 con 0x7f58cc160ac0 2023-11-28T11:53:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.245+0000 7f58beffd700 1 -- 172.21.15.50:0/1935909314 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f58c4010050 con 0x7f58cc160ac0 2023-11-28T11:53:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.245+0000 7f58beffd700 1 --2- 172.21.15.50:0/1935909314 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f58b0064ee0 0x7f58b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.245+0000 7f58beffd700 1 -- 172.21.15.50:0/1935909314 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f58c4081a60 con 0x7f58cc160ac0 2023-11-28T11:53:38.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.245+0000 7f58d204c700 1 --2- 172.21.15.50:0/1935909314 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f58b0064ee0 0x7f58b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:38.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.245+0000 7f58d204c700 1 --2- 172.21.15.50:0/1935909314 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f58b0064ee0 0x7f58b0067390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f58c8007fd0 tx=0x7f58c8007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.253+0000 7f58beffd700 1 -- 172.21.15.50:0/1935909314 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f58c404fec0 con 0x7f58cc160ac0 2023-11-28T11:53:38.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:38.417+0000 7f58d42b0700 1 -- 172.21.15.50:0/1935909314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f58cc072c20 con 0x7f58cc160ac0 2023-11-28T11:53:39.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.405+0000 7f58beffd700 1 -- 172.21.15.50:0/1935909314 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f58c40534e0 con 0x7f58cc160ac0 2023-11-28T11:53:39.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.409+0000 7f58d42b0700 1 -- 172.21.15.50:0/1935909314 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f58b0064ee0 msgr2=0x7f58b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:39.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.409+0000 7f58d42b0700 1 --2- 172.21.15.50:0/1935909314 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f58b0064ee0 0x7f58b0067390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f58c8007fd0 tx=0x7f58c8007de0 comp rx=0 tx=0).stop 2023-11-28T11:53:39.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.409+0000 7f58d42b0700 1 -- 172.21.15.50:0/1935909314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58cc160ac0 msgr2=0x7f58cc0cb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:39.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.409+0000 7f58d42b0700 1 --2- 172.21.15.50:0/1935909314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58cc160ac0 0x7f58cc0cb5b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f58c400cc50 tx=0x7f58c400cf60 comp rx=0 tx=0).stop 2023-11-28T11:53:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.409+0000 7f58d42b0700 1 -- 172.21.15.50:0/1935909314 shutdown_connections 2023-11-28T11:53:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.409+0000 7f58d42b0700 1 --2- 172.21.15.50:0/1935909314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58cc160ac0 0x7f58cc0cb5b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.409+0000 7f58d42b0700 1 --2- 172.21.15.50:0/1935909314 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f58b0064ee0 0x7f58b0067390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.413+0000 7f58d42b0700 1 --2- 172.21.15.50:0/1935909314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc0cd1c0 0x7f58cc0c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.413+0000 7f58d42b0700 1 --2- 172.21.15.50:0/1935909314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58cc0b45f0 0x7f58cc0b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.413+0000 7f58d42b0700 1 -- 172.21.15.50:0/1935909314 >> 172.21.15.50:0/1935909314 conn(0x7f58cc06cb40 msgr2=0x7f58cc156e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:39.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.413+0000 7f58d42b0700 1 -- 172.21.15.50:0/1935909314 shutdown_connections 2023-11-28T11:53:39.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.413+0000 7f58d42b0700 1 -- 172.21.15.50:0/1935909314 wait complete. 2023-11-28T11:53:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-11-28T11:53:39.433 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-28T11:53:39.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.553+0000 7f1467fff700 1 Processor -- start 2023-11-28T11:53:39.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.553+0000 7f1467fff700 1 -- start start 2023-11-28T11:53:39.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.553+0000 7f1467fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f14680b1ae0 0x7f146806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:39.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.553+0000 7f1467fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14680cf0e0 0x7f14680cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:39.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.553+0000 7f1467fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14680cfa80 con 0x7f146806a4c0 2023-11-28T11:53:39.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.553+0000 7f1467fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14680d0ab0 con 0x7f14680b1ae0 2023-11-28T11:53:39.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.553+0000 7f1467fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146806a9c0 con 0x7f14680cf0e0 2023-11-28T11:53:39.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.553+0000 7f1466ffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f14680b1ae0 0x7f146806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:39.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.553+0000 7f1466ffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f14680b1ae0 0x7f146806d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:57750/0 (socket says 172.21.15.50:57750) 2023-11-28T11:53:39.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.553+0000 7f1466ffd700 1 -- 172.21.15.50:0/3581447608 learned_addr learned my addr 172.21.15.50:0/3581447608 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:39.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.553+0000 7f14677fe700 1 --2- 172.21.15.50:0/3581447608 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14680cf0e0 0x7f14680cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.557+0000 7f1466ffd700 1 -- 172.21.15.50:0/3581447608 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14680cf0e0 msgr2=0x7f14680cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.557+0000 7f1466ffd700 1 --2- 172.21.15.50:0/3581447608 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14680cf0e0 0x7f14680cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.557+0000 7f1466ffd700 1 -- 172.21.15.50:0/3581447608 >> v1:172.21.15.192:6789/0 conn(0x7f146806a4c0 legacy=0x7f14680d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:39.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.557+0000 7f1466ffd700 1 -- 172.21.15.50:0/3581447608 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146806aca0 con 0x7f14680b1ae0 2023-11-28T11:53:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.557+0000 7f1466ffd700 1 --2- 172.21.15.50:0/3581447608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14680b1ae0 0x7f146806d8e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1458009910 tx=0x7f1458009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8a4b4eae833fba4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.557+0000 7f1465ffb700 1 -- 172.21.15.50:0/3581447608 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458011830 con 0x7f14680b1ae0 2023-11-28T11:53:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.557+0000 7f1465ffb700 1 -- 172.21.15.50:0/3581447608 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1458011990 con 0x7f14680b1ae0 2023-11-28T11:53:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.557+0000 7f1465ffb700 1 -- 172.21.15.50:0/3581447608 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458011d40 con 0x7f14680b1ae0 2023-11-28T11:53:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.557+0000 7f1467fff700 1 -- 172.21.15.50:0/3581447608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14680b1ae0 msgr2=0x7f146806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:39.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.557+0000 7f1467fff700 1 --2- 172.21.15.50:0/3581447608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14680b1ae0 0x7f146806d8e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1458009910 tx=0x7f1458009c20 comp rx=0 tx=0).stop 2023-11-28T11:53:39.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.557+0000 7f1467fff700 1 -- 172.21.15.50:0/3581447608 shutdown_connections 2023-11-28T11:53:39.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.557+0000 7f1467fff700 1 --2- 172.21.15.50:0/3581447608 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14680cf0e0 0x7f14680cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:39.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.557+0000 7f1467fff700 1 --2- 172.21.15.50:0/3581447608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14680b1ae0 0x7f146806d8e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:39.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.557+0000 7f1467fff700 1 -- 172.21.15.50:0/3581447608 >> 172.21.15.50:0/3581447608 conn(0x7f146809bbd0 msgr2=0x7f14680b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:39.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.557+0000 7f1467fff700 1 -- 172.21.15.50:0/3581447608 shutdown_connections 2023-11-28T11:53:39.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.557+0000 7f1467fff700 1 -- 172.21.15.50:0/3581447608 wait complete. 2023-11-28T11:53:39.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f1467fff700 1 Processor -- start 2023-11-28T11:53:39.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f1467fff700 1 -- start start 2023-11-28T11:53:39.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f1467fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f146806a4c0 0x7f146815ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:39.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f1467fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14680b1ae0 0x7f146815f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:39.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f1467fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14680cf0e0 0x7f1468159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:39.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f1467fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146815dcc0 con 0x7f14680b1ae0 2023-11-28T11:53:39.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f1467fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146815df60 con 0x7f14680cf0e0 2023-11-28T11:53:39.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f1467fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146815e240 con 0x7f146806a4c0 2023-11-28T11:53:39.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f14667fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14680b1ae0 0x7f146815f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:39.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f14667fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14680b1ae0 0x7f146815f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54806/0 (socket says 172.21.15.50:54806) 2023-11-28T11:53:39.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f14667fc700 1 -- 172.21.15.50:0/3078184228 learned_addr learned my addr 172.21.15.50:0/3078184228 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:39.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f14677fe700 1 --2- 172.21.15.50:0/3078184228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14680cf0e0 0x7f1468159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:39.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f1466ffd700 1 --2- 172.21.15.50:0/3078184228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f146806a4c0 0x7f146815ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:39.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f14667fc700 1 -- 172.21.15.50:0/3078184228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f146806a4c0 msgr2=0x7f146815ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:39.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f14667fc700 1 --2- 172.21.15.50:0/3078184228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f146806a4c0 0x7f146815ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:39.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f14667fc700 1 -- 172.21.15.50:0/3078184228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14680cf0e0 msgr2=0x7f1468159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:39.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f14667fc700 1 --2- 172.21.15.50:0/3078184228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14680cf0e0 0x7f1468159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:39.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f14667fc700 1 -- 172.21.15.50:0/3078184228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1458009570 con 0x7f14680b1ae0 2023-11-28T11:53:39.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f14667fc700 1 --2- 172.21.15.50:0/3078184228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14680b1ae0 0x7f146815f260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f145c00c500 tx=0x7f145c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:39.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f144f7fe700 1 -- 172.21.15.50:0/3078184228 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c0052d0 con 0x7f14680b1ae0 2023-11-28T11:53:39.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f144f7fe700 1 -- 172.21.15.50:0/3078184228 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145c005430 con 0x7f14680b1ae0 2023-11-28T11:53:39.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f1467fff700 1 -- 172.21.15.50:0/3078184228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14680b4380 con 0x7f14680b1ae0 2023-11-28T11:53:39.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f144f7fe700 1 -- 172.21.15.50:0/3078184228 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c0055a0 con 0x7f14680b1ae0 2023-11-28T11:53:39.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.561+0000 7f1467fff700 1 -- 172.21.15.50:0/3078184228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146806af80 con 0x7f14680b1ae0 2023-11-28T11:53:39.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.565+0000 7f144f7fe700 1 -- 172.21.15.50:0/3078184228 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f145c019030 con 0x7f14680b1ae0 2023-11-28T11:53:39.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.565+0000 7f1467fff700 1 -- 172.21.15.50:0/3078184228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14680b1eb0 con 0x7f14680b1ae0 2023-11-28T11:53:39.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.565+0000 7f144f7fe700 1 --2- 172.21.15.50:0/3078184228 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1454064ee0 0x7f1454067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:39.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.565+0000 7f144f7fe700 1 -- 172.21.15.50:0/3078184228 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f145c080f00 con 0x7f14680b1ae0 2023-11-28T11:53:39.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.565+0000 7f1466ffd700 1 --2- 172.21.15.50:0/3078184228 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1454064ee0 0x7f1454067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:39.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.565+0000 7f1466ffd700 1 --2- 172.21.15.50:0/3078184228 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1454064ee0 0x7f1454067390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f14680b53b0 tx=0x7f1458008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:39.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.573+0000 7f144f7fe700 1 -- 172.21.15.50:0/3078184228 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f145c04f280 con 0x7f14680b1ae0 2023-11-28T11:53:39.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:39.733+0000 7f1467fff700 1 -- 172.21.15.50:0/3078184228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f1468072500 con 0x7f14680b1ae0 2023-11-28T11:53:40.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.417+0000 7f144f7fe700 1 -- 172.21.15.50:0/3078184228 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f145c0528a0 con 0x7f14680b1ae0 2023-11-28T11:53:40.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.429+0000 7f1467fff700 1 -- 172.21.15.50:0/3078184228 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1454064ee0 msgr2=0x7f1454067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:40.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.429+0000 7f1467fff700 1 --2- 172.21.15.50:0/3078184228 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1454064ee0 0x7f1454067390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f14680b53b0 tx=0x7f1458008030 comp rx=0 tx=0).stop 2023-11-28T11:53:40.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.429+0000 7f1467fff700 1 -- 172.21.15.50:0/3078184228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14680b1ae0 msgr2=0x7f146815f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:40.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.429+0000 7f1467fff700 1 --2- 172.21.15.50:0/3078184228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14680b1ae0 0x7f146815f260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f145c00c500 tx=0x7f145c00c810 comp rx=0 tx=0).stop 2023-11-28T11:53:40.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.429+0000 7f1467fff700 1 -- 172.21.15.50:0/3078184228 shutdown_connections 2023-11-28T11:53:40.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.429+0000 7f1467fff700 1 --2- 172.21.15.50:0/3078184228 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1454064ee0 0x7f1454067390 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f14680b53b0 tx=0x7f1458008030 comp rx=0 tx=0).stop 2023-11-28T11:53:40.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.429+0000 7f1467fff700 1 --2- 172.21.15.50:0/3078184228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14680cf0e0 0x7f1468159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.429+0000 7f1467fff700 1 --2- 172.21.15.50:0/3078184228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14680b1ae0 0x7f146815f260 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.429+0000 7f1467fff700 1 --2- 172.21.15.50:0/3078184228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f146806a4c0 0x7f146815ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.429+0000 7f1467fff700 1 -- 172.21.15.50:0/3078184228 >> 172.21.15.50:0/3078184228 conn(0x7f146809bbd0 msgr2=0x7f14680b5790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:40.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.437+0000 7f1467fff700 1 -- 172.21.15.50:0/3078184228 shutdown_connections 2023-11-28T11:53:40.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.437+0000 7f1467fff700 1 -- 172.21.15.50:0/3078184228 wait complete. 2023-11-28T11:53:40.451 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-11-28T11:53:40.458 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T11:53:40.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.565+0000 7fba25285700 1 Processor -- start 2023-11-28T11:53:40.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.565+0000 7fba25285700 1 -- start start 2023-11-28T11:53:40.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.565+0000 7fba25285700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fba2006a4c0 0x7fba2006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:40.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.565+0000 7fba25285700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2006a9c0 con 0x7fba200cf0e0 2023-11-28T11:53:40.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.565+0000 7fba25285700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2006aca0 con 0x7fba200b1ae0 2023-11-28T11:53:40.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.565+0000 7fba25285700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba200d0ab0 con 0x7fba2006a4c0 2023-11-28T11:53:40.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.565+0000 7fba24a84700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fba200cf0e0 0x7fba200cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45970/0 (socket says 172.21.15.50:45970) 2023-11-28T11:53:40.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.565+0000 7fba24a84700 1 -- 172.21.15.50:0/2709645750 learned_addr learned my addr 172.21.15.50:0/2709645750 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:40.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.565+0000 7fba1f7fe700 1 --2- 172.21.15.50:0/2709645750 >> v2:172.21.15.192:3300/0 conn(0x7fba2006a4c0 0x7fba2006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:40.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.565+0000 7fba1effd700 1 -- 172.21.15.50:0/2709645750 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416480387 0 0) 0x7fba2006a9c0 con 0x7fba200cf0e0 2023-11-28T11:53:40.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 -- 172.21.15.50:0/2709645750 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba0c0035d0 con 0x7fba200cf0e0 2023-11-28T11:53:40.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 -- 172.21.15.50:0/2709645750 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690286867 0 0) 0x7fba2006aca0 con 0x7fba200b1ae0 2023-11-28T11:53:40.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 -- 172.21.15.50:0/2709645750 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba2006a9c0 con 0x7fba200b1ae0 2023-11-28T11:53:40.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 -- 172.21.15.50:0/2709645750 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4020977896 0 0) 0x7fba0c0035d0 con 0x7fba200cf0e0 2023-11-28T11:53:40.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 -- 172.21.15.50:0/2709645750 >> v2:172.21.15.192:3300/0 conn(0x7fba2006a4c0 msgr2=0x7fba2006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:40.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 --2- 172.21.15.50:0/2709645750 >> v2:172.21.15.192:3300/0 conn(0x7fba2006a4c0 0x7fba2006d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 -- 172.21.15.50:0/2709645750 >> v1:172.21.15.192:6789/0 conn(0x7fba200b1ae0 legacy=0x7fba200d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:40.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 -- 172.21.15.50:0/2709645750 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2006af80 con 0x7fba200cf0e0 2023-11-28T11:53:40.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 -- 172.21.15.50:0/2709645750 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7fba180019f0 con 0x7fba200cf0e0 2023-11-28T11:53:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 -- 172.21.15.50:0/2709645750 >> v1:172.21.15.50:6789/0 conn(0x7fba200cf0e0 legacy=0x7fba200cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 --2- 172.21.15.50:0/2709645750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba0c003bb0 0x7fba0c003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 --2- 172.21.15.50:0/2709645750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba0c004870 0x7fba0c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 --2- 172.21.15.50:0/2709645750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba0c005220 0x7fba0c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 -- 172.21.15.50:0/2709645750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba200d0ab0 con 0x7fba0c003bb0 2023-11-28T11:53:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 -- 172.21.15.50:0/2709645750 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c00c080 con 0x7fba0c005220 2023-11-28T11:53:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 -- 172.21.15.50:0/2709645750 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c00c240 con 0x7fba0c004870 2023-11-28T11:53:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1ffff700 1 --2- 172.21.15.50:0/2709645750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba0c003bb0 0x7fba0c003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1f7fe700 1 --2- 172.21.15.50:0/2709645750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba0c004870 0x7fba0c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba24a84700 1 --2- 172.21.15.50:0/2709645750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba0c005220 0x7fba0c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1f7fe700 1 -- 172.21.15.50:0/2709645750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba0c005220 msgr2=0x7fba0c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1f7fe700 1 --2- 172.21.15.50:0/2709645750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba0c005220 0x7fba0c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1f7fe700 1 -- 172.21.15.50:0/2709645750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba0c003bb0 msgr2=0x7fba0c003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:40.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1f7fe700 1 --2- 172.21.15.50:0/2709645750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba0c003bb0 0x7fba0c003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba24a84700 1 -- 172.21.15.50:0/2709645750 reap_dead start 2023-11-28T11:53:40.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1f7fe700 1 -- 172.21.15.50:0/2709645750 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c0035d0 con 0x7fba0c004870 2023-11-28T11:53:40.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1ffff700 1 --2- 172.21.15.50:0/2709645750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba0c003bb0 0x7fba0c003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:53:40.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1f7fe700 1 --2- 172.21.15.50:0/2709645750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba0c004870 0x7fba0c004ce0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fba10009b70 tx=0x7fba0c0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcb6fdd170cbcaf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:40.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 -- 172.21.15.50:0/2709645750 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1000e6c0 con 0x7fba0c004870 2023-11-28T11:53:40.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 -- 172.21.15.50:0/2709645750 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1000e820 con 0x7fba0c004870 2023-11-28T11:53:40.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba1effd700 1 -- 172.21.15.50:0/2709645750 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1000eb90 con 0x7fba0c004870 2023-11-28T11:53:40.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba25285700 1 -- 172.21.15.50:0/2709645750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba0c004870 msgr2=0x7fba0c004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:40.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba25285700 1 --2- 172.21.15.50:0/2709645750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba0c004870 0x7fba0c004ce0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fba10009b70 tx=0x7fba0c0058a0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba25285700 1 -- 172.21.15.50:0/2709645750 shutdown_connections 2023-11-28T11:53:40.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba25285700 1 --2- 172.21.15.50:0/2709645750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba0c004870 0x7fba0c004ce0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba25285700 1 -- 172.21.15.50:0/2709645750 >> 172.21.15.50:0/2709645750 conn(0x7fba2009bbd0 msgr2=0x7fba200b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:40.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba25285700 1 -- 172.21.15.50:0/2709645750 shutdown_connections 2023-11-28T11:53:40.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.569+0000 7fba25285700 1 -- 172.21.15.50:0/2709645750 wait complete. 2023-11-28T11:53:40.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba25285700 1 Processor -- start 2023-11-28T11:53:40.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba25285700 1 -- start start 2023-11-28T11:53:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba25285700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba0c004870 0x7fba2015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba25285700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba200b0d70 0x7fba201f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba25285700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba201f9500 0x7fba2009e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba25285700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba201f9970 con 0x7fba200b0d70 2023-11-28T11:53:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba25285700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba201f6b70 con 0x7fba0c004870 2023-11-28T11:53:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba25285700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2015ea30 con 0x7fba201f9500 2023-11-28T11:53:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba1f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba200b0d70 0x7fba201f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba1f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba200b0d70 0x7fba201f8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54820/0 (socket says 172.21.15.50:54820) 2023-11-28T11:53:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba1f7fe700 1 -- 172.21.15.50:0/1495371232 learned_addr learned my addr 172.21.15.50:0/1495371232 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba24a84700 1 --2- 172.21.15.50:0/1495371232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba201f9500 0x7fba2009e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba1ffff700 1 --2- 172.21.15.50:0/1495371232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba0c004870 0x7fba2015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba24a84700 1 -- 172.21.15.50:0/1495371232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba0c004870 msgr2=0x7fba2015e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:40.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba24a84700 1 --2- 172.21.15.50:0/1495371232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba0c004870 0x7fba2015e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba24a84700 1 -- 172.21.15.50:0/1495371232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba200b0d70 msgr2=0x7fba201f8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:40.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba24a84700 1 --2- 172.21.15.50:0/1495371232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba200b0d70 0x7fba201f8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba24a84700 1 -- 172.21.15.50:0/1495371232 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba200b1eb0 con 0x7fba201f9500 2023-11-28T11:53:40.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba1f7fe700 1 --2- 172.21.15.50:0/1495371232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba200b0d70 0x7fba201f8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:53:40.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba24a84700 1 --2- 172.21.15.50:0/1495371232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba201f9500 0x7fba2009e560 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fba200cf4b0 tx=0x7fba18001a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:40.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba1cff9700 1 -- 172.21.15.50:0/1495371232 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1800a8c0 con 0x7fba201f9500 2023-11-28T11:53:40.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba1cff9700 1 -- 172.21.15.50:0/1495371232 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1800aa40 con 0x7fba201f9500 2023-11-28T11:53:40.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba25285700 1 -- 172.21.15.50:0/1495371232 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba200b4380 con 0x7fba201f9500 2023-11-28T11:53:40.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba1cff9700 1 -- 172.21.15.50:0/1495371232 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1800ae30 con 0x7fba201f9500 2023-11-28T11:53:40.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.573+0000 7fba25285700 1 -- 172.21.15.50:0/1495371232 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba200b60e0 con 0x7fba201f9500 2023-11-28T11:53:40.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.577+0000 7fba25285700 1 -- 172.21.15.50:0/1495371232 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba201f6d90 con 0x7fba201f9500 2023-11-28T11:53:40.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.577+0000 7fba1cff9700 1 -- 172.21.15.50:0/1495371232 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fba1801d460 con 0x7fba201f9500 2023-11-28T11:53:40.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.577+0000 7fba1cff9700 1 --2- 172.21.15.50:0/1495371232 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba00064f10 0x7fba000673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:40.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.577+0000 7fba1cff9700 1 -- 172.21.15.50:0/1495371232 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fba180823f0 con 0x7fba201f9500 2023-11-28T11:53:40.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.577+0000 7fba1ffff700 1 --2- 172.21.15.50:0/1495371232 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba00064f10 0x7fba000673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:40.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.577+0000 7fba1ffff700 1 --2- 172.21.15.50:0/1495371232 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba00064f10 0x7fba000673c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fba20069bb0 tx=0x7fba08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:40.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.589+0000 7fba1cff9700 1 -- 172.21.15.50:0/1495371232 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fba201f6d90 con 0x7fba201f9500 2023-11-28T11:53:40.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.789+0000 7fba25285700 1 -- 172.21.15.50:0/1495371232 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fba201f6d90 con 0x7fba201f9500 2023-11-28T11:53:40.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.809+0000 7fba1cff9700 1 -- 172.21.15.50:0/1495371232 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fba201f6d90 con 0x7fba201f9500 2023-11-28T11:53:40.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.833+0000 7fba25285700 1 -- 172.21.15.50:0/1495371232 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba00064f10 msgr2=0x7fba000673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:40.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.833+0000 7fba25285700 1 --2- 172.21.15.50:0/1495371232 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba00064f10 0x7fba000673c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fba20069bb0 tx=0x7fba08009040 comp rx=0 tx=0).stop 2023-11-28T11:53:40.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.833+0000 7fba25285700 1 -- 172.21.15.50:0/1495371232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba201f9500 msgr2=0x7fba2009e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:40.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.833+0000 7fba25285700 1 --2- 172.21.15.50:0/1495371232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba201f9500 0x7fba2009e560 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fba200cf4b0 tx=0x7fba18001a20 comp rx=0 tx=0).stop 2023-11-28T11:53:40.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.833+0000 7fba25285700 1 -- 172.21.15.50:0/1495371232 shutdown_connections 2023-11-28T11:53:40.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.833+0000 7fba25285700 1 --2- 172.21.15.50:0/1495371232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba201f9500 0x7fba2009e560 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.833+0000 7fba25285700 1 --2- 172.21.15.50:0/1495371232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba200b0d70 0x7fba201f8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.833+0000 7fba25285700 1 --2- 172.21.15.50:0/1495371232 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba00064f10 0x7fba000673c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.833+0000 7fba25285700 1 --2- 172.21.15.50:0/1495371232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba0c004870 0x7fba2015e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.833+0000 7fba25285700 1 -- 172.21.15.50:0/1495371232 >> 172.21.15.50:0/1495371232 conn(0x7fba2009bbd0 msgr2=0x7fba2015bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.833+0000 7fba25285700 1 -- 172.21.15.50:0/1495371232 shutdown_connections 2023-11-28T11:53:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.833+0000 7fba25285700 1 -- 172.21.15.50:0/1495371232 wait complete. 2023-11-28T11:53:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 3 and data pool 4 2023-11-28T11:53:40.849 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-28T11:53:40.850 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-28T11:53:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.957+0000 7fa23f59e700 1 Processor -- start 2023-11-28T11:53:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.957+0000 7fa23f59e700 1 -- start start 2023-11-28T11:53:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23f59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa24006a4c0 0x7fa24006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23f59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa2400cf0e0 0x7fa2400cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2400cfa40 con 0x7fa2400b1ae0 2023-11-28T11:53:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23f59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2400d0ab0 con 0x7fa24006a4c0 2023-11-28T11:53:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23f59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24006a9c0 con 0x7fa2400cf0e0 2023-11-28T11:53:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23e59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa2400b1ae0 0x7fa2400d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45980/0 (socket says 172.21.15.50:45980) 2023-11-28T11:53:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23e59c700 1 -- 172.21.15.50:0/3125680542 learned_addr learned my addr 172.21.15.50:0/3125680542 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23dd9b700 1 --2- 172.21.15.50:0/3125680542 >> v2:172.21.15.50:3300/0 conn(0x7fa24006a4c0 0x7fa24006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23ed9d700 1 --2- 172.21.15.50:0/3125680542 >> v2:172.21.15.192:3300/0 conn(0x7fa2400cf0e0 0x7fa2400cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23d59a700 1 -- 172.21.15.50:0/3125680542 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863519656 0 0) 0x7fa2400cfa40 con 0x7fa2400b1ae0 2023-11-28T11:53:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23d59a700 1 -- 172.21.15.50:0/3125680542 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2280035d0 con 0x7fa2400b1ae0 2023-11-28T11:53:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23dd9b700 1 -- 172.21.15.50:0/3125680542 >> v2:172.21.15.192:3300/0 conn(0x7fa2400cf0e0 msgr2=0x7fa2400cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23dd9b700 1 --2- 172.21.15.50:0/3125680542 >> v2:172.21.15.192:3300/0 conn(0x7fa2400cf0e0 0x7fa2400cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23dd9b700 1 -- 172.21.15.50:0/3125680542 >> v1:172.21.15.50:6789/0 conn(0x7fa2400b1ae0 legacy=0x7fa2400d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23dd9b700 1 -- 172.21.15.50:0/3125680542 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24006aca0 con 0x7fa24006a4c0 2023-11-28T11:53:40.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23dd9b700 1 --2- 172.21.15.50:0/3125680542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa24006a4c0 0x7fa24006d8e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa2400b6440 tx=0x7fa234009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ce09944a792919 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:40.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23d59a700 1 -- 172.21.15.50:0/3125680542 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234011830 con 0x7fa24006a4c0 2023-11-28T11:53:40.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23d59a700 1 -- 172.21.15.50:0/3125680542 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa234011990 con 0x7fa24006a4c0 2023-11-28T11:53:40.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.961+0000 7fa23d59a700 1 -- 172.21.15.50:0/3125680542 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234011d20 con 0x7fa24006a4c0 2023-11-28T11:53:40.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.965+0000 7fa23f59e700 1 -- 172.21.15.50:0/3125680542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa24006a4c0 msgr2=0x7fa24006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:40.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.965+0000 7fa23f59e700 1 --2- 172.21.15.50:0/3125680542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa24006a4c0 0x7fa24006d8e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa2400b6440 tx=0x7fa234009b30 comp rx=0 tx=0).stop 2023-11-28T11:53:40.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.965+0000 7fa23f59e700 1 -- 172.21.15.50:0/3125680542 shutdown_connections 2023-11-28T11:53:40.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.965+0000 7fa23f59e700 1 --2- 172.21.15.50:0/3125680542 >> v2:172.21.15.192:3300/0 conn(0x7fa2400cf0e0 0x7fa2400cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.965+0000 7fa23f59e700 1 --2- 172.21.15.50:0/3125680542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa24006a4c0 0x7fa24006d8e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.965+0000 7fa23f59e700 1 -- 172.21.15.50:0/3125680542 >> 172.21.15.50:0/3125680542 conn(0x7fa24009bbd0 msgr2=0x7fa2400b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:40.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.965+0000 7fa23f59e700 1 -- 172.21.15.50:0/3125680542 shutdown_connections 2023-11-28T11:53:40.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.965+0000 7fa23f59e700 1 -- 172.21.15.50:0/3125680542 wait complete. 2023-11-28T11:53:40.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.965+0000 7fa23f59e700 1 Processor -- start 2023-11-28T11:53:40.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.965+0000 7fa23f59e700 1 -- start start 2023-11-28T11:53:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.965+0000 7fa23f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa24006a4c0 0x7fa240159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.965+0000 7fa23f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2400b1ae0 0x7fa24015f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.965+0000 7fa23f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2400cf0e0 0x7fa2400b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.965+0000 7fa23f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24015cd00 con 0x7fa2400cf0e0 2023-11-28T11:53:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.965+0000 7fa23f59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24015c6d0 con 0x7fa2400b1ae0 2023-11-28T11:53:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.965+0000 7fa23f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24015a4d0 con 0x7fa24006a4c0 2023-11-28T11:53:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa23ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2400cf0e0 0x7fa2400b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa23ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2400cf0e0 0x7fa2400b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54832/0 (socket says 172.21.15.50:54832) 2023-11-28T11:53:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa23ed9d700 1 -- 172.21.15.50:0/4138138568 learned_addr learned my addr 172.21.15.50:0/4138138568 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa23dd9b700 1 --2- 172.21.15.50:0/4138138568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2400b1ae0 0x7fa24015f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:40.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa23e59c700 1 --2- 172.21.15.50:0/4138138568 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa24006a4c0 0x7fa240159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa23ed9d700 1 -- 172.21.15.50:0/4138138568 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa24006a4c0 msgr2=0x7fa240159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa23ed9d700 1 --2- 172.21.15.50:0/4138138568 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa24006a4c0 0x7fa240159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa23ed9d700 1 -- 172.21.15.50:0/4138138568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2400b1ae0 msgr2=0x7fa24015f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa23ed9d700 1 --2- 172.21.15.50:0/4138138568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2400b1ae0 0x7fa24015f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa23ed9d700 1 -- 172.21.15.50:0/4138138568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2340094b0 con 0x7fa2400cf0e0 2023-11-28T11:53:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa23ed9d700 1 --2- 172.21.15.50:0/4138138568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2400cf0e0 0x7fa2400b3180 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa23000eb60 tx=0x7fa23000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa22effd700 1 -- 172.21.15.50:0/4138138568 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa230009740 con 0x7fa2400cf0e0 2023-11-28T11:53:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa22effd700 1 -- 172.21.15.50:0/4138138568 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa230009e00 con 0x7fa2400cf0e0 2023-11-28T11:53:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa22effd700 1 -- 172.21.15.50:0/4138138568 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23000ca70 con 0x7fa2400cf0e0 2023-11-28T11:53:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa23f59e700 1 -- 172.21.15.50:0/4138138568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2400b4380 con 0x7fa2400cf0e0 2023-11-28T11:53:40.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa23f59e700 1 -- 172.21.15.50:0/4138138568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24006af80 con 0x7fa2400cf0e0 2023-11-28T11:53:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa22effd700 1 -- 172.21.15.50:0/4138138568 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa230019030 con 0x7fa2400cf0e0 2023-11-28T11:53:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.969+0000 7fa23f59e700 1 -- 172.21.15.50:0/4138138568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2400b1eb0 con 0x7fa2400cf0e0 2023-11-28T11:53:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.973+0000 7fa22effd700 1 --2- 172.21.15.50:0/4138138568 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa220064ee0 0x7fa220067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.973+0000 7fa22effd700 1 -- 172.21.15.50:0/4138138568 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa230081d70 con 0x7fa2400cf0e0 2023-11-28T11:53:40.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.973+0000 7fa23e59c700 1 --2- 172.21.15.50:0/4138138568 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa220064ee0 0x7fa220067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:40.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.973+0000 7fa23e59c700 1 --2- 172.21.15.50:0/4138138568 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa220064ee0 0x7fa220067390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa238001560 tx=0x7fa238001a90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:40.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:40.985+0000 7fa22effd700 1 -- 172.21.15.50:0/4138138568 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa23004fe90 con 0x7fa2400cf0e0 2023-11-28T11:53:41.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.157+0000 7fa23f59e700 1 -- 172.21.15.50:0/4138138568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fa240072500 con 0x7fa2400cf0e0 2023-11-28T11:53:41.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.813+0000 7fa22effd700 1 -- 172.21.15.50:0/4138138568 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7fa2300534b0 con 0x7fa2400cf0e0 2023-11-28T11:53:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.817+0000 7fa23f59e700 1 -- 172.21.15.50:0/4138138568 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa220064ee0 msgr2=0x7fa220067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.817+0000 7fa23f59e700 1 --2- 172.21.15.50:0/4138138568 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa220064ee0 0x7fa220067390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa238001560 tx=0x7fa238001a90 comp rx=0 tx=0).stop 2023-11-28T11:53:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.817+0000 7fa23f59e700 1 -- 172.21.15.50:0/4138138568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2400cf0e0 msgr2=0x7fa2400b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.817+0000 7fa23f59e700 1 --2- 172.21.15.50:0/4138138568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2400cf0e0 0x7fa2400b3180 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa23000eb60 tx=0x7fa23000ee70 comp rx=0 tx=0).stop 2023-11-28T11:53:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.817+0000 7fa23f59e700 1 -- 172.21.15.50:0/4138138568 shutdown_connections 2023-11-28T11:53:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.817+0000 7fa23f59e700 1 --2- 172.21.15.50:0/4138138568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2400cf0e0 0x7fa2400b3180 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.817+0000 7fa23f59e700 1 --2- 172.21.15.50:0/4138138568 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa220064ee0 0x7fa220067390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.817+0000 7fa23f59e700 1 --2- 172.21.15.50:0/4138138568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2400b1ae0 0x7fa24015f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.817+0000 7fa23f59e700 1 --2- 172.21.15.50:0/4138138568 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa24006a4c0 0x7fa240159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:41.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.817+0000 7fa23f59e700 1 -- 172.21.15.50:0/4138138568 >> 172.21.15.50:0/4138138568 conn(0x7fa24009bbd0 msgr2=0x7fa2400d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:41.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.817+0000 7fa23f59e700 1 -- 172.21.15.50:0/4138138568 shutdown_connections 2023-11-28T11:53:41.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.817+0000 7fa23f59e700 1 -- 172.21.15.50:0/4138138568 wait complete. 2023-11-28T11:53:41.839 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T11:53:41.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.961+0000 7f4ace9a8700 1 Processor -- start 2023-11-28T11:53:41.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.961+0000 7f4ace9a8700 1 -- start start 2023-11-28T11:53:41.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4ace9a8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ac80adbd0 0x7f4ac8163740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:41.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4ace9a8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac80ae0b0 con 0x7f4ac815d0b0 2023-11-28T11:53:41.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4ace9a8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac80ae950 con 0x7f4ac815c5d0 2023-11-28T11:53:41.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4ace9a8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac80b37e0 con 0x7f4ac80adbd0 2023-11-28T11:53:41.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4ace1a7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ac80adbd0 0x7f4ac8163740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:41.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4acd1a5700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4ac815d0b0 0x7f4ac81582c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38870/0 (socket says 172.21.15.50:38870) 2023-11-28T11:53:41.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4ace1a7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ac80adbd0 0x7f4ac8163740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36554/0 (socket says 172.21.15.50:36554) 2023-11-28T11:53:41.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4acd1a5700 1 -- 172.21.15.50:0/1429712704 learned_addr learned my addr 172.21.15.50:0/1429712704 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:41.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4ace1a7700 1 -- 172.21.15.50:0/1429712704 >> v1:172.21.15.192:6789/0 conn(0x7f4ac815c5d0 legacy=0x7f4ac815c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:41.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4ace1a7700 1 -- 172.21.15.50:0/1429712704 >> v1:172.21.15.50:6789/0 conn(0x7f4ac815d0b0 legacy=0x7f4ac81582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:41.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4acc9a4700 1 -- 172.21.15.50:0/1429712704 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197138738 0 0) 0x7f4ac80ae0b0 con 0x7f4ac815d0b0 2023-11-28T11:53:41.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4ace1a7700 1 -- 172.21.15.50:0/1429712704 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac80b3ac0 con 0x7f4ac80adbd0 2023-11-28T11:53:41.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4ace1a7700 1 --2- 172.21.15.50:0/1429712704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac80adbd0 0x7f4ac8163740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0009d90 tx=0x7f4ac000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eedf313942b8f1a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:41.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4acc9a4700 1 -- 172.21.15.50:0/1429712704 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac000e070 con 0x7f4ac80adbd0 2023-11-28T11:53:41.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4acc9a4700 1 -- 172.21.15.50:0/1429712704 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac000bbd0 con 0x7f4ac80adbd0 2023-11-28T11:53:41.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4acc9a4700 1 -- 172.21.15.50:0/1429712704 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0012430 con 0x7f4ac80adbd0 2023-11-28T11:53:41.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4ace9a8700 1 -- 172.21.15.50:0/1429712704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac80adbd0 msgr2=0x7f4ac8163740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:41.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4ace9a8700 1 --2- 172.21.15.50:0/1429712704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac80adbd0 0x7f4ac8163740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0009d90 tx=0x7f4ac000b330 comp rx=0 tx=0).stop 2023-11-28T11:53:41.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4ace9a8700 1 -- 172.21.15.50:0/1429712704 shutdown_connections 2023-11-28T11:53:41.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4ace9a8700 1 --2- 172.21.15.50:0/1429712704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac80adbd0 0x7f4ac8163740 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:41.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4ace9a8700 1 -- 172.21.15.50:0/1429712704 >> 172.21.15.50:0/1429712704 conn(0x7f4ac80ce770 msgr2=0x7f4ac80ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:41.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4ace9a8700 1 -- 172.21.15.50:0/1429712704 shutdown_connections 2023-11-28T11:53:41.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.965+0000 7f4ace9a8700 1 -- 172.21.15.50:0/1429712704 wait complete. 2023-11-28T11:53:41.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace9a8700 1 Processor -- start 2023-11-28T11:53:41.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace9a8700 1 -- start start 2023-11-28T11:53:41.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace9a8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac80adbd0 0x7f4ac8133900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:41.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace9a8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac815c5d0 0x7f4ac8070060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:41.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace9a8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac815d0b0 0x7f4ac80705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:41.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace9a8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac81590a0 con 0x7f4ac815d0b0 2023-11-28T11:53:41.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace9a8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac8159380 con 0x7f4ac80adbd0 2023-11-28T11:53:41.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace9a8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac8159660 con 0x7f4ac815c5d0 2023-11-28T11:53:41.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace1a7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac815d0b0 0x7f4ac80705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:41.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace1a7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac815d0b0 0x7f4ac80705a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36558/0 (socket says 172.21.15.50:36558) 2023-11-28T11:53:41.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace1a7700 1 -- 172.21.15.50:0/3905457235 learned_addr learned my addr 172.21.15.50:0/3905457235 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:41.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4acd1a5700 1 --2- 172.21.15.50:0/3905457235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac815c5d0 0x7f4ac8070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:41.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4acd9a6700 1 --2- 172.21.15.50:0/3905457235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac80adbd0 0x7f4ac8133900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:41.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace1a7700 1 -- 172.21.15.50:0/3905457235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac815c5d0 msgr2=0x7f4ac8070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:41.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace1a7700 1 --2- 172.21.15.50:0/3905457235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac815c5d0 0x7f4ac8070060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:41.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace1a7700 1 -- 172.21.15.50:0/3905457235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac80adbd0 msgr2=0x7f4ac8133900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:41.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace1a7700 1 --2- 172.21.15.50:0/3905457235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac80adbd0 0x7f4ac8133900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:41.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace1a7700 1 -- 172.21.15.50:0/3905457235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac0009a70 con 0x7f4ac815d0b0 2023-11-28T11:53:41.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4acd1a5700 1 --2- 172.21.15.50:0/3905457235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac815c5d0 0x7f4ac8070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:53:41.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace1a7700 1 --2- 172.21.15.50:0/3905457235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac815d0b0 0x7f4ac80705a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0014040 tx=0x7f4ac0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:41.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4abe7fc700 1 -- 172.21.15.50:0/3905457235 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0012430 con 0x7f4ac815d0b0 2023-11-28T11:53:41.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4abe7fc700 1 -- 172.21.15.50:0/3905457235 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac0020070 con 0x7f4ac815d0b0 2023-11-28T11:53:41.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace9a8700 1 -- 172.21.15.50:0/3905457235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac80ae5e0 con 0x7f4ac815d0b0 2023-11-28T11:53:41.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4abe7fc700 1 -- 172.21.15.50:0/3905457235 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0007000 con 0x7f4ac815d0b0 2023-11-28T11:53:41.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.969+0000 7f4ace9a8700 1 -- 172.21.15.50:0/3905457235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac80ae300 con 0x7f4ac815d0b0 2023-11-28T11:53:41.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.973+0000 7f4ace9a8700 1 -- 172.21.15.50:0/3905457235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac80afdf0 con 0x7f4ac815d0b0 2023-11-28T11:53:41.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.973+0000 7f4abe7fc700 1 -- 172.21.15.50:0/3905457235 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4ac0004280 con 0x7f4ac815d0b0 2023-11-28T11:53:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.973+0000 7f4abe7fc700 1 --2- 172.21.15.50:0/3905457235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4aac064ee0 0x7f4aac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.973+0000 7f4abe7fc700 1 -- 172.21.15.50:0/3905457235 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f4ac0022070 con 0x7f4ac815d0b0 2023-11-28T11:53:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.973+0000 7f4acd9a6700 1 --2- 172.21.15.50:0/3905457235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4aac064ee0 0x7f4aac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.977+0000 7f4acd9a6700 1 --2- 172.21.15.50:0/3905457235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4aac064ee0 0x7f4aac067390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4000f60 tx=0x7f4ac4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:41.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:41.985+0000 7f4abe7fc700 1 -- 172.21.15.50:0/3905457235 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4ac0052960 con 0x7f4ac815d0b0 2023-11-28T11:53:42.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:42.149+0000 7f4ace9a8700 1 -- 172.21.15.50:0/3905457235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4ac8072500 con 0x7f4ac815d0b0 2023-11-28T11:53:43.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.845+0000 7f4abe7fc700 1 -- 172.21.15.50:0/3905457235 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f4ac001a380 con 0x7f4ac815d0b0 2023-11-28T11:53:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.853+0000 7f4ace9a8700 1 -- 172.21.15.50:0/3905457235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4aac064ee0 msgr2=0x7f4aac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.853+0000 7f4ace9a8700 1 --2- 172.21.15.50:0/3905457235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4aac064ee0 0x7f4aac067390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4000f60 tx=0x7f4ac4009040 comp rx=0 tx=0).stop 2023-11-28T11:53:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.853+0000 7f4ace9a8700 1 -- 172.21.15.50:0/3905457235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac815d0b0 msgr2=0x7f4ac80705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.853+0000 7f4ace9a8700 1 --2- 172.21.15.50:0/3905457235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac815d0b0 0x7f4ac80705a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0014040 tx=0x7f4ac0004af0 comp rx=0 tx=0).stop 2023-11-28T11:53:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.853+0000 7f4ace9a8700 1 -- 172.21.15.50:0/3905457235 shutdown_connections 2023-11-28T11:53:43.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.853+0000 7f4ace9a8700 1 --2- 172.21.15.50:0/3905457235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ac815d0b0 0x7f4ac80705a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:43.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.853+0000 7f4ace9a8700 1 --2- 172.21.15.50:0/3905457235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ac815c5d0 0x7f4ac8070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:43.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.853+0000 7f4ace9a8700 1 --2- 172.21.15.50:0/3905457235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4aac064ee0 0x7f4aac067390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:43.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.853+0000 7f4ace9a8700 1 --2- 172.21.15.50:0/3905457235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac80adbd0 0x7f4ac8133900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:43.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.853+0000 7f4ace9a8700 1 -- 172.21.15.50:0/3905457235 >> 172.21.15.50:0/3905457235 conn(0x7f4ac80ce770 msgr2=0x7f4ac8071c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:43.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.853+0000 7f4ace9a8700 1 -- 172.21.15.50:0/3905457235 shutdown_connections 2023-11-28T11:53:43.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.853+0000 7f4ace9a8700 1 -- 172.21.15.50:0/3905457235 wait complete. 2023-11-28T11:53:43.859 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data_ec' created 2023-11-28T11:53:43.871 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-28T11:53:43.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.985+0000 7f07fffff700 1 Processor -- start 2023-11-28T11:53:43.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.985+0000 7f07fffff700 1 -- start start 2023-11-28T11:53:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f08000ad840 0x7f08000cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08000c8a50 0x7f080006d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fffff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080006bfb0 con 0x7f08000c8eb0 2023-11-28T11:53:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fffff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08000cb590 con 0x7f08000c8a50 2023-11-28T11:53:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fffff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f080006c290 con 0x7f08000ad840 2023-11-28T11:53:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07ff7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f08000c8eb0 0x7f08000cae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38884/0 (socket says 172.21.15.50:38884) 2023-11-28T11:53:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07ff7fe700 1 -- 172.21.15.50:0/4097043665 learned_addr learned my addr 172.21.15.50:0/4097043665 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fe7fc700 1 --2- 172.21.15.50:0/4097043665 >> v2:172.21.15.50:3300/0 conn(0x7f08000c8a50 0x7f080006d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:43.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07feffd700 1 --2- 172.21.15.50:0/4097043665 >> v2:172.21.15.192:3300/0 conn(0x7f08000ad840 0x7f08000cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:43.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fdffb700 1 -- 172.21.15.50:0/4097043665 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854052262 0 0) 0x7f080006bfb0 con 0x7f08000c8eb0 2023-11-28T11:53:43.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fdffb700 1 -- 172.21.15.50:0/4097043665 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e80035d0 con 0x7f08000c8eb0 2023-11-28T11:53:43.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fe7fc700 1 -- 172.21.15.50:0/4097043665 >> v2:172.21.15.192:3300/0 conn(0x7f08000ad840 msgr2=0x7f08000cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:43.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fe7fc700 1 --2- 172.21.15.50:0/4097043665 >> v2:172.21.15.192:3300/0 conn(0x7f08000ad840 0x7f08000cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:43.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fe7fc700 1 -- 172.21.15.50:0/4097043665 >> v1:172.21.15.50:6789/0 conn(0x7f08000c8eb0 legacy=0x7f08000cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:43.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fe7fc700 1 -- 172.21.15.50:0/4097043665 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080006c570 con 0x7f08000c8a50 2023-11-28T11:53:43.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fe7fc700 1 --2- 172.21.15.50:0/4097043665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08000c8a50 0x7f080006d050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f08000b0fc0 tx=0x7f07f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea33704305547ebc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:43.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fdffb700 1 -- 172.21.15.50:0/4097043665 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f000e070 con 0x7f08000c8a50 2023-11-28T11:53:43.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fdffb700 1 -- 172.21.15.50:0/4097043665 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f000bb20 con 0x7f08000c8a50 2023-11-28T11:53:43.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fdffb700 1 -- 172.21.15.50:0/4097043665 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f000be90 con 0x7f08000c8a50 2023-11-28T11:53:43.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fffff700 1 -- 172.21.15.50:0/4097043665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08000c8a50 msgr2=0x7f080006d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:43.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fffff700 1 --2- 172.21.15.50:0/4097043665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08000c8a50 0x7f080006d050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f08000b0fc0 tx=0x7f07f000b330 comp rx=0 tx=0).stop 2023-11-28T11:53:43.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fffff700 1 -- 172.21.15.50:0/4097043665 shutdown_connections 2023-11-28T11:53:43.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fffff700 1 --2- 172.21.15.50:0/4097043665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08000c8a50 0x7f080006d050 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:43.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fffff700 1 --2- 172.21.15.50:0/4097043665 >> v2:172.21.15.192:3300/0 conn(0x7f08000ad840 0x7f08000cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:43.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fffff700 1 -- 172.21.15.50:0/4097043665 >> 172.21.15.50:0/4097043665 conn(0x7f08000ce400 msgr2=0x7f08000ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:43.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fffff700 1 -- 172.21.15.50:0/4097043665 shutdown_connections 2023-11-28T11:53:43.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fffff700 1 -- 172.21.15.50:0/4097043665 wait complete. 2023-11-28T11:53:43.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fffff700 1 Processor -- start 2023-11-28T11:53:43.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.989+0000 7f07fffff700 1 -- start start 2023-11-28T11:53:43.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07fffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08000ad840 0x7f08001577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:43.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07fffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08000c8a50 0x7f0800160a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:43.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07fffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08000c8eb0 0x7f080008a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:43.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07fffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080008a1a0 con 0x7f08000ad840 2023-11-28T11:53:43.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07fffff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0800158650 con 0x7f08000c8a50 2023-11-28T11:53:43.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07fffff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0800157db0 con 0x7f08000c8eb0 2023-11-28T11:53:43.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07feffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08000ad840 0x7f08001577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:43.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07feffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08000ad840 0x7f08001577d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36568/0 (socket says 172.21.15.50:36568) 2023-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07feffd700 1 -- 172.21.15.50:0/489167221 learned_addr learned my addr 172.21.15.50:0/489167221 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07fe7fc700 1 --2- 172.21.15.50:0/489167221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08000c8a50 0x7f0800160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07ff7fe700 1 --2- 172.21.15.50:0/489167221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08000c8eb0 0x7f080008a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07fe7fc700 1 -- 172.21.15.50:0/489167221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08000c8eb0 msgr2=0x7f080008a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07fe7fc700 1 --2- 172.21.15.50:0/489167221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08000c8eb0 0x7f080008a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07fe7fc700 1 -- 172.21.15.50:0/489167221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08000ad840 msgr2=0x7f08001577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07fe7fc700 1 --2- 172.21.15.50:0/489167221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08000ad840 0x7f08001577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07fe7fc700 1 -- 172.21.15.50:0/489167221 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f0009a70 con 0x7f08000c8a50 2023-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07fe7fc700 1 --2- 172.21.15.50:0/489167221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08000c8a50 0x7f0800160a50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f07f0016000 tx=0x7f07f0004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07e77fe700 1 -- 172.21.15.50:0/489167221 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0007000 con 0x7f08000c8a50 2023-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07e77fe700 1 -- 172.21.15.50:0/489167221 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f0012630 con 0x7f08000c8a50 2023-11-28T11:53:43.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07fffff700 1 -- 172.21.15.50:0/489167221 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080006cb30 con 0x7f08000c8a50 2023-11-28T11:53:44.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07e77fe700 1 -- 172.21.15.50:0/489167221 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f00129e0 con 0x7f08000c8a50 2023-11-28T11:53:44.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.993+0000 7f07fffff700 1 -- 172.21.15.50:0/489167221 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080006c850 con 0x7f08000c8a50 2023-11-28T11:53:44.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.997+0000 7f07e77fe700 1 -- 172.21.15.50:0/489167221 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f07f0012b40 con 0x7f08000c8a50 2023-11-28T11:53:44.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.997+0000 7f07fffff700 1 -- 172.21.15.50:0/489167221 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08000adc10 con 0x7f08000c8a50 2023-11-28T11:53:44.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.997+0000 7f07e77fe700 1 --2- 172.21.15.50:0/489167221 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f07ec064ee0 0x7f07ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:44.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.997+0000 7f07e77fe700 1 -- 172.21.15.50:0/489167221 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f07f00847d0 con 0x7f08000c8a50 2023-11-28T11:53:44.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.997+0000 7f07feffd700 1 --2- 172.21.15.50:0/489167221 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f07ec064ee0 0x7f07ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:44.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:43.997+0000 7f07feffd700 1 --2- 172.21.15.50:0/489167221 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f07ec064ee0 0x7f07ec067390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009c10 tx=0x7f07f4009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:44.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:44.009+0000 7f07e77fe700 1 -- 172.21.15.50:0/489167221 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f07f00525b0 con 0x7f08000c8a50 2023-11-28T11:53:44.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:44.169+0000 7f07fffff700 1 -- 172.21.15.50:0/489167221 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f0800072500 con 0x7f08000c8a50 2023-11-28T11:53:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:44.861+0000 7f07e77fe700 1 -- 172.21.15.50:0/489167221 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f07f0055bd0 con 0x7f08000c8a50 2023-11-28T11:53:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:44.869+0000 7f07fffff700 1 -- 172.21.15.50:0/489167221 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f07ec064ee0 msgr2=0x7f07ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:44.869+0000 7f07fffff700 1 --2- 172.21.15.50:0/489167221 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f07ec064ee0 0x7f07ec067390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009c10 tx=0x7f07f4009240 comp rx=0 tx=0).stop 2023-11-28T11:53:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:44.869+0000 7f07fffff700 1 -- 172.21.15.50:0/489167221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08000c8a50 msgr2=0x7f0800160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:44.869+0000 7f07fffff700 1 --2- 172.21.15.50:0/489167221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08000c8a50 0x7f0800160a50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f07f0016000 tx=0x7f07f0004af0 comp rx=0 tx=0).stop 2023-11-28T11:53:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:44.869+0000 7f07fffff700 1 -- 172.21.15.50:0/489167221 shutdown_connections 2023-11-28T11:53:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:44.869+0000 7f07fffff700 1 --2- 172.21.15.50:0/489167221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08000c8eb0 0x7f080008a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:44.869+0000 7f07fffff700 1 --2- 172.21.15.50:0/489167221 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f07ec064ee0 0x7f07ec067390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:44.869+0000 7f07fffff700 1 --2- 172.21.15.50:0/489167221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08000c8a50 0x7f0800160a50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:44.869+0000 7f07fffff700 1 --2- 172.21.15.50:0/489167221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08000ad840 0x7f08001577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:44.869+0000 7f07fffff700 1 -- 172.21.15.50:0/489167221 >> 172.21.15.50:0/489167221 conn(0x7f08000ce400 msgr2=0x7f0800153260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:44.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:44.869+0000 7f07fffff700 1 -- 172.21.15.50:0/489167221 shutdown_connections 2023-11-28T11:53:44.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:44.869+0000 7f07fffff700 1 -- 172.21.15.50:0/489167221 wait complete. 2023-11-28T11:53:44.885 INFO:teuthology.orchestra.run.smithi050.stderr:set pool 5 allow_ec_overwrites to true 2023-11-28T11:53:44.898 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-28T11:53:45.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa542ea8700 1 Processor -- start 2023-11-28T11:53:45.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa542ea8700 1 -- start start 2023-11-28T11:53:45.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa542ea8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa53403e7b0 0x7fa5340553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa542ea8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa534058ba0 0x7fa53400e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa542ea8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53400f280 con 0x7fa53400ee20 2023-11-28T11:53:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa542ea8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa534038950 con 0x7fa534058ba0 2023-11-28T11:53:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa542ea8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5340e6fe0 con 0x7fa53403e7b0 2023-11-28T11:53:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa5416a5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa534058ba0 0x7fa53400e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa5416a5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa534058ba0 0x7fa53400e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36580/0 (socket says 172.21.15.50:36580) 2023-11-28T11:53:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa5416a5700 1 -- 172.21.15.50:0/1541427303 learned_addr learned my addr 172.21.15.50:0/1541427303 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa541ea6700 1 --2- 172.21.15.50:0/1541427303 >> v2:172.21.15.192:3300/0 conn(0x7fa53403e7b0 0x7fa5340553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa5416a5700 1 -- 172.21.15.50:0/1541427303 >> v2:172.21.15.192:3300/0 conn(0x7fa53403e7b0 msgr2=0x7fa5340553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa5416a5700 1 --2- 172.21.15.50:0/1541427303 >> v2:172.21.15.192:3300/0 conn(0x7fa53403e7b0 0x7fa5340553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa5416a5700 1 -- 172.21.15.50:0/1541427303 >> v1:172.21.15.192:6789/0 conn(0x7fa53400ee20 legacy=0x7fa5340060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa5416a5700 1 -- 172.21.15.50:0/1541427303 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5340e72c0 con 0x7fa534058ba0 2023-11-28T11:53:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa541ea6700 1 --2- 172.21.15.50:0/1541427303 >> v2:172.21.15.192:3300/0 conn(0x7fa53403e7b0 0x7fa5340553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:53:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa5416a5700 1 --2- 172.21.15.50:0/1541427303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa534058ba0 0x7fa53400e8e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa534010250 tx=0x7fa52c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c0ba3cdf06d9d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa540ea4700 1 -- 172.21.15.50:0/1541427303 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c00b8a0 con 0x7fa534058ba0 2023-11-28T11:53:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa540ea4700 1 -- 172.21.15.50:0/1541427303 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c00ba00 con 0x7fa534058ba0 2023-11-28T11:53:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.005+0000 7fa540ea4700 1 -- 172.21.15.50:0/1541427303 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c00bd90 con 0x7fa534058ba0 2023-11-28T11:53:45.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.009+0000 7fa542ea8700 1 -- 172.21.15.50:0/1541427303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa534058ba0 msgr2=0x7fa53400e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:45.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.009+0000 7fa542ea8700 1 --2- 172.21.15.50:0/1541427303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa534058ba0 0x7fa53400e8e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa534010250 tx=0x7fa52c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.009+0000 7fa542ea8700 1 -- 172.21.15.50:0/1541427303 shutdown_connections 2023-11-28T11:53:45.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.009+0000 7fa542ea8700 1 --2- 172.21.15.50:0/1541427303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa534058ba0 0x7fa53400e8e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.009+0000 7fa542ea8700 1 --2- 172.21.15.50:0/1541427303 >> v2:172.21.15.192:3300/0 conn(0x7fa53403e7b0 0x7fa5340553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.009+0000 7fa542ea8700 1 -- 172.21.15.50:0/1541427303 >> 172.21.15.50:0/1541427303 conn(0x7fa534059170 msgr2=0x7fa534059570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.009+0000 7fa542ea8700 1 -- 172.21.15.50:0/1541427303 shutdown_connections 2023-11-28T11:53:45.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.009+0000 7fa542ea8700 1 -- 172.21.15.50:0/1541427303 wait complete. 2023-11-28T11:53:45.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.009+0000 7fa542ea8700 1 Processor -- start 2023-11-28T11:53:45.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.009+0000 7fa542ea8700 1 -- start start 2023-11-28T11:53:45.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa542ea8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa53400ee20 0x7fa53403d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa542ea8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa53403e7b0 0x7fa53404ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa542ea8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa534058ba0 0x7fa53404d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa542ea8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53404dbb0 con 0x7fa53403e7b0 2023-11-28T11:53:45.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa542ea8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53404de90 con 0x7fa534058ba0 2023-11-28T11:53:45.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa542ea8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53404e170 con 0x7fa53400ee20 2023-11-28T11:53:45.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa5416a5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa53403e7b0 0x7fa53404ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa5416a5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa53403e7b0 0x7fa53404ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36594/0 (socket says 172.21.15.50:36594) 2023-11-28T11:53:45.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa5416a5700 1 -- 172.21.15.50:0/3638690446 learned_addr learned my addr 172.21.15.50:0/3638690446 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa5426a7700 1 --2- 172.21.15.50:0/3638690446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa534058ba0 0x7fa53404d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa541ea6700 1 --2- 172.21.15.50:0/3638690446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa53400ee20 0x7fa53403d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa5416a5700 1 -- 172.21.15.50:0/3638690446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa53400ee20 msgr2=0x7fa53403d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa5416a5700 1 --2- 172.21.15.50:0/3638690446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa53400ee20 0x7fa53403d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa5416a5700 1 -- 172.21.15.50:0/3638690446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa534058ba0 msgr2=0x7fa53404d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa5416a5700 1 --2- 172.21.15.50:0/3638690446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa534058ba0 0x7fa53404d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa5416a5700 1 -- 172.21.15.50:0/3638690446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c009570 con 0x7fa53403e7b0 2023-11-28T11:53:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa541ea6700 1 --2- 172.21.15.50:0/3638690446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa53400ee20 0x7fa53403d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:53:45.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa5416a5700 1 --2- 172.21.15.50:0/3638690446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa53403e7b0 0x7fa53404ce40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa52c000c00 tx=0x7fa52c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:45.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa5327fc700 1 -- 172.21.15.50:0/3638690446 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c0038c0 con 0x7fa53403e7b0 2023-11-28T11:53:45.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa5327fc700 1 -- 172.21.15.50:0/3638690446 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c01e070 con 0x7fa53403e7b0 2023-11-28T11:53:45.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa542ea8700 1 -- 172.21.15.50:0/3638690446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa534053b40 con 0x7fa53403e7b0 2023-11-28T11:53:45.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa5327fc700 1 -- 172.21.15.50:0/3638690446 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c003c80 con 0x7fa53403e7b0 2023-11-28T11:53:45.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.013+0000 7fa542ea8700 1 -- 172.21.15.50:0/3638690446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa534053860 con 0x7fa53403e7b0 2023-11-28T11:53:45.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.017+0000 7fa542ea8700 1 -- 172.21.15.50:0/3638690446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53403eb80 con 0x7fa53403e7b0 2023-11-28T11:53:45.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.017+0000 7fa5327fc700 1 -- 172.21.15.50:0/3638690446 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa52c00f050 con 0x7fa53403e7b0 2023-11-28T11:53:45.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.017+0000 7fa5327fc700 1 --2- 172.21.15.50:0/3638690446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa520064ee0 0x7fa520067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.017+0000 7fa5327fc700 1 -- 172.21.15.50:0/3638690446 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fa52c020070 con 0x7fa53403e7b0 2023-11-28T11:53:45.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.017+0000 7fa541ea6700 1 --2- 172.21.15.50:0/3638690446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa520064ee0 0x7fa520067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.017+0000 7fa541ea6700 1 --2- 172.21.15.50:0/3638690446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa520064ee0 0x7fa520067390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa538009a10 tx=0x7fa538008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:45.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.025+0000 7fa5327fc700 1 -- 172.21.15.50:0/3638690446 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa52c0517c0 con 0x7fa53403e7b0 2023-11-28T11:53:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.225+0000 7fa542ea8700 1 -- 172.21.15.50:0/3638690446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fa534005550 con 0x7fa53403e7b0 2023-11-28T11:53:45.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.237+0000 7fa5327fc700 1 -- 172.21.15.50:0/3638690446 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fa52c081e60 con 0x7fa53403e7b0 2023-11-28T11:53:45.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.241+0000 7fa542ea8700 1 -- 172.21.15.50:0/3638690446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa520064ee0 msgr2=0x7fa520067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:45.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.241+0000 7fa542ea8700 1 --2- 172.21.15.50:0/3638690446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa520064ee0 0x7fa520067390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa538009a10 tx=0x7fa538008040 comp rx=0 tx=0).stop 2023-11-28T11:53:45.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.241+0000 7fa542ea8700 1 -- 172.21.15.50:0/3638690446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa53403e7b0 msgr2=0x7fa53404ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:45.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.241+0000 7fa542ea8700 1 --2- 172.21.15.50:0/3638690446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa53403e7b0 0x7fa53404ce40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa52c000c00 tx=0x7fa52c004770 comp rx=0 tx=0).stop 2023-11-28T11:53:45.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.241+0000 7fa542ea8700 1 -- 172.21.15.50:0/3638690446 shutdown_connections 2023-11-28T11:53:45.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.241+0000 7fa542ea8700 1 --2- 172.21.15.50:0/3638690446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa520064ee0 0x7fa520067390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.241+0000 7fa542ea8700 1 --2- 172.21.15.50:0/3638690446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa534058ba0 0x7fa53404d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.241+0000 7fa542ea8700 1 --2- 172.21.15.50:0/3638690446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa53403e7b0 0x7fa53404ce40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.241+0000 7fa542ea8700 1 --2- 172.21.15.50:0/3638690446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa53400ee20 0x7fa53403d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.241+0000 7fa542ea8700 1 -- 172.21.15.50:0/3638690446 >> 172.21.15.50:0/3638690446 conn(0x7fa534059170 msgr2=0x7fa534039510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:45.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.241+0000 7fa542ea8700 1 -- 172.21.15.50:0/3638690446 shutdown_connections 2023-11-28T11:53:45.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.241+0000 7fa542ea8700 1 -- 172.21.15.50:0/3638690446 wait complete. 2023-11-28T11:53:45.246 INFO:teuthology.orchestra.run.smithi050.stderr:added data pool 5 to fsmap 2023-11-28T11:53:45.259 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:53:45.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.373+0000 7f0ca6056700 1 Processor -- start 2023-11-28T11:53:45.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.373+0000 7f0ca6056700 1 -- start start 2023-11-28T11:53:45.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.373+0000 7f0ca6056700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ca0158e60 0x7f0ca00c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.373+0000 7f0ca6056700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0ca00cb460 0x7f0ca00cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.373+0000 7f0ca6056700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca00cd8f0 con 0x7f0ca00ad490 2023-11-28T11:53:45.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.373+0000 7f0ca6056700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca00add00 con 0x7f0ca0158e60 2023-11-28T11:53:45.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.373+0000 7f0ca6056700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca00cc4f0 con 0x7f0ca00cb460 2023-11-28T11:53:45.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.373+0000 7f0ca5054700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ca0158e60 0x7f0ca00c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.373+0000 7f0ca5054700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ca0158e60 0x7f0ca00c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36610/0 (socket says 172.21.15.50:36610) 2023-11-28T11:53:45.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.373+0000 7f0ca5054700 1 -- 172.21.15.50:0/4226597137 learned_addr learned my addr 172.21.15.50:0/4226597137 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:45.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.373+0000 7f0ca5855700 1 --2- 172.21.15.50:0/4226597137 >> v2:172.21.15.192:3300/0 conn(0x7f0ca00cb460 0x7f0ca00cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.373+0000 7f0ca5054700 1 -- 172.21.15.50:0/4226597137 >> v2:172.21.15.192:3300/0 conn(0x7f0ca00cb460 msgr2=0x7f0ca00cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:45.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.373+0000 7f0ca5054700 1 --2- 172.21.15.50:0/4226597137 >> v2:172.21.15.192:3300/0 conn(0x7f0ca00cb460 0x7f0ca00cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.373+0000 7f0ca5054700 1 -- 172.21.15.50:0/4226597137 >> v1:172.21.15.192:6789/0 conn(0x7f0ca00ad490 legacy=0x7f0ca00cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:45.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.373+0000 7f0ca5054700 1 -- 172.21.15.50:0/4226597137 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca006dc60 con 0x7f0ca0158e60 2023-11-28T11:53:45.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.373+0000 7f0ca5855700 1 --2- 172.21.15.50:0/4226597137 >> v2:172.21.15.192:3300/0 conn(0x7f0ca00cb460 0x7f0ca00cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:53:45.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.377+0000 7f0ca5054700 1 --2- 172.21.15.50:0/4226597137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca0158e60 0x7f0ca00c8a30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0ca006b820 tx=0x7f0c9800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2683284a3f882e31 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:45.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.377+0000 7f0c97fff700 1 -- 172.21.15.50:0/4226597137 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98010070 con 0x7f0ca0158e60 2023-11-28T11:53:45.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.377+0000 7f0c97fff700 1 -- 172.21.15.50:0/4226597137 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9800dd40 con 0x7f0ca0158e60 2023-11-28T11:53:45.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.377+0000 7f0c97fff700 1 -- 172.21.15.50:0/4226597137 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9800b310 con 0x7f0ca0158e60 2023-11-28T11:53:45.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.377+0000 7f0ca6056700 1 -- 172.21.15.50:0/4226597137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca0158e60 msgr2=0x7f0ca00c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:45.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.377+0000 7f0ca6056700 1 --2- 172.21.15.50:0/4226597137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca0158e60 0x7f0ca00c8a30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0ca006b820 tx=0x7f0c9800d460 comp rx=0 tx=0).stop 2023-11-28T11:53:45.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.377+0000 7f0ca6056700 1 -- 172.21.15.50:0/4226597137 shutdown_connections 2023-11-28T11:53:45.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.377+0000 7f0ca6056700 1 --2- 172.21.15.50:0/4226597137 >> v2:172.21.15.192:3300/0 conn(0x7f0ca00cb460 0x7f0ca00cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.377+0000 7f0ca6056700 1 --2- 172.21.15.50:0/4226597137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca0158e60 0x7f0ca00c8a30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.377+0000 7f0ca6056700 1 -- 172.21.15.50:0/4226597137 >> 172.21.15.50:0/4226597137 conn(0x7f0ca00ce3e0 msgr2=0x7f0ca00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:45.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.377+0000 7f0ca6056700 1 -- 172.21.15.50:0/4226597137 shutdown_connections 2023-11-28T11:53:45.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.377+0000 7f0ca6056700 1 -- 172.21.15.50:0/4226597137 wait complete. 2023-11-28T11:53:45.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca6056700 1 Processor -- start 2023-11-28T11:53:45.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca6056700 1 -- start start 2023-11-28T11:53:45.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca6056700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca00ad490 0x7f0ca00c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca6056700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ca00cb460 0x7f0ca00ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca6056700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca0158e60 0x7f0ca00abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca6056700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00c2fc0 con 0x7f0ca0158e60 2023-11-28T11:53:45.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca6056700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca014d620 con 0x7f0ca00cb460 2023-11-28T11:53:45.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca6056700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca01ed3e0 con 0x7f0ca00ad490 2023-11-28T11:53:45.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca5855700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca0158e60 0x7f0ca00abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca5054700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca00ad490 0x7f0ca00c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca5054700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca00ad490 0x7f0ca00c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:40934/0 (socket says 172.21.15.50:40934) 2023-11-28T11:53:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca5054700 1 -- 172.21.15.50:0/911018677 learned_addr learned my addr 172.21.15.50:0/911018677 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca4853700 1 --2- 172.21.15.50:0/911018677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ca00cb460 0x7f0ca00ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca5855700 1 -- 172.21.15.50:0/911018677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca00ad490 msgr2=0x7f0ca00c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca5855700 1 --2- 172.21.15.50:0/911018677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca00ad490 0x7f0ca00c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca5855700 1 -- 172.21.15.50:0/911018677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ca00cb460 msgr2=0x7f0ca00ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca5855700 1 --2- 172.21.15.50:0/911018677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ca00cb460 0x7f0ca00ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca5855700 1 -- 172.21.15.50:0/911018677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9800bd40 con 0x7f0ca0158e60 2023-11-28T11:53:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.381+0000 7f0ca5855700 1 --2- 172.21.15.50:0/911018677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca0158e60 0x7f0ca00abfb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c7f0 tx=0x7f0c9c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.385+0000 7f0c95ffb700 1 -- 172.21.15.50:0/911018677 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c011800 con 0x7f0ca0158e60 2023-11-28T11:53:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.385+0000 7f0c95ffb700 1 -- 172.21.15.50:0/911018677 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c0119a0 con 0x7f0ca0158e60 2023-11-28T11:53:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.385+0000 7f0c95ffb700 1 -- 172.21.15.50:0/911018677 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c011d50 con 0x7f0ca0158e60 2023-11-28T11:53:45.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.385+0000 7f0ca6056700 1 -- 172.21.15.50:0/911018677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca0159230 con 0x7f0ca0158e60 2023-11-28T11:53:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.385+0000 7f0ca6056700 1 -- 172.21.15.50:0/911018677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca00cde90 con 0x7f0ca0158e60 2023-11-28T11:53:45.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.385+0000 7f0ca6056700 1 -- 172.21.15.50:0/911018677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca006d6a0 con 0x7f0ca0158e60 2023-11-28T11:53:45.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.385+0000 7f0c95ffb700 1 -- 172.21.15.50:0/911018677 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0c9c021070 con 0x7f0ca0158e60 2023-11-28T11:53:45.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.389+0000 7f0c95ffb700 1 --2- 172.21.15.50:0/911018677 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0c84064ee0 0x7f0c84067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.389+0000 7f0c95ffb700 1 -- 172.21.15.50:0/911018677 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0c9c081e70 con 0x7f0ca0158e60 2023-11-28T11:53:45.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.389+0000 7f0ca5054700 1 --2- 172.21.15.50:0/911018677 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0c84064ee0 0x7f0c84067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.389+0000 7f0ca5054700 1 --2- 172.21.15.50:0/911018677 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0c84064ee0 0x7f0c84067390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800d4a0 tx=0x7f0c9800b000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:45.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.397+0000 7f0c95ffb700 1 -- 172.21.15.50:0/911018677 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0c9c04fd20 con 0x7f0ca0158e60 2023-11-28T11:53:45.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.593+0000 7f0ca6056700 1 -- 172.21.15.50:0/911018677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ca0072500 con 0x7f0ca0158e60 2023-11-28T11:53:45.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.597+0000 7f0c95ffb700 1 -- 172.21.15.50:0/911018677 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4647 (secure 0 0 0) 0x7f0c9c053340 con 0x7f0ca0158e60 2023-11-28T11:53:45.601 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:53:45.601 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2457318670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2457318670},{"type":"v1","addr":"172.21.15.192:6836","nonce":2457318670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3448258722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3448258722},{"type":"v1","addr":"172.21.15.192:6837","nonce":3448258722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/490368853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":490368853},{"type":"v1","addr":"172.21.15.50:6833","nonce":490368853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:53:40.797417+0000","modified":"2023-11-28T11:53:45.232271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3764199418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3764199418},{"type":"v1","addr":"172.21.15.50:6835","nonce":3764199418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-28T11:53:45.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.597+0000 7f0ca6056700 1 -- 172.21.15.50:0/911018677 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0c84064ee0 msgr2=0x7f0c84067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:45.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.597+0000 7f0ca6056700 1 --2- 172.21.15.50:0/911018677 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0c84064ee0 0x7f0c84067390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800d4a0 tx=0x7f0c9800b000 comp rx=0 tx=0).stop 2023-11-28T11:53:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.597+0000 7f0ca6056700 1 -- 172.21.15.50:0/911018677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca0158e60 msgr2=0x7f0ca00abfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.597+0000 7f0ca6056700 1 --2- 172.21.15.50:0/911018677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca0158e60 0x7f0ca00abfb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c7f0 tx=0x7f0c9c00cb00 comp rx=0 tx=0).stop 2023-11-28T11:53:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.597+0000 7f0ca6056700 1 -- 172.21.15.50:0/911018677 shutdown_connections 2023-11-28T11:53:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.597+0000 7f0ca6056700 1 --2- 172.21.15.50:0/911018677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca0158e60 0x7f0ca00abfb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.597+0000 7f0ca6056700 1 --2- 172.21.15.50:0/911018677 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0c84064ee0 0x7f0c84067390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.597+0000 7f0ca6056700 1 --2- 172.21.15.50:0/911018677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ca00cb460 0x7f0ca00ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.597+0000 7f0ca6056700 1 --2- 172.21.15.50:0/911018677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca00ad490 0x7f0ca00c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.597+0000 7f0ca6056700 1 -- 172.21.15.50:0/911018677 >> 172.21.15.50:0/911018677 conn(0x7f0ca00ce3e0 msgr2=0x7f0ca006a200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.597+0000 7f0ca6056700 1 -- 172.21.15.50:0/911018677 shutdown_connections 2023-11-28T11:53:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.597+0000 7f0ca6056700 1 -- 172.21.15.50:0/911018677 wait complete. 2023-11-28T11:53:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 7 2023-11-28T11:53:45.615 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:53:45.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a759e700 1 Processor -- start 2023-11-28T11:53:45.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a759e700 1 -- start start 2023-11-28T11:53:45.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a806a330 0x7fb1a80b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb1a80d2780 0x7fb1a80d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a759e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a80cf070 con 0x7fb1a80b1ca0 2023-11-28T11:53:45.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a80d3160 con 0x7fb1a80d2780 2023-11-28T11:53:45.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a80b2070 con 0x7fb1a806a330 2023-11-28T11:53:45.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a6d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb1a80d2780 0x7fb1a80d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a6d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb1a80d2780 0x7fb1a80d2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36634/0 (socket says 172.21.15.50:36634) 2023-11-28T11:53:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a6d9d700 1 -- 172.21.15.50:0/2300099700 learned_addr learned my addr 172.21.15.50:0/2300099700 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb19dd9b700 1 --2- 172.21.15.50:0/2300099700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a806a330 0x7fb1a80b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a6d9d700 1 -- 172.21.15.50:0/2300099700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a806a330 msgr2=0x7fb1a80b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a6d9d700 1 --2- 172.21.15.50:0/2300099700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a806a330 0x7fb1a80b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a6d9d700 1 -- 172.21.15.50:0/2300099700 >> v1:172.21.15.192:6789/0 conn(0x7fb1a80b1ca0 legacy=0x7fb1a80cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a6d9d700 1 -- 172.21.15.50:0/2300099700 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a806a8a0 con 0x7fb1a80d2780 2023-11-28T11:53:45.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a6d9d700 1 --2- 172.21.15.50:0/2300099700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a80d2780 0x7fb1a80d2c20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009e50 tx=0x7fb1a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6e1f1591c0b0f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:45.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a5d9b700 1 -- 172.21.15.50:0/2300099700 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a000e070 con 0x7fb1a80d2780 2023-11-28T11:53:45.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a5d9b700 1 -- 172.21.15.50:0/2300099700 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a000b910 con 0x7fb1a80d2780 2023-11-28T11:53:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a5d9b700 1 -- 172.21.15.50:0/2300099700 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a000bcc0 con 0x7fb1a80d2780 2023-11-28T11:53:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a759e700 1 -- 172.21.15.50:0/2300099700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a80d2780 msgr2=0x7fb1a80d2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a759e700 1 --2- 172.21.15.50:0/2300099700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a80d2780 0x7fb1a80d2c20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009e50 tx=0x7fb1a000b330 comp rx=0 tx=0).stop 2023-11-28T11:53:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a759e700 1 -- 172.21.15.50:0/2300099700 shutdown_connections 2023-11-28T11:53:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a759e700 1 --2- 172.21.15.50:0/2300099700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a80d2780 0x7fb1a80d2c20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a759e700 1 --2- 172.21.15.50:0/2300099700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a806a330 0x7fb1a80b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a759e700 1 -- 172.21.15.50:0/2300099700 >> 172.21.15.50:0/2300099700 conn(0x7fb1a80b5740 msgr2=0x7fb1a80b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a759e700 1 -- 172.21.15.50:0/2300099700 shutdown_connections 2023-11-28T11:53:45.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.729+0000 7fb1a759e700 1 -- 172.21.15.50:0/2300099700 wait complete. 2023-11-28T11:53:45.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb1a759e700 1 Processor -- start 2023-11-28T11:53:45.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb1a759e700 1 -- start start 2023-11-28T11:53:45.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb1a759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a806a330 0x7fb1a80c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb1a759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a80b1ca0 0x7fb1a80c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb1a759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a80d2780 0x7fb1a80b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb1a759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a80c9e00 con 0x7fb1a806a330 2023-11-28T11:53:45.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb1a759e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a80c6580 con 0x7fb1a80b1ca0 2023-11-28T11:53:45.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb1a759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a80ca030 con 0x7fb1a80d2780 2023-11-28T11:53:45.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb1a659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a806a330 0x7fb1a80c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb19dd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a80b1ca0 0x7fb1a80c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb19dd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a80b1ca0 0x7fb1a80c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:34968/0 (socket says 172.21.15.50:34968) 2023-11-28T11:53:45.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb1a6d9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a80d2780 0x7fb1a80b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb19dd9b700 1 -- 172.21.15.50:0/833199234 learned_addr learned my addr 172.21.15.50:0/833199234 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:45.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb1a659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a806a330 0x7fb1a80c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36642/0 (socket says 172.21.15.50:36642) 2023-11-28T11:53:45.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb1a659c700 1 -- 172.21.15.50:0/833199234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a80d2780 msgr2=0x7fb1a80b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:45.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb1a659c700 1 --2- 172.21.15.50:0/833199234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a80d2780 0x7fb1a80b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb1a659c700 1 -- 172.21.15.50:0/833199234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a80b1ca0 msgr2=0x7fb1a80c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:45.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb1a659c700 1 --2- 172.21.15.50:0/833199234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a80b1ca0 0x7fb1a80c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb1a659c700 1 -- 172.21.15.50:0/833199234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a0009b30 con 0x7fb1a806a330 2023-11-28T11:53:45.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.733+0000 7fb19dd9b700 1 --2- 172.21.15.50:0/833199234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a80b1ca0 0x7fb1a80c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:53:45.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.737+0000 7fb1a659c700 1 --2- 172.21.15.50:0/833199234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a806a330 0x7fb1a80c9160 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb19800c410 tx=0x7fb198001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:45.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.737+0000 7fb19f7fe700 1 -- 172.21.15.50:0/833199234 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1980052d0 con 0x7fb1a806a330 2023-11-28T11:53:45.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.737+0000 7fb19f7fe700 1 -- 172.21.15.50:0/833199234 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb198005430 con 0x7fb1a806a330 2023-11-28T11:53:45.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.737+0000 7fb1a759e700 1 -- 172.21.15.50:0/833199234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a806ae60 con 0x7fb1a806a330 2023-11-28T11:53:45.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.737+0000 7fb19f7fe700 1 -- 172.21.15.50:0/833199234 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1980055a0 con 0x7fb1a806a330 2023-11-28T11:53:45.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.737+0000 7fb1a759e700 1 -- 172.21.15.50:0/833199234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a806ab80 con 0x7fb1a806a330 2023-11-28T11:53:45.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.737+0000 7fb1a759e700 1 -- 172.21.15.50:0/833199234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a806b140 con 0x7fb1a806a330 2023-11-28T11:53:45.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.737+0000 7fb19f7fe700 1 -- 172.21.15.50:0/833199234 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb198019030 con 0x7fb1a806a330 2023-11-28T11:53:45.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.737+0000 7fb19f7fe700 1 --2- 172.21.15.50:0/833199234 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb188064ee0 0x7fb188067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:45.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.737+0000 7fb19f7fe700 1 -- 172.21.15.50:0/833199234 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb1980812c0 con 0x7fb1a806a330 2023-11-28T11:53:45.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.737+0000 7fb19dd9b700 1 --2- 172.21.15.50:0/833199234 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb188064ee0 0x7fb188067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:45.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.741+0000 7fb19dd9b700 1 --2- 172.21.15.50:0/833199234 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb188064ee0 0x7fb188067390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80b6e50 tx=0x7fb190009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:45.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.745+0000 7fb19f7fe700 1 -- 172.21.15.50:0/833199234 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb19804f170 con 0x7fb1a806a330 2023-11-28T11:53:45.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.909+0000 7fb1a759e700 1 -- 172.21.15.50:0/833199234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1a8072c20 con 0x7fb1a806a330 2023-11-28T11:53:45.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.913+0000 7fb19f7fe700 1 -- 172.21.15.50:0/833199234 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7fb198052790 con 0x7fb1a806a330 2023-11-28T11:53:45.919 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:53:45.919 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:45.231747+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:53:45.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.917+0000 7fb1a759e700 1 -- 172.21.15.50:0/833199234 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb188064ee0 msgr2=0x7fb188067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:45.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.917+0000 7fb1a759e700 1 --2- 172.21.15.50:0/833199234 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb188064ee0 0x7fb188067390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80b6e50 tx=0x7fb190009240 comp rx=0 tx=0).stop 2023-11-28T11:53:45.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.917+0000 7fb1a759e700 1 -- 172.21.15.50:0/833199234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a806a330 msgr2=0x7fb1a80c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:45.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.917+0000 7fb1a759e700 1 --2- 172.21.15.50:0/833199234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a806a330 0x7fb1a80c9160 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb19800c410 tx=0x7fb198001e70 comp rx=0 tx=0).stop 2023-11-28T11:53:45.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.917+0000 7fb1a759e700 1 -- 172.21.15.50:0/833199234 shutdown_connections 2023-11-28T11:53:45.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.917+0000 7fb1a759e700 1 --2- 172.21.15.50:0/833199234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a80d2780 0x7fb1a80b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.917+0000 7fb1a759e700 1 --2- 172.21.15.50:0/833199234 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb188064ee0 0x7fb188067390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.917+0000 7fb1a759e700 1 --2- 172.21.15.50:0/833199234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a80b1ca0 0x7fb1a80c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.917+0000 7fb1a759e700 1 --2- 172.21.15.50:0/833199234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a806a330 0x7fb1a80c9160 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:45.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.917+0000 7fb1a759e700 1 -- 172.21.15.50:0/833199234 >> 172.21.15.50:0/833199234 conn(0x7fb1a80b5740 msgr2=0x7fb1a815bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:45.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.917+0000 7fb1a759e700 1 -- 172.21.15.50:0/833199234 shutdown_connections 2023-11-28T11:53:45.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:45.917+0000 7fb1a759e700 1 -- 172.21.15.50:0/833199234 wait complete. 2023-11-28T11:53:45.935 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:53:46.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.045+0000 7fd788831700 1 Processor -- start 2023-11-28T11:53:46.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.045+0000 7fd788831700 1 -- start start 2023-11-28T11:53:46.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd788831700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd78406abe0 0x7fd784164cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:46.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd788831700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd78415b340 con 0x7fd78415aec0 2023-11-28T11:53:46.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd788831700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd78415e300 con 0x7fd784154600 2023-11-28T11:53:46.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd788831700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78406ced0 con 0x7fd78406abe0 2023-11-28T11:53:46.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd78259c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd78415aec0 0x7fd78406a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38892/0 (socket says 172.21.15.50:38892) 2023-11-28T11:53:46.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd78259c700 1 -- 172.21.15.50:0/2797822800 learned_addr learned my addr 172.21.15.50:0/2797822800 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:46.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd78359e700 1 --2- 172.21.15.50:0/2797822800 >> v2:172.21.15.192:3300/0 conn(0x7fd78406abe0 0x7fd784164cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:46.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd781d9b700 1 -- 172.21.15.50:0/2797822800 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318897569 0 0) 0x7fd778001110 con 0x7fd78415aec0 2023-11-28T11:53:46.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd781d9b700 1 -- 172.21.15.50:0/2797822800 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd76c0035d0 con 0x7fd78415aec0 2023-11-28T11:53:46.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd78359e700 1 -- 172.21.15.50:0/2797822800 >> v1:172.21.15.192:6789/0 conn(0x7fd784154600 legacy=0x7fd78406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:46.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd78359e700 1 -- 172.21.15.50:0/2797822800 >> v1:172.21.15.50:6789/0 conn(0x7fd78415aec0 legacy=0x7fd78406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:46.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd78359e700 1 -- 172.21.15.50:0/2797822800 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78415c510 con 0x7fd78406abe0 2023-11-28T11:53:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd78359e700 1 --2- 172.21.15.50:0/2797822800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd78406abe0 0x7fd784164cc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009d90 tx=0x7fd77c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1465e0e807c02d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd781d9b700 1 -- 172.21.15.50:0/2797822800 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c00e070 con 0x7fd78406abe0 2023-11-28T11:53:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd781d9b700 1 -- 172.21.15.50:0/2797822800 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c00bb20 con 0x7fd78406abe0 2023-11-28T11:53:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd781d9b700 1 -- 172.21.15.50:0/2797822800 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c012430 con 0x7fd78406abe0 2023-11-28T11:53:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd788831700 1 -- 172.21.15.50:0/2797822800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd78406abe0 msgr2=0x7fd784164cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd788831700 1 --2- 172.21.15.50:0/2797822800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd78406abe0 0x7fd784164cc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009d90 tx=0x7fd77c00b330 comp rx=0 tx=0).stop 2023-11-28T11:53:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd788831700 1 -- 172.21.15.50:0/2797822800 shutdown_connections 2023-11-28T11:53:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd788831700 1 --2- 172.21.15.50:0/2797822800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd78406abe0 0x7fd784164cc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd788831700 1 -- 172.21.15.50:0/2797822800 >> 172.21.15.50:0/2797822800 conn(0x7fd78406ec40 msgr2=0x7fd7840b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd788831700 1 -- 172.21.15.50:0/2797822800 shutdown_connections 2023-11-28T11:53:46.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.049+0000 7fd788831700 1 -- 172.21.15.50:0/2797822800 wait complete. 2023-11-28T11:53:46.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd788831700 1 Processor -- start 2023-11-28T11:53:46.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd788831700 1 -- start start 2023-11-28T11:53:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd788831700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78406abe0 0x7fd7840b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd788831700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd78415aec0 0x7fd7840b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd788831700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd784159080 0x7fd7841f0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd788831700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7841511d0 con 0x7fd78406abe0 2023-11-28T11:53:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd788831700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7840b47e0 con 0x7fd78415aec0 2023-11-28T11:53:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd788831700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7840b3c60 con 0x7fd784159080 2023-11-28T11:53:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd782d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78406abe0 0x7fd7840b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:46.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd782d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78406abe0 0x7fd7840b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36644/0 (socket says 172.21.15.50:36644) 2023-11-28T11:53:46.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd782d9d700 1 -- 172.21.15.50:0/4089947412 learned_addr learned my addr 172.21.15.50:0/4089947412 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:46.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd78259c700 1 --2- 172.21.15.50:0/4089947412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd78415aec0 0x7fd7840b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:46.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd78359e700 1 --2- 172.21.15.50:0/4089947412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd784159080 0x7fd7841f0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:46.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd782d9d700 1 -- 172.21.15.50:0/4089947412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd784159080 msgr2=0x7fd7841f0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:46.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd782d9d700 1 --2- 172.21.15.50:0/4089947412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd784159080 0x7fd7841f0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:46.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd782d9d700 1 -- 172.21.15.50:0/4089947412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd78415aec0 msgr2=0x7fd7840b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:46.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd782d9d700 1 --2- 172.21.15.50:0/4089947412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd78415aec0 0x7fd7840b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:46.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.053+0000 7fd782d9d700 1 -- 172.21.15.50:0/4089947412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c009a70 con 0x7fd78406abe0 2023-11-28T11:53:46.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.057+0000 7fd782d9d700 1 --2- 172.21.15.50:0/4089947412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78406abe0 0x7fd7840b3680 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd77400c500 tx=0x7fd77400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:46.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.057+0000 7fd76b7fe700 1 -- 172.21.15.50:0/4089947412 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7740052d0 con 0x7fd78406abe0 2023-11-28T11:53:46.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.057+0000 7fd76b7fe700 1 -- 172.21.15.50:0/4089947412 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd774005430 con 0x7fd78406abe0 2023-11-28T11:53:46.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.057+0000 7fd788831700 1 -- 172.21.15.50:0/4089947412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78415dcb0 con 0x7fd78406abe0 2023-11-28T11:53:46.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.057+0000 7fd76b7fe700 1 -- 172.21.15.50:0/4089947412 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7740055a0 con 0x7fd78406abe0 2023-11-28T11:53:46.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.057+0000 7fd788831700 1 -- 172.21.15.50:0/4089947412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78415d9d0 con 0x7fd78406abe0 2023-11-28T11:53:46.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.057+0000 7fd788831700 1 -- 172.21.15.50:0/4089947412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78415df90 con 0x7fd78406abe0 2023-11-28T11:53:46.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.057+0000 7fd76b7fe700 1 -- 172.21.15.50:0/4089947412 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd774019030 con 0x7fd78406abe0 2023-11-28T11:53:46.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.057+0000 7fd76b7fe700 1 --2- 172.21.15.50:0/4089947412 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd770064f10 0x7fd7700673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:46.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.061+0000 7fd76b7fe700 1 -- 172.21.15.50:0/4089947412 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd7740814c0 con 0x7fd78406abe0 2023-11-28T11:53:46.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.061+0000 7fd78259c700 1 --2- 172.21.15.50:0/4089947412 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd770064f10 0x7fd7700673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:46.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.061+0000 7fd78259c700 1 --2- 172.21.15.50:0/4089947412 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd770064f10 0x7fd7700673c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd784150210 tx=0x7fd778007c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:46.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.065+0000 7fd76b7fe700 1 -- 172.21.15.50:0/4089947412 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd77404f280 con 0x7fd78406abe0 2023-11-28T11:53:46.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.229+0000 7fd788831700 1 -- 172.21.15.50:0/4089947412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7840cd1e0 con 0x7fd78406abe0 2023-11-28T11:53:46.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.233+0000 7fd76b7fe700 1 -- 172.21.15.50:0/4089947412 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7fd7840cd1e0 con 0x7fd78406abe0 2023-11-28T11:53:46.238 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:53:46.239 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:45.231747+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:53:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.237+0000 7fd788831700 1 -- 172.21.15.50:0/4089947412 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd770064f10 msgr2=0x7fd7700673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.237+0000 7fd788831700 1 --2- 172.21.15.50:0/4089947412 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd770064f10 0x7fd7700673c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd784150210 tx=0x7fd778007c60 comp rx=0 tx=0).stop 2023-11-28T11:53:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.237+0000 7fd788831700 1 -- 172.21.15.50:0/4089947412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78406abe0 msgr2=0x7fd7840b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.237+0000 7fd788831700 1 --2- 172.21.15.50:0/4089947412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78406abe0 0x7fd7840b3680 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd77400c500 tx=0x7fd77400c810 comp rx=0 tx=0).stop 2023-11-28T11:53:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.237+0000 7fd788831700 1 -- 172.21.15.50:0/4089947412 shutdown_connections 2023-11-28T11:53:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.237+0000 7fd788831700 1 --2- 172.21.15.50:0/4089947412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd784159080 0x7fd7841f0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.237+0000 7fd788831700 1 --2- 172.21.15.50:0/4089947412 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd770064f10 0x7fd7700673c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.237+0000 7fd788831700 1 --2- 172.21.15.50:0/4089947412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd78415aec0 0x7fd7840b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.237+0000 7fd788831700 1 --2- 172.21.15.50:0/4089947412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78406abe0 0x7fd7840b3680 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.237+0000 7fd788831700 1 -- 172.21.15.50:0/4089947412 >> 172.21.15.50:0/4089947412 conn(0x7fd78406ec40 msgr2=0x7fd7840c5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:46.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.237+0000 7fd788831700 1 -- 172.21.15.50:0/4089947412 shutdown_connections 2023-11-28T11:53:46.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.237+0000 7fd788831700 1 -- 172.21.15.50:0/4089947412 wait complete. 2023-11-28T11:53:46.268 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:53:46.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.381+0000 7f94bb133700 1 Processor -- start 2023-11-28T11:53:46.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.381+0000 7f94bb133700 1 -- start start 2023-11-28T11:53:46.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.381+0000 7f94bb133700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94b4153420 0x7f94b40c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:46.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.381+0000 7f94bb133700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f94b41537f0 0x7f94b40ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:46.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.381+0000 7f94bb133700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b40cad30 con 0x7f94b415cb50 2023-11-28T11:53:46.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.381+0000 7f94bb133700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b40cdda0 con 0x7f94b4153420 2023-11-28T11:53:46.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.381+0000 7f94bb133700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b40b0cd0 con 0x7f94b41537f0 2023-11-28T11:53:46.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.381+0000 7f94b8ecf700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94b4153420 0x7f94b40c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:46.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.381+0000 7f94b8ecf700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94b4153420 0x7f94b40c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36650/0 (socket says 172.21.15.50:36650) 2023-11-28T11:53:46.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.381+0000 7f94b8ecf700 1 -- 172.21.15.50:0/515669506 learned_addr learned my addr 172.21.15.50:0/515669506 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:46.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.381+0000 7f94b3fff700 1 --2- 172.21.15.50:0/515669506 >> v2:172.21.15.192:3300/0 conn(0x7f94b41537f0 0x7f94b40ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:46.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.381+0000 7f94b8ecf700 1 -- 172.21.15.50:0/515669506 >> v2:172.21.15.192:3300/0 conn(0x7f94b41537f0 msgr2=0x7f94b40ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:46.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.381+0000 7f94b8ecf700 1 --2- 172.21.15.50:0/515669506 >> v2:172.21.15.192:3300/0 conn(0x7f94b41537f0 0x7f94b40ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:46.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.385+0000 7f94b8ecf700 1 -- 172.21.15.50:0/515669506 >> v1:172.21.15.192:6789/0 conn(0x7f94b415cb50 legacy=0x7f94b415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:46.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.385+0000 7f94b8ecf700 1 -- 172.21.15.50:0/515669506 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b40caa00 con 0x7f94b4153420 2023-11-28T11:53:46.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.385+0000 7f94b8ecf700 1 --2- 172.21.15.50:0/515669506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b4153420 0x7f94b40c8f50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f94b406faa0 tx=0x7f94a8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0efbb85124eec3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:46.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.385+0000 7f94b37fe700 1 -- 172.21.15.50:0/515669506 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8011830 con 0x7f94b4153420 2023-11-28T11:53:46.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.385+0000 7f94b37fe700 1 -- 172.21.15.50:0/515669506 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a8011990 con 0x7f94b4153420 2023-11-28T11:53:46.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.385+0000 7f94b37fe700 1 -- 172.21.15.50:0/515669506 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8011d20 con 0x7f94b4153420 2023-11-28T11:53:46.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.385+0000 7f94bb133700 1 -- 172.21.15.50:0/515669506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b4153420 msgr2=0x7f94b40c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:46.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.385+0000 7f94bb133700 1 --2- 172.21.15.50:0/515669506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b4153420 0x7f94b40c8f50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f94b406faa0 tx=0x7f94a8009bf0 comp rx=0 tx=0).stop 2023-11-28T11:53:46.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.385+0000 7f94bb133700 1 -- 172.21.15.50:0/515669506 shutdown_connections 2023-11-28T11:53:46.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.385+0000 7f94bb133700 1 --2- 172.21.15.50:0/515669506 >> v2:172.21.15.192:3300/0 conn(0x7f94b41537f0 0x7f94b40ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:46.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.385+0000 7f94bb133700 1 --2- 172.21.15.50:0/515669506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b4153420 0x7f94b40c8f50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:46.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.385+0000 7f94bb133700 1 -- 172.21.15.50:0/515669506 >> 172.21.15.50:0/515669506 conn(0x7f94b406caf0 msgr2=0x7f94b40ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:46.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.385+0000 7f94bb133700 1 -- 172.21.15.50:0/515669506 shutdown_connections 2023-11-28T11:53:46.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.385+0000 7f94bb133700 1 -- 172.21.15.50:0/515669506 wait complete. 2023-11-28T11:53:46.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.385+0000 7f94bb133700 1 Processor -- start 2023-11-28T11:53:46.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.385+0000 7f94bb133700 1 -- start start 2023-11-28T11:53:46.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94bb133700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b4153420 0x7f94b4165ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:46.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94bb133700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94b41537f0 0x7f94b41471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:46.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94bb133700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94b415cb50 0x7f94b415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:46.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94bb133700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b4147a80 con 0x7f94b4153420 2023-11-28T11:53:46.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94bb133700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40b16e0 con 0x7f94b415cb50 2023-11-28T11:53:46.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94bb133700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40b2260 con 0x7f94b41537f0 2023-11-28T11:53:46.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94b8ecf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b4153420 0x7f94b4165ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:46.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94b8ecf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b4153420 0x7f94b4165ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36658/0 (socket says 172.21.15.50:36658) 2023-11-28T11:53:46.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94b8ecf700 1 -- 172.21.15.50:0/964772095 learned_addr learned my addr 172.21.15.50:0/964772095 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:46.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94b96d0700 1 --2- 172.21.15.50:0/964772095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94b415cb50 0x7f94b415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:46.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94b3fff700 1 --2- 172.21.15.50:0/964772095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94b41537f0 0x7f94b41471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:46.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94b8ecf700 1 -- 172.21.15.50:0/964772095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94b41537f0 msgr2=0x7f94b41471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:46.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94b8ecf700 1 --2- 172.21.15.50:0/964772095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94b41537f0 0x7f94b41471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:46.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94b8ecf700 1 -- 172.21.15.50:0/964772095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94b415cb50 msgr2=0x7f94b415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:46.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94b8ecf700 1 --2- 172.21.15.50:0/964772095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94b415cb50 0x7f94b415cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:46.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94b8ecf700 1 -- 172.21.15.50:0/964772095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a8009570 con 0x7f94b4153420 2023-11-28T11:53:46.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94b8ecf700 1 --2- 172.21.15.50:0/964772095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b4153420 0x7f94b4165ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009f40 tx=0x7f94a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:46.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94b17fa700 1 -- 172.21.15.50:0/964772095 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8004450 con 0x7f94b4153420 2023-11-28T11:53:46.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94b17fa700 1 -- 172.21.15.50:0/964772095 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a801f070 con 0x7f94b4153420 2023-11-28T11:53:46.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94b17fa700 1 -- 172.21.15.50:0/964772095 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8003900 con 0x7f94b4153420 2023-11-28T11:53:46.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94bb133700 1 -- 172.21.15.50:0/964772095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b40b0f70 con 0x7f94b4153420 2023-11-28T11:53:46.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94bb133700 1 -- 172.21.15.50:0/964772095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b40ce590 con 0x7f94b4153420 2023-11-28T11:53:46.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.389+0000 7f94bb133700 1 -- 172.21.15.50:0/964772095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b40b1250 con 0x7f94b4153420 2023-11-28T11:53:46.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.393+0000 7f94b17fa700 1 -- 172.21.15.50:0/964772095 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f94a800f050 con 0x7f94b4153420 2023-11-28T11:53:46.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.393+0000 7f94b17fa700 1 --2- 172.21.15.50:0/964772095 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9498064ee0 0x7f9498067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:46.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.393+0000 7f94b17fa700 1 -- 172.21.15.50:0/964772095 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f94a8021070 con 0x7f94b4153420 2023-11-28T11:53:46.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.393+0000 7f94b3fff700 1 --2- 172.21.15.50:0/964772095 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9498064ee0 0x7f9498067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:46.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.393+0000 7f94b3fff700 1 --2- 172.21.15.50:0/964772095 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9498064ee0 0x7f9498067390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f94b40cc7a0 tx=0x7f94a0009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:46.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.397+0000 7f94b17fa700 1 -- 172.21.15.50:0/964772095 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f94a8051480 con 0x7f94b4153420 2023-11-28T11:53:46.502 INFO:tasks.ceph.mds.c.smithi050.stderr:2023-11-28T11:53:46.497+0000 7fab8c263700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:53:46.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.597+0000 7f94bb133700 1 -- 172.21.15.50:0/964772095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94b4072500 con 0x7f94b4153420 2023-11-28T11:53:46.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.601+0000 7f94b17fa700 1 -- 172.21.15.50:0/964772095 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4647 (secure 0 0 0) 0x7f94a802a090 con 0x7f94b4153420 2023-11-28T11:53:46.604 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:53:46.604 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2457318670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2457318670},{"type":"v1","addr":"172.21.15.192:6836","nonce":2457318670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3448258722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3448258722},{"type":"v1","addr":"172.21.15.192:6837","nonce":3448258722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/490368853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":490368853},{"type":"v1","addr":"172.21.15.50:6833","nonce":490368853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:53:40.797417+0000","modified":"2023-11-28T11:53:45.232271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3764199418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3764199418},{"type":"v1","addr":"172.21.15.50:6835","nonce":3764199418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-28T11:53:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.601+0000 7f94bb133700 1 -- 172.21.15.50:0/964772095 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9498064ee0 msgr2=0x7f9498067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.601+0000 7f94bb133700 1 --2- 172.21.15.50:0/964772095 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9498064ee0 0x7f9498067390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f94b40cc7a0 tx=0x7f94a0009240 comp rx=0 tx=0).stop 2023-11-28T11:53:46.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.601+0000 7f94bb133700 1 -- 172.21.15.50:0/964772095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b4153420 msgr2=0x7f94b4165ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:46.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.601+0000 7f94bb133700 1 --2- 172.21.15.50:0/964772095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b4153420 0x7f94b4165ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009f40 tx=0x7f94a8004770 comp rx=0 tx=0).stop 2023-11-28T11:53:46.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.601+0000 7f94bb133700 1 -- 172.21.15.50:0/964772095 shutdown_connections 2023-11-28T11:53:46.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.601+0000 7f94bb133700 1 --2- 172.21.15.50:0/964772095 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9498064ee0 0x7f9498067390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:46.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.601+0000 7f94bb133700 1 --2- 172.21.15.50:0/964772095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94b415cb50 0x7f94b415cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:46.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.601+0000 7f94bb133700 1 --2- 172.21.15.50:0/964772095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94b41537f0 0x7f94b41471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:46.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.601+0000 7f94bb133700 1 --2- 172.21.15.50:0/964772095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b4153420 0x7f94b4165ad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:46.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.601+0000 7f94bb133700 1 -- 172.21.15.50:0/964772095 >> 172.21.15.50:0/964772095 conn(0x7f94b406caf0 msgr2=0x7f94b40c3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:46.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.601+0000 7f94bb133700 1 -- 172.21.15.50:0/964772095 shutdown_connections 2023-11-28T11:53:46.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:46.601+0000 7f94bb133700 1 -- 172.21.15.50:0/964772095 wait complete. 2023-11-28T11:53:46.608 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 7 2023-11-28T11:53:47.021 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T11:53:40.797417+0000', 'modified': '2023-11-28T11:53:45.232271+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/3764199418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 3764199418}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 3764199418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-11-28T11:53:47.021 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T11:53:47.022 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-28T11:53:47.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.145+0000 7f5e70b83700 1 Processor -- start 2023-11-28T11:53:47.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.145+0000 7f5e70b83700 1 -- start start 2023-11-28T11:53:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.145+0000 7f5e70b83700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5e6c0cc730 0x7f5e6c0ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.145+0000 7f5e70b83700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e6c1594f0 0x7f5e6c159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.145+0000 7f5e70b83700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6c0cd720 con 0x7f5e6c15d650 2023-11-28T11:53:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.145+0000 7f5e70b83700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6c0cd990 con 0x7f5e6c0cc730 2023-11-28T11:53:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.145+0000 7f5e70b83700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c0cdc70 con 0x7f5e6c1594f0 2023-11-28T11:53:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.145+0000 7f5e63fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5e6c0cc730 0x7f5e6c0ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.145+0000 7f5e63fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5e6c0cc730 0x7f5e6c0ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36662/0 (socket says 172.21.15.50:36662) 2023-11-28T11:53:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.145+0000 7f5e63fff700 1 -- 172.21.15.50:0/255660053 learned_addr learned my addr 172.21.15.50:0/255660053 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:47.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.145+0000 7f5e6bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e6c1594f0 0x7f5e6c159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.145+0000 7f5e63fff700 1 -- 172.21.15.50:0/255660053 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e6c1594f0 msgr2=0x7f5e6c159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:47.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.145+0000 7f5e63fff700 1 --2- 172.21.15.50:0/255660053 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e6c1594f0 0x7f5e6c159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.145+0000 7f5e63fff700 1 -- 172.21.15.50:0/255660053 >> v1:172.21.15.192:6789/0 conn(0x7f5e6c15d650 legacy=0x7f5e6c0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:47.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.145+0000 7f5e6affd700 1 -- 172.21.15.50:0/255660053 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580911187 0 0) 0x7f5e6c0cd720 con 0x7f5e6c15d650 2023-11-28T11:53:47.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.145+0000 7f5e63fff700 1 -- 172.21.15.50:0/255660053 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c0cdf50 con 0x7f5e6c0cc730 2023-11-28T11:53:47.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.145+0000 7f5e63fff700 1 --2- 172.21.15.50:0/255660053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e6c0cc730 0x7f5e6c0ce470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009910 tx=0x7f5e54009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c173c88a2dc598 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:47.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.149+0000 7f5e6affd700 1 -- 172.21.15.50:0/255660053 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54011830 con 0x7f5e6c0cc730 2023-11-28T11:53:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.149+0000 7f5e6affd700 1 -- 172.21.15.50:0/255660053 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e54011990 con 0x7f5e6c0cc730 2023-11-28T11:53:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.149+0000 7f5e6affd700 1 -- 172.21.15.50:0/255660053 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54011d40 con 0x7f5e6c0cc730 2023-11-28T11:53:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.149+0000 7f5e70b83700 1 -- 172.21.15.50:0/255660053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e6c0cc730 msgr2=0x7f5e6c0ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.149+0000 7f5e70b83700 1 --2- 172.21.15.50:0/255660053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e6c0cc730 0x7f5e6c0ce470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009910 tx=0x7f5e54009c20 comp rx=0 tx=0).stop 2023-11-28T11:53:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.149+0000 7f5e70b83700 1 -- 172.21.15.50:0/255660053 shutdown_connections 2023-11-28T11:53:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.149+0000 7f5e70b83700 1 --2- 172.21.15.50:0/255660053 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e6c1594f0 0x7f5e6c159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.149+0000 7f5e70b83700 1 --2- 172.21.15.50:0/255660053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e6c0cc730 0x7f5e6c0ce470 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.149+0000 7f5e70b83700 1 -- 172.21.15.50:0/255660053 >> 172.21.15.50:0/255660053 conn(0x7f5e6c06ec40 msgr2=0x7f5e6c0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.149+0000 7f5e70b83700 1 -- 172.21.15.50:0/255660053 shutdown_connections 2023-11-28T11:53:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.149+0000 7f5e70b83700 1 -- 172.21.15.50:0/255660053 wait complete. 2023-11-28T11:53:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.149+0000 7f5e70b83700 1 Processor -- start 2023-11-28T11:53:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.149+0000 7f5e70b83700 1 -- start start 2023-11-28T11:53:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e70b83700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e6c0cc730 0x7f5e6c14f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e70b83700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e6c1594f0 0x7f5e6c0b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e70b83700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e6c15d650 0x7f5e6c0c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e70b83700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c14f6c0 con 0x7f5e6c15d650 2023-11-28T11:53:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e70b83700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c0c3120 con 0x7f5e6c1594f0 2023-11-28T11:53:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e70b83700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c0c3400 con 0x7f5e6c0cc730 2023-11-28T11:53:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e6bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e6c15d650 0x7f5e6c0c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e6bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e6c15d650 0x7f5e6c0c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36676/0 (socket says 172.21.15.50:36676) 2023-11-28T11:53:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e6bfff700 1 -- 172.21.15.50:0/447221263 learned_addr learned my addr 172.21.15.50:0/447221263 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e63fff700 1 --2- 172.21.15.50:0/447221263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e6c1594f0 0x7f5e6c0b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e6b7fe700 1 --2- 172.21.15.50:0/447221263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e6c0cc730 0x7f5e6c14f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e6bfff700 1 -- 172.21.15.50:0/447221263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e6c0cc730 msgr2=0x7f5e6c14f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e6bfff700 1 --2- 172.21.15.50:0/447221263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e6c0cc730 0x7f5e6c14f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e6bfff700 1 -- 172.21.15.50:0/447221263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e6c1594f0 msgr2=0x7f5e6c0b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e6bfff700 1 --2- 172.21.15.50:0/447221263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e6c1594f0 0x7f5e6c0b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e6bfff700 1 -- 172.21.15.50:0/447221263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54009570 con 0x7f5e6c15d650 2023-11-28T11:53:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e6b7fe700 1 --2- 172.21.15.50:0/447221263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e6c0cc730 0x7f5e6c14f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:53:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e6bfff700 1 --2- 172.21.15.50:0/447221263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e6c15d650 0x7f5e6c0c6f10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400efc0 tx=0x7f5e6400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e68ff9700 1 -- 172.21.15.50:0/447221263 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64009ea0 con 0x7f5e6c15d650 2023-11-28T11:53:47.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e68ff9700 1 -- 172.21.15.50:0/447221263 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6400f040 con 0x7f5e6c15d650 2023-11-28T11:53:47.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e70b83700 1 -- 172.21.15.50:0/447221263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6c159e90 con 0x7f5e6c15d650 2023-11-28T11:53:47.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e68ff9700 1 -- 172.21.15.50:0/447221263 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64014480 con 0x7f5e6c15d650 2023-11-28T11:53:47.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.153+0000 7f5e70b83700 1 -- 172.21.15.50:0/447221263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6c15a250 con 0x7f5e6c15d650 2023-11-28T11:53:47.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e68ff9700 1 -- 172.21.15.50:0/447221263 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5e640145e0 con 0x7f5e6c15d650 2023-11-28T11:53:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e68ff9700 1 --2- 172.21.15.50:0/447221263 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5e4c064ee0 0x7f5e4c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e68ff9700 1 -- 172.21.15.50:0/447221263 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e64082c60 con 0x7f5e6c15d650 2023-11-28T11:53:47.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e6b7fe700 1 --2- 172.21.15.50:0/447221263 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5e4c064ee0 0x7f5e4c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e75065740 1 Processor -- start 2023-11-28T11:53:47.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e6b7fe700 1 --2- 172.21.15.50:0/447221263 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5e4c064ee0 0x7f5e4c067390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c000f60 tx=0x7f5e5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:47.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e75065740 1 -- start start 2023-11-28T11:53:47.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e75065740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191eae0 0x1bcee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e75065740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x191e710 0x1bcf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e75065740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1bcf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e75065740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a8dae0 con 0x1969790 2023-11-28T11:53:47.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e75065740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x1afdbd0 con 0x191e710 2023-11-28T11:53:47.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e75065740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1af6ed0 con 0x191eae0 2023-11-28T11:53:47.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e6bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1bcf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e6bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1bcf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36682/0 (socket says 172.21.15.50:36682) 2023-11-28T11:53:47.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e6bfff700 1 -- 172.21.15.50:0/3282966867 learned_addr learned my addr 172.21.15.50:0/3282966867 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:47.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e6b7fe700 1 --2- 172.21.15.50:0/3282966867 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191eae0 0x1bcee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.157+0000 7f5e63fff700 1 --2- 172.21.15.50:0/3282966867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x191e710 0x1bcf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e6bfff700 1 -- 172.21.15.50:0/3282966867 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191eae0 msgr2=0x1bcee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:47.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e6bfff700 1 --2- 172.21.15.50:0/3282966867 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191eae0 0x1bcee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e6bfff700 1 -- 172.21.15.50:0/3282966867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x191e710 msgr2=0x1bcf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:47.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e6bfff700 1 --2- 172.21.15.50:0/3282966867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x191e710 0x1bcf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e6bfff700 1 -- 172.21.15.50:0/3282966867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1b1ccc0 con 0x1969790 2023-11-28T11:53:47.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e6bfff700 1 --2- 172.21.15.50:0/3282966867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1bcf880 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5e64009d50 tx=0x7f5e6405c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eadedf1ff09da24e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:47.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e617fa700 1 -- 172.21.15.50:0/3282966867 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6405a2c0 con 0x1969790 2023-11-28T11:53:47.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e617fa700 1 -- 172.21.15.50:0/3282966867 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e64067e90 con 0x1969790 2023-11-28T11:53:47.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e617fa700 1 -- 172.21.15.50:0/3282966867 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6405c550 con 0x1969790 2023-11-28T11:53:47.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e75065740 1 -- 172.21.15.50:0/3282966867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 msgr2=0x1bcf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:47.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e75065740 1 --2- 172.21.15.50:0/3282966867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1bcf880 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5e64009d50 tx=0x7f5e6405c8b0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e75065740 1 -- 172.21.15.50:0/3282966867 shutdown_connections 2023-11-28T11:53:47.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e75065740 1 --2- 172.21.15.50:0/3282966867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1bcf880 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e75065740 1 --2- 172.21.15.50:0/3282966867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x191e710 0x1bcf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e75065740 1 --2- 172.21.15.50:0/3282966867 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191eae0 0x1bcee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e75065740 1 -- 172.21.15.50:0/3282966867 >> 172.21.15.50:0/3282966867 conn(0x191eeb0 msgr2=0x1bb7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e75065740 1 -- 172.21.15.50:0/3282966867 shutdown_connections 2023-11-28T11:53:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e75065740 1 -- 172.21.15.50:0/3282966867 wait complete. 2023-11-28T11:53:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e75065740 1 -- start start 2023-11-28T11:53:47.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.161+0000 7f5e75065740 1 Processor -- start 2023-11-28T11:53:47.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e75065740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x191e710 0x1bb6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e75065740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191eae0 0x1ba70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e75065740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1ba7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e75065740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x19a3b20 con 0x1969790 2023-11-28T11:53:47.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e75065740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ba89f0 con 0x191e710 2023-11-28T11:53:47.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e75065740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ba8c90 con 0x191eae0 2023-11-28T11:53:47.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e75065740 10 client.0 _ll_register_callbacks cb 0x1b530d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:53:47.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e6bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1ba7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e63fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191eae0 0x1ba70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e6bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1ba7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36686/0 (socket says 172.21.15.50:36686) 2023-11-28T11:53:47.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e6b7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x191e710 0x1bb6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e6bfff700 1 -- 172.21.15.50:0/1587206401 learned_addr learned my addr 172.21.15.50:0/1587206401 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:47.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e6bfff700 1 -- 172.21.15.50:0/1587206401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191eae0 msgr2=0x1ba70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:47.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e6bfff700 1 --2- 172.21.15.50:0/1587206401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191eae0 0x1ba70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e6bfff700 1 -- 172.21.15.50:0/1587206401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x191e710 msgr2=0x1bb6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:47.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e6bfff700 1 --2- 172.21.15.50:0/1587206401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x191e710 0x1bb6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e6bfff700 1 -- 172.21.15.50:0/1587206401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6c15a250 con 0x1969790 2023-11-28T11:53:47.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e6bfff700 1 --2- 172.21.15.50:0/1587206401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1ba7610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5e64054400 tx=0x7f5e64013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10729900e56c0fd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:47.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e4a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:53:47.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e4a7fc700 1 -- 172.21.15.50:0/1587206401 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64050a90 con 0x1969790 2023-11-28T11:53:47.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e4a7fc700 1 -- 172.21.15.50:0/1587206401 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e64055ae0 con 0x1969790 2023-11-28T11:53:47.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e75065740 1 -- 172.21.15.50:0/1587206401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1aeff50 con 0x1969790 2023-11-28T11:53:47.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e4a7fc700 1 -- 172.21.15.50:0/1587206401 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e64055cc0 con 0x1969790 2023-11-28T11:53:47.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e75065740 10 client.4413 fetch_fsmap learned FSMap version 7 2023-11-28T11:53:47.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e75065740 1 -- 172.21.15.50:0/1587206401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x196a9e0 con 0x1969790 2023-11-28T11:53:47.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e4a7fc700 1 -- 172.21.15.50:0/1587206401 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1aeff50 con 0x1969790 2023-11-28T11:53:47.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e4a7fc700 1 -- 172.21.15.50:0/1587206401 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5e64050540 con 0x1969790 2023-11-28T11:53:47.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e75065740 10 client.4413 fetch_fsmap finished waiting for FSMap version 7 2023-11-28T11:53:47.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e75065740 10 client.4413 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T11:53:47.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e75065740 20 client.4413 populate_metadata read hostname 'smithi050' 2023-11-28T11:53:47.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e75065740 1 --2- 172.21.15.50:0/1587206401 >> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] conn(0x1bb72d0 0x1baa170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e75065740 4 client.4413 mds_command: new command op to 4260 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:53:47.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e75065740 1 -- 172.21.15.50:0/1587206401 --> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1aefc70 con 0x1bb72d0 2023-11-28T11:53:47.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e6b7fe700 1 --2- 172.21.15.50:0/1587206401 >> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] conn(0x1bb72d0 0x1baa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e6b7fe700 1 --2- 172.21.15.50:0/1587206401 >> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] conn(0x1bb72d0 0x1baa170 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afcc3085cddd5a40 server_cookie=102f48ef5ffdf5fc in_seq=0 out_seq=0 2023-11-28T11:53:47.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.165+0000 7f5e4a7fc700 10 client.4413 ms_handle_connect on v2:172.21.15.50:6834/3764199418 2023-11-28T11:53:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.169+0000 7f5e4a7fc700 1 -- 172.21.15.50:0/1587206401 <== mds.0 v2:172.21.15.50:6834/3764199418 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1aefc70 con 0x1bb72d0 2023-11-28T11:53:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.169+0000 7f5e4a7fc700 10 client.4413 handle_command_reply: tid=0 2023-11-28T11:53:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.169+0000 7f5e75065740 1 client.4413 shutdown 2023-11-28T11:53:47.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.169+0000 7f5e75065740 1 -- 172.21.15.50:0/1587206401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 msgr2=0x1ba7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.169+0000 7f5e75065740 1 --2- 172.21.15.50:0/1587206401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1ba7610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5e64054400 tx=0x7f5e64013000 comp rx=0 tx=0).stop 2023-11-28T11:53:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.169+0000 7f5e75065740 1 -- 172.21.15.50:0/1587206401 shutdown_connections 2023-11-28T11:53:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.169+0000 7f5e75065740 1 --2- 172.21.15.50:0/1587206401 >> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] conn(0x1bb72d0 0x1baa170 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.169+0000 7f5e75065740 1 --2- 172.21.15.50:0/1587206401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1ba7610 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.169+0000 7f5e4a7fc700 0 client.4413 ms_handle_reset on v2:172.21.15.50:6834/3764199418 2023-11-28T11:53:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.169+0000 7f5e75065740 1 --2- 172.21.15.50:0/1587206401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191eae0 0x1ba70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.169+0000 7f5e75065740 1 --2- 172.21.15.50:0/1587206401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x191e710 0x1bb6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.169+0000 7f5e75065740 1 -- 172.21.15.50:0/1587206401 >> 172.21.15.50:0/1587206401 conn(0x191eeb0 msgr2=0x1bb7780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.169+0000 7f5e75065740 1 -- 172.21.15.50:0/1587206401 shutdown_connections 2023-11-28T11:53:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.169+0000 7f5e75065740 1 -- 172.21.15.50:0/1587206401 wait complete. 2023-11-28T11:53:47.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.169+0000 7f5e75065740 20 client.4413 trim_cache size 0 max 16384 2023-11-28T11:53:47.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e75065740 1 Processor -- start 2023-11-28T11:53:47.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e75065740 1 -- start start 2023-11-28T11:53:47.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e75065740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191e710 0x1bcfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e75065740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x191eae0 0x1bd0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e75065740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1ba40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e75065740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1af5d60 con 0x1969790 2023-11-28T11:53:47.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e75065740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x1afb040 con 0x191eae0 2023-11-28T11:53:47.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e75065740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ac1460 con 0x191e710 2023-11-28T11:53:47.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e6bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1ba40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e6bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1ba40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36690/0 (socket says 172.21.15.50:36690) 2023-11-28T11:53:47.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e6bfff700 1 -- 172.21.15.50:0/1612348214 learned_addr learned my addr 172.21.15.50:0/1612348214 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:47.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e6b7fe700 1 --2- 172.21.15.50:0/1612348214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191e710 0x1bcfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e63fff700 1 --2- 172.21.15.50:0/1612348214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x191eae0 0x1bd0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e6bfff700 1 -- 172.21.15.50:0/1612348214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191e710 msgr2=0x1bcfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:47.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e6bfff700 1 --2- 172.21.15.50:0/1612348214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191e710 0x1bcfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e6bfff700 1 -- 172.21.15.50:0/1612348214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x191eae0 msgr2=0x1bd0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:47.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e6bfff700 1 --2- 172.21.15.50:0/1612348214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x191eae0 0x1bd0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.185+0000 7f5e6bfff700 1 -- 172.21.15.50:0/1612348214 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c0c3c80 con 0x1969790 2023-11-28T11:53:47.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e6bfff700 1 --2- 172.21.15.50:0/1612348214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1ba40e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5e64009a40 tx=0x7f5e6406d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b1a90ffae06141 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e61ffb700 1 -- 172.21.15.50:0/1612348214 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64050a90 con 0x1969790 2023-11-28T11:53:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e61ffb700 1 -- 172.21.15.50:0/1612348214 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e640508c0 con 0x1969790 2023-11-28T11:53:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e61ffb700 1 -- 172.21.15.50:0/1612348214 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64055ae0 con 0x1969790 2023-11-28T11:53:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 1 -- 172.21.15.50:0/1612348214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 msgr2=0x1ba40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 1 --2- 172.21.15.50:0/1612348214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1ba40e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5e64009a40 tx=0x7f5e6406d040 comp rx=0 tx=0).stop 2023-11-28T11:53:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 1 -- 172.21.15.50:0/1612348214 shutdown_connections 2023-11-28T11:53:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 1 --2- 172.21.15.50:0/1612348214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1969790 0x1ba40e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 1 --2- 172.21.15.50:0/1612348214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x191eae0 0x1bd0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 1 --2- 172.21.15.50:0/1612348214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191e710 0x1bcfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 1 -- 172.21.15.50:0/1612348214 >> 172.21.15.50:0/1612348214 conn(0x191eeb0 msgr2=0x1bccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 1 -- 172.21.15.50:0/1612348214 shutdown_connections 2023-11-28T11:53:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 1 -- 172.21.15.50:0/1612348214 wait complete. 2023-11-28T11:53:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 1 -- start start 2023-11-28T11:53:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 1 Processor -- start 2023-11-28T11:53:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191e710 0x1bf1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x191eae0 0x1c357f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1969790 0x1bf31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bf2490 con 0x191eae0 2023-11-28T11:53:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ba9d40 con 0x1969790 2023-11-28T11:53:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bf2a00 con 0x191e710 2023-11-28T11:53:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e75065740 10 client.0 _ll_register_callbacks cb 0x1aa32d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:53:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e63fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x191eae0 0x1c357f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e63fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x191eae0 0x1c357f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36702/0 (socket says 172.21.15.50:36702) 2023-11-28T11:53:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e63fff700 1 -- 172.21.15.50:0/946651872 learned_addr learned my addr 172.21.15.50:0/946651872 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e6bfff700 1 --2- 172.21.15.50:0/946651872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1969790 0x1bf31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e6b7fe700 1 --2- 172.21.15.50:0/946651872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191e710 0x1bf1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e63fff700 1 -- 172.21.15.50:0/946651872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191e710 msgr2=0x1bf1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e63fff700 1 --2- 172.21.15.50:0/946651872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191e710 0x1bf1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e63fff700 1 -- 172.21.15.50:0/946651872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1969790 msgr2=0x1bf31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e63fff700 1 --2- 172.21.15.50:0/946651872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1969790 0x1bf31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e63fff700 1 -- 172.21.15.50:0/946651872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x196a9e0 con 0x191eae0 2023-11-28T11:53:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e6bfff700 1 --2- 172.21.15.50:0/946651872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1969790 0x1bf31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:53:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.189+0000 7f5e6b7fe700 1 --2- 172.21.15.50:0/946651872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191e710 0x1bf1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:53:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e63fff700 1 --2- 172.21.15.50:0/946651872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x191eae0 0x1c357f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5e54013000 tx=0x7f5e540047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92636a49305cac0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e4a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:53:47.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e4a7fc700 1 -- 172.21.15.50:0/946651872 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5401bb60 con 0x191eae0 2023-11-28T11:53:47.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e4a7fc700 1 -- 172.21.15.50:0/946651872 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e5401bcc0 con 0x191eae0 2023-11-28T11:53:47.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 1 -- 172.21.15.50:0/946651872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e64067e90 con 0x191eae0 2023-11-28T11:53:47.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e4a7fc700 1 -- 172.21.15.50:0/946651872 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e5401be80 con 0x191eae0 2023-11-28T11:53:47.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 10 client.4419 fetch_fsmap learned FSMap version 7 2023-11-28T11:53:47.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 1 -- 172.21.15.50:0/946651872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x1aa3a20 con 0x191eae0 2023-11-28T11:53:47.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e4a7fc700 1 -- 172.21.15.50:0/946651872 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e64067e90 con 0x191eae0 2023-11-28T11:53:47.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e4a7fc700 1 -- 172.21.15.50:0/946651872 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5e5402f350 con 0x191eae0 2023-11-28T11:53:47.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 10 client.4419 fetch_fsmap finished waiting for FSMap version 7 2023-11-28T11:53:47.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 10 client.4419 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T11:53:47.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 20 client.4419 populate_metadata read hostname 'smithi050' 2023-11-28T11:53:47.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 1 --2- 172.21.15.50:0/946651872 >> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] conn(0x1c37440 0x1ba3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 4 client.4419 mds_command: new command op to 4260 tid=0[{"prefix": "status"}] 2023-11-28T11:53:47.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 1 -- 172.21.15.50:0/946651872 --> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] -- command(tid 0: {"prefix": "status"}) v1 -- 0x199b260 con 0x1c37440 2023-11-28T11:53:47.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e6b7fe700 1 --2- 172.21.15.50:0/946651872 >> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] conn(0x1c37440 0x1ba3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e4a7fc700 10 client.4419 ms_handle_connect on v2:172.21.15.50:6834/3764199418 2023-11-28T11:53:47.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e6b7fe700 1 --2- 172.21.15.50:0/946651872 >> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] conn(0x1c37440 0x1ba3110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c2d44b2ef3e255b server_cookie=ece0c391fd100351 in_seq=0 out_seq=0 2023-11-28T11:53:47.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e4a7fc700 1 -- 172.21.15.50:0/946651872 <== mds.0 v2:172.21.15.50:6834/3764199418 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x199b260 con 0x1c37440 2023-11-28T11:53:47.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e4a7fc700 10 client.4419 handle_command_reply: tid=0 2023-11-28T11:53:47.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 1 client.4419 shutdown 2023-11-28T11:53:47.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 1 -- 172.21.15.50:0/946651872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x191eae0 msgr2=0x1c357f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:47.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 1 --2- 172.21.15.50:0/946651872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x191eae0 0x1c357f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5e54013000 tx=0x7f5e540047e0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 1 -- 172.21.15.50:0/946651872 shutdown_connections 2023-11-28T11:53:47.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 1 --2- 172.21.15.50:0/946651872 >> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] conn(0x1c37440 0x1ba3110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 1 --2- 172.21.15.50:0/946651872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1969790 0x1bf31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e4a7fc700 0 client.4419 ms_handle_reset on v2:172.21.15.50:6834/3764199418 2023-11-28T11:53:47.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 1 --2- 172.21.15.50:0/946651872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x191eae0 0x1c357f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 1 --2- 172.21.15.50:0/946651872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x191e710 0x1bf1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 1 -- 172.21.15.50:0/946651872 >> 172.21.15.50:0/946651872 conn(0x191eeb0 msgr2=0x1bb7760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:47.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 1 -- 172.21.15.50:0/946651872 shutdown_connections 2023-11-28T11:53:47.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 1 -- 172.21.15.50:0/946651872 wait complete. 2023-11-28T11:53:47.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.193+0000 7f5e75065740 20 client.4419 trim_cache size 0 max 16384 2023-11-28T11:53:47.205 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:53:47.205 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "cfe07b6e-9334-49cb-bc97-5dba7caa4ff8", 2023-11-28T11:53:47.205 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-11-28T11:53:47.205 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4260, 2023-11-28T11:53:47.205 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-11-28T11:53:47.205 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-11-28T11:53:47.205 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-11-28T11:53:47.205 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.3975564440000001, 2023-11-28T11:53:47.206 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 7, 2023-11-28T11:53:47.206 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 25, 2023-11-28T11:53:47.206 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 24, 2023-11-28T11:53:47.206 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 11.712213397999999 2023-11-28T11:53:47.206 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:53:47.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.197+0000 7f5e70b83700 1 -- 172.21.15.50:0/447221263 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5e4c064ee0 msgr2=0x7f5e4c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:47.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.197+0000 7f5e70b83700 1 --2- 172.21.15.50:0/447221263 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5e4c064ee0 0x7f5e4c067390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c000f60 tx=0x7f5e5c009040 comp rx=0 tx=0).stop 2023-11-28T11:53:47.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.197+0000 7f5e70b83700 1 -- 172.21.15.50:0/447221263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e6c15d650 msgr2=0x7f5e6c0c6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:47.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.197+0000 7f5e70b83700 1 --2- 172.21.15.50:0/447221263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e6c15d650 0x7f5e6c0c6f10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400efc0 tx=0x7f5e6400c3a0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.197+0000 7f5e70b83700 1 -- 172.21.15.50:0/447221263 shutdown_connections 2023-11-28T11:53:47.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.197+0000 7f5e70b83700 1 --2- 172.21.15.50:0/447221263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e6c15d650 0x7f5e6c0c6f10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.197+0000 7f5e70b83700 1 --2- 172.21.15.50:0/447221263 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5e4c064ee0 0x7f5e4c067390 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.197+0000 7f5e70b83700 1 --2- 172.21.15.50:0/447221263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e6c1594f0 0x7f5e6c0b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.197+0000 7f5e70b83700 1 --2- 172.21.15.50:0/447221263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e6c0cc730 0x7f5e6c14f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.197+0000 7f5e70b83700 1 -- 172.21.15.50:0/447221263 >> 172.21.15.50:0/447221263 conn(0x7f5e6c06ec40 msgr2=0x7f5e6c06c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:47.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.197+0000 7f5e70b83700 1 -- 172.21.15.50:0/447221263 shutdown_connections 2023-11-28T11:53:47.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.197+0000 7f5e70b83700 1 -- 172.21.15.50:0/447221263 wait complete. 2023-11-28T11:53:47.217 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T11:53:47.218 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-28T11:53:47.218 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:53:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.333+0000 7f0f64c09700 1 Processor -- start 2023-11-28T11:53:47.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.333+0000 7f0f64c09700 1 -- start start 2023-11-28T11:53:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f64c09700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0f6006a350 0x7f0f601671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f64c09700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f600d0760 con 0x7f0f600b8250 2023-11-28T11:53:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f64c09700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f600cd270 con 0x7f0f6006a800 2023-11-28T11:53:47.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f64c09700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f600cd550 con 0x7f0f6006a350 2023-11-28T11:53:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f5e59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0f600b8250 0x7f0f600cf8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38898/0 (socket says 172.21.15.50:38898) 2023-11-28T11:53:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f5e59c700 1 -- 172.21.15.50:0/1900862626 learned_addr learned my addr 172.21.15.50:0/1900862626 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:47.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f5ed9d700 1 --2- 172.21.15.50:0/1900862626 >> v2:172.21.15.192:3300/0 conn(0x7f0f6006a350 0x7f0f601671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f5d59a700 1 -- 172.21.15.50:0/1900862626 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886310918 0 0) 0x7f0f600d0760 con 0x7f0f600b8250 2023-11-28T11:53:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f5d59a700 1 -- 172.21.15.50:0/1900862626 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f4c0035d0 con 0x7f0f600b8250 2023-11-28T11:53:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f5ed9d700 1 -- 172.21.15.50:0/1900862626 >> v1:172.21.15.192:6789/0 conn(0x7f0f6006a800 legacy=0x7f0f60069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f5d59a700 1 -- 172.21.15.50:0/1900862626 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684976500 0 0) 0x7f0f600cd270 con 0x7f0f6006a800 2023-11-28T11:53:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f5ed9d700 1 -- 172.21.15.50:0/1900862626 >> v1:172.21.15.50:6789/0 conn(0x7f0f600b8250 legacy=0x7f0f600cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f5ed9d700 1 -- 172.21.15.50:0/1900862626 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f600d0a00 con 0x7f0f6006a350 2023-11-28T11:53:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f5ed9d700 1 --2- 172.21.15.50:0/1900862626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f6006a350 0x7f0f601671b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009d90 tx=0x7f0f5800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb6f4e68034fa5b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f5d59a700 1 -- 172.21.15.50:0/1900862626 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800e070 con 0x7f0f6006a350 2023-11-28T11:53:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f5d59a700 1 -- 172.21.15.50:0/1900862626 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5800bb20 con 0x7f0f6006a350 2023-11-28T11:53:47.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f5d59a700 1 -- 172.21.15.50:0/1900862626 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800be90 con 0x7f0f6006a350 2023-11-28T11:53:47.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f64c09700 1 -- 172.21.15.50:0/1900862626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f6006a350 msgr2=0x7f0f601671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:47.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f64c09700 1 --2- 172.21.15.50:0/1900862626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f6006a350 0x7f0f601671b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009d90 tx=0x7f0f5800b330 comp rx=0 tx=0).stop 2023-11-28T11:53:47.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f64c09700 1 -- 172.21.15.50:0/1900862626 shutdown_connections 2023-11-28T11:53:47.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f64c09700 1 --2- 172.21.15.50:0/1900862626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f6006a350 0x7f0f601671b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f64c09700 1 -- 172.21.15.50:0/1900862626 >> 172.21.15.50:0/1900862626 conn(0x7f0f6006beb0 msgr2=0x7f0f6006c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:47.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f64c09700 1 -- 172.21.15.50:0/1900862626 shutdown_connections 2023-11-28T11:53:47.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.337+0000 7f0f64c09700 1 -- 172.21.15.50:0/1900862626 wait complete. 2023-11-28T11:53:47.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f64c09700 1 Processor -- start 2023-11-28T11:53:47.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f64c09700 1 -- start start 2023-11-28T11:53:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f64c09700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f6006a350 0x7f0f6015f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f64c09700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f6006a800 0x7f0f6015c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f64c09700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f600b8250 0x7f0f600b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f64c09700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600b2e60 con 0x7f0f600b8250 2023-11-28T11:53:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f64c09700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600c9060 con 0x7f0f6006a800 2023-11-28T11:53:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f64c09700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600c8d10 con 0x7f0f6006a350 2023-11-28T11:53:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f5ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f600b8250 0x7f0f600b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f5ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f600b8250 0x7f0f600b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36714/0 (socket says 172.21.15.50:36714) 2023-11-28T11:53:47.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f5ed9d700 1 -- 172.21.15.50:0/931138211 learned_addr learned my addr 172.21.15.50:0/931138211 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:47.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f5dd9b700 1 --2- 172.21.15.50:0/931138211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f6006a800 0x7f0f6015c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f5e59c700 1 --2- 172.21.15.50:0/931138211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f6006a350 0x7f0f6015f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f5ed9d700 1 -- 172.21.15.50:0/931138211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f6006a350 msgr2=0x7f0f6015f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:47.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f5ed9d700 1 --2- 172.21.15.50:0/931138211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f6006a350 0x7f0f6015f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f5ed9d700 1 -- 172.21.15.50:0/931138211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f6006a800 msgr2=0x7f0f6015c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:47.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f5ed9d700 1 --2- 172.21.15.50:0/931138211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f6006a800 0x7f0f6015c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f5ed9d700 1 -- 172.21.15.50:0/931138211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f58009a70 con 0x7f0f600b8250 2023-11-28T11:53:47.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f5ed9d700 1 --2- 172.21.15.50:0/931138211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f600b8250 0x7f0f600b3920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0f6006d1e0 tx=0x7f0f58004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:47.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f56ffd700 1 -- 172.21.15.50:0/931138211 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58003c40 con 0x7f0f600b8250 2023-11-28T11:53:47.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.341+0000 7f0f56ffd700 1 -- 172.21.15.50:0/931138211 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f58003dc0 con 0x7f0f600b8250 2023-11-28T11:53:47.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.345+0000 7f0f64c09700 1 -- 172.21.15.50:0/931138211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f600cd830 con 0x7f0f600b8250 2023-11-28T11:53:47.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.345+0000 7f0f56ffd700 1 -- 172.21.15.50:0/931138211 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58012aa0 con 0x7f0f600b8250 2023-11-28T11:53:47.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.345+0000 7f0f64c09700 1 -- 172.21.15.50:0/931138211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f600b8620 con 0x7f0f600b8250 2023-11-28T11:53:47.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.345+0000 7f0f64c09700 1 -- 172.21.15.50:0/931138211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f600d1f30 con 0x7f0f600b8250 2023-11-28T11:53:47.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.345+0000 7f0f56ffd700 1 -- 172.21.15.50:0/931138211 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0f58012c00 con 0x7f0f600b8250 2023-11-28T11:53:47.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.345+0000 7f0f56ffd700 1 --2- 172.21.15.50:0/931138211 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0f40064f10 0x7f0f400673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:47.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.345+0000 7f0f56ffd700 1 -- 172.21.15.50:0/931138211 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0f58083a90 con 0x7f0f600b8250 2023-11-28T11:53:47.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.345+0000 7f0f5e59c700 1 --2- 172.21.15.50:0/931138211 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0f40064f10 0x7f0f400673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:47.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.349+0000 7f0f5e59c700 1 --2- 172.21.15.50:0/931138211 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0f40064f10 0x7f0f400673c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0f50007fd0 tx=0x7f0f50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:47.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.353+0000 7f0f56ffd700 1 -- 172.21.15.50:0/931138211 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0f58051940 con 0x7f0f600b8250 2023-11-28T11:53:47.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.549+0000 7f0f64c09700 1 -- 172.21.15.50:0/931138211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0f60072500 con 0x7f0f600b8250 2023-11-28T11:53:47.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.549+0000 7f0f56ffd700 1 -- 172.21.15.50:0/931138211 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0f58054f60 con 0x7f0f600b8250 2023-11-28T11:53:47.553 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-28T11:53:47.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.553+0000 7f0f64c09700 1 -- 172.21.15.50:0/931138211 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0f40064f10 msgr2=0x7f0f400673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:47.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.553+0000 7f0f64c09700 1 --2- 172.21.15.50:0/931138211 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0f40064f10 0x7f0f400673c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0f50007fd0 tx=0x7f0f50009040 comp rx=0 tx=0).stop 2023-11-28T11:53:47.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.553+0000 7f0f64c09700 1 -- 172.21.15.50:0/931138211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f600b8250 msgr2=0x7f0f600b3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:47.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.553+0000 7f0f64c09700 1 --2- 172.21.15.50:0/931138211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f600b8250 0x7f0f600b3920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0f6006d1e0 tx=0x7f0f58004af0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.553+0000 7f0f64c09700 1 -- 172.21.15.50:0/931138211 shutdown_connections 2023-11-28T11:53:47.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.553+0000 7f0f64c09700 1 --2- 172.21.15.50:0/931138211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f600b8250 0x7f0f600b3920 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.553+0000 7f0f64c09700 1 --2- 172.21.15.50:0/931138211 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0f40064f10 0x7f0f400673c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.553+0000 7f0f64c09700 1 --2- 172.21.15.50:0/931138211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f6006a800 0x7f0f6015c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.553+0000 7f0f64c09700 1 --2- 172.21.15.50:0/931138211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f6006a350 0x7f0f6015f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.553+0000 7f0f64c09700 1 -- 172.21.15.50:0/931138211 >> 172.21.15.50:0/931138211 conn(0x7f0f6006beb0 msgr2=0x7f0f600cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.553+0000 7f0f64c09700 1 -- 172.21.15.50:0/931138211 shutdown_connections 2023-11-28T11:53:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:47.553+0000 7f0f64c09700 1 -- 172.21.15.50:0/931138211 wait complete. 2023-11-28T11:53:47.574 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T11:53:47.574 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:53:47.574 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-11-28T11:53:47.575 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-28T11:53:47.575 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-28T11:53:47.575 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T11:53:47.575 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T11:53:47.575 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:53:47.575 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-28T11:53:47.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:47.575 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-11-28T11:53:47.581 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:53:47.582 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:53:47.582 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:53:47.582 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:53:47.582 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-11-28T11:53:47.582 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:53:47.582 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:53:47.582 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:53:47.582 INFO:teuthology.orchestra.run.smithi050.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:53:47.582 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:53:47.582 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T11:53:47.582 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42565sec preferred_lft 42565sec 2023-11-28T11:53:47.583 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-11-28T11:53:47.583 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:53:47.583 INFO:teuthology.orchestra.run.smithi050.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:53:47.583 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:53:47.583 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:53:47.583 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:53:47.583 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T11:53:47.583 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:5d:90:5e:15 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:53:47.583 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T11:53:47.583 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:53:47.584 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T11:53:47.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:47.584 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-11-28T11:53:47.584 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-11-28T11:53:47.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2023-11-28T11:53:47.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2023-11-28T11:53:47.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2023-11-28T11:53:47.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T11:53:47.584 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-11-28T11:53:47.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:47.629 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:53:47.642 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-11-28T11:53:47.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:47.642 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-11-28T11:53:47.705 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-11-28T11:53:47.705 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:53:47.705 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T11:53:47.706 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T11:53:47.706 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T11:53:47.706 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:53:47.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:47.706 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-11-28T11:53:47.706 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-11-28T11:53:47.706 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T11:53:47.706 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T11:53:47.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T11:53:47.707 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-11-28T11:53:47.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:47.749 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-11-28T11:53:47.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:47.755 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-11-28T11:53:47.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:47.761 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-11-28T11:53:47.761 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-11-28T11:53:47.761 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T11:53:47.761 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-28T11:53:47.761 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-11-28T11:53:47.833 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-28T11:53:47.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:47.834 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-11-28T11:53:47.834 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-11-28T11:53:47.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-28T11:53:47.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T11:53:47.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-28T11:53:47.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-28T11:53:47.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-28T11:53:47.834 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-11-28T11:53:47.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:47.897 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-11-28T11:53:47.897 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-11-28T11:53:47.897 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-11-28T11:53:47.897 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T11:53:47.897 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-11-28T11:53:47.925 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-28T11:53:47.925 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:53:47.925 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-28T11:53:47.931 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-28T11:53:47.931 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:53:47.931 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-11-28T11:53:47.936 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:53:47.996 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:53:47.996 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:53:48.011 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:53:48.012 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:53:48.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:48.012 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:53:48.020 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T11:53:48.020 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_mountpoint=/ --client_fs=cephfs) 2023-11-28T11:53:48.022 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:53:48.036 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:53:48.036 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:53:48.096 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:53:48.096 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:53:48.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:48.097 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:53:48.113 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:2023-11-28T11:53:48.109+0000 7f1956ce5640 -1 init, newargv = 0x55d1311413e0 newargc=15 2023-11-28T11:53:48.113 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[42105]: starting ceph client 2023-11-28T11:53:48.125 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[42105]: starting fuse 2023-11-28T11:53:49.205 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:53:49.222 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:53:49.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:53:49.279 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:53:49.280 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:53:49.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:49.280 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:53:49.288 INFO:teuthology.orchestra.run.smithi050.stdout:52 2023-11-28T11:53:49.288 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-28T11:53:49.288 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:53:49.288 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-11-28T11:53:49.289 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-11-28T11:53:49.289 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-11-28T11:53:49.289 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-11-28T11:53:49.289 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:53:49.289 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-11-28T11:53:49.289 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-28T11:53:49.289 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-11-28T11:53:49.289 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-28T11:53:49.289 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:53:49.289 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-11-28T11:53:49.289 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-11-28T11:53:49.289 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-11-28T11:53:49.290 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-11-28T11:53:49.290 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:53:49.290 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-11-28T11:53:49.290 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T11:53:49.290 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T11:53:49.290 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T11:53:49.290 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-11-28T11:53:49.290 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-11-28T11:53:49.290 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-11-28T11:53:49.290 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T11:53:49.290 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:53:49.290 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.admin")) 2023-11-28T11:53:49.291 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-11-28T11:53:49.371 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.admin.42105.asok 2023-11-28T11:53:49.557 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42105.asok 2023-11-28T11:53:49.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:49.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42105.asok status 2023-11-28T11:53:49.706 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:53:49.707 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-11-28T11:53:49.707 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T11:53:49.707 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T11:53:49.707 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "admin", 2023-11-28T11:53:49.707 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-11-28T11:53:49.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-28T11:53:49.707 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "42105", 2023-11-28T11:53:49.707 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-11-28T11:53:49.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:53:49.708 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-11-28T11:53:49.708 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-11-28T11:53:49.708 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4431, 2023-11-28T11:53:49.708 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-11-28T11:53:49.708 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-11-28T11:53:49.708 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-11-28T11:53:49.708 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 4431 2023-11-28T11:53:49.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:53:49.708 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-11-28T11:53:49.708 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-11-28T11:53:49.708 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:53:49.708 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 77509085 2023-11-28T11:53:49.709 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:53:49.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:53:49.709 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-11-28T11:53:49.709 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-11-28T11:53:49.709 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:53:49.709 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 77509085 2023-11-28T11:53:49.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:53:49.709 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.4431 192.168.0.1:0/77509085", 2023-11-28T11:53:49.709 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/77509085", 2023-11-28T11:53:49.709 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-11-28T11:53:49.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 7, 2023-11-28T11:53:49.709 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 25, 2023-11-28T11:53:49.709 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-11-28T11:53:49.710 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-11-28T11:53:49.710 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-11-28T11:53:49.710 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:53:49.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:49.717 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-11-28T11:53:49.717 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-28T11:53:49.725 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-11-28T11:53:49.725 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-28T11:53:49.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:49.725 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-28T11:53:49.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:49.741 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-28T11:53:49.786 INFO:teuthology.orchestra.run.smithi050.stdout:# file: . 2023-11-28T11:53:49.786 INFO:teuthology.orchestra.run.smithi050.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-28T11:53:49.786 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:53:49.787 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:53:49.788 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:53:49.797 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:53:49.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f6932e700 1 Processor -- start 2023-11-28T11:53:49.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f6932e700 1 -- start start 2023-11-28T11:53:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f6932e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8f640c1ac0 0x7f8f64069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f6932e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f640ceef0 0x7f8f6406a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f6932e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f640cae70 con 0x7f8f641606b0 2023-11-28T11:53:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f6932e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f640cbc10 con 0x7f8f640c1ac0 2023-11-28T11:53:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f6932e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640cb130 con 0x7f8f640ceef0 2023-11-28T11:53:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f637fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8f640c1ac0 0x7f8f64069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:49.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f637fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8f640c1ac0 0x7f8f64069c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36730/0 (socket says 172.21.15.50:36730) 2023-11-28T11:53:49.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f637fe700 1 -- 172.21.15.50:0/3290695063 learned_addr learned my addr 172.21.15.50:0/3290695063 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:49.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f68b2d700 1 --2- 172.21.15.50:0/3290695063 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f640ceef0 0x7f8f6406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:49.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f637fe700 1 -- 172.21.15.50:0/3290695063 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f640ceef0 msgr2=0x7f8f6406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:49.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f637fe700 1 --2- 172.21.15.50:0/3290695063 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f640ceef0 0x7f8f6406a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:49.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f637fe700 1 -- 172.21.15.50:0/3290695063 >> v1:172.21.15.192:6789/0 conn(0x7f8f641606b0 legacy=0x7f8f640c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:49.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f637fe700 1 -- 172.21.15.50:0/3290695063 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f640cb410 con 0x7f8f640c1ac0 2023-11-28T11:53:49.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f637fe700 1 --2- 172.21.15.50:0/3290695063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f640c1ac0 0x7f8f64069c40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009e50 tx=0x7f8f5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3a39cda86a9736 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:49.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f62ffd700 1 -- 172.21.15.50:0/3290695063 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c00e070 con 0x7f8f640c1ac0 2023-11-28T11:53:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f62ffd700 1 -- 172.21.15.50:0/3290695063 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c00b910 con 0x7f8f640c1ac0 2023-11-28T11:53:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f62ffd700 1 -- 172.21.15.50:0/3290695063 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c00bcc0 con 0x7f8f640c1ac0 2023-11-28T11:53:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f6932e700 1 -- 172.21.15.50:0/3290695063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f640c1ac0 msgr2=0x7f8f64069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f6932e700 1 --2- 172.21.15.50:0/3290695063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f640c1ac0 0x7f8f64069c40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009e50 tx=0x7f8f5c00b330 comp rx=0 tx=0).stop 2023-11-28T11:53:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f6932e700 1 -- 172.21.15.50:0/3290695063 shutdown_connections 2023-11-28T11:53:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f6932e700 1 --2- 172.21.15.50:0/3290695063 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f640ceef0 0x7f8f6406a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f6932e700 1 --2- 172.21.15.50:0/3290695063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f640c1ac0 0x7f8f64069c40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f6932e700 1 -- 172.21.15.50:0/3290695063 >> 172.21.15.50:0/3290695063 conn(0x7f8f640ce3e0 msgr2=0x7f8f640ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f6932e700 1 -- 172.21.15.50:0/3290695063 shutdown_connections 2023-11-28T11:53:49.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.917+0000 7f8f6932e700 1 -- 172.21.15.50:0/3290695063 wait complete. 2023-11-28T11:53:49.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.921+0000 7f8f6932e700 1 Processor -- start 2023-11-28T11:53:49.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.921+0000 7f8f6932e700 1 -- start start 2023-11-28T11:53:49.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f6932e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f640c1ac0 0x7f8f64163380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:49.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f6932e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f640ceef0 0x7f8f640c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:49.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f6932e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f641606b0 0x7f8f641f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f6932e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f64163960 con 0x7f8f640c1ac0 2023-11-28T11:53:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f6932e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f64163120 con 0x7f8f641606b0 2023-11-28T11:53:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f6932e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f64161c50 con 0x7f8f640ceef0 2023-11-28T11:53:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f63fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f640c1ac0 0x7f8f64163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f63fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f640c1ac0 0x7f8f64163380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36742/0 (socket says 172.21.15.50:36742) 2023-11-28T11:53:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f63fff700 1 -- 172.21.15.50:0/25902133 learned_addr learned my addr 172.21.15.50:0/25902133 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f68b2d700 1 --2- 172.21.15.50:0/25902133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f641606b0 0x7f8f641f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:49.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f637fe700 1 --2- 172.21.15.50:0/25902133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f640ceef0 0x7f8f640c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:49.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f63fff700 1 -- 172.21.15.50:0/25902133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f640ceef0 msgr2=0x7f8f640c1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:49.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f63fff700 1 --2- 172.21.15.50:0/25902133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f640ceef0 0x7f8f640c1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:49.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f63fff700 1 -- 172.21.15.50:0/25902133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f641606b0 msgr2=0x7f8f641f5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:49.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f63fff700 1 --2- 172.21.15.50:0/25902133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f641606b0 0x7f8f641f5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:49.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f63fff700 1 -- 172.21.15.50:0/25902133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c009b30 con 0x7f8f640c1ac0 2023-11-28T11:53:49.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f63fff700 1 --2- 172.21.15.50:0/25902133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f640c1ac0 0x7f8f64163380 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400c500 tx=0x7f8f5400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:49.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f60ff9700 1 -- 172.21.15.50:0/25902133 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f540052d0 con 0x7f8f640c1ac0 2023-11-28T11:53:49.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f60ff9700 1 -- 172.21.15.50:0/25902133 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f54005430 con 0x7f8f640c1ac0 2023-11-28T11:53:49.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f60ff9700 1 -- 172.21.15.50:0/25902133 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f540055a0 con 0x7f8f640c1ac0 2023-11-28T11:53:49.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f6932e700 1 -- 172.21.15.50:0/25902133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f640b36c0 con 0x7f8f640c1ac0 2023-11-28T11:53:49.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.925+0000 7f8f6932e700 1 -- 172.21.15.50:0/25902133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f640cb6f0 con 0x7f8f640c1ac0 2023-11-28T11:53:49.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.929+0000 7f8f6932e700 1 -- 172.21.15.50:0/25902133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f640ad610 con 0x7f8f640c1ac0 2023-11-28T11:53:49.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.929+0000 7f8f60ff9700 1 -- 172.21.15.50:0/25902133 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8f54019030 con 0x7f8f640c1ac0 2023-11-28T11:53:49.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.929+0000 7f8f60ff9700 1 --2- 172.21.15.50:0/25902133 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8f44064f10 0x7f8f440673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:49.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.929+0000 7f8f60ff9700 1 -- 172.21.15.50:0/25902133 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8f54081430 con 0x7f8f640c1ac0 2023-11-28T11:53:49.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.929+0000 7f8f637fe700 1 --2- 172.21.15.50:0/25902133 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8f44064f10 0x7f8f440673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:49.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.929+0000 7f8f637fe700 1 --2- 172.21.15.50:0/25902133 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8f44064f10 0x7f8f440673c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f640c1eb0 tx=0x7f8f5c009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:49.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:49.937+0000 7f8f60ff9700 1 -- 172.21.15.50:0/25902133 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8f5404f1f0 con 0x7f8f640c1ac0 2023-11-28T11:53:50.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.101+0000 7f8f6932e700 1 -- 172.21.15.50:0/25902133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f64072500 con 0x7f8f640c1ac0 2023-11-28T11:53:50.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.105+0000 7f8f60ff9700 1 -- 172.21.15.50:0/25902133 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f8f54052810 con 0x7f8f640c1ac0 2023-11-28T11:53:50.108 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:53:50.108 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:45.231747+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:53:50.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.105+0000 7f8f6932e700 1 -- 172.21.15.50:0/25902133 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8f44064f10 msgr2=0x7f8f440673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.105+0000 7f8f6932e700 1 --2- 172.21.15.50:0/25902133 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8f44064f10 0x7f8f440673c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f640c1eb0 tx=0x7f8f5c009000 comp rx=0 tx=0).stop 2023-11-28T11:53:50.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.105+0000 7f8f6932e700 1 -- 172.21.15.50:0/25902133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f640c1ac0 msgr2=0x7f8f64163380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.105+0000 7f8f6932e700 1 --2- 172.21.15.50:0/25902133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f640c1ac0 0x7f8f64163380 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400c500 tx=0x7f8f5400c810 comp rx=0 tx=0).stop 2023-11-28T11:53:50.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.105+0000 7f8f6932e700 1 -- 172.21.15.50:0/25902133 shutdown_connections 2023-11-28T11:53:50.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.105+0000 7f8f6932e700 1 --2- 172.21.15.50:0/25902133 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8f44064f10 0x7f8f440673c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.105+0000 7f8f6932e700 1 --2- 172.21.15.50:0/25902133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f641606b0 0x7f8f641f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.105+0000 7f8f6932e700 1 --2- 172.21.15.50:0/25902133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f640ceef0 0x7f8f640c1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.105+0000 7f8f6932e700 1 --2- 172.21.15.50:0/25902133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f640c1ac0 0x7f8f64163380 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.105+0000 7f8f6932e700 1 -- 172.21.15.50:0/25902133 >> 172.21.15.50:0/25902133 conn(0x7f8f640ce3e0 msgr2=0x7f8f640ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:50.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.105+0000 7f8f6932e700 1 -- 172.21.15.50:0/25902133 shutdown_connections 2023-11-28T11:53:50.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.105+0000 7f8f6932e700 1 -- 172.21.15.50:0/25902133 wait complete. 2023-11-28T11:53:50.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:53:38.462826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:53:39.778621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:53:42.870360+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:53:50.123 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:53:50.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.233+0000 7f3cdb59e700 1 Processor -- start 2023-11-28T11:53:50.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.233+0000 7f3cdb59e700 1 -- start start 2023-11-28T11:53:50.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.233+0000 7f3cdb59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3cdc158480 0x7f3cdc0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.233+0000 7f3cdb59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cdc158850 0x7f3cdc0c9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.233+0000 7f3cdb59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cdc06a4d0 con 0x7f3cdc0cd3a0 2023-11-28T11:53:50.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.233+0000 7f3cdb59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cdc0cc1f0 con 0x7f3cdc158480 2023-11-28T11:53:50.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.233+0000 7f3cdb59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0cc490 con 0x7f3cdc158850 2023-11-28T11:53:50.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.233+0000 7f3cd9d9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cdc158850 0x7f3cdc0c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.233+0000 7f3cda59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3cdc158480 0x7f3cdc0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.233+0000 7f3cda59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3cdc158480 0x7f3cdc0cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:35102/0 (socket says 172.21.15.50:35102) 2023-11-28T11:53:50.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.233+0000 7f3cdad9d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3cdc0cd3a0 0x7f3cdc0ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:38216/0 (socket says 172.21.15.50:38216) 2023-11-28T11:53:50.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.233+0000 7f3cda59c700 1 -- 172.21.15.50:0/1822642030 learned_addr learned my addr 172.21.15.50:0/1822642030 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:50.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.233+0000 7f3cd9d9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cdc158850 0x7f3cdc0c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:41048/0 (socket says 172.21.15.50:41048) 2023-11-28T11:53:50.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.237+0000 7f3cda59c700 1 -- 172.21.15.50:0/1822642030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cdc158850 msgr2=0x7f3cdc0c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:50.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.237+0000 7f3cda59c700 1 --2- 172.21.15.50:0/1822642030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cdc158850 0x7f3cdc0c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.237+0000 7f3cda59c700 1 -- 172.21.15.50:0/1822642030 >> v1:172.21.15.192:6789/0 conn(0x7f3cdc0cd3a0 legacy=0x7f3cdc0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.237+0000 7f3cda59c700 1 -- 172.21.15.50:0/1822642030 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc06a720 con 0x7f3cdc158480 2023-11-28T11:53:50.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.237+0000 7f3cda59c700 1 --2- 172.21.15.50:0/1822642030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cdc158480 0x7f3cdc0cbcb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0083f0 tx=0x7f3ccc00a870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9c1018a759823db server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:50.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.237+0000 7f3cd959a700 1 -- 172.21.15.50:0/1822642030 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc00a2d0 con 0x7f3cdc158480 2023-11-28T11:53:50.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.237+0000 7f3cd959a700 1 -- 172.21.15.50:0/1822642030 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc003a40 con 0x7f3cdc158480 2023-11-28T11:53:50.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.237+0000 7f3cd959a700 1 -- 172.21.15.50:0/1822642030 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc003dd0 con 0x7f3cdc158480 2023-11-28T11:53:50.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.237+0000 7f3cdb59e700 1 -- 172.21.15.50:0/1822642030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cdc158480 msgr2=0x7f3cdc0cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.237+0000 7f3cdb59e700 1 --2- 172.21.15.50:0/1822642030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cdc158480 0x7f3cdc0cbcb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0083f0 tx=0x7f3ccc00a870 comp rx=0 tx=0).stop 2023-11-28T11:53:50.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.237+0000 7f3cdb59e700 1 -- 172.21.15.50:0/1822642030 shutdown_connections 2023-11-28T11:53:50.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.237+0000 7f3cdb59e700 1 --2- 172.21.15.50:0/1822642030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cdc158850 0x7f3cdc0c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.237+0000 7f3cdb59e700 1 --2- 172.21.15.50:0/1822642030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cdc158480 0x7f3cdc0cbcb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.237+0000 7f3cdb59e700 1 -- 172.21.15.50:0/1822642030 >> 172.21.15.50:0/1822642030 conn(0x7f3cdc06c660 msgr2=0x7f3cdc06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:50.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.237+0000 7f3cdb59e700 1 -- 172.21.15.50:0/1822642030 shutdown_connections 2023-11-28T11:53:50.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.237+0000 7f3cdb59e700 1 -- 172.21.15.50:0/1822642030 wait complete. 2023-11-28T11:53:50.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.237+0000 7f3cdb59e700 1 Processor -- start 2023-11-28T11:53:50.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdb59e700 1 -- start start 2023-11-28T11:53:50.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdb59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cdc0cd3a0 0x7f3cdc14fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdb59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cdc158480 0x7f3cdc0c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cdc158850 0x7f3cdc153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdb59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0b2ae0 con 0x7f3cdc158850 2023-11-28T11:53:50.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdb59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc151230 con 0x7f3cdc158480 2023-11-28T11:53:50.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdb59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0b21b0 con 0x7f3cdc0cd3a0 2023-11-28T11:53:50.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cdc158850 0x7f3cdc153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cdc158850 0x7f3cdc153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36754/0 (socket says 172.21.15.50:36754) 2023-11-28T11:53:50.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdad9d700 1 -- 172.21.15.50:0/1410055084 learned_addr learned my addr 172.21.15.50:0/1410055084 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:50.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cd9d9b700 1 --2- 172.21.15.50:0/1410055084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cdc158480 0x7f3cdc0c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cda59c700 1 --2- 172.21.15.50:0/1410055084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cdc0cd3a0 0x7f3cdc14fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdad9d700 1 -- 172.21.15.50:0/1410055084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cdc0cd3a0 msgr2=0x7f3cdc14fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdad9d700 1 --2- 172.21.15.50:0/1410055084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cdc0cd3a0 0x7f3cdc14fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdad9d700 1 -- 172.21.15.50:0/1410055084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cdc158480 msgr2=0x7f3cdc0c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdad9d700 1 --2- 172.21.15.50:0/1410055084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cdc158480 0x7f3cdc0c6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdad9d700 1 -- 172.21.15.50:0/1410055084 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc00ab50 con 0x7f3cdc158850 2023-11-28T11:53:50.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdad9d700 1 --2- 172.21.15.50:0/1410055084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cdc158850 0x7f3cdc153590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400c500 tx=0x7f3cd400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:50.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cd2ffd700 1 -- 172.21.15.50:0/1410055084 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4005cd0 con 0x7f3cdc158850 2023-11-28T11:53:50.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cd2ffd700 1 -- 172.21.15.50:0/1410055084 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd4005e30 con 0x7f3cdc158850 2023-11-28T11:53:50.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdb59e700 1 -- 172.21.15.50:0/1410055084 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc06ace0 con 0x7f3cdc158850 2023-11-28T11:53:50.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cd2ffd700 1 -- 172.21.15.50:0/1410055084 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40072f0 con 0x7f3cdc158850 2023-11-28T11:53:50.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.241+0000 7f3cdb59e700 1 -- 172.21.15.50:0/1410055084 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cdc06aa00 con 0x7f3cdc158850 2023-11-28T11:53:50.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.245+0000 7f3cdb59e700 1 -- 172.21.15.50:0/1410055084 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cdc0c9950 con 0x7f3cdc158850 2023-11-28T11:53:50.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.245+0000 7f3cd2ffd700 1 -- 172.21.15.50:0/1410055084 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3cd4019030 con 0x7f3cdc158850 2023-11-28T11:53:50.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.245+0000 7f3cd2ffd700 1 --2- 172.21.15.50:0/1410055084 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3cbc064f10 0x7f3cbc0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.245+0000 7f3cd2ffd700 1 -- 172.21.15.50:0/1410055084 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3cd4081550 con 0x7f3cdc158850 2023-11-28T11:53:50.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.245+0000 7f3cda59c700 1 --2- 172.21.15.50:0/1410055084 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3cbc064f10 0x7f3cbc0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.245+0000 7f3cda59c700 1 --2- 172.21.15.50:0/1410055084 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3cbc064f10 0x7f3cbc0673c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc000f80 tx=0x7f3ccc00a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:50.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.253+0000 7f3cd2ffd700 1 -- 172.21.15.50:0/1410055084 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3cd404f290 con 0x7f3cdc158850 2023-11-28T11:53:50.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.417+0000 7f3cdb59e700 1 -- 172.21.15.50:0/1410055084 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3cdc072c20 con 0x7f3cdc158850 2023-11-28T11:53:50.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.417+0000 7f3cd2ffd700 1 -- 172.21.15.50:0/1410055084 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3cd4017020 con 0x7f3cdc158850 2023-11-28T11:53:50.423 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:53:50.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.421+0000 7f3cdb59e700 1 -- 172.21.15.50:0/1410055084 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3cbc064f10 msgr2=0x7f3cbc0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.421+0000 7f3cdb59e700 1 --2- 172.21.15.50:0/1410055084 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3cbc064f10 0x7f3cbc0673c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc000f80 tx=0x7f3ccc00a000 comp rx=0 tx=0).stop 2023-11-28T11:53:50.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.421+0000 7f3cdb59e700 1 -- 172.21.15.50:0/1410055084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cdc158850 msgr2=0x7f3cdc153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.421+0000 7f3cdb59e700 1 --2- 172.21.15.50:0/1410055084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cdc158850 0x7f3cdc153590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400c500 tx=0x7f3cd400c810 comp rx=0 tx=0).stop 2023-11-28T11:53:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.421+0000 7f3cdb59e700 1 -- 172.21.15.50:0/1410055084 shutdown_connections 2023-11-28T11:53:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.421+0000 7f3cdb59e700 1 --2- 172.21.15.50:0/1410055084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cdc158850 0x7f3cdc153590 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.421+0000 7f3cdb59e700 1 --2- 172.21.15.50:0/1410055084 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3cbc064f10 0x7f3cbc0673c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.421+0000 7f3cdb59e700 1 --2- 172.21.15.50:0/1410055084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cdc158480 0x7f3cdc0c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.421+0000 7f3cdb59e700 1 --2- 172.21.15.50:0/1410055084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cdc0cd3a0 0x7f3cdc14fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.421+0000 7f3cdb59e700 1 -- 172.21.15.50:0/1410055084 >> 172.21.15.50:0/1410055084 conn(0x7f3cdc06c660 msgr2=0x7f3cdc0c9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.421+0000 7f3cdb59e700 1 -- 172.21.15.50:0/1410055084 shutdown_connections 2023-11-28T11:53:50.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.421+0000 7f3cdb59e700 1 -- 172.21.15.50:0/1410055084 wait complete. 2023-11-28T11:53:50.439 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:53:50.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.549+0000 7f9adf59e700 1 Processor -- start 2023-11-28T11:53:50.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.549+0000 7f9adf59e700 1 -- start start 2023-11-28T11:53:50.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.549+0000 7f9adf59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ae00b00e0 0x7f9ae015d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.549+0000 7f9adf59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9ae00b04b0 0x7f9ae006bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.549+0000 7f9adf59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae006d700 con 0x7f9ae00cbb30 2023-11-28T11:53:50.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.549+0000 7f9adf59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae009c150 con 0x7f9ae00b04b0 2023-11-28T11:53:50.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.549+0000 7f9adf59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00ac050 con 0x7f9ae00b00e0 2023-11-28T11:53:50.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.549+0000 7f9ade59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ae00b00e0 0x7f9ae015d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.549+0000 7f9ade59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ae00b00e0 0x7f9ae015d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:41052/0 (socket says 172.21.15.50:41052) 2023-11-28T11:53:50.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.549+0000 7f9ade59c700 1 -- 172.21.15.50:0/3916438074 learned_addr learned my addr 172.21.15.50:0/3916438074 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:50.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.549+0000 7f9addd9b700 1 --1- 172.21.15.50:0/3916438074 >> v1:172.21.15.192:6789/0 conn(0x7f9ae00cbb30 0x7f9ae015d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:38226/0 (socket says 172.21.15.50:38226) 2023-11-28T11:53:50.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.549+0000 7f9aded9d700 1 --2- 172.21.15.50:0/3916438074 >> v2:172.21.15.192:3300/0 conn(0x7f9ae00b04b0 0x7f9ae006bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.553+0000 7f9ade59c700 1 -- 172.21.15.50:0/3916438074 >> v2:172.21.15.192:3300/0 conn(0x7f9ae00b04b0 msgr2=0x7f9ae006bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:50.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.553+0000 7f9ade59c700 1 --2- 172.21.15.50:0/3916438074 >> v2:172.21.15.192:3300/0 conn(0x7f9ae00b04b0 0x7f9ae006bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.553+0000 7f9ade59c700 1 -- 172.21.15.50:0/3916438074 >> v1:172.21.15.192:6789/0 conn(0x7f9ae00cbb30 legacy=0x7f9ae015d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.553+0000 7f9ade59c700 1 -- 172.21.15.50:0/3916438074 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae00ac260 con 0x7f9ae00b00e0 2023-11-28T11:53:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.553+0000 7f9ade59c700 1 --2- 172.21.15.50:0/3916438074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ae00b00e0 0x7f9ae015d170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009e50 tx=0x7f9ad800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c8c2076f520b385 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.553+0000 7f9add59a700 1 -- 172.21.15.50:0/3916438074 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad800e070 con 0x7f9ae00b00e0 2023-11-28T11:53:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.553+0000 7f9add59a700 1 -- 172.21.15.50:0/3916438074 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad800b910 con 0x7f9ae00b00e0 2023-11-28T11:53:50.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.553+0000 7f9add59a700 1 -- 172.21.15.50:0/3916438074 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad800bcc0 con 0x7f9ae00b00e0 2023-11-28T11:53:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.553+0000 7f9adf59e700 1 -- 172.21.15.50:0/3916438074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ae00b00e0 msgr2=0x7f9ae015d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.553+0000 7f9adf59e700 1 --2- 172.21.15.50:0/3916438074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ae00b00e0 0x7f9ae015d170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009e50 tx=0x7f9ad800b330 comp rx=0 tx=0).stop 2023-11-28T11:53:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.553+0000 7f9adf59e700 1 -- 172.21.15.50:0/3916438074 shutdown_connections 2023-11-28T11:53:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.553+0000 7f9adf59e700 1 --2- 172.21.15.50:0/3916438074 >> v2:172.21.15.192:3300/0 conn(0x7f9ae00b04b0 0x7f9ae006bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.553+0000 7f9adf59e700 1 --2- 172.21.15.50:0/3916438074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ae00b00e0 0x7f9ae015d170 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.553+0000 7f9adf59e700 1 -- 172.21.15.50:0/3916438074 >> 172.21.15.50:0/3916438074 conn(0x7f9ae00cae70 msgr2=0x7f9ae00cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.553+0000 7f9adf59e700 1 -- 172.21.15.50:0/3916438074 shutdown_connections 2023-11-28T11:53:50.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.553+0000 7f9adf59e700 1 -- 172.21.15.50:0/3916438074 wait complete. 2023-11-28T11:53:50.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9adf59e700 1 Processor -- start 2023-11-28T11:53:50.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9adf59e700 1 -- start start 2023-11-28T11:53:50.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9adf59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae00b00e0 0x7f9ae00c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9adf59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ae00b04b0 0x7f9ae0156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9adf59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ae00cbb30 0x7f9ae015bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9adf59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae01567d0 con 0x7f9ae00b00e0 2023-11-28T11:53:50.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9adf59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00c5660 con 0x7f9ae00cbb30 2023-11-28T11:53:50.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9adf59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00c5940 con 0x7f9ae00b04b0 2023-11-28T11:53:50.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9ade59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae00b00e0 0x7f9ae00c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9ade59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae00b00e0 0x7f9ae00c8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36768/0 (socket says 172.21.15.50:36768) 2023-11-28T11:53:50.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9ade59c700 1 -- 172.21.15.50:0/3734998264 learned_addr learned my addr 172.21.15.50:0/3734998264 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:50.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9aded9d700 1 --2- 172.21.15.50:0/3734998264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ae00cbb30 0x7f9ae015bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9addd9b700 1 --2- 172.21.15.50:0/3734998264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ae00b04b0 0x7f9ae0156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9ade59c700 1 -- 172.21.15.50:0/3734998264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ae00b04b0 msgr2=0x7f9ae0156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9ade59c700 1 --2- 172.21.15.50:0/3734998264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ae00b04b0 0x7f9ae0156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9ade59c700 1 -- 172.21.15.50:0/3734998264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ae00cbb30 msgr2=0x7f9ae015bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9ade59c700 1 --2- 172.21.15.50:0/3734998264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ae00cbb30 0x7f9ae015bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9ade59c700 1 -- 172.21.15.50:0/3734998264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad8009b30 con 0x7f9ae00b00e0 2023-11-28T11:53:50.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9ade59c700 1 --2- 172.21.15.50:0/3734998264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae00b00e0 0x7f9ae00c8030 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800b370 tx=0x7f9ad8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:50.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9aceffd700 1 -- 172.21.15.50:0/3734998264 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad80048b0 con 0x7f9ae00b00e0 2023-11-28T11:53:50.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9aceffd700 1 -- 172.21.15.50:0/3734998264 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad80092e0 con 0x7f9ae00b00e0 2023-11-28T11:53:50.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9adf59e700 1 -- 172.21.15.50:0/3734998264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae009bdb0 con 0x7f9ae00b00e0 2023-11-28T11:53:50.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9aceffd700 1 -- 172.21.15.50:0/3734998264 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad801c680 con 0x7f9ae00b00e0 2023-11-28T11:53:50.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.557+0000 7f9adf59e700 1 -- 172.21.15.50:0/3734998264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae00cc660 con 0x7f9ae00b00e0 2023-11-28T11:53:50.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.561+0000 7f9adf59e700 1 -- 172.21.15.50:0/3734998264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae00cc9f0 con 0x7f9ae00b00e0 2023-11-28T11:53:50.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.561+0000 7f9aceffd700 1 -- 172.21.15.50:0/3734998264 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9ad8022030 con 0x7f9ae00b00e0 2023-11-28T11:53:50.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.561+0000 7f9aceffd700 1 --2- 172.21.15.50:0/3734998264 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9ac0064ee0 0x7f9ac0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.561+0000 7f9aceffd700 1 -- 172.21.15.50:0/3734998264 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9ad80839f0 con 0x7f9ae00b00e0 2023-11-28T11:53:50.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.561+0000 7f9addd9b700 1 --2- 172.21.15.50:0/3734998264 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9ac0064ee0 0x7f9ac0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.565+0000 7f9addd9b700 1 --2- 172.21.15.50:0/3734998264 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9ac0064ee0 0x7f9ac0067390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00c9f80 tx=0x7f9ad4007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:50.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.569+0000 7f9aceffd700 1 -- 172.21.15.50:0/3734998264 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9ad8085e60 con 0x7f9ae00b00e0 2023-11-28T11:53:50.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.725+0000 7f9adf59e700 1 -- 172.21.15.50:0/3734998264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9ae0072500 con 0x7f9ae00b00e0 2023-11-28T11:53:50.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.729+0000 7f9aceffd700 1 -- 172.21.15.50:0/3734998264 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ad80518a0 con 0x7f9ae00b00e0 2023-11-28T11:53:50.731 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:53:50.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.729+0000 7f9adf59e700 1 -- 172.21.15.50:0/3734998264 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9ac0064ee0 msgr2=0x7f9ac0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.729+0000 7f9adf59e700 1 --2- 172.21.15.50:0/3734998264 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9ac0064ee0 0x7f9ac0067390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00c9f80 tx=0x7f9ad4007d30 comp rx=0 tx=0).stop 2023-11-28T11:53:50.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.729+0000 7f9adf59e700 1 -- 172.21.15.50:0/3734998264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae00b00e0 msgr2=0x7f9ae00c8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.729+0000 7f9adf59e700 1 --2- 172.21.15.50:0/3734998264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae00b00e0 0x7f9ae00c8030 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800b370 tx=0x7f9ad8004af0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.729+0000 7f9adf59e700 1 -- 172.21.15.50:0/3734998264 shutdown_connections 2023-11-28T11:53:50.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.729+0000 7f9adf59e700 1 --2- 172.21.15.50:0/3734998264 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9ac0064ee0 0x7f9ac0067390 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.729+0000 7f9adf59e700 1 --2- 172.21.15.50:0/3734998264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ae00cbb30 0x7f9ae015bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.729+0000 7f9adf59e700 1 --2- 172.21.15.50:0/3734998264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ae00b04b0 0x7f9ae0156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.729+0000 7f9adf59e700 1 --2- 172.21.15.50:0/3734998264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ae00b00e0 0x7f9ae00c8030 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.729+0000 7f9adf59e700 1 -- 172.21.15.50:0/3734998264 >> 172.21.15.50:0/3734998264 conn(0x7f9ae00cae70 msgr2=0x7f9ae00ae2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:50.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.729+0000 7f9adf59e700 1 -- 172.21.15.50:0/3734998264 shutdown_connections 2023-11-28T11:53:50.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.729+0000 7f9adf59e700 1 -- 172.21.15.50:0/3734998264 wait complete. 2023-11-28T11:53:50.747 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:53:50.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.861+0000 7fa8b8813700 1 Processor -- start 2023-11-28T11:53:50.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.861+0000 7fa8b8813700 1 -- start start 2023-11-28T11:53:50.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b8813700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa8b406f010 0x7fa8b4161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b8813700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8b40cbaf0 0x7fa8b4163fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b8813700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b415a3a0 con 0x7fa8b406a6e0 2023-11-28T11:53:50.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b8813700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b40ca430 con 0x7fa8b40cbaf0 2023-11-28T11:53:50.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b8813700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b40ca710 con 0x7fa8b406f010 2023-11-28T11:53:50.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8b40cbaf0 0x7fa8b4163fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8b40cbaf0 0x7fa8b4163fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36782/0 (socket says 172.21.15.50:36782) 2023-11-28T11:53:50.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b3fff700 1 -- 172.21.15.50:0/1873460058 learned_addr learned my addr 172.21.15.50:0/1873460058 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:50.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8abfff700 1 --2- 172.21.15.50:0/1873460058 >> v2:172.21.15.192:3300/0 conn(0x7fa8b406f010 0x7fa8b4161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b3fff700 1 -- 172.21.15.50:0/1873460058 >> v2:172.21.15.192:3300/0 conn(0x7fa8b406f010 msgr2=0x7fa8b4161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:50.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b3fff700 1 --2- 172.21.15.50:0/1873460058 >> v2:172.21.15.192:3300/0 conn(0x7fa8b406f010 0x7fa8b4161a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b3fff700 1 -- 172.21.15.50:0/1873460058 >> v1:172.21.15.192:6789/0 conn(0x7fa8b406a6e0 legacy=0x7fa8b406aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b3fff700 1 -- 172.21.15.50:0/1873460058 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b40ca9f0 con 0x7fa8b40cbaf0 2023-11-28T11:53:50.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b3fff700 1 --2- 172.21.15.50:0/1873460058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b40cbaf0 0x7fa8b4163fb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4069e50 tx=0x7fa8ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5da4eb1c79b498 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:50.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b2ffd700 1 -- 172.21.15.50:0/1873460058 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac00e070 con 0x7fa8b40cbaf0 2023-11-28T11:53:50.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b2ffd700 1 -- 172.21.15.50:0/1873460058 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac00b9c0 con 0x7fa8b40cbaf0 2023-11-28T11:53:50.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b2ffd700 1 -- 172.21.15.50:0/1873460058 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac00bd70 con 0x7fa8b40cbaf0 2023-11-28T11:53:50.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b8813700 1 -- 172.21.15.50:0/1873460058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b40cbaf0 msgr2=0x7fa8b4163fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b8813700 1 --2- 172.21.15.50:0/1873460058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b40cbaf0 0x7fa8b4163fb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4069e50 tx=0x7fa8ac00b330 comp rx=0 tx=0).stop 2023-11-28T11:53:50.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b8813700 1 -- 172.21.15.50:0/1873460058 shutdown_connections 2023-11-28T11:53:50.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b8813700 1 --2- 172.21.15.50:0/1873460058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b40cbaf0 0x7fa8b4163fb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b8813700 1 --2- 172.21.15.50:0/1873460058 >> v2:172.21.15.192:3300/0 conn(0x7fa8b406f010 0x7fa8b4161a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b8813700 1 -- 172.21.15.50:0/1873460058 >> 172.21.15.50:0/1873460058 conn(0x7fa8b40d0240 msgr2=0x7fa8b40cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:50.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b8813700 1 -- 172.21.15.50:0/1873460058 shutdown_connections 2023-11-28T11:53:50.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.865+0000 7fa8b8813700 1 -- 172.21.15.50:0/1873460058 wait complete. 2023-11-28T11:53:50.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.869+0000 7fa8b8813700 1 Processor -- start 2023-11-28T11:53:50.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.869+0000 7fa8b8813700 1 -- start start 2023-11-28T11:53:50.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.869+0000 7fa8b8813700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b406a6e0 0x7fa8b40ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.869+0000 7fa8b8813700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8b406f010 0x7fa8b40c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.869+0000 7fa8b8813700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8b40cbaf0 0x7fa8b41581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.869+0000 7fa8b8813700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40c9cd0 con 0x7fa8b406a6e0 2023-11-28T11:53:50.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.869+0000 7fa8b8813700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40abf40 con 0x7fa8b40cbaf0 2023-11-28T11:53:50.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.869+0000 7fa8b8813700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40ac220 con 0x7fa8b406f010 2023-11-28T11:53:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.869+0000 7fa8b37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b406a6e0 0x7fa8b40ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.869+0000 7fa8b37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b406a6e0 0x7fa8b40ab860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36794/0 (socket says 172.21.15.50:36794) 2023-11-28T11:53:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.869+0000 7fa8b37fe700 1 -- 172.21.15.50:0/977917637 learned_addr learned my addr 172.21.15.50:0/977917637 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.873+0000 7fa8b3fff700 1 --2- 172.21.15.50:0/977917637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8b40cbaf0 0x7fa8b41581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.873+0000 7fa8abfff700 1 --2- 172.21.15.50:0/977917637 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8b406f010 0x7fa8b40c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.873+0000 7fa8b37fe700 1 -- 172.21.15.50:0/977917637 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8b406f010 msgr2=0x7fa8b40c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.873+0000 7fa8b37fe700 1 --2- 172.21.15.50:0/977917637 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8b406f010 0x7fa8b40c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.873+0000 7fa8b37fe700 1 -- 172.21.15.50:0/977917637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8b40cbaf0 msgr2=0x7fa8b41581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:50.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.873+0000 7fa8b37fe700 1 --2- 172.21.15.50:0/977917637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8b40cbaf0 0x7fa8b41581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:50.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.873+0000 7fa8b37fe700 1 -- 172.21.15.50:0/977917637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac009b30 con 0x7fa8b406a6e0 2023-11-28T11:53:50.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.873+0000 7fa8b37fe700 1 --2- 172.21.15.50:0/977917637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b406a6e0 0x7fa8b40ab860 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa8a400c500 tx=0x7fa8a400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:50.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.873+0000 7fa8b0ff9700 1 -- 172.21.15.50:0/977917637 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a40052d0 con 0x7fa8b406a6e0 2023-11-28T11:53:50.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.873+0000 7fa8b0ff9700 1 -- 172.21.15.50:0/977917637 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a4005430 con 0x7fa8b406a6e0 2023-11-28T11:53:50.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.873+0000 7fa8b0ff9700 1 -- 172.21.15.50:0/977917637 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a40055a0 con 0x7fa8b406a6e0 2023-11-28T11:53:50.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.873+0000 7fa8b8813700 1 -- 172.21.15.50:0/977917637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b40cafb0 con 0x7fa8b406a6e0 2023-11-28T11:53:50.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.873+0000 7fa8b8813700 1 -- 172.21.15.50:0/977917637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b40cacd0 con 0x7fa8b406a6e0 2023-11-28T11:53:50.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.873+0000 7fa8b8813700 1 -- 172.21.15.50:0/977917637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b40ca070 con 0x7fa8b406a6e0 2023-11-28T11:53:50.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.877+0000 7fa8b0ff9700 1 -- 172.21.15.50:0/977917637 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa8a4019030 con 0x7fa8b406a6e0 2023-11-28T11:53:50.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.877+0000 7fa8b0ff9700 1 --2- 172.21.15.50:0/977917637 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa894064f30 0x7fa8940673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:50.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.881+0000 7fa8b0ff9700 1 -- 172.21.15.50:0/977917637 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa8a40816d0 con 0x7fa8b406a6e0 2023-11-28T11:53:50.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.881+0000 7fa8abfff700 1 --2- 172.21.15.50:0/977917637 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa894064f30 0x7fa8940673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:50.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.881+0000 7fa8abfff700 1 --2- 172.21.15.50:0/977917637 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa894064f30 0x7fa8940673e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40ae720 tx=0x7fa89c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:50.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:50.881+0000 7fa8b0ff9700 1 -- 172.21.15.50:0/977917637 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa8a404f510 con 0x7fa8b406a6e0 2023-11-28T11:53:51.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.037+0000 7fa8b8813700 1 -- 172.21.15.50:0/977917637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8b415a3a0 con 0x7fa8b406a6e0 2023-11-28T11:53:51.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.037+0000 7fa8b0ff9700 1 -- 172.21.15.50:0/977917637 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8b415a3a0 con 0x7fa8b406a6e0 2023-11-28T11:53:51.041 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:53:51.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.041+0000 7fa8b8813700 1 -- 172.21.15.50:0/977917637 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa894064f30 msgr2=0x7fa8940673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.041+0000 7fa8b8813700 1 --2- 172.21.15.50:0/977917637 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa894064f30 0x7fa8940673e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40ae720 tx=0x7fa89c008040 comp rx=0 tx=0).stop 2023-11-28T11:53:51.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.041+0000 7fa8b8813700 1 -- 172.21.15.50:0/977917637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b406a6e0 msgr2=0x7fa8b40ab860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.041+0000 7fa8b8813700 1 --2- 172.21.15.50:0/977917637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b406a6e0 0x7fa8b40ab860 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa8a400c500 tx=0x7fa8a400c810 comp rx=0 tx=0).stop 2023-11-28T11:53:51.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.041+0000 7fa8b8813700 1 -- 172.21.15.50:0/977917637 shutdown_connections 2023-11-28T11:53:51.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.041+0000 7fa8b8813700 1 --2- 172.21.15.50:0/977917637 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa894064f30 0x7fa8940673e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.041+0000 7fa8b8813700 1 --2- 172.21.15.50:0/977917637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8b40cbaf0 0x7fa8b41581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.041+0000 7fa8b8813700 1 --2- 172.21.15.50:0/977917637 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8b406f010 0x7fa8b40c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.041+0000 7fa8b8813700 1 --2- 172.21.15.50:0/977917637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b406a6e0 0x7fa8b40ab860 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.041+0000 7fa8b8813700 1 -- 172.21.15.50:0/977917637 >> 172.21.15.50:0/977917637 conn(0x7fa8b40d0240 msgr2=0x7fa8b40ae900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.041+0000 7fa8b8813700 1 -- 172.21.15.50:0/977917637 shutdown_connections 2023-11-28T11:53:51.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.041+0000 7fa8b8813700 1 -- 172.21.15.50:0/977917637 wait complete. 2023-11-28T11:53:51.055 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:53:51.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad9fe8700 1 Processor -- start 2023-11-28T11:53:51.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad9fe8700 1 -- start start 2023-11-28T11:53:51.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad9fe8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad415a3e0 0x7faad40ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad9fe8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad409c0e0 con 0x7faad40b2d30 2023-11-28T11:53:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad9fe8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad40b13e0 con 0x7faad40cc2f0 2023-11-28T11:53:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad9fe8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad40b16c0 con 0x7faad415a3e0 2023-11-28T11:53:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad97e7700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faad40b2d30 0x7faad4069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38910/0 (socket says 172.21.15.50:38910) 2023-11-28T11:53:51.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad97e7700 1 -- 172.21.15.50:0/2801322564 learned_addr learned my addr 172.21.15.50:0/2801322564 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad3fff700 1 --2- 172.21.15.50:0/2801322564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad415a3e0 0x7faad40ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad37fe700 1 -- 172.21.15.50:0/2801322564 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034320271 0 0) 0x7faad409c0e0 con 0x7faad40b2d30 2023-11-28T11:53:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad37fe700 1 -- 172.21.15.50:0/2801322564 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faab40035d0 con 0x7faad40b2d30 2023-11-28T11:53:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad37fe700 1 -- 172.21.15.50:0/2801322564 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268718459 0 0) 0x7faad40b13e0 con 0x7faad40cc2f0 2023-11-28T11:53:51.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad37fe700 1 -- 172.21.15.50:0/2801322564 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faad409c0e0 con 0x7faad40cc2f0 2023-11-28T11:53:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad37fe700 1 -- 172.21.15.50:0/2801322564 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2434273779 0 0) 0x7faab40035d0 con 0x7faad40b2d30 2023-11-28T11:53:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad37fe700 1 -- 172.21.15.50:0/2801322564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad415a3e0 msgr2=0x7faad40ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad37fe700 1 --2- 172.21.15.50:0/2801322564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad415a3e0 0x7faad40ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad37fe700 1 -- 172.21.15.50:0/2801322564 >> v1:172.21.15.192:6789/0 conn(0x7faad40cc2f0 legacy=0x7faad40cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad37fe700 1 -- 172.21.15.50:0/2801322564 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad40b19a0 con 0x7faad40b2d30 2023-11-28T11:53:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad37fe700 1 -- 172.21.15.50:0/2801322564 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7faacc0019f0 con 0x7faad40b2d30 2023-11-28T11:53:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad37fe700 1 -- 172.21.15.50:0/2801322564 >> v1:172.21.15.50:6789/0 conn(0x7faad40b2d30 legacy=0x7faad4069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad37fe700 1 --2- 172.21.15.50:0/2801322564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad415a3e0 0x7faab4003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad37fe700 1 --2- 172.21.15.50:0/2801322564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faab4004140 0x7faab4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad37fe700 1 --2- 172.21.15.50:0/2801322564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faab4004db0 0x7faab4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad37fe700 1 -- 172.21.15.50:0/2801322564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad40b16c0 con 0x7faab4004db0 2023-11-28T11:53:51.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad37fe700 1 -- 172.21.15.50:0/2801322564 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab400bae0 con 0x7faab4004140 2023-11-28T11:53:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad37fe700 1 -- 172.21.15.50:0/2801322564 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab400bca0 con 0x7faad415a3e0 2023-11-28T11:53:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad97e7700 1 --2- 172.21.15.50:0/2801322564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faab4004db0 0x7faab4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad3fff700 1 --2- 172.21.15.50:0/2801322564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faab4004140 0x7faab4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.165+0000 7faad8fe6700 1 --2- 172.21.15.50:0/2801322564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad415a3e0 0x7faab4003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.169+0000 7faad97e7700 1 -- 172.21.15.50:0/2801322564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad415a3e0 msgr2=0x7faab4003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.169+0000 7faad97e7700 1 --2- 172.21.15.50:0/2801322564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad415a3e0 0x7faab4003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.169+0000 7faad97e7700 1 -- 172.21.15.50:0/2801322564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faab4004140 msgr2=0x7faab4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.169+0000 7faad97e7700 1 --2- 172.21.15.50:0/2801322564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faab4004140 0x7faab4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.169+0000 7faad97e7700 1 -- 172.21.15.50:0/2801322564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab40035d0 con 0x7faab4004db0 2023-11-28T11:53:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.169+0000 7faad97e7700 1 --2- 172.21.15.50:0/2801322564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faab4004db0 0x7faab4005220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faacc002230 tx=0x7faab40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c96fa9c25e3fcb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.169+0000 7faad37fe700 1 -- 172.21.15.50:0/2801322564 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0072d0 con 0x7faab4004db0 2023-11-28T11:53:51.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.169+0000 7faad37fe700 1 -- 172.21.15.50:0/2801322564 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc007430 con 0x7faab4004db0 2023-11-28T11:53:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.169+0000 7faad37fe700 1 -- 172.21.15.50:0/2801322564 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0077a0 con 0x7faab4004db0 2023-11-28T11:53:51.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.169+0000 7faad9fe8700 1 -- 172.21.15.50:0/2801322564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faab4004db0 msgr2=0x7faab4005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.169+0000 7faad9fe8700 1 --2- 172.21.15.50:0/2801322564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faab4004db0 0x7faab4005220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faacc002230 tx=0x7faab40058a0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.169+0000 7faad97e7700 1 -- 172.21.15.50:0/2801322564 reap_dead start 2023-11-28T11:53:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.169+0000 7faad9fe8700 1 -- 172.21.15.50:0/2801322564 shutdown_connections 2023-11-28T11:53:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.169+0000 7faad9fe8700 1 -- 172.21.15.50:0/2801322564 >> 172.21.15.50:0/2801322564 conn(0x7faad40cae70 msgr2=0x7faad40cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.169+0000 7faad9fe8700 1 -- 172.21.15.50:0/2801322564 shutdown_connections 2023-11-28T11:53:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.169+0000 7faad9fe8700 1 -- 172.21.15.50:0/2801322564 wait complete. 2023-11-28T11:53:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.169+0000 7faad9fe8700 1 Processor -- start 2023-11-28T11:53:51.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad9fe8700 1 -- start start 2023-11-28T11:53:51.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad9fe8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faab4004db0 0x7faad4150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad9fe8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad40adfe0 0x7faad415a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad9fe8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad415acf0 0x7faad41582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad9fe8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad4157e50 con 0x7faad40adfe0 2023-11-28T11:53:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad9fe8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad4157240 con 0x7faab4004db0 2023-11-28T11:53:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad9fe8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad4157520 con 0x7faad415acf0 2023-11-28T11:53:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad40adfe0 0x7faad415a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad8fe6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faab4004db0 0x7faad4150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad8fe6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faab4004db0 0x7faad4150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:35170/0 (socket says 172.21.15.50:35170) 2023-11-28T11:53:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad8fe6700 1 -- 172.21.15.50:0/3812269667 learned_addr learned my addr 172.21.15.50:0/3812269667 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad97e7700 1 --2- 172.21.15.50:0/3812269667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad415acf0 0x7faad41582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad3fff700 1 -- 172.21.15.50:0/3812269667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad415acf0 msgr2=0x7faad41582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad3fff700 1 --2- 172.21.15.50:0/3812269667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad415acf0 0x7faad41582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad3fff700 1 -- 172.21.15.50:0/3812269667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faab4004db0 msgr2=0x7faad4150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad3fff700 1 --2- 172.21.15.50:0/3812269667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faab4004db0 0x7faad4150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad3fff700 1 -- 172.21.15.50:0/3812269667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad406a350 con 0x7faad40adfe0 2023-11-28T11:53:51.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad8fe6700 1 --2- 172.21.15.50:0/3812269667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faab4004db0 0x7faad4150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:53:51.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad3fff700 1 --2- 172.21.15.50:0/3812269667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad40adfe0 0x7faad415a7b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faabc0118e0 tx=0x7faabc011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:51.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad17fa700 1 -- 172.21.15.50:0/3812269667 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc004300 con 0x7faad40adfe0 2023-11-28T11:53:51.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad17fa700 1 -- 172.21.15.50:0/3812269667 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faabc004460 con 0x7faad40adfe0 2023-11-28T11:53:51.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad9fe8700 1 -- 172.21.15.50:0/3812269667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad40b1c80 con 0x7faad40adfe0 2023-11-28T11:53:51.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad17fa700 1 -- 172.21.15.50:0/3812269667 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc0045d0 con 0x7faad40adfe0 2023-11-28T11:53:51.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.173+0000 7faad9fe8700 1 -- 172.21.15.50:0/3812269667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad40ac280 con 0x7faad40adfe0 2023-11-28T11:53:51.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.177+0000 7faad9fe8700 1 -- 172.21.15.50:0/3812269667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad4157fc0 con 0x7faad40adfe0 2023-11-28T11:53:51.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.177+0000 7faad17fa700 1 -- 172.21.15.50:0/3812269667 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faabc024070 con 0x7faad40adfe0 2023-11-28T11:53:51.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.177+0000 7faad17fa700 1 --2- 172.21.15.50:0/3812269667 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faab8064ee0 0x7faab8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.177+0000 7faad17fa700 1 -- 172.21.15.50:0/3812269667 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faabc018030 con 0x7faad40adfe0 2023-11-28T11:53:51.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.177+0000 7faad8fe6700 1 --2- 172.21.15.50:0/3812269667 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faab8064ee0 0x7faab8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.181+0000 7faad8fe6700 1 --2- 172.21.15.50:0/3812269667 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faab8064ee0 0x7faab8067390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faac4007900 tx=0x7faac4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:51.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.185+0000 7faad17fa700 1 -- 172.21.15.50:0/3812269667 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faabc0504b0 con 0x7faad40adfe0 2023-11-28T11:53:51.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.345+0000 7faad9fe8700 1 -- 172.21.15.50:0/3812269667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faad4072500 con 0x7faad40adfe0 2023-11-28T11:53:51.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.345+0000 7faad17fa700 1 -- 172.21.15.50:0/3812269667 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7faabc0220a0 con 0x7faad40adfe0 2023-11-28T11:53:51.349 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:53:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.349+0000 7faad9fe8700 1 -- 172.21.15.50:0/3812269667 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faab8064ee0 msgr2=0x7faab8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.349+0000 7faad9fe8700 1 --2- 172.21.15.50:0/3812269667 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faab8064ee0 0x7faab8067390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faac4007900 tx=0x7faac4009040 comp rx=0 tx=0).stop 2023-11-28T11:53:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.349+0000 7faad9fe8700 1 -- 172.21.15.50:0/3812269667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad40adfe0 msgr2=0x7faad415a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.349+0000 7faad9fe8700 1 --2- 172.21.15.50:0/3812269667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad40adfe0 0x7faad415a7b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faabc0118e0 tx=0x7faabc011bf0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.349+0000 7faad9fe8700 1 -- 172.21.15.50:0/3812269667 shutdown_connections 2023-11-28T11:53:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.349+0000 7faad9fe8700 1 --2- 172.21.15.50:0/3812269667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad415acf0 0x7faad41582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.349+0000 7faad9fe8700 1 --2- 172.21.15.50:0/3812269667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad40adfe0 0x7faad415a7b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.349+0000 7faad9fe8700 1 --2- 172.21.15.50:0/3812269667 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faab8064ee0 0x7faab8067390 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.349+0000 7faad9fe8700 1 --2- 172.21.15.50:0/3812269667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faab4004db0 0x7faad4150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.349+0000 7faad9fe8700 1 -- 172.21.15.50:0/3812269667 >> 172.21.15.50:0/3812269667 conn(0x7faad40cae70 msgr2=0x7faad40c9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:51.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.349+0000 7faad9fe8700 1 -- 172.21.15.50:0/3812269667 shutdown_connections 2023-11-28T11:53:51.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.349+0000 7faad9fe8700 1 -- 172.21.15.50:0/3812269667 wait complete. 2023-11-28T11:53:51.364 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:53:51.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.477+0000 7efcf3fff700 1 Processor -- start 2023-11-28T11:53:51.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.477+0000 7efcf3fff700 1 -- start start 2023-11-28T11:53:51.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.477+0000 7efcf3fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcec048850 0x7efcec037000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.477+0000 7efcf3fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efcec048c20 0x7efcec037540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.477+0000 7efcf3fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcec006e60 con 0x7efcec03b1d0 2023-11-28T11:53:51.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.477+0000 7efcf3fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcec007420 con 0x7efcec048c20 2023-11-28T11:53:51.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.477+0000 7efcf3fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcec007140 con 0x7efcec048850 2023-11-28T11:53:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.477+0000 7efcf2ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcec048850 0x7efcec037000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.477+0000 7efcf27fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efcec048c20 0x7efcec037540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.477+0000 7efcf2ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcec048850 0x7efcec037000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:41110/0 (socket says 172.21.15.50:41110) 2023-11-28T11:53:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.477+0000 7efcf2ffd700 1 -- 172.21.15.50:0/296315844 learned_addr learned my addr 172.21.15.50:0/296315844 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.477+0000 7efcf37fe700 1 --1- 172.21.15.50:0/296315844 >> v1:172.21.15.192:6789/0 conn(0x7efcec03b1d0 0x7efcec050eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:38254/0 (socket says 172.21.15.50:38254) 2023-11-28T11:53:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.481+0000 7efcf2ffd700 1 -- 172.21.15.50:0/296315844 >> v2:172.21.15.192:3300/0 conn(0x7efcec048c20 msgr2=0x7efcec037540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.481+0000 7efcf2ffd700 1 --2- 172.21.15.50:0/296315844 >> v2:172.21.15.192:3300/0 conn(0x7efcec048c20 0x7efcec037540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.481+0000 7efcf2ffd700 1 -- 172.21.15.50:0/296315844 >> v1:172.21.15.192:6789/0 conn(0x7efcec03b1d0 legacy=0x7efcec050eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.481+0000 7efcf2ffd700 1 -- 172.21.15.50:0/296315844 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec007e60 con 0x7efcec048850 2023-11-28T11:53:51.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.481+0000 7efcf2ffd700 1 --2- 172.21.15.50:0/296315844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcec048850 0x7efcec037000 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efce4009910 tx=0x7efce4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea08cec1a85c8aa1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:51.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.481+0000 7efcf1ffb700 1 -- 172.21.15.50:0/296315844 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4011830 con 0x7efcec048850 2023-11-28T11:53:51.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.481+0000 7efcf1ffb700 1 -- 172.21.15.50:0/296315844 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce4011990 con 0x7efcec048850 2023-11-28T11:53:51.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.481+0000 7efcf1ffb700 1 -- 172.21.15.50:0/296315844 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4011d40 con 0x7efcec048850 2023-11-28T11:53:51.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.481+0000 7efcf3fff700 1 -- 172.21.15.50:0/296315844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcec048850 msgr2=0x7efcec037000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.481+0000 7efcf3fff700 1 --2- 172.21.15.50:0/296315844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcec048850 0x7efcec037000 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efce4009910 tx=0x7efce4009c20 comp rx=0 tx=0).stop 2023-11-28T11:53:51.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.481+0000 7efcf3fff700 1 -- 172.21.15.50:0/296315844 shutdown_connections 2023-11-28T11:53:51.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.481+0000 7efcf3fff700 1 --2- 172.21.15.50:0/296315844 >> v2:172.21.15.192:3300/0 conn(0x7efcec048c20 0x7efcec037540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.481+0000 7efcf3fff700 1 --2- 172.21.15.50:0/296315844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcec048850 0x7efcec037000 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.481+0000 7efcf3fff700 1 -- 172.21.15.50:0/296315844 >> 172.21.15.50:0/296315844 conn(0x7efcec052000 msgr2=0x7efcec052400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:51.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.481+0000 7efcf3fff700 1 -- 172.21.15.50:0/296315844 shutdown_connections 2023-11-28T11:53:51.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.481+0000 7efcf3fff700 1 -- 172.21.15.50:0/296315844 wait complete. 2023-11-28T11:53:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.481+0000 7efcf3fff700 1 Processor -- start 2023-11-28T11:53:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf3fff700 1 -- start start 2023-11-28T11:53:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcec03b1d0 0x7efcec04e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf3fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcec048850 0x7efcec17d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcec17c210 0x7efcec0dca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf3fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec04ae40 con 0x7efcec03b1d0 2023-11-28T11:53:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf3fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec04e980 con 0x7efcec17c210 2023-11-28T11:53:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf3fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcec17c6a0 con 0x7efcec048850 2023-11-28T11:53:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcec03b1d0 0x7efcec04e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcec03b1d0 0x7efcec04e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36816/0 (socket says 172.21.15.50:36816) 2023-11-28T11:53:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf2ffd700 1 -- 172.21.15.50:0/1075088126 learned_addr learned my addr 172.21.15.50:0/1075088126 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf27fc700 1 --2- 172.21.15.50:0/1075088126 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcec048850 0x7efcec17d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf37fe700 1 --2- 172.21.15.50:0/1075088126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcec17c210 0x7efcec0dca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf2ffd700 1 -- 172.21.15.50:0/1075088126 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcec048850 msgr2=0x7efcec17d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf2ffd700 1 --2- 172.21.15.50:0/1075088126 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcec048850 0x7efcec17d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf2ffd700 1 -- 172.21.15.50:0/1075088126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcec17c210 msgr2=0x7efcec0dca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf2ffd700 1 --2- 172.21.15.50:0/1075088126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcec17c210 0x7efcec0dca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf2ffd700 1 -- 172.21.15.50:0/1075088126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce4009570 con 0x7efcec03b1d0 2023-11-28T11:53:51.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf2ffd700 1 --2- 172.21.15.50:0/1075088126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcec03b1d0 0x7efcec04e440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efce4000c00 tx=0x7efce4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:51.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcdb7fe700 1 -- 172.21.15.50:0/1075088126 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4004380 con 0x7efcec03b1d0 2023-11-28T11:53:51.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcdb7fe700 1 -- 172.21.15.50:0/1075088126 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce401f070 con 0x7efcec03b1d0 2023-11-28T11:53:51.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf3fff700 1 -- 172.21.15.50:0/1075088126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcec0544b0 con 0x7efcec03b1d0 2023-11-28T11:53:51.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcdb7fe700 1 -- 172.21.15.50:0/1075088126 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce40036c0 con 0x7efcec03b1d0 2023-11-28T11:53:51.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.485+0000 7efcf3fff700 1 -- 172.21.15.50:0/1075088126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcec008140 con 0x7efcec03b1d0 2023-11-28T11:53:51.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.489+0000 7efcf3fff700 1 -- 172.21.15.50:0/1075088126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcec054640 con 0x7efcec03b1d0 2023-11-28T11:53:51.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.489+0000 7efcdb7fe700 1 -- 172.21.15.50:0/1075088126 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efce400f050 con 0x7efcec03b1d0 2023-11-28T11:53:51.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.489+0000 7efcdb7fe700 1 --2- 172.21.15.50:0/1075088126 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efce0064ee0 0x7efce0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.489+0000 7efcdb7fe700 1 -- 172.21.15.50:0/1075088126 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efce4083650 con 0x7efcec03b1d0 2023-11-28T11:53:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.489+0000 7efcf27fc700 1 --2- 172.21.15.50:0/1075088126 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efce0064ee0 0x7efce0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.489+0000 7efcf27fc700 1 --2- 172.21.15.50:0/1075088126 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efce0064ee0 0x7efce0067390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efce8009bf0 tx=0x7efce8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:51.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.493+0000 7efcdb7fe700 1 -- 172.21.15.50:0/1075088126 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efce4051410 con 0x7efcec03b1d0 2023-11-28T11:53:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.661+0000 7efcf3fff700 1 -- 172.21.15.50:0/1075088126 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efcec0525e0 con 0x7efcec03b1d0 2023-11-28T11:53:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.661+0000 7efcdb7fe700 1 -- 172.21.15.50:0/1075088126 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7efce40150a0 con 0x7efcec03b1d0 2023-11-28T11:53:51.666 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:53:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.665+0000 7efcf3fff700 1 -- 172.21.15.50:0/1075088126 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efce0064ee0 msgr2=0x7efce0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.665+0000 7efcf3fff700 1 --2- 172.21.15.50:0/1075088126 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efce0064ee0 0x7efce0067390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efce8009bf0 tx=0x7efce8009240 comp rx=0 tx=0).stop 2023-11-28T11:53:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.665+0000 7efcf3fff700 1 -- 172.21.15.50:0/1075088126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcec03b1d0 msgr2=0x7efcec04e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.665+0000 7efcf3fff700 1 --2- 172.21.15.50:0/1075088126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcec03b1d0 0x7efcec04e440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efce4000c00 tx=0x7efce4004770 comp rx=0 tx=0).stop 2023-11-28T11:53:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.665+0000 7efcf3fff700 1 -- 172.21.15.50:0/1075088126 shutdown_connections 2023-11-28T11:53:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.665+0000 7efcf3fff700 1 --2- 172.21.15.50:0/1075088126 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efce0064ee0 0x7efce0067390 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.665+0000 7efcf3fff700 1 --2- 172.21.15.50:0/1075088126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcec17c210 0x7efcec0dca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.665+0000 7efcf3fff700 1 --2- 172.21.15.50:0/1075088126 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcec048850 0x7efcec17d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.665+0000 7efcf3fff700 1 --2- 172.21.15.50:0/1075088126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efcec03b1d0 0x7efcec04e440 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.665+0000 7efcf3fff700 1 -- 172.21.15.50:0/1075088126 >> 172.21.15.50:0/1075088126 conn(0x7efcec052000 msgr2=0x7efcec036780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.665+0000 7efcf3fff700 1 -- 172.21.15.50:0/1075088126 shutdown_connections 2023-11-28T11:53:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.665+0000 7efcf3fff700 1 -- 172.21.15.50:0/1075088126 wait complete. 2023-11-28T11:53:51.680 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:53:51.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b651cf700 1 Processor -- start 2023-11-28T11:53:51.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b651cf700 1 -- start start 2023-11-28T11:53:51.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b651cf700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b6006a350 0x7f5b601671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b651cf700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b600d0760 con 0x7f5b600b8250 2023-11-28T11:53:51.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b651cf700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b600cd270 con 0x7f5b6006a800 2023-11-28T11:53:51.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b651cf700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b600cd550 con 0x7f5b6006a350 2023-11-28T11:53:51.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b5f59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b6006a350 0x7f5b601671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b5ed9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5b600b8250 0x7f5b600cf8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60128/0 (socket says 172.21.15.50:60128) 2023-11-28T11:53:51.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b5ed9d700 1 -- 172.21.15.50:0/1149874968 learned_addr learned my addr 172.21.15.50:0/1149874968 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:51.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b5dd9b700 1 -- 172.21.15.50:0/1149874968 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676690079 0 0) 0x7f5b600d0760 con 0x7f5b600b8250 2023-11-28T11:53:51.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b5dd9b700 1 -- 172.21.15.50:0/1149874968 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b480035d0 con 0x7f5b600b8250 2023-11-28T11:53:51.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b5f59e700 1 -- 172.21.15.50:0/1149874968 >> v1:172.21.15.192:6789/0 conn(0x7f5b6006a800 legacy=0x7f5b60069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b5f59e700 1 -- 172.21.15.50:0/1149874968 >> v1:172.21.15.50:6789/0 conn(0x7f5b600b8250 legacy=0x7f5b600cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b5dd9b700 1 -- 172.21.15.50:0/1149874968 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578365627 0 0) 0x7f5b600cd270 con 0x7f5b6006a800 2023-11-28T11:53:51.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b5f59e700 1 -- 172.21.15.50:0/1149874968 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b600d0a00 con 0x7f5b6006a350 2023-11-28T11:53:51.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b5f59e700 1 --2- 172.21.15.50:0/1149874968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b6006a350 0x7f5b601671b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009d90 tx=0x7f5b5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0859af5e52828e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:51.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b5dd9b700 1 -- 172.21.15.50:0/1149874968 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5800e070 con 0x7f5b6006a350 2023-11-28T11:53:51.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b5dd9b700 1 -- 172.21.15.50:0/1149874968 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5800bb20 con 0x7f5b6006a350 2023-11-28T11:53:51.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.793+0000 7f5b5dd9b700 1 -- 172.21.15.50:0/1149874968 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5800bed0 con 0x7f5b6006a350 2023-11-28T11:53:51.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.797+0000 7f5b651cf700 1 -- 172.21.15.50:0/1149874968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b6006a350 msgr2=0x7f5b601671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.797+0000 7f5b651cf700 1 --2- 172.21.15.50:0/1149874968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b6006a350 0x7f5b601671b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009d90 tx=0x7f5b5800b330 comp rx=0 tx=0).stop 2023-11-28T11:53:51.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.797+0000 7f5b651cf700 1 -- 172.21.15.50:0/1149874968 shutdown_connections 2023-11-28T11:53:51.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.797+0000 7f5b651cf700 1 --2- 172.21.15.50:0/1149874968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b6006a350 0x7f5b601671b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.797+0000 7f5b651cf700 1 -- 172.21.15.50:0/1149874968 >> 172.21.15.50:0/1149874968 conn(0x7f5b6006beb0 msgr2=0x7f5b6006c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:51.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.797+0000 7f5b651cf700 1 -- 172.21.15.50:0/1149874968 shutdown_connections 2023-11-28T11:53:51.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.797+0000 7f5b651cf700 1 -- 172.21.15.50:0/1149874968 wait complete. 2023-11-28T11:53:51.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.797+0000 7f5b651cf700 1 Processor -- start 2023-11-28T11:53:51.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.797+0000 7f5b651cf700 1 -- start start 2023-11-28T11:53:51.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b651cf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b6006a350 0x7f5b60159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b651cf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b6006a800 0x7f5b600b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b651cf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b600b8250 0x7f5b600b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b651cf700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b601597c0 con 0x7f5b600b8250 2023-11-28T11:53:51.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b651cf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600c6a20 con 0x7f5b6006a800 2023-11-28T11:53:51.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b651cf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b601f2010 con 0x7f5b6006a350 2023-11-28T11:53:51.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b5f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b600b8250 0x7f5b600b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b5f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b600b8250 0x7f5b600b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47822/0 (socket says 172.21.15.50:47822) 2023-11-28T11:53:51.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b5f59e700 1 -- 172.21.15.50:0/2412891809 learned_addr learned my addr 172.21.15.50:0/2412891809 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:51.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b5e59c700 1 --2- 172.21.15.50:0/2412891809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b6006a800 0x7f5b600b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b5ed9d700 1 --2- 172.21.15.50:0/2412891809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b6006a350 0x7f5b60159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b5f59e700 1 -- 172.21.15.50:0/2412891809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b6006a350 msgr2=0x7f5b60159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b5f59e700 1 --2- 172.21.15.50:0/2412891809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b6006a350 0x7f5b60159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b5f59e700 1 -- 172.21.15.50:0/2412891809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b6006a800 msgr2=0x7f5b600b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:51.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b5f59e700 1 --2- 172.21.15.50:0/2412891809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b6006a800 0x7f5b600b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:51.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b5f59e700 1 -- 172.21.15.50:0/2412891809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b58009a70 con 0x7f5b600b8250 2023-11-28T11:53:51.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b5f59e700 1 --2- 172.21.15.50:0/2412891809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b600b8250 0x7f5b600b3c80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5b6006d1e0 tx=0x7f5b58004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:51.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b477fe700 1 -- 172.21.15.50:0/2412891809 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5801c810 con 0x7f5b600b8250 2023-11-28T11:53:51.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b477fe700 1 -- 172.21.15.50:0/2412891809 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b58020070 con 0x7f5b600b8250 2023-11-28T11:53:51.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b477fe700 1 -- 172.21.15.50:0/2412891809 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5801cbb0 con 0x7f5b600b8250 2023-11-28T11:53:51.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b651cf700 1 -- 172.21.15.50:0/2412891809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b600cd830 con 0x7f5b600b8250 2023-11-28T11:53:51.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.801+0000 7f5b651cf700 1 -- 172.21.15.50:0/2412891809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b600b8620 con 0x7f5b600b8250 2023-11-28T11:53:51.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.805+0000 7f5b651cf700 1 -- 172.21.15.50:0/2412891809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b600d1f30 con 0x7f5b600b8250 2023-11-28T11:53:51.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.805+0000 7f5b477fe700 1 -- 172.21.15.50:0/2412891809 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5b5802e070 con 0x7f5b600b8250 2023-11-28T11:53:51.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.805+0000 7f5b477fe700 1 --2- 172.21.15.50:0/2412891809 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b4c064ee0 0x7f5b4c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:51.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.805+0000 7f5b477fe700 1 -- 172.21.15.50:0/2412891809 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5b58022070 con 0x7f5b600b8250 2023-11-28T11:53:51.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.805+0000 7f5b5ed9d700 1 --2- 172.21.15.50:0/2412891809 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b4c064ee0 0x7f5b4c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:51.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.805+0000 7f5b5ed9d700 1 --2- 172.21.15.50:0/2412891809 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b4c064ee0 0x7f5b4c067390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b50007fd0 tx=0x7f5b50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:51.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.813+0000 7f5b477fe700 1 -- 172.21.15.50:0/2412891809 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5b580b4400 con 0x7f5b600b8250 2023-11-28T11:53:51.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.993+0000 7f5b651cf700 1 -- 172.21.15.50:0/2412891809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5b60072500 con 0x7f5b600b8250 2023-11-28T11:53:51.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.993+0000 7f5b477fe700 1 -- 172.21.15.50:0/2412891809 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5b58051f90 con 0x7f5b600b8250 2023-11-28T11:53:52.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.997+0000 7f5b651cf700 1 -- 172.21.15.50:0/2412891809 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b4c064ee0 msgr2=0x7f5b4c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.997+0000 7f5b651cf700 1 --2- 172.21.15.50:0/2412891809 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b4c064ee0 0x7f5b4c067390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b50007fd0 tx=0x7f5b50009040 comp rx=0 tx=0).stop 2023-11-28T11:53:52.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.997+0000 7f5b651cf700 1 -- 172.21.15.50:0/2412891809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b600b8250 msgr2=0x7f5b600b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.997+0000 7f5b651cf700 1 --2- 172.21.15.50:0/2412891809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b600b8250 0x7f5b600b3c80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5b6006d1e0 tx=0x7f5b58004af0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.997+0000 7f5b651cf700 1 -- 172.21.15.50:0/2412891809 shutdown_connections 2023-11-28T11:53:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.997+0000 7f5b651cf700 1 --2- 172.21.15.50:0/2412891809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b600b8250 0x7f5b600b3c80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.997+0000 7f5b651cf700 1 --2- 172.21.15.50:0/2412891809 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b4c064ee0 0x7f5b4c067390 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.997+0000 7f5b651cf700 1 --2- 172.21.15.50:0/2412891809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b6006a800 0x7f5b600b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.997+0000 7f5b651cf700 1 --2- 172.21.15.50:0/2412891809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b6006a350 0x7f5b60159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.997+0000 7f5b651cf700 1 -- 172.21.15.50:0/2412891809 >> 172.21.15.50:0/2412891809 conn(0x7f5b6006beb0 msgr2=0x7f5b6015a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.997+0000 7f5b651cf700 1 -- 172.21.15.50:0/2412891809 shutdown_connections 2023-11-28T11:53:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:51.997+0000 7f5b651cf700 1 -- 172.21.15.50:0/2412891809 wait complete. 2023-11-28T11:53:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-11-28T11:53:52.012 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:53:52.012 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:53:52.017 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:53:52.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f21809a3700 1 Processor -- start 2023-11-28T11:53:52.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f21809a3700 1 -- start start 2023-11-28T11:53:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f21809a3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f217c0cc360 0x7f217c0cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f21809a3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f217c0cc730 con 0x7f217c0cd000 2023-11-28T11:53:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f21809a3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f217c0b1f30 con 0x7f217c1607b0 2023-11-28T11:53:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f21809a3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217c0d04c0 con 0x7f217c0cc360 2023-11-28T11:53:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f217c0cd000 0x7f217c0afdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60132/0 (socket says 172.21.15.50:60132) 2023-11-28T11:53:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217bfff700 1 -- 172.21.15.50:0/768175906 learned_addr learned my addr 172.21.15.50:0/768175906 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217b7fe700 1 --2- 172.21.15.50:0/768175906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f217c0cc360 0x7f217c0cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217a7fc700 1 -- 172.21.15.50:0/768175906 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424735495 0 0) 0x7f217c0cc730 con 0x7f217c0cd000 2023-11-28T11:53:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217a7fc700 1 -- 172.21.15.50:0/768175906 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21680035d0 con 0x7f217c0cd000 2023-11-28T11:53:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217a7fc700 1 -- 172.21.15.50:0/768175906 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2418161879 0 0) 0x7f21680035d0 con 0x7f217c0cd000 2023-11-28T11:53:52.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217a7fc700 1 -- 172.21.15.50:0/768175906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f217c0cc360 msgr2=0x7f217c0cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217a7fc700 1 --2- 172.21.15.50:0/768175906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f217c0cc360 0x7f217c0cfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217a7fc700 1 -- 172.21.15.50:0/768175906 >> v1:172.21.15.192:6789/0 conn(0x7f217c1607b0 legacy=0x7f217c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217a7fc700 1 -- 172.21.15.50:0/768175906 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c0d01e0 con 0x7f217c0cd000 2023-11-28T11:53:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217a7fc700 1 -- 172.21.15.50:0/768175906 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f2174001670 con 0x7f217c0cd000 2023-11-28T11:53:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217a7fc700 1 -- 172.21.15.50:0/768175906 >> v1:172.21.15.50:6789/0 conn(0x7f217c0cd000 legacy=0x7f217c0afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217a7fc700 1 --2- 172.21.15.50:0/768175906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f217c0cc360 0x7f2168003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217a7fc700 1 --2- 172.21.15.50:0/768175906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2168003fd0 0x7f2168004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217a7fc700 1 --2- 172.21.15.50:0/768175906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2168004db0 0x7f2168005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217a7fc700 1 -- 172.21.15.50:0/768175906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c0d04c0 con 0x7f2168003fd0 2023-11-28T11:53:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217a7fc700 1 -- 172.21.15.50:0/768175906 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216800bb10 con 0x7f2168004db0 2023-11-28T11:53:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217a7fc700 1 -- 172.21.15.50:0/768175906 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216800bcd0 con 0x7f217c0cc360 2023-11-28T11:53:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217affd700 1 --2- 172.21.15.50:0/768175906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2168003fd0 0x7f2168004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217b7fe700 1 --2- 172.21.15.50:0/768175906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f217c0cc360 0x7f2168003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217bfff700 1 --2- 172.21.15.50:0/768175906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2168004db0 0x7f2168005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217affd700 1 -- 172.21.15.50:0/768175906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f217c0cc360 msgr2=0x7f2168003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217affd700 1 --2- 172.21.15.50:0/768175906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f217c0cc360 0x7f2168003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217affd700 1 -- 172.21.15.50:0/768175906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2168004db0 msgr2=0x7f2168005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217affd700 1 --2- 172.21.15.50:0/768175906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2168004db0 0x7f2168005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217affd700 1 -- 172.21.15.50:0/768175906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21680035d0 con 0x7f2168003fd0 2023-11-28T11:53:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.129+0000 7f217bfff700 1 --2- 172.21.15.50:0/768175906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2168004db0 0x7f2168005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:53:52.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.133+0000 7f217affd700 1 --2- 172.21.15.50:0/768175906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2168003fd0 0x7f2168004870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f216400c0e0 tx=0x7f21680058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5590cef7d5c61a0e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:52.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.133+0000 7f217a7fc700 1 -- 172.21.15.50:0/768175906 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164001da0 con 0x7f2168003fd0 2023-11-28T11:53:52.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.133+0000 7f217a7fc700 1 -- 172.21.15.50:0/768175906 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2164003c70 con 0x7f2168003fd0 2023-11-28T11:53:52.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.133+0000 7f217a7fc700 1 -- 172.21.15.50:0/768175906 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216400ca20 con 0x7f2168003fd0 2023-11-28T11:53:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.133+0000 7f21809a3700 1 -- 172.21.15.50:0/768175906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2168003fd0 msgr2=0x7f2168004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.133+0000 7f21809a3700 1 --2- 172.21.15.50:0/768175906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2168003fd0 0x7f2168004870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f216400c0e0 tx=0x7f21680058a0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.133+0000 7f217bfff700 1 -- 172.21.15.50:0/768175906 reap_dead start 2023-11-28T11:53:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.133+0000 7f21809a3700 1 -- 172.21.15.50:0/768175906 shutdown_connections 2023-11-28T11:53:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.133+0000 7f21809a3700 1 -- 172.21.15.50:0/768175906 >> 172.21.15.50:0/768175906 conn(0x7f217c0b2140 msgr2=0x7f217c0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.133+0000 7f21809a3700 1 -- 172.21.15.50:0/768175906 shutdown_connections 2023-11-28T11:53:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.133+0000 7f21809a3700 1 -- 172.21.15.50:0/768175906 wait complete. 2023-11-28T11:53:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f21809a3700 1 Processor -- start 2023-11-28T11:53:52.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f21809a3700 1 -- start start 2023-11-28T11:53:52.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f21809a3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2168003fd0 0x7f217c0c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f21809a3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f217c15a520 0x7f217c15a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f21809a3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f217c14b3c0 0x7f217c14b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f21809a3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c15aed0 con 0x7f2168003fd0 2023-11-28T11:53:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f21809a3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c0c88a0 con 0x7f217c14b3c0 2023-11-28T11:53:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f21809a3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217c0c8b80 con 0x7f217c15a520 2023-11-28T11:53:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f217b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2168003fd0 0x7f217c0c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f217b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2168003fd0 0x7f217c0c81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47830/0 (socket says 172.21.15.50:47830) 2023-11-28T11:53:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f217b7fe700 1 -- 172.21.15.50:0/3053635048 learned_addr learned my addr 172.21.15.50:0/3053635048 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f217bfff700 1 --2- 172.21.15.50:0/3053635048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f217c14b3c0 0x7f217c14b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f217affd700 1 --2- 172.21.15.50:0/3053635048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f217c15a520 0x7f217c15a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f217b7fe700 1 -- 172.21.15.50:0/3053635048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f217c15a520 msgr2=0x7f217c15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f217b7fe700 1 --2- 172.21.15.50:0/3053635048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f217c15a520 0x7f217c15a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f217b7fe700 1 -- 172.21.15.50:0/3053635048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f217c14b3c0 msgr2=0x7f217c14b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f217b7fe700 1 --2- 172.21.15.50:0/3053635048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f217c14b3c0 0x7f217c14b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f217b7fe700 1 -- 172.21.15.50:0/3053635048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c15ffb0 con 0x7f2168003fd0 2023-11-28T11:53:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f217bfff700 1 --2- 172.21.15.50:0/3053635048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f217c14b3c0 0x7f217c14b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:53:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f217b7fe700 1 --2- 172.21.15.50:0/3053635048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2168003fd0 0x7f217c0c81e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f216c011a20 tx=0x7f216c011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.137+0000 7f2173fff700 1 -- 172.21.15.50:0/3053635048 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c00fa00 con 0x7f2168003fd0 2023-11-28T11:53:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.141+0000 7f2173fff700 1 -- 172.21.15.50:0/3053635048 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c00fb60 con 0x7f2168003fd0 2023-11-28T11:53:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.141+0000 7f21809a3700 1 -- 172.21.15.50:0/3053635048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217c15fcd0 con 0x7f2168003fd0 2023-11-28T11:53:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.141+0000 7f2173fff700 1 -- 172.21.15.50:0/3053635048 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c014440 con 0x7f2168003fd0 2023-11-28T11:53:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.141+0000 7f21809a3700 1 -- 172.21.15.50:0/3053635048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217c160290 con 0x7f2168003fd0 2023-11-28T11:53:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.141+0000 7f2173fff700 1 -- 172.21.15.50:0/3053635048 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f216c0145a0 con 0x7f2168003fd0 2023-11-28T11:53:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.141+0000 7f21809a3700 1 -- 172.21.15.50:0/3053635048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217c072500 con 0x7f2168003fd0 2023-11-28T11:53:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.141+0000 7f2173fff700 1 --2- 172.21.15.50:0/3053635048 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f215c064ee0 0x7f215c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.141+0000 7f2173fff700 1 -- 172.21.15.50:0/3053635048 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f216c082b90 con 0x7f2168003fd0 2023-11-28T11:53:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.141+0000 7f217affd700 1 --2- 172.21.15.50:0/3053635048 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f215c064ee0 0x7f215c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.145+0000 7f217affd700 1 --2- 172.21.15.50:0/3053635048 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f215c064ee0 0x7f215c067390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2164005040 tx=0x7f2164009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:52.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.149+0000 7f2173fff700 1 -- 172.21.15.50:0/3053635048 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f216c0509b0 con 0x7f2168003fd0 2023-11-28T11:53:52.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.313+0000 7f21809a3700 1 -- 172.21.15.50:0/3053635048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f217c0b65b0 con 0x7f2168003fd0 2023-11-28T11:53:52.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.313+0000 7f2173fff700 1 -- 172.21.15.50:0/3053635048 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f216c053fd0 con 0x7f2168003fd0 2023-11-28T11:53:52.317 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:53:52.318 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:45.231747+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:53:52.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.317+0000 7f21809a3700 1 -- 172.21.15.50:0/3053635048 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f215c064ee0 msgr2=0x7f215c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.317+0000 7f21809a3700 1 --2- 172.21.15.50:0/3053635048 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f215c064ee0 0x7f215c067390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2164005040 tx=0x7f2164009030 comp rx=0 tx=0).stop 2023-11-28T11:53:52.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.317+0000 7f21809a3700 1 -- 172.21.15.50:0/3053635048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2168003fd0 msgr2=0x7f217c0c81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.317+0000 7f21809a3700 1 --2- 172.21.15.50:0/3053635048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2168003fd0 0x7f217c0c81e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f216c011a20 tx=0x7f216c011de0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.317+0000 7f21809a3700 1 -- 172.21.15.50:0/3053635048 shutdown_connections 2023-11-28T11:53:52.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.317+0000 7f21809a3700 1 --2- 172.21.15.50:0/3053635048 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f215c064ee0 0x7f215c067390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.317+0000 7f21809a3700 1 --2- 172.21.15.50:0/3053635048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f217c14b3c0 0x7f217c14b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.317+0000 7f21809a3700 1 --2- 172.21.15.50:0/3053635048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f217c15a520 0x7f217c15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.317+0000 7f21809a3700 1 --2- 172.21.15.50:0/3053635048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2168003fd0 0x7f217c0c81e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.317+0000 7f21809a3700 1 -- 172.21.15.50:0/3053635048 >> 172.21.15.50:0/3053635048 conn(0x7f217c0b2140 msgr2=0x7f217c0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:52.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.317+0000 7f21809a3700 1 -- 172.21.15.50:0/3053635048 shutdown_connections 2023-11-28T11:53:52.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.317+0000 7f21809a3700 1 -- 172.21.15.50:0/3053635048 wait complete. 2023-11-28T11:53:52.333 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:53:38.462826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:53:39.778621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:53:42.870360+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:53:52.334 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:53:52.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.449+0000 7fa5c54c2700 1 Processor -- start 2023-11-28T11:53:52.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c54c2700 1 -- start start 2023-11-28T11:53:52.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c54c2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c00b1ae0 0x7fa5c006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c54c2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5c00cf0e0 0x7fa5c00cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c54c2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c00cfa80 con 0x7fa5c006a4c0 2023-11-28T11:53:52.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c54c2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c00d0ab0 con 0x7fa5c00cf0e0 2023-11-28T11:53:52.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c54c2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c006a9c0 con 0x7fa5c00b1ae0 2023-11-28T11:53:52.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c4cc1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5c00cf0e0 0x7fa5c00cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5bf7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa5c006a4c0 0x7fa5c00d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60144/0 (socket says 172.21.15.50:60144) 2023-11-28T11:53:52.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5bf7fe700 1 -- 172.21.15.50:0/23569938 learned_addr learned my addr 172.21.15.50:0/23569938 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:52.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5bffff700 1 --2- 172.21.15.50:0/23569938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c00b1ae0 0x7fa5c006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5beffd700 1 -- 172.21.15.50:0/23569938 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238573310 0 0) 0x7fa5c00cfa80 con 0x7fa5c006a4c0 2023-11-28T11:53:52.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5beffd700 1 -- 172.21.15.50:0/23569938 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5ac0035d0 con 0x7fa5c006a4c0 2023-11-28T11:53:52.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c4cc1700 1 -- 172.21.15.50:0/23569938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c00b1ae0 msgr2=0x7fa5c006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:52.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c4cc1700 1 --2- 172.21.15.50:0/23569938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c00b1ae0 0x7fa5c006d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c4cc1700 1 -- 172.21.15.50:0/23569938 >> v1:172.21.15.50:6789/0 conn(0x7fa5c006a4c0 legacy=0x7fa5c00d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c4cc1700 1 -- 172.21.15.50:0/23569938 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c006aca0 con 0x7fa5c00cf0e0 2023-11-28T11:53:52.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5bffff700 1 --2- 172.21.15.50:0/23569938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c00b1ae0 0x7fa5c006d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:53:52.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c4cc1700 1 --2- 172.21.15.50:0/23569938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c00cf0e0 0x7fa5c00cf540 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009d90 tx=0x7fa5b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e957d8ba674fd6e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:52.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5beffd700 1 -- 172.21.15.50:0/23569938 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b800e070 con 0x7fa5c00cf0e0 2023-11-28T11:53:52.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5beffd700 1 -- 172.21.15.50:0/23569938 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b8003a40 con 0x7fa5c00cf0e0 2023-11-28T11:53:52.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5beffd700 1 -- 172.21.15.50:0/23569938 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8001670 con 0x7fa5c00cf0e0 2023-11-28T11:53:52.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c54c2700 1 -- 172.21.15.50:0/23569938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c00cf0e0 msgr2=0x7fa5c00cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c54c2700 1 --2- 172.21.15.50:0/23569938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c00cf0e0 0x7fa5c00cf540 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009d90 tx=0x7fa5b800b330 comp rx=0 tx=0).stop 2023-11-28T11:53:52.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c54c2700 1 -- 172.21.15.50:0/23569938 shutdown_connections 2023-11-28T11:53:52.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c54c2700 1 --2- 172.21.15.50:0/23569938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c00cf0e0 0x7fa5c00cf540 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c54c2700 1 --2- 172.21.15.50:0/23569938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c00b1ae0 0x7fa5c006d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c54c2700 1 -- 172.21.15.50:0/23569938 >> 172.21.15.50:0/23569938 conn(0x7fa5c009bbd0 msgr2=0x7fa5c00b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:52.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c54c2700 1 -- 172.21.15.50:0/23569938 shutdown_connections 2023-11-28T11:53:52.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.453+0000 7fa5c54c2700 1 -- 172.21.15.50:0/23569938 wait complete. 2023-11-28T11:53:52.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.457+0000 7fa5c54c2700 1 Processor -- start 2023-11-28T11:53:52.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.457+0000 7fa5c54c2700 1 -- start start 2023-11-28T11:53:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.457+0000 7fa5c54c2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c006a4c0 0x7fa5c00a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.457+0000 7fa5c54c2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5c00b1ae0 0x7fa5c015e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.457+0000 7fa5c54c2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c00cf0e0 0x7fa5c014ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.457+0000 7fa5c54c2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c009c7d0 con 0x7fa5c006a4c0 2023-11-28T11:53:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.457+0000 7fa5c54c2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c014a750 con 0x7fa5c00b1ae0 2023-11-28T11:53:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.457+0000 7fa5c54c2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c014aa00 con 0x7fa5c00cf0e0 2023-11-28T11:53:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.457+0000 7fa5bffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c006a4c0 0x7fa5c00a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.457+0000 7fa5bffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c006a4c0 0x7fa5c00a00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47840/0 (socket says 172.21.15.50:47840) 2023-11-28T11:53:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.457+0000 7fa5bffff700 1 -- 172.21.15.50:0/38939145 learned_addr learned my addr 172.21.15.50:0/38939145 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:52.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.457+0000 7fa5c4cc1700 1 --2- 172.21.15.50:0/38939145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c00cf0e0 0x7fa5c014ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.457+0000 7fa5bf7fe700 1 --2- 172.21.15.50:0/38939145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5c00b1ae0 0x7fa5c015e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.461+0000 7fa5bffff700 1 -- 172.21.15.50:0/38939145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c00cf0e0 msgr2=0x7fa5c014ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.461+0000 7fa5bffff700 1 --2- 172.21.15.50:0/38939145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c00cf0e0 0x7fa5c014ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.461+0000 7fa5bffff700 1 -- 172.21.15.50:0/38939145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5c00b1ae0 msgr2=0x7fa5c015e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.461+0000 7fa5bffff700 1 --2- 172.21.15.50:0/38939145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5c00b1ae0 0x7fa5c015e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.461+0000 7fa5bffff700 1 -- 172.21.15.50:0/38939145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b00094b0 con 0x7fa5c006a4c0 2023-11-28T11:53:52.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.461+0000 7fa5bffff700 1 --2- 172.21.15.50:0/38939145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c006a4c0 0x7fa5c00a00b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000ec10 tx=0x7fa5b000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:52.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.461+0000 7fa5bcff9700 1 -- 172.21.15.50:0/38939145 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b000c850 con 0x7fa5c006a4c0 2023-11-28T11:53:52.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.461+0000 7fa5bcff9700 1 -- 172.21.15.50:0/38939145 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b000c9b0 con 0x7fa5c006a4c0 2023-11-28T11:53:52.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.461+0000 7fa5c54c2700 1 -- 172.21.15.50:0/38939145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b8009a70 con 0x7fa5c006a4c0 2023-11-28T11:53:52.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.461+0000 7fa5bcff9700 1 -- 172.21.15.50:0/38939145 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b000cd40 con 0x7fa5c006a4c0 2023-11-28T11:53:52.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.461+0000 7fa5c54c2700 1 -- 172.21.15.50:0/38939145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c00b4380 con 0x7fa5c006a4c0 2023-11-28T11:53:52.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.461+0000 7fa5c54c2700 1 -- 172.21.15.50:0/38939145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c006af80 con 0x7fa5c006a4c0 2023-11-28T11:53:52.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.461+0000 7fa5bcff9700 1 -- 172.21.15.50:0/38939145 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa5b0023070 con 0x7fa5c006a4c0 2023-11-28T11:53:52.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.461+0000 7fa5bcff9700 1 --2- 172.21.15.50:0/38939145 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa5a0064ee0 0x7fa5a0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.461+0000 7fa5bcff9700 1 -- 172.21.15.50:0/38939145 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa5b00823e0 con 0x7fa5c006a4c0 2023-11-28T11:53:52.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.465+0000 7fa5bf7fe700 1 --2- 172.21.15.50:0/38939145 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa5a0064ee0 0x7fa5a0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.465+0000 7fa5bf7fe700 1 --2- 172.21.15.50:0/38939145 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa5a0064ee0 0x7fa5a0067390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8005930 tx=0x7fa5a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:52.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.469+0000 7fa5bcff9700 1 -- 172.21.15.50:0/38939145 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa5b0050290 con 0x7fa5c006a4c0 2023-11-28T11:53:52.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.637+0000 7fa5c54c2700 1 -- 172.21.15.50:0/38939145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa5c00b1eb0 con 0x7fa5c006a4c0 2023-11-28T11:53:52.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.637+0000 7fa5bcff9700 1 -- 172.21.15.50:0/38939145 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa5b000cea0 con 0x7fa5c006a4c0 2023-11-28T11:53:52.641 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:53:52.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.641+0000 7fa5c54c2700 1 -- 172.21.15.50:0/38939145 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa5a0064ee0 msgr2=0x7fa5a0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.641+0000 7fa5c54c2700 1 --2- 172.21.15.50:0/38939145 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa5a0064ee0 0x7fa5a0067390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8005930 tx=0x7fa5a8009040 comp rx=0 tx=0).stop 2023-11-28T11:53:52.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.641+0000 7fa5c54c2700 1 -- 172.21.15.50:0/38939145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c006a4c0 msgr2=0x7fa5c00a00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.641+0000 7fa5c54c2700 1 --2- 172.21.15.50:0/38939145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c006a4c0 0x7fa5c00a00b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000ec10 tx=0x7fa5b000ef20 comp rx=0 tx=0).stop 2023-11-28T11:53:52.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.641+0000 7fa5c54c2700 1 -- 172.21.15.50:0/38939145 shutdown_connections 2023-11-28T11:53:52.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.641+0000 7fa5c54c2700 1 --2- 172.21.15.50:0/38939145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c00cf0e0 0x7fa5c014ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.641+0000 7fa5c54c2700 1 --2- 172.21.15.50:0/38939145 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa5a0064ee0 0x7fa5a0067390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.641+0000 7fa5c54c2700 1 --2- 172.21.15.50:0/38939145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5c00b1ae0 0x7fa5c015e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.641+0000 7fa5c54c2700 1 --2- 172.21.15.50:0/38939145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c006a4c0 0x7fa5c00a00b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.641+0000 7fa5c54c2700 1 -- 172.21.15.50:0/38939145 >> 172.21.15.50:0/38939145 conn(0x7fa5c009bbd0 msgr2=0x7fa5c006d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:52.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.641+0000 7fa5c54c2700 1 -- 172.21.15.50:0/38939145 shutdown_connections 2023-11-28T11:53:52.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.641+0000 7fa5c54c2700 1 -- 172.21.15.50:0/38939145 wait complete. 2023-11-28T11:53:52.656 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:53:52.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.773+0000 7f4ce0a0c700 1 Processor -- start 2023-11-28T11:53:52.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.773+0000 7f4ce0a0c700 1 -- start start 2023-11-28T11:53:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4ce0a0c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4cdc0b1ae0 0x7f4cdc06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4ce0a0c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4cdc06a4c0 0x7f4cdc0d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4ce0a0c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cdc06a9c0 con 0x7f4cdc0cf0e0 2023-11-28T11:53:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4ce0a0c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cdc06aca0 con 0x7f4cdc06a4c0 2023-11-28T11:53:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4ce0a0c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cdc06af80 con 0x7f4cdc0b1ae0 2023-11-28T11:53:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4cdaffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4cdc06a4c0 0x7f4cdc0d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4cdaffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4cdc06a4c0 0x7f4cdc0d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47846/0 (socket says 172.21.15.50:47846) 2023-11-28T11:53:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4cdaffd700 1 -- 172.21.15.50:0/1566738283 learned_addr learned my addr 172.21.15.50:0/1566738283 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:52.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4cdb7fe700 1 --2- 172.21.15.50:0/1566738283 >> v2:172.21.15.192:3300/0 conn(0x7f4cdc0b1ae0 0x7f4cdc06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4cdaffd700 1 -- 172.21.15.50:0/1566738283 >> v2:172.21.15.192:3300/0 conn(0x7f4cdc0b1ae0 msgr2=0x7f4cdc06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4cdaffd700 1 --2- 172.21.15.50:0/1566738283 >> v2:172.21.15.192:3300/0 conn(0x7f4cdc0b1ae0 0x7f4cdc06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4cdaffd700 1 -- 172.21.15.50:0/1566738283 >> v1:172.21.15.192:6789/0 conn(0x7f4cdc0cf0e0 legacy=0x7f4cdc0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4cdaffd700 1 -- 172.21.15.50:0/1566738283 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc0b4380 con 0x7f4cdc06a4c0 2023-11-28T11:53:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4cdaffd700 1 --2- 172.21.15.50:0/1566738283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cdc06a4c0 0x7f4cdc0d03a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc0b8870 tx=0x7f4cd0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c4faab0f369c5e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4cda7fc700 1 -- 172.21.15.50:0/1566738283 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0011830 con 0x7f4cdc06a4c0 2023-11-28T11:53:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4cda7fc700 1 -- 172.21.15.50:0/1566738283 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd0011990 con 0x7f4cdc06a4c0 2023-11-28T11:53:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4cda7fc700 1 -- 172.21.15.50:0/1566738283 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0011d20 con 0x7f4cdc06a4c0 2023-11-28T11:53:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4ce0a0c700 1 -- 172.21.15.50:0/1566738283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cdc06a4c0 msgr2=0x7f4cdc0d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4ce0a0c700 1 --2- 172.21.15.50:0/1566738283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cdc06a4c0 0x7f4cdc0d03a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc0b8870 tx=0x7f4cd0009bf0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4ce0a0c700 1 -- 172.21.15.50:0/1566738283 shutdown_connections 2023-11-28T11:53:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4ce0a0c700 1 --2- 172.21.15.50:0/1566738283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cdc06a4c0 0x7f4cdc0d03a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4ce0a0c700 1 --2- 172.21.15.50:0/1566738283 >> v2:172.21.15.192:3300/0 conn(0x7f4cdc0b1ae0 0x7f4cdc06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4ce0a0c700 1 -- 172.21.15.50:0/1566738283 >> 172.21.15.50:0/1566738283 conn(0x7f4cdc09bbd0 msgr2=0x7f4cdc0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4ce0a0c700 1 -- 172.21.15.50:0/1566738283 shutdown_connections 2023-11-28T11:53:52.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.777+0000 7f4ce0a0c700 1 -- 172.21.15.50:0/1566738283 wait complete. 2023-11-28T11:53:52.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.781+0000 7f4ce0a0c700 1 Processor -- start 2023-11-28T11:53:52.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.781+0000 7f4ce0a0c700 1 -- start start 2023-11-28T11:53:52.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4ce0a0c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4cdc06a4c0 0x7f4cdc155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4ce0a0c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cdc0b1ae0 0x7f4cdc0c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4ce0a0c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cdc0cf0e0 0x7f4cdc0c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4ce0a0c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc0c8000 con 0x7f4cdc0b1ae0 2023-11-28T11:53:52.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4ce0a0c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc0c7250 con 0x7f4cdc0cf0e0 2023-11-28T11:53:52.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4ce0a0c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc156f50 con 0x7f4cdc06a4c0 2023-11-28T11:53:52.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4cdb7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4cdc06a4c0 0x7f4cdc155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4cdbfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cdc0cf0e0 0x7f4cdc0c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4cdaffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cdc0b1ae0 0x7f4cdc0c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4cdb7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4cdc06a4c0 0x7f4cdc155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:38268/0 (socket says 172.21.15.50:38268) 2023-11-28T11:53:52.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4cdb7fe700 1 -- 172.21.15.50:0/3844611647 learned_addr learned my addr 172.21.15.50:0/3844611647 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:52.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4cdbfff700 1 -- 172.21.15.50:0/3844611647 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4cdc06a4c0 msgr2=0x7f4cdc155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4cdbfff700 1 --2- 172.21.15.50:0/3844611647 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4cdc06a4c0 0x7f4cdc155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4cdbfff700 1 -- 172.21.15.50:0/3844611647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cdc0b1ae0 msgr2=0x7f4cdc0c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4cdbfff700 1 --2- 172.21.15.50:0/3844611647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cdc0b1ae0 0x7f4cdc0c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4cdbfff700 1 -- 172.21.15.50:0/3844611647 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd0009570 con 0x7f4cdc0cf0e0 2023-11-28T11:53:52.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4cdb7fe700 1 --2- 172.21.15.50:0/3844611647 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4cdc06a4c0 0x7f4cdc155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:53:52.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4cdbfff700 1 --2- 172.21.15.50:0/3844611647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cdc0cf0e0 0x7f4cdc0c6d10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400cb90 tx=0x7f4cd400cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:52.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4cc3fff700 1 -- 172.21.15.50:0/3844611647 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4003c20 con 0x7f4cdc0cf0e0 2023-11-28T11:53:52.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4cc3fff700 1 -- 172.21.15.50:0/3844611647 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd4003d80 con 0x7f4cdc0cf0e0 2023-11-28T11:53:52.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4ce0a0c700 1 -- 172.21.15.50:0/3844611647 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cdc0b60e0 con 0x7f4cdc0cf0e0 2023-11-28T11:53:52.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4cc3fff700 1 -- 172.21.15.50:0/3844611647 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd400aa80 con 0x7f4cdc0cf0e0 2023-11-28T11:53:52.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.785+0000 7f4ce0a0c700 1 -- 172.21.15.50:0/3844611647 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cdc0b1eb0 con 0x7f4cdc0cf0e0 2023-11-28T11:53:52.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.789+0000 7f4ce0a0c700 1 -- 172.21.15.50:0/3844611647 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cdc0d08e0 con 0x7f4cdc0cf0e0 2023-11-28T11:53:52.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.789+0000 7f4cc3fff700 1 -- 172.21.15.50:0/3844611647 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4cd4010050 con 0x7f4cdc0cf0e0 2023-11-28T11:53:52.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.789+0000 7f4cc3fff700 1 --2- 172.21.15.50:0/3844611647 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4cc8064ee0 0x7f4cc8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:52.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.789+0000 7f4cc3fff700 1 -- 172.21.15.50:0/3844611647 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4cd4081ff0 con 0x7f4cdc0cf0e0 2023-11-28T11:53:52.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.789+0000 7f4cdb7fe700 1 --2- 172.21.15.50:0/3844611647 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4cc8064ee0 0x7f4cc8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:52.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.789+0000 7f4cdb7fe700 1 --2- 172.21.15.50:0/3844611647 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4cc8064ee0 0x7f4cc8067390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0112c0 tx=0x7f4ccc009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:52.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.797+0000 7f4cc3fff700 1 -- 172.21.15.50:0/3844611647 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4cd404fdd0 con 0x7f4cdc0cf0e0 2023-11-28T11:53:52.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.969+0000 7f4ce0a0c700 1 -- 172.21.15.50:0/3844611647 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4cdc157120 con 0x7f4cdc0cf0e0 2023-11-28T11:53:52.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.969+0000 7f4cc3fff700 1 -- 172.21.15.50:0/3844611647 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4cd40533f0 con 0x7f4cdc0cf0e0 2023-11-28T11:53:52.974 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:53:52.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.973+0000 7f4ce0a0c700 1 -- 172.21.15.50:0/3844611647 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4cc8064ee0 msgr2=0x7f4cc8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.973+0000 7f4ce0a0c700 1 --2- 172.21.15.50:0/3844611647 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4cc8064ee0 0x7f4cc8067390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0112c0 tx=0x7f4ccc009240 comp rx=0 tx=0).stop 2023-11-28T11:53:52.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.973+0000 7f4ce0a0c700 1 -- 172.21.15.50:0/3844611647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cdc0cf0e0 msgr2=0x7f4cdc0c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:52.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.973+0000 7f4ce0a0c700 1 --2- 172.21.15.50:0/3844611647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cdc0cf0e0 0x7f4cdc0c6d10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400cb90 tx=0x7f4cd400cea0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.973+0000 7f4ce0a0c700 1 -- 172.21.15.50:0/3844611647 shutdown_connections 2023-11-28T11:53:52.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.973+0000 7f4ce0a0c700 1 --2- 172.21.15.50:0/3844611647 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4cc8064ee0 0x7f4cc8067390 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.973+0000 7f4ce0a0c700 1 --2- 172.21.15.50:0/3844611647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cdc0cf0e0 0x7f4cdc0c6d10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.973+0000 7f4ce0a0c700 1 --2- 172.21.15.50:0/3844611647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4cdc0b1ae0 0x7f4cdc0c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.973+0000 7f4ce0a0c700 1 --2- 172.21.15.50:0/3844611647 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4cdc06a4c0 0x7f4cdc155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:52.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.973+0000 7f4ce0a0c700 1 -- 172.21.15.50:0/3844611647 >> 172.21.15.50:0/3844611647 conn(0x7f4cdc09bbd0 msgr2=0x7f4cdc0b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:52.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.973+0000 7f4ce0a0c700 1 -- 172.21.15.50:0/3844611647 shutdown_connections 2023-11-28T11:53:52.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:52.973+0000 7f4ce0a0c700 1 -- 172.21.15.50:0/3844611647 wait complete. 2023-11-28T11:53:52.995 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:53:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.109+0000 7fb70e759700 1 Processor -- start 2023-11-28T11:53:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.109+0000 7fb70e759700 1 -- start start 2023-11-28T11:53:53.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70e759700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb70806a4c0 0x7fb70806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:53.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70e759700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7080cf0e0 0x7fb7080cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:53.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70e759700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7080cfa80 con 0x7fb7080b1ae0 2023-11-28T11:53:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70e759700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7080d0ab0 con 0x7fb70806a4c0 2023-11-28T11:53:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70e759700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70806a9c0 con 0x7fb7080cf0e0 2023-11-28T11:53:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70cf56700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb70806a4c0 0x7fb70806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70cf56700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb70806a4c0 0x7fb70806d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47868/0 (socket says 172.21.15.50:47868) 2023-11-28T11:53:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70cf56700 1 -- 172.21.15.50:0/4210828913 learned_addr learned my addr 172.21.15.50:0/4210828913 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:53.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70df58700 1 --2- 172.21.15.50:0/4210828913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7080cf0e0 0x7fb7080cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:53.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70cf56700 1 -- 172.21.15.50:0/4210828913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7080cf0e0 msgr2=0x7fb7080cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:53.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70cf56700 1 --2- 172.21.15.50:0/4210828913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7080cf0e0 0x7fb7080cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70cf56700 1 -- 172.21.15.50:0/4210828913 >> v1:172.21.15.192:6789/0 conn(0x7fb7080b1ae0 legacy=0x7fb7080d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70cf56700 1 -- 172.21.15.50:0/4210828913 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70806aca0 con 0x7fb70806a4c0 2023-11-28T11:53:53.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70cf56700 1 --2- 172.21.15.50:0/4210828913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb70806a4c0 0x7fb70806d8e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb704009910 tx=0x7fb704009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a821f1eaf89de895 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:53.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb6fffff700 1 -- 172.21.15.50:0/4210828913 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70400ba60 con 0x7fb70806a4c0 2023-11-28T11:53:53.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb6fffff700 1 -- 172.21.15.50:0/4210828913 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70400bbc0 con 0x7fb70806a4c0 2023-11-28T11:53:53.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb6fffff700 1 -- 172.21.15.50:0/4210828913 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb704009e60 con 0x7fb70806a4c0 2023-11-28T11:53:53.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70e759700 1 -- 172.21.15.50:0/4210828913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb70806a4c0 msgr2=0x7fb70806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70e759700 1 --2- 172.21.15.50:0/4210828913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb70806a4c0 0x7fb70806d8e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb704009910 tx=0x7fb704009c20 comp rx=0 tx=0).stop 2023-11-28T11:53:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70e759700 1 -- 172.21.15.50:0/4210828913 shutdown_connections 2023-11-28T11:53:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70e759700 1 --2- 172.21.15.50:0/4210828913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7080cf0e0 0x7fb7080cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70e759700 1 --2- 172.21.15.50:0/4210828913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb70806a4c0 0x7fb70806d8e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70e759700 1 -- 172.21.15.50:0/4210828913 >> 172.21.15.50:0/4210828913 conn(0x7fb70809bbd0 msgr2=0x7fb7080b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.113+0000 7fb70e759700 1 -- 172.21.15.50:0/4210828913 shutdown_connections 2023-11-28T11:53:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.117+0000 7fb70e759700 1 -- 172.21.15.50:0/4210828913 wait complete. 2023-11-28T11:53:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.117+0000 7fb70e759700 1 Processor -- start 2023-11-28T11:53:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.117+0000 7fb70e759700 1 -- start start 2023-11-28T11:53:53.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.117+0000 7fb70e759700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb70806a4c0 0x7fb708159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:53.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.117+0000 7fb70e759700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7080b1ae0 0x7fb7080c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:53.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.117+0000 7fb70e759700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7080cf0e0 0x7fb7080c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.117+0000 7fb70e759700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70815d2c0 con 0x7fb7080cf0e0 2023-11-28T11:53:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.117+0000 7fb70e759700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70815f3e0 con 0x7fb7080b1ae0 2023-11-28T11:53:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.117+0000 7fb70e759700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080c90b0 con 0x7fb70806a4c0 2023-11-28T11:53:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb70df58700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7080cf0e0 0x7fb7080c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb70df58700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7080cf0e0 0x7fb7080c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47878/0 (socket says 172.21.15.50:47878) 2023-11-28T11:53:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb70df58700 1 -- 172.21.15.50:0/2001797410 learned_addr learned my addr 172.21.15.50:0/2001797410 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb70d757700 1 --2- 172.21.15.50:0/2001797410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb70806a4c0 0x7fb708159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb70cf56700 1 --2- 172.21.15.50:0/2001797410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7080b1ae0 0x7fb7080c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:53.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb70df58700 1 -- 172.21.15.50:0/2001797410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb70806a4c0 msgr2=0x7fb708159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb70df58700 1 --2- 172.21.15.50:0/2001797410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb70806a4c0 0x7fb708159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb70df58700 1 -- 172.21.15.50:0/2001797410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7080b1ae0 msgr2=0x7fb7080c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb70df58700 1 --2- 172.21.15.50:0/2001797410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7080b1ae0 0x7fb7080c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb70df58700 1 -- 172.21.15.50:0/2001797410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb704009570 con 0x7fb7080cf0e0 2023-11-28T11:53:53.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb70df58700 1 --2- 172.21.15.50:0/2001797410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7080cf0e0 0x7fb7080c7da0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb700007e70 tx=0x7fb70000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:53.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb6fdffb700 1 -- 172.21.15.50:0/2001797410 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70000ed30 con 0x7fb7080cf0e0 2023-11-28T11:53:53.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb6fdffb700 1 -- 172.21.15.50:0/2001797410 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70000eeb0 con 0x7fb7080cf0e0 2023-11-28T11:53:53.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb70e759700 1 -- 172.21.15.50:0/2001797410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7080b4380 con 0x7fb7080cf0e0 2023-11-28T11:53:53.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb6fdffb700 1 -- 172.21.15.50:0/2001797410 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700014640 con 0x7fb7080cf0e0 2023-11-28T11:53:53.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb70e759700 1 -- 172.21.15.50:0/2001797410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb70806af80 con 0x7fb7080cf0e0 2023-11-28T11:53:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb70e759700 1 -- 172.21.15.50:0/2001797410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7080b1eb0 con 0x7fb7080cf0e0 2023-11-28T11:53:53.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.121+0000 7fb6fdffb700 1 -- 172.21.15.50:0/2001797410 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb700012050 con 0x7fb7080cf0e0 2023-11-28T11:53:53.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.125+0000 7fb6fdffb700 1 --2- 172.21.15.50:0/2001797410 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb6ec064ee0 0x7fb6ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:53.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.125+0000 7fb6fdffb700 1 -- 172.21.15.50:0/2001797410 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb7000826b0 con 0x7fb7080cf0e0 2023-11-28T11:53:53.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.125+0000 7fb70d757700 1 --2- 172.21.15.50:0/2001797410 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb6ec064ee0 0x7fb6ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:53.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.125+0000 7fb70d757700 1 --2- 172.21.15.50:0/2001797410 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb6ec064ee0 0x7fb6ec067390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8000f60 tx=0x7fb6f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:53.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.129+0000 7fb6fdffb700 1 -- 172.21.15.50:0/2001797410 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb700050560 con 0x7fb7080cf0e0 2023-11-28T11:53:53.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.293+0000 7fb70e759700 1 -- 172.21.15.50:0/2001797410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb70815d400 con 0x7fb7080cf0e0 2023-11-28T11:53:53.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.293+0000 7fb6fdffb700 1 -- 172.21.15.50:0/2001797410 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb70815d400 con 0x7fb7080cf0e0 2023-11-28T11:53:53.299 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:53:53.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.297+0000 7fb70e759700 1 -- 172.21.15.50:0/2001797410 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb6ec064ee0 msgr2=0x7fb6ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.297+0000 7fb70e759700 1 --2- 172.21.15.50:0/2001797410 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb6ec064ee0 0x7fb6ec067390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8000f60 tx=0x7fb6f8009040 comp rx=0 tx=0).stop 2023-11-28T11:53:53.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.297+0000 7fb70e759700 1 -- 172.21.15.50:0/2001797410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7080cf0e0 msgr2=0x7fb7080c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.297+0000 7fb70e759700 1 --2- 172.21.15.50:0/2001797410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7080cf0e0 0x7fb7080c7da0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb700007e70 tx=0x7fb70000e3c0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.297+0000 7fb70e759700 1 -- 172.21.15.50:0/2001797410 shutdown_connections 2023-11-28T11:53:53.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.297+0000 7fb70e759700 1 --2- 172.21.15.50:0/2001797410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7080cf0e0 0x7fb7080c7da0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.297+0000 7fb70e759700 1 --2- 172.21.15.50:0/2001797410 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb6ec064ee0 0x7fb6ec067390 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.297+0000 7fb70e759700 1 --2- 172.21.15.50:0/2001797410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7080b1ae0 0x7fb7080c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.297+0000 7fb70e759700 1 --2- 172.21.15.50:0/2001797410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb70806a4c0 0x7fb708159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.297+0000 7fb70e759700 1 -- 172.21.15.50:0/2001797410 >> 172.21.15.50:0/2001797410 conn(0x7fb70809bbd0 msgr2=0x7fb7080b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:53.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.297+0000 7fb70e759700 1 -- 172.21.15.50:0/2001797410 shutdown_connections 2023-11-28T11:53:53.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.297+0000 7fb70e759700 1 -- 172.21.15.50:0/2001797410 wait complete. 2023-11-28T11:53:53.314 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:53:53.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.433+0000 7fdc9eef4700 1 Processor -- start 2023-11-28T11:53:53.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.433+0000 7fdc9eef4700 1 -- start start 2023-11-28T11:53:53.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.433+0000 7fdc9eef4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc980ce5c0 0x7fdc98164bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:53.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.433+0000 7fdc9eef4700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc980c9b50 con 0x7fdc980c2240 2023-11-28T11:53:53.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.433+0000 7fdc9eef4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc98165130 con 0x7fdc980ced50 2023-11-28T11:53:53.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.433+0000 7fdc9eef4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980cc990 con 0x7fdc980ce5c0 2023-11-28T11:53:53.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.433+0000 7fdc9def2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdc980c2240 0x7fdc98069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60152/0 (socket says 172.21.15.50:60152) 2023-11-28T11:53:53.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.433+0000 7fdc9def2700 1 -- 172.21.15.50:0/4204458326 learned_addr learned my addr 172.21.15.50:0/4204458326 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:53.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.433+0000 7fdc9d6f1700 1 --2- 172.21.15.50:0/4204458326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc980ce5c0 0x7fdc98164bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:53.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9cef0700 1 -- 172.21.15.50:0/4204458326 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737219138 0 0) 0x7fdc88001290 con 0x7fdc980c2240 2023-11-28T11:53:53.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9d6f1700 1 -- 172.21.15.50:0/4204458326 >> v1:172.21.15.192:6789/0 conn(0x7fdc980ced50 legacy=0x7fdc980cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9d6f1700 1 -- 172.21.15.50:0/4204458326 >> v1:172.21.15.50:6789/0 conn(0x7fdc980c2240 legacy=0x7fdc98069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9d6f1700 1 -- 172.21.15.50:0/4204458326 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc980ccc00 con 0x7fdc980ce5c0 2023-11-28T11:53:53.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9d6f1700 1 --2- 172.21.15.50:0/4204458326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc980ce5c0 0x7fdc98164bf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009800 tx=0x7fdc94009b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a2edbcd0c05ccc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:53.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9cef0700 1 -- 172.21.15.50:0/4204458326 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94004230 con 0x7fdc980ce5c0 2023-11-28T11:53:53.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9cef0700 1 -- 172.21.15.50:0/4204458326 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc94004390 con 0x7fdc980ce5c0 2023-11-28T11:53:53.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9cef0700 1 -- 172.21.15.50:0/4204458326 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc940036c0 con 0x7fdc980ce5c0 2023-11-28T11:53:53.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9eef4700 1 -- 172.21.15.50:0/4204458326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc980ce5c0 msgr2=0x7fdc98164bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9eef4700 1 --2- 172.21.15.50:0/4204458326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc980ce5c0 0x7fdc98164bf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009800 tx=0x7fdc94009b10 comp rx=0 tx=0).stop 2023-11-28T11:53:53.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9eef4700 1 -- 172.21.15.50:0/4204458326 shutdown_connections 2023-11-28T11:53:53.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9eef4700 1 --2- 172.21.15.50:0/4204458326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc980ce5c0 0x7fdc98164bf0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9eef4700 1 -- 172.21.15.50:0/4204458326 >> 172.21.15.50:0/4204458326 conn(0x7fdc9806c660 msgr2=0x7fdc9806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:53.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9eef4700 1 -- 172.21.15.50:0/4204458326 shutdown_connections 2023-11-28T11:53:53.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9eef4700 1 -- 172.21.15.50:0/4204458326 wait complete. 2023-11-28T11:53:53.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9eef4700 1 Processor -- start 2023-11-28T11:53:53.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9eef4700 1 -- start start 2023-11-28T11:53:53.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9eef4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc980c2240 0x7fdc980c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:53.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9eef4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc980ce5c0 0x7fdc98158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:53.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9eef4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc980ced50 0x7fdc981f9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:53.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9eef4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980c7910 con 0x7fdc980c2240 2023-11-28T11:53:53.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9eef4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc980c4fe0 con 0x7fdc980ce5c0 2023-11-28T11:53:53.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.437+0000 7fdc9eef4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc98160ce0 con 0x7fdc980ced50 2023-11-28T11:53:53.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc9d6f1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc980ce5c0 0x7fdc98158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:53.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc9def2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc980c2240 0x7fdc980c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:53.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc9d6f1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc980ce5c0 0x7fdc98158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:51036/0 (socket says 172.21.15.50:51036) 2023-11-28T11:53:53.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc9d6f1700 1 -- 172.21.15.50:0/3830214887 learned_addr learned my addr 172.21.15.50:0/3830214887 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:53.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc9e6f3700 1 --2- 172.21.15.50:0/3830214887 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc980ced50 0x7fdc981f9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:53.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc9d6f1700 1 -- 172.21.15.50:0/3830214887 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc980ced50 msgr2=0x7fdc981f9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc9d6f1700 1 --2- 172.21.15.50:0/3830214887 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc980ced50 0x7fdc981f9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc9d6f1700 1 -- 172.21.15.50:0/3830214887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc980c2240 msgr2=0x7fdc980c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc9d6f1700 1 --2- 172.21.15.50:0/3830214887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc980c2240 0x7fdc980c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc9d6f1700 1 -- 172.21.15.50:0/3830214887 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc940094b0 con 0x7fdc980ce5c0 2023-11-28T11:53:53.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc9d6f1700 1 --2- 172.21.15.50:0/3830214887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc980ce5c0 0x7fdc98158610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdc940090b0 tx=0x7fdc94004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:53.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc8e7fc700 1 -- 172.21.15.50:0/3830214887 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94003e90 con 0x7fdc980ce5c0 2023-11-28T11:53:53.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc8e7fc700 1 -- 172.21.15.50:0/3830214887 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9401f070 con 0x7fdc980ce5c0 2023-11-28T11:53:53.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc9eef4700 1 -- 172.21.15.50:0/3830214887 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc980c9870 con 0x7fdc980ce5c0 2023-11-28T11:53:53.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc8e7fc700 1 -- 172.21.15.50:0/3830214887 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94011850 con 0x7fdc980ce5c0 2023-11-28T11:53:53.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc9eef4700 1 -- 172.21.15.50:0/3830214887 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc980c9590 con 0x7fdc980ce5c0 2023-11-28T11:53:53.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc9eef4700 1 -- 172.21.15.50:0/3830214887 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9806a350 con 0x7fdc980ce5c0 2023-11-28T11:53:53.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.441+0000 7fdc8e7fc700 1 -- 172.21.15.50:0/3830214887 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdc94017020 con 0x7fdc980ce5c0 2023-11-28T11:53:53.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.445+0000 7fdc8e7fc700 1 --2- 172.21.15.50:0/3830214887 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc7c064f10 0x7fdc7c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:53.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.445+0000 7fdc8e7fc700 1 -- 172.21.15.50:0/3830214887 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdc94021070 con 0x7fdc980ce5c0 2023-11-28T11:53:53.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.445+0000 7fdc9def2700 1 --2- 172.21.15.50:0/3830214887 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc7c064f10 0x7fdc7c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:53.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.445+0000 7fdc9def2700 1 --2- 172.21.15.50:0/3830214887 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc7c064f10 0x7fdc7c0673c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdc88007fd0 tx=0x7fdc88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:53.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.453+0000 7fdc8e7fc700 1 -- 172.21.15.50:0/3830214887 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdc94085e60 con 0x7fdc980ce5c0 2023-11-28T11:53:53.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.617+0000 7fdc9eef4700 1 -- 172.21.15.50:0/3830214887 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc98072c20 con 0x7fdc980ce5c0 2023-11-28T11:53:53.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.621+0000 7fdc8e7fc700 1 -- 172.21.15.50:0/3830214887 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc94051a00 con 0x7fdc980ce5c0 2023-11-28T11:53:53.625 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:53:53.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.621+0000 7fdc9eef4700 1 -- 172.21.15.50:0/3830214887 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc7c064f10 msgr2=0x7fdc7c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.621+0000 7fdc9eef4700 1 --2- 172.21.15.50:0/3830214887 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc7c064f10 0x7fdc7c0673c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdc88007fd0 tx=0x7fdc88009040 comp rx=0 tx=0).stop 2023-11-28T11:53:53.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.621+0000 7fdc9eef4700 1 -- 172.21.15.50:0/3830214887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc980ce5c0 msgr2=0x7fdc98158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.621+0000 7fdc9eef4700 1 --2- 172.21.15.50:0/3830214887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc980ce5c0 0x7fdc98158610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdc940090b0 tx=0x7fdc94004770 comp rx=0 tx=0).stop 2023-11-28T11:53:53.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.621+0000 7fdc9eef4700 1 -- 172.21.15.50:0/3830214887 shutdown_connections 2023-11-28T11:53:53.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.621+0000 7fdc9eef4700 1 --2- 172.21.15.50:0/3830214887 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc980ced50 0x7fdc981f9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.621+0000 7fdc9eef4700 1 --2- 172.21.15.50:0/3830214887 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc7c064f10 0x7fdc7c0673c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.621+0000 7fdc9eef4700 1 --2- 172.21.15.50:0/3830214887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc980ce5c0 0x7fdc98158610 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.621+0000 7fdc9eef4700 1 --2- 172.21.15.50:0/3830214887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc980c2240 0x7fdc980c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.621+0000 7fdc9eef4700 1 -- 172.21.15.50:0/3830214887 >> 172.21.15.50:0/3830214887 conn(0x7fdc9806c660 msgr2=0x7fdc980cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:53.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.621+0000 7fdc9eef4700 1 -- 172.21.15.50:0/3830214887 shutdown_connections 2023-11-28T11:53:53.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.621+0000 7fdc9eef4700 1 -- 172.21.15.50:0/3830214887 wait complete. 2023-11-28T11:53:53.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:53:53.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59eb69700 1 Processor -- start 2023-11-28T11:53:53.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59eb69700 1 -- start start 2023-11-28T11:53:53.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59eb69700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5980b1ae0 0x7fe59806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:53.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59eb69700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe59806a4c0 0x7fe5980d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:53.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59eb69700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59806a9c0 con 0x7fe5980cf0e0 2023-11-28T11:53:53.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59eb69700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59806aca0 con 0x7fe59806a4c0 2023-11-28T11:53:53.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59eb69700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59806af80 con 0x7fe5980b1ae0 2023-11-28T11:53:53.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59d366700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe59806a4c0 0x7fe5980d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:53.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59e368700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe5980cf0e0 0x7fe5980b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60162/0 (socket says 172.21.15.50:60162) 2023-11-28T11:53:53.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59e368700 1 -- 172.21.15.50:0/1415810291 learned_addr learned my addr 172.21.15.50:0/1415810291 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:53.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59db67700 1 --2- 172.21.15.50:0/1415810291 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5980b1ae0 0x7fe59806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:53.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59d366700 1 -- 172.21.15.50:0/1415810291 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5980b1ae0 msgr2=0x7fe59806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:53.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59d366700 1 --2- 172.21.15.50:0/1415810291 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5980b1ae0 0x7fe59806d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59d366700 1 -- 172.21.15.50:0/1415810291 >> v1:172.21.15.50:6789/0 conn(0x7fe5980cf0e0 legacy=0x7fe5980b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59cb65700 1 -- 172.21.15.50:0/1415810291 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801311689 0 0) 0x7fe59806a9c0 con 0x7fe5980cf0e0 2023-11-28T11:53:53.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59d366700 1 -- 172.21.15.50:0/1415810291 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5980b4380 con 0x7fe59806a4c0 2023-11-28T11:53:53.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59d366700 1 --2- 172.21.15.50:0/1415810291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe59806a4c0 0x7fe5980d03a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe588009850 tx=0x7fe588009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1375d7f5ed93a4b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:53.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59cb65700 1 -- 172.21.15.50:0/1415810291 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588011830 con 0x7fe59806a4c0 2023-11-28T11:53:53.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59cb65700 1 -- 172.21.15.50:0/1415810291 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe588011990 con 0x7fe59806a4c0 2023-11-28T11:53:53.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.757+0000 7fe59cb65700 1 -- 172.21.15.50:0/1415810291 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588011d40 con 0x7fe59806a4c0 2023-11-28T11:53:53.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.761+0000 7fe59eb69700 1 -- 172.21.15.50:0/1415810291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe59806a4c0 msgr2=0x7fe5980d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.761+0000 7fe59eb69700 1 --2- 172.21.15.50:0/1415810291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe59806a4c0 0x7fe5980d03a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe588009850 tx=0x7fe588009b60 comp rx=0 tx=0).stop 2023-11-28T11:53:53.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.761+0000 7fe59eb69700 1 -- 172.21.15.50:0/1415810291 shutdown_connections 2023-11-28T11:53:53.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.761+0000 7fe59eb69700 1 --2- 172.21.15.50:0/1415810291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe59806a4c0 0x7fe5980d03a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.761+0000 7fe59eb69700 1 --2- 172.21.15.50:0/1415810291 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5980b1ae0 0x7fe59806d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.761+0000 7fe59eb69700 1 -- 172.21.15.50:0/1415810291 >> 172.21.15.50:0/1415810291 conn(0x7fe59809bbd0 msgr2=0x7fe5980b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:53.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.761+0000 7fe59eb69700 1 -- 172.21.15.50:0/1415810291 shutdown_connections 2023-11-28T11:53:53.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.761+0000 7fe59eb69700 1 -- 172.21.15.50:0/1415810291 wait complete. 2023-11-28T11:53:53.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.761+0000 7fe59eb69700 1 Processor -- start 2023-11-28T11:53:53.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.761+0000 7fe59eb69700 1 -- start start 2023-11-28T11:53:53.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.761+0000 7fe59eb69700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe59806a4c0 0x7fe59815afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:53.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.761+0000 7fe59eb69700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5980b1ae0 0x7fe5980b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:53.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.761+0000 7fe59eb69700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5980cf0e0 0x7fe5980b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:53.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.761+0000 7fe59eb69700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5980c8120 con 0x7fe5980b1ae0 2023-11-28T11:53:53.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.761+0000 7fe59eb69700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5980c7510 con 0x7fe5980cf0e0 2023-11-28T11:53:53.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.761+0000 7fe59eb69700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5980c77f0 con 0x7fe59806a4c0 2023-11-28T11:53:53.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.765+0000 7fe59d366700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5980b1ae0 0x7fe5980b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:53.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.765+0000 7fe59d366700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5980b1ae0 0x7fe5980b06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47918/0 (socket says 172.21.15.50:47918) 2023-11-28T11:53:53.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.765+0000 7fe59db67700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe59806a4c0 0x7fe59815afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:53.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.765+0000 7fe59e368700 1 --2- 172.21.15.50:0/3263368211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5980cf0e0 0x7fe5980b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:53.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.765+0000 7fe59d366700 1 -- 172.21.15.50:0/3263368211 learned_addr learned my addr 172.21.15.50:0/3263368211 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:53.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.765+0000 7fe59d366700 1 -- 172.21.15.50:0/3263368211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe59806a4c0 msgr2=0x7fe59815afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.765+0000 7fe59d366700 1 --2- 172.21.15.50:0/3263368211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe59806a4c0 0x7fe59815afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.765+0000 7fe59d366700 1 -- 172.21.15.50:0/3263368211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5980cf0e0 msgr2=0x7fe5980b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.765+0000 7fe59d366700 1 --2- 172.21.15.50:0/3263368211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5980cf0e0 0x7fe5980b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.765+0000 7fe59d366700 1 -- 172.21.15.50:0/3263368211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5880094b0 con 0x7fe5980b1ae0 2023-11-28T11:53:53.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.765+0000 7fe59d366700 1 --2- 172.21.15.50:0/3263368211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5980b1ae0 0x7fe5980b06a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe588000c00 tx=0x7fe588004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:53.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.765+0000 7fe58e7fc700 1 -- 172.21.15.50:0/3263368211 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588019980 con 0x7fe5980b1ae0 2023-11-28T11:53:53.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.765+0000 7fe58e7fc700 1 -- 172.21.15.50:0/3263368211 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58801e070 con 0x7fe5980b1ae0 2023-11-28T11:53:53.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.765+0000 7fe59eb69700 1 -- 172.21.15.50:0/3263368211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5980b60e0 con 0x7fe5980b1ae0 2023-11-28T11:53:53.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.765+0000 7fe58e7fc700 1 -- 172.21.15.50:0/3263368211 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588019d20 con 0x7fe5980b1ae0 2023-11-28T11:53:53.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.765+0000 7fe59eb69700 1 -- 172.21.15.50:0/3263368211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5980b1eb0 con 0x7fe5980b1ae0 2023-11-28T11:53:53.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.765+0000 7fe59eb69700 1 -- 172.21.15.50:0/3263368211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5980d08e0 con 0x7fe5980b1ae0 2023-11-28T11:53:53.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.769+0000 7fe58e7fc700 1 -- 172.21.15.50:0/3263368211 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe58800f050 con 0x7fe5980b1ae0 2023-11-28T11:53:53.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.769+0000 7fe58e7fc700 1 --2- 172.21.15.50:0/3263368211 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe57c064ee0 0x7fe57c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:53.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.769+0000 7fe58e7fc700 1 -- 172.21.15.50:0/3263368211 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe5880830b0 con 0x7fe5980b1ae0 2023-11-28T11:53:53.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.769+0000 7fe59db67700 1 --2- 172.21.15.50:0/3263368211 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe57c064ee0 0x7fe57c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:53.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.773+0000 7fe59db67700 1 --2- 172.21.15.50:0/3263368211 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe57c064ee0 0x7fe57c067390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe594009bf0 tx=0x7fe594009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:53.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.777+0000 7fe58e7fc700 1 -- 172.21.15.50:0/3263368211 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe588050f60 con 0x7fe5980b1ae0 2023-11-28T11:53:53.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.937+0000 7fe59eb69700 1 -- 172.21.15.50:0/3263368211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe5980c8260 con 0x7fe5980b1ae0 2023-11-28T11:53:53.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.937+0000 7fe58e7fc700 1 -- 172.21.15.50:0/3263368211 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe588054580 con 0x7fe5980b1ae0 2023-11-28T11:53:53.942 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:53:53.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.941+0000 7fe59eb69700 1 -- 172.21.15.50:0/3263368211 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe57c064ee0 msgr2=0x7fe57c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.941+0000 7fe59eb69700 1 --2- 172.21.15.50:0/3263368211 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe57c064ee0 0x7fe57c067390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe594009bf0 tx=0x7fe594009240 comp rx=0 tx=0).stop 2023-11-28T11:53:53.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.941+0000 7fe59eb69700 1 -- 172.21.15.50:0/3263368211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5980b1ae0 msgr2=0x7fe5980b06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:53.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.941+0000 7fe59eb69700 1 --2- 172.21.15.50:0/3263368211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5980b1ae0 0x7fe5980b06a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe588000c00 tx=0x7fe588004770 comp rx=0 tx=0).stop 2023-11-28T11:53:53.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.941+0000 7fe59eb69700 1 -- 172.21.15.50:0/3263368211 shutdown_connections 2023-11-28T11:53:53.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.941+0000 7fe59eb69700 1 --2- 172.21.15.50:0/3263368211 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe57c064ee0 0x7fe57c067390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.941+0000 7fe59eb69700 1 --2- 172.21.15.50:0/3263368211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5980cf0e0 0x7fe5980b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.941+0000 7fe59eb69700 1 --2- 172.21.15.50:0/3263368211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5980b1ae0 0x7fe5980b06a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.941+0000 7fe59eb69700 1 --2- 172.21.15.50:0/3263368211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe59806a4c0 0x7fe59815afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:53.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.941+0000 7fe59eb69700 1 -- 172.21.15.50:0/3263368211 >> 172.21.15.50:0/3263368211 conn(0x7fe59809bbd0 msgr2=0x7fe59815bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:53.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.941+0000 7fe59eb69700 1 -- 172.21.15.50:0/3263368211 shutdown_connections 2023-11-28T11:53:53.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:53.941+0000 7fe59eb69700 1 -- 172.21.15.50:0/3263368211 wait complete. 2023-11-28T11:53:53.962 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:53:54.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f674d5e3700 1 Processor -- start 2023-11-28T11:53:54.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f674d5e3700 1 -- start start 2023-11-28T11:53:54.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f674d5e3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f674806d7d0 0x7f674806a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:54.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f674d5e3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67480b4c10 0x7f67480cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:54.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f674d5e3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f674806dc70 con 0x7f67480cf050 2023-11-28T11:53:54.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f674d5e3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674806aa70 con 0x7f674806d7d0 2023-11-28T11:53:54.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f674d5e3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674815c6d0 con 0x7f67480b4c10 2023-11-28T11:53:54.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f6747fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f67480cf050 0x7f67480cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60164/0 (socket says 172.21.15.50:60164) 2023-11-28T11:53:54.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f6747fff700 1 -- 172.21.15.50:0/627109143 learned_addr learned my addr 172.21.15.50:0/627109143 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:53:54.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f67477fe700 1 --2- 172.21.15.50:0/627109143 >> v2:172.21.15.192:3300/0 conn(0x7f674806d7d0 0x7f674806a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:54.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f674cde2700 1 --2- 172.21.15.50:0/627109143 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67480b4c10 0x7f67480cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:54.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f6746ffd700 1 -- 172.21.15.50:0/627109143 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504200506 0 0) 0x7f673c001110 con 0x7f67480cf050 2023-11-28T11:53:54.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f6746ffd700 1 -- 172.21.15.50:0/627109143 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67300035d0 con 0x7f67480cf050 2023-11-28T11:53:54.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f67477fe700 1 -- 172.21.15.50:0/627109143 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67480b4c10 msgr2=0x7f67480cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:53:54.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f67477fe700 1 --2- 172.21.15.50:0/627109143 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67480b4c10 0x7f67480cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:54.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f67477fe700 1 -- 172.21.15.50:0/627109143 >> v1:172.21.15.50:6789/0 conn(0x7f67480cf050 legacy=0x7f67480cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:54.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f67477fe700 1 -- 172.21.15.50:0/627109143 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674806ac60 con 0x7f674806d7d0 2023-11-28T11:53:54.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f674cde2700 1 --2- 172.21.15.50:0/627109143 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67480b4c10 0x7f67480cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:53:54.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f67477fe700 1 --2- 172.21.15.50:0/627109143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f674806d7d0 0x7f674806a530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6738009850 tx=0x7f6738009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7eb0fd8cb0ea3bf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:54.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f6746ffd700 1 -- 172.21.15.50:0/627109143 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738011830 con 0x7f674806d7d0 2023-11-28T11:53:54.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f6746ffd700 1 -- 172.21.15.50:0/627109143 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6738011990 con 0x7f674806d7d0 2023-11-28T11:53:54.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.077+0000 7f6746ffd700 1 -- 172.21.15.50:0/627109143 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738011d40 con 0x7f674806d7d0 2023-11-28T11:53:54.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f674d5e3700 1 -- 172.21.15.50:0/627109143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f674806d7d0 msgr2=0x7f674806a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:54.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f674d5e3700 1 --2- 172.21.15.50:0/627109143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f674806d7d0 0x7f674806a530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6738009850 tx=0x7f6738009b60 comp rx=0 tx=0).stop 2023-11-28T11:53:54.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f674d5e3700 1 -- 172.21.15.50:0/627109143 shutdown_connections 2023-11-28T11:53:54.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f674d5e3700 1 --2- 172.21.15.50:0/627109143 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67480b4c10 0x7f67480cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:54.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f674d5e3700 1 --2- 172.21.15.50:0/627109143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f674806d7d0 0x7f674806a530 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:54.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f674d5e3700 1 -- 172.21.15.50:0/627109143 >> 172.21.15.50:0/627109143 conn(0x7f674809bb30 msgr2=0x7f67480b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:54.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f674d5e3700 1 -- 172.21.15.50:0/627109143 shutdown_connections 2023-11-28T11:53:54.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f674d5e3700 1 -- 172.21.15.50:0/627109143 wait complete. 2023-11-28T11:53:54.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f674d5e3700 1 Processor -- start 2023-11-28T11:53:54.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f674d5e3700 1 -- start start 2023-11-28T11:53:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f674d5e3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f674806d7d0 0x7f67481590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f674d5e3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67480b4c10 0x7f67480b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f674d5e3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67480cf050 0x7f67480b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f674d5e3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674815f060 con 0x7f67480b4c10 2023-11-28T11:53:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f674d5e3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67480c7350 con 0x7f67480cf050 2023-11-28T11:53:54.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f674d5e3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67480c7630 con 0x7f674806d7d0 2023-11-28T11:53:54.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f67477fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67480b4c10 0x7f67480b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:54.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f67477fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67480b4c10 0x7f67480b0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47922/0 (socket says 172.21.15.50:47922) 2023-11-28T11:53:54.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f67477fe700 1 -- 172.21.15.50:0/483392087 learned_addr learned my addr 172.21.15.50:0/483392087 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:53:54.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.081+0000 7f6747fff700 1 --2- 172.21.15.50:0/483392087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f674806d7d0 0x7f67481590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:54.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f674cde2700 1 --2- 172.21.15.50:0/483392087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67480cf050 0x7f67480b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:54.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f67477fe700 1 -- 172.21.15.50:0/483392087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f674806d7d0 msgr2=0x7f67481590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:54.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f67477fe700 1 --2- 172.21.15.50:0/483392087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f674806d7d0 0x7f67481590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:54.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f67477fe700 1 -- 172.21.15.50:0/483392087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67480cf050 msgr2=0x7f67480b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:54.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f67477fe700 1 --2- 172.21.15.50:0/483392087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67480cf050 0x7f67480b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:54.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f67477fe700 1 -- 172.21.15.50:0/483392087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6740009a70 con 0x7f67480b4c10 2023-11-28T11:53:54.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f6747fff700 1 --2- 172.21.15.50:0/483392087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f674806d7d0 0x7f67481590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:53:54.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f67477fe700 1 --2- 172.21.15.50:0/483392087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67480b4c10 0x7f67480b0010 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f67380090b0 tx=0x7f6738004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:54.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f6744ff9700 1 -- 172.21.15.50:0/483392087 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738004380 con 0x7f67480b4c10 2023-11-28T11:53:54.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f6744ff9700 1 -- 172.21.15.50:0/483392087 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673801f070 con 0x7f67480b4c10 2023-11-28T11:53:54.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f674d5e3700 1 -- 172.21.15.50:0/483392087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67380094b0 con 0x7f67480b4c10 2023-11-28T11:53:54.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f6744ff9700 1 -- 172.21.15.50:0/483392087 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67380036c0 con 0x7f67480b4c10 2023-11-28T11:53:54.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f674d5e3700 1 -- 172.21.15.50:0/483392087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67480b4410 con 0x7f67480b4c10 2023-11-28T11:53:54.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f6744ff9700 1 -- 172.21.15.50:0/483392087 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f673802a020 con 0x7f67480b4c10 2023-11-28T11:53:54.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f674d5e3700 1 -- 172.21.15.50:0/483392087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f674806af40 con 0x7f67480b4c10 2023-11-28T11:53:54.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f6744ff9700 1 --2- 172.21.15.50:0/483392087 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6734064ee0 0x7f6734067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:53:54.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f6744ff9700 1 -- 172.21.15.50:0/483392087 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6738083580 con 0x7f67480b4c10 2023-11-28T11:53:54.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.085+0000 7f6747fff700 1 --2- 172.21.15.50:0/483392087 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6734064ee0 0x7f6734067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:53:54.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.089+0000 7f6747fff700 1 --2- 172.21.15.50:0/483392087 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6734064ee0 0x7f6734067390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f673c001270 tx=0x7f673c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:53:54.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.097+0000 7f6744ff9700 1 -- 172.21.15.50:0/483392087 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6738051430 con 0x7f67480b4c10 2023-11-28T11:53:54.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.265+0000 7f674d5e3700 1 -- 172.21.15.50:0/483392087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f67480b46f0 con 0x7f67480b4c10 2023-11-28T11:53:54.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.269+0000 7f6744ff9700 1 -- 172.21.15.50:0/483392087 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6738006ce0 con 0x7f67480b4c10 2023-11-28T11:53:54.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.269+0000 7f674d5e3700 1 -- 172.21.15.50:0/483392087 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6734064ee0 msgr2=0x7f6734067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:54.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.269+0000 7f674d5e3700 1 --2- 172.21.15.50:0/483392087 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6734064ee0 0x7f6734067390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f673c001270 tx=0x7f673c009040 comp rx=0 tx=0).stop 2023-11-28T11:53:54.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.269+0000 7f674d5e3700 1 -- 172.21.15.50:0/483392087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67480b4c10 msgr2=0x7f67480b0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:53:54.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.269+0000 7f674d5e3700 1 --2- 172.21.15.50:0/483392087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67480b4c10 0x7f67480b0010 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f67380090b0 tx=0x7f6738004770 comp rx=0 tx=0).stop 2023-11-28T11:53:54.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.269+0000 7f674d5e3700 1 -- 172.21.15.50:0/483392087 shutdown_connections 2023-11-28T11:53:54.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.269+0000 7f674d5e3700 1 --2- 172.21.15.50:0/483392087 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6734064ee0 0x7f6734067390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:54.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.269+0000 7f674d5e3700 1 --2- 172.21.15.50:0/483392087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67480cf050 0x7f67480b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:54.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.269+0000 7f674d5e3700 1 --2- 172.21.15.50:0/483392087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67480b4c10 0x7f67480b0010 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:54.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.269+0000 7f674d5e3700 1 --2- 172.21.15.50:0/483392087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f674806d7d0 0x7f67481590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:53:54.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.269+0000 7f674d5e3700 1 -- 172.21.15.50:0/483392087 >> 172.21.15.50:0/483392087 conn(0x7f674809bb30 msgr2=0x7f6748069dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:53:54.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.269+0000 7f674d5e3700 1 -- 172.21.15.50:0/483392087 shutdown_connections 2023-11-28T11:53:54.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:53:54.269+0000 7f674d5e3700 1 -- 172.21.15.50:0/483392087 wait complete. 2023-11-28T11:53:54.278 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-11-28T11:53:54.287 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-11-28T11:53:54.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:53:54.288 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-28T11:53:54.307 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[42105]: fuse finished with error 0 and tester_r 0 2023-11-28T11:53:54.309 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:54:00.411 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T11:54:00.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:00.412 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-28T11:54:00.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:00.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.769+0000 7fdfc8925700 1 Processor -- start 2023-11-28T11:54:00.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.769+0000 7fdfc8925700 1 -- start start 2023-11-28T11:54:00.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc8925700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfc40cadf0 0x7fdfc40cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:00.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc8925700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc4158440 con 0x7fdfc406c8d0 2023-11-28T11:54:00.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc8925700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc406a960 con 0x7fdfc4158070 2023-11-28T11:54:00.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc8925700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc406b500 con 0x7fdfc40cadf0 2023-11-28T11:54:00.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc2ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdfc406c8d0 0x7fdfc406adf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60168/0 (socket says 172.21.15.50:60168) 2023-11-28T11:54:00.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc2ffd700 1 -- 172.21.15.50:0/4275496167 learned_addr learned my addr 172.21.15.50:0/4275496167 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:00.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc3fff700 1 --2- 172.21.15.50:0/4275496167 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfc40cadf0 0x7fdfc40cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:00.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc27fc700 1 -- 172.21.15.50:0/4275496167 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343953243 0 0) 0x7fdfc4158440 con 0x7fdfc406c8d0 2023-11-28T11:54:00.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc27fc700 1 -- 172.21.15.50:0/4275496167 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfac0035d0 con 0x7fdfc406c8d0 2023-11-28T11:54:00.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc27fc700 1 -- 172.21.15.50:0/4275496167 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712497605 0 0) 0x7fdfc406a960 con 0x7fdfc4158070 2023-11-28T11:54:00.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc27fc700 1 -- 172.21.15.50:0/4275496167 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfc4158440 con 0x7fdfc4158070 2023-11-28T11:54:00.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc3fff700 1 -- 172.21.15.50:0/4275496167 >> v1:172.21.15.192:6789/0 conn(0x7fdfc4158070 legacy=0x7fdfc40ad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:00.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc3fff700 1 -- 172.21.15.50:0/4275496167 >> v1:172.21.15.50:6789/0 conn(0x7fdfc406c8d0 legacy=0x7fdfc406adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:00.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc3fff700 1 -- 172.21.15.50:0/4275496167 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc406ceb0 con 0x7fdfc40cadf0 2023-11-28T11:54:00.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc3fff700 1 --2- 172.21.15.50:0/4275496167 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfc40cadf0 0x7fdfc40cb270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00ca30 tx=0x7fdfbc00cd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1ec737a6d74db33 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:00.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc27fc700 1 -- 172.21.15.50:0/4275496167 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc007dd0 con 0x7fdfc40cadf0 2023-11-28T11:54:00.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc27fc700 1 -- 172.21.15.50:0/4275496167 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc00b8e0 con 0x7fdfc40cadf0 2023-11-28T11:54:00.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc27fc700 1 -- 172.21.15.50:0/4275496167 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc00bc90 con 0x7fdfc40cadf0 2023-11-28T11:54:00.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc8925700 1 -- 172.21.15.50:0/4275496167 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfc40cadf0 msgr2=0x7fdfc40cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:00.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc8925700 1 --2- 172.21.15.50:0/4275496167 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfc40cadf0 0x7fdfc40cb270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00ca30 tx=0x7fdfbc00cd40 comp rx=0 tx=0).stop 2023-11-28T11:54:00.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc8925700 1 -- 172.21.15.50:0/4275496167 shutdown_connections 2023-11-28T11:54:00.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc8925700 1 --2- 172.21.15.50:0/4275496167 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfc40cadf0 0x7fdfc40cb270 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:00.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc8925700 1 -- 172.21.15.50:0/4275496167 >> 172.21.15.50:0/4275496167 conn(0x7fdfc40ce3e0 msgr2=0x7fdfc40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:00.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc8925700 1 -- 172.21.15.50:0/4275496167 shutdown_connections 2023-11-28T11:54:00.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.773+0000 7fdfc8925700 1 -- 172.21.15.50:0/4275496167 wait complete. 2023-11-28T11:54:00.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc8925700 1 Processor -- start 2023-11-28T11:54:00.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc8925700 1 -- start start 2023-11-28T11:54:00.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc8925700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfc406c8d0 0x7fdfc414a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:00.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc8925700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc40cadf0 0x7fdfc4157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:00.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc8925700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfc4158070 0x7fdfc4071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:00.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc8925700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc40ae990 con 0x7fdfc40cadf0 2023-11-28T11:54:00.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc8925700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4157350 con 0x7fdfc406c8d0 2023-11-28T11:54:00.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc8925700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc40addc0 con 0x7fdfc4158070 2023-11-28T11:54:00.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc40cadf0 0x7fdfc4157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:00.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc37fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfc406c8d0 0x7fdfc414a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:00.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc3fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfc4158070 0x7fdfc4071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:00.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc37fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfc406c8d0 0x7fdfc414a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:51080/0 (socket says 172.21.15.50:51080) 2023-11-28T11:54:00.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc40cadf0 0x7fdfc4157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47932/0 (socket says 172.21.15.50:47932) 2023-11-28T11:54:00.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc37fe700 1 -- 172.21.15.50:0/1848139010 learned_addr learned my addr 172.21.15.50:0/1848139010 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:00.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc37fe700 1 -- 172.21.15.50:0/1848139010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfc4158070 msgr2=0x7fdfc4071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc37fe700 1 --2- 172.21.15.50:0/1848139010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfc4158070 0x7fdfc4071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc37fe700 1 -- 172.21.15.50:0/1848139010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc40cadf0 msgr2=0x7fdfc4157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc37fe700 1 --2- 172.21.15.50:0/1848139010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc40cadf0 0x7fdfc4157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc37fe700 1 -- 172.21.15.50:0/1848139010 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc00c660 con 0x7fdfc406c8d0 2023-11-28T11:54:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc3fff700 1 --2- 172.21.15.50:0/1848139010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfc4158070 0x7fdfc4071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.777+0000 7fdfc2ffd700 1 --2- 172.21.15.50:0/1848139010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc40cadf0 0x7fdfc4157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.781+0000 7fdfc37fe700 1 --2- 172.21.15.50:0/1848139010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfc406c8d0 0x7fdfc414a230 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800c490 tx=0x7fdfb800c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.781+0000 7fdfabfff700 1 -- 172.21.15.50:0/1848139010 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb800cea0 con 0x7fdfc406c8d0 2023-11-28T11:54:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.781+0000 7fdfabfff700 1 -- 172.21.15.50:0/1848139010 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb80052f0 con 0x7fdfc406c8d0 2023-11-28T11:54:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.781+0000 7fdfabfff700 1 -- 172.21.15.50:0/1848139010 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80036a0 con 0x7fdfc406c8d0 2023-11-28T11:54:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.781+0000 7fdfc8925700 1 -- 172.21.15.50:0/1848139010 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc406d470 con 0x7fdfc406c8d0 2023-11-28T11:54:00.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.781+0000 7fdfc8925700 1 -- 172.21.15.50:0/1848139010 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc406d190 con 0x7fdfc406c8d0 2023-11-28T11:54:00.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.781+0000 7fdfc8925700 1 -- 172.21.15.50:0/1848139010 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc4072500 con 0x7fdfc406c8d0 2023-11-28T11:54:00.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.781+0000 7fdfabfff700 1 -- 172.21.15.50:0/1848139010 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdfb8019030 con 0x7fdfc406c8d0 2023-11-28T11:54:00.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.781+0000 7fdfabfff700 1 --2- 172.21.15.50:0/1848139010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdfb0064ee0 0x7fdfb0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:00.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.781+0000 7fdfabfff700 1 -- 172.21.15.50:0/1848139010 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdfb80817f0 con 0x7fdfc406c8d0 2023-11-28T11:54:00.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.785+0000 7fdfc2ffd700 1 --2- 172.21.15.50:0/1848139010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdfb0064ee0 0x7fdfb0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:00.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.785+0000 7fdfc2ffd700 1 --2- 172.21.15.50:0/1848139010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdfb0064ee0 0x7fdfb0067390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdfc41f4c20 tx=0x7fdfb4007e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:00.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.789+0000 7fdfabfff700 1 -- 172.21.15.50:0/1848139010 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdfb804f740 con 0x7fdfc406c8d0 2023-11-28T11:54:00.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.965+0000 7fdfc8925700 1 -- 172.21.15.50:0/1848139010 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfc406a570 con 0x7fdfc406c8d0 2023-11-28T11:54:00.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.969+0000 7fdfabfff700 1 -- 172.21.15.50:0/1848139010 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7fdfb8052d60 con 0x7fdfc406c8d0 2023-11-28T11:54:00.973 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:00.974 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:45.231747+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:00.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.973+0000 7fdfc8925700 1 -- 172.21.15.50:0/1848139010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdfb0064ee0 msgr2=0x7fdfb0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:00.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.973+0000 7fdfc8925700 1 --2- 172.21.15.50:0/1848139010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdfb0064ee0 0x7fdfb0067390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdfc41f4c20 tx=0x7fdfb4007e00 comp rx=0 tx=0).stop 2023-11-28T11:54:00.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.973+0000 7fdfc8925700 1 -- 172.21.15.50:0/1848139010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfc406c8d0 msgr2=0x7fdfc414a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:00.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.973+0000 7fdfc8925700 1 --2- 172.21.15.50:0/1848139010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfc406c8d0 0x7fdfc414a230 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800c490 tx=0x7fdfb800c7a0 comp rx=0 tx=0).stop 2023-11-28T11:54:00.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.973+0000 7fdfc8925700 1 -- 172.21.15.50:0/1848139010 shutdown_connections 2023-11-28T11:54:00.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.973+0000 7fdfc8925700 1 --2- 172.21.15.50:0/1848139010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfc4158070 0x7fdfc4071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:00.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.973+0000 7fdfc8925700 1 --2- 172.21.15.50:0/1848139010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc40cadf0 0x7fdfc4157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:00.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.973+0000 7fdfc8925700 1 --2- 172.21.15.50:0/1848139010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdfb0064ee0 0x7fdfb0067390 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:00.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.973+0000 7fdfc8925700 1 --2- 172.21.15.50:0/1848139010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfc406c8d0 0x7fdfc414a230 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:00.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.973+0000 7fdfc8925700 1 -- 172.21.15.50:0/1848139010 >> 172.21.15.50:0/1848139010 conn(0x7fdfc40ce3e0 msgr2=0x7fdfc415ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:00.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.973+0000 7fdfc8925700 1 -- 172.21.15.50:0/1848139010 shutdown_connections 2023-11-28T11:54:00.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:00.973+0000 7fdfc8925700 1 -- 172.21.15.50:0/1848139010 wait complete. 2023-11-28T11:54:00.994 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:01.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.105+0000 7f1c76ab0700 1 Processor -- start 2023-11-28T11:54:01.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.105+0000 7f1c76ab0700 1 -- start start 2023-11-28T11:54:01.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.105+0000 7f1c76ab0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c700cd000 0x7f1c700cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:01.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c76ab0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1c700b09a0 0x7f1c700cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:01.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c76ab0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c700ce3a0 con 0x7f1c700cd3d0 2023-11-28T11:54:01.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c76ab0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c700d02c0 con 0x7f1c700b09a0 2023-11-28T11:54:01.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c76ab0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700b0e20 con 0x7f1c700cd000 2023-11-28T11:54:01.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c752ad700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1c700cd3d0 0x7f1c700b3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60172/0 (socket says 172.21.15.50:60172) 2023-11-28T11:54:01.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c752ad700 1 -- 172.21.15.50:0/1521042391 learned_addr learned my addr 172.21.15.50:0/1521042391 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:01.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c762af700 1 --2- 172.21.15.50:0/1521042391 >> v2:172.21.15.192:3300/0 conn(0x7f1c700b09a0 0x7f1c700cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:01.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c75aae700 1 --2- 172.21.15.50:0/1521042391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c700cd000 0x7f1c700cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:01.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c74aac700 1 -- 172.21.15.50:0/1521042391 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294803037 0 0) 0x7f1c700ce3a0 con 0x7f1c700cd3d0 2023-11-28T11:54:01.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c74aac700 1 -- 172.21.15.50:0/1521042391 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c5c0035d0 con 0x7f1c700cd3d0 2023-11-28T11:54:01.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c762af700 1 -- 172.21.15.50:0/1521042391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c700cd000 msgr2=0x7f1c700cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:01.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c762af700 1 --2- 172.21.15.50:0/1521042391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c700cd000 0x7f1c700cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c762af700 1 -- 172.21.15.50:0/1521042391 >> v1:172.21.15.50:6789/0 conn(0x7f1c700cd3d0 legacy=0x7f1c700b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:01.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c762af700 1 -- 172.21.15.50:0/1521042391 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c700ce640 con 0x7f1c700b09a0 2023-11-28T11:54:01.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c762af700 1 --2- 172.21.15.50:0/1521042391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c700b09a0 0x7f1c700cf120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009d90 tx=0x7f1c6800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fa4269de5378d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:01.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c74aac700 1 -- 172.21.15.50:0/1521042391 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6800e070 con 0x7f1c700b09a0 2023-11-28T11:54:01.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c74aac700 1 -- 172.21.15.50:0/1521042391 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6800bb20 con 0x7f1c700b09a0 2023-11-28T11:54:01.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c74aac700 1 -- 172.21.15.50:0/1521042391 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68012430 con 0x7f1c700b09a0 2023-11-28T11:54:01.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c76ab0700 1 -- 172.21.15.50:0/1521042391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c700b09a0 msgr2=0x7f1c700cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:01.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c76ab0700 1 --2- 172.21.15.50:0/1521042391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c700b09a0 0x7f1c700cf120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009d90 tx=0x7f1c6800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:01.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c76ab0700 1 -- 172.21.15.50:0/1521042391 shutdown_connections 2023-11-28T11:54:01.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c76ab0700 1 --2- 172.21.15.50:0/1521042391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c700b09a0 0x7f1c700cf120 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c76ab0700 1 --2- 172.21.15.50:0/1521042391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c700cd000 0x7f1c700cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c76ab0700 1 -- 172.21.15.50:0/1521042391 >> 172.21.15.50:0/1521042391 conn(0x7f1c700b2140 msgr2=0x7f1c700b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:01.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c76ab0700 1 -- 172.21.15.50:0/1521042391 shutdown_connections 2023-11-28T11:54:01.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.109+0000 7f1c76ab0700 1 -- 172.21.15.50:0/1521042391 wait complete. 2023-11-28T11:54:01.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.113+0000 7f1c76ab0700 1 Processor -- start 2023-11-28T11:54:01.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.113+0000 7f1c76ab0700 1 -- start start 2023-11-28T11:54:01.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c76ab0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c700b09a0 0x7f1c70152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:01.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c76ab0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c700cd000 0x7f1c700afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:01.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c76ab0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c700cd3d0 0x7f1c7006e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:01.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c76ab0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c701533e0 con 0x7f1c700cd3d0 2023-11-28T11:54:01.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c76ab0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700c81b0 con 0x7f1c700b09a0 2023-11-28T11:54:01.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c76ab0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700c8490 con 0x7f1c700cd000 2023-11-28T11:54:01.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c762af700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c700cd3d0 0x7f1c7006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:01.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c762af700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c700cd3d0 0x7f1c7006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47936/0 (socket says 172.21.15.50:47936) 2023-11-28T11:54:01.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c762af700 1 -- 172.21.15.50:0/2937339920 learned_addr learned my addr 172.21.15.50:0/2937339920 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:01.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c75aae700 1 --2- 172.21.15.50:0/2937339920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c700b09a0 0x7f1c70152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:01.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c752ad700 1 --2- 172.21.15.50:0/2937339920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c700cd000 0x7f1c700afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:01.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c762af700 1 -- 172.21.15.50:0/2937339920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c700cd000 msgr2=0x7f1c700afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:01.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c762af700 1 --2- 172.21.15.50:0/2937339920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c700cd000 0x7f1c700afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c762af700 1 -- 172.21.15.50:0/2937339920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c700b09a0 msgr2=0x7f1c70152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:01.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c762af700 1 --2- 172.21.15.50:0/2937339920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c700b09a0 0x7f1c70152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c762af700 1 -- 172.21.15.50:0/2937339920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c68009a70 con 0x7f1c700cd3d0 2023-11-28T11:54:01.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c762af700 1 --2- 172.21.15.50:0/2937339920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c700cd3d0 0x7f1c7006e000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1c68014040 tx=0x7f1c68004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:01.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c667fc700 1 -- 172.21.15.50:0/2937339920 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68012430 con 0x7f1c700cd3d0 2023-11-28T11:54:01.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c667fc700 1 -- 172.21.15.50:0/2937339920 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c68020070 con 0x7f1c700cd3d0 2023-11-28T11:54:01.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c76ab0700 1 -- 172.21.15.50:0/2937339920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c700cec00 con 0x7f1c700cd3d0 2023-11-28T11:54:01.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c667fc700 1 -- 172.21.15.50:0/2937339920 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c680098f0 con 0x7f1c700cd3d0 2023-11-28T11:54:01.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c76ab0700 1 -- 172.21.15.50:0/2937339920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c700ce920 con 0x7f1c700cd3d0 2023-11-28T11:54:01.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.117+0000 7f1c76ab0700 1 -- 172.21.15.50:0/2937339920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7015d6a0 con 0x7f1c700cd3d0 2023-11-28T11:54:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.121+0000 7f1c667fc700 1 -- 172.21.15.50:0/2937339920 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1c6802e070 con 0x7f1c700cd3d0 2023-11-28T11:54:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.121+0000 7f1c667fc700 1 --2- 172.21.15.50:0/2937339920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c54064ee0 0x7f1c54067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.121+0000 7f1c667fc700 1 -- 172.21.15.50:0/2937339920 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1c68022070 con 0x7f1c700cd3d0 2023-11-28T11:54:01.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.121+0000 7f1c75aae700 1 --2- 172.21.15.50:0/2937339920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c54064ee0 0x7f1c54067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:01.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.121+0000 7f1c75aae700 1 --2- 172.21.15.50:0/2937339920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c54064ee0 0x7f1c54067390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1c700b5f50 tx=0x7f1c60009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:01.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.129+0000 7f1c667fc700 1 -- 172.21.15.50:0/2937339920 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1c68051c10 con 0x7f1c700cd3d0 2023-11-28T11:54:01.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.297+0000 7f1c76ab0700 1 -- 172.21.15.50:0/2937339920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c70072500 con 0x7f1c700cd3d0 2023-11-28T11:54:01.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.297+0000 7f1c667fc700 1 -- 172.21.15.50:0/2937339920 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f1c6802c090 con 0x7f1c700cd3d0 2023-11-28T11:54:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:01.303 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:45.231747+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:01.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.301+0000 7f1c76ab0700 1 -- 172.21.15.50:0/2937339920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c54064ee0 msgr2=0x7f1c54067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:01.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.301+0000 7f1c76ab0700 1 --2- 172.21.15.50:0/2937339920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c54064ee0 0x7f1c54067390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1c700b5f50 tx=0x7f1c60009240 comp rx=0 tx=0).stop 2023-11-28T11:54:01.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.301+0000 7f1c76ab0700 1 -- 172.21.15.50:0/2937339920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c700cd3d0 msgr2=0x7f1c7006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:01.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.301+0000 7f1c76ab0700 1 --2- 172.21.15.50:0/2937339920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c700cd3d0 0x7f1c7006e000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1c68014040 tx=0x7f1c68004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.301+0000 7f1c76ab0700 1 -- 172.21.15.50:0/2937339920 shutdown_connections 2023-11-28T11:54:01.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.301+0000 7f1c76ab0700 1 --2- 172.21.15.50:0/2937339920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c700cd3d0 0x7f1c7006e000 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.301+0000 7f1c76ab0700 1 --2- 172.21.15.50:0/2937339920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c700cd000 0x7f1c700afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.301+0000 7f1c76ab0700 1 --2- 172.21.15.50:0/2937339920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c54064ee0 0x7f1c54067390 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.301+0000 7f1c76ab0700 1 --2- 172.21.15.50:0/2937339920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c700b09a0 0x7f1c70152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.301+0000 7f1c76ab0700 1 -- 172.21.15.50:0/2937339920 >> 172.21.15.50:0/2937339920 conn(0x7f1c700b2140 msgr2=0x7f1c700b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:01.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.301+0000 7f1c76ab0700 1 -- 172.21.15.50:0/2937339920 shutdown_connections 2023-11-28T11:54:01.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.301+0000 7f1c76ab0700 1 -- 172.21.15.50:0/2937339920 wait complete. 2023-11-28T11:54:01.318 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T11:54:01.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.441+0000 7f7c74a75700 1 Processor -- start 2023-11-28T11:54:01.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.441+0000 7f7c74a75700 1 -- start start 2023-11-28T11:54:01.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c74a75700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7c700c9c00 0x7f7c7006cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:01.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c74a75700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7006ea10 0x7f7c700cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c74a75700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7006f990 con 0x7f7c7015c160 2023-11-28T11:54:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c74a75700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7006a4d0 con 0x7f7c700c9c00 2023-11-28T11:54:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c74a75700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7006ee90 con 0x7f7c7006ea10 2023-11-28T11:54:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6effd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7c7015c160 0x7f7c700c9fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60182/0 (socket says 172.21.15.50:60182) 2023-11-28T11:54:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6effd700 1 -- 172.21.15.50:0/839527316 learned_addr learned my addr 172.21.15.50:0/839527316 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6ffff700 1 --2- 172.21.15.50:0/839527316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7006ea10 0x7f7c700cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6f7fe700 1 --2- 172.21.15.50:0/839527316 >> v2:172.21.15.192:3300/0 conn(0x7f7c700c9c00 0x7f7c7006cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 -- 172.21.15.50:0/839527316 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269206356 0 0) 0x7f7c7006f990 con 0x7f7c7015c160 2023-11-28T11:54:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 -- 172.21.15.50:0/839527316 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c580035d0 con 0x7f7c7015c160 2023-11-28T11:54:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 -- 172.21.15.50:0/839527316 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4122127796 0 0) 0x7f7c580035d0 con 0x7f7c7015c160 2023-11-28T11:54:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 -- 172.21.15.50:0/839527316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7006ea10 msgr2=0x7f7c700cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 --2- 172.21.15.50:0/839527316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7006ea10 0x7f7c700cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 -- 172.21.15.50:0/839527316 >> v2:172.21.15.192:3300/0 conn(0x7f7c700c9c00 msgr2=0x7f7c7006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 --2- 172.21.15.50:0/839527316 >> v2:172.21.15.192:3300/0 conn(0x7f7c700c9c00 0x7f7c7006cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 -- 172.21.15.50:0/839527316 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7006f0f0 con 0x7f7c7015c160 2023-11-28T11:54:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 -- 172.21.15.50:0/839527316 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f7c64005140 con 0x7f7c7015c160 2023-11-28T11:54:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 -- 172.21.15.50:0/839527316 >> v1:172.21.15.50:6789/0 conn(0x7f7c7015c160 legacy=0x7f7c700c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 --2- 172.21.15.50:0/839527316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7006ea10 0x7f7c58003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 --2- 172.21.15.50:0/839527316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c58003fa0 0x7f7c58004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 --2- 172.21.15.50:0/839527316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c58004db0 0x7f7c58005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 -- 172.21.15.50:0/839527316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7006a4d0 con 0x7f7c58004db0 2023-11-28T11:54:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 -- 172.21.15.50:0/839527316 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7006ee90 con 0x7f7c58003fa0 2023-11-28T11:54:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 -- 172.21.15.50:0/839527316 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5800ba30 con 0x7f7c7006ea10 2023-11-28T11:54:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6ffff700 1 --2- 172.21.15.50:0/839527316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c58004db0 0x7f7c58005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6effd700 1 --2- 172.21.15.50:0/839527316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c58003fa0 0x7f7c58004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6f7fe700 1 --2- 172.21.15.50:0/839527316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7006ea10 0x7f7c58003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6ffff700 1 -- 172.21.15.50:0/839527316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7006ea10 msgr2=0x7f7c58003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6ffff700 1 --2- 172.21.15.50:0/839527316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7006ea10 0x7f7c58003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6ffff700 1 -- 172.21.15.50:0/839527316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c58003fa0 msgr2=0x7f7c58004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6ffff700 1 --2- 172.21.15.50:0/839527316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c58003fa0 0x7f7c58004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6ffff700 1 -- 172.21.15.50:0/839527316 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c580035d0 con 0x7f7c58004db0 2023-11-28T11:54:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6ffff700 1 --2- 172.21.15.50:0/839527316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c58004db0 0x7f7c58005220 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7c68009fc0 tx=0x7f7c580058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc31fd9c9b3dc6ae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:01.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 -- 172.21.15.50:0/839527316 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800ec30 con 0x7f7c58004db0 2023-11-28T11:54:01.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 -- 172.21.15.50:0/839527316 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6800f040 con 0x7f7c58004db0 2023-11-28T11:54:01.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.445+0000 7f7c6e7fc700 1 -- 172.21.15.50:0/839527316 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68014480 con 0x7f7c58004db0 2023-11-28T11:54:01.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.449+0000 7f7c74a75700 1 -- 172.21.15.50:0/839527316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c58004db0 msgr2=0x7f7c58005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:01.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.449+0000 7f7c74a75700 1 --2- 172.21.15.50:0/839527316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c58004db0 0x7f7c58005220 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7c68009fc0 tx=0x7f7c580058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.449+0000 7f7c6ffff700 1 -- 172.21.15.50:0/839527316 reap_dead start 2023-11-28T11:54:01.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.449+0000 7f7c74a75700 1 -- 172.21.15.50:0/839527316 shutdown_connections 2023-11-28T11:54:01.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.449+0000 7f7c74a75700 1 -- 172.21.15.50:0/839527316 >> 172.21.15.50:0/839527316 conn(0x7f7c700d0240 msgr2=0x7f7c700cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:01.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.449+0000 7f7c74a75700 1 -- 172.21.15.50:0/839527316 shutdown_connections 2023-11-28T11:54:01.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.449+0000 7f7c74a75700 1 -- 172.21.15.50:0/839527316 wait complete. 2023-11-28T11:54:01.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.449+0000 7f7c74a75700 1 Processor -- start 2023-11-28T11:54:01.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.449+0000 7f7c74a75700 1 -- start start 2023-11-28T11:54:01.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c74a75700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c700b4250 0x7f7c7015ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:01.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c74a75700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c700b4620 0x7f7c701f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:01.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c74a75700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7015c550 0x7f7c701f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:01.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c74a75700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7015d720 con 0x7f7c7015c550 2023-11-28T11:54:01.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c74a75700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7015f190 con 0x7f7c700b4250 2023-11-28T11:54:01.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c74a75700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7015cb10 con 0x7f7c700b4620 2023-11-28T11:54:01.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c6ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7015c550 0x7f7c701f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:01.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c6ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7015c550 0x7f7c701f56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47962/0 (socket says 172.21.15.50:47962) 2023-11-28T11:54:01.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c6ffff700 1 -- 172.21.15.50:0/638368670 learned_addr learned my addr 172.21.15.50:0/638368670 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:01.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c6effd700 1 --2- 172.21.15.50:0/638368670 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c700b4620 0x7f7c701f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:01.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c6f7fe700 1 --2- 172.21.15.50:0/638368670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c700b4250 0x7f7c7015ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:01.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c6ffff700 1 -- 172.21.15.50:0/638368670 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c700b4620 msgr2=0x7f7c701f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:01.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c6ffff700 1 --2- 172.21.15.50:0/638368670 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c700b4620 0x7f7c701f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c6ffff700 1 -- 172.21.15.50:0/638368670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c700b4250 msgr2=0x7f7c7015ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:01.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c6ffff700 1 --2- 172.21.15.50:0/638368670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c700b4250 0x7f7c7015ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c6ffff700 1 -- 172.21.15.50:0/638368670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7006f6b0 con 0x7f7c7015c550 2023-11-28T11:54:01.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c6ffff700 1 --2- 172.21.15.50:0/638368670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7015c550 0x7f7c701f56f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7c68009f60 tx=0x7f7c68009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:01.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c57fff700 1 -- 172.21.15.50:0/638368670 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68007000 con 0x7f7c7015c550 2023-11-28T11:54:01.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c57fff700 1 -- 172.21.15.50:0/638368670 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c68003e50 con 0x7f7c7015c550 2023-11-28T11:54:01.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c74a75700 1 -- 172.21.15.50:0/638368670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7006f3d0 con 0x7f7c7015c550 2023-11-28T11:54:01.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c57fff700 1 -- 172.21.15.50:0/638368670 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c680159e0 con 0x7f7c7015c550 2023-11-28T11:54:01.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.453+0000 7f7c74a75700 1 -- 172.21.15.50:0/638368670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c700cd910 con 0x7f7c7015c550 2023-11-28T11:54:01.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.457+0000 7f7c74a75700 1 -- 172.21.15.50:0/638368670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7015d8d0 con 0x7f7c7015c550 2023-11-28T11:54:01.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.457+0000 7f7c57fff700 1 -- 172.21.15.50:0/638368670 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7c68015b40 con 0x7f7c7015c550 2023-11-28T11:54:01.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.457+0000 7f7c57fff700 1 --2- 172.21.15.50:0/638368670 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7c5c064ee0 0x7f7c5c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:01.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.457+0000 7f7c57fff700 1 -- 172.21.15.50:0/638368670 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7c68084180 con 0x7f7c7015c550 2023-11-28T11:54:01.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.457+0000 7f7c6f7fe700 1 --2- 172.21.15.50:0/638368670 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7c5c064ee0 0x7f7c5c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:01.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.457+0000 7f7c6f7fe700 1 --2- 172.21.15.50:0/638368670 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7c5c064ee0 0x7f7c5c067390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009bf0 tx=0x7f7c60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:01.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.465+0000 7f7c57fff700 1 -- 172.21.15.50:0/638368670 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7c7015d8d0 con 0x7f7c7015c550 2023-11-28T11:54:01.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.665+0000 7f7c74a75700 1 -- 172.21.15.50:0/638368670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7c7015d8d0 con 0x7f7c7015c550 2023-11-28T11:54:01.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.937+0000 7f7c57fff700 1 -- 172.21.15.50:0/638368670 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7c7015d8d0 con 0x7f7c7015c550 2023-11-28T11:54:01.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.941+0000 7f7c74a75700 1 -- 172.21.15.50:0/638368670 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7c5c064ee0 msgr2=0x7f7c5c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:01.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.941+0000 7f7c74a75700 1 --2- 172.21.15.50:0/638368670 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7c5c064ee0 0x7f7c5c067390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009bf0 tx=0x7f7c60008040 comp rx=0 tx=0).stop 2023-11-28T11:54:01.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.941+0000 7f7c74a75700 1 -- 172.21.15.50:0/638368670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7015c550 msgr2=0x7f7c701f56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:01.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.941+0000 7f7c74a75700 1 --2- 172.21.15.50:0/638368670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7015c550 0x7f7c701f56f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7c68009f60 tx=0x7f7c68009750 comp rx=0 tx=0).stop 2023-11-28T11:54:01.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.941+0000 7f7c74a75700 1 -- 172.21.15.50:0/638368670 shutdown_connections 2023-11-28T11:54:01.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.941+0000 7f7c74a75700 1 --2- 172.21.15.50:0/638368670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7015c550 0x7f7c701f56f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.941+0000 7f7c74a75700 1 --2- 172.21.15.50:0/638368670 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c700b4620 0x7f7c701f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.941+0000 7f7c74a75700 1 --2- 172.21.15.50:0/638368670 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7c5c064ee0 0x7f7c5c067390 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.941+0000 7f7c74a75700 1 --2- 172.21.15.50:0/638368670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c700b4250 0x7f7c7015ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:01.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.941+0000 7f7c74a75700 1 -- 172.21.15.50:0/638368670 >> 172.21.15.50:0/638368670 conn(0x7f7c700d0240 msgr2=0x7f7c7015b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:01.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.941+0000 7f7c74a75700 1 -- 172.21.15.50:0/638368670 shutdown_connections 2023-11-28T11:54:01.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:01.941+0000 7f7c74a75700 1 -- 172.21.15.50:0/638368670 wait complete. 2023-11-28T11:54:01.964 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-11-28T11:54:01.965 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T11:54:02.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.085+0000 7fda9359e700 1 Processor -- start 2023-11-28T11:54:02.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9359e700 1 -- start start 2023-11-28T11:54:02.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9359e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda94160880 0x7fda9406aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:02.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9359e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fda9406b000 0x7fda940c13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:02.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9359e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda94160c50 con 0x7fda940c1900 2023-11-28T11:54:02.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9359e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9406b450 con 0x7fda9406b000 2023-11-28T11:54:02.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9359e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda940b3050 con 0x7fda94160880 2023-11-28T11:54:02.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda92d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fda940c1900 0x7fda940afe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56294/0 (socket says 172.21.15.50:56294) 2023-11-28T11:54:02.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda92d9d700 1 -- 172.21.15.50:0/2813435851 learned_addr learned my addr 172.21.15.50:0/2813435851 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:02.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda91d9b700 1 --2- 172.21.15.50:0/2813435851 >> v2:172.21.15.192:3300/0 conn(0x7fda9406b000 0x7fda940c13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:02.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9259c700 1 --2- 172.21.15.50:0/2813435851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda94160880 0x7fda9406aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:02.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 -- 172.21.15.50:0/2813435851 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991712793 0 0) 0x7fda94160c50 con 0x7fda940c1900 2023-11-28T11:54:02.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 -- 172.21.15.50:0/2813435851 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda7c0035d0 con 0x7fda940c1900 2023-11-28T11:54:02.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 -- 172.21.15.50:0/2813435851 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2069761305 0 0) 0x7fda7c0035d0 con 0x7fda940c1900 2023-11-28T11:54:02.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 -- 172.21.15.50:0/2813435851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda94160880 msgr2=0x7fda9406aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:02.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 --2- 172.21.15.50:0/2813435851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda94160880 0x7fda9406aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:02.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 -- 172.21.15.50:0/2813435851 >> v2:172.21.15.192:3300/0 conn(0x7fda9406b000 msgr2=0x7fda940c13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:02.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 --2- 172.21.15.50:0/2813435851 >> v2:172.21.15.192:3300/0 conn(0x7fda9406b000 0x7fda940c13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:02.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 -- 172.21.15.50:0/2813435851 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda940c1d60 con 0x7fda940c1900 2023-11-28T11:54:02.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 -- 172.21.15.50:0/2813435851 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7fda8c001670 con 0x7fda940c1900 2023-11-28T11:54:02.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 -- 172.21.15.50:0/2813435851 >> v1:172.21.15.50:6789/0 conn(0x7fda940c1900 legacy=0x7fda940afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:02.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 --2- 172.21.15.50:0/2813435851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda7c003a20 0x7fda7c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:02.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 --2- 172.21.15.50:0/2813435851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda94160880 0x7fda7c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:02.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 --2- 172.21.15.50:0/2813435851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda7c004db0 0x7fda7c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:02.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 -- 172.21.15.50:0/2813435851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9406b450 con 0x7fda7c004db0 2023-11-28T11:54:02.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 -- 172.21.15.50:0/2813435851 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda940b3050 con 0x7fda7c003a20 2023-11-28T11:54:02.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 -- 172.21.15.50:0/2813435851 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c00ba30 con 0x7fda94160880 2023-11-28T11:54:02.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda92d9d700 1 --2- 172.21.15.50:0/2813435851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda7c004db0 0x7fda7c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:02.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda91d9b700 1 --2- 172.21.15.50:0/2813435851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda94160880 0x7fda7c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:02.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9259c700 1 --2- 172.21.15.50:0/2813435851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda7c003a20 0x7fda7c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:02.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda92d9d700 1 -- 172.21.15.50:0/2813435851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda94160880 msgr2=0x7fda7c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:02.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda92d9d700 1 --2- 172.21.15.50:0/2813435851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda94160880 0x7fda7c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:02.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda92d9d700 1 -- 172.21.15.50:0/2813435851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda7c003a20 msgr2=0x7fda7c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:02.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda92d9d700 1 --2- 172.21.15.50:0/2813435851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda7c003a20 0x7fda7c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:02.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda92d9d700 1 -- 172.21.15.50:0/2813435851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c0035d0 con 0x7fda7c004db0 2023-11-28T11:54:02.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda92d9d700 1 --2- 172.21.15.50:0/2813435851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda7c004db0 0x7fda7c005220 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00c2f0 tx=0x7fda7c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85cb4ba9b4b6df server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 -- 172.21.15.50:0/2813435851 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c007c80 con 0x7fda7c004db0 2023-11-28T11:54:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.089+0000 7fda9159a700 1 -- 172.21.15.50:0/2813435851 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c00ce30 con 0x7fda7c004db0 2023-11-28T11:54:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.093+0000 7fda9159a700 1 -- 172.21.15.50:0/2813435851 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c005bc0 con 0x7fda7c004db0 2023-11-28T11:54:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.093+0000 7fda9359e700 1 -- 172.21.15.50:0/2813435851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda7c004db0 msgr2=0x7fda7c005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.093+0000 7fda9359e700 1 --2- 172.21.15.50:0/2813435851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda7c004db0 0x7fda7c005220 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00c2f0 tx=0x7fda7c0058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.093+0000 7fda92d9d700 1 -- 172.21.15.50:0/2813435851 reap_dead start 2023-11-28T11:54:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.093+0000 7fda9359e700 1 -- 172.21.15.50:0/2813435851 shutdown_connections 2023-11-28T11:54:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.093+0000 7fda9359e700 1 -- 172.21.15.50:0/2813435851 >> 172.21.15.50:0/2813435851 conn(0x7fda940cae70 msgr2=0x7fda940cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.093+0000 7fda9359e700 1 -- 172.21.15.50:0/2813435851 shutdown_connections 2023-11-28T11:54:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.093+0000 7fda9359e700 1 -- 172.21.15.50:0/2813435851 wait complete. 2023-11-28T11:54:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda9359e700 1 Processor -- start 2023-11-28T11:54:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda9359e700 1 -- start start 2023-11-28T11:54:02.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda9359e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda94159bf0 0x7fda940b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda9359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940aee60 0x7fda940c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda9359e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda940c4180 0x7fda940c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda9359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda940af340 con 0x7fda940aee60 2023-11-28T11:54:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda9359e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda940af620 con 0x7fda94159bf0 2023-11-28T11:54:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda9359e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda940af900 con 0x7fda940c4180 2023-11-28T11:54:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda91d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940aee60 0x7fda940c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda91d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940aee60 0x7fda940c2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53072/0 (socket says 172.21.15.50:53072) 2023-11-28T11:54:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda91d9b700 1 -- 172.21.15.50:0/340809644 learned_addr learned my addr 172.21.15.50:0/340809644 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda9259c700 1 --2- 172.21.15.50:0/340809644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda94159bf0 0x7fda940b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda92d9d700 1 --2- 172.21.15.50:0/340809644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda940c4180 0x7fda940c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda91d9b700 1 -- 172.21.15.50:0/340809644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda940c4180 msgr2=0x7fda940c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:02.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda91d9b700 1 --2- 172.21.15.50:0/340809644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda940c4180 0x7fda940c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda91d9b700 1 -- 172.21.15.50:0/340809644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda94159bf0 msgr2=0x7fda940b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda91d9b700 1 --2- 172.21.15.50:0/340809644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda94159bf0 0x7fda940b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda91d9b700 1 -- 172.21.15.50:0/340809644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda94069ce0 con 0x7fda940aee60 2023-11-28T11:54:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.097+0000 7fda91d9b700 1 --2- 172.21.15.50:0/340809644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940aee60 0x7fda940c2900 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fda84011e30 tx=0x7fda8400f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.101+0000 7fda82ffd700 1 -- 172.21.15.50:0/340809644 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8400e040 con 0x7fda940aee60 2023-11-28T11:54:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.101+0000 7fda82ffd700 1 -- 172.21.15.50:0/340809644 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8400f040 con 0x7fda940aee60 2023-11-28T11:54:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.101+0000 7fda9359e700 1 -- 172.21.15.50:0/340809644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9406b630 con 0x7fda940aee60 2023-11-28T11:54:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.101+0000 7fda82ffd700 1 -- 172.21.15.50:0/340809644 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda84015650 con 0x7fda940aee60 2023-11-28T11:54:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.101+0000 7fda9359e700 1 -- 172.21.15.50:0/340809644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda94069fc0 con 0x7fda940aee60 2023-11-28T11:54:02.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.101+0000 7fda9359e700 1 -- 172.21.15.50:0/340809644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda94072500 con 0x7fda940aee60 2023-11-28T11:54:02.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.101+0000 7fda82ffd700 1 -- 172.21.15.50:0/340809644 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fda840157b0 con 0x7fda940aee60 2023-11-28T11:54:02.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.101+0000 7fda82ffd700 1 --2- 172.21.15.50:0/340809644 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fda74064f10 0x7fda740673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:02.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.101+0000 7fda82ffd700 1 -- 172.21.15.50:0/340809644 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fda84082e70 con 0x7fda940aee60 2023-11-28T11:54:02.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.101+0000 7fda9259c700 1 --2- 172.21.15.50:0/340809644 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fda74064f10 0x7fda740673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:02.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.105+0000 7fda9259c700 1 --2- 172.21.15.50:0/340809644 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fda74064f10 0x7fda740673c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda88009bf0 tx=0x7fda88009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:02.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.113+0000 7fda82ffd700 1 -- 172.21.15.50:0/340809644 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fda84050cc0 con 0x7fda940aee60 2023-11-28T11:54:02.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.317+0000 7fda9359e700 1 -- 172.21.15.50:0/340809644 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fda9406a290 con 0x7fda940aee60 2023-11-28T11:54:02.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.949+0000 7fda82ffd700 1 -- 172.21.15.50:0/340809644 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fda840542e0 con 0x7fda940aee60 2023-11-28T11:54:02.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.953+0000 7fda9359e700 1 -- 172.21.15.50:0/340809644 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fda74064f10 msgr2=0x7fda740673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:02.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.953+0000 7fda9359e700 1 --2- 172.21.15.50:0/340809644 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fda74064f10 0x7fda740673c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda88009bf0 tx=0x7fda88009240 comp rx=0 tx=0).stop 2023-11-28T11:54:02.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.953+0000 7fda9359e700 1 -- 172.21.15.50:0/340809644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940aee60 msgr2=0x7fda940c2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:02.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.953+0000 7fda9359e700 1 --2- 172.21.15.50:0/340809644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940aee60 0x7fda940c2900 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fda84011e30 tx=0x7fda8400f490 comp rx=0 tx=0).stop 2023-11-28T11:54:02.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.953+0000 7fda9359e700 1 -- 172.21.15.50:0/340809644 shutdown_connections 2023-11-28T11:54:02.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.953+0000 7fda9359e700 1 --2- 172.21.15.50:0/340809644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda940c4180 0x7fda940c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:02.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.953+0000 7fda9359e700 1 --2- 172.21.15.50:0/340809644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940aee60 0x7fda940c2900 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:02.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.953+0000 7fda9359e700 1 --2- 172.21.15.50:0/340809644 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fda74064f10 0x7fda740673c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:02.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.953+0000 7fda9359e700 1 --2- 172.21.15.50:0/340809644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda94159bf0 0x7fda940b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:02.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.953+0000 7fda9359e700 1 -- 172.21.15.50:0/340809644 >> 172.21.15.50:0/340809644 conn(0x7fda940cae70 msgr2=0x7fda940ab400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:02.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.953+0000 7fda9359e700 1 -- 172.21.15.50:0/340809644 shutdown_connections 2023-11-28T11:54:02.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:02.953+0000 7fda9359e700 1 -- 172.21.15.50:0/340809644 wait complete. 2023-11-28T11:54:02.975 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T11:54:02.975 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:54:03.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2dad695700 1 Processor -- start 2023-11-28T11:54:03.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2dad695700 1 -- start start 2023-11-28T11:54:03.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2dad695700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2da80cf050 0x7f2da806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:03.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2dad695700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2da806a530 0x7f2da80cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:03.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2dad695700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da815c6d0 con 0x7f2da80b4c10 2023-11-28T11:54:03.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2dad695700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da806a9d0 con 0x7f2da806a530 2023-11-28T11:54:03.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2dad695700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da80cf960 con 0x7f2da80cf050 2023-11-28T11:54:03.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2da77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2da806a530 0x7f2da80cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:03.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2da77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2da806a530 0x7f2da80cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53076/0 (socket says 172.21.15.50:53076) 2023-11-28T11:54:03.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2da77fe700 1 -- 172.21.15.50:0/359735862 learned_addr learned my addr 172.21.15.50:0/359735862 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:03.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2da7fff700 1 --2- 172.21.15.50:0/359735862 >> v2:172.21.15.192:3300/0 conn(0x7f2da80cf050 0x7f2da806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:03.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2da77fe700 1 -- 172.21.15.50:0/359735862 >> v2:172.21.15.192:3300/0 conn(0x7f2da80cf050 msgr2=0x7f2da806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:03.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2da77fe700 1 --2- 172.21.15.50:0/359735862 >> v2:172.21.15.192:3300/0 conn(0x7f2da80cf050 0x7f2da806d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2da77fe700 1 -- 172.21.15.50:0/359735862 >> v1:172.21.15.192:6789/0 conn(0x7f2da80b4c10 legacy=0x7f2da80cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2da77fe700 1 -- 172.21.15.50:0/359735862 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da806ac60 con 0x7f2da806a530 2023-11-28T11:54:03.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2da77fe700 1 --2- 172.21.15.50:0/359735862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da806a530 0x7f2da80cf420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2da808b9c0 tx=0x7f2d90009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de40b0eb595fac7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:03.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2da6ffd700 1 -- 172.21.15.50:0/359735862 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90011830 con 0x7f2da806a530 2023-11-28T11:54:03.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2da6ffd700 1 -- 172.21.15.50:0/359735862 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d90011990 con 0x7f2da806a530 2023-11-28T11:54:03.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.093+0000 7f2da6ffd700 1 -- 172.21.15.50:0/359735862 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90011d20 con 0x7f2da806a530 2023-11-28T11:54:03.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.097+0000 7f2dad695700 1 -- 172.21.15.50:0/359735862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da806a530 msgr2=0x7f2da80cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.097+0000 7f2dad695700 1 --2- 172.21.15.50:0/359735862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da806a530 0x7f2da80cf420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2da808b9c0 tx=0x7f2d90009bf0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.097+0000 7f2dad695700 1 -- 172.21.15.50:0/359735862 shutdown_connections 2023-11-28T11:54:03.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.097+0000 7f2dad695700 1 --2- 172.21.15.50:0/359735862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da806a530 0x7f2da80cf420 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.097+0000 7f2dad695700 1 --2- 172.21.15.50:0/359735862 >> v2:172.21.15.192:3300/0 conn(0x7f2da80cf050 0x7f2da806d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.097+0000 7f2dad695700 1 -- 172.21.15.50:0/359735862 >> 172.21.15.50:0/359735862 conn(0x7f2da809bb30 msgr2=0x7f2da80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:03.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.097+0000 7f2dad695700 1 -- 172.21.15.50:0/359735862 shutdown_connections 2023-11-28T11:54:03.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.097+0000 7f2dad695700 1 -- 172.21.15.50:0/359735862 wait complete. 2023-11-28T11:54:03.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.097+0000 7f2dad695700 1 Processor -- start 2023-11-28T11:54:03.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.097+0000 7f2dad695700 1 -- start start 2023-11-28T11:54:03.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2dad695700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da806a530 0x7f2da809ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:03.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2dad695700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2da80b4c10 0x7f2da815a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:03.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2dad695700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2da80cf050 0x7f2da809e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:03.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2dad695700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da809dcd0 con 0x7f2da806a530 2023-11-28T11:54:03.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2dad695700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da809d050 con 0x7f2da80cf050 2023-11-28T11:54:03.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2dad695700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da809d330 con 0x7f2da80b4c10 2023-11-28T11:54:03.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2da7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da806a530 0x7f2da809ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:03.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2da7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da806a530 0x7f2da809ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53078/0 (socket says 172.21.15.50:53078) 2023-11-28T11:54:03.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2da7fff700 1 -- 172.21.15.50:0/3532185506 learned_addr learned my addr 172.21.15.50:0/3532185506 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:03.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2dace94700 1 --2- 172.21.15.50:0/3532185506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2da80cf050 0x7f2da809e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:03.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2da77fe700 1 --2- 172.21.15.50:0/3532185506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2da80b4c10 0x7f2da815a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:03.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2da7fff700 1 -- 172.21.15.50:0/3532185506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2da80b4c10 msgr2=0x7f2da815a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2da7fff700 1 --2- 172.21.15.50:0/3532185506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2da80b4c10 0x7f2da815a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2da7fff700 1 -- 172.21.15.50:0/3532185506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2da80cf050 msgr2=0x7f2da809e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2da7fff700 1 --2- 172.21.15.50:0/3532185506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2da80cf050 0x7f2da809e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2da7fff700 1 -- 172.21.15.50:0/3532185506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d90009570 con 0x7f2da806a530 2023-11-28T11:54:03.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2da7fff700 1 --2- 172.21.15.50:0/3532185506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da806a530 0x7f2da809ca70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2da000efc0 tx=0x7f2da000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:03.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2da4ff9700 1 -- 172.21.15.50:0/3532185506 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da000cb50 con 0x7f2da806a530 2023-11-28T11:54:03.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2da4ff9700 1 -- 172.21.15.50:0/3532185506 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da000f040 con 0x7f2da806a530 2023-11-28T11:54:03.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2dad695700 1 -- 172.21.15.50:0/3532185506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da80b4410 con 0x7f2da806a530 2023-11-28T11:54:03.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2da4ff9700 1 -- 172.21.15.50:0/3532185506 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da0014480 con 0x7f2da806a530 2023-11-28T11:54:03.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.101+0000 7f2dad695700 1 -- 172.21.15.50:0/3532185506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da806af40 con 0x7f2da806a530 2023-11-28T11:54:03.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.105+0000 7f2dad695700 1 -- 172.21.15.50:0/3532185506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da80b46f0 con 0x7f2da806a530 2023-11-28T11:54:03.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.105+0000 7f2da4ff9700 1 -- 172.21.15.50:0/3532185506 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2da00145e0 con 0x7f2da806a530 2023-11-28T11:54:03.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.105+0000 7f2da4ff9700 1 --2- 172.21.15.50:0/3532185506 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2d8c064ee0 0x7f2d8c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:03.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.105+0000 7f2da4ff9700 1 -- 172.21.15.50:0/3532185506 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2da0082ad0 con 0x7f2da806a530 2023-11-28T11:54:03.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.105+0000 7f2da77fe700 1 --2- 172.21.15.50:0/3532185506 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2d8c064ee0 0x7f2d8c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:03.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.105+0000 7f2da77fe700 1 --2- 172.21.15.50:0/3532185506 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2d8c064ee0 0x7f2d8c067390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2d90000c00 tx=0x7f2d90008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:03.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.109+0000 7f2da4ff9700 1 -- 172.21.15.50:0/3532185506 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2da0050900 con 0x7f2da806a530 2023-11-28T11:54:03.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.309+0000 7f2dad695700 1 -- 172.21.15.50:0/3532185506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2da8072500 con 0x7f2da806a530 2023-11-28T11:54:03.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.313+0000 7f2da4ff9700 1 -- 172.21.15.50:0/3532185506 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7f2da0053f20 con 0x7f2da806a530 2023-11-28T11:54:03.316 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:03.316 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2457318670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2457318670},{"type":"v1","addr":"172.21.15.192:6836","nonce":2457318670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3448258722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3448258722},{"type":"v1","addr":"172.21.15.192:6837","nonce":3448258722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/490368853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":490368853},{"type":"v1","addr":"172.21.15.50:6833","nonce":490368853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:53:40.797417+0000","modified":"2023-11-28T11:54:02.939902+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3764199418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3764199418},{"type":"v1","addr":"172.21.15.50:6835","nonce":3764199418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:54:03.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.313+0000 7f2dad695700 1 -- 172.21.15.50:0/3532185506 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2d8c064ee0 msgr2=0x7f2d8c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.313+0000 7f2dad695700 1 --2- 172.21.15.50:0/3532185506 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2d8c064ee0 0x7f2d8c067390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2d90000c00 tx=0x7f2d90008030 comp rx=0 tx=0).stop 2023-11-28T11:54:03.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.313+0000 7f2dad695700 1 -- 172.21.15.50:0/3532185506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da806a530 msgr2=0x7f2da809ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.313+0000 7f2dad695700 1 --2- 172.21.15.50:0/3532185506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da806a530 0x7f2da809ca70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2da000efc0 tx=0x7f2da000c0c0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.313+0000 7f2dad695700 1 -- 172.21.15.50:0/3532185506 shutdown_connections 2023-11-28T11:54:03.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.313+0000 7f2dad695700 1 --2- 172.21.15.50:0/3532185506 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2d8c064ee0 0x7f2d8c067390 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.313+0000 7f2dad695700 1 --2- 172.21.15.50:0/3532185506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2da80cf050 0x7f2da809e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.313+0000 7f2dad695700 1 --2- 172.21.15.50:0/3532185506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2da80b4c10 0x7f2da815a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.313+0000 7f2dad695700 1 --2- 172.21.15.50:0/3532185506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2da806a530 0x7f2da809ca70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.313+0000 7f2dad695700 1 -- 172.21.15.50:0/3532185506 >> 172.21.15.50:0/3532185506 conn(0x7f2da809bb30 msgr2=0x7f2da80657e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:03.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.313+0000 7f2dad695700 1 -- 172.21.15.50:0/3532185506 shutdown_connections 2023-11-28T11:54:03.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.313+0000 7f2dad695700 1 -- 172.21.15.50:0/3532185506 wait complete. 2023-11-28T11:54:03.319 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-11-28T11:54:03.331 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:03.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.441+0000 7f948dc6a700 1 Processor -- start 2023-11-28T11:54:03.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.441+0000 7f948dc6a700 1 -- start start 2023-11-28T11:54:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f948dc6a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9488160680 0x7f9488071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f948dc6a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9488069c40 0x7f94880cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f948dc6a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94880cc420 con 0x7f94880b0c30 2023-11-28T11:54:03.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f948dc6a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94880cc6c0 con 0x7f9488160680 2023-11-28T11:54:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f948dc6a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94880cc9a0 con 0x7f9488069c40 2023-11-28T11:54:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f94877fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9488160680 0x7f9488071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f9486ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9488069c40 0x7f94880cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f94877fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9488160680 0x7f9488071260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53084/0 (socket says 172.21.15.50:53084) 2023-11-28T11:54:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f94877fe700 1 -- 172.21.15.50:0/1229284120 learned_addr learned my addr 172.21.15.50:0/1229284120 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f9487fff700 1 --1- 172.21.15.50:0/1229284120 >> v1:172.21.15.192:6789/0 conn(0x7f94880b0c30 0x7f94880c9ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:51124/0 (socket says 172.21.15.50:51124) 2023-11-28T11:54:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f94877fe700 1 -- 172.21.15.50:0/1229284120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9488069c40 msgr2=0x7f94880cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f94877fe700 1 --2- 172.21.15.50:0/1229284120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9488069c40 0x7f94880cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f94867fc700 1 -- 172.21.15.50:0/1229284120 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521859464 0 0) 0x7f94880cc420 con 0x7f94880b0c30 2023-11-28T11:54:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f94877fe700 1 -- 172.21.15.50:0/1229284120 >> v1:172.21.15.192:6789/0 conn(0x7f94880b0c30 legacy=0x7f94880c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f94877fe700 1 -- 172.21.15.50:0/1229284120 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94880705c0 con 0x7f9488160680 2023-11-28T11:54:03.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f94877fe700 1 --2- 172.21.15.50:0/1229284120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9488160680 0x7f9488071260 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9478009910 tx=0x7f9478009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b843fc1a0de677 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:03.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f94867fc700 1 -- 172.21.15.50:0/1229284120 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478011830 con 0x7f9488160680 2023-11-28T11:54:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f94867fc700 1 -- 172.21.15.50:0/1229284120 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9478011990 con 0x7f9488160680 2023-11-28T11:54:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f94867fc700 1 -- 172.21.15.50:0/1229284120 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478011d40 con 0x7f9488160680 2023-11-28T11:54:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f948dc6a700 1 -- 172.21.15.50:0/1229284120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9488160680 msgr2=0x7f9488071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f948dc6a700 1 --2- 172.21.15.50:0/1229284120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9488160680 0x7f9488071260 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9478009910 tx=0x7f9478009c20 comp rx=0 tx=0).stop 2023-11-28T11:54:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f948dc6a700 1 -- 172.21.15.50:0/1229284120 shutdown_connections 2023-11-28T11:54:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f948dc6a700 1 --2- 172.21.15.50:0/1229284120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9488069c40 0x7f94880cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f948dc6a700 1 --2- 172.21.15.50:0/1229284120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9488160680 0x7f9488071260 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f948dc6a700 1 -- 172.21.15.50:0/1229284120 >> 172.21.15.50:0/1229284120 conn(0x7f948806caf0 msgr2=0x7f94880ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f948dc6a700 1 -- 172.21.15.50:0/1229284120 shutdown_connections 2023-11-28T11:54:03.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.445+0000 7f948dc6a700 1 -- 172.21.15.50:0/1229284120 wait complete. 2023-11-28T11:54:03.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f948dc6a700 1 Processor -- start 2023-11-28T11:54:03.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f948dc6a700 1 -- start start 2023-11-28T11:54:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f948dc6a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9488069c40 0x7f9488157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:03.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f948dc6a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94880b0c30 0x7f94880c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f948dc6a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9488160680 0x7f94880ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f948dc6a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94880c6fb0 con 0x7f9488160680 2023-11-28T11:54:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f948dc6a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94881580a0 con 0x7f94880b0c30 2023-11-28T11:54:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f948dc6a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9488161fb0 con 0x7f9488069c40 2023-11-28T11:54:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f9487fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9488160680 0x7f94880ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f94877fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9488069c40 0x7f9488157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f9487fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9488160680 0x7f94880ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53090/0 (socket says 172.21.15.50:53090) 2023-11-28T11:54:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f9486ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94880b0c30 0x7f94880c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:03.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f9487fff700 1 -- 172.21.15.50:0/2781038415 learned_addr learned my addr 172.21.15.50:0/2781038415 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f9487fff700 1 -- 172.21.15.50:0/2781038415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9488069c40 msgr2=0x7f9488157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f9487fff700 1 --2- 172.21.15.50:0/2781038415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9488069c40 0x7f9488157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f9487fff700 1 -- 172.21.15.50:0/2781038415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94880b0c30 msgr2=0x7f94880c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f9487fff700 1 --2- 172.21.15.50:0/2781038415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94880b0c30 0x7f94880c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.449+0000 7f9487fff700 1 -- 172.21.15.50:0/2781038415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9478009570 con 0x7f9488160680 2023-11-28T11:54:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.453+0000 7f9487fff700 1 --2- 172.21.15.50:0/2781038415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9488160680 0x7f94880ca120 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f948000cca0 tx=0x7f948000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.453+0000 7f947ffff700 1 -- 172.21.15.50:0/2781038415 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948000ab70 con 0x7f9488160680 2023-11-28T11:54:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.453+0000 7f947ffff700 1 -- 172.21.15.50:0/2781038415 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948000acd0 con 0x7f9488160680 2023-11-28T11:54:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.453+0000 7f947ffff700 1 -- 172.21.15.50:0/2781038415 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480007310 con 0x7f9488160680 2023-11-28T11:54:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.453+0000 7f948dc6a700 1 -- 172.21.15.50:0/2781038415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94880c9750 con 0x7f9488160680 2023-11-28T11:54:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.453+0000 7f948dc6a700 1 -- 172.21.15.50:0/2781038415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9488071940 con 0x7f9488160680 2023-11-28T11:54:03.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.453+0000 7f948dc6a700 1 -- 172.21.15.50:0/2781038415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9488160a50 con 0x7f9488160680 2023-11-28T11:54:03.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.453+0000 7f947ffff700 1 -- 172.21.15.50:0/2781038415 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9480010070 con 0x7f9488160680 2023-11-28T11:54:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.453+0000 7f947ffff700 1 --2- 172.21.15.50:0/2781038415 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9468064ee0 0x7f9468067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.453+0000 7f947ffff700 1 -- 172.21.15.50:0/2781038415 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9480081b90 con 0x7f9488160680 2023-11-28T11:54:03.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.453+0000 7f94877fe700 1 --2- 172.21.15.50:0/2781038415 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9468064ee0 0x7f9468067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:03.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.457+0000 7f94877fe700 1 --2- 172.21.15.50:0/2781038415 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9468064ee0 0x7f9468067390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9478009150 tx=0x7f947801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:03.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.461+0000 7f947ffff700 1 -- 172.21.15.50:0/2781038415 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f948004f9e0 con 0x7f9488160680 2023-11-28T11:54:03.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.621+0000 7f948dc6a700 1 -- 172.21.15.50:0/2781038415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9488072500 con 0x7f9488160680 2023-11-28T11:54:03.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.625+0000 7f947ffff700 1 -- 172.21.15.50:0/2781038415 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f9480018020 con 0x7f9488160680 2023-11-28T11:54:03.630 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:03.630 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:45.231747+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:03.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.625+0000 7f948dc6a700 1 -- 172.21.15.50:0/2781038415 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9468064ee0 msgr2=0x7f9468067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.625+0000 7f948dc6a700 1 --2- 172.21.15.50:0/2781038415 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9468064ee0 0x7f9468067390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9478009150 tx=0x7f947801c040 comp rx=0 tx=0).stop 2023-11-28T11:54:03.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.625+0000 7f948dc6a700 1 -- 172.21.15.50:0/2781038415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9488160680 msgr2=0x7f94880ca120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.625+0000 7f948dc6a700 1 --2- 172.21.15.50:0/2781038415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9488160680 0x7f94880ca120 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f948000cca0 tx=0x7f948000a060 comp rx=0 tx=0).stop 2023-11-28T11:54:03.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.625+0000 7f948dc6a700 1 -- 172.21.15.50:0/2781038415 shutdown_connections 2023-11-28T11:54:03.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.625+0000 7f948dc6a700 1 --2- 172.21.15.50:0/2781038415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9488160680 0x7f94880ca120 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.625+0000 7f948dc6a700 1 --2- 172.21.15.50:0/2781038415 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9468064ee0 0x7f9468067390 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.625+0000 7f948dc6a700 1 --2- 172.21.15.50:0/2781038415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94880b0c30 0x7f94880c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.625+0000 7f948dc6a700 1 --2- 172.21.15.50:0/2781038415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9488069c40 0x7f9488157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.625+0000 7f948dc6a700 1 -- 172.21.15.50:0/2781038415 >> 172.21.15.50:0/2781038415 conn(0x7f948806caf0 msgr2=0x7f94880c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:03.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.625+0000 7f948dc6a700 1 -- 172.21.15.50:0/2781038415 shutdown_connections 2023-11-28T11:54:03.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.625+0000 7f948dc6a700 1 -- 172.21.15.50:0/2781038415 wait complete. 2023-11-28T11:54:03.643 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T11:54:03.643 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:54:03.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.749+0000 7f0dd754d700 1 Processor -- start 2023-11-28T11:54:03.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.749+0000 7f0dd754d700 1 -- start start 2023-11-28T11:54:03.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd754d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0dd015c150 0x7f0dd01607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:03.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd754d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd015c520 con 0x7f0dd00cc600 2023-11-28T11:54:03.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd754d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd00ca680 con 0x7f0dd00c9e70 2023-11-28T11:54:03.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd754d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd00ca960 con 0x7f0dd015c150 2023-11-28T11:54:03.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd6d4c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0dd00cc600 0x7f0dd00ce320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56304/0 (socket says 172.21.15.50:56304) 2023-11-28T11:54:03.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd6d4c700 1 -- 172.21.15.50:0/55732863 learned_addr learned my addr 172.21.15.50:0/55732863 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:03.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd654b700 1 --2- 172.21.15.50:0/55732863 >> v2:172.21.15.50:3300/0 conn(0x7f0dd015c150 0x7f0dd01607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:03.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd5549700 1 -- 172.21.15.50:0/55732863 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172750515 0 0) 0x7f0dd015c520 con 0x7f0dd00cc600 2023-11-28T11:54:03.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd5549700 1 -- 172.21.15.50:0/55732863 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dbc0035d0 con 0x7f0dd00cc600 2023-11-28T11:54:03.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd5549700 1 -- 172.21.15.50:0/55732863 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854098441 0 0) 0x7f0dd00ca680 con 0x7f0dd00c9e70 2023-11-28T11:54:03.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd5549700 1 -- 172.21.15.50:0/55732863 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd015c520 con 0x7f0dd00c9e70 2023-11-28T11:54:03.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd654b700 1 -- 172.21.15.50:0/55732863 >> v1:172.21.15.192:6789/0 conn(0x7f0dd00c9e70 legacy=0x7f0dd00cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd654b700 1 -- 172.21.15.50:0/55732863 >> v1:172.21.15.50:6789/0 conn(0x7f0dd00cc600 legacy=0x7f0dd00ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd654b700 1 -- 172.21.15.50:0/55732863 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd00cd840 con 0x7f0dd015c150 2023-11-28T11:54:03.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd654b700 1 --2- 172.21.15.50:0/55732863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dd015c150 0x7f0dd01607b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009850 tx=0x7f0dcc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6bded2f435244b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:03.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd5549700 1 -- 172.21.15.50:0/55732863 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc011830 con 0x7f0dd015c150 2023-11-28T11:54:03.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd5549700 1 -- 172.21.15.50:0/55732863 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc011990 con 0x7f0dd015c150 2023-11-28T11:54:03.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd5549700 1 -- 172.21.15.50:0/55732863 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc011d40 con 0x7f0dd015c150 2023-11-28T11:54:03.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd754d700 1 -- 172.21.15.50:0/55732863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dd015c150 msgr2=0x7f0dd01607b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd754d700 1 --2- 172.21.15.50:0/55732863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dd015c150 0x7f0dd01607b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009850 tx=0x7f0dcc009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:03.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd754d700 1 -- 172.21.15.50:0/55732863 shutdown_connections 2023-11-28T11:54:03.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd754d700 1 --2- 172.21.15.50:0/55732863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dd015c150 0x7f0dd01607b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd754d700 1 -- 172.21.15.50:0/55732863 >> 172.21.15.50:0/55732863 conn(0x7f0dd006ec40 msgr2=0x7f0dd00b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:03.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd754d700 1 -- 172.21.15.50:0/55732863 shutdown_connections 2023-11-28T11:54:03.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.753+0000 7f0dd754d700 1 -- 172.21.15.50:0/55732863 wait complete. 2023-11-28T11:54:03.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.757+0000 7f0dd754d700 1 Processor -- start 2023-11-28T11:54:03.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.757+0000 7f0dd754d700 1 -- start start 2023-11-28T11:54:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.757+0000 7f0dd754d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dd00c9e70 0x7f0dd00b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.757+0000 7f0dd754d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0dd00cc600 0x7f0dd01586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.757+0000 7f0dd754d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dd015c150 0x7f0dd01f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.757+0000 7f0dd754d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00b46b0 con 0x7f0dd015c150 2023-11-28T11:54:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.757+0000 7f0dd754d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd01f5ce0 con 0x7f0dd00c9e70 2023-11-28T11:54:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.757+0000 7f0dd754d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00b3b30 con 0x7f0dd00cc600 2023-11-28T11:54:03.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.757+0000 7f0dd6d4c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dd015c150 0x7f0dd01f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:03.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.757+0000 7f0dd6d4c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dd015c150 0x7f0dd01f57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53098/0 (socket says 172.21.15.50:53098) 2023-11-28T11:54:03.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.757+0000 7f0dd6d4c700 1 -- 172.21.15.50:0/2990920749 learned_addr learned my addr 172.21.15.50:0/2990920749 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:03.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.757+0000 7f0dd5d4a700 1 --2- 172.21.15.50:0/2990920749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0dd00cc600 0x7f0dd01586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:03.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.757+0000 7f0dd654b700 1 --2- 172.21.15.50:0/2990920749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dd00c9e70 0x7f0dd00b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.761+0000 7f0dd6d4c700 1 -- 172.21.15.50:0/2990920749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0dd00cc600 msgr2=0x7f0dd01586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.761+0000 7f0dd6d4c700 1 --2- 172.21.15.50:0/2990920749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0dd00cc600 0x7f0dd01586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.761+0000 7f0dd6d4c700 1 -- 172.21.15.50:0/2990920749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dd00c9e70 msgr2=0x7f0dd00b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.761+0000 7f0dd6d4c700 1 --2- 172.21.15.50:0/2990920749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dd00c9e70 0x7f0dd00b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.761+0000 7f0dd6d4c700 1 -- 172.21.15.50:0/2990920749 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc0094b0 con 0x7f0dd015c150 2023-11-28T11:54:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.761+0000 7f0dd6d4c700 1 --2- 172.21.15.50:0/2990920749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dd015c150 0x7f0dd01f57a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800cb70 tx=0x7f0dc800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.761+0000 7f0dc6ffd700 1 -- 172.21.15.50:0/2990920749 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8007480 con 0x7f0dd015c150 2023-11-28T11:54:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.761+0000 7f0dc6ffd700 1 -- 172.21.15.50:0/2990920749 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc80075e0 con 0x7f0dd015c150 2023-11-28T11:54:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.761+0000 7f0dd754d700 1 -- 172.21.15.50:0/2990920749 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd00cde00 con 0x7f0dd015c150 2023-11-28T11:54:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.761+0000 7f0dc6ffd700 1 -- 172.21.15.50:0/2990920749 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8007970 con 0x7f0dd015c150 2023-11-28T11:54:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.761+0000 7f0dd754d700 1 -- 172.21.15.50:0/2990920749 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd00cdb20 con 0x7f0dd015c150 2023-11-28T11:54:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.761+0000 7f0dd754d700 1 -- 172.21.15.50:0/2990920749 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd00ca2f0 con 0x7f0dd015c150 2023-11-28T11:54:03.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.765+0000 7f0dc6ffd700 1 -- 172.21.15.50:0/2990920749 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0dc8019030 con 0x7f0dd015c150 2023-11-28T11:54:03.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.765+0000 7f0dc6ffd700 1 --2- 172.21.15.50:0/2990920749 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0db4064ee0 0x7f0db4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:03.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.765+0000 7f0dc6ffd700 1 -- 172.21.15.50:0/2990920749 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0dc8081a60 con 0x7f0dd015c150 2023-11-28T11:54:03.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.765+0000 7f0dd654b700 1 --2- 172.21.15.50:0/2990920749 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0db4064ee0 0x7f0db4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:03.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.765+0000 7f0dd654b700 1 --2- 172.21.15.50:0/2990920749 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0db4064ee0 0x7f0db4067390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0090b0 tx=0x7f0dcc01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:03.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.769+0000 7f0dc6ffd700 1 -- 172.21.15.50:0/2990920749 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0dc804f890 con 0x7f0dd015c150 2023-11-28T11:54:03.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.933+0000 7f0dd754d700 1 -- 172.21.15.50:0/2990920749 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0dd006cf00 con 0x7f0db4064ee0 2023-11-28T11:54:03.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.957+0000 7f0dc6ffd700 1 -- 172.21.15.50:0/2990920749 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367425 (secure 0 0 0) 0x7f0dd006cf00 con 0x7f0db4064ee0 2023-11-28T11:54:03.964 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:03.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.961+0000 7f0dd754d700 1 -- 172.21.15.50:0/2990920749 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0db4064ee0 msgr2=0x7f0db4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.961+0000 7f0dd754d700 1 --2- 172.21.15.50:0/2990920749 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0db4064ee0 0x7f0db4067390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0090b0 tx=0x7f0dcc01c040 comp rx=0 tx=0).stop 2023-11-28T11:54:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.961+0000 7f0dd754d700 1 -- 172.21.15.50:0/2990920749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dd015c150 msgr2=0x7f0dd01f57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.961+0000 7f0dd754d700 1 --2- 172.21.15.50:0/2990920749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dd015c150 0x7f0dd01f57a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800cb70 tx=0x7f0dc800cba0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.961+0000 7f0dd754d700 1 -- 172.21.15.50:0/2990920749 shutdown_connections 2023-11-28T11:54:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.961+0000 7f0dd754d700 1 --2- 172.21.15.50:0/2990920749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dd015c150 0x7f0dd01f57a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.961+0000 7f0dd754d700 1 --2- 172.21.15.50:0/2990920749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0dd00cc600 0x7f0dd01586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.961+0000 7f0dd754d700 1 --2- 172.21.15.50:0/2990920749 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0db4064ee0 0x7f0db4067390 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.961+0000 7f0dd754d700 1 --2- 172.21.15.50:0/2990920749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dd00c9e70 0x7f0dd00b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.961+0000 7f0dd754d700 1 -- 172.21.15.50:0/2990920749 >> 172.21.15.50:0/2990920749 conn(0x7f0dd006ec40 msgr2=0x7f0dd00b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.961+0000 7f0dd754d700 1 -- 172.21.15.50:0/2990920749 shutdown_connections 2023-11-28T11:54:03.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:03.961+0000 7f0dd754d700 1 -- 172.21.15.50:0/2990920749 wait complete. 2023-11-28T11:54:03.969 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:54:03.983 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-11-28T11:54:02.866687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594895,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71384,"kb_used_data":3288,"kb_used_omap":0,"kb_used_meta":68032,"kb_avail":754903336,"statfs":{"total":773094113280,"available":773021016064,"internally_reserved":0,"allocated":3366912,"data_stored":2063942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69664768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1749,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005566"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889694+0000","last_change":"2023-11-28T11:53:44.882435+0000","last_active":"2023-11-28T11:53:44.889694+0000","last_peered":"2023-11-28T11:53:44.889694+0000","last_clean":"2023-11-28T11:53:44.889694+0000","last_became_active":"2023-11-28T11:53:44.882048+0000","last_became_peered":"2023-11-28T11:53:44.882048+0000","last_unstale":"2023-11-28T11:53:44.889694+0000","last_undegraded":"2023-11-28T11:53:44.889694+0000","last_fullsized":"2023-11-28T11:53:44.889694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:05.347162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867841+0000","last_change":"2023-11-28T11:53:40.436343+0000","last_active":"2023-11-28T11:53:44.867841+0000","last_peered":"2023-11-28T11:53:44.867841+0000","last_clean":"2023-11-28T11:53:44.867841+0000","last_became_active":"2023-11-28T11:53:40.435879+0000","last_became_peered":"2023-11-28T11:53:40.435879+0000","last_unstale":"2023-11-28T11:53:44.867841+0000","last_undegraded":"2023-11-28T11:53:44.867841+0000","last_fullsized":"2023-11-28T11:53:44.867841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:00.300889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859343+0000","last_change":"2023-11-28T11:53:40.821925+0000","last_active":"2023-11-28T11:53:44.859343+0000","last_peered":"2023-11-28T11:53:44.859343+0000","last_clean":"2023-11-28T11:53:44.859343+0000","last_became_active":"2023-11-28T11:53:40.821597+0000","last_became_peered":"2023-11-28T11:53:40.821597+0000","last_unstale":"2023-11-28T11:53:44.859343+0000","last_undegraded":"2023-11-28T11:53:44.859343+0000","last_fullsized":"2023-11-28T11:53:44.859343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:23.875985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.880793+0000","last_change":"2023-11-28T11:53:44.875925+0000","last_active":"2023-11-28T11:53:44.880793+0000","last_peered":"2023-11-28T11:53:44.880793+0000","last_clean":"2023-11-28T11:53:44.880793+0000","last_became_active":"2023-11-28T11:53:44.875558+0000","last_became_peered":"2023-11-28T11:53:44.875558+0000","last_unstale":"2023-11-28T11:53:44.880793+0000","last_undegraded":"2023-11-28T11:53:44.880793+0000","last_fullsized":"2023-11-28T11:53:44.880793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:12.753046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863282+0000","last_change":"2023-11-28T11:53:40.441515+0000","last_active":"2023-11-28T11:53:44.863282+0000","last_peered":"2023-11-28T11:53:44.863282+0000","last_clean":"2023-11-28T11:53:44.863282+0000","last_became_active":"2023-11-28T11:53:40.441208+0000","last_became_peered":"2023-11-28T11:53:40.441208+0000","last_unstale":"2023-11-28T11:53:44.863282+0000","last_undegraded":"2023-11-28T11:53:44.863282+0000","last_fullsized":"2023-11-28T11:53:44.863282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:35:19.888846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862872+0000","last_change":"2023-11-28T11:53:40.830197+0000","last_active":"2023-11-28T11:53:44.862872+0000","last_peered":"2023-11-28T11:53:44.862872+0000","last_clean":"2023-11-28T11:53:44.862872+0000","last_became_active":"2023-11-28T11:53:40.829740+0000","last_became_peered":"2023-11-28T11:53:40.829740+0000","last_unstale":"2023-11-28T11:53:44.862872+0000","last_undegraded":"2023-11-28T11:53:44.862872+0000","last_fullsized":"2023-11-28T11:53:44.862872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:38.089006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873088+0000","last_change":"2023-11-28T11:53:44.870606+0000","last_active":"2023-11-28T11:53:44.873088+0000","last_peered":"2023-11-28T11:53:44.873088+0000","last_clean":"2023-11-28T11:53:44.873088+0000","last_became_active":"2023-11-28T11:53:44.870208+0000","last_became_peered":"2023-11-28T11:53:44.870208+0000","last_unstale":"2023-11-28T11:53:44.873088+0000","last_undegraded":"2023-11-28T11:53:44.873088+0000","last_fullsized":"2023-11-28T11:53:44.873088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:09:00.740331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.855028+0000","last_change":"2023-11-28T11:53:40.448313+0000","last_active":"2023-11-28T11:53:44.855028+0000","last_peered":"2023-11-28T11:53:44.855028+0000","last_clean":"2023-11-28T11:53:44.855028+0000","last_became_active":"2023-11-28T11:53:40.448063+0000","last_became_peered":"2023-11-28T11:53:40.448063+0000","last_unstale":"2023-11-28T11:53:44.855028+0000","last_undegraded":"2023-11-28T11:53:44.855028+0000","last_fullsized":"2023-11-28T11:53:44.855028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:39.305975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859973+0000","last_change":"2023-11-28T11:53:40.820453+0000","last_active":"2023-11-28T11:53:44.859973+0000","last_peered":"2023-11-28T11:53:44.859973+0000","last_clean":"2023-11-28T11:53:44.859973+0000","last_became_active":"2023-11-28T11:53:40.820114+0000","last_became_peered":"2023-11-28T11:53:40.820114+0000","last_unstale":"2023-11-28T11:53:44.859973+0000","last_undegraded":"2023-11-28T11:53:44.859973+0000","last_fullsized":"2023-11-28T11:53:44.859973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:07:13.206788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.880082+0000","last_change":"2023-11-28T11:53:44.877852+0000","last_active":"2023-11-28T11:53:44.880082+0000","last_peered":"2023-11-28T11:53:44.880082+0000","last_clean":"2023-11-28T11:53:44.880082+0000","last_became_active":"2023-11-28T11:53:44.877334+0000","last_became_peered":"2023-11-28T11:53:44.877334+0000","last_unstale":"2023-11-28T11:53:44.880082+0000","last_undegraded":"2023-11-28T11:53:44.880082+0000","last_fullsized":"2023-11-28T11:53:44.880082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:29.010118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852090+0000","last_change":"2023-11-28T11:53:40.450034+0000","last_active":"2023-11-28T11:53:44.852090+0000","last_peered":"2023-11-28T11:53:44.852090+0000","last_clean":"2023-11-28T11:53:44.852090+0000","last_became_active":"2023-11-28T11:53:40.449802+0000","last_became_peered":"2023-11-28T11:53:40.449802+0000","last_unstale":"2023-11-28T11:53:44.852090+0000","last_undegraded":"2023-11-28T11:53:44.852090+0000","last_fullsized":"2023-11-28T11:53:44.852090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:41.874385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859657+0000","last_change":"2023-11-28T11:53:40.822841+0000","last_active":"2023-11-28T11:53:44.859657+0000","last_peered":"2023-11-28T11:53:44.859657+0000","last_clean":"2023-11-28T11:53:44.859657+0000","last_became_active":"2023-11-28T11:53:40.822586+0000","last_became_peered":"2023-11-28T11:53:40.822586+0000","last_unstale":"2023-11-28T11:53:44.859657+0000","last_undegraded":"2023-11-28T11:53:44.859657+0000","last_fullsized":"2023-11-28T11:53:44.859657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:03.251004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889865+0000","last_change":"2023-11-28T11:53:44.883848+0000","last_active":"2023-11-28T11:53:44.889865+0000","last_peered":"2023-11-28T11:53:44.889865+0000","last_clean":"2023-11-28T11:53:44.889865+0000","last_became_active":"2023-11-28T11:53:44.883452+0000","last_became_peered":"2023-11-28T11:53:44.883452+0000","last_unstale":"2023-11-28T11:53:44.889865+0000","last_undegraded":"2023-11-28T11:53:44.889865+0000","last_fullsized":"2023-11-28T11:53:44.889865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:38.035586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.869040+0000","last_change":"2023-11-28T11:53:40.449747+0000","last_active":"2023-11-28T11:53:44.869040+0000","last_peered":"2023-11-28T11:53:44.869040+0000","last_clean":"2023-11-28T11:53:44.869040+0000","last_became_active":"2023-11-28T11:53:40.449347+0000","last_became_peered":"2023-11-28T11:53:40.449347+0000","last_unstale":"2023-11-28T11:53:44.869040+0000","last_undegraded":"2023-11-28T11:53:44.869040+0000","last_fullsized":"2023-11-28T11:53:44.869040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:54.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852330+0000","last_change":"2023-11-28T11:53:40.827861+0000","last_active":"2023-11-28T11:53:44.852330+0000","last_peered":"2023-11-28T11:53:44.852330+0000","last_clean":"2023-11-28T11:53:44.852330+0000","last_became_active":"2023-11-28T11:53:40.827614+0000","last_became_peered":"2023-11-28T11:53:40.827614+0000","last_unstale":"2023-11-28T11:53:44.852330+0000","last_undegraded":"2023-11-28T11:53:44.852330+0000","last_fullsized":"2023-11-28T11:53:44.852330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:01.312325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.883955+0000","last_change":"2023-11-28T11:53:44.880640+0000","last_active":"2023-11-28T11:53:44.883955+0000","last_peered":"2023-11-28T11:53:44.883955+0000","last_clean":"2023-11-28T11:53:44.883955+0000","last_became_active":"2023-11-28T11:53:44.880247+0000","last_became_peered":"2023-11-28T11:53:44.880247+0000","last_unstale":"2023-11-28T11:53:44.883955+0000","last_undegraded":"2023-11-28T11:53:44.883955+0000","last_fullsized":"2023-11-28T11:53:44.883955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:51:39.277759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860162+0000","last_change":"2023-11-28T11:53:40.448452+0000","last_active":"2023-11-28T11:53:44.860162+0000","last_peered":"2023-11-28T11:53:44.860162+0000","last_clean":"2023-11-28T11:53:44.860162+0000","last_became_active":"2023-11-28T11:53:40.448154+0000","last_became_peered":"2023-11-28T11:53:40.448154+0000","last_unstale":"2023-11-28T11:53:44.860162+0000","last_undegraded":"2023-11-28T11:53:44.860162+0000","last_fullsized":"2023-11-28T11:53:44.860162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:41.874385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863052+0000","last_change":"2023-11-28T11:53:40.825987+0000","last_active":"2023-11-28T11:53:44.863052+0000","last_peered":"2023-11-28T11:53:44.863052+0000","last_clean":"2023-11-28T11:53:44.863052+0000","last_became_active":"2023-11-28T11:53:40.825706+0000","last_became_peered":"2023-11-28T11:53:40.825706+0000","last_unstale":"2023-11-28T11:53:44.863052+0000","last_undegraded":"2023-11-28T11:53:44.863052+0000","last_fullsized":"2023-11-28T11:53:44.863052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:27:28.269321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.886243+0000","last_change":"2023-11-28T11:53:44.883030+0000","last_active":"2023-11-28T11:53:44.886243+0000","last_peered":"2023-11-28T11:53:44.886243+0000","last_clean":"2023-11-28T11:53:44.886243+0000","last_became_active":"2023-11-28T11:53:44.882675+0000","last_became_peered":"2023-11-28T11:53:44.882675+0000","last_unstale":"2023-11-28T11:53:44.886243+0000","last_undegraded":"2023-11-28T11:53:44.886243+0000","last_fullsized":"2023-11-28T11:53:44.886243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:07:45.954153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.872964+0000","last_change":"2023-11-28T11:53:40.448373+0000","last_active":"2023-11-28T11:53:44.872964+0000","last_peered":"2023-11-28T11:53:44.872964+0000","last_clean":"2023-11-28T11:53:44.872964+0000","last_became_active":"2023-11-28T11:53:40.448029+0000","last_became_peered":"2023-11-28T11:53:40.448029+0000","last_unstale":"2023-11-28T11:53:44.872964+0000","last_undegraded":"2023-11-28T11:53:44.872964+0000","last_fullsized":"2023-11-28T11:53:44.872964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:57.826127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867262+0000","last_change":"2023-11-28T11:53:40.833512+0000","last_active":"2023-11-28T11:53:44.867262+0000","last_peered":"2023-11-28T11:53:44.867262+0000","last_clean":"2023-11-28T11:53:44.867262+0000","last_became_active":"2023-11-28T11:53:40.833244+0000","last_became_peered":"2023-11-28T11:53:40.833244+0000","last_unstale":"2023-11-28T11:53:44.867262+0000","last_undegraded":"2023-11-28T11:53:44.867262+0000","last_fullsized":"2023-11-28T11:53:44.867262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:58.623372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889172+0000","last_change":"2023-11-28T11:53:44.881845+0000","last_active":"2023-11-28T11:53:44.889172+0000","last_peered":"2023-11-28T11:53:44.889172+0000","last_clean":"2023-11-28T11:53:44.889172+0000","last_became_active":"2023-11-28T11:53:44.881453+0000","last_became_peered":"2023-11-28T11:53:44.881453+0000","last_unstale":"2023-11-28T11:53:44.889172+0000","last_undegraded":"2023-11-28T11:53:44.889172+0000","last_fullsized":"2023-11-28T11:53:44.889172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:41:45.095803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861569+0000","last_change":"2023-11-28T11:53:40.440029+0000","last_active":"2023-11-28T11:53:44.861569+0000","last_peered":"2023-11-28T11:53:44.861569+0000","last_clean":"2023-11-28T11:53:44.861569+0000","last_became_active":"2023-11-28T11:53:40.439844+0000","last_became_peered":"2023-11-28T11:53:40.439844+0000","last_unstale":"2023-11-28T11:53:44.861569+0000","last_undegraded":"2023-11-28T11:53:44.861569+0000","last_fullsized":"2023-11-28T11:53:44.861569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:00.300889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865451+0000","last_change":"2023-11-28T11:53:40.827603+0000","last_active":"2023-11-28T11:53:44.865451+0000","last_peered":"2023-11-28T11:53:44.865451+0000","last_clean":"2023-11-28T11:53:44.865451+0000","last_became_active":"2023-11-28T11:53:40.827305+0000","last_became_peered":"2023-11-28T11:53:40.827305+0000","last_unstale":"2023-11-28T11:53:44.865451+0000","last_undegraded":"2023-11-28T11:53:44.865451+0000","last_fullsized":"2023-11-28T11:53:44.865451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:06.422936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861418+0000","last_change":"2023-11-28T11:53:40.825931+0000","last_active":"2023-11-28T11:53:44.861418+0000","last_peered":"2023-11-28T11:53:44.861418+0000","last_clean":"2023-11-28T11:53:44.861418+0000","last_became_active":"2023-11-28T11:53:40.825661+0000","last_became_peered":"2023-11-28T11:53:40.825661+0000","last_unstale":"2023-11-28T11:53:44.861418+0000","last_undegraded":"2023-11-28T11:53:44.861418+0000","last_fullsized":"2023-11-28T11:53:44.861418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.868397+0000","last_change":"2023-11-28T11:53:40.435820+0000","last_active":"2023-11-28T11:53:44.868397+0000","last_peered":"2023-11-28T11:53:44.868397+0000","last_clean":"2023-11-28T11:53:44.868397+0000","last_became_active":"2023-11-28T11:53:40.435413+0000","last_became_peered":"2023-11-28T11:53:40.435413+0000","last_unstale":"2023-11-28T11:53:44.868397+0000","last_undegraded":"2023-11-28T11:53:44.868397+0000","last_fullsized":"2023-11-28T11:53:44.868397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:39.305975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.882057+0000","last_change":"2023-11-28T11:53:44.878777+0000","last_active":"2023-11-28T11:53:44.882057+0000","last_peered":"2023-11-28T11:53:44.882057+0000","last_clean":"2023-11-28T11:53:44.882057+0000","last_became_active":"2023-11-28T11:53:44.878407+0000","last_became_peered":"2023-11-28T11:53:44.878407+0000","last_unstale":"2023-11-28T11:53:44.882057+0000","last_undegraded":"2023-11-28T11:53:44.882057+0000","last_fullsized":"2023-11-28T11:53:44.882057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:17.214530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862966+0000","last_change":"2023-11-28T11:53:40.831099+0000","last_active":"2023-11-28T11:53:44.862966+0000","last_peered":"2023-11-28T11:53:44.862966+0000","last_clean":"2023-11-28T11:53:44.862966+0000","last_became_active":"2023-11-28T11:53:40.830838+0000","last_became_peered":"2023-11-28T11:53:40.830838+0000","last_unstale":"2023-11-28T11:53:44.862966+0000","last_undegraded":"2023-11-28T11:53:44.862966+0000","last_fullsized":"2023-11-28T11:53:44.862966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:49.919629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.854355+0000","last_change":"2023-11-28T11:53:40.443966+0000","last_active":"2023-11-28T11:53:44.854355+0000","last_peered":"2023-11-28T11:53:44.854355+0000","last_clean":"2023-11-28T11:53:44.854355+0000","last_became_active":"2023-11-28T11:53:40.443553+0000","last_became_peered":"2023-11-28T11:53:40.443553+0000","last_unstale":"2023-11-28T11:53:44.854355+0000","last_undegraded":"2023-11-28T11:53:44.854355+0000","last_fullsized":"2023-11-28T11:53:44.854355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:19.967407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.879723+0000","last_change":"2023-11-28T11:53:44.874157+0000","last_active":"2023-11-28T11:53:44.879723+0000","last_peered":"2023-11-28T11:53:44.879723+0000","last_clean":"2023-11-28T11:53:44.879723+0000","last_became_active":"2023-11-28T11:53:44.873721+0000","last_became_peered":"2023-11-28T11:53:44.873721+0000","last_unstale":"2023-11-28T11:53:44.879723+0000","last_undegraded":"2023-11-28T11:53:44.879723+0000","last_fullsized":"2023-11-28T11:53:44.879723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:38.035586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859711+0000","last_change":"2023-11-28T11:53:40.443961+0000","last_active":"2023-11-28T11:53:44.859711+0000","last_peered":"2023-11-28T11:53:44.859711+0000","last_clean":"2023-11-28T11:53:44.859711+0000","last_became_active":"2023-11-28T11:53:40.443600+0000","last_became_peered":"2023-11-28T11:53:40.443600+0000","last_unstale":"2023-11-28T11:53:44.859711+0000","last_undegraded":"2023-11-28T11:53:44.859711+0000","last_fullsized":"2023-11-28T11:53:44.859711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:05.411499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873244+0000","last_change":"2023-11-28T11:53:40.823833+0000","last_active":"2023-11-28T11:53:44.873244+0000","last_peered":"2023-11-28T11:53:44.873244+0000","last_clean":"2023-11-28T11:53:44.873244+0000","last_became_active":"2023-11-28T11:53:40.823583+0000","last_became_peered":"2023-11-28T11:53:40.823583+0000","last_unstale":"2023-11-28T11:53:44.873244+0000","last_undegraded":"2023-11-28T11:53:44.873244+0000","last_fullsized":"2023-11-28T11:53:44.873244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:18.454529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889155+0000","last_change":"2023-11-28T11:53:44.886943+0000","last_active":"2023-11-28T11:53:44.889155+0000","last_peered":"2023-11-28T11:53:44.889155+0000","last_clean":"2023-11-28T11:53:44.889155+0000","last_became_active":"2023-11-28T11:53:44.884458+0000","last_became_peered":"2023-11-28T11:53:44.884458+0000","last_unstale":"2023-11-28T11:53:44.889155+0000","last_undegraded":"2023-11-28T11:53:44.889155+0000","last_fullsized":"2023-11-28T11:53:44.889155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:09:00.740331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T11:53:49.771859+0000","last_change":"2023-11-28T11:53:40.445841+0000","last_active":"2023-11-28T11:53:49.771859+0000","last_peered":"2023-11-28T11:53:49.771859+0000","last_clean":"2023-11-28T11:53:49.771859+0000","last_became_active":"2023-11-28T11:53:40.445170+0000","last_became_peered":"2023-11-28T11:53:40.445170+0000","last_unstale":"2023-11-28T11:53:49.771859+0000","last_undegraded":"2023-11-28T11:53:49.771859+0000","last_fullsized":"2023-11-28T11:53:49.771859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:39.305975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859738+0000","last_change":"2023-11-28T11:53:40.822601+0000","last_active":"2023-11-28T11:53:44.859738+0000","last_peered":"2023-11-28T11:53:44.859738+0000","last_clean":"2023-11-28T11:53:44.859738+0000","last_became_active":"2023-11-28T11:53:40.822327+0000","last_became_peered":"2023-11-28T11:53:40.822327+0000","last_unstale":"2023-11-28T11:53:44.859738+0000","last_undegraded":"2023-11-28T11:53:44.859738+0000","last_fullsized":"2023-11-28T11:53:44.859738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:06.929054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889658+0000","last_change":"2023-11-28T11:53:44.881520+0000","last_active":"2023-11-28T11:53:44.889658+0000","last_peered":"2023-11-28T11:53:44.889658+0000","last_clean":"2023-11-28T11:53:44.889658+0000","last_became_active":"2023-11-28T11:53:44.881135+0000","last_became_peered":"2023-11-28T11:53:44.881135+0000","last_unstale":"2023-11-28T11:53:44.889658+0000","last_undegraded":"2023-11-28T11:53:44.889658+0000","last_fullsized":"2023-11-28T11:53:44.889658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:27.296993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873318+0000","last_change":"2023-11-28T11:53:40.833933+0000","last_active":"2023-11-28T11:53:44.873318+0000","last_peered":"2023-11-28T11:53:44.873318+0000","last_clean":"2023-11-28T11:53:44.873318+0000","last_became_active":"2023-11-28T11:53:40.833658+0000","last_became_peered":"2023-11-28T11:53:40.833658+0000","last_unstale":"2023-11-28T11:53:44.873318+0000","last_undegraded":"2023-11-28T11:53:44.873318+0000","last_fullsized":"2023-11-28T11:53:44.873318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:57.215796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865519+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:53:44.865519+0000","last_peered":"2023-11-28T11:53:44.865519+0000","last_clean":"2023-11-28T11:53:44.865519+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:53:44.865519+0000","last_undegraded":"2023-11-28T11:53:44.865519+0000","last_fullsized":"2023-11-28T11:53:44.865519+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.855082+0000","last_change":"2023-11-28T11:53:40.441530+0000","last_active":"2023-11-28T11:53:44.855082+0000","last_peered":"2023-11-28T11:53:44.855082+0000","last_clean":"2023-11-28T11:53:44.855082+0000","last_became_active":"2023-11-28T11:53:40.441317+0000","last_became_peered":"2023-11-28T11:53:40.441317+0000","last_unstale":"2023-11-28T11:53:44.855082+0000","last_undegraded":"2023-11-28T11:53:44.855082+0000","last_fullsized":"2023-11-28T11:53:44.855082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:54.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889193+0000","last_change":"2023-11-28T11:53:44.882186+0000","last_active":"2023-11-28T11:53:44.889193+0000","last_peered":"2023-11-28T11:53:44.889193+0000","last_clean":"2023-11-28T11:53:44.889193+0000","last_became_active":"2023-11-28T11:53:44.881794+0000","last_became_peered":"2023-11-28T11:53:44.881794+0000","last_unstale":"2023-11-28T11:53:44.889193+0000","last_undegraded":"2023-11-28T11:53:44.889193+0000","last_fullsized":"2023-11-28T11:53:44.889193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:05.347162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.868559+0000","last_change":"2023-11-28T11:53:40.836155+0000","last_active":"2023-11-28T11:53:44.868559+0000","last_peered":"2023-11-28T11:53:44.868559+0000","last_clean":"2023-11-28T11:53:44.868559+0000","last_became_active":"2023-11-28T11:53:40.834486+0000","last_became_peered":"2023-11-28T11:53:40.834486+0000","last_unstale":"2023-11-28T11:53:44.868559+0000","last_undegraded":"2023-11-28T11:53:44.868559+0000","last_fullsized":"2023-11-28T11:53:44.868559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865189+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:53:44.865189+0000","last_peered":"2023-11-28T11:53:44.865189+0000","last_clean":"2023-11-28T11:53:44.865189+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:53:44.865189+0000","last_undegraded":"2023-11-28T11:53:44.865189+0000","last_fullsized":"2023-11-28T11:53:44.865189+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873207+0000","last_change":"2023-11-28T11:53:40.448611+0000","last_active":"2023-11-28T11:53:44.873207+0000","last_peered":"2023-11-28T11:53:44.873207+0000","last_clean":"2023-11-28T11:53:44.873207+0000","last_became_active":"2023-11-28T11:53:40.445176+0000","last_became_peered":"2023-11-28T11:53:40.445176+0000","last_unstale":"2023-11-28T11:53:44.873207+0000","last_undegraded":"2023-11-28T11:53:44.873207+0000","last_fullsized":"2023-11-28T11:53:44.873207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:16:02.435885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.881976+0000","last_change":"2023-11-28T11:53:44.876201+0000","last_active":"2023-11-28T11:53:44.881976+0000","last_peered":"2023-11-28T11:53:44.881976+0000","last_clean":"2023-11-28T11:53:44.881976+0000","last_became_active":"2023-11-28T11:53:44.875772+0000","last_became_peered":"2023-11-28T11:53:44.875772+0000","last_unstale":"2023-11-28T11:53:44.881976+0000","last_undegraded":"2023-11-28T11:53:44.881976+0000","last_fullsized":"2023-11-28T11:53:44.881976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:45:22.911172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861493+0000","last_change":"2023-11-28T11:53:40.831017+0000","last_active":"2023-11-28T11:53:44.861493+0000","last_peered":"2023-11-28T11:53:44.861493+0000","last_clean":"2023-11-28T11:53:44.861493+0000","last_became_active":"2023-11-28T11:53:40.830653+0000","last_became_peered":"2023-11-28T11:53:40.830653+0000","last_unstale":"2023-11-28T11:53:44.861493+0000","last_undegraded":"2023-11-28T11:53:44.861493+0000","last_fullsized":"2023-11-28T11:53:44.861493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:57.213686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862754+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:53:44.862754+0000","last_peered":"2023-11-28T11:53:44.862754+0000","last_clean":"2023-11-28T11:53:44.862754+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:53:44.862754+0000","last_undegraded":"2023-11-28T11:53:44.862754+0000","last_fullsized":"2023-11-28T11:53:44.862754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.877834+0000","last_change":"2023-11-28T11:53:40.444866+0000","last_active":"2023-11-28T11:53:44.877834+0000","last_peered":"2023-11-28T11:53:44.877834+0000","last_clean":"2023-11-28T11:53:44.877834+0000","last_became_active":"2023-11-28T11:53:40.444600+0000","last_became_peered":"2023-11-28T11:53:40.444600+0000","last_unstale":"2023-11-28T11:53:44.877834+0000","last_undegraded":"2023-11-28T11:53:44.877834+0000","last_fullsized":"2023-11-28T11:53:44.877834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:54.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.881029+0000","last_change":"2023-11-28T11:53:44.877188+0000","last_active":"2023-11-28T11:53:44.881029+0000","last_peered":"2023-11-28T11:53:44.881029+0000","last_clean":"2023-11-28T11:53:44.881029+0000","last_became_active":"2023-11-28T11:53:44.876752+0000","last_became_peered":"2023-11-28T11:53:44.876752+0000","last_unstale":"2023-11-28T11:53:44.881029+0000","last_undegraded":"2023-11-28T11:53:44.881029+0000","last_fullsized":"2023-11-28T11:53:44.881029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:49.906382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860156+0000","last_change":"2023-11-28T11:53:40.832575+0000","last_active":"2023-11-28T11:53:44.860156+0000","last_peered":"2023-11-28T11:53:44.860156+0000","last_clean":"2023-11-28T11:53:44.860156+0000","last_became_active":"2023-11-28T11:53:40.832265+0000","last_became_peered":"2023-11-28T11:53:40.832265+0000","last_unstale":"2023-11-28T11:53:44.860156+0000","last_undegraded":"2023-11-28T11:53:44.860156+0000","last_fullsized":"2023-11-28T11:53:44.860156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:27:28.269321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863573+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:53:44.863573+0000","last_peered":"2023-11-28T11:53:44.863573+0000","last_clean":"2023-11-28T11:53:44.863573+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:53:44.863573+0000","last_undegraded":"2023-11-28T11:53:44.863573+0000","last_fullsized":"2023-11-28T11:53:44.863573+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T11:53:45.370919+0000","last_change":"2023-11-28T11:53:40.450301+0000","last_active":"2023-11-28T11:53:45.370919+0000","last_peered":"2023-11-28T11:53:45.370919+0000","last_clean":"2023-11-28T11:53:45.370919+0000","last_became_active":"2023-11-28T11:53:40.450014+0000","last_became_peered":"2023-11-28T11:53:40.450014+0000","last_unstale":"2023-11-28T11:53:45.370919+0000","last_undegraded":"2023-11-28T11:53:45.370919+0000","last_fullsized":"2023-11-28T11:53:45.370919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:57.826127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.883889+0000","last_change":"2023-11-28T11:53:44.880249+0000","last_active":"2023-11-28T11:53:44.883889+0000","last_peered":"2023-11-28T11:53:44.883889+0000","last_clean":"2023-11-28T11:53:44.883889+0000","last_became_active":"2023-11-28T11:53:44.879807+0000","last_became_peered":"2023-11-28T11:53:44.879807+0000","last_unstale":"2023-11-28T11:53:44.883889+0000","last_undegraded":"2023-11-28T11:53:44.883889+0000","last_fullsized":"2023-11-28T11:53:44.883889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:24:18.219732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867353+0000","last_change":"2023-11-28T11:53:40.822809+0000","last_active":"2023-11-28T11:53:44.867353+0000","last_peered":"2023-11-28T11:53:44.867353+0000","last_clean":"2023-11-28T11:53:44.867353+0000","last_became_active":"2023-11-28T11:53:40.822525+0000","last_became_peered":"2023-11-28T11:53:40.822525+0000","last_unstale":"2023-11-28T11:53:44.867353+0000","last_undegraded":"2023-11-28T11:53:44.867353+0000","last_fullsized":"2023-11-28T11:53:44.867353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:33.728842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863783+0000","last_change":"2023-11-28T11:53:40.447043+0000","last_active":"2023-11-28T11:53:44.863783+0000","last_peered":"2023-11-28T11:53:44.863783+0000","last_clean":"2023-11-28T11:53:44.863783+0000","last_became_active":"2023-11-28T11:53:40.446655+0000","last_became_peered":"2023-11-28T11:53:40.446655+0000","last_unstale":"2023-11-28T11:53:44.863783+0000","last_undegraded":"2023-11-28T11:53:44.863783+0000","last_fullsized":"2023-11-28T11:53:44.863783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:16:02.435885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.858559+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:53:44.858559+0000","last_peered":"2023-11-28T11:53:44.858559+0000","last_clean":"2023-11-28T11:53:44.858559+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:53:44.858559+0000","last_undegraded":"2023-11-28T11:53:44.858559+0000","last_fullsized":"2023-11-28T11:53:44.858559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873069+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:53:44.873069+0000","last_peered":"2023-11-28T11:53:44.873069+0000","last_clean":"2023-11-28T11:53:44.873069+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:53:44.873069+0000","last_undegraded":"2023-11-28T11:53:44.873069+0000","last_fullsized":"2023-11-28T11:53:44.873069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.881432+0000","last_change":"2023-11-28T11:53:44.877382+0000","last_active":"2023-11-28T11:53:44.881432+0000","last_peered":"2023-11-28T11:53:44.881432+0000","last_clean":"2023-11-28T11:53:44.881432+0000","last_became_active":"2023-11-28T11:53:44.876993+0000","last_became_peered":"2023-11-28T11:53:44.876993+0000","last_unstale":"2023-11-28T11:53:44.881432+0000","last_undegraded":"2023-11-28T11:53:44.881432+0000","last_fullsized":"2023-11-28T11:53:44.881432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:54:59.674019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.876641+0000","last_change":"2023-11-28T11:53:40.829307+0000","last_active":"2023-11-28T11:53:44.876641+0000","last_peered":"2023-11-28T11:53:44.876641+0000","last_clean":"2023-11-28T11:53:44.876641+0000","last_became_active":"2023-11-28T11:53:40.828558+0000","last_became_peered":"2023-11-28T11:53:40.828558+0000","last_unstale":"2023-11-28T11:53:44.876641+0000","last_undegraded":"2023-11-28T11:53:44.876641+0000","last_fullsized":"2023-11-28T11:53:44.876641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:03:21.599961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.871461+0000","last_change":"2023-11-28T11:53:40.446066+0000","last_active":"2023-11-28T11:53:44.871461+0000","last_peered":"2023-11-28T11:53:44.871461+0000","last_clean":"2023-11-28T11:53:44.871461+0000","last_became_active":"2023-11-28T11:53:40.445774+0000","last_became_peered":"2023-11-28T11:53:40.445774+0000","last_unstale":"2023-11-28T11:53:44.871461+0000","last_undegraded":"2023-11-28T11:53:44.871461+0000","last_fullsized":"2023-11-28T11:53:44.871461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:58:24.917085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861363+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:53:44.861363+0000","last_peered":"2023-11-28T11:53:44.861363+0000","last_clean":"2023-11-28T11:53:44.861363+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:53:44.861363+0000","last_undegraded":"2023-11-28T11:53:44.861363+0000","last_fullsized":"2023-11-28T11:53:44.861363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.888435+0000","last_change":"2023-11-28T11:53:44.881392+0000","last_active":"2023-11-28T11:53:44.888435+0000","last_peered":"2023-11-28T11:53:44.888435+0000","last_clean":"2023-11-28T11:53:44.888435+0000","last_became_active":"2023-11-28T11:53:44.880999+0000","last_became_peered":"2023-11-28T11:53:44.880999+0000","last_unstale":"2023-11-28T11:53:44.888435+0000","last_undegraded":"2023-11-28T11:53:44.888435+0000","last_fullsized":"2023-11-28T11:53:44.888435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:10.350062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873131+0000","last_change":"2023-11-28T11:53:40.829883+0000","last_active":"2023-11-28T11:53:44.873131+0000","last_peered":"2023-11-28T11:53:44.873131+0000","last_clean":"2023-11-28T11:53:44.873131+0000","last_became_active":"2023-11-28T11:53:40.828918+0000","last_became_peered":"2023-11-28T11:53:40.828918+0000","last_unstale":"2023-11-28T11:53:44.873131+0000","last_undegraded":"2023-11-28T11:53:44.873131+0000","last_fullsized":"2023-11-28T11:53:44.873131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:53.307980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859888+0000","last_change":"2023-11-28T11:53:40.444678+0000","last_active":"2023-11-28T11:53:44.859888+0000","last_peered":"2023-11-28T11:53:44.859888+0000","last_clean":"2023-11-28T11:53:44.859888+0000","last_became_active":"2023-11-28T11:53:40.444330+0000","last_became_peered":"2023-11-28T11:53:40.444330+0000","last_unstale":"2023-11-28T11:53:44.859888+0000","last_undegraded":"2023-11-28T11:53:44.859888+0000","last_fullsized":"2023-11-28T11:53:44.859888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:54.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852107+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:53:44.852107+0000","last_peered":"2023-11-28T11:53:44.852107+0000","last_clean":"2023-11-28T11:53:44.852107+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:53:44.852107+0000","last_undegraded":"2023-11-28T11:53:44.852107+0000","last_fullsized":"2023-11-28T11:53:44.852107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.887490+0000","last_change":"2023-11-28T11:53:44.879815+0000","last_active":"2023-11-28T11:53:44.887490+0000","last_peered":"2023-11-28T11:53:44.887490+0000","last_clean":"2023-11-28T11:53:44.887490+0000","last_became_active":"2023-11-28T11:53:44.879231+0000","last_became_peered":"2023-11-28T11:53:44.879231+0000","last_unstale":"2023-11-28T11:53:44.887490+0000","last_undegraded":"2023-11-28T11:53:44.887490+0000","last_fullsized":"2023-11-28T11:53:44.887490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:29.010118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865882+0000","last_change":"2023-11-28T11:53:40.825293+0000","last_active":"2023-11-28T11:53:44.865882+0000","last_peered":"2023-11-28T11:53:44.865882+0000","last_clean":"2023-11-28T11:53:44.865882+0000","last_became_active":"2023-11-28T11:53:40.824947+0000","last_became_peered":"2023-11-28T11:53:40.824947+0000","last_unstale":"2023-11-28T11:53:44.865882+0000","last_undegraded":"2023-11-28T11:53:44.865882+0000","last_fullsized":"2023-11-28T11:53:44.865882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:57.215796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862236+0000","last_change":"2023-11-28T11:53:40.442915+0000","last_active":"2023-11-28T11:53:44.862236+0000","last_peered":"2023-11-28T11:53:44.862236+0000","last_clean":"2023-11-28T11:53:44.862236+0000","last_became_active":"2023-11-28T11:53:40.442616+0000","last_became_peered":"2023-11-28T11:53:40.442616+0000","last_unstale":"2023-11-28T11:53:44.862236+0000","last_undegraded":"2023-11-28T11:53:44.862236+0000","last_fullsized":"2023-11-28T11:53:44.862236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:41.874385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.858675+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:53:44.858675+0000","last_peered":"2023-11-28T11:53:44.858675+0000","last_clean":"2023-11-28T11:53:44.858675+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:53:44.858675+0000","last_undegraded":"2023-11-28T11:53:44.858675+0000","last_fullsized":"2023-11-28T11:53:44.858675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.886370+0000","last_change":"2023-11-28T11:53:44.883518+0000","last_active":"2023-11-28T11:53:44.886370+0000","last_peered":"2023-11-28T11:53:44.886370+0000","last_clean":"2023-11-28T11:53:44.886370+0000","last_became_active":"2023-11-28T11:53:44.880294+0000","last_became_peered":"2023-11-28T11:53:44.880294+0000","last_unstale":"2023-11-28T11:53:44.886370+0000","last_undegraded":"2023-11-28T11:53:44.886370+0000","last_fullsized":"2023-11-28T11:53:44.886370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:18.531528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.876596+0000","last_change":"2023-11-28T11:53:40.823797+0000","last_active":"2023-11-28T11:53:44.876596+0000","last_peered":"2023-11-28T11:53:44.876596+0000","last_clean":"2023-11-28T11:53:44.876596+0000","last_became_active":"2023-11-28T11:53:40.823514+0000","last_became_peered":"2023-11-28T11:53:40.823514+0000","last_unstale":"2023-11-28T11:53:44.876596+0000","last_undegraded":"2023-11-28T11:53:44.876596+0000","last_fullsized":"2023-11-28T11:53:44.876596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861642+0000","last_change":"2023-11-28T11:53:40.450607+0000","last_active":"2023-11-28T11:53:44.861642+0000","last_peered":"2023-11-28T11:53:44.861642+0000","last_clean":"2023-11-28T11:53:44.861642+0000","last_became_active":"2023-11-28T11:53:40.450324+0000","last_became_peered":"2023-11-28T11:53:40.450324+0000","last_unstale":"2023-11-28T11:53:44.861642+0000","last_undegraded":"2023-11-28T11:53:44.861642+0000","last_fullsized":"2023-11-28T11:53:44.861642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:17.443093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.872261+0000","last_change":"2023-11-28T11:53:44.868741+0000","last_active":"2023-11-28T11:53:44.872261+0000","last_peered":"2023-11-28T11:53:44.872261+0000","last_clean":"2023-11-28T11:53:44.872261+0000","last_became_active":"2023-11-28T11:53:44.868320+0000","last_became_peered":"2023-11-28T11:53:44.868320+0000","last_unstale":"2023-11-28T11:53:44.872261+0000","last_undegraded":"2023-11-28T11:53:44.872261+0000","last_fullsized":"2023-11-28T11:53:44.872261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:54:58.724369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862814+0000","last_change":"2023-11-28T11:53:40.823419+0000","last_active":"2023-11-28T11:53:44.862814+0000","last_peered":"2023-11-28T11:53:44.862814+0000","last_clean":"2023-11-28T11:53:44.862814+0000","last_became_active":"2023-11-28T11:53:40.821588+0000","last_became_peered":"2023-11-28T11:53:40.821588+0000","last_unstale":"2023-11-28T11:53:44.862814+0000","last_undegraded":"2023-11-28T11:53:44.862814+0000","last_fullsized":"2023-11-28T11:53:44.862814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:13.793522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862499+0000","last_change":"2023-11-28T11:53:40.448234+0000","last_active":"2023-11-28T11:53:44.862499+0000","last_peered":"2023-11-28T11:53:44.862499+0000","last_clean":"2023-11-28T11:53:44.862499+0000","last_became_active":"2023-11-28T11:53:40.447793+0000","last_became_peered":"2023-11-28T11:53:40.447793+0000","last_unstale":"2023-11-28T11:53:44.862499+0000","last_undegraded":"2023-11-28T11:53:44.862499+0000","last_fullsized":"2023-11-28T11:53:44.862499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:57.826127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.871780+0000","last_change":"2023-11-28T11:53:44.868480+0000","last_active":"2023-11-28T11:53:44.871780+0000","last_peered":"2023-11-28T11:53:44.871780+0000","last_clean":"2023-11-28T11:53:44.871780+0000","last_became_active":"2023-11-28T11:53:44.868051+0000","last_became_peered":"2023-11-28T11:53:44.868051+0000","last_unstale":"2023-11-28T11:53:44.871780+0000","last_undegraded":"2023-11-28T11:53:44.871780+0000","last_fullsized":"2023-11-28T11:53:44.871780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:45:35.342963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862591+0000","last_change":"2023-11-28T11:53:40.826870+0000","last_active":"2023-11-28T11:53:44.862591+0000","last_peered":"2023-11-28T11:53:44.862591+0000","last_clean":"2023-11-28T11:53:44.862591+0000","last_became_active":"2023-11-28T11:53:40.826561+0000","last_became_peered":"2023-11-28T11:53:40.826561+0000","last_unstale":"2023-11-28T11:53:44.862591+0000","last_undegraded":"2023-11-28T11:53:44.862591+0000","last_fullsized":"2023-11-28T11:53:44.862591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:24:13.706573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865183+0000","last_change":"2023-11-28T11:53:40.450118+0000","last_active":"2023-11-28T11:53:44.865183+0000","last_peered":"2023-11-28T11:53:44.865183+0000","last_clean":"2023-11-28T11:53:44.865183+0000","last_became_active":"2023-11-28T11:53:40.449740+0000","last_became_peered":"2023-11-28T11:53:40.449740+0000","last_unstale":"2023-11-28T11:53:44.865183+0000","last_undegraded":"2023-11-28T11:53:44.865183+0000","last_fullsized":"2023-11-28T11:53:44.865183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:16:02.435885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889470+0000","last_change":"2023-11-28T11:53:44.880051+0000","last_active":"2023-11-28T11:53:44.889470+0000","last_peered":"2023-11-28T11:53:44.889470+0000","last_clean":"2023-11-28T11:53:44.889470+0000","last_became_active":"2023-11-28T11:53:44.879656+0000","last_became_peered":"2023-11-28T11:53:44.879656+0000","last_unstale":"2023-11-28T11:53:44.889470+0000","last_undegraded":"2023-11-28T11:53:44.889470+0000","last_fullsized":"2023-11-28T11:53:44.889470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:21:48.435615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859774+0000","last_change":"2023-11-28T11:53:40.822906+0000","last_active":"2023-11-28T11:53:44.859774+0000","last_peered":"2023-11-28T11:53:44.859774+0000","last_clean":"2023-11-28T11:53:44.859774+0000","last_became_active":"2023-11-28T11:53:40.822629+0000","last_became_peered":"2023-11-28T11:53:40.822629+0000","last_unstale":"2023-11-28T11:53:44.859774+0000","last_undegraded":"2023-11-28T11:53:44.859774+0000","last_fullsized":"2023-11-28T11:53:44.859774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:34.614578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862074+0000","last_change":"2023-11-28T11:53:40.441500+0000","last_active":"2023-11-28T11:53:44.862074+0000","last_peered":"2023-11-28T11:53:44.862074+0000","last_clean":"2023-11-28T11:53:44.862074+0000","last_became_active":"2023-11-28T11:53:40.441158+0000","last_became_peered":"2023-11-28T11:53:40.441158+0000","last_unstale":"2023-11-28T11:53:44.862074+0000","last_undegraded":"2023-11-28T11:53:44.862074+0000","last_fullsized":"2023-11-28T11:53:44.862074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:19.967407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873877+0000","last_change":"2023-11-28T11:53:44.872014+0000","last_active":"2023-11-28T11:53:44.873877+0000","last_peered":"2023-11-28T11:53:44.873877+0000","last_clean":"2023-11-28T11:53:44.873877+0000","last_became_active":"2023-11-28T11:53:44.871605+0000","last_became_peered":"2023-11-28T11:53:44.871605+0000","last_unstale":"2023-11-28T11:53:44.873877+0000","last_undegraded":"2023-11-28T11:53:44.873877+0000","last_fullsized":"2023-11-28T11:53:44.873877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:45:22.911172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.868467+0000","last_change":"2023-11-28T11:53:40.822940+0000","last_active":"2023-11-28T11:53:44.868467+0000","last_peered":"2023-11-28T11:53:44.868467+0000","last_clean":"2023-11-28T11:53:44.868467+0000","last_became_active":"2023-11-28T11:53:40.822043+0000","last_became_peered":"2023-11-28T11:53:40.822043+0000","last_unstale":"2023-11-28T11:53:44.868467+0000","last_undegraded":"2023-11-28T11:53:44.868467+0000","last_fullsized":"2023-11-28T11:53:44.868467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:57.213686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.851830+0000","last_change":"2023-11-28T11:53:40.443907+0000","last_active":"2023-11-28T11:53:44.851830+0000","last_peered":"2023-11-28T11:53:44.851830+0000","last_clean":"2023-11-28T11:53:44.851830+0000","last_became_active":"2023-11-28T11:53:40.443561+0000","last_became_peered":"2023-11-28T11:53:40.443561+0000","last_unstale":"2023-11-28T11:53:44.851830+0000","last_undegraded":"2023-11-28T11:53:44.851830+0000","last_fullsized":"2023-11-28T11:53:44.851830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:00.300889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.886453+0000","last_change":"2023-11-28T11:53:44.878401+0000","last_active":"2023-11-28T11:53:44.886453+0000","last_peered":"2023-11-28T11:53:44.886453+0000","last_clean":"2023-11-28T11:53:44.886453+0000","last_became_active":"2023-11-28T11:53:44.877984+0000","last_became_peered":"2023-11-28T11:53:44.877984+0000","last_unstale":"2023-11-28T11:53:44.886453+0000","last_undegraded":"2023-11-28T11:53:44.886453+0000","last_fullsized":"2023-11-28T11:53:44.886453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:41.510014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865016+0000","last_change":"2023-11-28T11:53:40.828665+0000","last_active":"2023-11-28T11:53:44.865016+0000","last_peered":"2023-11-28T11:53:44.865016+0000","last_clean":"2023-11-28T11:53:44.865016+0000","last_became_active":"2023-11-28T11:53:40.828391+0000","last_became_peered":"2023-11-28T11:53:40.828391+0000","last_unstale":"2023-11-28T11:53:44.865016+0000","last_undegraded":"2023-11-28T11:53:44.865016+0000","last_fullsized":"2023-11-28T11:53:44.865016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:26:32.332628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859809+0000","last_change":"2023-11-28T11:53:40.443223+0000","last_active":"2023-11-28T11:53:44.859809+0000","last_peered":"2023-11-28T11:53:44.859809+0000","last_clean":"2023-11-28T11:53:44.859809+0000","last_became_active":"2023-11-28T11:53:40.442898+0000","last_became_peered":"2023-11-28T11:53:40.442898+0000","last_unstale":"2023-11-28T11:53:44.859809+0000","last_undegraded":"2023-11-28T11:53:44.859809+0000","last_fullsized":"2023-11-28T11:53:44.859809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:55.478609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.872465+0000","last_change":"2023-11-28T11:53:44.870670+0000","last_active":"2023-11-28T11:53:44.872465+0000","last_peered":"2023-11-28T11:53:44.872465+0000","last_clean":"2023-11-28T11:53:44.872465+0000","last_became_active":"2023-11-28T11:53:44.870011+0000","last_became_peered":"2023-11-28T11:53:44.870011+0000","last_unstale":"2023-11-28T11:53:44.872465+0000","last_undegraded":"2023-11-28T11:53:44.872465+0000","last_fullsized":"2023-11-28T11:53:44.872465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:17.214530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859908+0000","last_change":"2023-11-28T11:53:40.816472+0000","last_active":"2023-11-28T11:53:44.859908+0000","last_peered":"2023-11-28T11:53:44.859908+0000","last_clean":"2023-11-28T11:53:44.859908+0000","last_became_active":"2023-11-28T11:53:40.816159+0000","last_became_peered":"2023-11-28T11:53:40.816159+0000","last_unstale":"2023-11-28T11:53:44.859908+0000","last_undegraded":"2023-11-28T11:53:44.859908+0000","last_fullsized":"2023-11-28T11:53:44.859908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:38.089006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.869315+0000","last_change":"2023-11-28T11:53:40.450339+0000","last_active":"2023-11-28T11:53:44.869315+0000","last_peered":"2023-11-28T11:53:44.869315+0000","last_clean":"2023-11-28T11:53:44.869315+0000","last_became_active":"2023-11-28T11:53:40.450046+0000","last_became_peered":"2023-11-28T11:53:40.450046+0000","last_unstale":"2023-11-28T11:53:44.869315+0000","last_undegraded":"2023-11-28T11:53:44.869315+0000","last_fullsized":"2023-11-28T11:53:44.869315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:17.443093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.888530+0000","last_change":"2023-11-28T11:53:44.882874+0000","last_active":"2023-11-28T11:53:44.888530+0000","last_peered":"2023-11-28T11:53:44.888530+0000","last_clean":"2023-11-28T11:53:44.888530+0000","last_became_active":"2023-11-28T11:53:44.882175+0000","last_became_peered":"2023-11-28T11:53:44.882175+0000","last_unstale":"2023-11-28T11:53:44.888530+0000","last_undegraded":"2023-11-28T11:53:44.888530+0000","last_fullsized":"2023-11-28T11:53:44.888530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:53.340638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.851850+0000","last_change":"2023-11-28T11:53:40.826543+0000","last_active":"2023-11-28T11:53:44.851850+0000","last_peered":"2023-11-28T11:53:44.851850+0000","last_clean":"2023-11-28T11:53:44.851850+0000","last_became_active":"2023-11-28T11:53:40.826182+0000","last_became_peered":"2023-11-28T11:53:40.826182+0000","last_unstale":"2023-11-28T11:53:44.851850+0000","last_undegraded":"2023-11-28T11:53:44.851850+0000","last_fullsized":"2023-11-28T11:53:44.851850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:03:21.599961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.869691+0000","last_change":"2023-11-28T11:53:40.450402+0000","last_active":"2023-11-28T11:53:44.869691+0000","last_peered":"2023-11-28T11:53:44.869691+0000","last_clean":"2023-11-28T11:53:44.869691+0000","last_became_active":"2023-11-28T11:53:40.450094+0000","last_became_peered":"2023-11-28T11:53:40.450094+0000","last_unstale":"2023-11-28T11:53:44.869691+0000","last_undegraded":"2023-11-28T11:53:44.869691+0000","last_fullsized":"2023-11-28T11:53:44.869691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:35:19.888846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.886156+0000","last_change":"2023-11-28T11:53:44.882776+0000","last_active":"2023-11-28T11:53:44.886156+0000","last_peered":"2023-11-28T11:53:44.886156+0000","last_clean":"2023-11-28T11:53:44.886156+0000","last_became_active":"2023-11-28T11:53:44.880222+0000","last_became_peered":"2023-11-28T11:53:44.880222+0000","last_unstale":"2023-11-28T11:53:44.886156+0000","last_undegraded":"2023-11-28T11:53:44.886156+0000","last_fullsized":"2023-11-28T11:53:44.886156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:05.347162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.882471+0000","last_change":"2023-11-28T11:53:44.879327+0000","last_active":"2023-11-28T11:53:44.882471+0000","last_peered":"2023-11-28T11:53:44.882471+0000","last_clean":"2023-11-28T11:53:44.882471+0000","last_became_active":"2023-11-28T11:53:44.878937+0000","last_became_peered":"2023-11-28T11:53:44.878937+0000","last_unstale":"2023-11-28T11:53:44.882471+0000","last_undegraded":"2023-11-28T11:53:44.882471+0000","last_fullsized":"2023-11-28T11:53:44.882471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:37.024091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.864801+0000","last_change":"2023-11-28T11:53:40.437606+0000","last_active":"2023-11-28T11:53:44.864801+0000","last_peered":"2023-11-28T11:53:44.864801+0000","last_clean":"2023-11-28T11:53:44.864801+0000","last_became_active":"2023-11-28T11:53:40.436841+0000","last_became_peered":"2023-11-28T11:53:40.436841+0000","last_unstale":"2023-11-28T11:53:44.864801+0000","last_undegraded":"2023-11-28T11:53:44.864801+0000","last_fullsized":"2023-11-28T11:53:44.864801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:57.826127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.877919+0000","last_change":"2023-11-28T11:53:40.830708+0000","last_active":"2023-11-28T11:53:44.877919+0000","last_peered":"2023-11-28T11:53:44.877919+0000","last_clean":"2023-11-28T11:53:44.877919+0000","last_became_active":"2023-11-28T11:53:40.830408+0000","last_became_peered":"2023-11-28T11:53:40.830408+0000","last_unstale":"2023-11-28T11:53:44.877919+0000","last_undegraded":"2023-11-28T11:53:44.877919+0000","last_fullsized":"2023-11-28T11:53:44.877919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:03.251004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889061+0000","last_change":"2023-11-28T11:53:44.883220+0000","last_active":"2023-11-28T11:53:44.889061+0000","last_peered":"2023-11-28T11:53:44.889061+0000","last_clean":"2023-11-28T11:53:44.889061+0000","last_became_active":"2023-11-28T11:53:44.881046+0000","last_became_peered":"2023-11-28T11:53:44.881046+0000","last_unstale":"2023-11-28T11:53:44.889061+0000","last_undegraded":"2023-11-28T11:53:44.889061+0000","last_fullsized":"2023-11-28T11:53:44.889061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:54:59.674019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861290+0000","last_change":"2023-11-28T11:53:40.451361+0000","last_active":"2023-11-28T11:53:44.861290+0000","last_peered":"2023-11-28T11:53:44.861290+0000","last_clean":"2023-11-28T11:53:44.861290+0000","last_became_active":"2023-11-28T11:53:40.451055+0000","last_became_peered":"2023-11-28T11:53:40.451055+0000","last_unstale":"2023-11-28T11:53:44.861290+0000","last_undegraded":"2023-11-28T11:53:44.861290+0000","last_fullsized":"2023-11-28T11:53:44.861290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:00.300889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867430+0000","last_change":"2023-11-28T11:53:40.832925+0000","last_active":"2023-11-28T11:53:44.867430+0000","last_peered":"2023-11-28T11:53:44.867430+0000","last_clean":"2023-11-28T11:53:44.867430+0000","last_became_active":"2023-11-28T11:53:40.824344+0000","last_became_peered":"2023-11-28T11:53:40.824344+0000","last_unstale":"2023-11-28T11:53:44.867430+0000","last_undegraded":"2023-11-28T11:53:44.867430+0000","last_fullsized":"2023-11-28T11:53:44.867430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:07:13.206788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862637+0000","last_change":"2023-11-28T11:53:40.444858+0000","last_active":"2023-11-28T11:53:44.862637+0000","last_peered":"2023-11-28T11:53:44.862637+0000","last_clean":"2023-11-28T11:53:44.862637+0000","last_became_active":"2023-11-28T11:53:40.444494+0000","last_became_peered":"2023-11-28T11:53:40.444494+0000","last_unstale":"2023-11-28T11:53:44.862637+0000","last_undegraded":"2023-11-28T11:53:44.862637+0000","last_fullsized":"2023-11-28T11:53:44.862637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:41.874385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.854924+0000","last_change":"2023-11-28T11:53:40.826741+0000","last_active":"2023-11-28T11:53:44.854924+0000","last_peered":"2023-11-28T11:53:44.854924+0000","last_clean":"2023-11-28T11:53:44.854924+0000","last_became_active":"2023-11-28T11:53:40.826438+0000","last_became_peered":"2023-11-28T11:53:40.826438+0000","last_unstale":"2023-11-28T11:53:44.854924+0000","last_undegraded":"2023-11-28T11:53:44.854924+0000","last_fullsized":"2023-11-28T11:53:44.854924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.887781+0000","last_change":"2023-11-28T11:53:44.881841+0000","last_active":"2023-11-28T11:53:44.887781+0000","last_peered":"2023-11-28T11:53:44.887781+0000","last_clean":"2023-11-28T11:53:44.887781+0000","last_became_active":"2023-11-28T11:53:44.880886+0000","last_became_peered":"2023-11-28T11:53:44.880886+0000","last_unstale":"2023-11-28T11:53:44.887781+0000","last_undegraded":"2023-11-28T11:53:44.887781+0000","last_fullsized":"2023-11-28T11:53:44.887781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:09:31.123351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861943+0000","last_change":"2023-11-28T11:53:40.450777+0000","last_active":"2023-11-28T11:53:44.861943+0000","last_peered":"2023-11-28T11:53:44.861943+0000","last_clean":"2023-11-28T11:53:44.861943+0000","last_became_active":"2023-11-28T11:53:40.449763+0000","last_became_peered":"2023-11-28T11:53:40.449763+0000","last_unstale":"2023-11-28T11:53:44.861943+0000","last_undegraded":"2023-11-28T11:53:44.861943+0000","last_fullsized":"2023-11-28T11:53:44.861943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:19.967407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863452+0000","last_change":"2023-11-28T11:53:40.826209+0000","last_active":"2023-11-28T11:53:44.863452+0000","last_peered":"2023-11-28T11:53:44.863452+0000","last_clean":"2023-11-28T11:53:44.863452+0000","last_became_active":"2023-11-28T11:53:40.825734+0000","last_became_peered":"2023-11-28T11:53:40.825734+0000","last_unstale":"2023-11-28T11:53:44.863452+0000","last_undegraded":"2023-11-28T11:53:44.863452+0000","last_fullsized":"2023-11-28T11:53:44.863452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:06.929054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.881708+0000","last_change":"2023-11-28T11:53:44.877701+0000","last_active":"2023-11-28T11:53:44.881708+0000","last_peered":"2023-11-28T11:53:44.881708+0000","last_clean":"2023-11-28T11:53:44.881708+0000","last_became_active":"2023-11-28T11:53:44.877282+0000","last_became_peered":"2023-11-28T11:53:44.877282+0000","last_unstale":"2023-11-28T11:53:44.881708+0000","last_undegraded":"2023-11-28T11:53:44.881708+0000","last_fullsized":"2023-11-28T11:53:44.881708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:31.365757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.864694+0000","last_change":"2023-11-28T11:53:40.828450+0000","last_active":"2023-11-28T11:53:44.864694+0000","last_peered":"2023-11-28T11:53:44.864694+0000","last_clean":"2023-11-28T11:53:44.864694+0000","last_became_active":"2023-11-28T11:53:40.828013+0000","last_became_peered":"2023-11-28T11:53:40.828013+0000","last_unstale":"2023-11-28T11:53:44.864694+0000","last_undegraded":"2023-11-28T11:53:44.864694+0000","last_fullsized":"2023-11-28T11:53:44.864694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:56.490046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.875831+0000","last_change":"2023-11-28T11:53:40.830008+0000","last_active":"2023-11-28T11:53:44.875831+0000","last_peered":"2023-11-28T11:53:44.875831+0000","last_clean":"2023-11-28T11:53:44.875831+0000","last_became_active":"2023-11-28T11:53:40.829403+0000","last_became_peered":"2023-11-28T11:53:40.829403+0000","last_unstale":"2023-11-28T11:53:44.875831+0000","last_undegraded":"2023-11-28T11:53:44.875831+0000","last_fullsized":"2023-11-28T11:53:44.875831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:33.728842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860063+0000","last_change":"2023-11-28T11:53:40.822203+0000","last_active":"2023-11-28T11:53:44.860063+0000","last_peered":"2023-11-28T11:53:44.860063+0000","last_clean":"2023-11-28T11:53:44.860063+0000","last_became_active":"2023-11-28T11:53:40.821925+0000","last_became_peered":"2023-11-28T11:53:40.821925+0000","last_unstale":"2023-11-28T11:53:44.860063+0000","last_undegraded":"2023-11-28T11:53:44.860063+0000","last_fullsized":"2023-11-28T11:53:44.860063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:21:45.014606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861940+0000","last_change":"2023-11-28T11:53:40.831266+0000","last_active":"2023-11-28T11:53:44.861940+0000","last_peered":"2023-11-28T11:53:44.861940+0000","last_clean":"2023-11-28T11:53:44.861940+0000","last_became_active":"2023-11-28T11:53:40.830547+0000","last_became_peered":"2023-11-28T11:53:40.830547+0000","last_unstale":"2023-11-28T11:53:44.861940+0000","last_undegraded":"2023-11-28T11:53:44.861940+0000","last_fullsized":"2023-11-28T11:53:44.861940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:51.196033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873045+0000","last_change":"2023-11-28T11:53:40.820563+0000","last_active":"2023-11-28T11:53:44.873045+0000","last_peered":"2023-11-28T11:53:44.873045+0000","last_clean":"2023-11-28T11:53:44.873045+0000","last_became_active":"2023-11-28T11:53:40.820312+0000","last_became_peered":"2023-11-28T11:53:40.820312+0000","last_unstale":"2023-11-28T11:53:44.873045+0000","last_undegraded":"2023-11-28T11:53:44.873045+0000","last_fullsized":"2023-11-28T11:53:44.873045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:53:09.778935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.854790+0000","last_change":"2023-11-28T11:53:40.831601+0000","last_active":"2023-11-28T11:53:44.854790+0000","last_peered":"2023-11-28T11:53:44.854790+0000","last_clean":"2023-11-28T11:53:44.854790+0000","last_became_active":"2023-11-28T11:53:40.831307+0000","last_became_peered":"2023-11-28T11:53:40.831307+0000","last_unstale":"2023-11-28T11:53:44.854790+0000","last_undegraded":"2023-11-28T11:53:44.854790+0000","last_fullsized":"2023-11-28T11:53:44.854790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:58.623372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.876637+0000","last_change":"2023-11-28T11:53:40.829422+0000","last_active":"2023-11-28T11:53:44.876637+0000","last_peered":"2023-11-28T11:53:44.876637+0000","last_clean":"2023-11-28T11:53:44.876637+0000","last_became_active":"2023-11-28T11:53:40.829178+0000","last_became_peered":"2023-11-28T11:53:40.829178+0000","last_unstale":"2023-11-28T11:53:44.876637+0000","last_undegraded":"2023-11-28T11:53:44.876637+0000","last_fullsized":"2023-11-28T11:53:44.876637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:58.623372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.876529+0000","last_change":"2023-11-28T11:53:40.826723+0000","last_active":"2023-11-28T11:53:44.876529+0000","last_peered":"2023-11-28T11:53:44.876529+0000","last_clean":"2023-11-28T11:53:44.876529+0000","last_became_active":"2023-11-28T11:53:40.826291+0000","last_became_peered":"2023-11-28T11:53:40.826291+0000","last_unstale":"2023-11-28T11:53:44.876529+0000","last_undegraded":"2023-11-28T11:53:44.876529+0000","last_fullsized":"2023-11-28T11:53:44.876529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:04.735416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.858446+0000","last_change":"2023-11-28T11:53:40.825388+0000","last_active":"2023-11-28T11:53:44.858446+0000","last_peered":"2023-11-28T11:53:44.858446+0000","last_clean":"2023-11-28T11:53:44.858446+0000","last_became_active":"2023-11-28T11:53:40.823486+0000","last_became_peered":"2023-11-28T11:53:40.823486+0000","last_unstale":"2023-11-28T11:53:44.858446+0000","last_undegraded":"2023-11-28T11:53:44.858446+0000","last_fullsized":"2023-11-28T11:53:44.858446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:07:13.206788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862735+0000","last_change":"2023-11-28T11:53:40.834673+0000","last_active":"2023-11-28T11:53:44.862735+0000","last_peered":"2023-11-28T11:53:44.862735+0000","last_clean":"2023-11-28T11:53:44.862735+0000","last_became_active":"2023-11-28T11:53:40.834446+0000","last_became_peered":"2023-11-28T11:53:40.834446+0000","last_unstale":"2023-11-28T11:53:44.862735+0000","last_undegraded":"2023-11-28T11:53:44.862735+0000","last_fullsized":"2023-11-28T11:53:44.862735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:45:19.490164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862539+0000","last_change":"2023-11-28T11:53:40.823930+0000","last_active":"2023-11-28T11:53:44.862539+0000","last_peered":"2023-11-28T11:53:44.862539+0000","last_clean":"2023-11-28T11:53:44.862539+0000","last_became_active":"2023-11-28T11:53:40.823085+0000","last_became_peered":"2023-11-28T11:53:40.823085+0000","last_unstale":"2023-11-28T11:53:44.862539+0000","last_undegraded":"2023-11-28T11:53:44.862539+0000","last_fullsized":"2023-11-28T11:53:44.862539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:03.251004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861847+0000","last_change":"2023-11-28T11:53:40.825318+0000","last_active":"2023-11-28T11:53:44.861847+0000","last_peered":"2023-11-28T11:53:44.861847+0000","last_clean":"2023-11-28T11:53:44.861847+0000","last_became_active":"2023-11-28T11:53:40.823580+0000","last_became_peered":"2023-11-28T11:53:40.823580+0000","last_unstale":"2023-11-28T11:53:44.861847+0000","last_undegraded":"2023-11-28T11:53:44.861847+0000","last_fullsized":"2023-11-28T11:53:44.861847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:53.307980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859699+0000","last_change":"2023-11-28T11:53:40.822632+0000","last_active":"2023-11-28T11:53:44.859699+0000","last_peered":"2023-11-28T11:53:44.859699+0000","last_clean":"2023-11-28T11:53:44.859699+0000","last_became_active":"2023-11-28T11:53:40.822041+0000","last_became_peered":"2023-11-28T11:53:40.822041+0000","last_unstale":"2023-11-28T11:53:44.859699+0000","last_undegraded":"2023-11-28T11:53:44.859699+0000","last_fullsized":"2023-11-28T11:53:44.859699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:25.589109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.853050+0000","last_change":"2023-11-28T11:53:40.827422+0000","last_active":"2023-11-28T11:53:44.853050+0000","last_peered":"2023-11-28T11:53:44.853050+0000","last_clean":"2023-11-28T11:53:44.853050+0000","last_became_active":"2023-11-28T11:53:40.827049+0000","last_became_peered":"2023-11-28T11:53:40.827049+0000","last_unstale":"2023-11-28T11:53:44.853050+0000","last_undegraded":"2023-11-28T11:53:44.853050+0000","last_fullsized":"2023-11-28T11:53:44.853050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:40.317412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862710+0000","last_change":"2023-11-28T11:53:40.830609+0000","last_active":"2023-11-28T11:53:44.862710+0000","last_peered":"2023-11-28T11:53:44.862710+0000","last_clean":"2023-11-28T11:53:44.862710+0000","last_became_active":"2023-11-28T11:53:40.830049+0000","last_became_peered":"2023-11-28T11:53:40.830049+0000","last_unstale":"2023-11-28T11:53:44.862710+0000","last_undegraded":"2023-11-28T11:53:44.862710+0000","last_fullsized":"2023-11-28T11:53:44.862710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:39:08.352832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867744+0000","last_change":"2023-11-28T11:53:40.834235+0000","last_active":"2023-11-28T11:53:44.867744+0000","last_peered":"2023-11-28T11:53:44.867744+0000","last_clean":"2023-11-28T11:53:44.867744+0000","last_became_active":"2023-11-28T11:53:40.833501+0000","last_became_peered":"2023-11-28T11:53:40.833501+0000","last_unstale":"2023-11-28T11:53:44.867744+0000","last_undegraded":"2023-11-28T11:53:44.867744+0000","last_fullsized":"2023-11-28T11:53:44.867744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:12.417672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859262+0000","last_change":"2023-11-28T11:53:40.814201+0000","last_active":"2023-11-28T11:53:44.859262+0000","last_peered":"2023-11-28T11:53:44.859262+0000","last_clean":"2023-11-28T11:53:44.859262+0000","last_became_active":"2023-11-28T11:53:40.813798+0000","last_became_peered":"2023-11-28T11:53:40.813798+0000","last_unstale":"2023-11-28T11:53:44.859262+0000","last_undegraded":"2023-11-28T11:53:44.859262+0000","last_fullsized":"2023-11-28T11:53:44.859262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:49.919629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861214+0000","last_change":"2023-11-28T11:53:40.819145+0000","last_active":"2023-11-28T11:53:44.861214+0000","last_peered":"2023-11-28T11:53:44.861214+0000","last_clean":"2023-11-28T11:53:44.861214+0000","last_became_active":"2023-11-28T11:53:40.818894+0000","last_became_peered":"2023-11-28T11:53:40.818894+0000","last_unstale":"2023-11-28T11:53:44.861214+0000","last_undegraded":"2023-11-28T11:53:44.861214+0000","last_fullsized":"2023-11-28T11:53:44.861214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852149+0000","last_change":"2023-11-28T11:53:40.831922+0000","last_active":"2023-11-28T11:53:44.852149+0000","last_peered":"2023-11-28T11:53:44.852149+0000","last_clean":"2023-11-28T11:53:44.852149+0000","last_became_active":"2023-11-28T11:53:40.831309+0000","last_became_peered":"2023-11-28T11:53:40.831309+0000","last_unstale":"2023-11-28T11:53:44.852149+0000","last_undegraded":"2023-11-28T11:53:44.852149+0000","last_fullsized":"2023-11-28T11:53:44.852149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:53.307980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852158+0000","last_change":"2023-11-28T11:53:40.828525+0000","last_active":"2023-11-28T11:53:44.852158+0000","last_peered":"2023-11-28T11:53:44.852158+0000","last_clean":"2023-11-28T11:53:44.852158+0000","last_became_active":"2023-11-28T11:53:40.827088+0000","last_became_peered":"2023-11-28T11:53:40.827088+0000","last_unstale":"2023-11-28T11:53:44.852158+0000","last_undegraded":"2023-11-28T11:53:44.852158+0000","last_fullsized":"2023-11-28T11:53:44.852158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:42.885822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852234+0000","last_change":"2023-11-28T11:53:40.827903+0000","last_active":"2023-11-28T11:53:44.852234+0000","last_peered":"2023-11-28T11:53:44.852234+0000","last_clean":"2023-11-28T11:53:44.852234+0000","last_became_active":"2023-11-28T11:53:40.827630+0000","last_became_peered":"2023-11-28T11:53:40.827630+0000","last_unstale":"2023-11-28T11:53:44.852234+0000","last_undegraded":"2023-11-28T11:53:44.852234+0000","last_fullsized":"2023-11-28T11:53:44.852234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:20.978843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860656+0000","last_change":"2023-11-28T11:53:40.817481+0000","last_active":"2023-11-28T11:53:44.860656+0000","last_peered":"2023-11-28T11:53:44.860656+0000","last_clean":"2023-11-28T11:53:44.860656+0000","last_became_active":"2023-11-28T11:53:40.816901+0000","last_became_peered":"2023-11-28T11:53:40.816901+0000","last_unstale":"2023-11-28T11:53:44.860656+0000","last_undegraded":"2023-11-28T11:53:44.860656+0000","last_fullsized":"2023-11-28T11:53:44.860656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:57.213686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.853557+0000","last_change":"2023-11-28T11:53:40.826671+0000","last_active":"2023-11-28T11:53:44.853557+0000","last_peered":"2023-11-28T11:53:44.853557+0000","last_clean":"2023-11-28T11:53:44.853557+0000","last_became_active":"2023-11-28T11:53:40.826306+0000","last_became_peered":"2023-11-28T11:53:40.826306+0000","last_unstale":"2023-11-28T11:53:44.853557+0000","last_undegraded":"2023-11-28T11:53:44.853557+0000","last_fullsized":"2023-11-28T11:53:44.853557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:07:13.206788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867648+0000","last_change":"2023-11-28T11:53:40.834257+0000","last_active":"2023-11-28T11:53:44.867648+0000","last_peered":"2023-11-28T11:53:44.867648+0000","last_clean":"2023-11-28T11:53:44.867648+0000","last_became_active":"2023-11-28T11:53:40.833624+0000","last_became_peered":"2023-11-28T11:53:40.833624+0000","last_unstale":"2023-11-28T11:53:44.867648+0000","last_undegraded":"2023-11-28T11:53:44.867648+0000","last_fullsized":"2023-11-28T11:53:44.867648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:51.196033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.851513+0000","last_change":"2023-11-28T11:53:40.827595+0000","last_active":"2023-11-28T11:53:44.851513+0000","last_peered":"2023-11-28T11:53:44.851513+0000","last_clean":"2023-11-28T11:53:44.851513+0000","last_became_active":"2023-11-28T11:53:40.827244+0000","last_became_peered":"2023-11-28T11:53:40.827244+0000","last_unstale":"2023-11-28T11:53:44.851513+0000","last_undegraded":"2023-11-28T11:53:44.851513+0000","last_fullsized":"2023-11-28T11:53:44.851513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:12.417672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861137+0000","last_change":"2023-11-28T11:53:40.818652+0000","last_active":"2023-11-28T11:53:44.861137+0000","last_peered":"2023-11-28T11:53:44.861137+0000","last_clean":"2023-11-28T11:53:44.861137+0000","last_became_active":"2023-11-28T11:53:40.818359+0000","last_became_peered":"2023-11-28T11:53:40.818359+0000","last_unstale":"2023-11-28T11:53:44.861137+0000","last_undegraded":"2023-11-28T11:53:44.861137+0000","last_fullsized":"2023-11-28T11:53:44.861137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:58.623372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859346+0000","last_change":"2023-11-28T11:53:40.815826+0000","last_active":"2023-11-28T11:53:44.859346+0000","last_peered":"2023-11-28T11:53:44.859346+0000","last_clean":"2023-11-28T11:53:44.859346+0000","last_became_active":"2023-11-28T11:53:40.815568+0000","last_became_peered":"2023-11-28T11:53:40.815568+0000","last_unstale":"2023-11-28T11:53:44.859346+0000","last_undegraded":"2023-11-28T11:53:44.859346+0000","last_fullsized":"2023-11-28T11:53:44.859346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:07:42.533145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.868655+0000","last_change":"2023-11-28T11:53:40.832666+0000","last_active":"2023-11-28T11:53:44.868655+0000","last_peered":"2023-11-28T11:53:44.868655+0000","last_clean":"2023-11-28T11:53:44.868655+0000","last_became_active":"2023-11-28T11:53:40.823823+0000","last_became_peered":"2023-11-28T11:53:40.823823+0000","last_unstale":"2023-11-28T11:53:44.868655+0000","last_undegraded":"2023-11-28T11:53:44.868655+0000","last_fullsized":"2023-11-28T11:53:44.868655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:53.307980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.864534+0000","last_change":"2023-11-28T11:53:40.821057+0000","last_active":"2023-11-28T11:53:44.864534+0000","last_peered":"2023-11-28T11:53:44.864534+0000","last_clean":"2023-11-28T11:53:44.864534+0000","last_became_active":"2023-11-28T11:53:40.820709+0000","last_became_peered":"2023-11-28T11:53:40.820709+0000","last_unstale":"2023-11-28T11:53:44.864534+0000","last_undegraded":"2023-11-28T11:53:44.864534+0000","last_fullsized":"2023-11-28T11:53:44.864534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:01.312325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860193+0000","last_change":"2023-11-28T11:53:40.817645+0000","last_active":"2023-11-28T11:53:44.860193+0000","last_peered":"2023-11-28T11:53:44.860193+0000","last_clean":"2023-11-28T11:53:44.860193+0000","last_became_active":"2023-11-28T11:53:40.817205+0000","last_became_peered":"2023-11-28T11:53:40.817205+0000","last_unstale":"2023-11-28T11:53:44.860193+0000","last_undegraded":"2023-11-28T11:53:44.860193+0000","last_fullsized":"2023-11-28T11:53:44.860193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:45:19.490164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.853399+0000","last_change":"2023-11-28T11:53:40.826609+0000","last_active":"2023-11-28T11:53:44.853399+0000","last_peered":"2023-11-28T11:53:44.853399+0000","last_clean":"2023-11-28T11:53:44.853399+0000","last_became_active":"2023-11-28T11:53:40.826314+0000","last_became_peered":"2023-11-28T11:53:40.826314+0000","last_unstale":"2023-11-28T11:53:44.853399+0000","last_undegraded":"2023-11-28T11:53:44.853399+0000","last_fullsized":"2023-11-28T11:53:44.853399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:51.196033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.853274+0000","last_change":"2023-11-28T11:53:40.828425+0000","last_active":"2023-11-28T11:53:44.853274+0000","last_peered":"2023-11-28T11:53:44.853274+0000","last_clean":"2023-11-28T11:53:44.853274+0000","last_became_active":"2023-11-28T11:53:40.828140+0000","last_became_peered":"2023-11-28T11:53:40.828140+0000","last_unstale":"2023-11-28T11:53:44.853274+0000","last_undegraded":"2023-11-28T11:53:44.853274+0000","last_fullsized":"2023-11-28T11:53:44.853274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:55.927473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4527,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9256,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362584,"statfs":{"total":96636764160,"available":96627286016,"internally_reserved":0,"allocated":884736,"data_stored":703105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":108776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8148,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363692,"statfs":{"total":96636764160,"available":96628420608,"internally_reserved":0,"allocated":274432,"data_stored":110398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8224,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363616,"statfs":{"total":96636764160,"available":96628342784,"internally_reserved":0,"allocated":286720,"data_stored":113563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8140,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363700,"statfs":{"total":96636764160,"available":96628428800,"internally_reserved":0,"allocated":266240,"data_stored":108866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":108776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9232,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362608,"statfs":{"total":96636764160,"available":96627310592,"internally_reserved":0,"allocated":860160,"data_stored":700130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12240,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359600,"statfs":{"total":96636764160,"available":96624230400,"internally_reserved":0,"allocated":270336,"data_stored":110328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:54:03.989 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:54:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.105+0000 7fba8f187700 1 Processor -- start 2023-11-28T11:54:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.105+0000 7fba8f187700 1 -- start start 2023-11-28T11:54:04.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8f187700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fba8806c640 0x7fba8806cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8f187700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba880b2020 0x7fba880b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8f187700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba88152f80 con 0x7fba88152bb0 2023-11-28T11:54:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8f187700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8806d020 con 0x7fba8806c640 2023-11-28T11:54:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8f187700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba88159a30 con 0x7fba880b2020 2023-11-28T11:54:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8e185700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fba88152bb0 0x7fba8815caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56314/0 (socket says 172.21.15.50:56314) 2023-11-28T11:54:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8e185700 1 -- 172.21.15.50:0/2621298207 learned_addr learned my addr 172.21.15.50:0/2621298207 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8d984700 1 --2- 172.21.15.50:0/2621298207 >> v2:172.21.15.50:3300/0 conn(0x7fba8806c640 0x7fba8806cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8e986700 1 --2- 172.21.15.50:0/2621298207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba880b2020 0x7fba880b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8d183700 1 -- 172.21.15.50:0/2621298207 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763881387 0 0) 0x7fba88152f80 con 0x7fba88152bb0 2023-11-28T11:54:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8d183700 1 -- 172.21.15.50:0/2621298207 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba740035d0 con 0x7fba88152bb0 2023-11-28T11:54:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8d984700 1 -- 172.21.15.50:0/2621298207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba880b2020 msgr2=0x7fba880b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:04.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8d984700 1 --2- 172.21.15.50:0/2621298207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba880b2020 0x7fba880b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8d984700 1 -- 172.21.15.50:0/2621298207 >> v1:172.21.15.50:6789/0 conn(0x7fba88152bb0 legacy=0x7fba8815caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:04.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8d984700 1 -- 172.21.15.50:0/2621298207 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba88158eb0 con 0x7fba8806c640 2023-11-28T11:54:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8d984700 1 --2- 172.21.15.50:0/2621298207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba8806c640 0x7fba8806cae0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fba7800a9f0 tx=0x7fba7800ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f985872974ed97e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8d183700 1 -- 172.21.15.50:0/2621298207 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7800cb70 con 0x7fba8806c640 2023-11-28T11:54:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8d183700 1 -- 172.21.15.50:0/2621298207 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7800ae90 con 0x7fba8806c640 2023-11-28T11:54:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8d183700 1 -- 172.21.15.50:0/2621298207 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78018400 con 0x7fba8806c640 2023-11-28T11:54:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8f187700 1 -- 172.21.15.50:0/2621298207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba8806c640 msgr2=0x7fba8806cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8f187700 1 --2- 172.21.15.50:0/2621298207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba8806c640 0x7fba8806cae0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fba7800a9f0 tx=0x7fba7800ad00 comp rx=0 tx=0).stop 2023-11-28T11:54:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8f187700 1 -- 172.21.15.50:0/2621298207 shutdown_connections 2023-11-28T11:54:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8f187700 1 --2- 172.21.15.50:0/2621298207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba880b2020 0x7fba880b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.109+0000 7fba8f187700 1 --2- 172.21.15.50:0/2621298207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba8806c640 0x7fba8806cae0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.113+0000 7fba8f187700 1 -- 172.21.15.50:0/2621298207 >> 172.21.15.50:0/2621298207 conn(0x7fba8806e000 msgr2=0x7fba880b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:04.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.113+0000 7fba8f187700 1 -- 172.21.15.50:0/2621298207 shutdown_connections 2023-11-28T11:54:04.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.113+0000 7fba8f187700 1 -- 172.21.15.50:0/2621298207 wait complete. 2023-11-28T11:54:04.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.113+0000 7fba8f187700 1 Processor -- start 2023-11-28T11:54:04.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.113+0000 7fba8f187700 1 -- start start 2023-11-28T11:54:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.113+0000 7fba8f187700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba8806c640 0x7fba88156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.113+0000 7fba8f187700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba880b2020 0x7fba88142990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.113+0000 7fba8f187700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba88152bb0 0x7fba880ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.113+0000 7fba8f187700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba88156e40 con 0x7fba8806c640 2023-11-28T11:54:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.113+0000 7fba8f187700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba88157110 con 0x7fba880b2020 2023-11-28T11:54:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.113+0000 7fba8f187700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba881573f0 con 0x7fba88152bb0 2023-11-28T11:54:04.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.113+0000 7fba8e185700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba8806c640 0x7fba88156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.113+0000 7fba8e185700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba8806c640 0x7fba88156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53120/0 (socket says 172.21.15.50:53120) 2023-11-28T11:54:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.113+0000 7fba8e185700 1 -- 172.21.15.50:0/2008795010 learned_addr learned my addr 172.21.15.50:0/2008795010 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.113+0000 7fba8d984700 1 --2- 172.21.15.50:0/2008795010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba880b2020 0x7fba88142990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.117+0000 7fba8e986700 1 --2- 172.21.15.50:0/2008795010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba88152bb0 0x7fba880ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.117+0000 7fba8e185700 1 -- 172.21.15.50:0/2008795010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba88152bb0 msgr2=0x7fba880ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.117+0000 7fba8e185700 1 --2- 172.21.15.50:0/2008795010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba88152bb0 0x7fba880ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.117+0000 7fba8e185700 1 -- 172.21.15.50:0/2008795010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba880b2020 msgr2=0x7fba88142990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.117+0000 7fba8e185700 1 --2- 172.21.15.50:0/2008795010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba880b2020 0x7fba88142990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.117+0000 7fba8e185700 1 -- 172.21.15.50:0/2008795010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7800a650 con 0x7fba8806c640 2023-11-28T11:54:04.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.117+0000 7fba8e986700 1 --2- 172.21.15.50:0/2008795010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba88152bb0 0x7fba880ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:04.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.117+0000 7fba8e185700 1 --2- 172.21.15.50:0/2008795010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba8806c640 0x7fba88156900 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fba8400c4f0 tx=0x7fba8400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:04.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.117+0000 7fba7effd700 1 -- 172.21.15.50:0/2008795010 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84005d90 con 0x7fba8806c640 2023-11-28T11:54:04.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.117+0000 7fba7effd700 1 -- 172.21.15.50:0/2008795010 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba840070d0 con 0x7fba8806c640 2023-11-28T11:54:04.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.117+0000 7fba8f187700 1 -- 172.21.15.50:0/2008795010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba88159470 con 0x7fba8806c640 2023-11-28T11:54:04.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.117+0000 7fba7effd700 1 -- 172.21.15.50:0/2008795010 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84007440 con 0x7fba8806c640 2023-11-28T11:54:04.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.117+0000 7fba8f187700 1 -- 172.21.15.50:0/2008795010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba88159190 con 0x7fba8806c640 2023-11-28T11:54:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.117+0000 7fba8f187700 1 -- 172.21.15.50:0/2008795010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba88159750 con 0x7fba8806c640 2023-11-28T11:54:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.117+0000 7fba7effd700 1 -- 172.21.15.50:0/2008795010 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fba84019030 con 0x7fba8806c640 2023-11-28T11:54:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.117+0000 7fba7effd700 1 --2- 172.21.15.50:0/2008795010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba6c064ee0 0x7fba6c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.117+0000 7fba7effd700 1 -- 172.21.15.50:0/2008795010 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fba84081440 con 0x7fba8806c640 2023-11-28T11:54:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.121+0000 7fba8d984700 1 --2- 172.21.15.50:0/2008795010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba6c064ee0 0x7fba6c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.121+0000 7fba8d984700 1 --2- 172.21.15.50:0/2008795010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba6c064ee0 0x7fba6c067390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fba78000c00 tx=0x7fba78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:04.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.125+0000 7fba7effd700 1 -- 172.21.15.50:0/2008795010 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fba8404a400 con 0x7fba8806c640 2023-11-28T11:54:04.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.293+0000 7fba8f187700 1 -- 172.21.15.50:0/2008795010 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba88155190 con 0x7fba6c064ee0 2023-11-28T11:54:04.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.313+0000 7fba7effd700 1 -- 172.21.15.50:0/2008795010 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367425 (secure 0 0 0) 0x7fba88155190 con 0x7fba6c064ee0 2023-11-28T11:54:04.320 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:04.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.317+0000 7fba8f187700 1 -- 172.21.15.50:0/2008795010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba6c064ee0 msgr2=0x7fba6c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:04.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.317+0000 7fba8f187700 1 --2- 172.21.15.50:0/2008795010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba6c064ee0 0x7fba6c067390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fba78000c00 tx=0x7fba78008040 comp rx=0 tx=0).stop 2023-11-28T11:54:04.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.317+0000 7fba8f187700 1 -- 172.21.15.50:0/2008795010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba8806c640 msgr2=0x7fba88156900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:04.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.317+0000 7fba8f187700 1 --2- 172.21.15.50:0/2008795010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba8806c640 0x7fba88156900 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fba8400c4f0 tx=0x7fba8400c800 comp rx=0 tx=0).stop 2023-11-28T11:54:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.317+0000 7fba8f187700 1 -- 172.21.15.50:0/2008795010 shutdown_connections 2023-11-28T11:54:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.317+0000 7fba8f187700 1 --2- 172.21.15.50:0/2008795010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba88152bb0 0x7fba880ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.317+0000 7fba8f187700 1 --2- 172.21.15.50:0/2008795010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba6c064ee0 0x7fba6c067390 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.317+0000 7fba8f187700 1 --2- 172.21.15.50:0/2008795010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba880b2020 0x7fba88142990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.317+0000 7fba8f187700 1 --2- 172.21.15.50:0/2008795010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba8806c640 0x7fba88156900 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.317+0000 7fba8f187700 1 -- 172.21.15.50:0/2008795010 >> 172.21.15.50:0/2008795010 conn(0x7fba8806e000 msgr2=0x7fba8806acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.317+0000 7fba8f187700 1 -- 172.21.15.50:0/2008795010 shutdown_connections 2023-11-28T11:54:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.317+0000 7fba8f187700 1 -- 172.21.15.50:0/2008795010 wait complete. 2023-11-28T11:54:04.324 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:54:04.335 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-11-28T11:54:02.866687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594895,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71384,"kb_used_data":3288,"kb_used_omap":0,"kb_used_meta":68032,"kb_avail":754903336,"statfs":{"total":773094113280,"available":773021016064,"internally_reserved":0,"allocated":3366912,"data_stored":2063942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69664768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1749,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005566"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889694+0000","last_change":"2023-11-28T11:53:44.882435+0000","last_active":"2023-11-28T11:53:44.889694+0000","last_peered":"2023-11-28T11:53:44.889694+0000","last_clean":"2023-11-28T11:53:44.889694+0000","last_became_active":"2023-11-28T11:53:44.882048+0000","last_became_peered":"2023-11-28T11:53:44.882048+0000","last_unstale":"2023-11-28T11:53:44.889694+0000","last_undegraded":"2023-11-28T11:53:44.889694+0000","last_fullsized":"2023-11-28T11:53:44.889694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:05.347162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867841+0000","last_change":"2023-11-28T11:53:40.436343+0000","last_active":"2023-11-28T11:53:44.867841+0000","last_peered":"2023-11-28T11:53:44.867841+0000","last_clean":"2023-11-28T11:53:44.867841+0000","last_became_active":"2023-11-28T11:53:40.435879+0000","last_became_peered":"2023-11-28T11:53:40.435879+0000","last_unstale":"2023-11-28T11:53:44.867841+0000","last_undegraded":"2023-11-28T11:53:44.867841+0000","last_fullsized":"2023-11-28T11:53:44.867841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:00.300889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859343+0000","last_change":"2023-11-28T11:53:40.821925+0000","last_active":"2023-11-28T11:53:44.859343+0000","last_peered":"2023-11-28T11:53:44.859343+0000","last_clean":"2023-11-28T11:53:44.859343+0000","last_became_active":"2023-11-28T11:53:40.821597+0000","last_became_peered":"2023-11-28T11:53:40.821597+0000","last_unstale":"2023-11-28T11:53:44.859343+0000","last_undegraded":"2023-11-28T11:53:44.859343+0000","last_fullsized":"2023-11-28T11:53:44.859343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:23.875985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.880793+0000","last_change":"2023-11-28T11:53:44.875925+0000","last_active":"2023-11-28T11:53:44.880793+0000","last_peered":"2023-11-28T11:53:44.880793+0000","last_clean":"2023-11-28T11:53:44.880793+0000","last_became_active":"2023-11-28T11:53:44.875558+0000","last_became_peered":"2023-11-28T11:53:44.875558+0000","last_unstale":"2023-11-28T11:53:44.880793+0000","last_undegraded":"2023-11-28T11:53:44.880793+0000","last_fullsized":"2023-11-28T11:53:44.880793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:12.753046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863282+0000","last_change":"2023-11-28T11:53:40.441515+0000","last_active":"2023-11-28T11:53:44.863282+0000","last_peered":"2023-11-28T11:53:44.863282+0000","last_clean":"2023-11-28T11:53:44.863282+0000","last_became_active":"2023-11-28T11:53:40.441208+0000","last_became_peered":"2023-11-28T11:53:40.441208+0000","last_unstale":"2023-11-28T11:53:44.863282+0000","last_undegraded":"2023-11-28T11:53:44.863282+0000","last_fullsized":"2023-11-28T11:53:44.863282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:35:19.888846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862872+0000","last_change":"2023-11-28T11:53:40.830197+0000","last_active":"2023-11-28T11:53:44.862872+0000","last_peered":"2023-11-28T11:53:44.862872+0000","last_clean":"2023-11-28T11:53:44.862872+0000","last_became_active":"2023-11-28T11:53:40.829740+0000","last_became_peered":"2023-11-28T11:53:40.829740+0000","last_unstale":"2023-11-28T11:53:44.862872+0000","last_undegraded":"2023-11-28T11:53:44.862872+0000","last_fullsized":"2023-11-28T11:53:44.862872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:38.089006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873088+0000","last_change":"2023-11-28T11:53:44.870606+0000","last_active":"2023-11-28T11:53:44.873088+0000","last_peered":"2023-11-28T11:53:44.873088+0000","last_clean":"2023-11-28T11:53:44.873088+0000","last_became_active":"2023-11-28T11:53:44.870208+0000","last_became_peered":"2023-11-28T11:53:44.870208+0000","last_unstale":"2023-11-28T11:53:44.873088+0000","last_undegraded":"2023-11-28T11:53:44.873088+0000","last_fullsized":"2023-11-28T11:53:44.873088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:09:00.740331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.855028+0000","last_change":"2023-11-28T11:53:40.448313+0000","last_active":"2023-11-28T11:53:44.855028+0000","last_peered":"2023-11-28T11:53:44.855028+0000","last_clean":"2023-11-28T11:53:44.855028+0000","last_became_active":"2023-11-28T11:53:40.448063+0000","last_became_peered":"2023-11-28T11:53:40.448063+0000","last_unstale":"2023-11-28T11:53:44.855028+0000","last_undegraded":"2023-11-28T11:53:44.855028+0000","last_fullsized":"2023-11-28T11:53:44.855028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:39.305975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859973+0000","last_change":"2023-11-28T11:53:40.820453+0000","last_active":"2023-11-28T11:53:44.859973+0000","last_peered":"2023-11-28T11:53:44.859973+0000","last_clean":"2023-11-28T11:53:44.859973+0000","last_became_active":"2023-11-28T11:53:40.820114+0000","last_became_peered":"2023-11-28T11:53:40.820114+0000","last_unstale":"2023-11-28T11:53:44.859973+0000","last_undegraded":"2023-11-28T11:53:44.859973+0000","last_fullsized":"2023-11-28T11:53:44.859973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:07:13.206788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.880082+0000","last_change":"2023-11-28T11:53:44.877852+0000","last_active":"2023-11-28T11:53:44.880082+0000","last_peered":"2023-11-28T11:53:44.880082+0000","last_clean":"2023-11-28T11:53:44.880082+0000","last_became_active":"2023-11-28T11:53:44.877334+0000","last_became_peered":"2023-11-28T11:53:44.877334+0000","last_unstale":"2023-11-28T11:53:44.880082+0000","last_undegraded":"2023-11-28T11:53:44.880082+0000","last_fullsized":"2023-11-28T11:53:44.880082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:29.010118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852090+0000","last_change":"2023-11-28T11:53:40.450034+0000","last_active":"2023-11-28T11:53:44.852090+0000","last_peered":"2023-11-28T11:53:44.852090+0000","last_clean":"2023-11-28T11:53:44.852090+0000","last_became_active":"2023-11-28T11:53:40.449802+0000","last_became_peered":"2023-11-28T11:53:40.449802+0000","last_unstale":"2023-11-28T11:53:44.852090+0000","last_undegraded":"2023-11-28T11:53:44.852090+0000","last_fullsized":"2023-11-28T11:53:44.852090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:41.874385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859657+0000","last_change":"2023-11-28T11:53:40.822841+0000","last_active":"2023-11-28T11:53:44.859657+0000","last_peered":"2023-11-28T11:53:44.859657+0000","last_clean":"2023-11-28T11:53:44.859657+0000","last_became_active":"2023-11-28T11:53:40.822586+0000","last_became_peered":"2023-11-28T11:53:40.822586+0000","last_unstale":"2023-11-28T11:53:44.859657+0000","last_undegraded":"2023-11-28T11:53:44.859657+0000","last_fullsized":"2023-11-28T11:53:44.859657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:03.251004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889865+0000","last_change":"2023-11-28T11:53:44.883848+0000","last_active":"2023-11-28T11:53:44.889865+0000","last_peered":"2023-11-28T11:53:44.889865+0000","last_clean":"2023-11-28T11:53:44.889865+0000","last_became_active":"2023-11-28T11:53:44.883452+0000","last_became_peered":"2023-11-28T11:53:44.883452+0000","last_unstale":"2023-11-28T11:53:44.889865+0000","last_undegraded":"2023-11-28T11:53:44.889865+0000","last_fullsized":"2023-11-28T11:53:44.889865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:38.035586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.869040+0000","last_change":"2023-11-28T11:53:40.449747+0000","last_active":"2023-11-28T11:53:44.869040+0000","last_peered":"2023-11-28T11:53:44.869040+0000","last_clean":"2023-11-28T11:53:44.869040+0000","last_became_active":"2023-11-28T11:53:40.449347+0000","last_became_peered":"2023-11-28T11:53:40.449347+0000","last_unstale":"2023-11-28T11:53:44.869040+0000","last_undegraded":"2023-11-28T11:53:44.869040+0000","last_fullsized":"2023-11-28T11:53:44.869040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:54.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852330+0000","last_change":"2023-11-28T11:53:40.827861+0000","last_active":"2023-11-28T11:53:44.852330+0000","last_peered":"2023-11-28T11:53:44.852330+0000","last_clean":"2023-11-28T11:53:44.852330+0000","last_became_active":"2023-11-28T11:53:40.827614+0000","last_became_peered":"2023-11-28T11:53:40.827614+0000","last_unstale":"2023-11-28T11:53:44.852330+0000","last_undegraded":"2023-11-28T11:53:44.852330+0000","last_fullsized":"2023-11-28T11:53:44.852330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:01.312325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.883955+0000","last_change":"2023-11-28T11:53:44.880640+0000","last_active":"2023-11-28T11:53:44.883955+0000","last_peered":"2023-11-28T11:53:44.883955+0000","last_clean":"2023-11-28T11:53:44.883955+0000","last_became_active":"2023-11-28T11:53:44.880247+0000","last_became_peered":"2023-11-28T11:53:44.880247+0000","last_unstale":"2023-11-28T11:53:44.883955+0000","last_undegraded":"2023-11-28T11:53:44.883955+0000","last_fullsized":"2023-11-28T11:53:44.883955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:51:39.277759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860162+0000","last_change":"2023-11-28T11:53:40.448452+0000","last_active":"2023-11-28T11:53:44.860162+0000","last_peered":"2023-11-28T11:53:44.860162+0000","last_clean":"2023-11-28T11:53:44.860162+0000","last_became_active":"2023-11-28T11:53:40.448154+0000","last_became_peered":"2023-11-28T11:53:40.448154+0000","last_unstale":"2023-11-28T11:53:44.860162+0000","last_undegraded":"2023-11-28T11:53:44.860162+0000","last_fullsized":"2023-11-28T11:53:44.860162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:41.874385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863052+0000","last_change":"2023-11-28T11:53:40.825987+0000","last_active":"2023-11-28T11:53:44.863052+0000","last_peered":"2023-11-28T11:53:44.863052+0000","last_clean":"2023-11-28T11:53:44.863052+0000","last_became_active":"2023-11-28T11:53:40.825706+0000","last_became_peered":"2023-11-28T11:53:40.825706+0000","last_unstale":"2023-11-28T11:53:44.863052+0000","last_undegraded":"2023-11-28T11:53:44.863052+0000","last_fullsized":"2023-11-28T11:53:44.863052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:27:28.269321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.886243+0000","last_change":"2023-11-28T11:53:44.883030+0000","last_active":"2023-11-28T11:53:44.886243+0000","last_peered":"2023-11-28T11:53:44.886243+0000","last_clean":"2023-11-28T11:53:44.886243+0000","last_became_active":"2023-11-28T11:53:44.882675+0000","last_became_peered":"2023-11-28T11:53:44.882675+0000","last_unstale":"2023-11-28T11:53:44.886243+0000","last_undegraded":"2023-11-28T11:53:44.886243+0000","last_fullsized":"2023-11-28T11:53:44.886243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:07:45.954153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.872964+0000","last_change":"2023-11-28T11:53:40.448373+0000","last_active":"2023-11-28T11:53:44.872964+0000","last_peered":"2023-11-28T11:53:44.872964+0000","last_clean":"2023-11-28T11:53:44.872964+0000","last_became_active":"2023-11-28T11:53:40.448029+0000","last_became_peered":"2023-11-28T11:53:40.448029+0000","last_unstale":"2023-11-28T11:53:44.872964+0000","last_undegraded":"2023-11-28T11:53:44.872964+0000","last_fullsized":"2023-11-28T11:53:44.872964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:57.826127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867262+0000","last_change":"2023-11-28T11:53:40.833512+0000","last_active":"2023-11-28T11:53:44.867262+0000","last_peered":"2023-11-28T11:53:44.867262+0000","last_clean":"2023-11-28T11:53:44.867262+0000","last_became_active":"2023-11-28T11:53:40.833244+0000","last_became_peered":"2023-11-28T11:53:40.833244+0000","last_unstale":"2023-11-28T11:53:44.867262+0000","last_undegraded":"2023-11-28T11:53:44.867262+0000","last_fullsized":"2023-11-28T11:53:44.867262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:58.623372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889172+0000","last_change":"2023-11-28T11:53:44.881845+0000","last_active":"2023-11-28T11:53:44.889172+0000","last_peered":"2023-11-28T11:53:44.889172+0000","last_clean":"2023-11-28T11:53:44.889172+0000","last_became_active":"2023-11-28T11:53:44.881453+0000","last_became_peered":"2023-11-28T11:53:44.881453+0000","last_unstale":"2023-11-28T11:53:44.889172+0000","last_undegraded":"2023-11-28T11:53:44.889172+0000","last_fullsized":"2023-11-28T11:53:44.889172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:41:45.095803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861569+0000","last_change":"2023-11-28T11:53:40.440029+0000","last_active":"2023-11-28T11:53:44.861569+0000","last_peered":"2023-11-28T11:53:44.861569+0000","last_clean":"2023-11-28T11:53:44.861569+0000","last_became_active":"2023-11-28T11:53:40.439844+0000","last_became_peered":"2023-11-28T11:53:40.439844+0000","last_unstale":"2023-11-28T11:53:44.861569+0000","last_undegraded":"2023-11-28T11:53:44.861569+0000","last_fullsized":"2023-11-28T11:53:44.861569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:00.300889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865451+0000","last_change":"2023-11-28T11:53:40.827603+0000","last_active":"2023-11-28T11:53:44.865451+0000","last_peered":"2023-11-28T11:53:44.865451+0000","last_clean":"2023-11-28T11:53:44.865451+0000","last_became_active":"2023-11-28T11:53:40.827305+0000","last_became_peered":"2023-11-28T11:53:40.827305+0000","last_unstale":"2023-11-28T11:53:44.865451+0000","last_undegraded":"2023-11-28T11:53:44.865451+0000","last_fullsized":"2023-11-28T11:53:44.865451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:06.422936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861418+0000","last_change":"2023-11-28T11:53:40.825931+0000","last_active":"2023-11-28T11:53:44.861418+0000","last_peered":"2023-11-28T11:53:44.861418+0000","last_clean":"2023-11-28T11:53:44.861418+0000","last_became_active":"2023-11-28T11:53:40.825661+0000","last_became_peered":"2023-11-28T11:53:40.825661+0000","last_unstale":"2023-11-28T11:53:44.861418+0000","last_undegraded":"2023-11-28T11:53:44.861418+0000","last_fullsized":"2023-11-28T11:53:44.861418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.868397+0000","last_change":"2023-11-28T11:53:40.435820+0000","last_active":"2023-11-28T11:53:44.868397+0000","last_peered":"2023-11-28T11:53:44.868397+0000","last_clean":"2023-11-28T11:53:44.868397+0000","last_became_active":"2023-11-28T11:53:40.435413+0000","last_became_peered":"2023-11-28T11:53:40.435413+0000","last_unstale":"2023-11-28T11:53:44.868397+0000","last_undegraded":"2023-11-28T11:53:44.868397+0000","last_fullsized":"2023-11-28T11:53:44.868397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:39.305975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.882057+0000","last_change":"2023-11-28T11:53:44.878777+0000","last_active":"2023-11-28T11:53:44.882057+0000","last_peered":"2023-11-28T11:53:44.882057+0000","last_clean":"2023-11-28T11:53:44.882057+0000","last_became_active":"2023-11-28T11:53:44.878407+0000","last_became_peered":"2023-11-28T11:53:44.878407+0000","last_unstale":"2023-11-28T11:53:44.882057+0000","last_undegraded":"2023-11-28T11:53:44.882057+0000","last_fullsized":"2023-11-28T11:53:44.882057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:17.214530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862966+0000","last_change":"2023-11-28T11:53:40.831099+0000","last_active":"2023-11-28T11:53:44.862966+0000","last_peered":"2023-11-28T11:53:44.862966+0000","last_clean":"2023-11-28T11:53:44.862966+0000","last_became_active":"2023-11-28T11:53:40.830838+0000","last_became_peered":"2023-11-28T11:53:40.830838+0000","last_unstale":"2023-11-28T11:53:44.862966+0000","last_undegraded":"2023-11-28T11:53:44.862966+0000","last_fullsized":"2023-11-28T11:53:44.862966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:49.919629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.854355+0000","last_change":"2023-11-28T11:53:40.443966+0000","last_active":"2023-11-28T11:53:44.854355+0000","last_peered":"2023-11-28T11:53:44.854355+0000","last_clean":"2023-11-28T11:53:44.854355+0000","last_became_active":"2023-11-28T11:53:40.443553+0000","last_became_peered":"2023-11-28T11:53:40.443553+0000","last_unstale":"2023-11-28T11:53:44.854355+0000","last_undegraded":"2023-11-28T11:53:44.854355+0000","last_fullsized":"2023-11-28T11:53:44.854355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:19.967407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.879723+0000","last_change":"2023-11-28T11:53:44.874157+0000","last_active":"2023-11-28T11:53:44.879723+0000","last_peered":"2023-11-28T11:53:44.879723+0000","last_clean":"2023-11-28T11:53:44.879723+0000","last_became_active":"2023-11-28T11:53:44.873721+0000","last_became_peered":"2023-11-28T11:53:44.873721+0000","last_unstale":"2023-11-28T11:53:44.879723+0000","last_undegraded":"2023-11-28T11:53:44.879723+0000","last_fullsized":"2023-11-28T11:53:44.879723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:38.035586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859711+0000","last_change":"2023-11-28T11:53:40.443961+0000","last_active":"2023-11-28T11:53:44.859711+0000","last_peered":"2023-11-28T11:53:44.859711+0000","last_clean":"2023-11-28T11:53:44.859711+0000","last_became_active":"2023-11-28T11:53:40.443600+0000","last_became_peered":"2023-11-28T11:53:40.443600+0000","last_unstale":"2023-11-28T11:53:44.859711+0000","last_undegraded":"2023-11-28T11:53:44.859711+0000","last_fullsized":"2023-11-28T11:53:44.859711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:05.411499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873244+0000","last_change":"2023-11-28T11:53:40.823833+0000","last_active":"2023-11-28T11:53:44.873244+0000","last_peered":"2023-11-28T11:53:44.873244+0000","last_clean":"2023-11-28T11:53:44.873244+0000","last_became_active":"2023-11-28T11:53:40.823583+0000","last_became_peered":"2023-11-28T11:53:40.823583+0000","last_unstale":"2023-11-28T11:53:44.873244+0000","last_undegraded":"2023-11-28T11:53:44.873244+0000","last_fullsized":"2023-11-28T11:53:44.873244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:18.454529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889155+0000","last_change":"2023-11-28T11:53:44.886943+0000","last_active":"2023-11-28T11:53:44.889155+0000","last_peered":"2023-11-28T11:53:44.889155+0000","last_clean":"2023-11-28T11:53:44.889155+0000","last_became_active":"2023-11-28T11:53:44.884458+0000","last_became_peered":"2023-11-28T11:53:44.884458+0000","last_unstale":"2023-11-28T11:53:44.889155+0000","last_undegraded":"2023-11-28T11:53:44.889155+0000","last_fullsized":"2023-11-28T11:53:44.889155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:09:00.740331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T11:53:49.771859+0000","last_change":"2023-11-28T11:53:40.445841+0000","last_active":"2023-11-28T11:53:49.771859+0000","last_peered":"2023-11-28T11:53:49.771859+0000","last_clean":"2023-11-28T11:53:49.771859+0000","last_became_active":"2023-11-28T11:53:40.445170+0000","last_became_peered":"2023-11-28T11:53:40.445170+0000","last_unstale":"2023-11-28T11:53:49.771859+0000","last_undegraded":"2023-11-28T11:53:49.771859+0000","last_fullsized":"2023-11-28T11:53:49.771859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:39.305975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859738+0000","last_change":"2023-11-28T11:53:40.822601+0000","last_active":"2023-11-28T11:53:44.859738+0000","last_peered":"2023-11-28T11:53:44.859738+0000","last_clean":"2023-11-28T11:53:44.859738+0000","last_became_active":"2023-11-28T11:53:40.822327+0000","last_became_peered":"2023-11-28T11:53:40.822327+0000","last_unstale":"2023-11-28T11:53:44.859738+0000","last_undegraded":"2023-11-28T11:53:44.859738+0000","last_fullsized":"2023-11-28T11:53:44.859738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:06.929054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889658+0000","last_change":"2023-11-28T11:53:44.881520+0000","last_active":"2023-11-28T11:53:44.889658+0000","last_peered":"2023-11-28T11:53:44.889658+0000","last_clean":"2023-11-28T11:53:44.889658+0000","last_became_active":"2023-11-28T11:53:44.881135+0000","last_became_peered":"2023-11-28T11:53:44.881135+0000","last_unstale":"2023-11-28T11:53:44.889658+0000","last_undegraded":"2023-11-28T11:53:44.889658+0000","last_fullsized":"2023-11-28T11:53:44.889658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:27.296993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873318+0000","last_change":"2023-11-28T11:53:40.833933+0000","last_active":"2023-11-28T11:53:44.873318+0000","last_peered":"2023-11-28T11:53:44.873318+0000","last_clean":"2023-11-28T11:53:44.873318+0000","last_became_active":"2023-11-28T11:53:40.833658+0000","last_became_peered":"2023-11-28T11:53:40.833658+0000","last_unstale":"2023-11-28T11:53:44.873318+0000","last_undegraded":"2023-11-28T11:53:44.873318+0000","last_fullsized":"2023-11-28T11:53:44.873318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:57.215796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865519+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:53:44.865519+0000","last_peered":"2023-11-28T11:53:44.865519+0000","last_clean":"2023-11-28T11:53:44.865519+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:53:44.865519+0000","last_undegraded":"2023-11-28T11:53:44.865519+0000","last_fullsized":"2023-11-28T11:53:44.865519+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.855082+0000","last_change":"2023-11-28T11:53:40.441530+0000","last_active":"2023-11-28T11:53:44.855082+0000","last_peered":"2023-11-28T11:53:44.855082+0000","last_clean":"2023-11-28T11:53:44.855082+0000","last_became_active":"2023-11-28T11:53:40.441317+0000","last_became_peered":"2023-11-28T11:53:40.441317+0000","last_unstale":"2023-11-28T11:53:44.855082+0000","last_undegraded":"2023-11-28T11:53:44.855082+0000","last_fullsized":"2023-11-28T11:53:44.855082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:54.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889193+0000","last_change":"2023-11-28T11:53:44.882186+0000","last_active":"2023-11-28T11:53:44.889193+0000","last_peered":"2023-11-28T11:53:44.889193+0000","last_clean":"2023-11-28T11:53:44.889193+0000","last_became_active":"2023-11-28T11:53:44.881794+0000","last_became_peered":"2023-11-28T11:53:44.881794+0000","last_unstale":"2023-11-28T11:53:44.889193+0000","last_undegraded":"2023-11-28T11:53:44.889193+0000","last_fullsized":"2023-11-28T11:53:44.889193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:05.347162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.868559+0000","last_change":"2023-11-28T11:53:40.836155+0000","last_active":"2023-11-28T11:53:44.868559+0000","last_peered":"2023-11-28T11:53:44.868559+0000","last_clean":"2023-11-28T11:53:44.868559+0000","last_became_active":"2023-11-28T11:53:40.834486+0000","last_became_peered":"2023-11-28T11:53:40.834486+0000","last_unstale":"2023-11-28T11:53:44.868559+0000","last_undegraded":"2023-11-28T11:53:44.868559+0000","last_fullsized":"2023-11-28T11:53:44.868559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865189+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:53:44.865189+0000","last_peered":"2023-11-28T11:53:44.865189+0000","last_clean":"2023-11-28T11:53:44.865189+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:53:44.865189+0000","last_undegraded":"2023-11-28T11:53:44.865189+0000","last_fullsized":"2023-11-28T11:53:44.865189+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873207+0000","last_change":"2023-11-28T11:53:40.448611+0000","last_active":"2023-11-28T11:53:44.873207+0000","last_peered":"2023-11-28T11:53:44.873207+0000","last_clean":"2023-11-28T11:53:44.873207+0000","last_became_active":"2023-11-28T11:53:40.445176+0000","last_became_peered":"2023-11-28T11:53:40.445176+0000","last_unstale":"2023-11-28T11:53:44.873207+0000","last_undegraded":"2023-11-28T11:53:44.873207+0000","last_fullsized":"2023-11-28T11:53:44.873207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:16:02.435885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.881976+0000","last_change":"2023-11-28T11:53:44.876201+0000","last_active":"2023-11-28T11:53:44.881976+0000","last_peered":"2023-11-28T11:53:44.881976+0000","last_clean":"2023-11-28T11:53:44.881976+0000","last_became_active":"2023-11-28T11:53:44.875772+0000","last_became_peered":"2023-11-28T11:53:44.875772+0000","last_unstale":"2023-11-28T11:53:44.881976+0000","last_undegraded":"2023-11-28T11:53:44.881976+0000","last_fullsized":"2023-11-28T11:53:44.881976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:45:22.911172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861493+0000","last_change":"2023-11-28T11:53:40.831017+0000","last_active":"2023-11-28T11:53:44.861493+0000","last_peered":"2023-11-28T11:53:44.861493+0000","last_clean":"2023-11-28T11:53:44.861493+0000","last_became_active":"2023-11-28T11:53:40.830653+0000","last_became_peered":"2023-11-28T11:53:40.830653+0000","last_unstale":"2023-11-28T11:53:44.861493+0000","last_undegraded":"2023-11-28T11:53:44.861493+0000","last_fullsized":"2023-11-28T11:53:44.861493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:57.213686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862754+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:53:44.862754+0000","last_peered":"2023-11-28T11:53:44.862754+0000","last_clean":"2023-11-28T11:53:44.862754+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:53:44.862754+0000","last_undegraded":"2023-11-28T11:53:44.862754+0000","last_fullsized":"2023-11-28T11:53:44.862754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.877834+0000","last_change":"2023-11-28T11:53:40.444866+0000","last_active":"2023-11-28T11:53:44.877834+0000","last_peered":"2023-11-28T11:53:44.877834+0000","last_clean":"2023-11-28T11:53:44.877834+0000","last_became_active":"2023-11-28T11:53:40.444600+0000","last_became_peered":"2023-11-28T11:53:40.444600+0000","last_unstale":"2023-11-28T11:53:44.877834+0000","last_undegraded":"2023-11-28T11:53:44.877834+0000","last_fullsized":"2023-11-28T11:53:44.877834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:54.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.881029+0000","last_change":"2023-11-28T11:53:44.877188+0000","last_active":"2023-11-28T11:53:44.881029+0000","last_peered":"2023-11-28T11:53:44.881029+0000","last_clean":"2023-11-28T11:53:44.881029+0000","last_became_active":"2023-11-28T11:53:44.876752+0000","last_became_peered":"2023-11-28T11:53:44.876752+0000","last_unstale":"2023-11-28T11:53:44.881029+0000","last_undegraded":"2023-11-28T11:53:44.881029+0000","last_fullsized":"2023-11-28T11:53:44.881029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:49.906382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860156+0000","last_change":"2023-11-28T11:53:40.832575+0000","last_active":"2023-11-28T11:53:44.860156+0000","last_peered":"2023-11-28T11:53:44.860156+0000","last_clean":"2023-11-28T11:53:44.860156+0000","last_became_active":"2023-11-28T11:53:40.832265+0000","last_became_peered":"2023-11-28T11:53:40.832265+0000","last_unstale":"2023-11-28T11:53:44.860156+0000","last_undegraded":"2023-11-28T11:53:44.860156+0000","last_fullsized":"2023-11-28T11:53:44.860156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:27:28.269321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863573+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:53:44.863573+0000","last_peered":"2023-11-28T11:53:44.863573+0000","last_clean":"2023-11-28T11:53:44.863573+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:53:44.863573+0000","last_undegraded":"2023-11-28T11:53:44.863573+0000","last_fullsized":"2023-11-28T11:53:44.863573+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T11:53:45.370919+0000","last_change":"2023-11-28T11:53:40.450301+0000","last_active":"2023-11-28T11:53:45.370919+0000","last_peered":"2023-11-28T11:53:45.370919+0000","last_clean":"2023-11-28T11:53:45.370919+0000","last_became_active":"2023-11-28T11:53:40.450014+0000","last_became_peered":"2023-11-28T11:53:40.450014+0000","last_unstale":"2023-11-28T11:53:45.370919+0000","last_undegraded":"2023-11-28T11:53:45.370919+0000","last_fullsized":"2023-11-28T11:53:45.370919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:57.826127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.883889+0000","last_change":"2023-11-28T11:53:44.880249+0000","last_active":"2023-11-28T11:53:44.883889+0000","last_peered":"2023-11-28T11:53:44.883889+0000","last_clean":"2023-11-28T11:53:44.883889+0000","last_became_active":"2023-11-28T11:53:44.879807+0000","last_became_peered":"2023-11-28T11:53:44.879807+0000","last_unstale":"2023-11-28T11:53:44.883889+0000","last_undegraded":"2023-11-28T11:53:44.883889+0000","last_fullsized":"2023-11-28T11:53:44.883889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:24:18.219732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867353+0000","last_change":"2023-11-28T11:53:40.822809+0000","last_active":"2023-11-28T11:53:44.867353+0000","last_peered":"2023-11-28T11:53:44.867353+0000","last_clean":"2023-11-28T11:53:44.867353+0000","last_became_active":"2023-11-28T11:53:40.822525+0000","last_became_peered":"2023-11-28T11:53:40.822525+0000","last_unstale":"2023-11-28T11:53:44.867353+0000","last_undegraded":"2023-11-28T11:53:44.867353+0000","last_fullsized":"2023-11-28T11:53:44.867353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:33.728842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863783+0000","last_change":"2023-11-28T11:53:40.447043+0000","last_active":"2023-11-28T11:53:44.863783+0000","last_peered":"2023-11-28T11:53:44.863783+0000","last_clean":"2023-11-28T11:53:44.863783+0000","last_became_active":"2023-11-28T11:53:40.446655+0000","last_became_peered":"2023-11-28T11:53:40.446655+0000","last_unstale":"2023-11-28T11:53:44.863783+0000","last_undegraded":"2023-11-28T11:53:44.863783+0000","last_fullsized":"2023-11-28T11:53:44.863783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:16:02.435885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.858559+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:53:44.858559+0000","last_peered":"2023-11-28T11:53:44.858559+0000","last_clean":"2023-11-28T11:53:44.858559+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:53:44.858559+0000","last_undegraded":"2023-11-28T11:53:44.858559+0000","last_fullsized":"2023-11-28T11:53:44.858559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873069+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:53:44.873069+0000","last_peered":"2023-11-28T11:53:44.873069+0000","last_clean":"2023-11-28T11:53:44.873069+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:53:44.873069+0000","last_undegraded":"2023-11-28T11:53:44.873069+0000","last_fullsized":"2023-11-28T11:53:44.873069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.881432+0000","last_change":"2023-11-28T11:53:44.877382+0000","last_active":"2023-11-28T11:53:44.881432+0000","last_peered":"2023-11-28T11:53:44.881432+0000","last_clean":"2023-11-28T11:53:44.881432+0000","last_became_active":"2023-11-28T11:53:44.876993+0000","last_became_peered":"2023-11-28T11:53:44.876993+0000","last_unstale":"2023-11-28T11:53:44.881432+0000","last_undegraded":"2023-11-28T11:53:44.881432+0000","last_fullsized":"2023-11-28T11:53:44.881432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:54:59.674019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.876641+0000","last_change":"2023-11-28T11:53:40.829307+0000","last_active":"2023-11-28T11:53:44.876641+0000","last_peered":"2023-11-28T11:53:44.876641+0000","last_clean":"2023-11-28T11:53:44.876641+0000","last_became_active":"2023-11-28T11:53:40.828558+0000","last_became_peered":"2023-11-28T11:53:40.828558+0000","last_unstale":"2023-11-28T11:53:44.876641+0000","last_undegraded":"2023-11-28T11:53:44.876641+0000","last_fullsized":"2023-11-28T11:53:44.876641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:03:21.599961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.871461+0000","last_change":"2023-11-28T11:53:40.446066+0000","last_active":"2023-11-28T11:53:44.871461+0000","last_peered":"2023-11-28T11:53:44.871461+0000","last_clean":"2023-11-28T11:53:44.871461+0000","last_became_active":"2023-11-28T11:53:40.445774+0000","last_became_peered":"2023-11-28T11:53:40.445774+0000","last_unstale":"2023-11-28T11:53:44.871461+0000","last_undegraded":"2023-11-28T11:53:44.871461+0000","last_fullsized":"2023-11-28T11:53:44.871461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:58:24.917085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861363+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:53:44.861363+0000","last_peered":"2023-11-28T11:53:44.861363+0000","last_clean":"2023-11-28T11:53:44.861363+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:53:44.861363+0000","last_undegraded":"2023-11-28T11:53:44.861363+0000","last_fullsized":"2023-11-28T11:53:44.861363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.888435+0000","last_change":"2023-11-28T11:53:44.881392+0000","last_active":"2023-11-28T11:53:44.888435+0000","last_peered":"2023-11-28T11:53:44.888435+0000","last_clean":"2023-11-28T11:53:44.888435+0000","last_became_active":"2023-11-28T11:53:44.880999+0000","last_became_peered":"2023-11-28T11:53:44.880999+0000","last_unstale":"2023-11-28T11:53:44.888435+0000","last_undegraded":"2023-11-28T11:53:44.888435+0000","last_fullsized":"2023-11-28T11:53:44.888435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:10.350062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873131+0000","last_change":"2023-11-28T11:53:40.829883+0000","last_active":"2023-11-28T11:53:44.873131+0000","last_peered":"2023-11-28T11:53:44.873131+0000","last_clean":"2023-11-28T11:53:44.873131+0000","last_became_active":"2023-11-28T11:53:40.828918+0000","last_became_peered":"2023-11-28T11:53:40.828918+0000","last_unstale":"2023-11-28T11:53:44.873131+0000","last_undegraded":"2023-11-28T11:53:44.873131+0000","last_fullsized":"2023-11-28T11:53:44.873131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:53.307980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859888+0000","last_change":"2023-11-28T11:53:40.444678+0000","last_active":"2023-11-28T11:53:44.859888+0000","last_peered":"2023-11-28T11:53:44.859888+0000","last_clean":"2023-11-28T11:53:44.859888+0000","last_became_active":"2023-11-28T11:53:40.444330+0000","last_became_peered":"2023-11-28T11:53:40.444330+0000","last_unstale":"2023-11-28T11:53:44.859888+0000","last_undegraded":"2023-11-28T11:53:44.859888+0000","last_fullsized":"2023-11-28T11:53:44.859888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:54.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852107+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:53:44.852107+0000","last_peered":"2023-11-28T11:53:44.852107+0000","last_clean":"2023-11-28T11:53:44.852107+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:53:44.852107+0000","last_undegraded":"2023-11-28T11:53:44.852107+0000","last_fullsized":"2023-11-28T11:53:44.852107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.887490+0000","last_change":"2023-11-28T11:53:44.879815+0000","last_active":"2023-11-28T11:53:44.887490+0000","last_peered":"2023-11-28T11:53:44.887490+0000","last_clean":"2023-11-28T11:53:44.887490+0000","last_became_active":"2023-11-28T11:53:44.879231+0000","last_became_peered":"2023-11-28T11:53:44.879231+0000","last_unstale":"2023-11-28T11:53:44.887490+0000","last_undegraded":"2023-11-28T11:53:44.887490+0000","last_fullsized":"2023-11-28T11:53:44.887490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:29.010118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865882+0000","last_change":"2023-11-28T11:53:40.825293+0000","last_active":"2023-11-28T11:53:44.865882+0000","last_peered":"2023-11-28T11:53:44.865882+0000","last_clean":"2023-11-28T11:53:44.865882+0000","last_became_active":"2023-11-28T11:53:40.824947+0000","last_became_peered":"2023-11-28T11:53:40.824947+0000","last_unstale":"2023-11-28T11:53:44.865882+0000","last_undegraded":"2023-11-28T11:53:44.865882+0000","last_fullsized":"2023-11-28T11:53:44.865882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:57.215796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862236+0000","last_change":"2023-11-28T11:53:40.442915+0000","last_active":"2023-11-28T11:53:44.862236+0000","last_peered":"2023-11-28T11:53:44.862236+0000","last_clean":"2023-11-28T11:53:44.862236+0000","last_became_active":"2023-11-28T11:53:40.442616+0000","last_became_peered":"2023-11-28T11:53:40.442616+0000","last_unstale":"2023-11-28T11:53:44.862236+0000","last_undegraded":"2023-11-28T11:53:44.862236+0000","last_fullsized":"2023-11-28T11:53:44.862236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:41.874385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.858675+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:53:44.858675+0000","last_peered":"2023-11-28T11:53:44.858675+0000","last_clean":"2023-11-28T11:53:44.858675+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:53:44.858675+0000","last_undegraded":"2023-11-28T11:53:44.858675+0000","last_fullsized":"2023-11-28T11:53:44.858675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.886370+0000","last_change":"2023-11-28T11:53:44.883518+0000","last_active":"2023-11-28T11:53:44.886370+0000","last_peered":"2023-11-28T11:53:44.886370+0000","last_clean":"2023-11-28T11:53:44.886370+0000","last_became_active":"2023-11-28T11:53:44.880294+0000","last_became_peered":"2023-11-28T11:53:44.880294+0000","last_unstale":"2023-11-28T11:53:44.886370+0000","last_undegraded":"2023-11-28T11:53:44.886370+0000","last_fullsized":"2023-11-28T11:53:44.886370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:18.531528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.876596+0000","last_change":"2023-11-28T11:53:40.823797+0000","last_active":"2023-11-28T11:53:44.876596+0000","last_peered":"2023-11-28T11:53:44.876596+0000","last_clean":"2023-11-28T11:53:44.876596+0000","last_became_active":"2023-11-28T11:53:40.823514+0000","last_became_peered":"2023-11-28T11:53:40.823514+0000","last_unstale":"2023-11-28T11:53:44.876596+0000","last_undegraded":"2023-11-28T11:53:44.876596+0000","last_fullsized":"2023-11-28T11:53:44.876596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861642+0000","last_change":"2023-11-28T11:53:40.450607+0000","last_active":"2023-11-28T11:53:44.861642+0000","last_peered":"2023-11-28T11:53:44.861642+0000","last_clean":"2023-11-28T11:53:44.861642+0000","last_became_active":"2023-11-28T11:53:40.450324+0000","last_became_peered":"2023-11-28T11:53:40.450324+0000","last_unstale":"2023-11-28T11:53:44.861642+0000","last_undegraded":"2023-11-28T11:53:44.861642+0000","last_fullsized":"2023-11-28T11:53:44.861642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:17.443093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.872261+0000","last_change":"2023-11-28T11:53:44.868741+0000","last_active":"2023-11-28T11:53:44.872261+0000","last_peered":"2023-11-28T11:53:44.872261+0000","last_clean":"2023-11-28T11:53:44.872261+0000","last_became_active":"2023-11-28T11:53:44.868320+0000","last_became_peered":"2023-11-28T11:53:44.868320+0000","last_unstale":"2023-11-28T11:53:44.872261+0000","last_undegraded":"2023-11-28T11:53:44.872261+0000","last_fullsized":"2023-11-28T11:53:44.872261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:54:58.724369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862814+0000","last_change":"2023-11-28T11:53:40.823419+0000","last_active":"2023-11-28T11:53:44.862814+0000","last_peered":"2023-11-28T11:53:44.862814+0000","last_clean":"2023-11-28T11:53:44.862814+0000","last_became_active":"2023-11-28T11:53:40.821588+0000","last_became_peered":"2023-11-28T11:53:40.821588+0000","last_unstale":"2023-11-28T11:53:44.862814+0000","last_undegraded":"2023-11-28T11:53:44.862814+0000","last_fullsized":"2023-11-28T11:53:44.862814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:13.793522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862499+0000","last_change":"2023-11-28T11:53:40.448234+0000","last_active":"2023-11-28T11:53:44.862499+0000","last_peered":"2023-11-28T11:53:44.862499+0000","last_clean":"2023-11-28T11:53:44.862499+0000","last_became_active":"2023-11-28T11:53:40.447793+0000","last_became_peered":"2023-11-28T11:53:40.447793+0000","last_unstale":"2023-11-28T11:53:44.862499+0000","last_undegraded":"2023-11-28T11:53:44.862499+0000","last_fullsized":"2023-11-28T11:53:44.862499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:57.826127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.871780+0000","last_change":"2023-11-28T11:53:44.868480+0000","last_active":"2023-11-28T11:53:44.871780+0000","last_peered":"2023-11-28T11:53:44.871780+0000","last_clean":"2023-11-28T11:53:44.871780+0000","last_became_active":"2023-11-28T11:53:44.868051+0000","last_became_peered":"2023-11-28T11:53:44.868051+0000","last_unstale":"2023-11-28T11:53:44.871780+0000","last_undegraded":"2023-11-28T11:53:44.871780+0000","last_fullsized":"2023-11-28T11:53:44.871780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:45:35.342963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862591+0000","last_change":"2023-11-28T11:53:40.826870+0000","last_active":"2023-11-28T11:53:44.862591+0000","last_peered":"2023-11-28T11:53:44.862591+0000","last_clean":"2023-11-28T11:53:44.862591+0000","last_became_active":"2023-11-28T11:53:40.826561+0000","last_became_peered":"2023-11-28T11:53:40.826561+0000","last_unstale":"2023-11-28T11:53:44.862591+0000","last_undegraded":"2023-11-28T11:53:44.862591+0000","last_fullsized":"2023-11-28T11:53:44.862591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:24:13.706573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865183+0000","last_change":"2023-11-28T11:53:40.450118+0000","last_active":"2023-11-28T11:53:44.865183+0000","last_peered":"2023-11-28T11:53:44.865183+0000","last_clean":"2023-11-28T11:53:44.865183+0000","last_became_active":"2023-11-28T11:53:40.449740+0000","last_became_peered":"2023-11-28T11:53:40.449740+0000","last_unstale":"2023-11-28T11:53:44.865183+0000","last_undegraded":"2023-11-28T11:53:44.865183+0000","last_fullsized":"2023-11-28T11:53:44.865183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:16:02.435885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889470+0000","last_change":"2023-11-28T11:53:44.880051+0000","last_active":"2023-11-28T11:53:44.889470+0000","last_peered":"2023-11-28T11:53:44.889470+0000","last_clean":"2023-11-28T11:53:44.889470+0000","last_became_active":"2023-11-28T11:53:44.879656+0000","last_became_peered":"2023-11-28T11:53:44.879656+0000","last_unstale":"2023-11-28T11:53:44.889470+0000","last_undegraded":"2023-11-28T11:53:44.889470+0000","last_fullsized":"2023-11-28T11:53:44.889470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:21:48.435615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859774+0000","last_change":"2023-11-28T11:53:40.822906+0000","last_active":"2023-11-28T11:53:44.859774+0000","last_peered":"2023-11-28T11:53:44.859774+0000","last_clean":"2023-11-28T11:53:44.859774+0000","last_became_active":"2023-11-28T11:53:40.822629+0000","last_became_peered":"2023-11-28T11:53:40.822629+0000","last_unstale":"2023-11-28T11:53:44.859774+0000","last_undegraded":"2023-11-28T11:53:44.859774+0000","last_fullsized":"2023-11-28T11:53:44.859774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:34.614578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862074+0000","last_change":"2023-11-28T11:53:40.441500+0000","last_active":"2023-11-28T11:53:44.862074+0000","last_peered":"2023-11-28T11:53:44.862074+0000","last_clean":"2023-11-28T11:53:44.862074+0000","last_became_active":"2023-11-28T11:53:40.441158+0000","last_became_peered":"2023-11-28T11:53:40.441158+0000","last_unstale":"2023-11-28T11:53:44.862074+0000","last_undegraded":"2023-11-28T11:53:44.862074+0000","last_fullsized":"2023-11-28T11:53:44.862074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:19.967407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873877+0000","last_change":"2023-11-28T11:53:44.872014+0000","last_active":"2023-11-28T11:53:44.873877+0000","last_peered":"2023-11-28T11:53:44.873877+0000","last_clean":"2023-11-28T11:53:44.873877+0000","last_became_active":"2023-11-28T11:53:44.871605+0000","last_became_peered":"2023-11-28T11:53:44.871605+0000","last_unstale":"2023-11-28T11:53:44.873877+0000","last_undegraded":"2023-11-28T11:53:44.873877+0000","last_fullsized":"2023-11-28T11:53:44.873877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:45:22.911172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.868467+0000","last_change":"2023-11-28T11:53:40.822940+0000","last_active":"2023-11-28T11:53:44.868467+0000","last_peered":"2023-11-28T11:53:44.868467+0000","last_clean":"2023-11-28T11:53:44.868467+0000","last_became_active":"2023-11-28T11:53:40.822043+0000","last_became_peered":"2023-11-28T11:53:40.822043+0000","last_unstale":"2023-11-28T11:53:44.868467+0000","last_undegraded":"2023-11-28T11:53:44.868467+0000","last_fullsized":"2023-11-28T11:53:44.868467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:57.213686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.851830+0000","last_change":"2023-11-28T11:53:40.443907+0000","last_active":"2023-11-28T11:53:44.851830+0000","last_peered":"2023-11-28T11:53:44.851830+0000","last_clean":"2023-11-28T11:53:44.851830+0000","last_became_active":"2023-11-28T11:53:40.443561+0000","last_became_peered":"2023-11-28T11:53:40.443561+0000","last_unstale":"2023-11-28T11:53:44.851830+0000","last_undegraded":"2023-11-28T11:53:44.851830+0000","last_fullsized":"2023-11-28T11:53:44.851830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:00.300889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.886453+0000","last_change":"2023-11-28T11:53:44.878401+0000","last_active":"2023-11-28T11:53:44.886453+0000","last_peered":"2023-11-28T11:53:44.886453+0000","last_clean":"2023-11-28T11:53:44.886453+0000","last_became_active":"2023-11-28T11:53:44.877984+0000","last_became_peered":"2023-11-28T11:53:44.877984+0000","last_unstale":"2023-11-28T11:53:44.886453+0000","last_undegraded":"2023-11-28T11:53:44.886453+0000","last_fullsized":"2023-11-28T11:53:44.886453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:41.510014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865016+0000","last_change":"2023-11-28T11:53:40.828665+0000","last_active":"2023-11-28T11:53:44.865016+0000","last_peered":"2023-11-28T11:53:44.865016+0000","last_clean":"2023-11-28T11:53:44.865016+0000","last_became_active":"2023-11-28T11:53:40.828391+0000","last_became_peered":"2023-11-28T11:53:40.828391+0000","last_unstale":"2023-11-28T11:53:44.865016+0000","last_undegraded":"2023-11-28T11:53:44.865016+0000","last_fullsized":"2023-11-28T11:53:44.865016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:26:32.332628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859809+0000","last_change":"2023-11-28T11:53:40.443223+0000","last_active":"2023-11-28T11:53:44.859809+0000","last_peered":"2023-11-28T11:53:44.859809+0000","last_clean":"2023-11-28T11:53:44.859809+0000","last_became_active":"2023-11-28T11:53:40.442898+0000","last_became_peered":"2023-11-28T11:53:40.442898+0000","last_unstale":"2023-11-28T11:53:44.859809+0000","last_undegraded":"2023-11-28T11:53:44.859809+0000","last_fullsized":"2023-11-28T11:53:44.859809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:55.478609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.872465+0000","last_change":"2023-11-28T11:53:44.870670+0000","last_active":"2023-11-28T11:53:44.872465+0000","last_peered":"2023-11-28T11:53:44.872465+0000","last_clean":"2023-11-28T11:53:44.872465+0000","last_became_active":"2023-11-28T11:53:44.870011+0000","last_became_peered":"2023-11-28T11:53:44.870011+0000","last_unstale":"2023-11-28T11:53:44.872465+0000","last_undegraded":"2023-11-28T11:53:44.872465+0000","last_fullsized":"2023-11-28T11:53:44.872465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:17.214530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859908+0000","last_change":"2023-11-28T11:53:40.816472+0000","last_active":"2023-11-28T11:53:44.859908+0000","last_peered":"2023-11-28T11:53:44.859908+0000","last_clean":"2023-11-28T11:53:44.859908+0000","last_became_active":"2023-11-28T11:53:40.816159+0000","last_became_peered":"2023-11-28T11:53:40.816159+0000","last_unstale":"2023-11-28T11:53:44.859908+0000","last_undegraded":"2023-11-28T11:53:44.859908+0000","last_fullsized":"2023-11-28T11:53:44.859908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:38.089006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.869315+0000","last_change":"2023-11-28T11:53:40.450339+0000","last_active":"2023-11-28T11:53:44.869315+0000","last_peered":"2023-11-28T11:53:44.869315+0000","last_clean":"2023-11-28T11:53:44.869315+0000","last_became_active":"2023-11-28T11:53:40.450046+0000","last_became_peered":"2023-11-28T11:53:40.450046+0000","last_unstale":"2023-11-28T11:53:44.869315+0000","last_undegraded":"2023-11-28T11:53:44.869315+0000","last_fullsized":"2023-11-28T11:53:44.869315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:17.443093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.888530+0000","last_change":"2023-11-28T11:53:44.882874+0000","last_active":"2023-11-28T11:53:44.888530+0000","last_peered":"2023-11-28T11:53:44.888530+0000","last_clean":"2023-11-28T11:53:44.888530+0000","last_became_active":"2023-11-28T11:53:44.882175+0000","last_became_peered":"2023-11-28T11:53:44.882175+0000","last_unstale":"2023-11-28T11:53:44.888530+0000","last_undegraded":"2023-11-28T11:53:44.888530+0000","last_fullsized":"2023-11-28T11:53:44.888530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:53.340638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.851850+0000","last_change":"2023-11-28T11:53:40.826543+0000","last_active":"2023-11-28T11:53:44.851850+0000","last_peered":"2023-11-28T11:53:44.851850+0000","last_clean":"2023-11-28T11:53:44.851850+0000","last_became_active":"2023-11-28T11:53:40.826182+0000","last_became_peered":"2023-11-28T11:53:40.826182+0000","last_unstale":"2023-11-28T11:53:44.851850+0000","last_undegraded":"2023-11-28T11:53:44.851850+0000","last_fullsized":"2023-11-28T11:53:44.851850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:03:21.599961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.869691+0000","last_change":"2023-11-28T11:53:40.450402+0000","last_active":"2023-11-28T11:53:44.869691+0000","last_peered":"2023-11-28T11:53:44.869691+0000","last_clean":"2023-11-28T11:53:44.869691+0000","last_became_active":"2023-11-28T11:53:40.450094+0000","last_became_peered":"2023-11-28T11:53:40.450094+0000","last_unstale":"2023-11-28T11:53:44.869691+0000","last_undegraded":"2023-11-28T11:53:44.869691+0000","last_fullsized":"2023-11-28T11:53:44.869691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:35:19.888846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.886156+0000","last_change":"2023-11-28T11:53:44.882776+0000","last_active":"2023-11-28T11:53:44.886156+0000","last_peered":"2023-11-28T11:53:44.886156+0000","last_clean":"2023-11-28T11:53:44.886156+0000","last_became_active":"2023-11-28T11:53:44.880222+0000","last_became_peered":"2023-11-28T11:53:44.880222+0000","last_unstale":"2023-11-28T11:53:44.886156+0000","last_undegraded":"2023-11-28T11:53:44.886156+0000","last_fullsized":"2023-11-28T11:53:44.886156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:05.347162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.882471+0000","last_change":"2023-11-28T11:53:44.879327+0000","last_active":"2023-11-28T11:53:44.882471+0000","last_peered":"2023-11-28T11:53:44.882471+0000","last_clean":"2023-11-28T11:53:44.882471+0000","last_became_active":"2023-11-28T11:53:44.878937+0000","last_became_peered":"2023-11-28T11:53:44.878937+0000","last_unstale":"2023-11-28T11:53:44.882471+0000","last_undegraded":"2023-11-28T11:53:44.882471+0000","last_fullsized":"2023-11-28T11:53:44.882471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:37.024091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.864801+0000","last_change":"2023-11-28T11:53:40.437606+0000","last_active":"2023-11-28T11:53:44.864801+0000","last_peered":"2023-11-28T11:53:44.864801+0000","last_clean":"2023-11-28T11:53:44.864801+0000","last_became_active":"2023-11-28T11:53:40.436841+0000","last_became_peered":"2023-11-28T11:53:40.436841+0000","last_unstale":"2023-11-28T11:53:44.864801+0000","last_undegraded":"2023-11-28T11:53:44.864801+0000","last_fullsized":"2023-11-28T11:53:44.864801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:57.826127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.877919+0000","last_change":"2023-11-28T11:53:40.830708+0000","last_active":"2023-11-28T11:53:44.877919+0000","last_peered":"2023-11-28T11:53:44.877919+0000","last_clean":"2023-11-28T11:53:44.877919+0000","last_became_active":"2023-11-28T11:53:40.830408+0000","last_became_peered":"2023-11-28T11:53:40.830408+0000","last_unstale":"2023-11-28T11:53:44.877919+0000","last_undegraded":"2023-11-28T11:53:44.877919+0000","last_fullsized":"2023-11-28T11:53:44.877919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:03.251004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889061+0000","last_change":"2023-11-28T11:53:44.883220+0000","last_active":"2023-11-28T11:53:44.889061+0000","last_peered":"2023-11-28T11:53:44.889061+0000","last_clean":"2023-11-28T11:53:44.889061+0000","last_became_active":"2023-11-28T11:53:44.881046+0000","last_became_peered":"2023-11-28T11:53:44.881046+0000","last_unstale":"2023-11-28T11:53:44.889061+0000","last_undegraded":"2023-11-28T11:53:44.889061+0000","last_fullsized":"2023-11-28T11:53:44.889061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:54:59.674019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861290+0000","last_change":"2023-11-28T11:53:40.451361+0000","last_active":"2023-11-28T11:53:44.861290+0000","last_peered":"2023-11-28T11:53:44.861290+0000","last_clean":"2023-11-28T11:53:44.861290+0000","last_became_active":"2023-11-28T11:53:40.451055+0000","last_became_peered":"2023-11-28T11:53:40.451055+0000","last_unstale":"2023-11-28T11:53:44.861290+0000","last_undegraded":"2023-11-28T11:53:44.861290+0000","last_fullsized":"2023-11-28T11:53:44.861290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:00.300889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867430+0000","last_change":"2023-11-28T11:53:40.832925+0000","last_active":"2023-11-28T11:53:44.867430+0000","last_peered":"2023-11-28T11:53:44.867430+0000","last_clean":"2023-11-28T11:53:44.867430+0000","last_became_active":"2023-11-28T11:53:40.824344+0000","last_became_peered":"2023-11-28T11:53:40.824344+0000","last_unstale":"2023-11-28T11:53:44.867430+0000","last_undegraded":"2023-11-28T11:53:44.867430+0000","last_fullsized":"2023-11-28T11:53:44.867430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:07:13.206788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862637+0000","last_change":"2023-11-28T11:53:40.444858+0000","last_active":"2023-11-28T11:53:44.862637+0000","last_peered":"2023-11-28T11:53:44.862637+0000","last_clean":"2023-11-28T11:53:44.862637+0000","last_became_active":"2023-11-28T11:53:40.444494+0000","last_became_peered":"2023-11-28T11:53:40.444494+0000","last_unstale":"2023-11-28T11:53:44.862637+0000","last_undegraded":"2023-11-28T11:53:44.862637+0000","last_fullsized":"2023-11-28T11:53:44.862637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:41.874385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.854924+0000","last_change":"2023-11-28T11:53:40.826741+0000","last_active":"2023-11-28T11:53:44.854924+0000","last_peered":"2023-11-28T11:53:44.854924+0000","last_clean":"2023-11-28T11:53:44.854924+0000","last_became_active":"2023-11-28T11:53:40.826438+0000","last_became_peered":"2023-11-28T11:53:40.826438+0000","last_unstale":"2023-11-28T11:53:44.854924+0000","last_undegraded":"2023-11-28T11:53:44.854924+0000","last_fullsized":"2023-11-28T11:53:44.854924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.887781+0000","last_change":"2023-11-28T11:53:44.881841+0000","last_active":"2023-11-28T11:53:44.887781+0000","last_peered":"2023-11-28T11:53:44.887781+0000","last_clean":"2023-11-28T11:53:44.887781+0000","last_became_active":"2023-11-28T11:53:44.880886+0000","last_became_peered":"2023-11-28T11:53:44.880886+0000","last_unstale":"2023-11-28T11:53:44.887781+0000","last_undegraded":"2023-11-28T11:53:44.887781+0000","last_fullsized":"2023-11-28T11:53:44.887781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:09:31.123351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861943+0000","last_change":"2023-11-28T11:53:40.450777+0000","last_active":"2023-11-28T11:53:44.861943+0000","last_peered":"2023-11-28T11:53:44.861943+0000","last_clean":"2023-11-28T11:53:44.861943+0000","last_became_active":"2023-11-28T11:53:40.449763+0000","last_became_peered":"2023-11-28T11:53:40.449763+0000","last_unstale":"2023-11-28T11:53:44.861943+0000","last_undegraded":"2023-11-28T11:53:44.861943+0000","last_fullsized":"2023-11-28T11:53:44.861943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:19.967407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863452+0000","last_change":"2023-11-28T11:53:40.826209+0000","last_active":"2023-11-28T11:53:44.863452+0000","last_peered":"2023-11-28T11:53:44.863452+0000","last_clean":"2023-11-28T11:53:44.863452+0000","last_became_active":"2023-11-28T11:53:40.825734+0000","last_became_peered":"2023-11-28T11:53:40.825734+0000","last_unstale":"2023-11-28T11:53:44.863452+0000","last_undegraded":"2023-11-28T11:53:44.863452+0000","last_fullsized":"2023-11-28T11:53:44.863452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:06.929054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.881708+0000","last_change":"2023-11-28T11:53:44.877701+0000","last_active":"2023-11-28T11:53:44.881708+0000","last_peered":"2023-11-28T11:53:44.881708+0000","last_clean":"2023-11-28T11:53:44.881708+0000","last_became_active":"2023-11-28T11:53:44.877282+0000","last_became_peered":"2023-11-28T11:53:44.877282+0000","last_unstale":"2023-11-28T11:53:44.881708+0000","last_undegraded":"2023-11-28T11:53:44.881708+0000","last_fullsized":"2023-11-28T11:53:44.881708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:31.365757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.864694+0000","last_change":"2023-11-28T11:53:40.828450+0000","last_active":"2023-11-28T11:53:44.864694+0000","last_peered":"2023-11-28T11:53:44.864694+0000","last_clean":"2023-11-28T11:53:44.864694+0000","last_became_active":"2023-11-28T11:53:40.828013+0000","last_became_peered":"2023-11-28T11:53:40.828013+0000","last_unstale":"2023-11-28T11:53:44.864694+0000","last_undegraded":"2023-11-28T11:53:44.864694+0000","last_fullsized":"2023-11-28T11:53:44.864694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:56.490046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.875831+0000","last_change":"2023-11-28T11:53:40.830008+0000","last_active":"2023-11-28T11:53:44.875831+0000","last_peered":"2023-11-28T11:53:44.875831+0000","last_clean":"2023-11-28T11:53:44.875831+0000","last_became_active":"2023-11-28T11:53:40.829403+0000","last_became_peered":"2023-11-28T11:53:40.829403+0000","last_unstale":"2023-11-28T11:53:44.875831+0000","last_undegraded":"2023-11-28T11:53:44.875831+0000","last_fullsized":"2023-11-28T11:53:44.875831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:33.728842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860063+0000","last_change":"2023-11-28T11:53:40.822203+0000","last_active":"2023-11-28T11:53:44.860063+0000","last_peered":"2023-11-28T11:53:44.860063+0000","last_clean":"2023-11-28T11:53:44.860063+0000","last_became_active":"2023-11-28T11:53:40.821925+0000","last_became_peered":"2023-11-28T11:53:40.821925+0000","last_unstale":"2023-11-28T11:53:44.860063+0000","last_undegraded":"2023-11-28T11:53:44.860063+0000","last_fullsized":"2023-11-28T11:53:44.860063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:21:45.014606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861940+0000","last_change":"2023-11-28T11:53:40.831266+0000","last_active":"2023-11-28T11:53:44.861940+0000","last_peered":"2023-11-28T11:53:44.861940+0000","last_clean":"2023-11-28T11:53:44.861940+0000","last_became_active":"2023-11-28T11:53:40.830547+0000","last_became_peered":"2023-11-28T11:53:40.830547+0000","last_unstale":"2023-11-28T11:53:44.861940+0000","last_undegraded":"2023-11-28T11:53:44.861940+0000","last_fullsized":"2023-11-28T11:53:44.861940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:51.196033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873045+0000","last_change":"2023-11-28T11:53:40.820563+0000","last_active":"2023-11-28T11:53:44.873045+0000","last_peered":"2023-11-28T11:53:44.873045+0000","last_clean":"2023-11-28T11:53:44.873045+0000","last_became_active":"2023-11-28T11:53:40.820312+0000","last_became_peered":"2023-11-28T11:53:40.820312+0000","last_unstale":"2023-11-28T11:53:44.873045+0000","last_undegraded":"2023-11-28T11:53:44.873045+0000","last_fullsized":"2023-11-28T11:53:44.873045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:53:09.778935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.854790+0000","last_change":"2023-11-28T11:53:40.831601+0000","last_active":"2023-11-28T11:53:44.854790+0000","last_peered":"2023-11-28T11:53:44.854790+0000","last_clean":"2023-11-28T11:53:44.854790+0000","last_became_active":"2023-11-28T11:53:40.831307+0000","last_became_peered":"2023-11-28T11:53:40.831307+0000","last_unstale":"2023-11-28T11:53:44.854790+0000","last_undegraded":"2023-11-28T11:53:44.854790+0000","last_fullsized":"2023-11-28T11:53:44.854790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:58.623372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.876637+0000","last_change":"2023-11-28T11:53:40.829422+0000","last_active":"2023-11-28T11:53:44.876637+0000","last_peered":"2023-11-28T11:53:44.876637+0000","last_clean":"2023-11-28T11:53:44.876637+0000","last_became_active":"2023-11-28T11:53:40.829178+0000","last_became_peered":"2023-11-28T11:53:40.829178+0000","last_unstale":"2023-11-28T11:53:44.876637+0000","last_undegraded":"2023-11-28T11:53:44.876637+0000","last_fullsized":"2023-11-28T11:53:44.876637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:58.623372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.876529+0000","last_change":"2023-11-28T11:53:40.826723+0000","last_active":"2023-11-28T11:53:44.876529+0000","last_peered":"2023-11-28T11:53:44.876529+0000","last_clean":"2023-11-28T11:53:44.876529+0000","last_became_active":"2023-11-28T11:53:40.826291+0000","last_became_peered":"2023-11-28T11:53:40.826291+0000","last_unstale":"2023-11-28T11:53:44.876529+0000","last_undegraded":"2023-11-28T11:53:44.876529+0000","last_fullsized":"2023-11-28T11:53:44.876529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:04.735416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.858446+0000","last_change":"2023-11-28T11:53:40.825388+0000","last_active":"2023-11-28T11:53:44.858446+0000","last_peered":"2023-11-28T11:53:44.858446+0000","last_clean":"2023-11-28T11:53:44.858446+0000","last_became_active":"2023-11-28T11:53:40.823486+0000","last_became_peered":"2023-11-28T11:53:40.823486+0000","last_unstale":"2023-11-28T11:53:44.858446+0000","last_undegraded":"2023-11-28T11:53:44.858446+0000","last_fullsized":"2023-11-28T11:53:44.858446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:07:13.206788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862735+0000","last_change":"2023-11-28T11:53:40.834673+0000","last_active":"2023-11-28T11:53:44.862735+0000","last_peered":"2023-11-28T11:53:44.862735+0000","last_clean":"2023-11-28T11:53:44.862735+0000","last_became_active":"2023-11-28T11:53:40.834446+0000","last_became_peered":"2023-11-28T11:53:40.834446+0000","last_unstale":"2023-11-28T11:53:44.862735+0000","last_undegraded":"2023-11-28T11:53:44.862735+0000","last_fullsized":"2023-11-28T11:53:44.862735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:45:19.490164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862539+0000","last_change":"2023-11-28T11:53:40.823930+0000","last_active":"2023-11-28T11:53:44.862539+0000","last_peered":"2023-11-28T11:53:44.862539+0000","last_clean":"2023-11-28T11:53:44.862539+0000","last_became_active":"2023-11-28T11:53:40.823085+0000","last_became_peered":"2023-11-28T11:53:40.823085+0000","last_unstale":"2023-11-28T11:53:44.862539+0000","last_undegraded":"2023-11-28T11:53:44.862539+0000","last_fullsized":"2023-11-28T11:53:44.862539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:03.251004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861847+0000","last_change":"2023-11-28T11:53:40.825318+0000","last_active":"2023-11-28T11:53:44.861847+0000","last_peered":"2023-11-28T11:53:44.861847+0000","last_clean":"2023-11-28T11:53:44.861847+0000","last_became_active":"2023-11-28T11:53:40.823580+0000","last_became_peered":"2023-11-28T11:53:40.823580+0000","last_unstale":"2023-11-28T11:53:44.861847+0000","last_undegraded":"2023-11-28T11:53:44.861847+0000","last_fullsized":"2023-11-28T11:53:44.861847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:53.307980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859699+0000","last_change":"2023-11-28T11:53:40.822632+0000","last_active":"2023-11-28T11:53:44.859699+0000","last_peered":"2023-11-28T11:53:44.859699+0000","last_clean":"2023-11-28T11:53:44.859699+0000","last_became_active":"2023-11-28T11:53:40.822041+0000","last_became_peered":"2023-11-28T11:53:40.822041+0000","last_unstale":"2023-11-28T11:53:44.859699+0000","last_undegraded":"2023-11-28T11:53:44.859699+0000","last_fullsized":"2023-11-28T11:53:44.859699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:25.589109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.853050+0000","last_change":"2023-11-28T11:53:40.827422+0000","last_active":"2023-11-28T11:53:44.853050+0000","last_peered":"2023-11-28T11:53:44.853050+0000","last_clean":"2023-11-28T11:53:44.853050+0000","last_became_active":"2023-11-28T11:53:40.827049+0000","last_became_peered":"2023-11-28T11:53:40.827049+0000","last_unstale":"2023-11-28T11:53:44.853050+0000","last_undegraded":"2023-11-28T11:53:44.853050+0000","last_fullsized":"2023-11-28T11:53:44.853050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:40.317412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862710+0000","last_change":"2023-11-28T11:53:40.830609+0000","last_active":"2023-11-28T11:53:44.862710+0000","last_peered":"2023-11-28T11:53:44.862710+0000","last_clean":"2023-11-28T11:53:44.862710+0000","last_became_active":"2023-11-28T11:53:40.830049+0000","last_became_peered":"2023-11-28T11:53:40.830049+0000","last_unstale":"2023-11-28T11:53:44.862710+0000","last_undegraded":"2023-11-28T11:53:44.862710+0000","last_fullsized":"2023-11-28T11:53:44.862710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:39:08.352832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867744+0000","last_change":"2023-11-28T11:53:40.834235+0000","last_active":"2023-11-28T11:53:44.867744+0000","last_peered":"2023-11-28T11:53:44.867744+0000","last_clean":"2023-11-28T11:53:44.867744+0000","last_became_active":"2023-11-28T11:53:40.833501+0000","last_became_peered":"2023-11-28T11:53:40.833501+0000","last_unstale":"2023-11-28T11:53:44.867744+0000","last_undegraded":"2023-11-28T11:53:44.867744+0000","last_fullsized":"2023-11-28T11:53:44.867744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:12.417672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859262+0000","last_change":"2023-11-28T11:53:40.814201+0000","last_active":"2023-11-28T11:53:44.859262+0000","last_peered":"2023-11-28T11:53:44.859262+0000","last_clean":"2023-11-28T11:53:44.859262+0000","last_became_active":"2023-11-28T11:53:40.813798+0000","last_became_peered":"2023-11-28T11:53:40.813798+0000","last_unstale":"2023-11-28T11:53:44.859262+0000","last_undegraded":"2023-11-28T11:53:44.859262+0000","last_fullsized":"2023-11-28T11:53:44.859262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:49.919629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861214+0000","last_change":"2023-11-28T11:53:40.819145+0000","last_active":"2023-11-28T11:53:44.861214+0000","last_peered":"2023-11-28T11:53:44.861214+0000","last_clean":"2023-11-28T11:53:44.861214+0000","last_became_active":"2023-11-28T11:53:40.818894+0000","last_became_peered":"2023-11-28T11:53:40.818894+0000","last_unstale":"2023-11-28T11:53:44.861214+0000","last_undegraded":"2023-11-28T11:53:44.861214+0000","last_fullsized":"2023-11-28T11:53:44.861214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852149+0000","last_change":"2023-11-28T11:53:40.831922+0000","last_active":"2023-11-28T11:53:44.852149+0000","last_peered":"2023-11-28T11:53:44.852149+0000","last_clean":"2023-11-28T11:53:44.852149+0000","last_became_active":"2023-11-28T11:53:40.831309+0000","last_became_peered":"2023-11-28T11:53:40.831309+0000","last_unstale":"2023-11-28T11:53:44.852149+0000","last_undegraded":"2023-11-28T11:53:44.852149+0000","last_fullsized":"2023-11-28T11:53:44.852149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:53.307980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852158+0000","last_change":"2023-11-28T11:53:40.828525+0000","last_active":"2023-11-28T11:53:44.852158+0000","last_peered":"2023-11-28T11:53:44.852158+0000","last_clean":"2023-11-28T11:53:44.852158+0000","last_became_active":"2023-11-28T11:53:40.827088+0000","last_became_peered":"2023-11-28T11:53:40.827088+0000","last_unstale":"2023-11-28T11:53:44.852158+0000","last_undegraded":"2023-11-28T11:53:44.852158+0000","last_fullsized":"2023-11-28T11:53:44.852158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:42.885822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852234+0000","last_change":"2023-11-28T11:53:40.827903+0000","last_active":"2023-11-28T11:53:44.852234+0000","last_peered":"2023-11-28T11:53:44.852234+0000","last_clean":"2023-11-28T11:53:44.852234+0000","last_became_active":"2023-11-28T11:53:40.827630+0000","last_became_peered":"2023-11-28T11:53:40.827630+0000","last_unstale":"2023-11-28T11:53:44.852234+0000","last_undegraded":"2023-11-28T11:53:44.852234+0000","last_fullsized":"2023-11-28T11:53:44.852234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:20.978843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860656+0000","last_change":"2023-11-28T11:53:40.817481+0000","last_active":"2023-11-28T11:53:44.860656+0000","last_peered":"2023-11-28T11:53:44.860656+0000","last_clean":"2023-11-28T11:53:44.860656+0000","last_became_active":"2023-11-28T11:53:40.816901+0000","last_became_peered":"2023-11-28T11:53:40.816901+0000","last_unstale":"2023-11-28T11:53:44.860656+0000","last_undegraded":"2023-11-28T11:53:44.860656+0000","last_fullsized":"2023-11-28T11:53:44.860656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:57.213686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.853557+0000","last_change":"2023-11-28T11:53:40.826671+0000","last_active":"2023-11-28T11:53:44.853557+0000","last_peered":"2023-11-28T11:53:44.853557+0000","last_clean":"2023-11-28T11:53:44.853557+0000","last_became_active":"2023-11-28T11:53:40.826306+0000","last_became_peered":"2023-11-28T11:53:40.826306+0000","last_unstale":"2023-11-28T11:53:44.853557+0000","last_undegraded":"2023-11-28T11:53:44.853557+0000","last_fullsized":"2023-11-28T11:53:44.853557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:07:13.206788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867648+0000","last_change":"2023-11-28T11:53:40.834257+0000","last_active":"2023-11-28T11:53:44.867648+0000","last_peered":"2023-11-28T11:53:44.867648+0000","last_clean":"2023-11-28T11:53:44.867648+0000","last_became_active":"2023-11-28T11:53:40.833624+0000","last_became_peered":"2023-11-28T11:53:40.833624+0000","last_unstale":"2023-11-28T11:53:44.867648+0000","last_undegraded":"2023-11-28T11:53:44.867648+0000","last_fullsized":"2023-11-28T11:53:44.867648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:51.196033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.851513+0000","last_change":"2023-11-28T11:53:40.827595+0000","last_active":"2023-11-28T11:53:44.851513+0000","last_peered":"2023-11-28T11:53:44.851513+0000","last_clean":"2023-11-28T11:53:44.851513+0000","last_became_active":"2023-11-28T11:53:40.827244+0000","last_became_peered":"2023-11-28T11:53:40.827244+0000","last_unstale":"2023-11-28T11:53:44.851513+0000","last_undegraded":"2023-11-28T11:53:44.851513+0000","last_fullsized":"2023-11-28T11:53:44.851513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:12.417672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861137+0000","last_change":"2023-11-28T11:53:40.818652+0000","last_active":"2023-11-28T11:53:44.861137+0000","last_peered":"2023-11-28T11:53:44.861137+0000","last_clean":"2023-11-28T11:53:44.861137+0000","last_became_active":"2023-11-28T11:53:40.818359+0000","last_became_peered":"2023-11-28T11:53:40.818359+0000","last_unstale":"2023-11-28T11:53:44.861137+0000","last_undegraded":"2023-11-28T11:53:44.861137+0000","last_fullsized":"2023-11-28T11:53:44.861137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:58.623372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859346+0000","last_change":"2023-11-28T11:53:40.815826+0000","last_active":"2023-11-28T11:53:44.859346+0000","last_peered":"2023-11-28T11:53:44.859346+0000","last_clean":"2023-11-28T11:53:44.859346+0000","last_became_active":"2023-11-28T11:53:40.815568+0000","last_became_peered":"2023-11-28T11:53:40.815568+0000","last_unstale":"2023-11-28T11:53:44.859346+0000","last_undegraded":"2023-11-28T11:53:44.859346+0000","last_fullsized":"2023-11-28T11:53:44.859346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:07:42.533145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.868655+0000","last_change":"2023-11-28T11:53:40.832666+0000","last_active":"2023-11-28T11:53:44.868655+0000","last_peered":"2023-11-28T11:53:44.868655+0000","last_clean":"2023-11-28T11:53:44.868655+0000","last_became_active":"2023-11-28T11:53:40.823823+0000","last_became_peered":"2023-11-28T11:53:40.823823+0000","last_unstale":"2023-11-28T11:53:44.868655+0000","last_undegraded":"2023-11-28T11:53:44.868655+0000","last_fullsized":"2023-11-28T11:53:44.868655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:53.307980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.864534+0000","last_change":"2023-11-28T11:53:40.821057+0000","last_active":"2023-11-28T11:53:44.864534+0000","last_peered":"2023-11-28T11:53:44.864534+0000","last_clean":"2023-11-28T11:53:44.864534+0000","last_became_active":"2023-11-28T11:53:40.820709+0000","last_became_peered":"2023-11-28T11:53:40.820709+0000","last_unstale":"2023-11-28T11:53:44.864534+0000","last_undegraded":"2023-11-28T11:53:44.864534+0000","last_fullsized":"2023-11-28T11:53:44.864534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:01.312325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860193+0000","last_change":"2023-11-28T11:53:40.817645+0000","last_active":"2023-11-28T11:53:44.860193+0000","last_peered":"2023-11-28T11:53:44.860193+0000","last_clean":"2023-11-28T11:53:44.860193+0000","last_became_active":"2023-11-28T11:53:40.817205+0000","last_became_peered":"2023-11-28T11:53:40.817205+0000","last_unstale":"2023-11-28T11:53:44.860193+0000","last_undegraded":"2023-11-28T11:53:44.860193+0000","last_fullsized":"2023-11-28T11:53:44.860193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:45:19.490164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.853399+0000","last_change":"2023-11-28T11:53:40.826609+0000","last_active":"2023-11-28T11:53:44.853399+0000","last_peered":"2023-11-28T11:53:44.853399+0000","last_clean":"2023-11-28T11:53:44.853399+0000","last_became_active":"2023-11-28T11:53:40.826314+0000","last_became_peered":"2023-11-28T11:53:40.826314+0000","last_unstale":"2023-11-28T11:53:44.853399+0000","last_undegraded":"2023-11-28T11:53:44.853399+0000","last_fullsized":"2023-11-28T11:53:44.853399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:51.196033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.853274+0000","last_change":"2023-11-28T11:53:40.828425+0000","last_active":"2023-11-28T11:53:44.853274+0000","last_peered":"2023-11-28T11:53:44.853274+0000","last_clean":"2023-11-28T11:53:44.853274+0000","last_became_active":"2023-11-28T11:53:40.828140+0000","last_became_peered":"2023-11-28T11:53:40.828140+0000","last_unstale":"2023-11-28T11:53:44.853274+0000","last_undegraded":"2023-11-28T11:53:44.853274+0000","last_fullsized":"2023-11-28T11:53:44.853274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:55.927473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4527,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9256,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362584,"statfs":{"total":96636764160,"available":96627286016,"internally_reserved":0,"allocated":884736,"data_stored":703105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":108776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8148,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363692,"statfs":{"total":96636764160,"available":96628420608,"internally_reserved":0,"allocated":274432,"data_stored":110398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8224,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363616,"statfs":{"total":96636764160,"available":96628342784,"internally_reserved":0,"allocated":286720,"data_stored":113563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8140,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363700,"statfs":{"total":96636764160,"available":96628428800,"internally_reserved":0,"allocated":266240,"data_stored":108866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":108776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9232,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362608,"statfs":{"total":96636764160,"available":96627310592,"internally_reserved":0,"allocated":860160,"data_stored":700130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12240,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359600,"statfs":{"total":96636764160,"available":96624230400,"internally_reserved":0,"allocated":270336,"data_stored":110328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:54:04.341 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T11:54:04.341 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-28T11:54:04.341 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-28T11:54:04.342 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-28T11:54:04.342 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-28T11:54:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.449+0000 7f2f12fed700 1 Processor -- start 2023-11-28T11:54:04.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.449+0000 7f2f12fed700 1 -- start start 2023-11-28T11:54:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f12fed700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f0c0cbdf0 0x7f2f0c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f12fed700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c0ccb10 0x7f2f0c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f12fed700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c0ced80 con 0x7f2f0c15cdb0 2023-11-28T11:54:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f12fed700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c15fd80 con 0x7f2f0c0cbdf0 2023-11-28T11:54:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f12fed700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0cc260 con 0x7f2f0c0ccb10 2023-11-28T11:54:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f0bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f0c0cbdf0 0x7f2f0c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f0bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2f0c0cbdf0 0x7f2f0c0ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53134/0 (socket says 172.21.15.50:53134) 2023-11-28T11:54:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f0bfff700 1 -- 172.21.15.50:0/1851135812 learned_addr learned my addr 172.21.15.50:0/1851135812 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f1158a700 1 --2- 172.21.15.50:0/1851135812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c0ccb10 0x7f2f0c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f0bfff700 1 -- 172.21.15.50:0/1851135812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c0ccb10 msgr2=0x7f2f0c0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:04.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f0bfff700 1 --2- 172.21.15.50:0/1851135812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c0ccb10 0x7f2f0c0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f0bfff700 1 -- 172.21.15.50:0/1851135812 >> v1:172.21.15.50:6789/0 conn(0x7f2f0c15cdb0 legacy=0x7f2f0c0cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f0bfff700 1 -- 172.21.15.50:0/1851135812 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c15d580 con 0x7f2f0c0cbdf0 2023-11-28T11:54:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f1158a700 1 --2- 172.21.15.50:0/1851135812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c0ccb10 0x7f2f0c0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:54:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f0bfff700 1 --2- 172.21.15.50:0/1851135812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f0c0cbdf0 0x7f2f0c0ce840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009910 tx=0x7f2ef8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6a48466fb7b4e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f0b7fe700 1 -- 172.21.15.50:0/1851135812 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8004230 con 0x7f2f0c0cbdf0 2023-11-28T11:54:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f0b7fe700 1 -- 172.21.15.50:0/1851135812 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef8004390 con 0x7f2f0c0cbdf0 2023-11-28T11:54:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f0b7fe700 1 -- 172.21.15.50:0/1851135812 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8009e60 con 0x7f2f0c0cbdf0 2023-11-28T11:54:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f12fed700 1 -- 172.21.15.50:0/1851135812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f0c0cbdf0 msgr2=0x7f2f0c0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:04.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f12fed700 1 --2- 172.21.15.50:0/1851135812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f0c0cbdf0 0x7f2f0c0ce840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009910 tx=0x7f2ef8009c20 comp rx=0 tx=0).stop 2023-11-28T11:54:04.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f12fed700 1 -- 172.21.15.50:0/1851135812 shutdown_connections 2023-11-28T11:54:04.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f12fed700 1 --2- 172.21.15.50:0/1851135812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c0ccb10 0x7f2f0c0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f12fed700 1 --2- 172.21.15.50:0/1851135812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f0c0cbdf0 0x7f2f0c0ce840 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f12fed700 1 -- 172.21.15.50:0/1851135812 >> 172.21.15.50:0/1851135812 conn(0x7f2f0c0b0a90 msgr2=0x7f2f0c0b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:04.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f12fed700 1 -- 172.21.15.50:0/1851135812 shutdown_connections 2023-11-28T11:54:04.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.453+0000 7f2f12fed700 1 -- 172.21.15.50:0/1851135812 wait complete. 2023-11-28T11:54:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.457+0000 7f2f12fed700 1 Processor -- start 2023-11-28T11:54:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.457+0000 7f2f12fed700 1 -- start start 2023-11-28T11:54:04.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.457+0000 7f2f12fed700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c0cbdf0 0x7f2f0c158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.457+0000 7f2f12fed700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f0c0ccb10 0x7f2f0c1f1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.457+0000 7f2f12fed700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c15cdb0 0x7f2f0c0c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.457+0000 7f2f12fed700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c1f2380 con 0x7f2f0c0ccb10 2023-11-28T11:54:04.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.457+0000 7f2f12fed700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c158d40 con 0x7f2f0c0cbdf0 2023-11-28T11:54:04.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.457+0000 7f2f12fed700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c1f1dc0 con 0x7f2f0c15cdb0 2023-11-28T11:54:04.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.457+0000 7f2f0bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f0c0ccb10 0x7f2f0c1f1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.457+0000 7f2f0bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f0c0ccb10 0x7f2f0c1f1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53142/0 (socket says 172.21.15.50:53142) 2023-11-28T11:54:04.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.457+0000 7f2f0bfff700 1 -- 172.21.15.50:0/256393503 learned_addr learned my addr 172.21.15.50:0/256393503 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:04.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.457+0000 7f2f1158a700 1 --2- 172.21.15.50:0/256393503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c15cdb0 0x7f2f0c0c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.457+0000 7f2f10d89700 1 --2- 172.21.15.50:0/256393503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c0cbdf0 0x7f2f0c158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.461+0000 7f2f0bfff700 1 -- 172.21.15.50:0/256393503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c15cdb0 msgr2=0x7f2f0c0c2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:04.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.461+0000 7f2f0bfff700 1 --2- 172.21.15.50:0/256393503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c15cdb0 0x7f2f0c0c2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.461+0000 7f2f0bfff700 1 -- 172.21.15.50:0/256393503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c0cbdf0 msgr2=0x7f2f0c158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:04.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.461+0000 7f2f0bfff700 1 --2- 172.21.15.50:0/256393503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c0cbdf0 0x7f2f0c158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.461+0000 7f2f0bfff700 1 -- 172.21.15.50:0/256393503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef8009570 con 0x7f2f0c0ccb10 2023-11-28T11:54:04.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.461+0000 7f2f1158a700 1 --2- 172.21.15.50:0/256393503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c15cdb0 0x7f2f0c0c2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:04.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.461+0000 7f2f10d89700 1 --2- 172.21.15.50:0/256393503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c0cbdf0 0x7f2f0c158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:04.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.461+0000 7f2f0bfff700 1 --2- 172.21.15.50:0/256393503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f0c0ccb10 0x7f2f0c1f1330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009860 tx=0x7f2ef8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:04.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.461+0000 7f2f097fa700 1 -- 172.21.15.50:0/256393503 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef800bdb0 con 0x7f2f0c0ccb10 2023-11-28T11:54:04.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.461+0000 7f2f097fa700 1 -- 172.21.15.50:0/256393503 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef801f070 con 0x7f2f0c0ccb10 2023-11-28T11:54:04.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.461+0000 7f2f097fa700 1 -- 172.21.15.50:0/256393503 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8003900 con 0x7f2f0c0ccb10 2023-11-28T11:54:04.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.461+0000 7f2f12fed700 1 -- 172.21.15.50:0/256393503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0c0c9630 con 0x7f2f0c0ccb10 2023-11-28T11:54:04.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.461+0000 7f2f12fed700 1 -- 172.21.15.50:0/256393503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0c0cb400 con 0x7f2f0c0ccb10 2023-11-28T11:54:04.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.461+0000 7f2f12fed700 1 -- 172.21.15.50:0/256393503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0c0cb0f0 con 0x7f2f0c0ccb10 2023-11-28T11:54:04.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.465+0000 7f2f097fa700 1 -- 172.21.15.50:0/256393503 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2ef802a020 con 0x7f2f0c0ccb10 2023-11-28T11:54:04.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.465+0000 7f2f097fa700 1 --2- 172.21.15.50:0/256393503 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2ef0064ee0 0x7f2ef0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.465+0000 7f2f097fa700 1 -- 172.21.15.50:0/256393503 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2ef8083940 con 0x7f2f0c0ccb10 2023-11-28T11:54:04.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.465+0000 7f2f10d89700 1 --2- 172.21.15.50:0/256393503 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2ef0064ee0 0x7f2ef0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.465+0000 7f2f10d89700 1 --2- 172.21.15.50:0/256393503 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2ef0064ee0 0x7f2ef0067390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c155cf0 tx=0x7f2f00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:04.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.473+0000 7f2f097fa700 1 -- 172.21.15.50:0/256393503 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2ef80517f0 con 0x7f2f0c0ccb10 2023-11-28T11:54:04.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.673+0000 7f2f12fed700 1 -- 172.21.15.50:0/256393503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2f0c0cb0f0 con 0x7f2f0c0ccb10 2023-11-28T11:54:04.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.677+0000 7f2f097fa700 1 -- 172.21.15.50:0/256393503 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161637 (secure 0 0 0) 0x7f2ef8054e10 con 0x7f2f0c0ccb10 2023-11-28T11:54:04.682 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.681+0000 7f2f12fed700 1 -- 172.21.15.50:0/256393503 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2ef0064ee0 msgr2=0x7f2ef0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.681+0000 7f2f12fed700 1 --2- 172.21.15.50:0/256393503 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2ef0064ee0 0x7f2ef0067390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c155cf0 tx=0x7f2f00009040 comp rx=0 tx=0).stop 2023-11-28T11:54:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.681+0000 7f2f12fed700 1 -- 172.21.15.50:0/256393503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f0c0ccb10 msgr2=0x7f2f0c1f1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.681+0000 7f2f12fed700 1 --2- 172.21.15.50:0/256393503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f0c0ccb10 0x7f2f0c1f1330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009860 tx=0x7f2ef8004770 comp rx=0 tx=0).stop 2023-11-28T11:54:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.681+0000 7f2f12fed700 1 -- 172.21.15.50:0/256393503 shutdown_connections 2023-11-28T11:54:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.681+0000 7f2f12fed700 1 --2- 172.21.15.50:0/256393503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c15cdb0 0x7f2f0c0c2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.681+0000 7f2f12fed700 1 --2- 172.21.15.50:0/256393503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f0c0ccb10 0x7f2f0c1f1330 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.681+0000 7f2f12fed700 1 --2- 172.21.15.50:0/256393503 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2ef0064ee0 0x7f2ef0067390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.681+0000 7f2f12fed700 1 --2- 172.21.15.50:0/256393503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c0cbdf0 0x7f2f0c158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.681+0000 7f2f12fed700 1 -- 172.21.15.50:0/256393503 >> 172.21.15.50:0/256393503 conn(0x7f2f0c0b0a90 msgr2=0x7f2f0c0b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:04.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.681+0000 7f2f12fed700 1 -- 172.21.15.50:0/256393503 shutdown_connections 2023-11-28T11:54:04.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.681+0000 7f2f12fed700 1 -- 172.21.15.50:0/256393503 wait complete. 2023-11-28T11:54:04.697 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":5,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":36481},{"type":"v1","addr":"172.21.15.192:6833","nonce":36481}]},"active_addr":"172.21.15.192:6833/36481","active_change":"2023-11-28T11:53:28.845269+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":3942456966}]},{"addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":4187713419}]},{"addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":2986965586}]},{"addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":1715212916}]}]} 2023-11-28T11:54:04.700 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-28T11:54:04.700 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-28T11:54:04.701 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.809+0000 7f54434b8700 1 Processor -- start 2023-11-28T11:54:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.809+0000 7f54434b8700 1 -- start start 2023-11-28T11:54:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54434b8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f543c158e60 0x7f543c0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54434b8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f543c0cb460 0x7f543c0cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54434b8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543c0cd8f0 con 0x7f543c0ad490 2023-11-28T11:54:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54434b8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543c0add00 con 0x7f543c0cb460 2023-11-28T11:54:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54434b8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c0cc4f0 con 0x7f543c158e60 2023-11-28T11:54:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f5441cb5700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f543c0ad490 0x7f543c0cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56334/0 (socket says 172.21.15.50:56334) 2023-11-28T11:54:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f5441cb5700 1 -- 172.21.15.50:0/176764563 learned_addr learned my addr 172.21.15.50:0/176764563 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54424b6700 1 --2- 172.21.15.50:0/176764563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f543c158e60 0x7f543c0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f5442cb7700 1 --2- 172.21.15.50:0/176764563 >> v2:172.21.15.192:3300/0 conn(0x7f543c0cb460 0x7f543c0cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54414b4700 1 -- 172.21.15.50:0/176764563 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901532069 0 0) 0x7f543c0cd8f0 con 0x7f543c0ad490 2023-11-28T11:54:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54414b4700 1 -- 172.21.15.50:0/176764563 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54280035d0 con 0x7f543c0ad490 2023-11-28T11:54:04.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f5442cb7700 1 -- 172.21.15.50:0/176764563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f543c158e60 msgr2=0x7f543c0c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:04.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f5442cb7700 1 --2- 172.21.15.50:0/176764563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f543c158e60 0x7f543c0c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f5442cb7700 1 -- 172.21.15.50:0/176764563 >> v1:172.21.15.50:6789/0 conn(0x7f543c0ad490 legacy=0x7f543c0cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:04.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f5442cb7700 1 -- 172.21.15.50:0/176764563 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c06dc60 con 0x7f543c0cb460 2023-11-28T11:54:04.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54424b6700 1 --2- 172.21.15.50:0/176764563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f543c158e60 0x7f543c0c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:04.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f5442cb7700 1 --2- 172.21.15.50:0/176764563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f543c0cb460 0x7f543c0cbfb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5434009880 tx=0x7f5434009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ef3140d55881c65 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:04.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54414b4700 1 -- 172.21.15.50:0/176764563 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5434011830 con 0x7f543c0cb460 2023-11-28T11:54:04.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54414b4700 1 -- 172.21.15.50:0/176764563 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5434011990 con 0x7f543c0cb460 2023-11-28T11:54:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54414b4700 1 -- 172.21.15.50:0/176764563 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5434011d00 con 0x7f543c0cb460 2023-11-28T11:54:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54434b8700 1 -- 172.21.15.50:0/176764563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f543c0cb460 msgr2=0x7f543c0cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54434b8700 1 --2- 172.21.15.50:0/176764563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f543c0cb460 0x7f543c0cbfb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5434009880 tx=0x7f5434009b90 comp rx=0 tx=0).stop 2023-11-28T11:54:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54434b8700 1 -- 172.21.15.50:0/176764563 shutdown_connections 2023-11-28T11:54:04.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54434b8700 1 --2- 172.21.15.50:0/176764563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f543c0cb460 0x7f543c0cbfb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54434b8700 1 --2- 172.21.15.50:0/176764563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f543c158e60 0x7f543c0c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54434b8700 1 -- 172.21.15.50:0/176764563 >> 172.21.15.50:0/176764563 conn(0x7f543c0ce3e0 msgr2=0x7f543c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:04.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54434b8700 1 -- 172.21.15.50:0/176764563 shutdown_connections 2023-11-28T11:54:04.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.813+0000 7f54434b8700 1 -- 172.21.15.50:0/176764563 wait complete. 2023-11-28T11:54:04.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.817+0000 7f54434b8700 1 Processor -- start 2023-11-28T11:54:04.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.817+0000 7f54434b8700 1 -- start start 2023-11-28T11:54:04.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.817+0000 7f54434b8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f543c0ad490 0x7f543c0977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.817+0000 7f54434b8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543c0cb460 0x7f543c0abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.817+0000 7f54434b8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f543c158e60 0x7f543c0ac450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.817+0000 7f54434b8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c0ae850 con 0x7f543c0cb460 2023-11-28T11:54:04.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.817+0000 7f54434b8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c0af390 con 0x7f543c0ad490 2023-11-28T11:54:04.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.817+0000 7f54434b8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c0ab9d0 con 0x7f543c158e60 2023-11-28T11:54:04.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.817+0000 7f5442cb7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f543c158e60 0x7f543c0ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.817+0000 7f5441cb5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543c0cb460 0x7f543c0abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.817+0000 7f5442cb7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f543c158e60 0x7f543c0ac450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:54244/0 (socket says 172.21.15.50:54244) 2023-11-28T11:54:04.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.817+0000 7f5442cb7700 1 -- 172.21.15.50:0/47730040 learned_addr learned my addr 172.21.15.50:0/47730040 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:04.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.817+0000 7f54424b6700 1 --2- 172.21.15.50:0/47730040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f543c0ad490 0x7f543c0977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.821+0000 7f5441cb5700 1 -- 172.21.15.50:0/47730040 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f543c158e60 msgr2=0x7f543c0ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:04.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.821+0000 7f5441cb5700 1 --2- 172.21.15.50:0/47730040 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f543c158e60 0x7f543c0ac450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.821+0000 7f5441cb5700 1 -- 172.21.15.50:0/47730040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f543c0ad490 msgr2=0x7f543c0977e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:04.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.821+0000 7f5441cb5700 1 --2- 172.21.15.50:0/47730040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f543c0ad490 0x7f543c0977e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:04.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.821+0000 7f5441cb5700 1 -- 172.21.15.50:0/47730040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c0094b0 con 0x7f543c0cb460 2023-11-28T11:54:04.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.821+0000 7f5441cb5700 1 --2- 172.21.15.50:0/47730040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543c0cb460 0x7f543c0abf10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f543800cae0 tx=0x7f543800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:04.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.821+0000 7f5432ffd700 1 -- 172.21.15.50:0/47730040 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5438007480 con 0x7f543c0cb460 2023-11-28T11:54:04.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.821+0000 7f5432ffd700 1 -- 172.21.15.50:0/47730040 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54380075e0 con 0x7f543c0cb460 2023-11-28T11:54:04.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.821+0000 7f54434b8700 1 -- 172.21.15.50:0/47730040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54340094b0 con 0x7f543c0cb460 2023-11-28T11:54:04.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.821+0000 7f5432ffd700 1 -- 172.21.15.50:0/47730040 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5438007970 con 0x7f543c0cb460 2023-11-28T11:54:04.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.821+0000 7f54434b8700 1 -- 172.21.15.50:0/47730040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c159230 con 0x7f543c0cb460 2023-11-28T11:54:04.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.821+0000 7f54434b8700 1 -- 172.21.15.50:0/47730040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543c0cde90 con 0x7f543c0cb460 2023-11-28T11:54:04.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.825+0000 7f5432ffd700 1 -- 172.21.15.50:0/47730040 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5438019030 con 0x7f543c0cb460 2023-11-28T11:54:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.825+0000 7f5432ffd700 1 --2- 172.21.15.50:0/47730040 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5420064ee0 0x7f5420067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.825+0000 7f5432ffd700 1 -- 172.21.15.50:0/47730040 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f54380819c0 con 0x7f543c0cb460 2023-11-28T11:54:04.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.825+0000 7f54424b6700 1 --2- 172.21.15.50:0/47730040 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5420064ee0 0x7f5420067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:04.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.825+0000 7f54424b6700 1 --2- 172.21.15.50:0/47730040 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5420064ee0 0x7f5420067390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f542c009ce0 tx=0x7f542c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:04.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.829+0000 7f5432ffd700 1 -- 172.21.15.50:0/47730040 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f543804f7f0 con 0x7f543c0cb460 2023-11-28T11:54:05.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.997+0000 7f54434b8700 1 -- 172.21.15.50:0/47730040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f543c06d6a0 con 0x7f543c0cb460 2023-11-28T11:54:05.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:04.997+0000 7f5432ffd700 1 -- 172.21.15.50:0/47730040 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f5438017090 con 0x7f543c0cb460 2023-11-28T11:54:05.004 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:05.004 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:45.231747+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:05.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.005+0000 7f54434b8700 1 -- 172.21.15.50:0/47730040 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5420064ee0 msgr2=0x7f5420067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.005+0000 7f54434b8700 1 --2- 172.21.15.50:0/47730040 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5420064ee0 0x7f5420067390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f542c009ce0 tx=0x7f542c009240 comp rx=0 tx=0).stop 2023-11-28T11:54:05.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.005+0000 7f54434b8700 1 -- 172.21.15.50:0/47730040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543c0cb460 msgr2=0x7f543c0abf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.005+0000 7f54434b8700 1 --2- 172.21.15.50:0/47730040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543c0cb460 0x7f543c0abf10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f543800cae0 tx=0x7f543800cb10 comp rx=0 tx=0).stop 2023-11-28T11:54:05.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.005+0000 7f54434b8700 1 -- 172.21.15.50:0/47730040 shutdown_connections 2023-11-28T11:54:05.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.005+0000 7f54434b8700 1 --2- 172.21.15.50:0/47730040 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f543c158e60 0x7f543c0ac450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.005+0000 7f54434b8700 1 --2- 172.21.15.50:0/47730040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f543c0cb460 0x7f543c0abf10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.005+0000 7f54434b8700 1 --2- 172.21.15.50:0/47730040 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5420064ee0 0x7f5420067390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.005+0000 7f54434b8700 1 --2- 172.21.15.50:0/47730040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f543c0ad490 0x7f543c0977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.005+0000 7f54434b8700 1 -- 172.21.15.50:0/47730040 >> 172.21.15.50:0/47730040 conn(0x7f543c0ce3e0 msgr2=0x7f543c1524f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.005+0000 7f54434b8700 1 -- 172.21.15.50:0/47730040 shutdown_connections 2023-11-28T11:54:05.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.005+0000 7f54434b8700 1 -- 172.21.15.50:0/47730040 wait complete. 2023-11-28T11:54:05.023 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-28T11:54:05.023 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:05.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026f59e700 1 Processor -- start 2023-11-28T11:54:05.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026f59e700 1 -- start start 2023-11-28T11:54:05.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02700ce960 0x7f027015d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02700ccf60 con 0x7f02700d2500 2023-11-28T11:54:05.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026f59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02700b78b0 con 0x7f02700d3040 2023-11-28T11:54:05.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02700b66a0 con 0x7f02700ce960 2023-11-28T11:54:05.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026dd9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f02700d2500 0x7f02700d2930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56344/0 (socket says 172.21.15.50:56344) 2023-11-28T11:54:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026dd9b700 1 -- 172.21.15.50:0/699342309 learned_addr learned my addr 172.21.15.50:0/699342309 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026e59c700 1 --2- 172.21.15.50:0/699342309 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02700ce960 0x7f027015d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026d59a700 1 -- 172.21.15.50:0/699342309 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427605310 0 0) 0x7f02700ccf60 con 0x7f02700d2500 2023-11-28T11:54:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026d59a700 1 -- 172.21.15.50:0/699342309 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02500035d0 con 0x7f02700d2500 2023-11-28T11:54:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026d59a700 1 -- 172.21.15.50:0/699342309 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165491811 0 0) 0x7f02700b78b0 con 0x7f02700d3040 2023-11-28T11:54:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026d59a700 1 -- 172.21.15.50:0/699342309 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02700ccf60 con 0x7f02700d3040 2023-11-28T11:54:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026e59c700 1 -- 172.21.15.50:0/699342309 >> v1:172.21.15.192:6789/0 conn(0x7f02700d3040 legacy=0x7f027006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026e59c700 1 -- 172.21.15.50:0/699342309 >> v1:172.21.15.50:6789/0 conn(0x7f02700d2500 legacy=0x7f02700d2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026e59c700 1 -- 172.21.15.50:0/699342309 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02700b7b70 con 0x7f02700ce960 2023-11-28T11:54:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026e59c700 1 --2- 172.21.15.50:0/699342309 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02700ce960 0x7f027015d230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0268009dc0 tx=0x7f026800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaa210a4c160bfdc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026d59a700 1 -- 172.21.15.50:0/699342309 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026800e070 con 0x7f02700ce960 2023-11-28T11:54:05.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026d59a700 1 -- 172.21.15.50:0/699342309 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026800bb20 con 0x7f02700ce960 2023-11-28T11:54:05.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.133+0000 7f026d59a700 1 -- 172.21.15.50:0/699342309 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026800be90 con 0x7f02700ce960 2023-11-28T11:54:05.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.137+0000 7f026f59e700 1 -- 172.21.15.50:0/699342309 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02700ce960 msgr2=0x7f027015d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.137+0000 7f026f59e700 1 --2- 172.21.15.50:0/699342309 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02700ce960 0x7f027015d230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0268009dc0 tx=0x7f026800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:05.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.137+0000 7f026f59e700 1 -- 172.21.15.50:0/699342309 shutdown_connections 2023-11-28T11:54:05.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.137+0000 7f026f59e700 1 --2- 172.21.15.50:0/699342309 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02700ce960 0x7f027015d230 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.137+0000 7f026f59e700 1 -- 172.21.15.50:0/699342309 >> 172.21.15.50:0/699342309 conn(0x7f02700b5860 msgr2=0x7f02700b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.137+0000 7f026f59e700 1 -- 172.21.15.50:0/699342309 shutdown_connections 2023-11-28T11:54:05.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.137+0000 7f026f59e700 1 -- 172.21.15.50:0/699342309 wait complete. 2023-11-28T11:54:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026f59e700 1 Processor -- start 2023-11-28T11:54:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026f59e700 1 -- start start 2023-11-28T11:54:05.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02700ce960 0x7f02701f5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02700d2500 0x7f02700cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02700d3040 0x7f02700c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02700c94e0 con 0x7f02700d2500 2023-11-28T11:54:05.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026f59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027014c630 con 0x7f02700d3040 2023-11-28T11:54:05.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02700c88d0 con 0x7f02700ce960 2023-11-28T11:54:05.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02700d2500 0x7f02700cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026e59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02700ce960 0x7f02701f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02700d2500 0x7f02700cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53164/0 (socket says 172.21.15.50:53164) 2023-11-28T11:54:05.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026dd9b700 1 -- 172.21.15.50:0/1967343249 learned_addr learned my addr 172.21.15.50:0/1967343249 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026ed9d700 1 --2- 172.21.15.50:0/1967343249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02700d3040 0x7f02700c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026dd9b700 1 -- 172.21.15.50:0/1967343249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02700ce960 msgr2=0x7f02701f5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026dd9b700 1 --2- 172.21.15.50:0/1967343249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02700ce960 0x7f02701f5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026dd9b700 1 -- 172.21.15.50:0/1967343249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02700d3040 msgr2=0x7f02700c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026dd9b700 1 --2- 172.21.15.50:0/1967343249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02700d3040 0x7f02700c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026dd9b700 1 -- 172.21.15.50:0/1967343249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0268009a70 con 0x7f02700d2500 2023-11-28T11:54:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026dd9b700 1 --2- 172.21.15.50:0/1967343249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02700d2500 0x7f02700cc4b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f025800c700 tx=0x7f025800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f0266ffd700 1 -- 172.21.15.50:0/1967343249 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258005d90 con 0x7f02700d2500 2023-11-28T11:54:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f0266ffd700 1 -- 172.21.15.50:0/1967343249 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02580070d0 con 0x7f02700d2500 2023-11-28T11:54:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026f59e700 1 -- 172.21.15.50:0/1967343249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02700b8130 con 0x7f02700d2500 2023-11-28T11:54:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f0266ffd700 1 -- 172.21.15.50:0/1967343249 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258007480 con 0x7f02700d2500 2023-11-28T11:54:05.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.141+0000 7f026f59e700 1 -- 172.21.15.50:0/1967343249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02700b7e50 con 0x7f02700d2500 2023-11-28T11:54:05.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.145+0000 7f0266ffd700 1 -- 172.21.15.50:0/1967343249 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0258019030 con 0x7f02700d2500 2023-11-28T11:54:05.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.145+0000 7f026f59e700 1 -- 172.21.15.50:0/1967343249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02700b8410 con 0x7f02700d2500 2023-11-28T11:54:05.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.145+0000 7f0266ffd700 1 --2- 172.21.15.50:0/1967343249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0254064ee0 0x7f0254067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.145+0000 7f0266ffd700 1 -- 172.21.15.50:0/1967343249 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f02580814e0 con 0x7f02700d2500 2023-11-28T11:54:05.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.145+0000 7f026e59c700 1 --2- 172.21.15.50:0/1967343249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0254064ee0 0x7f0254067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.149+0000 7f026e59c700 1 --2- 172.21.15.50:0/1967343249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0254064ee0 0x7f0254067390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0268009d90 tx=0x7f026801d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.153+0000 7f0266ffd700 1 -- 172.21.15.50:0/1967343249 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f025804f330 con 0x7f02700d2500 2023-11-28T11:54:05.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.321+0000 7f026f59e700 1 -- 172.21.15.50:0/1967343249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02700c9680 con 0x7f02700d2500 2023-11-28T11:54:05.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.325+0000 7f0266ffd700 1 -- 172.21.15.50:0/1967343249 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f0258017090 con 0x7f02700d2500 2023-11-28T11:54:05.329 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:05.329 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:45.231747+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:05.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.325+0000 7f026f59e700 1 -- 172.21.15.50:0/1967343249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0254064ee0 msgr2=0x7f0254067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.325+0000 7f026f59e700 1 --2- 172.21.15.50:0/1967343249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0254064ee0 0x7f0254067390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0268009d90 tx=0x7f026801d040 comp rx=0 tx=0).stop 2023-11-28T11:54:05.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.325+0000 7f026f59e700 1 -- 172.21.15.50:0/1967343249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02700d2500 msgr2=0x7f02700cc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.325+0000 7f026f59e700 1 --2- 172.21.15.50:0/1967343249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02700d2500 0x7f02700cc4b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f025800c700 tx=0x7f025800ca10 comp rx=0 tx=0).stop 2023-11-28T11:54:05.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.325+0000 7f026f59e700 1 -- 172.21.15.50:0/1967343249 shutdown_connections 2023-11-28T11:54:05.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.325+0000 7f026f59e700 1 --2- 172.21.15.50:0/1967343249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0254064ee0 0x7f0254067390 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.325+0000 7f026f59e700 1 --2- 172.21.15.50:0/1967343249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02700d3040 0x7f02700c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.325+0000 7f026f59e700 1 --2- 172.21.15.50:0/1967343249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02700d2500 0x7f02700cc4b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.325+0000 7f026f59e700 1 --2- 172.21.15.50:0/1967343249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02700ce960 0x7f02701f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.325+0000 7f026f59e700 1 -- 172.21.15.50:0/1967343249 >> 172.21.15.50:0/1967343249 conn(0x7f02700b5860 msgr2=0x7f02700cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.329+0000 7f026f59e700 1 -- 172.21.15.50:0/1967343249 shutdown_connections 2023-11-28T11:54:05.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.329+0000 7f026f59e700 1 -- 172.21.15.50:0/1967343249 wait complete. 2023-11-28T11:54:05.345 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-28T11:54:05.346 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-28T11:54:05.346 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-28T11:54:05.347 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-28T11:54:05.347 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-28T11:54:05.347 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-28T11:54:05.348 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-28T11:54:05.348 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-28T11:54:05.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.497+0000 7f511a704700 1 Processor -- start 2023-11-28T11:54:05.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.497+0000 7f511a704700 1 -- start start 2023-11-28T11:54:05.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.497+0000 7fb6e6b1e700 1 Processor -- start 2023-11-28T11:54:05.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.497+0000 7fb6e6b1e700 1 -- start start 2023-11-28T11:54:05.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.497+0000 7f511a704700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51140ca700 0x7f51140c1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.497+0000 7f511a704700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51140c1dc0 con 0x7f51140b3df0 2023-11-28T11:54:05.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.497+0000 7f511a704700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51140cbcf0 con 0x7f51140c1970 2023-11-28T11:54:05.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.497+0000 7f511a704700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511406a9d0 con 0x7f51140ca700 2023-11-28T11:54:05.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.497+0000 7f5118ca1700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f51140b3df0 0x7f511415fab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56352/0 (socket says 172.21.15.50:56352) 2023-11-28T11:54:05.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.497+0000 7f5118ca1700 1 -- 172.21.15.50:0/974990072 learned_addr learned my addr 172.21.15.50:0/974990072 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:05.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.497+0000 7fb6e6b1e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6e006cd80 0x7fb6e015b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.497+0000 7fb6e6b1e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e00cdeb0 con 0x7fb6e00ca310 2023-11-28T11:54:05.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.497+0000 7fb6e6b1e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e00cca10 con 0x7fb6e006c0a0 2023-11-28T11:54:05.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.497+0000 7fb6e6b1e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e006c4f0 con 0x7fb6e006cd80 2023-11-28T11:54:05.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.497+0000 7fb6e5b1c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb6e00ca310 0x7fb6e0069eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56360/0 (socket says 172.21.15.50:56360) 2023-11-28T11:54:05.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.497+0000 7fb6e5b1c700 1 -- 172.21.15.50:0/1951757343 learned_addr learned my addr 172.21.15.50:0/1951757343 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:05.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.497+0000 7f5113fff700 1 --2- 172.21.15.50:0/974990072 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51140ca700 0x7f51140c1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f6214f9e700 1 Processor -- start 2023-11-28T11:54:05.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7fb6e4b1a700 1 -- 172.21.15.50:0/1951757343 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358019647 0 0) 0x7fb6dc001110 con 0x7fb6e00ca310 2023-11-28T11:54:05.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7fb6e631d700 1 --2- 172.21.15.50:0/1951757343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6e006cd80 0x7fb6e015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7fb6e4b1a700 1 -- 172.21.15.50:0/1951757343 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6cc0035d0 con 0x7fb6e00ca310 2023-11-28T11:54:05.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f6214f9e700 1 -- start start 2023-11-28T11:54:05.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f4c15e65700 1 Processor -- start 2023-11-28T11:54:05.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f5112ffd700 1 -- 172.21.15.50:0/974990072 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2713379959 0 0) 0x7f51140cbcf0 con 0x7f51140c1970 2023-11-28T11:54:05.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f5112ffd700 1 -- 172.21.15.50:0/974990072 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50fc0035d0 con 0x7f51140c1970 2023-11-28T11:54:05.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7fb6e4b1a700 1 -- 172.21.15.50:0/1951757343 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3040791185 0 0) 0x7fb6e00cca10 con 0x7fb6e006c0a0 2023-11-28T11:54:05.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7fb6e4b1a700 1 -- 172.21.15.50:0/1951757343 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6dc001110 con 0x7fb6e006c0a0 2023-11-28T11:54:05.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f5113fff700 1 -- 172.21.15.50:0/974990072 >> v1:172.21.15.192:6789/0 conn(0x7f51140c1970 legacy=0x7f51140b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f5113fff700 1 -- 172.21.15.50:0/974990072 >> v1:172.21.15.50:6789/0 conn(0x7f51140b3df0 legacy=0x7f511415fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f5113fff700 1 -- 172.21.15.50:0/974990072 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5114069d50 con 0x7f51140ca700 2023-11-28T11:54:05.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f4c15e65700 1 -- start start 2023-11-28T11:54:05.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f5113fff700 1 --2- 172.21.15.50:0/974990072 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51140ca700 0x7f51140c1430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f510c009dc0 tx=0x7f510c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10a056165a66b8b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7fb6e631d700 1 -- 172.21.15.50:0/1951757343 >> v1:172.21.15.192:6789/0 conn(0x7fb6e006c0a0 legacy=0x7fb6e006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7fb6e631d700 1 -- 172.21.15.50:0/1951757343 >> v1:172.21.15.50:6789/0 conn(0x7fb6e00ca310 legacy=0x7fb6e0069eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7fb6e631d700 1 -- 172.21.15.50:0/1951757343 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e006a670 con 0x7fb6e006cd80 2023-11-28T11:54:05.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7fb6e4b1a700 1 -- 172.21.15.50:0/1951757343 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3383930231 0 0) 0x7fb6dc001110 con 0x7fb6e006c0a0 2023-11-28T11:54:05.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f6214f9e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f62100ca700 0x7f62100c1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f6214f9e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f62100c1970 0x7f62100b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f5112ffd700 1 -- 172.21.15.50:0/974990072 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c00e070 con 0x7f51140ca700 2023-11-28T11:54:05.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f6214f9e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62100b3c20 0x7f621015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f6214f9e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621006a9d0 con 0x7f62100c1970 2023-11-28T11:54:05.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f6214f9e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62100c1dc0 con 0x7f62100ca700 2023-11-28T11:54:05.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f6214f9e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6210069d50 con 0x7f62100b3c20 2023-11-28T11:54:05.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f5112ffd700 1 -- 172.21.15.50:0/974990072 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c00bb20 con 0x7f51140ca700 2023-11-28T11:54:05.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f5112ffd700 1 -- 172.21.15.50:0/974990072 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c00be90 con 0x7f51140ca700 2023-11-28T11:54:05.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7fb6e631d700 1 --2- 172.21.15.50:0/1951757343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6e006cd80 0x7fb6e015b9f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009dc0 tx=0x7fb6d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=442abfed9493916 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7fb6e4b1a700 1 -- 172.21.15.50:0/1951757343 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d800e070 con 0x7fb6e006cd80 2023-11-28T11:54:05.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f620ed9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62100b3c20 0x7f621015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f620e59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f62100ca700 0x7f62100c1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f620ed9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62100b3c20 0x7f621015fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:54292/0 (socket says 172.21.15.50:54292) 2023-11-28T11:54:05.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f620ed9d700 1 -- 172.21.15.50:0/1838089406 learned_addr learned my addr 172.21.15.50:0/1838089406 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f620dd9b700 1 --2- 172.21.15.50:0/1838089406 >> v2:172.21.15.50:3300/0 conn(0x7f62100c1970 0x7f62100b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f620dd9b700 1 -- 172.21.15.50:0/1838089406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62100b3c20 msgr2=0x7f621015fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:05.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f620dd9b700 1 --2- 172.21.15.50:0/1838089406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62100b3c20 0x7f621015fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f620dd9b700 1 -- 172.21.15.50:0/1838089406 >> v2:172.21.15.192:3300/0 conn(0x7f62100ca700 msgr2=0x7f62100c1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:05.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f620dd9b700 1 --2- 172.21.15.50:0/1838089406 >> v2:172.21.15.192:3300/0 conn(0x7f62100ca700 0x7f62100c1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f620dd9b700 1 -- 172.21.15.50:0/1838089406 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621006a030 con 0x7f62100c1970 2023-11-28T11:54:05.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7fb6e4b1a700 1 -- 172.21.15.50:0/1951757343 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d8003a40 con 0x7fb6e006cd80 2023-11-28T11:54:05.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7fb6e4b1a700 1 -- 172.21.15.50:0/1951757343 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0001670 con 0x7fb6e006cd80 2023-11-28T11:54:05.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f4c15e65700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4c100ceef0 0x7f4c1006a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f4c15e65700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c100cae70 con 0x7f4c101606b0 2023-11-28T11:54:05.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f511a704700 1 -- 172.21.15.50:0/974990072 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51140ca700 msgr2=0x7f51140c1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f511a704700 1 --2- 172.21.15.50:0/974990072 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51140ca700 0x7f51140c1430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f510c009dc0 tx=0x7f510c00b330 comp rx=0 tx=0).stop 2023-11-28T11:54:05.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f4c14e63700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4c101606b0 0x7f4c100c13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56362/0 (socket says 172.21.15.50:56362) 2023-11-28T11:54:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f4c14e63700 1 -- 172.21.15.50:0/996420275 learned_addr learned my addr 172.21.15.50:0/996420275 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f4c15e65700 1 -- 172.21.15.50:0/996420275 --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c100cbc10 con 0x7f4c100c1ac0 2023-11-28T11:54:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f4c15e65700 1 -- 172.21.15.50:0/996420275 --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c100cb130 con 0x7f4c100ceef0 2023-11-28T11:54:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f4c15664700 1 --2- 172.21.15.50:0/996420275 >> v2:172.21.15.192:3300/0 conn(0x7f4c100ceef0 0x7f4c1006a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f620dd9b700 1 --2- 172.21.15.50:0/1838089406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62100c1970 0x7f62100b36e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6210163f10 tx=0x7f6204009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06e8b82115a9bbe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f4c0f7fe700 1 -- 172.21.15.50:0/996420275 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423613725 0 0) 0x7f4c100cae70 con 0x7f4c101606b0 2023-11-28T11:54:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f4c0f7fe700 1 -- 172.21.15.50:0/996420275 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80035d0 con 0x7f4c101606b0 2023-11-28T11:54:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f4c0f7fe700 1 -- 172.21.15.50:0/996420275 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181621376 0 0) 0x7f4c100cbc10 con 0x7f4c100c1ac0 2023-11-28T11:54:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f4c0f7fe700 1 -- 172.21.15.50:0/996420275 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c100cae70 con 0x7f4c100c1ac0 2023-11-28T11:54:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f4c15664700 1 -- 172.21.15.50:0/996420275 >> v1:172.21.15.192:6789/0 conn(0x7f4c100c1ac0 legacy=0x7f4c10069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f4c15664700 1 -- 172.21.15.50:0/996420275 >> v1:172.21.15.50:6789/0 conn(0x7f4c101606b0 legacy=0x7f4c100c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f4c15664700 1 -- 172.21.15.50:0/996420275 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c100cb410 con 0x7f4c100ceef0 2023-11-28T11:54:05.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f511a704700 1 -- 172.21.15.50:0/974990072 shutdown_connections 2023-11-28T11:54:05.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7fb6e6b1e700 1 -- 172.21.15.50:0/1951757343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6e006cd80 msgr2=0x7fb6e015b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7fb6e6b1e700 1 --2- 172.21.15.50:0/1951757343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6e006cd80 0x7fb6e015b9f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009dc0 tx=0x7fb6d800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:05.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f511a704700 1 --2- 172.21.15.50:0/974990072 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51140ca700 0x7f51140c1430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f511a704700 1 -- 172.21.15.50:0/974990072 >> 172.21.15.50:0/974990072 conn(0x7f51140ce460 msgr2=0x7f51140ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f511a704700 1 -- 172.21.15.50:0/974990072 shutdown_connections 2023-11-28T11:54:05.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f620d59a700 1 -- 172.21.15.50:0/1838089406 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204011830 con 0x7f62100c1970 2023-11-28T11:54:05.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f511a704700 1 -- 172.21.15.50:0/974990072 wait complete. 2023-11-28T11:54:05.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f620d59a700 1 -- 172.21.15.50:0/1838089406 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6204011990 con 0x7f62100c1970 2023-11-28T11:54:05.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f620d59a700 1 -- 172.21.15.50:0/1838089406 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204011d20 con 0x7f62100c1970 2023-11-28T11:54:05.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.501+0000 7f4c15664700 1 --2- 172.21.15.50:0/996420275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c100ceef0 0x7f4c1006a350 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009d90 tx=0x7f4c0800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f651a0fcf9227ab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f4c0f7fe700 1 -- 172.21.15.50:0/996420275 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0800e070 con 0x7f4c100ceef0 2023-11-28T11:54:05.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f4c0f7fe700 1 -- 172.21.15.50:0/996420275 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c08003a40 con 0x7f4c100ceef0 2023-11-28T11:54:05.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f4c0f7fe700 1 -- 172.21.15.50:0/996420275 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00001670 con 0x7f4c100ceef0 2023-11-28T11:54:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f6214f9e700 1 -- 172.21.15.50:0/1838089406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62100c1970 msgr2=0x7f62100b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f6214f9e700 1 --2- 172.21.15.50:0/1838089406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62100c1970 0x7f62100b36e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6210163f10 tx=0x7f6204009b30 comp rx=0 tx=0).stop 2023-11-28T11:54:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f6214f9e700 1 -- 172.21.15.50:0/1838089406 shutdown_connections 2023-11-28T11:54:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f6214f9e700 1 --2- 172.21.15.50:0/1838089406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62100b3c20 0x7f621015fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f6214f9e700 1 --2- 172.21.15.50:0/1838089406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62100c1970 0x7f62100b36e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f6214f9e700 1 --2- 172.21.15.50:0/1838089406 >> v2:172.21.15.192:3300/0 conn(0x7f62100ca700 0x7f62100c1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f6214f9e700 1 -- 172.21.15.50:0/1838089406 >> 172.21.15.50:0/1838089406 conn(0x7f62100ce460 msgr2=0x7f62100ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f6214f9e700 1 -- 172.21.15.50:0/1838089406 shutdown_connections 2023-11-28T11:54:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f4c15e65700 1 -- 172.21.15.50:0/996420275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c100ceef0 msgr2=0x7f4c1006a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f4c15e65700 1 --2- 172.21.15.50:0/996420275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c100ceef0 0x7f4c1006a350 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009d90 tx=0x7f4c0800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f6214f9e700 1 -- 172.21.15.50:0/1838089406 wait complete. 2023-11-28T11:54:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f511a704700 1 Processor -- start 2023-11-28T11:54:05.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f511a704700 1 -- start start 2023-11-28T11:54:05.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f6214f9e700 1 Processor -- start 2023-11-28T11:54:05.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f6214f9e700 1 -- start start 2023-11-28T11:54:05.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7fb6e6b1e700 1 -- 172.21.15.50:0/1951757343 shutdown_connections 2023-11-28T11:54:05.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7fb6e6b1e700 1 --2- 172.21.15.50:0/1951757343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6e006cd80 0x7fb6e015b9f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7fb6e6b1e700 1 -- 172.21.15.50:0/1951757343 >> 172.21.15.50:0/1951757343 conn(0x7fb6e00ce3e0 msgr2=0x7fb6e00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7fb6e6b1e700 1 -- 172.21.15.50:0/1951757343 shutdown_connections 2023-11-28T11:54:05.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7fb6e6b1e700 1 -- 172.21.15.50:0/1951757343 wait complete. 2023-11-28T11:54:05.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f511a704700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51140b3df0 0x7f511415e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f511a704700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51140c1970 0x7f51140abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f511a704700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51140ca700 0x7f51140ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f511a704700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511415feb0 con 0x7f51140c1970 2023-11-28T11:54:05.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f511a704700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51140ace60 con 0x7f51140b3df0 2023-11-28T11:54:05.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f511a704700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511415f2a0 con 0x7f51140ca700 2023-11-28T11:54:05.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f6214f9e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62100b3c20 0x7f621015e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f6214f9e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62100c1970 0x7f62100c4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f6214f9e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62100ca700 0x7f62100ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f6214f9e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6210161cb0 con 0x7f62100ca700 2023-11-28T11:54:05.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f6214f9e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6210160e30 con 0x7f62100c1970 2023-11-28T11:54:05.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f6214f9e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6210160b50 con 0x7f62100b3c20 2023-11-28T11:54:05.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f5118ca1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51140ca700 0x7f51140ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f5113fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51140b3df0 0x7f511415e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f5113fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51140b3df0 0x7f511415e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:55706/0 (socket says 172.21.15.50:55706) 2023-11-28T11:54:05.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f5113fff700 1 -- 172.21.15.50:0/1578214356 learned_addr learned my addr 172.21.15.50:0/1578214356 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f5118ca1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51140ca700 0x7f51140ac1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:54308/0 (socket says 172.21.15.50:54308) 2023-11-28T11:54:05.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f51137fe700 1 --2- 172.21.15.50:0/1578214356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51140c1970 0x7f51140abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f4c15e65700 1 -- 172.21.15.50:0/996420275 shutdown_connections 2023-11-28T11:54:05.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f620dd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62100c1970 0x7f62100c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f620dd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62100c1970 0x7f62100c4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:55718/0 (socket says 172.21.15.50:55718) 2023-11-28T11:54:05.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f620dd9b700 1 -- 172.21.15.50:0/2905316436 learned_addr learned my addr 172.21.15.50:0/2905316436 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f4c15e65700 1 --2- 172.21.15.50:0/996420275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c100ceef0 0x7f4c1006a350 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f4c15e65700 1 -- 172.21.15.50:0/996420275 >> 172.21.15.50:0/996420275 conn(0x7f4c100ce3e0 msgr2=0x7f4c100ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f4c15e65700 1 -- 172.21.15.50:0/996420275 shutdown_connections 2023-11-28T11:54:05.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f620ed9d700 1 --2- 172.21.15.50:0/2905316436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62100ca700 0x7f62100ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f51137fe700 1 -- 172.21.15.50:0/1578214356 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51140ca700 msgr2=0x7f51140ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f51137fe700 1 --2- 172.21.15.50:0/1578214356 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51140ca700 0x7f51140ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f51137fe700 1 -- 172.21.15.50:0/1578214356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51140b3df0 msgr2=0x7f511415e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f51137fe700 1 --2- 172.21.15.50:0/1578214356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51140b3df0 0x7f511415e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f51137fe700 1 -- 172.21.15.50:0/1578214356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c009a70 con 0x7f51140c1970 2023-11-28T11:54:05.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f4c15e65700 1 -- 172.21.15.50:0/996420275 wait complete. 2023-11-28T11:54:05.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f165945f700 1 Processor -- start 2023-11-28T11:54:05.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e6b1e700 1 Processor -- start 2023-11-28T11:54:05.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.505+0000 7f165945f700 1 -- start start 2023-11-28T11:54:05.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f165945f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f16540ada60 0x7f16540cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f620ed9d700 1 -- 172.21.15.50:0/2905316436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62100b3c20 msgr2=0x7f621015e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f620ed9d700 1 --2- 172.21.15.50:0/2905316436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62100b3c20 0x7f621015e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f620ed9d700 1 -- 172.21.15.50:0/2905316436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62100c1970 msgr2=0x7f62100c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f620ed9d700 1 --2- 172.21.15.50:0/2905316436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62100c1970 0x7f62100c4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f620ed9d700 1 -- 172.21.15.50:0/2905316436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62040094b0 con 0x7f62100ca700 2023-11-28T11:54:05.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f4c15e65700 1 Processor -- start 2023-11-28T11:54:05.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f620ed9d700 1 --2- 172.21.15.50:0/2905316436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62100ca700 0x7f62100ac390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f620800eab0 tx=0x7f620800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e6b1e700 1 -- start start 2023-11-28T11:54:05.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e6b1e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e006c0a0 0x7fb6e009aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e6b1e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6e006cd80 0x7fb6e0157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e6b1e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6e00ca310 0x7fb6e0098260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e6b1e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e0099e90 con 0x7fb6e006c0a0 2023-11-28T11:54:05.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e6b1e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e00987a0 con 0x7fb6e006cd80 2023-11-28T11:54:05.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e6b1e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e009a130 con 0x7fb6e00ca310 2023-11-28T11:54:05.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f944b341700 1 Processor -- start 2023-11-28T11:54:05.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f944b341700 1 -- start start 2023-11-28T11:54:05.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f51137fe700 1 --2- 172.21.15.50:0/1578214356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51140c1970 0x7f51140abc90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f510400c430 tx=0x7f510400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f5110ff9700 1 -- 172.21.15.50:0/1578214356 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51040052d0 con 0x7f51140c1970 2023-11-28T11:54:05.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f5110ff9700 1 -- 172.21.15.50:0/1578214356 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5104005450 con 0x7f51140c1970 2023-11-28T11:54:05.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f5110ff9700 1 -- 172.21.15.50:0/1578214356 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51040038e0 con 0x7f51140c1970 2023-11-28T11:54:05.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f511a704700 1 -- 172.21.15.50:0/1578214356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511406a310 con 0x7f51140c1970 2023-11-28T11:54:05.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f511a704700 1 -- 172.21.15.50:0/1578214356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511406a030 con 0x7f51140c1970 2023-11-28T11:54:05.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e5b1c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e006c0a0 0x7fb6e009aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e5b1c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e006c0a0 0x7fb6e009aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53208/0 (socket says 172.21.15.50:53208) 2023-11-28T11:54:05.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e5b1c700 1 -- 172.21.15.50:0/1143367904 learned_addr learned my addr 172.21.15.50:0/1143367904 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e631d700 1 --2- 172.21.15.50:0/1143367904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6e00ca310 0x7fb6e0098260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e531b700 1 --2- 172.21.15.50:0/1143367904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6e006cd80 0x7fb6e0157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e5b1c700 1 -- 172.21.15.50:0/1143367904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6e00ca310 msgr2=0x7fb6e0098260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e5b1c700 1 --2- 172.21.15.50:0/1143367904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6e00ca310 0x7fb6e0098260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e5b1c700 1 -- 172.21.15.50:0/1143367904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6e006cd80 msgr2=0x7fb6e0157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e5b1c700 1 --2- 172.21.15.50:0/1143367904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6e006cd80 0x7fb6e0157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e5b1c700 1 -- 172.21.15.50:0/1143367904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d8009a70 con 0x7fb6e006c0a0 2023-11-28T11:54:05.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f511a704700 1 -- 172.21.15.50:0/1578214356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f511406a5f0 con 0x7f51140c1970 2023-11-28T11:54:05.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f944b341700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9444160720 0x7f9444069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f944b341700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94440b08c0 0x7f94440b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f944b341700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f944406a220 con 0x7f94440b47b0 2023-11-28T11:54:05.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f944b341700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9444160af0 con 0x7f9444160720 2023-11-28T11:54:05.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f944b341700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94440b5740 con 0x7f94440b08c0 2023-11-28T11:54:05.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f944ab40700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f94440b47b0 0x7f9444164130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56378/0 (socket says 172.21.15.50:56378) 2023-11-28T11:54:05.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f944ab40700 1 -- 172.21.15.50:0/3611789630 learned_addr learned my addr 172.21.15.50:0/3611789630 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:05.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f9449b3e700 1 --2- 172.21.15.50:0/3611789630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94440b08c0 0x7f94440b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f944a33f700 1 --2- 172.21.15.50:0/3611789630 >> v2:172.21.15.192:3300/0 conn(0x7f9444160720 0x7f9444069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f944933d700 1 -- 172.21.15.50:0/3611789630 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677098520 0 0) 0x7f944406a220 con 0x7f94440b47b0 2023-11-28T11:54:05.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f944933d700 1 -- 172.21.15.50:0/3611789630 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94300145e0 con 0x7f94440b47b0 2023-11-28T11:54:05.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f61feffd700 1 -- 172.21.15.50:0/2905316436 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6208010040 con 0x7f62100ca700 2023-11-28T11:54:05.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f61feffd700 1 -- 172.21.15.50:0/2905316436 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6208003c40 con 0x7f62100ca700 2023-11-28T11:54:05.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f61feffd700 1 -- 172.21.15.50:0/2905316436 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6208004030 con 0x7f62100ca700 2023-11-28T11:54:05.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f165945f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f165406b420 0x7f16540c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f165945f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16540715c0 con 0x7f16540c18f0 2023-11-28T11:54:05.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f165945f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16540c1d70 con 0x7f16540ada60 2023-11-28T11:54:05.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f165945f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165406bce0 con 0x7f165406b420 2023-11-28T11:54:05.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f1653fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f16540ada60 0x7f16540cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f16537fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f165406b420 0x7f16540c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f1653fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f16540ada60 0x7f16540cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53196/0 (socket says 172.21.15.50:53196) 2023-11-28T11:54:05.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f1653fff700 1 -- 172.21.15.50:0/628430029 learned_addr learned my addr 172.21.15.50:0/628430029 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f1653fff700 1 -- 172.21.15.50:0/628430029 >> v2:172.21.15.192:3300/0 conn(0x7f165406b420 msgr2=0x7f16540c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:05.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f1653fff700 1 --2- 172.21.15.50:0/628430029 >> v2:172.21.15.192:3300/0 conn(0x7f165406b420 0x7f16540c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f1653fff700 1 -- 172.21.15.50:0/628430029 >> v1:172.21.15.192:6789/0 conn(0x7f16540c18f0 legacy=0x7f16540b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f1653fff700 1 -- 172.21.15.50:0/628430029 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16540cbd40 con 0x7f16540ada60 2023-11-28T11:54:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f16537fe700 1 --2- 172.21.15.50:0/628430029 >> v2:172.21.15.192:3300/0 conn(0x7f165406b420 0x7f16540c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f1653fff700 1 --2- 172.21.15.50:0/628430029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16540ada60 0x7f16540cb800 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f165406f950 tx=0x7f164c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33ae3f0d1adb03c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f1652ffd700 1 -- 172.21.15.50:0/628430029 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c00e070 con 0x7f16540ada60 2023-11-28T11:54:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f1652ffd700 1 -- 172.21.15.50:0/628430029 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164c00b9c0 con 0x7f16540ada60 2023-11-28T11:54:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f1652ffd700 1 -- 172.21.15.50:0/628430029 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c00bd70 con 0x7f16540ada60 2023-11-28T11:54:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f165945f700 1 -- 172.21.15.50:0/628430029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16540ada60 msgr2=0x7f16540cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f165945f700 1 --2- 172.21.15.50:0/628430029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16540ada60 0x7f16540cb800 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f165406f950 tx=0x7f164c00b330 comp rx=0 tx=0).stop 2023-11-28T11:54:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f4c15e65700 1 -- start start 2023-11-28T11:54:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f4c15e65700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4c100c1ac0 0x7f4c10071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f4c15e65700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c100ceef0 0x7f4c10162100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f4c15e65700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c101606b0 0x7f4c1006fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f5110ff9700 1 -- 172.21.15.50:0/1578214356 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5104019030 con 0x7f51140c1970 2023-11-28T11:54:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f5110ff9700 1 --2- 172.21.15.50:0/1578214356 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5100064ee0 0x7f5100067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f5110ff9700 1 -- 172.21.15.50:0/1578214356 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5104081590 con 0x7f51140c1970 2023-11-28T11:54:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f5110ff9700 1 --2- 172.21.15.50:0/1578214356 >> [v2:172.21.15.192:6816/36819,v1:172.21.15.192:6817/36819] conn(0x7f510006ebb0 0x7f5100070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f5110ff9700 1 -- 172.21.15.50:0/1578214356 --> [v2:172.21.15.192:6816/36819,v1:172.21.15.192:6817/36819] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51000716b0 con 0x7f510006ebb0 2023-11-28T11:54:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f5110ff9700 1 -- 172.21.15.50:0/1578214356 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5104083af0 con 0x7f51140c1970 2023-11-28T11:54:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6e5b1c700 1 --2- 172.21.15.50:0/1143367904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e006c0a0 0x7fb6e009aef0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00c4a0 tx=0x7fb6dc00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f4c15e65700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c101f91f0 con 0x7f4c101606b0 2023-11-28T11:54:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f4c15e65700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c101f94d0 con 0x7f4c100ceef0 2023-11-28T11:54:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7f4c15e65700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c101f97b0 con 0x7f4c100c1ac0 2023-11-28T11:54:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.509+0000 7fb6d67fc700 1 -- 172.21.15.50:0/1143367904 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc004ca0 con 0x7fb6e006c0a0 2023-11-28T11:54:05.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f9449b3e700 1 -- 172.21.15.50:0/3611789630 >> v2:172.21.15.192:3300/0 conn(0x7f9444160720 msgr2=0x7f9444069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:05.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f9449b3e700 1 --2- 172.21.15.50:0/3611789630 >> v2:172.21.15.192:3300/0 conn(0x7f9444160720 0x7f9444069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f9449b3e700 1 -- 172.21.15.50:0/3611789630 >> v1:172.21.15.50:6789/0 conn(0x7f94440b47b0 legacy=0x7f9444164130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f9449b3e700 1 -- 172.21.15.50:0/3611789630 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94440b00b0 con 0x7f94440b08c0 2023-11-28T11:54:05.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f5113fff700 1 --2- 172.21.15.50:0/1578214356 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5100064ee0 0x7f5100067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f4c15664700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c101606b0 0x7f4c1006fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f6214f9e700 1 -- 172.21.15.50:0/2905316436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621006a5f0 con 0x7f62100ca700 2023-11-28T11:54:05.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f5118ca1700 1 --2- 172.21.15.50:0/1578214356 >> [v2:172.21.15.192:6816/36819,v1:172.21.15.192:6817/36819] conn(0x7f510006ebb0 0x7f5100070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f6214f9e700 1 -- 172.21.15.50:0/2905316436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621006a310 con 0x7f62100ca700 2023-11-28T11:54:05.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f4c14e63700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4c100c1ac0 0x7f4c10071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f4c14e63700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4c100c1ac0 0x7f4c10071330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:54344/0 (socket says 172.21.15.50:54344) 2023-11-28T11:54:05.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f4c14e63700 1 -- 172.21.15.50:0/857719325 learned_addr learned my addr 172.21.15.50:0/857719325 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7fb6e6b1e700 1 -- 172.21.15.50:0/1143367904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e006ac30 con 0x7fb6e006c0a0 2023-11-28T11:54:05.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7fb6d67fc700 1 -- 172.21.15.50:0/1143367904 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6dc004e00 con 0x7fb6e006c0a0 2023-11-28T11:54:05.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7fb6e6b1e700 1 -- 172.21.15.50:0/1143367904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e006a950 con 0x7fb6e006c0a0 2023-11-28T11:54:05.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f165945f700 1 -- 172.21.15.50:0/628430029 shutdown_connections 2023-11-28T11:54:05.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f165945f700 1 --2- 172.21.15.50:0/628430029 >> v2:172.21.15.192:3300/0 conn(0x7f165406b420 0x7f16540c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f165945f700 1 --2- 172.21.15.50:0/628430029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16540ada60 0x7f16540cb800 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f165945f700 1 -- 172.21.15.50:0/628430029 >> 172.21.15.50:0/628430029 conn(0x7f16540b1f90 msgr2=0x7f16540ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f9449b3e700 1 --2- 172.21.15.50:0/3611789630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94440b08c0 0x7f94440b4270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9440009850 tx=0x7f9440009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4972b8c9efba1a54 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7fb6d67fc700 1 -- 172.21.15.50:0/1143367904 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc0072f0 con 0x7fb6e006c0a0 2023-11-28T11:54:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7fb6e6b1e700 1 -- 172.21.15.50:0/1143367904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb6c8000fc0 con 0x7fb6e006c0a0 2023-11-28T11:54:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f165945f700 1 -- 172.21.15.50:0/628430029 shutdown_connections 2023-11-28T11:54:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f165945f700 1 -- 172.21.15.50:0/628430029 wait complete. 2023-11-28T11:54:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f944933d700 1 -- 172.21.15.50:0/3611789630 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440011830 con 0x7f94440b08c0 2023-11-28T11:54:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f944933d700 1 -- 172.21.15.50:0/3611789630 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9440011990 con 0x7f94440b08c0 2023-11-28T11:54:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f944933d700 1 -- 172.21.15.50:0/3611789630 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440011d40 con 0x7f94440b08c0 2023-11-28T11:54:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f4c0ffff700 1 --2- 172.21.15.50:0/857719325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c100ceef0 0x7f4c10162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f4c14e63700 1 -- 172.21.15.50:0/857719325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c100ceef0 msgr2=0x7f4c10162100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f4c14e63700 1 --2- 172.21.15.50:0/857719325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c100ceef0 0x7f4c10162100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f4c14e63700 1 -- 172.21.15.50:0/857719325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c101606b0 msgr2=0x7f4c1006fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f4c14e63700 1 --2- 172.21.15.50:0/857719325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c101606b0 0x7f4c1006fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f4c14e63700 1 -- 172.21.15.50:0/857719325 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c08009a70 con 0x7f4c100c1ac0 2023-11-28T11:54:05.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f4c14e63700 1 --2- 172.21.15.50:0/857719325 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4c100c1ac0 0x7f4c10071330 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000c750 tx=0x7f4c0000ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f4c0d7fa700 1 -- 172.21.15.50:0/857719325 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00004ca0 con 0x7f4c100c1ac0 2023-11-28T11:54:05.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f4c15e65700 1 -- 172.21.15.50:0/857719325 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c100b36c0 con 0x7f4c100c1ac0 2023-11-28T11:54:05.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f4c15e65700 1 -- 172.21.15.50:0/857719325 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c100cb6f0 con 0x7f4c100c1ac0 2023-11-28T11:54:05.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f944b341700 1 -- 172.21.15.50:0/3611789630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94440b08c0 msgr2=0x7f94440b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f944b341700 1 --2- 172.21.15.50:0/3611789630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94440b08c0 0x7f94440b4270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9440009850 tx=0x7f9440009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:05.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f4c0d7fa700 1 -- 172.21.15.50:0/857719325 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c00004e00 con 0x7f4c100c1ac0 2023-11-28T11:54:05.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f4c0d7fa700 1 -- 172.21.15.50:0/857719325 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00007310 con 0x7f4c100c1ac0 2023-11-28T11:54:05.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f5118ca1700 1 --2- 172.21.15.50:0/1578214356 >> [v2:172.21.15.192:6816/36819,v1:172.21.15.192:6817/36819] conn(0x7f510006ebb0 0x7f5100070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f165945f700 1 Processor -- start 2023-11-28T11:54:05.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7fb707fff700 1 Processor -- start 2023-11-28T11:54:05.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7fb707fff700 1 -- start start 2023-11-28T11:54:05.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f5113fff700 1 --2- 172.21.15.50:0/1578214356 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5100064ee0 0x7f5100067390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f510c000f80 tx=0x7f510c011000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f61fcff9700 1 -- 172.21.15.50:0/2905316436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62100b40c0 con 0x7f62100ca700 2023-11-28T11:54:05.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f61feffd700 1 -- 172.21.15.50:0/2905316436 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f620801c030 con 0x7f62100ca700 2023-11-28T11:54:05.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f61feffd700 1 --2- 172.21.15.50:0/2905316436 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f61f0064f30 0x7f61f00673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7fb6d67fc700 1 -- 172.21.15.50:0/1143367904 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb6dc01a020 con 0x7fb6e006c0a0 2023-11-28T11:54:05.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f61feffd700 1 -- 172.21.15.50:0/2905316436 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6208081db0 con 0x7f62100ca700 2023-11-28T11:54:05.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f944b341700 1 -- 172.21.15.50:0/3611789630 shutdown_connections 2023-11-28T11:54:05.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f944b341700 1 --2- 172.21.15.50:0/3611789630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94440b08c0 0x7f94440b4270 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f944b341700 1 --2- 172.21.15.50:0/3611789630 >> v2:172.21.15.192:3300/0 conn(0x7f9444160720 0x7f9444069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f944b341700 1 -- 172.21.15.50:0/3611789630 >> 172.21.15.50:0/3611789630 conn(0x7f94440cf270 msgr2=0x7f94440cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f944b341700 1 -- 172.21.15.50:0/3611789630 shutdown_connections 2023-11-28T11:54:05.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f944b341700 1 -- 172.21.15.50:0/3611789630 wait complete. 2023-11-28T11:54:05.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f61feffd700 1 --2- 172.21.15.50:0/2905316436 >> [v2:172.21.15.50:6816/36464,v1:172.21.15.50:6817/36464] conn(0x7f61f006eb80 0x7f61f0070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f61feffd700 1 -- 172.21.15.50:0/2905316436 --> [v2:172.21.15.50:6816/36464,v1:172.21.15.50:6817/36464] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f61f0071680 con 0x7f61f006eb80 2023-11-28T11:54:05.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f61feffd700 1 -- 172.21.15.50:0/2905316436 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f620804fd00 con 0x7f62100ca700 2023-11-28T11:54:05.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f620e59c700 1 --2- 172.21.15.50:0/2905316436 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f61f0064f30 0x7f61f00673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7fb707fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb708071c70 0x7fb7080cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7fb707fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb7080b3a90 0x7fb708173cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f4c15e65700 1 -- 172.21.15.50:0/857719325 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4bec000fc0 con 0x7f4c100c1ac0 2023-11-28T11:54:05.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7fb707fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb708072040 con 0x7fb70806f7c0 2023-11-28T11:54:05.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7fb707fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb708072280 con 0x7fb7080b3a90 2023-11-28T11:54:05.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7fb707fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080cec00 con 0x7fb708071c70 2023-11-28T11:54:05.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.513+0000 7f165945f700 1 -- start start 2023-11-28T11:54:05.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb6d67fc700 1 --2- 172.21.15.50:0/1143367904 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb6c4064fb0 0x7fb6c4067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb7067fc700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb70806f7c0 0x7fb7080b3380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:51182/0 (socket says 172.21.15.50:51182) 2023-11-28T11:54:05.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb7067fc700 1 -- 172.21.15.50:0/3352146721 learned_addr learned my addr 172.21.15.50:0/3352146721 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:05.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb6d67fc700 1 -- 172.21.15.50:0/1143367904 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb6dc082370 con 0x7fb6e006c0a0 2023-11-28T11:54:05.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f620dd9b700 1 --2- 172.21.15.50:0/2905316436 >> [v2:172.21.15.50:6816/36464,v1:172.21.15.50:6817/36464] conn(0x7f61f006eb80 0x7f61f0070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb6d67fc700 1 --2- 172.21.15.50:0/1143367904 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x7fb6c406ec80 0x7fb6c40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb6d67fc700 1 -- 172.21.15.50:0/1143367904 --> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb6c4071780 con 0x7fb6c406ec80 2023-11-28T11:54:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb6d67fc700 1 -- 172.21.15.50:0/1143367904 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6dc082720 con 0x7fb6e006c0a0 2023-11-28T11:54:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f620e59c700 1 --2- 172.21.15.50:0/2905316436 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f61f0064f30 0x7f61f00673e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6200006b40 tx=0x7f6200006ad0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f165945f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f165406b420 0x7f16540cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb6e631d700 1 --2- 172.21.15.50:0/1143367904 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x7fb6c406ec80 0x7fb6c40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944b341700 1 Processor -- start 2023-11-28T11:54:05.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f620dd9b700 1 --2- 172.21.15.50:0/2905316436 >> [v2:172.21.15.50:6816/36464,v1:172.21.15.50:6817/36464] conn(0x7f61f006eb80 0x7f61f0070fb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb706ffd700 1 --2- 172.21.15.50:0/3352146721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb708071c70 0x7fb7080cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944b341700 1 -- start start 2023-11-28T11:54:05.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f5110ff9700 1 -- 172.21.15.50:0/1578214356 <== osd.4 v2:172.21.15.192:6816/36819 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f51000716b0 con 0x7f510006ebb0 2023-11-28T11:54:05.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb705ffb700 1 -- 172.21.15.50:0/3352146721 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266733205 0 0) 0x7fb6fc001110 con 0x7fb70806f7c0 2023-11-28T11:54:05.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb705ffb700 1 -- 172.21.15.50:0/3352146721 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6f00035d0 con 0x7fb70806f7c0 2023-11-28T11:54:05.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f165945f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16540c18f0 0x7f165415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f1653fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f165406b420 0x7f16540cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f1653fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f165406b420 0x7f16540cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:54354/0 (socket says 172.21.15.50:54354) 2023-11-28T11:54:05.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f1653fff700 1 -- 172.21.15.50:0/4259589348 learned_addr learned my addr 172.21.15.50:0/4259589348 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f165945f700 1 --2- 172.21.15.50:0/4259589348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f165406c170 0x7f165406c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f4c0d7fa700 1 -- 172.21.15.50:0/857719325 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4c0001a030 con 0x7f4c100c1ac0 2023-11-28T11:54:05.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f16537fe700 1 --2- 172.21.15.50:0/4259589348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16540c18f0 0x7f165415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb6e531b700 1 --2- 172.21.15.50:0/1143367904 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb6c4064fb0 0x7fb6c4067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f165945f700 1 -- 172.21.15.50:0/4259589348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16540c7970 con 0x7f165406c170 2023-11-28T11:54:05.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f165945f700 1 -- 172.21.15.50:0/4259589348 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16540cca10 con 0x7f16540c18f0 2023-11-28T11:54:05.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb7077fe700 1 --2- 172.21.15.50:0/3352146721 >> v2:172.21.15.50:3300/0 conn(0x7fb7080b3a90 0x7fb708173cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f165945f700 1 -- 172.21.15.50:0/4259589348 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165406cb50 con 0x7f165406b420 2023-11-28T11:54:05.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb6e631d700 1 --2- 172.21.15.50:0/1143367904 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x7fb6c406ec80 0x7fb6c40710b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb705ffb700 1 -- 172.21.15.50:0/3352146721 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2538060687 0 0) 0x7fb6f00035d0 con 0x7fb70806f7c0 2023-11-28T11:54:05.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb7077fe700 1 -- 172.21.15.50:0/3352146721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb708071c70 msgr2=0x7fb7080cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:05.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb7077fe700 1 --2- 172.21.15.50:0/3352146721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb708071c70 0x7fb7080cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f61feffd700 1 -- 172.21.15.50:0/2905316436 <== osd.1 v2:172.21.15.50:6816/36464 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f61f0071680 con 0x7f61f006eb80 2023-11-28T11:54:05.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944b341700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94440b08c0 0x7f9444159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f4c0d7fa700 1 --2- 172.21.15.50:0/857719325 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4bf4064ee0 0x7f4bf4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb7077fe700 1 -- 172.21.15.50:0/3352146721 >> v1:172.21.15.192:6789/0 conn(0x7fb70806f7c0 legacy=0x7fb7080b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f1658c5e700 1 --2- 172.21.15.50:0/4259589348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f165406c170 0x7f165406c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb7077fe700 1 -- 172.21.15.50:0/3352146721 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7080ceee0 con 0x7fb7080b3a90 2023-11-28T11:54:05.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944b341700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94440b47b0 0x7f9444154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944b341700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9444160720 0x7f9444156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944b341700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94441563c0 con 0x7f94440b08c0 2023-11-28T11:54:05.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944b341700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94441557b0 con 0x7f9444160720 2023-11-28T11:54:05.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944b341700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9444155a90 con 0x7f94440b47b0 2023-11-28T11:54:05.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f16537fe700 1 -- 172.21.15.50:0/4259589348 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f165406b420 msgr2=0x7f16540cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f16537fe700 1 --2- 172.21.15.50:0/4259589348 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f165406b420 0x7f16540cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f16537fe700 1 -- 172.21.15.50:0/4259589348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f165406c170 msgr2=0x7f165406c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f16537fe700 1 --2- 172.21.15.50:0/4259589348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f165406c170 0x7f165406c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f16537fe700 1 -- 172.21.15.50:0/4259589348 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c009b30 con 0x7f16540c18f0 2023-11-28T11:54:05.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944a33f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94440b08c0 0x7f9444159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944a33f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94440b08c0 0x7f9444159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53266/0 (socket says 172.21.15.50:53266) 2023-11-28T11:54:05.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944a33f700 1 -- 172.21.15.50:0/2119877094 learned_addr learned my addr 172.21.15.50:0/2119877094 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb7077fe700 1 --2- 172.21.15.50:0/3352146721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7080b3a90 0x7fb708173cb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009850 tx=0x7fb6f8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5f80e03c8f36b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb6e531b700 1 --2- 172.21.15.50:0/1143367904 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb6c4064fb0 0x7fb6c4067460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00017a0 tx=0x7fb6d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f16537fe700 1 --2- 172.21.15.50:0/4259589348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16540c18f0 0x7f165415a2c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f164400e7e0 tx=0x7f164400eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944ab40700 1 --2- 172.21.15.50:0/2119877094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9444160720 0x7f9444156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f9449b3e700 1 --2- 172.21.15.50:0/2119877094 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94440b47b0 0x7f9444154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944a33f700 1 -- 172.21.15.50:0/2119877094 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94440b47b0 msgr2=0x7f9444154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944a33f700 1 --2- 172.21.15.50:0/2119877094 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94440b47b0 0x7f9444154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944a33f700 1 -- 172.21.15.50:0/2119877094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9444160720 msgr2=0x7f9444156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944a33f700 1 --2- 172.21.15.50:0/2119877094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9444160720 0x7f9444156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944a33f700 1 -- 172.21.15.50:0/2119877094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94400094b0 con 0x7f94440b08c0 2023-11-28T11:54:05.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb705ffb700 1 -- 172.21.15.50:0/3352146721 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc001800 con 0x7fb7080b3a90 2023-11-28T11:54:05.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb705ffb700 1 -- 172.21.15.50:0/3352146721 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f8004030 con 0x7fb7080b3a90 2023-11-28T11:54:05.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7fb705ffb700 1 -- 172.21.15.50:0/3352146721 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80043e0 con 0x7fb7080b3a90 2023-11-28T11:54:05.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944a33f700 1 --2- 172.21.15.50:0/2119877094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94440b08c0 0x7f9444159640 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f943c00efc0 tx=0x7f943c00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f943affd700 1 -- 172.21.15.50:0/2119877094 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c00cc00 con 0x7f94440b08c0 2023-11-28T11:54:05.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f943affd700 1 -- 172.21.15.50:0/2119877094 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c00f040 con 0x7f94440b08c0 2023-11-28T11:54:05.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944b341700 1 -- 172.21.15.50:0/2119877094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94440afda0 con 0x7f94440b08c0 2023-11-28T11:54:05.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f944b341700 1 -- 172.21.15.50:0/2119877094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94440b0390 con 0x7f94440b08c0 2023-11-28T11:54:05.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.517+0000 7f943affd700 1 -- 172.21.15.50:0/2119877094 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c014480 con 0x7f94440b08c0 2023-11-28T11:54:05.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7f1650ff9700 1 -- 172.21.15.50:0/4259589348 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400c070 con 0x7f16540c18f0 2023-11-28T11:54:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7f1650ff9700 1 -- 172.21.15.50:0/4259589348 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1644013610 con 0x7f16540c18f0 2023-11-28T11:54:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7f1650ff9700 1 -- 172.21.15.50:0/4259589348 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440139a0 con 0x7f16540c18f0 2023-11-28T11:54:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7f4c0d7fa700 1 -- 172.21.15.50:0/857719325 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4c00081760 con 0x7f4c100c1ac0 2023-11-28T11:54:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7f4c0d7fa700 1 --2- 172.21.15.50:0/857719325 >> [v2:172.21.15.50:6808/36466,v1:172.21.15.50:6809/36466] conn(0x7f4bf406ebb0 0x7f4bf4070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7f4c0d7fa700 1 -- 172.21.15.50:0/857719325 --> [v2:172.21.15.50:6808/36466,v1:172.21.15.50:6809/36466] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4bf40716b0 con 0x7f4bf406ebb0 2023-11-28T11:54:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7f4c0d7fa700 1 -- 172.21.15.50:0/857719325 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c00081b10 con 0x7f4c100c1ac0 2023-11-28T11:54:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7fb707fff700 1 -- 172.21.15.50:0/3352146721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7080b3a90 msgr2=0x7fb708173cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7fb707fff700 1 --2- 172.21.15.50:0/3352146721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7080b3a90 0x7fb708173cb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009850 tx=0x7fb6f8009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7fb707fff700 1 -- 172.21.15.50:0/3352146721 shutdown_connections 2023-11-28T11:54:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7fb707fff700 1 --2- 172.21.15.50:0/3352146721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7080b3a90 0x7fb708173cb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7fb707fff700 1 --2- 172.21.15.50:0/3352146721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb708071c70 0x7fb7080cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7fb707fff700 1 -- 172.21.15.50:0/3352146721 >> 172.21.15.50:0/3352146721 conn(0x7fb7080b1f90 msgr2=0x7fb7080ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7fb707fff700 1 -- 172.21.15.50:0/3352146721 shutdown_connections 2023-11-28T11:54:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7f944b341700 1 -- 172.21.15.50:0/2119877094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f942c000fc0 con 0x7f94440b08c0 2023-11-28T11:54:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7f943affd700 1 -- 172.21.15.50:0/2119877094 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f943c0145e0 con 0x7f94440b08c0 2023-11-28T11:54:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7f4c15664700 1 --2- 172.21.15.50:0/857719325 >> [v2:172.21.15.50:6808/36466,v1:172.21.15.50:6809/36466] conn(0x7f4bf406ebb0 0x7f4bf4070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7fb707fff700 1 -- 172.21.15.50:0/3352146721 wait complete. 2023-11-28T11:54:05.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7fb707fff700 1 Processor -- start 2023-11-28T11:54:05.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7f165945f700 1 -- 172.21.15.50:0/4259589348 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1654071af0 con 0x7f16540c18f0 2023-11-28T11:54:05.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7f165945f700 1 -- 172.21.15.50:0/4259589348 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1654071810 con 0x7f16540c18f0 2023-11-28T11:54:05.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7f165945f700 1 -- 172.21.15.50:0/4259589348 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1654071dd0 con 0x7f16540c18f0 2023-11-28T11:54:05.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7f4c15664700 1 --2- 172.21.15.50:0/857719325 >> [v2:172.21.15.50:6808/36466,v1:172.21.15.50:6809/36466] conn(0x7f4bf406ebb0 0x7f4bf4070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7f1650ff9700 1 -- 172.21.15.50:0/4259589348 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1644013b00 con 0x7f16540c18f0 2023-11-28T11:54:05.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb6d67fc700 1 -- 172.21.15.50:0/1143367904 <== osd.6 v2:172.21.15.192:6824/36820 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb6c4071780 con 0x7fb6c406ec80 2023-11-28T11:54:05.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f1650ff9700 1 --2- 172.21.15.50:0/4259589348 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1640064f60 0x7f1640067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f943affd700 1 --2- 172.21.15.50:0/2119877094 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9428064f10 0x7f94280673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f564f59e700 1 Processor -- start 2023-11-28T11:54:05.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f1650ff9700 1 -- 172.21.15.50:0/4259589348 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1644082040 con 0x7f16540c18f0 2023-11-28T11:54:05.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f943affd700 1 -- 172.21.15.50:0/2119877094 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f943c082a60 con 0x7f94440b08c0 2023-11-28T11:54:05.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f4c0ffff700 1 --2- 172.21.15.50:0/857719325 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4bf4064ee0 0x7f4bf4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f4c0d7fa700 1 -- 172.21.15.50:0/857719325 <== osd.3 v2:172.21.15.50:6808/36466 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4bf40716b0 con 0x7f4bf406ebb0 2023-11-28T11:54:05.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f1650ff9700 1 --2- 172.21.15.50:0/4259589348 >> [v2:172.21.15.50:6824/36469,v1:172.21.15.50:6825/36469] conn(0x7f164006ec30 0x7f1640071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f1650ff9700 1 -- 172.21.15.50:0/4259589348 --> [v2:172.21.15.50:6824/36469,v1:172.21.15.50:6825/36469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1640071730 con 0x7f164006ec30 2023-11-28T11:54:05.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.521+0000 7fb707fff700 1 -- start start 2023-11-28T11:54:05.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f943affd700 1 --2- 172.21.15.50:0/2119877094 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x7f942806eb60 0x7f9428070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f943affd700 1 -- 172.21.15.50:0/2119877094 --> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9428071660 con 0x7f942806eb60 2023-11-28T11:54:05.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f943affd700 1 -- 172.21.15.50:0/2119877094 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f943c0872a0 con 0x7f94440b08c0 2023-11-28T11:54:05.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f1650ff9700 1 -- 172.21.15.50:0/4259589348 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16440824c0 con 0x7f16540c18f0 2023-11-28T11:54:05.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f1658c5e700 1 --2- 172.21.15.50:0/4259589348 >> [v2:172.21.15.50:6824/36469,v1:172.21.15.50:6825/36469] conn(0x7f164006ec30 0x7f1640071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f564f59e700 1 -- start start 2023-11-28T11:54:05.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f9449b3e700 1 --2- 172.21.15.50:0/2119877094 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9428064f10 0x7f94280673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f4c0ffff700 1 --2- 172.21.15.50:0/857719325 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4bf4064ee0 0x7f4bf4067390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4c100b0310 tx=0x7f4c04009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f944ab40700 1 --2- 172.21.15.50:0/2119877094 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x7f942806eb60 0x7f9428070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f1653fff700 1 --2- 172.21.15.50:0/4259589348 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1640064f60 0x7f1640067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f9449b3e700 1 --2- 172.21.15.50:0/2119877094 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9428064f10 0x7f94280673c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f94400090b0 tx=0x7f9440008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f564f59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f56500ca9e0 0x7f5650071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f564f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565006b5e0 con 0x7f5650159220 2023-11-28T11:54:05.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f564f59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56500cdfb0 con 0x7f565006c460 2023-11-28T11:54:05.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f564f59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56500722c0 con 0x7f56500ca9e0 2023-11-28T11:54:05.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f564dd9b700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f565006c460 0x7f56500ca2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:51198/0 (socket says 172.21.15.50:51198) 2023-11-28T11:54:05.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f564dd9b700 1 -- 172.21.15.50:0/2728466656 learned_addr learned my addr 172.21.15.50:0/2728466656 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:05.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f564ed9d700 1 --2- 172.21.15.50:0/2728466656 >> v2:172.21.15.192:3300/0 conn(0x7f56500ca9e0 0x7f5650071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f944ab40700 1 --2- 172.21.15.50:0/2119877094 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x7f942806eb60 0x7f9428070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f1653fff700 1 --2- 172.21.15.50:0/4259589348 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1640064f60 0x7f1640067410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f164c009440 tx=0x7f164c009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f564ed9d700 1 -- 172.21.15.50:0/2728466656 >> v1:172.21.15.192:6789/0 conn(0x7f565006c460 legacy=0x7f56500ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f564ed9d700 1 -- 172.21.15.50:0/2728466656 >> v1:172.21.15.50:6789/0 conn(0x7f5650159220 legacy=0x7f565006bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f564ed9d700 1 -- 172.21.15.50:0/2728466656 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56500ce290 con 0x7f56500ca9e0 2023-11-28T11:54:05.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7f564ed9d700 1 --2- 172.21.15.50:0/2728466656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56500ca9e0 0x7f5650071d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5644009850 tx=0x7f5644009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7224ac00c29ff89e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.529+0000 7f943affd700 1 -- 172.21.15.50:0/2119877094 <== osd.0 v2:172.21.15.50:6800/36462 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9428071660 con 0x7f942806eb60 2023-11-28T11:54:05.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb707fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb70806f7c0 0x7fb708094960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb707fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb708071c70 0x7fb7080954c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb707fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7080b3a90 0x7fb708095a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb707fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb708096cd0 con 0x7fb708071c70 2023-11-28T11:54:05.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb707fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080c2640 con 0x7fb70806f7c0 2023-11-28T11:54:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb707fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080c2360 con 0x7fb7080b3a90 2023-11-28T11:54:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb706ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb70806f7c0 0x7fb708094960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb706ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb70806f7c0 0x7fb708094960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:55772/0 (socket says 172.21.15.50:55772) 2023-11-28T11:54:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb706ffd700 1 -- 172.21.15.50:0/4030809417 learned_addr learned my addr 172.21.15.50:0/4030809417 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb7067fc700 1 --2- 172.21.15.50:0/4030809417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb708071c70 0x7fb7080954c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb706ffd700 1 -- 172.21.15.50:0/4030809417 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7080b3a90 msgr2=0x7fb708095a00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T11:54:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb706ffd700 1 --2- 172.21.15.50:0/4030809417 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7080b3a90 0x7fb708095a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb706ffd700 1 -- 172.21.15.50:0/4030809417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb708071c70 msgr2=0x7fb7080954c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb706ffd700 1 --2- 172.21.15.50:0/4030809417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb708071c70 0x7fb7080954c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb706ffd700 1 -- 172.21.15.50:0/4030809417 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f80094b0 con 0x7fb70806f7c0 2023-11-28T11:54:05.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb706ffd700 1 --2- 172.21.15.50:0/4030809417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb70806f7c0 0x7fb708094960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb70000efc0 tx=0x7fb70000c0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb6ef7fe700 1 -- 172.21.15.50:0/4030809417 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70000cc00 con 0x7fb70806f7c0 2023-11-28T11:54:05.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb6ef7fe700 1 -- 172.21.15.50:0/4030809417 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70000f040 con 0x7fb70806f7c0 2023-11-28T11:54:05.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb6ef7fe700 1 -- 172.21.15.50:0/4030809417 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700014480 con 0x7fb70806f7c0 2023-11-28T11:54:05.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb707fff700 1 -- 172.21.15.50:0/4030809417 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb708097b30 con 0x7fb70806f7c0 2023-11-28T11:54:05.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.525+0000 7fb707fff700 1 -- 172.21.15.50:0/4030809417 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb70806c340 con 0x7fb70806f7c0 2023-11-28T11:54:05.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.529+0000 7f1658c5e700 1 --2- 172.21.15.50:0/4259589348 >> [v2:172.21.15.50:6824/36469,v1:172.21.15.50:6825/36469] conn(0x7f164006ec30 0x7f1640071060 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.529+0000 7f564d59a700 1 -- 172.21.15.50:0/2728466656 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564400b710 con 0x7f56500ca9e0 2023-11-28T11:54:05.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.529+0000 7f564d59a700 1 -- 172.21.15.50:0/2728466656 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564400b870 con 0x7f56500ca9e0 2023-11-28T11:54:05.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.529+0000 7f564d59a700 1 -- 172.21.15.50:0/2728466656 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564400bc00 con 0x7f56500ca9e0 2023-11-28T11:54:05.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.529+0000 7f1650ff9700 1 -- 172.21.15.50:0/4259589348 <== osd.2 v2:172.21.15.50:6824/36469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1640071730 con 0x7f164006ec30 2023-11-28T11:54:05.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.529+0000 7f564f59e700 1 -- 172.21.15.50:0/2728466656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56500ca9e0 msgr2=0x7f5650071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.529+0000 7f564f59e700 1 --2- 172.21.15.50:0/2728466656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56500ca9e0 0x7f5650071d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5644009850 tx=0x7f5644009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:05.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.533+0000 7f564f59e700 1 -- 172.21.15.50:0/2728466656 shutdown_connections 2023-11-28T11:54:05.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.533+0000 7f564f59e700 1 --2- 172.21.15.50:0/2728466656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56500ca9e0 0x7f5650071d80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.533+0000 7f564f59e700 1 -- 172.21.15.50:0/2728466656 >> 172.21.15.50:0/2728466656 conn(0x7f56500b1d40 msgr2=0x7f56500cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.533+0000 7fb6ef7fe700 1 -- 172.21.15.50:0/4030809417 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb7000145e0 con 0x7fb70806f7c0 2023-11-28T11:54:05.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.533+0000 7fb6ef7fe700 1 --2- 172.21.15.50:0/4030809417 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb6f4064f10 0x7fb6f40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.533+0000 7fb6ef7fe700 1 -- 172.21.15.50:0/4030809417 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb700082bb0 con 0x7fb70806f7c0 2023-11-28T11:54:05.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7fb7067fc700 1 --2- 172.21.15.50:0/4030809417 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb6f4064f10 0x7fb6f40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7fb707fff700 1 --2- 172.21.15.50:0/4030809417 >> [v2:172.21.15.192:6800/36818,v1:172.21.15.192:6801/36818] conn(0x7fb708096860 0x7fb708060660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7fb707fff700 1 -- 172.21.15.50:0/4030809417 --> [v2:172.21.15.192:6800/36818,v1:172.21.15.192:6801/36818] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb708072500 con 0x7fb708096860 2023-11-28T11:54:05.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.533+0000 7f564f59e700 1 -- 172.21.15.50:0/2728466656 shutdown_connections 2023-11-28T11:54:05.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7f564f59e700 1 -- 172.21.15.50:0/2728466656 wait complete. 2023-11-28T11:54:05.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7fb7067fc700 1 --2- 172.21.15.50:0/4030809417 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb6f4064f10 0x7fb6f40673c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb7081778e0 tx=0x7fb6fc000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7fb7077fe700 1 --2- 172.21.15.50:0/4030809417 >> [v2:172.21.15.192:6800/36818,v1:172.21.15.192:6801/36818] conn(0x7fb708096860 0x7fb708060660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7fb7077fe700 1 --2- 172.21.15.50:0/4030809417 >> [v2:172.21.15.192:6800/36818,v1:172.21.15.192:6801/36818] conn(0x7fb708096860 0x7fb708060660 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7f564f59e700 1 Processor -- start 2023-11-28T11:54:05.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7f564f59e700 1 -- start start 2023-11-28T11:54:05.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7f564f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f565006c460 0x7f56500c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7fb6ef7fe700 1 -- 172.21.15.50:0/4030809417 <== osd.7 v2:172.21.15.192:6800/36818 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb708072500 con 0x7fb708096860 2023-11-28T11:54:05.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7f564f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56500ca9e0 0x7f5650154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7f564f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5650159220 0x7f565015ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7f564f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565015c6a0 con 0x7f565006c460 2023-11-28T11:54:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7f564f59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5650155010 con 0x7f5650159220 2023-11-28T11:54:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7f564f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56500c9200 con 0x7f56500ca9e0 2023-11-28T11:54:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7f564e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f565006c460 0x7f56500c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7f564dd9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56500ca9e0 0x7f5650154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7f564e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f565006c460 0x7f56500c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53292/0 (socket says 172.21.15.50:53292) 2023-11-28T11:54:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7f564e59c700 1 -- 172.21.15.50:0/493058222 learned_addr learned my addr 172.21.15.50:0/493058222 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.537+0000 7f564ed9d700 1 --2- 172.21.15.50:0/493058222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5650159220 0x7f565015ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f564e59c700 1 -- 172.21.15.50:0/493058222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56500ca9e0 msgr2=0x7f5650154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f564e59c700 1 --2- 172.21.15.50:0/493058222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56500ca9e0 0x7f5650154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f564e59c700 1 -- 172.21.15.50:0/493058222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5650159220 msgr2=0x7f565015ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f564e59c700 1 --2- 172.21.15.50:0/493058222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5650159220 0x7f565015ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f564e59c700 1 -- 172.21.15.50:0/493058222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440094b0 con 0x7f565006c460 2023-11-28T11:54:05.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f564e59c700 1 --2- 172.21.15.50:0/493058222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f565006c460 0x7f56500c65f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f564000c7b0 tx=0x7f564000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f511a704700 1 -- 172.21.15.50:0/1578214356 --> [v2:172.21.15.192:6816/36819,v1:172.21.15.192:6817/36819] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f51140008d0 con 0x7f510006ebb0 2023-11-28T11:54:05.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7fb6e6b1e700 1 -- 172.21.15.50:0/1143367904 --> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb6c8002d90 con 0x7fb6c406ec80 2023-11-28T11:54:05.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f5110ff9700 1 -- 172.21.15.50:0/1578214356 <== osd.4 v2:172.21.15.192:6816/36819 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f51140008d0 con 0x7f510006ebb0 2023-11-28T11:54:05.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7fb6d67fc700 1 -- 172.21.15.50:0/1143367904 <== osd.6 v2:172.21.15.192:6824/36820 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb6c8002d90 con 0x7fb6c406ec80 2023-11-28T11:54:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f511a704700 1 -- 172.21.15.50:0/1578214356 >> [v2:172.21.15.192:6816/36819,v1:172.21.15.192:6817/36819] conn(0x7f510006ebb0 msgr2=0x7f5100070fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f511a704700 1 --2- 172.21.15.50:0/1578214356 >> [v2:172.21.15.192:6816/36819,v1:172.21.15.192:6817/36819] conn(0x7f510006ebb0 0x7f5100070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f511a704700 1 -- 172.21.15.50:0/1578214356 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5100064ee0 msgr2=0x7f5100067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f511a704700 1 --2- 172.21.15.50:0/1578214356 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5100064ee0 0x7f5100067390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f510c000f80 tx=0x7f510c011000 comp rx=0 tx=0).stop 2023-11-28T11:54:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f511a704700 1 -- 172.21.15.50:0/1578214356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51140c1970 msgr2=0x7f51140abc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f511a704700 1 --2- 172.21.15.50:0/1578214356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51140c1970 0x7f51140abc90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f510400c430 tx=0x7f510400c740 comp rx=0 tx=0).stop 2023-11-28T11:54:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f5118ca1700 1 -- 172.21.15.50:0/1578214356 reap_dead start 2023-11-28T11:54:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f511a704700 1 -- 172.21.15.50:0/1578214356 shutdown_connections 2023-11-28T11:54:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f511a704700 1 -- 172.21.15.50:0/1578214356 >> 172.21.15.50:0/1578214356 conn(0x7f51140ce460 msgr2=0x7f511406bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.541+0000 7f511a704700 1 -- 172.21.15.50:0/1578214356 shutdown_connections 2023-11-28T11:54:05.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.545+0000 7f511a704700 1 -- 172.21.15.50:0/1578214356 wait complete. 2023-11-28T11:54:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.545+0000 7f563effd700 1 -- 172.21.15.50:0/493058222 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56400054e0 con 0x7f565006c460 2023-11-28T11:54:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.545+0000 7f563effd700 1 -- 172.21.15.50:0/493058222 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56400036a0 con 0x7f565006c460 2023-11-28T11:54:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.545+0000 7f564f59e700 1 -- 172.21.15.50:0/493058222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565006b830 con 0x7f565006c460 2023-11-28T11:54:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.545+0000 7f563effd700 1 -- 172.21.15.50:0/493058222 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640003a50 con 0x7f565006c460 2023-11-28T11:54:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.545+0000 7f564f59e700 1 -- 172.21.15.50:0/493058222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56500ce570 con 0x7f565006c460 2023-11-28T11:54:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.545+0000 7f564f59e700 1 -- 172.21.15.50:0/493058222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56501595f0 con 0x7f565006c460 2023-11-28T11:54:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.545+0000 7f563effd700 1 -- 172.21.15.50:0/493058222 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5640019030 con 0x7f565006c460 2023-11-28T11:54:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.545+0000 7f563effd700 1 --2- 172.21.15.50:0/493058222 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5638065100 0x7f56380675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.545+0000 7f563effd700 1 -- 172.21.15.50:0/493058222 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5640081300 con 0x7f565006c460 2023-11-28T11:54:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.545+0000 7f563effd700 1 --2- 172.21.15.50:0/493058222 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x7f563806ebe0 0x7f5638071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.545+0000 7f563effd700 1 -- 172.21.15.50:0/493058222 --> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f56380716e0 con 0x7f563806ebe0 2023-11-28T11:54:05.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.545+0000 7f563effd700 1 -- 172.21.15.50:0/493058222 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f564004ef30 con 0x7f565006c460 2023-11-28T11:54:05.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.545+0000 7f564ed9d700 1 --2- 172.21.15.50:0/493058222 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x7f563806ebe0 0x7f5638071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.549+0000 7f4c15e65700 1 -- 172.21.15.50:0/857719325 --> [v2:172.21.15.50:6808/36466,v1:172.21.15.50:6809/36466] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4bec002d60 con 0x7f4bf406ebb0 2023-11-28T11:54:05.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.549+0000 7f564dd9b700 1 --2- 172.21.15.50:0/493058222 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5638065100 0x7f56380675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.549+0000 7f564ed9d700 1 --2- 172.21.15.50:0/493058222 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x7f563806ebe0 0x7f5638071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.549+0000 7f564dd9b700 1 --2- 172.21.15.50:0/493058222 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5638065100 0x7f56380675b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f56500c57e0 tx=0x7f5648001bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.549+0000 7f563effd700 1 -- 172.21.15.50:0/493058222 <== osd.5 v2:172.21.15.192:6802/36817 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f56380716e0 con 0x7f563806ebe0 2023-11-28T11:54:05.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.553+0000 7f4c0d7fa700 1 -- 172.21.15.50:0/857719325 <== osd.3 v2:172.21.15.50:6808/36466 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4bec002d60 con 0x7f4bf406ebb0 2023-11-28T11:54:05.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.553+0000 7f165945f700 1 -- 172.21.15.50:0/4259589348 --> [v2:172.21.15.50:6824/36469,v1:172.21.15.50:6825/36469] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1654072500 con 0x7f164006ec30 2023-11-28T11:54:05.597 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-11-28T11:54:05.598 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T11:54:05.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7fb6e6b1e700 1 -- 172.21.15.50:0/1143367904 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x7fb6c406ec80 msgr2=0x7fb6c40710b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7fb6e6b1e700 1 --2- 172.21.15.50:0/1143367904 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x7fb6c406ec80 0x7fb6c40710b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f944b341700 1 -- 172.21.15.50:0/2119877094 --> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f942c002d60 con 0x7f942806eb60 2023-11-28T11:54:05.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f4c15e65700 1 -- 172.21.15.50:0/857719325 >> [v2:172.21.15.50:6808/36466,v1:172.21.15.50:6809/36466] conn(0x7f4bf406ebb0 msgr2=0x7f4bf4070fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f4c15e65700 1 --2- 172.21.15.50:0/857719325 >> [v2:172.21.15.50:6808/36466,v1:172.21.15.50:6809/36466] conn(0x7f4bf406ebb0 0x7f4bf4070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7fb6e6b1e700 1 -- 172.21.15.50:0/1143367904 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb6c4064fb0 msgr2=0x7fb6c4067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7fb6e6b1e700 1 --2- 172.21.15.50:0/1143367904 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb6c4064fb0 0x7fb6c4067460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00017a0 tx=0x7fb6d0009040 comp rx=0 tx=0).stop 2023-11-28T11:54:05.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7fb6e6b1e700 1 -- 172.21.15.50:0/1143367904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e006c0a0 msgr2=0x7fb6e009aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7fb6e6b1e700 1 --2- 172.21.15.50:0/1143367904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e006c0a0 0x7fb6e009aef0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00c4a0 tx=0x7fb6dc00c7b0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7fb6e631d700 1 -- 172.21.15.50:0/1143367904 reap_dead start 2023-11-28T11:54:05.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7fb6e6b1e700 1 -- 172.21.15.50:0/1143367904 shutdown_connections 2023-11-28T11:54:05.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7fb6e6b1e700 1 -- 172.21.15.50:0/1143367904 >> 172.21.15.50:0/1143367904 conn(0x7fb6e00ce3e0 msgr2=0x7fb6e0071990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f1650ff9700 1 -- 172.21.15.50:0/4259589348 <== osd.2 v2:172.21.15.50:6824/36469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1654072500 con 0x7f164006ec30 2023-11-28T11:54:05.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f4c15e65700 1 -- 172.21.15.50:0/857719325 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4bf4064ee0 msgr2=0x7f4bf4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f4c15e65700 1 --2- 172.21.15.50:0/857719325 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4bf4064ee0 0x7f4bf4067390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4c100b0310 tx=0x7f4c04009040 comp rx=0 tx=0).stop 2023-11-28T11:54:05.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f4c15e65700 1 -- 172.21.15.50:0/857719325 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4c100c1ac0 msgr2=0x7f4c10071330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f4c15e65700 1 --2- 172.21.15.50:0/857719325 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4c100c1ac0 0x7f4c10071330 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000c750 tx=0x7f4c0000ca60 comp rx=0 tx=0).stop 2023-11-28T11:54:05.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f4c15664700 1 -- 172.21.15.50:0/857719325 reap_dead start 2023-11-28T11:54:05.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7fb6e6b1e700 1 -- 172.21.15.50:0/1143367904 shutdown_connections 2023-11-28T11:54:05.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f4c15e65700 1 -- 172.21.15.50:0/857719325 shutdown_connections 2023-11-28T11:54:05.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f4c15e65700 1 -- 172.21.15.50:0/857719325 >> 172.21.15.50:0/857719325 conn(0x7f4c100ce3e0 msgr2=0x7f4c1006af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7fb6e6b1e700 1 -- 172.21.15.50:0/1143367904 wait complete. 2023-11-28T11:54:05.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f4c15e65700 1 -- 172.21.15.50:0/857719325 shutdown_connections 2023-11-28T11:54:05.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f943affd700 1 -- 172.21.15.50:0/2119877094 <== osd.0 v2:172.21.15.50:6800/36462 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f942c002d60 con 0x7f942806eb60 2023-11-28T11:54:05.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f4c15e65700 1 -- 172.21.15.50:0/857719325 wait complete. 2023-11-28T11:54:05.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f165945f700 1 -- 172.21.15.50:0/4259589348 >> [v2:172.21.15.50:6824/36469,v1:172.21.15.50:6825/36469] conn(0x7f164006ec30 msgr2=0x7f1640071060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f165945f700 1 --2- 172.21.15.50:0/4259589348 >> [v2:172.21.15.50:6824/36469,v1:172.21.15.50:6825/36469] conn(0x7f164006ec30 0x7f1640071060 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f165945f700 1 -- 172.21.15.50:0/4259589348 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1640064f60 msgr2=0x7f1640067410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f165945f700 1 --2- 172.21.15.50:0/4259589348 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1640064f60 0x7f1640067410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f164c009440 tx=0x7f164c009000 comp rx=0 tx=0).stop 2023-11-28T11:54:05.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f165945f700 1 -- 172.21.15.50:0/4259589348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16540c18f0 msgr2=0x7f165415a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f165945f700 1 --2- 172.21.15.50:0/4259589348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16540c18f0 0x7f165415a2c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f164400e7e0 tx=0x7f164400eaf0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f1658c5e700 1 -- 172.21.15.50:0/4259589348 reap_dead start 2023-11-28T11:54:05.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f944b341700 1 -- 172.21.15.50:0/2119877094 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x7f942806eb60 msgr2=0x7f9428070f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f944b341700 1 --2- 172.21.15.50:0/2119877094 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x7f942806eb60 0x7f9428070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f165945f700 1 -- 172.21.15.50:0/4259589348 shutdown_connections 2023-11-28T11:54:05.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f165945f700 1 -- 172.21.15.50:0/4259589348 >> 172.21.15.50:0/4259589348 conn(0x7f16540b1f90 msgr2=0x7f16540c89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f165945f700 1 -- 172.21.15.50:0/4259589348 shutdown_connections 2023-11-28T11:54:05.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f165945f700 1 -- 172.21.15.50:0/4259589348 wait complete. 2023-11-28T11:54:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f944b341700 1 -- 172.21.15.50:0/2119877094 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9428064f10 msgr2=0x7f94280673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f944b341700 1 --2- 172.21.15.50:0/2119877094 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9428064f10 0x7f94280673c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f94400090b0 tx=0x7f9440008030 comp rx=0 tx=0).stop 2023-11-28T11:54:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f944b341700 1 -- 172.21.15.50:0/2119877094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94440b08c0 msgr2=0x7f9444159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f944b341700 1 --2- 172.21.15.50:0/2119877094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94440b08c0 0x7f9444159640 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f943c00efc0 tx=0x7f943c00c0c0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f944ab40700 1 -- 172.21.15.50:0/2119877094 reap_dead start 2023-11-28T11:54:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f944b341700 1 -- 172.21.15.50:0/2119877094 shutdown_connections 2023-11-28T11:54:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.557+0000 7f944b341700 1 -- 172.21.15.50:0/2119877094 >> 172.21.15.50:0/2119877094 conn(0x7f94440cf270 msgr2=0x7f94440b6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.561+0000 7f944b341700 1 -- 172.21.15.50:0/2119877094 shutdown_connections 2023-11-28T11:54:05.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.561+0000 7f944b341700 1 -- 172.21.15.50:0/2119877094 wait complete. 2023-11-28T11:54:05.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.561+0000 7fb707fff700 1 -- 172.21.15.50:0/4030809417 --> [v2:172.21.15.192:6800/36818,v1:172.21.15.192:6801/36818] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb708094ea0 con 0x7fb708096860 2023-11-28T11:54:05.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.565+0000 7fb6ef7fe700 1 -- 172.21.15.50:0/4030809417 <== osd.7 v2:172.21.15.192:6800/36818 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb708094ea0 con 0x7fb708096860 2023-11-28T11:54:05.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.565+0000 7fb707fff700 1 -- 172.21.15.50:0/4030809417 >> [v2:172.21.15.192:6800/36818,v1:172.21.15.192:6801/36818] conn(0x7fb708096860 msgr2=0x7fb708060660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.565+0000 7fb707fff700 1 --2- 172.21.15.50:0/4030809417 >> [v2:172.21.15.192:6800/36818,v1:172.21.15.192:6801/36818] conn(0x7fb708096860 0x7fb708060660 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.565+0000 7f61fcff9700 1 -- 172.21.15.50:0/2905316436 --> [v2:172.21.15.50:6816/36464,v1:172.21.15.50:6817/36464] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f62100008d0 con 0x7f61f006eb80 2023-11-28T11:54:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.565+0000 7fb707fff700 1 -- 172.21.15.50:0/4030809417 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb6f4064f10 msgr2=0x7fb6f40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.565+0000 7fb707fff700 1 --2- 172.21.15.50:0/4030809417 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb6f4064f10 0x7fb6f40673c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb7081778e0 tx=0x7fb6fc000bc0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.565+0000 7fb707fff700 1 -- 172.21.15.50:0/4030809417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb70806f7c0 msgr2=0x7fb708094960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.565+0000 7fb707fff700 1 --2- 172.21.15.50:0/4030809417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb70806f7c0 0x7fb708094960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb70000efc0 tx=0x7fb70000c0c0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.565+0000 7fb7077fe700 1 -- 172.21.15.50:0/4030809417 reap_dead start 2023-11-28T11:54:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.565+0000 7fb707fff700 1 -- 172.21.15.50:0/4030809417 shutdown_connections 2023-11-28T11:54:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.565+0000 7fb707fff700 1 -- 172.21.15.50:0/4030809417 >> 172.21.15.50:0/4030809417 conn(0x7fb7080b1f90 msgr2=0x7fb7080714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.565+0000 7fb707fff700 1 -- 172.21.15.50:0/4030809417 shutdown_connections 2023-11-28T11:54:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.565+0000 7fb707fff700 1 -- 172.21.15.50:0/4030809417 wait complete. 2023-11-28T11:54:05.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.569+0000 7f61feffd700 1 -- 172.21.15.50:0/2905316436 <== osd.1 v2:172.21.15.50:6816/36464 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f62100008d0 con 0x7f61f006eb80 2023-11-28T11:54:05.610 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-11-28T11:54:05.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T11:54:05.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.573+0000 7f564f59e700 1 -- 172.21.15.50:0/493058222 --> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5650072500 con 0x7f563806ebe0 2023-11-28T11:54:05.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.573+0000 7f563effd700 1 -- 172.21.15.50:0/493058222 <== osd.5 v2:172.21.15.192:6802/36817 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5650072500 con 0x7f563806ebe0 2023-11-28T11:54:05.612 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-11-28T11:54:05.612 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T11:54:05.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.573+0000 7f564f59e700 1 -- 172.21.15.50:0/493058222 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x7f563806ebe0 msgr2=0x7f5638071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.573+0000 7f564f59e700 1 --2- 172.21.15.50:0/493058222 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x7f563806ebe0 0x7f5638071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.573+0000 7f564f59e700 1 -- 172.21.15.50:0/493058222 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5638065100 msgr2=0x7f56380675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.573+0000 7f564f59e700 1 --2- 172.21.15.50:0/493058222 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5638065100 0x7f56380675b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f56500c57e0 tx=0x7f5648001bf0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.573+0000 7f564f59e700 1 -- 172.21.15.50:0/493058222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f565006c460 msgr2=0x7f56500c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.573+0000 7f564f59e700 1 --2- 172.21.15.50:0/493058222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f565006c460 0x7f56500c65f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f564000c7b0 tx=0x7f564000cac0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.573+0000 7f564ed9d700 1 -- 172.21.15.50:0/493058222 reap_dead start 2023-11-28T11:54:05.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.573+0000 7f564f59e700 1 -- 172.21.15.50:0/493058222 shutdown_connections 2023-11-28T11:54:05.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.573+0000 7f564f59e700 1 -- 172.21.15.50:0/493058222 >> 172.21.15.50:0/493058222 conn(0x7f56500b1d40 msgr2=0x7f56500ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.573+0000 7f564f59e700 1 -- 172.21.15.50:0/493058222 shutdown_connections 2023-11-28T11:54:05.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.573+0000 7f564f59e700 1 -- 172.21.15.50:0/493058222 wait complete. 2023-11-28T11:54:05.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.577+0000 7f61fcff9700 1 -- 172.21.15.50:0/2905316436 >> [v2:172.21.15.50:6816/36464,v1:172.21.15.50:6817/36464] conn(0x7f61f006eb80 msgr2=0x7f61f0070fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.577+0000 7f61fcff9700 1 --2- 172.21.15.50:0/2905316436 >> [v2:172.21.15.50:6816/36464,v1:172.21.15.50:6817/36464] conn(0x7f61f006eb80 0x7f61f0070fb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.577+0000 7f61fcff9700 1 -- 172.21.15.50:0/2905316436 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f61f0064f30 msgr2=0x7f61f00673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.577+0000 7f61fcff9700 1 --2- 172.21.15.50:0/2905316436 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f61f0064f30 0x7f61f00673e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6200006b40 tx=0x7f6200006ad0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.577+0000 7f61fcff9700 1 -- 172.21.15.50:0/2905316436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62100ca700 msgr2=0x7f62100ac390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.577+0000 7f61fcff9700 1 --2- 172.21.15.50:0/2905316436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62100ca700 0x7f62100ac390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f620800eab0 tx=0x7f620800edc0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.615 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-11-28T11:54:05.616 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T11:54:05.616 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-11-28T11:54:05.617 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T11:54:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.577+0000 7f620ed9d700 1 -- 172.21.15.50:0/2905316436 reap_dead start 2023-11-28T11:54:05.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.577+0000 7f61fcff9700 1 -- 172.21.15.50:0/2905316436 shutdown_connections 2023-11-28T11:54:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.577+0000 7f61fcff9700 1 -- 172.21.15.50:0/2905316436 >> 172.21.15.50:0/2905316436 conn(0x7f62100ce460 msgr2=0x7f621006bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.577+0000 7f61fcff9700 1 -- 172.21.15.50:0/2905316436 shutdown_connections 2023-11-28T11:54:05.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.577+0000 7f61fcff9700 1 -- 172.21.15.50:0/2905316436 wait complete. 2023-11-28T11:54:05.618 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-11-28T11:54:05.618 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T11:54:05.619 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-11-28T11:54:05.620 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T11:54:05.620 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-11-28T11:54:05.621 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T11:54:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.805+0000 7faa3602d700 1 Processor -- start 2023-11-28T11:54:05.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.805+0000 7faa3602d700 1 -- start start 2023-11-28T11:54:05.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.805+0000 7ff4b1418700 1 Processor -- start 2023-11-28T11:54:05.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.805+0000 7ff4b1418700 1 -- start start 2023-11-28T11:54:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.805+0000 7faa3602d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faa300ca5e0 0x7faa300cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.805+0000 7faa3602d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa3006d700 con 0x7faa3006a560 2023-11-28T11:54:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.805+0000 7faa3602d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa30072220 con 0x7faa300cee60 2023-11-28T11:54:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.805+0000 7faa3602d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa30071610 con 0x7faa300ca5e0 2023-11-28T11:54:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.805+0000 7faa2ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faa3006a560 0x7faa3015ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56402/0 (socket says 172.21.15.50:56402) 2023-11-28T11:54:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.805+0000 7faa2ffff700 1 -- 172.21.15.50:0/3655185459 learned_addr learned my addr 172.21.15.50:0/3655185459 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.805+0000 7faa2f7fe700 1 --2- 172.21.15.50:0/3655185459 >> v2:172.21.15.192:3300/0 conn(0x7faa300ca5e0 0x7faa300cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7ff4b1418700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4ac0cee60 0x7ff4ac0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7ff4b1418700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4ac06a560 0x7ff4ac15ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7ff4b1418700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ac072220 con 0x7ff4ac0ca5e0 2023-11-28T11:54:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7ff4b1418700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac06d700 con 0x7ff4ac06a560 2023-11-28T11:54:05.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7ff4b1418700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac071610 con 0x7ff4ac0cee60 2023-11-28T11:54:05.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7faa2f7fe700 1 -- 172.21.15.50:0/3655185459 >> v1:172.21.15.192:6789/0 conn(0x7faa300cee60 legacy=0x7faa30069e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7faa2f7fe700 1 -- 172.21.15.50:0/3655185459 >> v1:172.21.15.50:6789/0 conn(0x7faa3006a560 legacy=0x7faa3015ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7faa2e7fc700 1 -- 172.21.15.50:0/3655185459 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854647143 0 0) 0x7faa3006d700 con 0x7faa3006a560 2023-11-28T11:54:05.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7faa2f7fe700 1 -- 172.21.15.50:0/3655185459 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa300718f0 con 0x7faa300ca5e0 2023-11-28T11:54:05.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7ff4ab7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4ac06a560 0x7ff4ac15ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7ff4ab7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4ac06a560 0x7ff4ac15ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53298/0 (socket says 172.21.15.50:53298) 2023-11-28T11:54:05.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7ff4ab7fe700 1 -- 172.21.15.50:0/2205627677 learned_addr learned my addr 172.21.15.50:0/2205627677 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7faa2f7fe700 1 --2- 172.21.15.50:0/3655185459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa300ca5e0 0x7faa300cb6f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faa28009d90 tx=0x7faa2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db6eeca4312c06a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7ff4ab7fe700 1 -- 172.21.15.50:0/2205627677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4ac0cee60 msgr2=0x7ff4ac0cb6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:54:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7ff4ab7fe700 1 --2- 172.21.15.50:0/2205627677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4ac0cee60 0x7ff4ac0cb6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7ff4ab7fe700 1 -- 172.21.15.50:0/2205627677 >> v1:172.21.15.50:6789/0 conn(0x7ff4ac0ca5e0 legacy=0x7ff4ac069e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7ff4ab7fe700 1 -- 172.21.15.50:0/2205627677 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac0718f0 con 0x7ff4ac06a560 2023-11-28T11:54:05.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7faa2e7fc700 1 -- 172.21.15.50:0/3655185459 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2800e070 con 0x7faa300ca5e0 2023-11-28T11:54:05.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7faa2e7fc700 1 -- 172.21.15.50:0/3655185459 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2800bbd0 con 0x7faa300ca5e0 2023-11-28T11:54:05.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7faa2e7fc700 1 -- 172.21.15.50:0/3655185459 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa28012430 con 0x7faa300ca5e0 2023-11-28T11:54:05.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7ff4ab7fe700 1 --2- 172.21.15.50:0/2205627677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4ac06a560 0x7ff4ac15ba70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009e50 tx=0x7ff4a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c11093b74be244 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7ff4a9ffb700 1 -- 172.21.15.50:0/2205627677 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400e070 con 0x7ff4ac06a560 2023-11-28T11:54:05.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7ff4a9ffb700 1 -- 172.21.15.50:0/2205627677 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a400b9c0 con 0x7ff4ac06a560 2023-11-28T11:54:05.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7faa3602d700 1 -- 172.21.15.50:0/3655185459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa300ca5e0 msgr2=0x7faa300cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7faa3602d700 1 --2- 172.21.15.50:0/3655185459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa300ca5e0 0x7faa300cb6f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faa28009d90 tx=0x7faa2800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:05.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7faa3602d700 1 -- 172.21.15.50:0/3655185459 shutdown_connections 2023-11-28T11:54:05.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7faa3602d700 1 --2- 172.21.15.50:0/3655185459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa300ca5e0 0x7faa300cb6f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7faa3602d700 1 -- 172.21.15.50:0/3655185459 >> 172.21.15.50:0/3655185459 conn(0x7faa300b2010 msgr2=0x7faa300ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7faa3602d700 1 -- 172.21.15.50:0/3655185459 shutdown_connections 2023-11-28T11:54:05.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7faa3602d700 1 -- 172.21.15.50:0/3655185459 wait complete. 2023-11-28T11:54:05.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7ff4b1418700 1 -- 172.21.15.50:0/2205627677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4ac06a560 msgr2=0x7ff4ac15ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.809+0000 7ff4b1418700 1 --2- 172.21.15.50:0/2205627677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4ac06a560 0x7ff4ac15ba70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009e50 tx=0x7ff4a400b330 comp rx=0 tx=0).stop 2023-11-28T11:54:05.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7ff4b1418700 1 -- 172.21.15.50:0/2205627677 shutdown_connections 2023-11-28T11:54:05.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7ff4b1418700 1 --2- 172.21.15.50:0/2205627677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4ac06a560 0x7ff4ac15ba70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7ff4b1418700 1 --2- 172.21.15.50:0/2205627677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4ac0cee60 0x7ff4ac0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7ff4b1418700 1 -- 172.21.15.50:0/2205627677 >> 172.21.15.50:0/2205627677 conn(0x7ff4ac0b2010 msgr2=0x7ff4ac0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7ff4b1418700 1 -- 172.21.15.50:0/2205627677 shutdown_connections 2023-11-28T11:54:05.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa3602d700 1 Processor -- start 2023-11-28T11:54:05.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa3602d700 1 -- start start 2023-11-28T11:54:05.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7ff4b1418700 1 -- 172.21.15.50:0/2205627677 wait complete. 2023-11-28T11:54:05.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7f7109384700 1 Processor -- start 2023-11-28T11:54:05.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7f7109384700 1 -- start start 2023-11-28T11:54:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa3602d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa3006a560 0x7faa301fdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa3602d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa300ca5e0 0x7faa3006cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa3602d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa300cee60 0x7faa3006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa3602d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa300aba80 con 0x7faa300cee60 2023-11-28T11:54:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa3602d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa300c9b00 con 0x7faa300ca5e0 2023-11-28T11:54:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa3602d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa300c6e60 con 0x7faa3006a560 2023-11-28T11:54:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa2ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa300cee60 0x7faa3006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa2ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa300cee60 0x7faa3006d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53308/0 (socket says 172.21.15.50:53308) 2023-11-28T11:54:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa2ffff700 1 -- 172.21.15.50:0/254770749 learned_addr learned my addr 172.21.15.50:0/254770749 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7ff4b1418700 1 Processor -- start 2023-11-28T11:54:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7fc237b7a700 1 Processor -- start 2023-11-28T11:54:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa2effd700 1 --2- 172.21.15.50:0/254770749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa300ca5e0 0x7faa3006cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7ff4b1418700 1 -- start start 2023-11-28T11:54:05.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7f7109384700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f710406f7c0 0x7f7104069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7f7109384700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f71040cc400 0x7f71040b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa2f7fe700 1 --2- 172.21.15.50:0/254770749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa3006a560 0x7faa301fdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa2ffff700 1 -- 172.21.15.50:0/254770749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa3006a560 msgr2=0x7faa301fdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa2ffff700 1 --2- 172.21.15.50:0/254770749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa3006a560 0x7faa301fdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa2ffff700 1 -- 172.21.15.50:0/254770749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa300ca5e0 msgr2=0x7faa3006cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa2ffff700 1 --2- 172.21.15.50:0/254770749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa300ca5e0 0x7faa3006cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa2ffff700 1 -- 172.21.15.50:0/254770749 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa28009a70 con 0x7faa300cee60 2023-11-28T11:54:05.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7f71037fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f71040cbfb0 0x7f710406cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56416/0 (socket says 172.21.15.50:56416) 2023-11-28T11:54:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7f71037fe700 1 -- 172.21.15.50:0/3521980475 learned_addr learned my addr 172.21.15.50:0/3521980475 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7f7108b83700 1 --2- 172.21.15.50:0/3521980475 >> v2:172.21.15.192:3300/0 conn(0x7f71040cc400 0x7f71040b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7f7109384700 1 -- 172.21.15.50:0/3521980475 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71040cf000 con 0x7f71040cbfb0 2023-11-28T11:54:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7f7103fff700 1 --2- 172.21.15.50:0/3521980475 >> v2:172.21.15.50:3300/0 conn(0x7f710406f7c0 0x7f7104069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7faa2ffff700 1 --2- 172.21.15.50:0/254770749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa300cee60 0x7faa3006d150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faa2000c430 tx=0x7faa2000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7ff4b1418700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4ac06a560 0x7ff4ac0c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7ff4b1418700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4ac0ca5e0 0x7ff4ac1e0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7ff4b1418700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4ac0cee60 0x7ff4ac0cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7ff4b1418700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac0c4b30 con 0x7ff4ac06a560 2023-11-28T11:54:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7ff4b1418700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac0c3e10 con 0x7ff4ac0ca5e0 2023-11-28T11:54:05.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7ff4b1418700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac0ce780 con 0x7ff4ac0cee60 2023-11-28T11:54:05.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7fc237b7a700 1 -- start start 2023-11-28T11:54:05.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7ff4ab7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4ac0cee60 0x7ff4ac0cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7ff4ab7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4ac0cee60 0x7ff4ac0cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:54402/0 (socket says 172.21.15.50:54402) 2023-11-28T11:54:05.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7ff4ab7fe700 1 -- 172.21.15.50:0/82692872 learned_addr learned my addr 172.21.15.50:0/82692872 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7faa17fff700 1 -- 172.21.15.50:0/254770749 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa20004ca0 con 0x7faa300cee60 2023-11-28T11:54:05.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7faa17fff700 1 -- 172.21.15.50:0/254770749 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa20004e20 con 0x7faa300cee60 2023-11-28T11:54:05.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7faa17fff700 1 -- 172.21.15.50:0/254770749 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa20007310 con 0x7faa300cee60 2023-11-28T11:54:05.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7faa3602d700 1 -- 172.21.15.50:0/254770749 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa30071eb0 con 0x7faa300cee60 2023-11-28T11:54:05.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7faa3602d700 1 -- 172.21.15.50:0/254770749 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa30071bd0 con 0x7faa300cee60 2023-11-28T11:54:05.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7ff4ab7fe700 1 -- 172.21.15.50:0/82692872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4ac0ca5e0 msgr2=0x7ff4ac1e0b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T11:54:05.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7ff4ab7fe700 1 --2- 172.21.15.50:0/82692872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4ac0ca5e0 0x7ff4ac1e0b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7ff4ab7fe700 1 -- 172.21.15.50:0/82692872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4ac06a560 msgr2=0x7ff4ac0c45f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T11:54:05.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7ff4ab7fe700 1 --2- 172.21.15.50:0/82692872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4ac06a560 0x7ff4ac0c45f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7ff4ab7fe700 1 -- 172.21.15.50:0/82692872 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a4009b30 con 0x7ff4ac0cee60 2023-11-28T11:54:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7fc237b7a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc23006d870 0x7fc2300cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7fc237b7a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc2300cb340 0x7fc23006c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7fc237b7a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23006aaf0 con 0x7fc230069e50 2023-11-28T11:54:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7fc237b7a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2300cb7c0 con 0x7fc2300cb340 2023-11-28T11:54:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7fc237b7a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc230071c70 con 0x7fc23006d870 2023-11-28T11:54:05.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7ff4ab7fe700 1 --2- 172.21.15.50:0/82692872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4ac0cee60 0x7ff4ac0cc220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400b730 tx=0x7ff4a4004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7ff4937fe700 1 -- 172.21.15.50:0/82692872 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a401c850 con 0x7ff4ac0cee60 2023-11-28T11:54:05.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7fc235115700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc23006d870 0x7fc2300cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7fc235115700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc23006d870 0x7fc2300cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:55838/0 (socket says 172.21.15.50:55838) 2023-11-28T11:54:05.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7fc235115700 1 -- 172.21.15.50:0/1742467396 learned_addr learned my addr 172.21.15.50:0/1742467396 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7f7109384700 1 -- 172.21.15.50:0/3521980475 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7104095340 con 0x7f710406f7c0 2023-11-28T11:54:05.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7f7109384700 1 -- 172.21.15.50:0/3521980475 --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7104097c80 con 0x7f71040cc400 2023-11-28T11:54:05.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7f7102ffd700 1 -- 172.21.15.50:0/3521980475 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077220018 0 0) 0x7f71040cf000 con 0x7f71040cbfb0 2023-11-28T11:54:05.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7f7102ffd700 1 -- 172.21.15.50:0/3521980475 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70ec0035d0 con 0x7f71040cbfb0 2023-11-28T11:54:05.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7f7103fff700 1 -- 172.21.15.50:0/3521980475 >> v2:172.21.15.192:3300/0 conn(0x7f71040cc400 msgr2=0x7f71040b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:05.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.813+0000 7f7103fff700 1 --2- 172.21.15.50:0/3521980475 >> v2:172.21.15.192:3300/0 conn(0x7f71040cc400 0x7f71040b3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7f7103fff700 1 -- 172.21.15.50:0/3521980475 >> v1:172.21.15.50:6789/0 conn(0x7f71040cbfb0 legacy=0x7f710406cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7f7103fff700 1 -- 172.21.15.50:0/3521980475 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710406a8d0 con 0x7f710406f7c0 2023-11-28T11:54:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7f7103fff700 1 --2- 172.21.15.50:0/3521980475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f710406f7c0 0x7f7104069cd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f71040c1aa0 tx=0x7f70f8009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef872baf68a3fd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7f7102ffd700 1 -- 172.21.15.50:0/3521980475 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8013280 con 0x7f710406f7c0 2023-11-28T11:54:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7f7102ffd700 1 -- 172.21.15.50:0/3521980475 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f8028070 con 0x7f710406f7c0 2023-11-28T11:54:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7f7102ffd700 1 -- 172.21.15.50:0/3521980475 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8013600 con 0x7f710406f7c0 2023-11-28T11:54:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7f7109384700 1 -- 172.21.15.50:0/3521980475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f710406f7c0 msgr2=0x7f7104069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7f7109384700 1 --2- 172.21.15.50:0/3521980475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f710406f7c0 0x7f7104069cd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f71040c1aa0 tx=0x7f70f8009670 comp rx=0 tx=0).stop 2023-11-28T11:54:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7f7109384700 1 -- 172.21.15.50:0/3521980475 shutdown_connections 2023-11-28T11:54:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7f7109384700 1 --2- 172.21.15.50:0/3521980475 >> v2:172.21.15.192:3300/0 conn(0x7f71040cc400 0x7f71040b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7f7109384700 1 --2- 172.21.15.50:0/3521980475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f710406f7c0 0x7f7104069cd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7f7109384700 1 -- 172.21.15.50:0/3521980475 >> 172.21.15.50:0/3521980475 conn(0x7f71040b1f90 msgr2=0x7f71040ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7fc236117700 1 --2- 172.21.15.50:0/1742467396 >> v2:172.21.15.50:3300/0 conn(0x7fc2300cb340 0x7fc23006c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7f7109384700 1 -- 172.21.15.50:0/3521980475 shutdown_connections 2023-11-28T11:54:05.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7f7109384700 1 -- 172.21.15.50:0/3521980475 wait complete. 2023-11-28T11:54:05.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7ff4937fe700 1 -- 172.21.15.50:0/82692872 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a400bed0 con 0x7ff4ac0cee60 2023-11-28T11:54:05.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7ff4937fe700 1 -- 172.21.15.50:0/82692872 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a401cbd0 con 0x7ff4ac0cee60 2023-11-28T11:54:05.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7ff4b1418700 1 -- 172.21.15.50:0/82692872 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ac071eb0 con 0x7ff4ac0cee60 2023-11-28T11:54:05.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7ff4b1418700 1 -- 172.21.15.50:0/82692872 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ac071bd0 con 0x7ff4ac0cee60 2023-11-28T11:54:05.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7faa17fff700 1 -- 172.21.15.50:0/254770749 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faa2001a020 con 0x7faa300cee60 2023-11-28T11:54:05.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7faa17fff700 1 --2- 172.21.15.50:0/254770749 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa1c064f60 0x7faa1c067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7faa17fff700 1 -- 172.21.15.50:0/254770749 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faa20081be0 con 0x7faa300cee60 2023-11-28T11:54:05.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7fc234914700 1 -- 172.21.15.50:0/1742467396 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741927339 0 0) 0x7fc23006aaf0 con 0x7fc230069e50 2023-11-28T11:54:05.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7fc234914700 1 -- 172.21.15.50:0/1742467396 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc21c0035d0 con 0x7fc230069e50 2023-11-28T11:54:05.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7fc234914700 1 -- 172.21.15.50:0/1742467396 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 595735686 0 0) 0x7fc21c0035d0 con 0x7fc230069e50 2023-11-28T11:54:05.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7fc234914700 1 -- 172.21.15.50:0/1742467396 >> v2:172.21.15.192:3300/0 conn(0x7fc23006d870 msgr2=0x7fc2300cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:05.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7fc234914700 1 --2- 172.21.15.50:0/1742467396 >> v2:172.21.15.192:3300/0 conn(0x7fc23006d870 0x7fc2300cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7fc234914700 1 -- 172.21.15.50:0/1742467396 >> v2:172.21.15.50:3300/0 conn(0x7fc2300cb340 msgr2=0x7fc23006c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:05.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.817+0000 7faa2f7fe700 1 --2- 172.21.15.50:0/254770749 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa1c064f60 0x7faa1c067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc234914700 1 --2- 172.21.15.50:0/1742467396 >> v2:172.21.15.50:3300/0 conn(0x7fc2300cb340 0x7fc23006c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc234914700 1 -- 172.21.15.50:0/1742467396 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2300721d0 con 0x7fc230069e50 2023-11-28T11:54:05.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc234914700 1 -- 172.21.15.50:0/1742467396 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7fc220001670 con 0x7fc230069e50 2023-11-28T11:54:05.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7ff4b1418700 1 -- 172.21.15.50:0/82692872 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ac0c8ab0 con 0x7ff4ac0cee60 2023-11-28T11:54:05.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc234914700 1 -- 172.21.15.50:0/1742467396 >> v1:172.21.15.50:6789/0 conn(0x7fc230069e50 legacy=0x7fc2300ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc234914700 1 --2- 172.21.15.50:0/1742467396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc21c003a20 0x7fc21c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc234914700 1 --2- 172.21.15.50:0/1742467396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc21c004870 0x7fc21c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc234914700 1 --2- 172.21.15.50:0/1742467396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c005220 0x7fc21c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc234914700 1 -- 172.21.15.50:0/1742467396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2300cb7c0 con 0x7fc21c005220 2023-11-28T11:54:05.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc234914700 1 -- 172.21.15.50:0/1742467396 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc230071c70 con 0x7fc21c004870 2023-11-28T11:54:05.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc234914700 1 -- 172.21.15.50:0/1742467396 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c00c0a0 con 0x7fc21c003a20 2023-11-28T11:54:05.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc236117700 1 --2- 172.21.15.50:0/1742467396 >> v2:172.21.15.50:3300/0 conn(0x7fc2300cb340 0x7fc23006c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:05.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7faa3602d700 1 -- 172.21.15.50:0/254770749 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa300c8ab0 con 0x7faa300cee60 2023-11-28T11:54:05.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7109384700 1 Processor -- start 2023-11-28T11:54:05.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7faa2f7fe700 1 --2- 172.21.15.50:0/254770749 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa1c064f60 0x7faa1c067410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faa2800b370 tx=0x7faa28011000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc235115700 1 --2- 172.21.15.50:0/1742467396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc21c004870 0x7fc21c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc236117700 1 --2- 172.21.15.50:0/1742467396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c005220 0x7fc21c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc235916700 1 --2- 172.21.15.50:0/1742467396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc21c003a20 0x7fc21c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f0f1e1a0700 1 Processor -- start 2023-11-28T11:54:05.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f2744c00700 1 Processor -- start 2023-11-28T11:54:05.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc236117700 1 -- 172.21.15.50:0/1742467396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc21c003a20 msgr2=0x7fc21c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:05.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc236117700 1 --2- 172.21.15.50:0/1742467396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc21c003a20 0x7fc21c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc236117700 1 -- 172.21.15.50:0/1742467396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc21c004870 msgr2=0x7fc21c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:05.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc236117700 1 --2- 172.21.15.50:0/1742467396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc21c004870 0x7fc21c004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc236117700 1 -- 172.21.15.50:0/1742467396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c0035d0 con 0x7fc21c005220 2023-11-28T11:54:05.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f0f1e1a0700 1 -- start start 2023-11-28T11:54:05.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f2744c00700 1 -- start start 2023-11-28T11:54:05.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc236117700 1 -- 172.21.15.50:0/1742467396 reap_dead start 2023-11-28T11:54:05.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fc236117700 1 --2- 172.21.15.50:0/1742467396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c005220 0x7fc21c00ba30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc22800e350 tx=0x7fc21c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cea7a44f85a5ee9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7109384700 1 -- start start 2023-11-28T11:54:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7109384700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f710406f7c0 0x7f71040b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7109384700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71040cbfb0 0x7f71040acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7109384700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71040cc400 0x7f71041fdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7109384700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71040afc40 con 0x7f71040cc400 2023-11-28T11:54:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7109384700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71040b0dd0 con 0x7f71040cbfb0 2023-11-28T11:54:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7109384700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71040c29c0 con 0x7f710406f7c0 2023-11-28T11:54:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7108b83700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71040cc400 0x7f71041fdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7108b83700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71040cc400 0x7f71041fdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53342/0 (socket says 172.21.15.50:53342) 2023-11-28T11:54:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7108b83700 1 -- 172.21.15.50:0/1190929756 learned_addr learned my addr 172.21.15.50:0/1190929756 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f71037fe700 1 --2- 172.21.15.50:0/1190929756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71040cbfb0 0x7f71040acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f0f1e1a0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0f180ceaf0 0x7f0f1806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f0f1e1a0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1806c6c0 con 0x7f0f1806f7c0 2023-11-28T11:54:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f0f1e1a0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f180cb7e0 con 0x7f0f18071ca0 2023-11-28T11:54:05.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f0f1e1a0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f1806dbf0 con 0x7f0f180ceaf0 2023-11-28T11:54:05.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7103fff700 1 --2- 172.21.15.50:0/1190929756 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f710406f7c0 0x7f71040b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7fd5ca9700 1 Processor -- start 2023-11-28T11:54:05.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7fd5ca9700 1 -- start start 2023-11-28T11:54:05.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7ff4937fe700 1 -- 172.21.15.50:0/82692872 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff4a4024030 con 0x7ff4ac0cee60 2023-11-28T11:54:05.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7108b83700 1 -- 172.21.15.50:0/1190929756 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f710406f7c0 msgr2=0x7f71040b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7108b83700 1 --2- 172.21.15.50:0/1190929756 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f710406f7c0 0x7f71040b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7108b83700 1 -- 172.21.15.50:0/1190929756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71040cbfb0 msgr2=0x7f71040acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7108b83700 1 --2- 172.21.15.50:0/1190929756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71040cbfb0 0x7f71040acbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7108b83700 1 -- 172.21.15.50:0/1190929756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f8013a10 con 0x7f71040cc400 2023-11-28T11:54:05.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f0f1d99f700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0f18071ca0 0x7f0f1806a0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:51206/0 (socket says 172.21.15.50:51206) 2023-11-28T11:54:05.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f0f1d99f700 1 -- 172.21.15.50:0/1908040833 learned_addr learned my addr 172.21.15.50:0/1908040833 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:05.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f7108b83700 1 --2- 172.21.15.50:0/1190929756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71040cc400 0x7f71041fdec0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f70f400b9c0 tx=0x7f70f400d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fdd54cd3700 1 Processor -- start 2023-11-28T11:54:05.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f2744c00700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f274006a650 0x7f27400c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f0f1d19e700 1 --2- 172.21.15.50:0/1908040833 >> v2:172.21.15.50:3300/0 conn(0x7f0f180ceaf0 0x7f0f1806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7ff4937fe700 1 --2- 172.21.15.50:0/82692872 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff498064fb0 0x7ff498067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f2744c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2740071c50 0x7f274006ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f0f0ffff700 1 -- 172.21.15.50:0/1908040833 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746100155 0 0) 0x7f0f180cb7e0 con 0x7f0f18071ca0 2023-11-28T11:54:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f0f0ffff700 1 -- 172.21.15.50:0/1908040833 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f040035d0 con 0x7f0f18071ca0 2023-11-28T11:54:05.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7fdd54cd3700 1 -- start start 2023-11-28T11:54:05.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f273f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f274006a650 0x7f27400c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f2744c00700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2740158be0 con 0x7f27400ceaf0 2023-11-28T11:54:05.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f2744c00700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27400cf340 con 0x7f2740071c50 2023-11-28T11:54:05.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f2744c00700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27400cf060 con 0x7f274006a650 2023-11-28T11:54:05.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7ff4937fe700 1 -- 172.21.15.50:0/82692872 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff4a4083db0 con 0x7ff4ac0cee60 2023-11-28T11:54:05.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f273f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f274006a650 0x7f27400c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:55864/0 (socket says 172.21.15.50:55864) 2023-11-28T11:54:05.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7f273f7fe700 1 -- 172.21.15.50:0/1772955199 learned_addr learned my addr 172.21.15.50:0/1772955199 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.821+0000 7ff4aaffd700 1 --2- 172.21.15.50:0/82692872 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff498064fb0 0x7ff498067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f0ffff700 1 -- 172.21.15.50:0/1908040833 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 892426170 0 0) 0x7f0f040035d0 con 0x7f0f18071ca0 2023-11-28T11:54:05.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f273ffff700 1 --2- 172.21.15.50:0/1772955199 >> v2:172.21.15.50:3300/0 conn(0x7f2740071c50 0x7f274006ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f0ffff700 1 -- 172.21.15.50:0/1908040833 >> v2:172.21.15.50:3300/0 conn(0x7f0f180ceaf0 msgr2=0x7f0f1806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:05.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f0ffff700 1 --2- 172.21.15.50:0/1908040833 >> v2:172.21.15.50:3300/0 conn(0x7f0f180ceaf0 0x7f0f1806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f0ffff700 1 -- 172.21.15.50:0/1908040833 >> v1:172.21.15.50:6789/0 conn(0x7f0f1806f7c0 legacy=0x7f0f180cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f0ffff700 1 -- 172.21.15.50:0/1908040833 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1806c8f0 con 0x7f0f18071ca0 2023-11-28T11:54:05.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f0ffff700 1 -- 172.21.15.50:0/1908040833 <== mon.1 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f0f08001670 con 0x7f0f18071ca0 2023-11-28T11:54:05.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7fd5ca9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7fd00cee60 0x7f7fd00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f0ffff700 1 -- 172.21.15.50:0/1908040833 >> v1:172.21.15.192:6789/0 conn(0x7f0f18071ca0 legacy=0x7f0f1806a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f0ffff700 1 --2- 172.21.15.50:0/1908040833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f04003a20 0x7f0f04003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f0ffff700 1 --2- 172.21.15.50:0/1908040833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f04004870 0x7f0f04004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f0ffff700 1 --2- 172.21.15.50:0/1908040833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f04005220 0x7f0f04014240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f0ffff700 1 -- 172.21.15.50:0/1908040833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1806dbf0 con 0x7f0f04005220 2023-11-28T11:54:05.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f0ffff700 1 -- 172.21.15.50:0/1908040833 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040148b0 con 0x7f0f04003a20 2023-11-28T11:54:05.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f0ffff700 1 -- 172.21.15.50:0/1908040833 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f04014a70 con 0x7f0f04004870 2023-11-28T11:54:05.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f273f7fe700 1 -- 172.21.15.50:0/1772955199 >> v2:172.21.15.50:3300/0 conn(0x7f2740071c50 msgr2=0x7f274006ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:05.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f273f7fe700 1 --2- 172.21.15.50:0/1772955199 >> v2:172.21.15.50:3300/0 conn(0x7f2740071c50 0x7f274006ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f273f7fe700 1 -- 172.21.15.50:0/1772955199 >> v1:172.21.15.192:6789/0 conn(0x7f27400ceaf0 legacy=0x7f274006aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f273f7fe700 1 -- 172.21.15.50:0/1772955199 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2740069de0 con 0x7f274006a650 2023-11-28T11:54:05.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7fd5ca9700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd006d700 con 0x7f7fd00ca5e0 2023-11-28T11:54:05.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7fd5ca9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd0072220 con 0x7f7fd006a560 2023-11-28T11:54:05.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7fd5ca9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd0071610 con 0x7f7fd00cee60 2023-11-28T11:54:05.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f1d19e700 1 --2- 172.21.15.50:0/1908040833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f04003a20 0x7f0f04003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f273f7fe700 1 --2- 172.21.15.50:0/1772955199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f274006a650 0x7f27400c8a30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f274006f5d0 tx=0x7f273800d430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0aa17279b06aa52 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f1d99f700 1 --2- 172.21.15.50:0/1908040833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f04005220 0x7f0f04014240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7fcffff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7fd006a560 0x7f7fd015ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:51222/0 (socket says 172.21.15.50:51222) 2023-11-28T11:54:05.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7fcffff700 1 -- 172.21.15.50:0/4059268510 learned_addr learned my addr 172.21.15.50:0/4059268510 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:05.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd54cd3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdd500cb340 0x7fdd5006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7fceffd700 1 --2- 172.21.15.50:0/4059268510 >> v2:172.21.15.192:3300/0 conn(0x7f7fd00cee60 0x7f7fd00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd54cd3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd5006f7c0 0x7fdd5006a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd54cd3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdd50071ca0 0x7fdd5006a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd54cd3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5006c6c0 con 0x7fdd500cb340 2023-11-28T11:54:05.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f1c99d700 1 --2- 172.21.15.50:0/1908040833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f04004870 0x7f0f04004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd54cd3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5006dbf0 con 0x7fdd50071ca0 2023-11-28T11:54:05.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd54cd3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd50072240 con 0x7fdd5006f7c0 2023-11-28T11:54:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f1d99f700 1 -- 172.21.15.50:0/1908040833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f04004870 msgr2=0x7f0f04004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f1d99f700 1 --2- 172.21.15.50:0/1908040833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f04004870 0x7f0f04004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f1d99f700 1 -- 172.21.15.50:0/1908040833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f04003a20 msgr2=0x7f0f04003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f1d99f700 1 --2- 172.21.15.50:0/1908040833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f04003a20 0x7f0f04003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f1d99f700 1 -- 172.21.15.50:0/1908040833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1806c8f0 con 0x7f0f04005220 2023-11-28T11:54:05.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f1d19e700 1 --2- 172.21.15.50:0/1908040833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f04003a20 0x7f0f04003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:05.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f273e7fc700 1 -- 172.21.15.50:0/1772955199 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273800b0d0 con 0x7f274006a650 2023-11-28T11:54:05.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd4ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdd50071ca0 0x7fdd5006a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd4ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdd50071ca0 0x7fdd5006a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:55880/0 (socket says 172.21.15.50:55880) 2023-11-28T11:54:05.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd4ffff700 1 -- 172.21.15.50:0/1817303634 learned_addr learned my addr 172.21.15.50:0/1817303634 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f1d99f700 1 -- 172.21.15.50:0/1908040833 reap_dead start 2023-11-28T11:54:05.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd4f7fe700 1 --2- 172.21.15.50:0/1817303634 >> v2:172.21.15.50:3300/0 conn(0x7fdd500cb340 0x7fdd5006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f273e7fc700 1 -- 172.21.15.50:0/1772955199 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273800b230 con 0x7f274006a650 2023-11-28T11:54:05.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f273e7fc700 1 -- 172.21.15.50:0/1772955199 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738009600 con 0x7f274006a650 2023-11-28T11:54:05.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd4effd700 1 --2- 172.21.15.50:0/1817303634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd5006f7c0 0x7fdd5006a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7fceffd700 1 -- 172.21.15.50:0/4059268510 >> v1:172.21.15.192:6789/0 conn(0x7f7fd006a560 legacy=0x7f7fd015ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7fceffd700 1 -- 172.21.15.50:0/4059268510 >> v1:172.21.15.50:6789/0 conn(0x7f7fd00ca5e0 legacy=0x7f7fd0069e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7fceffd700 1 -- 172.21.15.50:0/4059268510 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd00718f0 con 0x7f7fd00cee60 2023-11-28T11:54:05.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7ff4aaffd700 1 --2- 172.21.15.50:0/82692872 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff498064fb0 0x7ff498067460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0015a0 tx=0x7ff49c007a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd4ffff700 1 -- 172.21.15.50:0/1817303634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd5006f7c0 msgr2=0x7fdd5006a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:05.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd4ffff700 1 --2- 172.21.15.50:0/1817303634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd5006f7c0 0x7fdd5006a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd4ffff700 1 -- 172.21.15.50:0/1817303634 >> v2:172.21.15.50:3300/0 conn(0x7fdd500cb340 msgr2=0x7fdd5006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:05.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd4ffff700 1 --2- 172.21.15.50:0/1817303634 >> v2:172.21.15.50:3300/0 conn(0x7fdd500cb340 0x7fdd5006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd4ffff700 1 -- 172.21.15.50:0/1817303634 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5006c8f0 con 0x7fdd50071ca0 2023-11-28T11:54:05.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd4f7fe700 1 --2- 172.21.15.50:0/1817303634 >> v2:172.21.15.50:3300/0 conn(0x7fdd500cb340 0x7fdd5006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:05.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7fceffd700 1 --2- 172.21.15.50:0/4059268510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fd00cee60 0x7f7fd00cb6f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009850 tx=0x7f7fc4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9fc2f96ef436653 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7fce7fc700 1 -- 172.21.15.50:0/4059268510 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4011830 con 0x7f7fd00cee60 2023-11-28T11:54:05.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd4ffff700 1 --2- 172.21.15.50:0/1817303634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd50071ca0 0x7fdd5006a630 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdd5006c130 tx=0x7fdd4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3a8394f03f7c9e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7fce7fc700 1 -- 172.21.15.50:0/4059268510 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc4011990 con 0x7f7fd00cee60 2023-11-28T11:54:05.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7fce7fc700 1 -- 172.21.15.50:0/4059268510 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4011d20 con 0x7f7fd00cee60 2023-11-28T11:54:05.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f2744c00700 1 -- 172.21.15.50:0/1772955199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f274006a650 msgr2=0x7f27400c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f2744c00700 1 --2- 172.21.15.50:0/1772955199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f274006a650 0x7f27400c8a30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f274006f5d0 tx=0x7f273800d430 comp rx=0 tx=0).stop 2023-11-28T11:54:05.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f2744c00700 1 -- 172.21.15.50:0/1772955199 shutdown_connections 2023-11-28T11:54:05.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f2744c00700 1 --2- 172.21.15.50:0/1772955199 >> v2:172.21.15.50:3300/0 conn(0x7f2740071c50 0x7f274006ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f2744c00700 1 --2- 172.21.15.50:0/1772955199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f274006a650 0x7f27400c8a30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f2744c00700 1 -- 172.21.15.50:0/1772955199 >> 172.21.15.50:0/1772955199 conn(0x7f27400b1f90 msgr2=0x7f27400ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f1d99f700 1 --2- 172.21.15.50:0/1908040833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f04005220 0x7f0f04014240 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800c290 tx=0x7f0f040058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490464915abc9668 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd4e7fc700 1 -- 172.21.15.50:0/1817303634 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800e070 con 0x7fdd50071ca0 2023-11-28T11:54:05.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd4e7fc700 1 -- 172.21.15.50:0/1817303634 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4800b910 con 0x7fdd50071ca0 2023-11-28T11:54:05.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f2744c00700 1 -- 172.21.15.50:0/1772955199 shutdown_connections 2023-11-28T11:54:05.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f2744c00700 1 -- 172.21.15.50:0/1772955199 wait complete. 2023-11-28T11:54:05.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd4e7fc700 1 -- 172.21.15.50:0/1817303634 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800bcc0 con 0x7fdd50071ca0 2023-11-28T11:54:05.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7fd5ca9700 1 -- 172.21.15.50:0/4059268510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fd00cee60 msgr2=0x7f7fd00cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7fd5ca9700 1 --2- 172.21.15.50:0/4059268510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fd00cee60 0x7f7fd00cb6f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009850 tx=0x7f7fc4009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:05.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd54cd3700 1 -- 172.21.15.50:0/1817303634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd50071ca0 msgr2=0x7fdd5006a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd54cd3700 1 --2- 172.21.15.50:0/1817303634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd50071ca0 0x7fdd5006a630 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdd5006c130 tx=0x7fdd4800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:05.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7100ff9700 1 -- 172.21.15.50:0/1190929756 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4008930 con 0x7f71040cc400 2023-11-28T11:54:05.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fc234914700 1 -- 172.21.15.50:0/1742467396 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22800ee10 con 0x7fc21c005220 2023-11-28T11:54:05.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f0ffff700 1 -- 172.21.15.50:0/1908040833 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08007c10 con 0x7f0f04005220 2023-11-28T11:54:05.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd54cd3700 1 -- 172.21.15.50:0/1817303634 shutdown_connections 2023-11-28T11:54:05.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd54cd3700 1 --2- 172.21.15.50:0/1817303634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd50071ca0 0x7fdd5006a630 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd54cd3700 1 --2- 172.21.15.50:0/1817303634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd5006f7c0 0x7fdd5006a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd54cd3700 1 --2- 172.21.15.50:0/1817303634 >> v2:172.21.15.50:3300/0 conn(0x7fdd500cb340 0x7fdd5006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fdd54cd3700 1 -- 172.21.15.50:0/1817303634 >> 172.21.15.50:0/1817303634 conn(0x7fdd500b1f90 msgr2=0x7fdd500ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f0ffff700 1 -- 172.21.15.50:0/1908040833 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0800ce30 con 0x7f0f04005220 2023-11-28T11:54:05.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f0f0ffff700 1 -- 172.21.15.50:0/1908040833 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08005bc0 con 0x7f0f04005220 2023-11-28T11:54:05.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7100ff9700 1 -- 172.21.15.50:0/1190929756 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f4008a90 con 0x7f71040cc400 2023-11-28T11:54:05.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7100ff9700 1 -- 172.21.15.50:0/1190929756 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4008e20 con 0x7f71040cc400 2023-11-28T11:54:05.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7109384700 1 -- 172.21.15.50:0/1190929756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710406a5f0 con 0x7f71040cc400 2023-11-28T11:54:05.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7f7109384700 1 -- 172.21.15.50:0/1190929756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710406a310 con 0x7f71040cc400 2023-11-28T11:54:05.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7faa17fff700 1 -- 172.21.15.50:0/254770749 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faa2004f9c0 con 0x7faa300cee60 2023-11-28T11:54:05.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fc234914700 1 -- 172.21.15.50:0/1742467396 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22800f040 con 0x7fc21c005220 2023-11-28T11:54:05.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.825+0000 7fc234914700 1 -- 172.21.15.50:0/1742467396 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228003c60 con 0x7fc21c005220 2023-11-28T11:54:05.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fc237b7a700 1 -- 172.21.15.50:0/1742467396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c005220 msgr2=0x7fc21c00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fc237b7a700 1 --2- 172.21.15.50:0/1742467396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c005220 0x7fc21c00ba30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc22800e350 tx=0x7fc21c0058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f2744c00700 1 Processor -- start 2023-11-28T11:54:05.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f2744c00700 1 -- start start 2023-11-28T11:54:05.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fc237b7a700 1 -- 172.21.15.50:0/1742467396 shutdown_connections 2023-11-28T11:54:05.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fc237b7a700 1 --2- 172.21.15.50:0/1742467396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c005220 0x7fc21c00ba30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fc237b7a700 1 -- 172.21.15.50:0/1742467396 >> 172.21.15.50:0/1742467396 conn(0x7fc2300b2010 msgr2=0x7fc2300ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f0f1e1a0700 1 -- 172.21.15.50:0/1908040833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f04005220 msgr2=0x7f0f04014240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f0f1e1a0700 1 --2- 172.21.15.50:0/1908040833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f04005220 0x7f0f04014240 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800c290 tx=0x7f0f040058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fdd54cd3700 1 -- 172.21.15.50:0/1817303634 shutdown_connections 2023-11-28T11:54:05.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f7fd5ca9700 1 -- 172.21.15.50:0/4059268510 shutdown_connections 2023-11-28T11:54:05.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f7fd5ca9700 1 --2- 172.21.15.50:0/4059268510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fd00cee60 0x7f7fd00cb6f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f7fd5ca9700 1 -- 172.21.15.50:0/4059268510 >> 172.21.15.50:0/4059268510 conn(0x7f7fd00b2010 msgr2=0x7f7fd00ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fc237b7a700 1 -- 172.21.15.50:0/1742467396 shutdown_connections 2023-11-28T11:54:05.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fdd54cd3700 1 -- 172.21.15.50:0/1817303634 wait complete. 2023-11-28T11:54:05.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f7fd5ca9700 1 -- 172.21.15.50:0/4059268510 shutdown_connections 2023-11-28T11:54:05.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f0f1e1a0700 1 -- 172.21.15.50:0/1908040833 shutdown_connections 2023-11-28T11:54:05.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f0f1e1a0700 1 --2- 172.21.15.50:0/1908040833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f04005220 0x7f0f04014240 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f0f1e1a0700 1 -- 172.21.15.50:0/1908040833 >> 172.21.15.50:0/1908040833 conn(0x7f0f180b1f90 msgr2=0x7f0f180ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:05.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fc237b7a700 1 -- 172.21.15.50:0/1742467396 wait complete. 2023-11-28T11:54:05.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f7fd5ca9700 1 -- 172.21.15.50:0/4059268510 wait complete. 2023-11-28T11:54:05.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f2744c00700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f274006a650 0x7f27400c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f2744c00700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2740071c50 0x7f27400c1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f2744c00700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27400ceaf0 0x7f2740095b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f2744c00700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27400c1780 con 0x7f274006a650 2023-11-28T11:54:05.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f2744c00700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27400b0840 con 0x7f2740071c50 2023-11-28T11:54:05.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f2744c00700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27400b0560 con 0x7f27400ceaf0 2023-11-28T11:54:05.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f273f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f274006a650 0x7f27400c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f273f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f274006a650 0x7f27400c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53376/0 (socket says 172.21.15.50:53376) 2023-11-28T11:54:05.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f273f7fe700 1 -- 172.21.15.50:0/141939458 learned_addr learned my addr 172.21.15.50:0/141939458 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f273ffff700 1 --2- 172.21.15.50:0/141939458 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27400ceaf0 0x7f2740095b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f273f7fe700 1 -- 172.21.15.50:0/141939458 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27400ceaf0 msgr2=0x7f2740095b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f273f7fe700 1 --2- 172.21.15.50:0/141939458 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27400ceaf0 0x7f2740095b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f273f7fe700 1 -- 172.21.15.50:0/141939458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2740071c50 msgr2=0x7f27400c1240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T11:54:05.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f273f7fe700 1 --2- 172.21.15.50:0/141939458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2740071c50 0x7f27400c1240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f273f7fe700 1 -- 172.21.15.50:0/141939458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273800bd40 con 0x7f274006a650 2023-11-28T11:54:05.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fdd54cd3700 1 Processor -- start 2023-11-28T11:54:05.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fdd54cd3700 1 -- start start 2023-11-28T11:54:05.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f273f7fe700 1 --2- 172.21.15.50:0/141939458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f274006a650 0x7f27400c89b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f273800d830 tx=0x7f2738004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f7fd5ca9700 1 Processor -- start 2023-11-28T11:54:05.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f7fd5ca9700 1 -- start start 2023-11-28T11:54:05.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fc237b7a700 1 Processor -- start 2023-11-28T11:54:05.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fc237b7a700 1 -- start start 2023-11-28T11:54:05.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f0f1e1a0700 1 -- 172.21.15.50:0/1908040833 shutdown_connections 2023-11-28T11:54:05.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f2727fff700 1 -- 172.21.15.50:0/141939458 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738022070 con 0x7f274006a650 2023-11-28T11:54:05.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f2727fff700 1 -- 172.21.15.50:0/141939458 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273800b6e0 con 0x7f274006a650 2023-11-28T11:54:05.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f2727fff700 1 -- 172.21.15.50:0/141939458 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738009be0 con 0x7f274006a650 2023-11-28T11:54:05.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fd5ca9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7fd006a560 0x7f7fd00cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fd5ca9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fd00ca5e0 0x7f7fd00ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fd5ca9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fd00cee60 0x7f7fd00ad950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fd5ca9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd00c6440 con 0x7f7fd00cee60 2023-11-28T11:54:05.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fd5ca9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd00cea90 con 0x7f7fd00ca5e0 2023-11-28T11:54:05.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fd5ca9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd00c66b0 con 0x7f7fd006a560 2023-11-28T11:54:05.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fceffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fd00ca5e0 0x7f7fd00ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fcf7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7fd006a560 0x7f7fd00cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fceffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fd00ca5e0 0x7f7fd00ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:55886/0 (socket says 172.21.15.50:55886) 2023-11-28T11:54:05.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fcf7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7fd006a560 0x7f7fd00cd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:54456/0 (socket says 172.21.15.50:54456) 2023-11-28T11:54:05.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fceffd700 1 -- 172.21.15.50:0/2807703010 learned_addr learned my addr 172.21.15.50:0/2807703010 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fcffff700 1 --2- 172.21.15.50:0/2807703010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fd00cee60 0x7f7fd00ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fdd54cd3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd5006f7c0 0x7fdd50097950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fdd54cd3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd50071ca0 0x7fdd500c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fdd54cd3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd500cb340 0x7fdd5009b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fdd54cd3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500cd240 con 0x7fdd5006f7c0 2023-11-28T11:54:05.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fdd54cd3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5014ebd0 con 0x7fdd500cb340 2023-11-28T11:54:05.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7fdd54cd3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500c1c70 con 0x7fdd50071ca0 2023-11-28T11:54:05.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fdd4f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd5006f7c0 0x7fdd50097950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fdd4f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd5006f7c0 0x7fdd50097950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53382/0 (socket says 172.21.15.50:53382) 2023-11-28T11:54:05.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fdd4f7fe700 1 -- 172.21.15.50:0/298864064 learned_addr learned my addr 172.21.15.50:0/298864064 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fdd4f7fe700 1 -- 172.21.15.50:0/298864064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd50071ca0 msgr2=0x7fdd500c4320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T11:54:05.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fdd4f7fe700 1 --2- 172.21.15.50:0/298864064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd50071ca0 0x7fdd500c4320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fdd4f7fe700 1 -- 172.21.15.50:0/298864064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd500cb340 msgr2=0x7fdd5009b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fdd4f7fe700 1 --2- 172.21.15.50:0/298864064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd500cb340 0x7fdd5009b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fdd4f7fe700 1 -- 172.21.15.50:0/298864064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd400094b0 con 0x7fdd5006f7c0 2023-11-28T11:54:05.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fdd4f7fe700 1 --2- 172.21.15.50:0/298864064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd5006f7c0 0x7fdd50097950 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000ebe0 tx=0x7fdd40009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f2744c00700 1 -- 172.21.15.50:0/141939458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274006a3a0 con 0x7f274006a650 2023-11-28T11:54:05.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f2744c00700 1 -- 172.21.15.50:0/141939458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274006a0c0 con 0x7f274006a650 2023-11-28T11:54:05.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fcffff700 1 -- 172.21.15.50:0/2807703010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7fd006a560 msgr2=0x7f7fd00cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fcffff700 1 --2- 172.21.15.50:0/2807703010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7fd006a560 0x7f7fd00cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fcffff700 1 -- 172.21.15.50:0/2807703010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fd00ca5e0 msgr2=0x7f7fd00ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fcffff700 1 --2- 172.21.15.50:0/2807703010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fd00ca5e0 0x7f7fd00ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fcffff700 1 -- 172.21.15.50:0/2807703010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc40094b0 con 0x7f7fd00cee60 2023-11-28T11:54:05.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fcf7fe700 1 --2- 172.21.15.50:0/2807703010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7fd006a560 0x7f7fd00cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:05.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7fcffff700 1 --2- 172.21.15.50:0/2807703010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fd00cee60 0x7f7fd00ad950 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800ca70 tx=0x7f7fc800caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f0f1e1a0700 1 -- 172.21.15.50:0/1908040833 wait complete. 2023-11-28T11:54:05.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1e1a0700 1 Processor -- start 2023-11-28T11:54:05.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1e1a0700 1 -- start start 2023-11-28T11:54:05.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1e1a0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f04005220 0x7f0f181ee9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1e1a0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f180cc8f0 0x7f0f180af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1e1a0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f1815a330 0x7f0f180aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1e1a0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f180b0ab0 con 0x7f0f180cc8f0 2023-11-28T11:54:05.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1e1a0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f180b0d90 con 0x7f0f04005220 2023-11-28T11:54:05.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1e1a0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f181edef0 con 0x7f0f1815a330 2023-11-28T11:54:05.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1d19e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f04005220 0x7f0f181ee9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1d19e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f04005220 0x7f0f181ee9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:55892/0 (socket says 172.21.15.50:55892) 2023-11-28T11:54:05.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1d19e700 1 -- 172.21.15.50:0/1818086844 learned_addr learned my addr 172.21.15.50:0/1818086844 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1d99f700 1 --2- 172.21.15.50:0/1818086844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f1815a330 0x7f0f180aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f2744c00700 1 -- 172.21.15.50:0/141939458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27400caa90 con 0x7f274006a650 2023-11-28T11:54:05.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1d19e700 1 -- 172.21.15.50:0/1818086844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f1815a330 msgr2=0x7f0f180aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:05.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1d19e700 1 --2- 172.21.15.50:0/1818086844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f1815a330 0x7f0f180aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1d19e700 1 -- 172.21.15.50:0/1818086844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f180cc8f0 msgr2=0x7f0f180af9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T11:54:05.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1d19e700 1 --2- 172.21.15.50:0/1818086844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f180cc8f0 0x7f0f180af9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1d19e700 1 -- 172.21.15.50:0/1818086844 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1806ceb0 con 0x7f0f04005220 2023-11-28T11:54:05.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f0f1d19e700 1 --2- 172.21.15.50:0/1818086844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f04005220 0x7f0f181ee9d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000f460 tx=0x7f0f1000f770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7f0f0dffb700 1 -- 172.21.15.50:0/1818086844 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1000e040 con 0x7f0f04005220 2023-11-28T11:54:05.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fc237b7a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c005220 0x7fc230156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fc237b7a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc230157b80 0x7fc23009a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fc237b7a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc230098a50 0x7fc23009ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fc237b7a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2300ccf90 con 0x7fc21c005220 2023-11-28T11:54:05.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fc237b7a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc230098f30 con 0x7fc230098a50 2023-11-28T11:54:05.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fc237b7a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2300cc4b0 con 0x7fc230157b80 2023-11-28T11:54:05.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fc235916700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c005220 0x7fc230156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fc235916700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c005220 0x7fc230156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53402/0 (socket says 172.21.15.50:53402) 2023-11-28T11:54:05.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fc235916700 1 -- 172.21.15.50:0/3415456874 learned_addr learned my addr 172.21.15.50:0/3415456874 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:05.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fc235916700 1 -- 172.21.15.50:0/3415456874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc230157b80 msgr2=0x7fc23009a6f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T11:54:05.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fc235916700 1 --2- 172.21.15.50:0/3415456874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc230157b80 0x7fc23009a6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fc235916700 1 -- 172.21.15.50:0/3415456874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc230098a50 msgr2=0x7fc23009ac30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T11:54:05.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fc235916700 1 --2- 172.21.15.50:0/3415456874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc230098a50 0x7fc23009ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:05.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7f0f0dffb700 1 -- 172.21.15.50:0/1818086844 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1000f040 con 0x7f0f04005220 2023-11-28T11:54:05.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7f0f0dffb700 1 -- 172.21.15.50:0/1818086844 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10003c40 con 0x7f0f04005220 2023-11-28T11:54:05.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7f0f1e1a0700 1 -- 172.21.15.50:0/1818086844 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1806cbd0 con 0x7f0f04005220 2023-11-28T11:54:05.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fc235916700 1 -- 172.21.15.50:0/3415456874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc230071ef0 con 0x7fc21c005220 2023-11-28T11:54:05.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7fc235916700 1 --2- 172.21.15.50:0/3415456874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c005220 0x7fc230156270 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc220000fb0 tx=0x7fc22000fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7f0f1e1a0700 1 -- 172.21.15.50:0/1818086844 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1806d190 con 0x7f0f04005220 2023-11-28T11:54:05.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f7109384700 1 -- 172.21.15.50:0/1190929756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71040cec90 con 0x7f71040cc400 2023-11-28T11:54:05.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f7100ff9700 1 -- 172.21.15.50:0/1190929756 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f70f4013070 con 0x7f71040cc400 2023-11-28T11:54:05.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.829+0000 7f7100ff9700 1 --2- 172.21.15.50:0/1190929756 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f70f0064f30 0x7f70f00673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7100ff9700 1 -- 172.21.15.50:0/1190929756 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f70f4081db0 con 0x7f71040cc400 2023-11-28T11:54:05.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7103fff700 1 --2- 172.21.15.50:0/1190929756 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f70f0064f30 0x7f70f00673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.833+0000 7f7103fff700 1 --2- 172.21.15.50:0/1190929756 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f70f0064f30 0x7f70f00673e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f70f8000c00 tx=0x7f70f8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7ff4937fe700 1 -- 172.21.15.50:0/82692872 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff4a4051bf0 con 0x7ff4ac0cee60 2023-11-28T11:54:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7fdd3ffff700 1 -- 172.21.15.50:0/298864064 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4000c8b0 con 0x7fdd5006f7c0 2023-11-28T11:54:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7fc2267fc700 1 -- 172.21.15.50:0/3415456874 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220006380 con 0x7fc21c005220 2023-11-28T11:54:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7fdd54cd3700 1 -- 172.21.15.50:0/298864064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd48009b30 con 0x7fdd5006f7c0 2023-11-28T11:54:05.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7fdd54cd3700 1 -- 172.21.15.50:0/298864064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5006ceb0 con 0x7fdd5006f7c0 2023-11-28T11:54:05.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7f0f0dffb700 1 -- 172.21.15.50:0/1818086844 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0f10024070 con 0x7f0f04005220 2023-11-28T11:54:05.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7f7fbffff700 1 -- 172.21.15.50:0/2807703010 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80074e0 con 0x7f7fd00cee60 2023-11-28T11:54:05.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7f7fd5ca9700 1 -- 172.21.15.50:0/2807703010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd0071eb0 con 0x7f7fd00cee60 2023-11-28T11:54:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7fc237b7a700 1 -- 172.21.15.50:0/3415456874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2301586d0 con 0x7fc21c005220 2023-11-28T11:54:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7fc237b7a700 1 -- 172.21.15.50:0/3415456874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23006a780 con 0x7fc21c005220 2023-11-28T11:54:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7f7fd5ca9700 1 -- 172.21.15.50:0/2807703010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd0071bd0 con 0x7f7fd00cee60 2023-11-28T11:54:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7fdd3ffff700 1 -- 172.21.15.50:0/298864064 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd40005a40 con 0x7fdd5006f7c0 2023-11-28T11:54:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7fdd3ffff700 1 -- 172.21.15.50:0/298864064 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd40005db0 con 0x7fdd5006f7c0 2023-11-28T11:54:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7f7fbffff700 1 -- 172.21.15.50:0/2807703010 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc8007640 con 0x7f7fd00cee60 2023-11-28T11:54:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7f7fbffff700 1 -- 172.21.15.50:0/2807703010 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80079b0 con 0x7f7fd00cee60 2023-11-28T11:54:05.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7f0f0dffb700 1 --2- 172.21.15.50:0/1818086844 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0efc064fe0 0x7f0efc067490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7f0f0dffb700 1 -- 172.21.15.50:0/1818086844 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0f10082a80 con 0x7f0f04005220 2023-11-28T11:54:05.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7fc2267fc700 1 -- 172.21.15.50:0/3415456874 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2200064e0 con 0x7fc21c005220 2023-11-28T11:54:05.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.837+0000 7fc2267fc700 1 -- 172.21.15.50:0/3415456874 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2200039c0 con 0x7fc21c005220 2023-11-28T11:54:05.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.841+0000 7f0f1c99d700 1 --2- 172.21.15.50:0/1818086844 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0efc064fe0 0x7f0efc067490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.841+0000 7f0f1e1a0700 1 -- 172.21.15.50:0/1818086844 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef8005310 con 0x7f0f04005220 2023-11-28T11:54:05.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.841+0000 7fdd54cd3700 1 -- 172.21.15.50:0/298864064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2c005310 con 0x7fdd5006f7c0 2023-11-28T11:54:05.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.841+0000 7f2727fff700 1 -- 172.21.15.50:0/141939458 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2738019030 con 0x7f274006a650 2023-11-28T11:54:05.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.841+0000 7f0f1c99d700 1 --2- 172.21.15.50:0/1818086844 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0efc064fe0 0x7f0efc067490 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0f181f1330 tx=0x7f0f14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.841+0000 7f2727fff700 1 --2- 172.21.15.50:0/141939458 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f272c064fb0 0x7f272c067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.841+0000 7f2727fff700 1 -- 172.21.15.50:0/141939458 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f27380876c0 con 0x7f274006a650 2023-11-28T11:54:05.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.841+0000 7f7fd5ca9700 1 -- 172.21.15.50:0/2807703010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd00c8ab0 con 0x7f7fd00cee60 2023-11-28T11:54:05.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.841+0000 7f273effd700 1 --2- 172.21.15.50:0/141939458 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f272c064fb0 0x7f272c067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.841+0000 7f273effd700 1 --2- 172.21.15.50:0/141939458 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f272c064fb0 0x7f272c067460 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2730000f60 tx=0x7f2730007a60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.841+0000 7fdd3ffff700 1 -- 172.21.15.50:0/298864064 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdd40019030 con 0x7fdd5006f7c0 2023-11-28T11:54:05.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.841+0000 7fdd3ffff700 1 --2- 172.21.15.50:0/298864064 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdd34064ee0 0x7fdd34067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.841+0000 7fdd4effd700 1 --2- 172.21.15.50:0/298864064 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdd34064ee0 0x7fdd34067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.841+0000 7fdd4effd700 1 --2- 172.21.15.50:0/298864064 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdd34064ee0 0x7fdd34067390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd500adbe0 tx=0x7fdd44009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.845+0000 7f7100ff9700 1 -- 172.21.15.50:0/1190929756 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f70f404fd00 con 0x7f71040cc400 2023-11-28T11:54:05.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.845+0000 7fdd3ffff700 1 -- 172.21.15.50:0/298864064 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdd40053820 con 0x7fdd5006f7c0 2023-11-28T11:54:05.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.845+0000 7f2727fff700 1 -- 172.21.15.50:0/141939458 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2738055500 con 0x7f274006a650 2023-11-28T11:54:05.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.845+0000 7f7fbffff700 1 -- 172.21.15.50:0/2807703010 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7fc8019030 con 0x7f7fd00cee60 2023-11-28T11:54:05.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.845+0000 7fc2267fc700 1 -- 172.21.15.50:0/3415456874 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc22001c030 con 0x7fc21c005220 2023-11-28T11:54:05.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.845+0000 7f7fbffff700 1 --2- 172.21.15.50:0/2807703010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7fb4064ee0 0x7f7fb4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.845+0000 7fc2267fc700 1 --2- 172.21.15.50:0/3415456874 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc214064ee0 0x7fc214067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:05.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.845+0000 7f7fcf7fe700 1 --2- 172.21.15.50:0/2807703010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7fb4064ee0 0x7f7fb4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.845+0000 7fc235115700 1 --2- 172.21.15.50:0/3415456874 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc214064ee0 0x7fc214067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:05.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.845+0000 7f7fcf7fe700 1 --2- 172.21.15.50:0/2807703010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7fb4064ee0 0x7f7fb4067390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0000f60 tx=0x7f7fc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.849+0000 7fc235115700 1 --2- 172.21.15.50:0/3415456874 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc214064ee0 0x7fc214067390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc2300afee0 tx=0x7fc22c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:05.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.849+0000 7fc237b7a700 1 -- 172.21.15.50:0/3415456874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc218005310 con 0x7fc21c005220 2023-11-28T11:54:05.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.849+0000 7f0f0dffb700 1 -- 172.21.15.50:0/1818086844 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0f100508c0 con 0x7f0f04005220 2023-11-28T11:54:05.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.853+0000 7fc2267fc700 1 -- 172.21.15.50:0/3415456874 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc2200533e0 con 0x7fc21c005220 2023-11-28T11:54:05.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.853+0000 7fdd3ffff700 1 -- 172.21.15.50:0/298864064 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdd4004fbc0 con 0x7fdd5006f7c0 2023-11-28T11:54:05.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.857+0000 7f7fbffff700 1 -- 172.21.15.50:0/2807703010 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7fc8021c70 con 0x7f7fd00cee60 2023-11-28T11:54:05.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.861+0000 7f7fbffff700 1 -- 172.21.15.50:0/2807703010 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7fc8053680 con 0x7f7fd00cee60 2023-11-28T11:54:05.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:05.869+0000 7fc2267fc700 1 -- 172.21.15.50:0/3415456874 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc22001a020 con 0x7fc21c005220 2023-11-28T11:54:05.980 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:54:05.982 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:54:06.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.141+0000 7faa3602d700 1 -- 172.21.15.50:0/254770749 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7faa300abbf0 con 0x7faa300cee60 2023-11-28T11:54:06.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.141+0000 7faa17fff700 1 -- 172.21.15.50:0/254770749 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faa20052fe0 con 0x7faa300cee60 2023-11-28T11:54:06.147 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-11-28T11:54:06.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.141+0000 7ff4b1418700 1 -- 172.21.15.50:0/82692872 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff4ac0008d0 con 0x7ff4ac0cee60 2023-11-28T11:54:06.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.141+0000 7ff4937fe700 1 -- 172.21.15.50:0/82692872 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4a4055210 con 0x7ff4ac0cee60 2023-11-28T11:54:06.148 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-11-28T11:54:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7ff4917fa700 1 -- 172.21.15.50:0/82692872 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff498064fb0 msgr2=0x7ff498067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7ff4917fa700 1 --2- 172.21.15.50:0/82692872 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff498064fb0 0x7ff498067460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0015a0 tx=0x7ff49c007a80 comp rx=0 tx=0).stop 2023-11-28T11:54:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7ff4917fa700 1 -- 172.21.15.50:0/82692872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4ac0cee60 msgr2=0x7ff4ac0cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7ff4917fa700 1 --2- 172.21.15.50:0/82692872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4ac0cee60 0x7ff4ac0cc220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400b730 tx=0x7ff4a4004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7ff4917fa700 1 -- 172.21.15.50:0/82692872 shutdown_connections 2023-11-28T11:54:06.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7faa15ffb700 1 -- 172.21.15.50:0/254770749 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa1c064f60 msgr2=0x7faa1c067410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:06.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7faa15ffb700 1 --2- 172.21.15.50:0/254770749 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa1c064f60 0x7faa1c067410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faa2800b370 tx=0x7faa28011000 comp rx=0 tx=0).stop 2023-11-28T11:54:06.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7faa15ffb700 1 -- 172.21.15.50:0/254770749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa300cee60 msgr2=0x7faa3006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:06.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7faa15ffb700 1 --2- 172.21.15.50:0/254770749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa300cee60 0x7faa3006d150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faa2000c430 tx=0x7faa2000c740 comp rx=0 tx=0).stop 2023-11-28T11:54:06.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7ff4917fa700 1 --2- 172.21.15.50:0/82692872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4ac0cee60 0x7ff4ac0cc220 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7ff4917fa700 1 --2- 172.21.15.50:0/82692872 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff498064fb0 0x7ff498067460 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7ff4917fa700 1 --2- 172.21.15.50:0/82692872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4ac0ca5e0 0x7ff4ac1e0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7faa15ffb700 1 -- 172.21.15.50:0/254770749 shutdown_connections 2023-11-28T11:54:06.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7faa15ffb700 1 --2- 172.21.15.50:0/254770749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa300cee60 0x7faa3006d150 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7faa15ffb700 1 --2- 172.21.15.50:0/254770749 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa1c064f60 0x7faa1c067410 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7faa15ffb700 1 --2- 172.21.15.50:0/254770749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa300ca5e0 0x7faa3006cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7faa15ffb700 1 --2- 172.21.15.50:0/254770749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa3006a560 0x7faa301fdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7faa15ffb700 1 -- 172.21.15.50:0/254770749 >> 172.21.15.50:0/254770749 conn(0x7faa300b2010 msgr2=0x7faa300adcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7ff4917fa700 1 --2- 172.21.15.50:0/82692872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4ac06a560 0x7ff4ac0c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7ff4917fa700 1 -- 172.21.15.50:0/82692872 >> 172.21.15.50:0/82692872 conn(0x7ff4ac0b2010 msgr2=0x7ff4ac0b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7faa15ffb700 1 -- 172.21.15.50:0/254770749 shutdown_connections 2023-11-28T11:54:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7faa15ffb700 1 -- 172.21.15.50:0/254770749 wait complete. 2023-11-28T11:54:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7ff4917fa700 1 -- 172.21.15.50:0/82692872 shutdown_connections 2023-11-28T11:54:06.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.149+0000 7ff4917fa700 1 -- 172.21.15.50:0/82692872 wait complete. 2023-11-28T11:54:06.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2023-11-28T11:54:06.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.169+0000 7f7109384700 1 -- 172.21.15.50:0/1190929756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7104072500 con 0x7f71040cc400 2023-11-28T11:54:06.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2023-11-28T11:54:06.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.169+0000 7f7100ff9700 1 -- 172.21.15.50:0/1190929756 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f70f4053320 con 0x7f71040cc400 2023-11-28T11:54:06.173 INFO:teuthology.orchestra.run.smithi050.stdout:55834574855 2023-11-28T11:54:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f2744c00700 1 -- 172.21.15.50:0/141939458 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2740072500 con 0x7f274006a650 2023-11-28T11:54:06.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f7109384700 1 -- 172.21.15.50:0/1190929756 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f70f0064f30 msgr2=0x7f70f00673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:06.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f7109384700 1 --2- 172.21.15.50:0/1190929756 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f70f0064f30 0x7f70f00673e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f70f8000c00 tx=0x7f70f8008030 comp rx=0 tx=0).stop 2023-11-28T11:54:06.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f7109384700 1 -- 172.21.15.50:0/1190929756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71040cc400 msgr2=0x7f71041fdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:06.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f7109384700 1 --2- 172.21.15.50:0/1190929756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71040cc400 0x7f71041fdec0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f70f400b9c0 tx=0x7f70f400d400 comp rx=0 tx=0).stop 2023-11-28T11:54:06.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f7109384700 1 -- 172.21.15.50:0/1190929756 shutdown_connections 2023-11-28T11:54:06.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f7109384700 1 --2- 172.21.15.50:0/1190929756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71040cc400 0x7f71041fdec0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f7109384700 1 --2- 172.21.15.50:0/1190929756 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f70f0064f30 0x7f70f00673e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f7109384700 1 --2- 172.21.15.50:0/1190929756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71040cbfb0 0x7f71040acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f7109384700 1 --2- 172.21.15.50:0/1190929756 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f710406f7c0 0x7f71040b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f7109384700 1 -- 172.21.15.50:0/1190929756 >> 172.21.15.50:0/1190929756 conn(0x7f71040b1f90 msgr2=0x7f710406cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:06.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f7109384700 1 -- 172.21.15.50:0/1190929756 shutdown_connections 2023-11-28T11:54:06.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f2727fff700 1 -- 172.21.15.50:0/141939458 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2738058b20 con 0x7f274006a650 2023-11-28T11:54:06.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f7109384700 1 -- 172.21.15.50:0/1190929756 wait complete. 2023-11-28T11:54:06.178 INFO:teuthology.orchestra.run.smithi050.stdout:55834574855 2023-11-28T11:54:06.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f7fd5ca9700 1 -- 172.21.15.50:0/2807703010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7fd00008d0 con 0x7f7fd00cee60 2023-11-28T11:54:06.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f7fbffff700 1 -- 172.21.15.50:0/2807703010 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7fc8017020 con 0x7f7fd00cee60 2023-11-28T11:54:06.178 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-11-28T11:54:06.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f2744c00700 1 -- 172.21.15.50:0/141939458 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f272c064fb0 msgr2=0x7f272c067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:06.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f2744c00700 1 --2- 172.21.15.50:0/141939458 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f272c064fb0 0x7f272c067460 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2730000f60 tx=0x7f2730007a60 comp rx=0 tx=0).stop 2023-11-28T11:54:06.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f2744c00700 1 -- 172.21.15.50:0/141939458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f274006a650 msgr2=0x7f27400c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:06.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f2744c00700 1 --2- 172.21.15.50:0/141939458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f274006a650 0x7f27400c89b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f273800d830 tx=0x7f2738004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f2744c00700 1 -- 172.21.15.50:0/141939458 shutdown_connections 2023-11-28T11:54:06.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f2744c00700 1 --2- 172.21.15.50:0/141939458 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27400ceaf0 0x7f2740095b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f2744c00700 1 --2- 172.21.15.50:0/141939458 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f272c064fb0 0x7f272c067460 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f2744c00700 1 --2- 172.21.15.50:0/141939458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2740071c50 0x7f27400c1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f2744c00700 1 --2- 172.21.15.50:0/141939458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f274006a650 0x7f27400c89b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f2744c00700 1 -- 172.21.15.50:0/141939458 >> 172.21.15.50:0/141939458 conn(0x7f27400b1f90 msgr2=0x7f27400c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:06.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f2744c00700 1 -- 172.21.15.50:0/141939458 shutdown_connections 2023-11-28T11:54:06.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.173+0000 7f2744c00700 1 -- 172.21.15.50:0/141939458 wait complete. 2023-11-28T11:54:06.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.177+0000 7f7fd5ca9700 1 -- 172.21.15.50:0/2807703010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7fb4064ee0 msgr2=0x7f7fb4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:06.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.177+0000 7f7fd5ca9700 1 --2- 172.21.15.50:0/2807703010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7fb4064ee0 0x7f7fb4067390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0000f60 tx=0x7f7fc0009040 comp rx=0 tx=0).stop 2023-11-28T11:54:06.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.177+0000 7f7fd5ca9700 1 -- 172.21.15.50:0/2807703010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fd00cee60 msgr2=0x7f7fd00ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:06.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.177+0000 7f7fd5ca9700 1 --2- 172.21.15.50:0/2807703010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fd00cee60 0x7f7fd00ad950 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800ca70 tx=0x7f7fc800caa0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.177+0000 7f7fd5ca9700 1 -- 172.21.15.50:0/2807703010 shutdown_connections 2023-11-28T11:54:06.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.177+0000 7f7fd5ca9700 1 --2- 172.21.15.50:0/2807703010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fd00cee60 0x7f7fd00ad950 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.177+0000 7f7fd5ca9700 1 --2- 172.21.15.50:0/2807703010 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7fb4064ee0 0x7f7fb4067390 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.177+0000 7f7fd5ca9700 1 --2- 172.21.15.50:0/2807703010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fd00ca5e0 0x7f7fd00ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.177+0000 7f7fd5ca9700 1 --2- 172.21.15.50:0/2807703010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7fd006a560 0x7f7fd00cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.177+0000 7f7fd5ca9700 1 -- 172.21.15.50:0/2807703010 >> 172.21.15.50:0/2807703010 conn(0x7f7fd00b2010 msgr2=0x7f7fd00af6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:06.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.177+0000 7f7fd5ca9700 1 -- 172.21.15.50:0/2807703010 shutdown_connections 2023-11-28T11:54:06.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.177+0000 7f7fd5ca9700 1 -- 172.21.15.50:0/2807703010 wait complete. 2023-11-28T11:54:06.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.181+0000 7f0f1e1a0700 1 -- 172.21.15.50:0/1818086844 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0ef80055c0 con 0x7f0f04005220 2023-11-28T11:54:06.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.181+0000 7f0f0dffb700 1 -- 172.21.15.50:0/1818086844 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0f10022070 con 0x7f0f04005220 2023-11-28T11:54:06.186 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-11-28T11:54:06.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7fdd54cd3700 1 -- 172.21.15.50:0/298864064 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdd2c0055c0 con 0x7fdd5006f7c0 2023-11-28T11:54:06.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7f0f1e1a0700 1 -- 172.21.15.50:0/1818086844 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0efc064fe0 msgr2=0x7f0efc067490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:06.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7f0f1e1a0700 1 --2- 172.21.15.50:0/1818086844 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0efc064fe0 0x7f0efc067490 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0f181f1330 tx=0x7f0f14009040 comp rx=0 tx=0).stop 2023-11-28T11:54:06.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7f0f1e1a0700 1 -- 172.21.15.50:0/1818086844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f04005220 msgr2=0x7f0f181ee9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:06.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7f0f1e1a0700 1 --2- 172.21.15.50:0/1818086844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f04005220 0x7f0f181ee9d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000f460 tx=0x7f0f1000f770 comp rx=0 tx=0).stop 2023-11-28T11:54:06.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7f0f1e1a0700 1 -- 172.21.15.50:0/1818086844 shutdown_connections 2023-11-28T11:54:06.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7f0f1e1a0700 1 --2- 172.21.15.50:0/1818086844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f1815a330 0x7f0f180aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7f0f1e1a0700 1 --2- 172.21.15.50:0/1818086844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f180cc8f0 0x7f0f180af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7f0f1e1a0700 1 --2- 172.21.15.50:0/1818086844 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0efc064fe0 0x7f0efc067490 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7f0f1e1a0700 1 --2- 172.21.15.50:0/1818086844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f04005220 0x7f0f181ee9d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7f0f1e1a0700 1 -- 172.21.15.50:0/1818086844 >> 172.21.15.50:0/1818086844 conn(0x7f0f180b1f90 msgr2=0x7f0f18156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:06.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7fdd3ffff700 1 -- 172.21.15.50:0/298864064 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd40017090 con 0x7fdd5006f7c0 2023-11-28T11:54:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7fc237b7a700 1 -- 172.21.15.50:0/3415456874 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc2180055c0 con 0x7fc21c005220 2023-11-28T11:54:06.190 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-11-28T11:54:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7f0f1e1a0700 1 -- 172.21.15.50:0/1818086844 shutdown_connections 2023-11-28T11:54:06.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7f0f1e1a0700 1 -- 172.21.15.50:0/1818086844 wait complete. 2023-11-28T11:54:06.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7fc2267fc700 1 -- 172.21.15.50:0/3415456874 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc22004f780 con 0x7fc21c005220 2023-11-28T11:54:06.191 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-11-28T11:54:06.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7fc237b7a700 1 -- 172.21.15.50:0/3415456874 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc214064ee0 msgr2=0x7fc214067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:06.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7fc237b7a700 1 --2- 172.21.15.50:0/3415456874 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc214064ee0 0x7fc214067390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc2300afee0 tx=0x7fc22c008040 comp rx=0 tx=0).stop 2023-11-28T11:54:06.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7fc237b7a700 1 -- 172.21.15.50:0/3415456874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c005220 msgr2=0x7fc230156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:06.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.185+0000 7fc237b7a700 1 --2- 172.21.15.50:0/3415456874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c005220 0x7fc230156270 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc220000fb0 tx=0x7fc22000fa60 comp rx=0 tx=0).stop 2023-11-28T11:54:06.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fc237b7a700 1 -- 172.21.15.50:0/3415456874 shutdown_connections 2023-11-28T11:54:06.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fc237b7a700 1 --2- 172.21.15.50:0/3415456874 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc214064ee0 0x7fc214067390 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fc237b7a700 1 --2- 172.21.15.50:0/3415456874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc230098a50 0x7fc23009ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fc237b7a700 1 --2- 172.21.15.50:0/3415456874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc230157b80 0x7fc23009a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fc237b7a700 1 --2- 172.21.15.50:0/3415456874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc21c005220 0x7fc230156270 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fc237b7a700 1 -- 172.21.15.50:0/3415456874 >> 172.21.15.50:0/3415456874 conn(0x7fc2300b2010 msgr2=0x7fc2301571d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:06.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fdd54cd3700 1 -- 172.21.15.50:0/298864064 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdd34064ee0 msgr2=0x7fdd34067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:06.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fdd54cd3700 1 --2- 172.21.15.50:0/298864064 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdd34064ee0 0x7fdd34067390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd500adbe0 tx=0x7fdd44009240 comp rx=0 tx=0).stop 2023-11-28T11:54:06.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fdd54cd3700 1 -- 172.21.15.50:0/298864064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd5006f7c0 msgr2=0x7fdd50097950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:06.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fdd54cd3700 1 --2- 172.21.15.50:0/298864064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd5006f7c0 0x7fdd50097950 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000ebe0 tx=0x7fdd40009e30 comp rx=0 tx=0).stop 2023-11-28T11:54:06.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fdd54cd3700 1 -- 172.21.15.50:0/298864064 shutdown_connections 2023-11-28T11:54:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fdd54cd3700 1 --2- 172.21.15.50:0/298864064 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdd34064ee0 0x7fdd34067390 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fdd54cd3700 1 --2- 172.21.15.50:0/298864064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd500cb340 0x7fdd5009b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fdd54cd3700 1 --2- 172.21.15.50:0/298864064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd50071ca0 0x7fdd500c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fdd54cd3700 1 --2- 172.21.15.50:0/298864064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd5006f7c0 0x7fdd50097950 secure :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000ebe0 tx=0x7fdd40009e30 comp rx=0 tx=0).stop 2023-11-28T11:54:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fdd54cd3700 1 -- 172.21.15.50:0/298864064 >> 172.21.15.50:0/298864064 conn(0x7fdd500b1f90 msgr2=0x7fdd500cb710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fc237b7a700 1 -- 172.21.15.50:0/3415456874 shutdown_connections 2023-11-28T11:54:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fc237b7a700 1 -- 172.21.15.50:0/3415456874 wait complete. 2023-11-28T11:54:06.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2023-11-28T11:54:06.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fdd54cd3700 1 -- 172.21.15.50:0/298864064 shutdown_connections 2023-11-28T11:54:06.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:06.189+0000 7fdd54cd3700 1 -- 172.21.15.50:0/298864064 wait complete. 2023-11-28T11:54:06.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2023-11-28T11:54:06.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-11-28T11:54:06.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2023-11-28T11:54:06.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2023-11-28T11:54:06.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2023-11-28T11:54:07.168 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T11:54:07.174 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T11:54:07.196 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T11:54:07.197 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T11:54:07.197 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T11:54:07.204 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T11:54:07.204 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T11:54:07.205 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T11:54:07.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3f59e700 1 Processor -- start 2023-11-28T11:54:07.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3f59e700 1 -- start start 2023-11-28T11:54:07.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3f59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b400cb340 0x7f9b4006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b4006f7c0 0x7f9b4006a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3f59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4006c6c0 con 0x7f9b40071ca0 2023-11-28T11:54:07.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3f59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4006dbf0 con 0x7f9b400cb340 2023-11-28T11:54:07.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b40072240 con 0x7f9b4006f7c0 2023-11-28T11:54:07.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b400cb340 0x7f9b4006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b400cb340 0x7f9b4006d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53410/0 (socket says 172.21.15.50:53410) 2023-11-28T11:54:07.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3e59c700 1 -- 172.21.15.50:0/2605043501 learned_addr learned my addr 172.21.15.50:0/2605043501 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:07.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3e59c700 1 -- 172.21.15.50:0/2605043501 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b4006f7c0 msgr2=0x7f9b4006a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:07.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3e59c700 1 --2- 172.21.15.50:0/2605043501 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b4006f7c0 0x7f9b4006a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3e59c700 1 -- 172.21.15.50:0/2605043501 >> v1:172.21.15.192:6789/0 conn(0x7f9b40071ca0 legacy=0x7f9b400cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3e59c700 1 -- 172.21.15.50:0/2605043501 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4006c8f0 con 0x7f9b400cb340 2023-11-28T11:54:07.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3e59c700 1 --2- 172.21.15.50:0/2605043501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b400cb340 0x7f9b4006d6b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009e50 tx=0x7f9b3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f23dca7ba6ecab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7fec68cd8700 1 Processor -- start 2023-11-28T11:54:07.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3d59a700 1 -- 172.21.15.50:0/2605043501 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3800e070 con 0x7f9b400cb340 2023-11-28T11:54:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3d59a700 1 -- 172.21.15.50:0/2605043501 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3800b9c0 con 0x7f9b400cb340 2023-11-28T11:54:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7f9b3d59a700 1 -- 172.21.15.50:0/2605043501 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3800bd70 con 0x7f9b400cb340 2023-11-28T11:54:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7f9b3f59e700 1 -- 172.21.15.50:0/2605043501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b400cb340 msgr2=0x7f9b4006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7f9b3f59e700 1 --2- 172.21.15.50:0/2605043501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b400cb340 0x7f9b4006d6b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009e50 tx=0x7f9b3800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.312+0000 7fec68cd8700 1 -- start start 2023-11-28T11:54:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7fec68cd8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fec5c054800 0x7fec5c036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7fec68cd8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c0060c0 con 0x7fec5c036cb0 2023-11-28T11:54:07.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7fec68cd8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c0ded00 con 0x7fec5c03a810 2023-11-28T11:54:07.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7fec68cd8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c0070b0 con 0x7fec5c054800 2023-11-28T11:54:07.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7f9b3f59e700 1 -- 172.21.15.50:0/2605043501 shutdown_connections 2023-11-28T11:54:07.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7f9b3f59e700 1 --2- 172.21.15.50:0/2605043501 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b4006f7c0 0x7f9b4006a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7f9b3f59e700 1 --2- 172.21.15.50:0/2605043501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b400cb340 0x7f9b4006d6b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7f9b3f59e700 1 -- 172.21.15.50:0/2605043501 >> 172.21.15.50:0/2605043501 conn(0x7f9b400b1f90 msgr2=0x7f9b400ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:07.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7f9b3f59e700 1 -- 172.21.15.50:0/2605043501 shutdown_connections 2023-11-28T11:54:07.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7f9b3f59e700 1 -- 172.21.15.50:0/2605043501 wait complete. 2023-11-28T11:54:07.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7fec6259c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fec5c054800 0x7fec5c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7fec6259c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fec5c054800 0x7fec5c036770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:55898/0 (socket says 172.21.15.50:55898) 2023-11-28T11:54:07.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7fec6259c700 1 -- 172.21.15.50:0/2420189126 learned_addr learned my addr 172.21.15.50:0/2420189126 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:07.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7fec6259c700 1 -- 172.21.15.50:0/2420189126 >> v1:172.21.15.192:6789/0 conn(0x7fec5c03a810 legacy=0x7fec5c0528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7fec6259c700 1 -- 172.21.15.50:0/2420189126 >> v1:172.21.15.50:6789/0 conn(0x7fec5c036cb0 legacy=0x7fec5c03a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:07.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7fec6259c700 1 -- 172.21.15.50:0/2420189126 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c0062f0 con 0x7fec5c054800 2023-11-28T11:54:07.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7fec6259c700 1 --2- 172.21.15.50:0/2420189126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c054800 0x7fec5c036770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fec54009390 tx=0x7fec54009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd68b79e163ea2eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7fec6159a700 1 -- 172.21.15.50:0/2420189126 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400cb70 con 0x7fec5c054800 2023-11-28T11:54:07.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7fec6159a700 1 -- 172.21.15.50:0/2420189126 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5400ccd0 con 0x7fec5c054800 2023-11-28T11:54:07.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7fec6159a700 1 -- 172.21.15.50:0/2420189126 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec54018600 con 0x7fec5c054800 2023-11-28T11:54:07.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7fec68cd8700 1 -- 172.21.15.50:0/2420189126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c054800 msgr2=0x7fec5c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7fec68cd8700 1 --2- 172.21.15.50:0/2420189126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c054800 0x7fec5c036770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fec54009390 tx=0x7fec54009f90 comp rx=0 tx=0).stop 2023-11-28T11:54:07.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7f9b3f59e700 1 Processor -- start 2023-11-28T11:54:07.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.316+0000 7f9b3f59e700 1 -- start start 2023-11-28T11:54:07.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7fec68cd8700 1 -- 172.21.15.50:0/2420189126 shutdown_connections 2023-11-28T11:54:07.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7fec68cd8700 1 --2- 172.21.15.50:0/2420189126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c054800 0x7fec5c036770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7fec68cd8700 1 -- 172.21.15.50:0/2420189126 >> 172.21.15.50:0/2420189126 conn(0x7fec5c051770 msgr2=0x7fec5c051b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:07.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b4006f7c0 0x7f9b400984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b40071ca0 0x7f9b402028a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b400cb340 0x7f9b40202de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b40071ca0 0x7f9b402028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3dd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b40071ca0 0x7f9b402028a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53426/0 (socket says 172.21.15.50:53426) 2023-11-28T11:54:07.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3e59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b4006f7c0 0x7f9b400984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3e59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b4006f7c0 0x7f9b400984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:55906/0 (socket says 172.21.15.50:55906) 2023-11-28T11:54:07.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3e59c700 1 -- 172.21.15.50:0/1847565622 learned_addr learned my addr 172.21.15.50:0/1847565622 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:07.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3f59e700 1 -- 172.21.15.50:0/1847565622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b400aedd0 con 0x7f9b40071ca0 2023-11-28T11:54:07.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3f59e700 1 -- 172.21.15.50:0/1847565622 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4014f750 con 0x7f9b4006f7c0 2023-11-28T11:54:07.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3f59e700 1 -- 172.21.15.50:0/1847565622 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4014fa30 con 0x7f9b400cb340 2023-11-28T11:54:07.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7fec68cd8700 1 -- 172.21.15.50:0/2420189126 shutdown_connections 2023-11-28T11:54:07.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3ed9d700 1 --2- 172.21.15.50:0/1847565622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b400cb340 0x7f9b40202de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7fec68cd8700 1 -- 172.21.15.50:0/2420189126 wait complete. 2023-11-28T11:54:07.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7fec68cd8700 1 Processor -- start 2023-11-28T11:54:07.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3e59c700 1 -- 172.21.15.50:0/1847565622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b400cb340 msgr2=0x7f9b40202de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3e59c700 1 --2- 172.21.15.50:0/1847565622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b400cb340 0x7f9b40202de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3e59c700 1 -- 172.21.15.50:0/1847565622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b40071ca0 msgr2=0x7f9b402028a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3e59c700 1 --2- 172.21.15.50:0/1847565622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b40071ca0 0x7f9b402028a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3e59c700 1 -- 172.21.15.50:0/1847565622 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b38009b30 con 0x7f9b4006f7c0 2023-11-28T11:54:07.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7f9b3e59c700 1 --2- 172.21.15.50:0/1847565622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b4006f7c0 0x7f9b400984d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9b38000f80 tx=0x7f9b38004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.320+0000 7fec68cd8700 1 -- start start 2023-11-28T11:54:07.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec68cd8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c036cb0 0x7fec5c184a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec68cd8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5c03a810 0x7fec5c0da200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec68cd8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec5c054800 0x7fec5c0da740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec68cd8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c04dcd0 con 0x7fec5c03a810 2023-11-28T11:54:07.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec68cd8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c04d0c0 con 0x7fec5c036cb0 2023-11-28T11:54:07.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec68cd8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c04d3a0 con 0x7fec5c054800 2023-11-28T11:54:07.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec61d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5c03a810 0x7fec5c0da200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec61d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5c03a810 0x7fec5c0da200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53440/0 (socket says 172.21.15.50:53440) 2023-11-28T11:54:07.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec61d9b700 1 -- 172.21.15.50:0/1465622742 learned_addr learned my addr 172.21.15.50:0/1465622742 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:07.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec6259c700 1 --2- 172.21.15.50:0/1465622742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c036cb0 0x7fec5c184a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec62d9d700 1 --2- 172.21.15.50:0/1465622742 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec5c054800 0x7fec5c0da740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec61d9b700 1 -- 172.21.15.50:0/1465622742 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec5c054800 msgr2=0x7fec5c0da740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec61d9b700 1 --2- 172.21.15.50:0/1465622742 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec5c054800 0x7fec5c0da740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec61d9b700 1 -- 172.21.15.50:0/1465622742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c036cb0 msgr2=0x7fec5c184a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec61d9b700 1 --2- 172.21.15.50:0/1465622742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c036cb0 0x7fec5c184a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec61d9b700 1 -- 172.21.15.50:0/1465622742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec54009e00 con 0x7fec5c03a810 2023-11-28T11:54:07.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec61d9b700 1 --2- 172.21.15.50:0/1465622742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5c03a810 0x7fec5c0da200 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fec5800c6b0 tx=0x7fec5800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7f9b2effd700 1 -- 172.21.15.50:0/1847565622 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b38004250 con 0x7f9b4006f7c0 2023-11-28T11:54:07.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7f9b3f59e700 1 -- 172.21.15.50:0/1847565622 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4006ceb0 con 0x7f9b4006f7c0 2023-11-28T11:54:07.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7f9b3f59e700 1 -- 172.21.15.50:0/1847565622 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4006cbd0 con 0x7f9b4006f7c0 2023-11-28T11:54:07.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7f9b2effd700 1 -- 172.21.15.50:0/1847565622 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b380043d0 con 0x7f9b4006f7c0 2023-11-28T11:54:07.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7f9b2effd700 1 -- 172.21.15.50:0/1847565622 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b38004780 con 0x7f9b4006f7c0 2023-11-28T11:54:07.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7f9b3f59e700 1 -- 172.21.15.50:0/1847565622 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b24005310 con 0x7f9b4006f7c0 2023-11-28T11:54:07.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.324+0000 7fec52ffd700 1 -- 172.21.15.50:0/1465622742 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec580052d0 con 0x7fec5c03a810 2023-11-28T11:54:07.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.328+0000 7fec68cd8700 1 -- 172.21.15.50:0/1465622742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c0068b0 con 0x7fec5c03a810 2023-11-28T11:54:07.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.328+0000 7fec68cd8700 1 -- 172.21.15.50:0/1465622742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c0065d0 con 0x7fec5c03a810 2023-11-28T11:54:07.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.328+0000 7f9b2effd700 1 -- 172.21.15.50:0/1847565622 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9b3802c070 con 0x7f9b4006f7c0 2023-11-28T11:54:07.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.328+0000 7f9b2effd700 1 --2- 172.21.15.50:0/1847565622 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9b20064fe0 0x7f9b20067490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.328+0000 7f9b2effd700 1 -- 172.21.15.50:0/1847565622 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9b38083a90 con 0x7f9b4006f7c0 2023-11-28T11:54:07.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.328+0000 7fec52ffd700 1 -- 172.21.15.50:0/1465622742 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec58005450 con 0x7fec5c03a810 2023-11-28T11:54:07.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.328+0000 7fec52ffd700 1 -- 172.21.15.50:0/1465622742 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec580038e0 con 0x7fec5c03a810 2023-11-28T11:54:07.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.328+0000 7f9b3dd9b700 1 --2- 172.21.15.50:0/1847565622 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9b20064fe0 0x7f9b20067490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.332+0000 7f9b3dd9b700 1 --2- 172.21.15.50:0/1847565622 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9b20064fe0 0x7f9b20067490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9b400bdbe0 tx=0x7f9b30009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.332+0000 7fec52ffd700 1 -- 172.21.15.50:0/1465622742 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fec58019030 con 0x7fec5c03a810 2023-11-28T11:54:07.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.332+0000 7fec52ffd700 1 --2- 172.21.15.50:0/1465622742 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fec44064f30 0x7fec440673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.332+0000 7fec52ffd700 1 -- 172.21.15.50:0/1465622742 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fec58081450 con 0x7fec5c03a810 2023-11-28T11:54:07.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.332+0000 7fec68cd8700 1 -- 172.21.15.50:0/1465622742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec48005310 con 0x7fec5c03a810 2023-11-28T11:54:07.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.332+0000 7fec6259c700 1 --2- 172.21.15.50:0/1465622742 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fec44064f30 0x7fec440673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.332+0000 7fec6259c700 1 --2- 172.21.15.50:0/1465622742 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fec44064f30 0x7fec440673e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fec54009fd0 tx=0x7fec54008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.336+0000 7f9b2effd700 1 -- 172.21.15.50:0/1847565622 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9b380518d0 con 0x7f9b4006f7c0 2023-11-28T11:54:07.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.340+0000 7fec52ffd700 1 -- 172.21.15.50:0/1465622742 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fec5804f340 con 0x7fec5c03a810 2023-11-28T11:54:07.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae40bfd700 1 Processor -- start 2023-11-28T11:54:07.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae40bfd700 1 -- start start 2023-11-28T11:54:07.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae40bfd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fae3c0c1b40 0x7fae3c0b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae40bfd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c0cbcf0 con 0x7fae3c0b3c20 2023-11-28T11:54:07.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae40bfd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c069d50 con 0x7fae3c0ca700 2023-11-28T11:54:07.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae40bfd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3c06a9d0 con 0x7fae3c0c1b40 2023-11-28T11:54:07.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3ad9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fae3c0b3c20 0x7fae3c15fab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56460/0 (socket says 172.21.15.50:56460) 2023-11-28T11:54:07.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3ad9d700 1 -- 172.21.15.50:0/2286339541 learned_addr learned my addr 172.21.15.50:0/2286339541 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:07.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae39d9b700 1 --2- 172.21.15.50:0/2286339541 >> v2:172.21.15.50:3300/0 conn(0x7fae3c0c1b40 0x7fae3c0b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3959a700 1 -- 172.21.15.50:0/2286339541 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471399885 0 0) 0x7fae3c0cbcf0 con 0x7fae3c0b3c20 2023-11-28T11:54:07.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3959a700 1 -- 172.21.15.50:0/2286339541 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae240035d0 con 0x7fae3c0b3c20 2023-11-28T11:54:07.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3959a700 1 -- 172.21.15.50:0/2286339541 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2399666859 0 0) 0x7fae240035d0 con 0x7fae3c0b3c20 2023-11-28T11:54:07.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3959a700 1 -- 172.21.15.50:0/2286339541 >> v2:172.21.15.50:3300/0 conn(0x7fae3c0c1b40 msgr2=0x7fae3c0b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:07.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3959a700 1 --2- 172.21.15.50:0/2286339541 >> v2:172.21.15.50:3300/0 conn(0x7fae3c0c1b40 0x7fae3c0b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3959a700 1 -- 172.21.15.50:0/2286339541 >> v1:172.21.15.192:6789/0 conn(0x7fae3c0ca700 legacy=0x7fae3c0c1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3959a700 1 -- 172.21.15.50:0/2286339541 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c06a030 con 0x7fae3c0b3c20 2023-11-28T11:54:07.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fdcdeddc700 1 Processor -- start 2023-11-28T11:54:07.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3959a700 1 -- 172.21.15.50:0/2286339541 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7fae340019f0 con 0x7fae3c0b3c20 2023-11-28T11:54:07.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3959a700 1 -- 172.21.15.50:0/2286339541 >> v1:172.21.15.50:6789/0 conn(0x7fae3c0b3c20 legacy=0x7fae3c15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3959a700 1 --2- 172.21.15.50:0/2286339541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae24003a20 0x7fae24003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3959a700 1 --2- 172.21.15.50:0/2286339541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae24004870 0x7fae24004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3959a700 1 --2- 172.21.15.50:0/2286339541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae24005220 0x7fae2400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3959a700 1 -- 172.21.15.50:0/2286339541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c06a9d0 con 0x7fae24005220 2023-11-28T11:54:07.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3959a700 1 -- 172.21.15.50:0/2286339541 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2400c100 con 0x7fae24003a20 2023-11-28T11:54:07.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3959a700 1 -- 172.21.15.50:0/2286339541 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2400c2c0 con 0x7fae24004870 2023-11-28T11:54:07.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.364+0000 7fae3ad9d700 1 --2- 172.21.15.50:0/2286339541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae24005220 0x7fae2400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae3a59c700 1 --2- 172.21.15.50:0/2286339541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae24003a20 0x7fae24003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae39d9b700 1 --2- 172.21.15.50:0/2286339541 >> v2:172.21.15.50:3300/0 conn(0x7fae3c0c1b40 0x7fae3c0b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:07.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae3ad9d700 1 -- 172.21.15.50:0/2286339541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae24004870 msgr2=0x7fae24004ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:54:07.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae3ad9d700 1 --2- 172.21.15.50:0/2286339541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae24004870 0x7fae24004ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae3ad9d700 1 -- 172.21.15.50:0/2286339541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae24003a20 msgr2=0x7fae24003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:07.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae3ad9d700 1 --2- 172.21.15.50:0/2286339541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae24003a20 0x7fae24003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae3ad9d700 1 -- 172.21.15.50:0/2286339541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae240035d0 con 0x7fae24005220 2023-11-28T11:54:07.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae3a59c700 1 --2- 172.21.15.50:0/2286339541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae24003a20 0x7fae24003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:07.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae3ad9d700 1 -- 172.21.15.50:0/2286339541 reap_dead start 2023-11-28T11:54:07.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae3ad9d700 1 --2- 172.21.15.50:0/2286339541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae24005220 0x7fae2400ba30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fae3400a7b0 tx=0x7fae240058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46896dd0b6ecbeb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae3959a700 1 -- 172.21.15.50:0/2286339541 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae340072d0 con 0x7fae24005220 2023-11-28T11:54:07.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae3959a700 1 -- 172.21.15.50:0/2286339541 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae34007430 con 0x7fae24005220 2023-11-28T11:54:07.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fdcdeddc700 1 -- start start 2023-11-28T11:54:07.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fdcdeddc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdcd806a800 0x7fdcd80cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fdcdeddc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd806c6c0 con 0x7fdcd806f7c0 2023-11-28T11:54:07.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fdcdeddc700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd8072240 con 0x7fdcd80cb340 2023-11-28T11:54:07.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fdcdeddc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd806c8f0 con 0x7fdcd806a800 2023-11-28T11:54:07.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fdcde5db700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdcd806a800 0x7fdcd80cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fdcdddda700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fdcd80cb340 0x7fdcd806d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:51274/0 (socket says 172.21.15.50:51274) 2023-11-28T11:54:07.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fdcdddda700 1 -- 172.21.15.50:0/3964282949 learned_addr learned my addr 172.21.15.50:0/3964282949 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:07.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fdcde5db700 1 -- 172.21.15.50:0/3964282949 >> v1:172.21.15.192:6789/0 conn(0x7fdcd80cb340 legacy=0x7fdcd806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fdcde5db700 1 -- 172.21.15.50:0/3964282949 >> v1:172.21.15.50:6789/0 conn(0x7fdcd806f7c0 legacy=0x7fdcd806a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:07.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae40bfd700 1 -- 172.21.15.50:0/2286339541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae24005220 msgr2=0x7fae2400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae40bfd700 1 --2- 172.21.15.50:0/2286339541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae24005220 0x7fae2400ba30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fae3400a7b0 tx=0x7fae240058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae40bfd700 1 -- 172.21.15.50:0/2286339541 shutdown_connections 2023-11-28T11:54:07.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae40bfd700 1 --2- 172.21.15.50:0/2286339541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae24005220 0x7fae2400ba30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae40bfd700 1 -- 172.21.15.50:0/2286339541 >> 172.21.15.50:0/2286339541 conn(0x7fae3c0ce460 msgr2=0x7fae3c0ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:07.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fdcde5db700 1 -- 172.21.15.50:0/3964282949 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd806cbd0 con 0x7fdcd806a800 2023-11-28T11:54:07.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7f4dc2dac700 1 Processor -- start 2023-11-28T11:54:07.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae40bfd700 1 -- 172.21.15.50:0/2286339541 shutdown_connections 2023-11-28T11:54:07.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7f4dc2dac700 1 -- start start 2023-11-28T11:54:07.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fdcde5db700 1 --2- 172.21.15.50:0/3964282949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd806a800 0x7fdcd80cbfb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009d90 tx=0x7fdcd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb650a735f90ed4c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fdcdcdd8700 1 -- 172.21.15.50:0/3964282949 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000bad0 con 0x7fdcd806a800 2023-11-28T11:54:07.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fdcdcdd8700 1 -- 172.21.15.50:0/3964282949 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd000bc30 con 0x7fdcd806a800 2023-11-28T11:54:07.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fdcdcdd8700 1 -- 172.21.15.50:0/3964282949 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0003a40 con 0x7fdcd806a800 2023-11-28T11:54:07.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7fae40bfd700 1 -- 172.21.15.50:0/2286339541 wait complete. 2023-11-28T11:54:07.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7f4dc2dac700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4dbc0ca310 0x7f4dbc06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7f67d8a38700 1 Processor -- start 2023-11-28T11:54:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fdcdeddc700 1 -- 172.21.15.50:0/3964282949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd806a800 msgr2=0x7fdcd80cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fdcdeddc700 1 --2- 172.21.15.50:0/3964282949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd806a800 0x7fdcd80cbfb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009d90 tx=0x7fdcd000b330 comp rx=0 tx=0).stop 2023-11-28T11:54:07.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7f4dc2dac700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc0cdeb0 con 0x7f4dbc069eb0 2023-11-28T11:54:07.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7f4dc2dac700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc0cca10 con 0x7f4dbc06cd80 2023-11-28T11:54:07.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7f4dc2dac700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dbc06a670 con 0x7f4dbc0ca310 2023-11-28T11:54:07.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc25ab700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4dbc06cd80 0x7f4dbc15b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:51280/0 (socket says 172.21.15.50:51280) 2023-11-28T11:54:07.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc25ab700 1 -- 172.21.15.50:0/2374936766 learned_addr learned my addr 172.21.15.50:0/2374936766 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:07.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae40bfd700 1 Processor -- start 2023-11-28T11:54:07.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fdcdeddc700 1 -- 172.21.15.50:0/3964282949 shutdown_connections 2023-11-28T11:54:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fdcdeddc700 1 --2- 172.21.15.50:0/3964282949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd806a800 0x7fdcd80cbfb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fdcdeddc700 1 -- 172.21.15.50:0/3964282949 >> 172.21.15.50:0/3964282949 conn(0x7fdcd80b1f90 msgr2=0x7fdcd80ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fdcdeddc700 1 -- 172.21.15.50:0/3964282949 shutdown_connections 2023-11-28T11:54:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fdcdeddc700 1 -- 172.21.15.50:0/3964282949 wait complete. 2023-11-28T11:54:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae40bfd700 1 -- start start 2023-11-28T11:54:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc0da8700 1 -- 172.21.15.50:0/2374936766 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293976937 0 0) 0x7f4dbc0cca10 con 0x7f4dbc06cd80 2023-11-28T11:54:07.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc0da8700 1 -- 172.21.15.50:0/2374936766 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4da80035d0 con 0x7f4dbc06cd80 2023-11-28T11:54:07.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc1daa700 1 --2- 172.21.15.50:0/2374936766 >> v2:172.21.15.192:3300/0 conn(0x7f4dbc0ca310 0x7f4dbc06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc0da8700 1 -- 172.21.15.50:0/2374936766 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798512297 0 0) 0x7f4db8001110 con 0x7f4dbc069eb0 2023-11-28T11:54:07.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc0da8700 1 -- 172.21.15.50:0/2374936766 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dbc0cca10 con 0x7f4dbc069eb0 2023-11-28T11:54:07.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc1daa700 1 -- 172.21.15.50:0/2374936766 >> v1:172.21.15.192:6789/0 conn(0x7f4dbc06cd80 legacy=0x7f4dbc15b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc1daa700 1 -- 172.21.15.50:0/2374936766 >> v1:172.21.15.50:6789/0 conn(0x7f4dbc069eb0 legacy=0x7f4dbc06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc1daa700 1 -- 172.21.15.50:0/2374936766 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc06a950 con 0x7f4dbc0ca310 2023-11-28T11:54:07.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.368+0000 7f67d8a38700 1 -- start start 2023-11-28T11:54:07.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d8a38700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67d40ceb50 0x7f67d40b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d8a38700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f67d406ad60 0x7f67d40b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d8a38700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d40b81f0 con 0x7f67d4160790 2023-11-28T11:54:07.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d8a38700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d40cce70 con 0x7f67d40ceb50 2023-11-28T11:54:07.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d8a38700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d40b6580 con 0x7f67d406ad60 2023-11-28T11:54:07.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d259c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67d40ceb50 0x7f67d40b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d259c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67d40ceb50 0x7f67d40b5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53474/0 (socket says 172.21.15.50:53474) 2023-11-28T11:54:07.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d259c700 1 -- 172.21.15.50:0/4267218428 learned_addr learned my addr 172.21.15.50:0/4267218428 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:07.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc1daa700 1 --2- 172.21.15.50:0/2374936766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc0ca310 0x7f4dbc06c0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009d90 tx=0x7f4db400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a28095de45dea00c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d259c700 1 -- 172.21.15.50:0/4267218428 >> v2:172.21.15.192:3300/0 conn(0x7f67d406ad60 msgr2=0x7f67d40b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:07.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d259c700 1 --2- 172.21.15.50:0/4267218428 >> v2:172.21.15.192:3300/0 conn(0x7f67d406ad60 0x7f67d40b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d259c700 1 -- 172.21.15.50:0/4267218428 >> v1:172.21.15.192:6789/0 conn(0x7f67d4160790 legacy=0x7f67d406a650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T11:54:07.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d259c700 1 -- 172.21.15.50:0/4267218428 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d40b7900 con 0x7f67d40ceb50 2023-11-28T11:54:07.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc0da8700 1 -- 172.21.15.50:0/2374936766 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db400e070 con 0x7f4dbc0ca310 2023-11-28T11:54:07.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d259c700 1 --2- 172.21.15.50:0/4267218428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d40ceb50 0x7f67d40b5e80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f67d408b150 tx=0x7f67c4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429f3b283d4ddc7f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc0da8700 1 -- 172.21.15.50:0/2374936766 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db400bb20 con 0x7f4dbc0ca310 2023-11-28T11:54:07.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc0da8700 1 -- 172.21.15.50:0/2374936766 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db400be90 con 0x7f4dbc0ca310 2023-11-28T11:54:07.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d159a700 1 -- 172.21.15.50:0/4267218428 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c4004230 con 0x7f67d40ceb50 2023-11-28T11:54:07.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d159a700 1 -- 172.21.15.50:0/4267218428 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c4004390 con 0x7f67d40ceb50 2023-11-28T11:54:07.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d159a700 1 -- 172.21.15.50:0/4267218428 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c40036c0 con 0x7f67d40ceb50 2023-11-28T11:54:07.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fdcdeddc700 1 Processor -- start 2023-11-28T11:54:07.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fdcdeddc700 1 -- start start 2023-11-28T11:54:07.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f7ce754f700 1 Processor -- start 2023-11-28T11:54:07.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f7ce754f700 1 -- start start 2023-11-28T11:54:07.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc2dac700 1 -- 172.21.15.50:0/2374936766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc0ca310 msgr2=0x7f4dbc06c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc2dac700 1 --2- 172.21.15.50:0/2374936766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc0ca310 0x7f4dbc06c0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009d90 tx=0x7f4db400b330 comp rx=0 tx=0).stop 2023-11-28T11:54:07.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae40bfd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae24005220 0x7fae3c0ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae40bfd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae3c0cb460 0x7fae3c0cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae40bfd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae3c155db0 0x7fae3c156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae40bfd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0c6310 con 0x7fae3c0cb460 2023-11-28T11:54:07.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae40bfd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c156760 con 0x7fae3c155db0 2023-11-28T11:54:07.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae40bfd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0c56d0 con 0x7fae24005220 2023-11-28T11:54:07.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae3a59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae24005220 0x7fae3c0ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae3a59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae24005220 0x7fae3c0ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:54520/0 (socket says 172.21.15.50:54520) 2023-11-28T11:54:07.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae3a59c700 1 -- 172.21.15.50:0/2127979030 learned_addr learned my addr 172.21.15.50:0/2127979030 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:07.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae39d9b700 1 --2- 172.21.15.50:0/2127979030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae3c0cb460 0x7fae3c0cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc2dac700 1 -- 172.21.15.50:0/2374936766 shutdown_connections 2023-11-28T11:54:07.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc2dac700 1 --2- 172.21.15.50:0/2374936766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc0ca310 0x7f4dbc06c0a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc2dac700 1 -- 172.21.15.50:0/2374936766 >> 172.21.15.50:0/2374936766 conn(0x7f4dbc0ce3e0 msgr2=0x7f4dbc0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:07.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d8a38700 1 -- 172.21.15.50:0/4267218428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d40ceb50 msgr2=0x7f67d40b5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f67d8a38700 1 --2- 172.21.15.50:0/4267218428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d40ceb50 0x7f67d40b5e80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f67d408b150 tx=0x7f67c4009bf0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae39d9b700 1 -- 172.21.15.50:0/2127979030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae24005220 msgr2=0x7fae3c0ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae39d9b700 1 --2- 172.21.15.50:0/2127979030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae24005220 0x7fae3c0ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae39d9b700 1 -- 172.21.15.50:0/2127979030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae3c155db0 msgr2=0x7fae3c156220 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T11:54:07.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae39d9b700 1 --2- 172.21.15.50:0/2127979030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae3c155db0 0x7fae3c156220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae39d9b700 1 -- 172.21.15.50:0/2127979030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c06a5f0 con 0x7fae3c0cb460 2023-11-28T11:54:07.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc2dac700 1 -- 172.21.15.50:0/2374936766 shutdown_connections 2023-11-28T11:54:07.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7f4dc2dac700 1 -- 172.21.15.50:0/2374936766 wait complete. 2023-11-28T11:54:07.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fdcdeddc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd806a800 0x7fdcd81dc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fdcdeddc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcd806f7c0 0x7fdcd81e4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fae39d9b700 1 --2- 172.21.15.50:0/2127979030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae3c0cb460 0x7fae3c0cb890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0add10 tx=0x7fae3000e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fdcdeddc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcd80cb340 0x7fdcd80cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fdcdeddc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd81e6410 con 0x7fdcd806a800 2023-11-28T11:54:07.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fdcdeddc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd81dc5e0 con 0x7fdcd80cb340 2023-11-28T11:54:07.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.372+0000 7fdcdeddc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd81e5800 con 0x7fdcd806f7c0 2023-11-28T11:54:07.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d8a38700 1 -- 172.21.15.50:0/4267218428 shutdown_connections 2023-11-28T11:54:07.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d8a38700 1 --2- 172.21.15.50:0/4267218428 >> v2:172.21.15.192:3300/0 conn(0x7f67d406ad60 0x7f67d40b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d8a38700 1 --2- 172.21.15.50:0/4267218428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d40ceb50 0x7f67d40b5e80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d8a38700 1 -- 172.21.15.50:0/4267218428 >> 172.21.15.50:0/4267218428 conn(0x7f67d4089f70 msgr2=0x7f67d40b5770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:07.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fdcdddda700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd806a800 0x7fdcd81dc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fdcdddda700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd806a800 0x7fdcd81dc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53494/0 (socket says 172.21.15.50:53494) 2023-11-28T11:54:07.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fdcdddda700 1 -- 172.21.15.50:0/2573668359 learned_addr learned my addr 172.21.15.50:0/2573668359 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:07.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fdcdd5d9700 1 --2- 172.21.15.50:0/2573668359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcd806f7c0 0x7fdcd81e4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f7ce754f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7ce00cfdd0 0x7f7ce00b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f7ce754f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ce00b2570 0x7f7ce00cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fdcde5db700 1 --2- 172.21.15.50:0/2573668359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcd80cb340 0x7fdcd80cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f7ce754f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce00cac70 con 0x7f7ce00cc590 2023-11-28T11:54:07.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f7ce754f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce006c8e0 con 0x7f7ce00cfdd0 2023-11-28T11:54:07.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f7ce754f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce00b29f0 con 0x7f7ce00b2570 2023-11-28T11:54:07.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d8a38700 1 -- 172.21.15.50:0/4267218428 shutdown_connections 2023-11-28T11:54:07.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d8a38700 1 -- 172.21.15.50:0/4267218428 wait complete. 2023-11-28T11:54:07.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fae2affd700 1 -- 172.21.15.50:0/2127979030 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3000c070 con 0x7fae3c0cb460 2023-11-28T11:54:07.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f7ce5aec700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ce00b2570 0x7f7ce00cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f7ce5aec700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ce00b2570 0x7f7ce00cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:54538/0 (socket says 172.21.15.50:54538) 2023-11-28T11:54:07.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f7ce5aec700 1 -- 172.21.15.50:0/847386469 learned_addr learned my addr 172.21.15.50:0/847386469 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:07.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fae40bfd700 1 -- 172.21.15.50:0/2127979030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3c06a310 con 0x7fae3c0cb460 2023-11-28T11:54:07.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fdcdddda700 1 -- 172.21.15.50:0/2573668359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcd806f7c0 msgr2=0x7fdcd81e4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fdcdddda700 1 --2- 172.21.15.50:0/2573668359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcd806f7c0 0x7fdcd81e4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fdcdddda700 1 -- 172.21.15.50:0/2573668359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcd80cb340 msgr2=0x7fdcd80cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fdcdddda700 1 --2- 172.21.15.50:0/2573668359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcd80cb340 0x7fdcd80cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fdcdddda700 1 -- 172.21.15.50:0/2573668359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd0009a70 con 0x7fdcd806a800 2023-11-28T11:54:07.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fae40bfd700 1 -- 172.21.15.50:0/2127979030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c0b40c0 con 0x7fae3c0cb460 2023-11-28T11:54:07.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f7ce52eb700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7ce00cc590 0x7f7ce00b0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:51290/0 (socket says 172.21.15.50:51290) 2023-11-28T11:54:07.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fae2affd700 1 -- 172.21.15.50:0/2127979030 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae30013630 con 0x7fae3c0cb460 2023-11-28T11:54:07.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fae2affd700 1 -- 172.21.15.50:0/2127979030 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae300139e0 con 0x7fae3c0cb460 2023-11-28T11:54:07.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc2dac700 1 Processor -- start 2023-11-28T11:54:07.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc2dac700 1 -- start start 2023-11-28T11:54:07.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f7ce5aec700 1 -- 172.21.15.50:0/847386469 >> v2:172.21.15.50:3300/0 conn(0x7f7ce00cfdd0 msgr2=0x7f7ce00b2030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:54:07.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d8a38700 1 Processor -- start 2023-11-28T11:54:07.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fdcdddda700 1 --2- 172.21.15.50:0/2573668359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd806a800 0x7fdcd81dc0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400c780 tx=0x7fdcd400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fae40bfd700 1 -- 172.21.15.50:0/2127979030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae20005310 con 0x7fae3c0cb460 2023-11-28T11:54:07.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d8a38700 1 -- start start 2023-11-28T11:54:07.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d8a38700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67d406ad60 0x7f67d415f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d8a38700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d40ceb50 0x7f67d40d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d8a38700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67d4160790 0x7f67d40b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d8a38700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d40b1640 con 0x7f67d40ceb50 2023-11-28T11:54:07.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d8a38700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d415e2f0 con 0x7f67d4160790 2023-11-28T11:54:07.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d8a38700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d415e590 con 0x7f67d406ad60 2023-11-28T11:54:07.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fdcce7fc700 1 -- 172.21.15.50:0/2573668359 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4004ca0 con 0x7fdcd806a800 2023-11-28T11:54:07.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fdcce7fc700 1 -- 172.21.15.50:0/2573668359 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd4004e00 con 0x7fdcd806a800 2023-11-28T11:54:07.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fdcce7fc700 1 -- 172.21.15.50:0/2573668359 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4007310 con 0x7fdcd806a800 2023-11-28T11:54:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fdcdeddc700 1 -- 172.21.15.50:0/2573668359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd806d190 con 0x7fdcd806a800 2023-11-28T11:54:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fdcdeddc700 1 -- 172.21.15.50:0/2573668359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd806ceb0 con 0x7fdcd806a800 2023-11-28T11:54:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7fae2affd700 1 -- 172.21.15.50:0/2127979030 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fae30013b40 con 0x7fae3c0cb460 2023-11-28T11:54:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7fae2affd700 1 --2- 172.21.15.50:0/2127979030 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fae1c064fb0 0x7fae1c067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7fae2affd700 1 -- 172.21.15.50:0/2127979030 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fae30081c10 con 0x7fae3c0cb460 2023-11-28T11:54:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7fae3a59c700 1 --2- 172.21.15.50:0/2127979030 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fae1c064fb0 0x7fae1c067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f6452998700 1 Processor -- start 2023-11-28T11:54:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc2dac700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dbc069eb0 0x7f4dbc157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc2dac700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc06cd80 0x7f4dbc1f5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc2dac700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dbc0ca310 0x7f4dbc154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc2dac700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc1f5ac0 con 0x7f4dbc0ca310 2023-11-28T11:54:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc2dac700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc157d20 con 0x7f4dbc06cd80 2023-11-28T11:54:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc2dac700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc0ade40 con 0x7f4dbc069eb0 2023-11-28T11:54:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc25ab700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dbc0ca310 0x7f4dbc154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc25ab700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dbc0ca310 0x7f4dbc154e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53516/0 (socket says 172.21.15.50:53516) 2023-11-28T11:54:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc25ab700 1 -- 172.21.15.50:0/3768940303 learned_addr learned my addr 172.21.15.50:0/3768940303 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc1daa700 1 --2- 172.21.15.50:0/3768940303 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dbc069eb0 0x7f4dbc157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc15a9700 1 --2- 172.21.15.50:0/3768940303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc06cd80 0x7f4dbc1f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc1daa700 1 -- 172.21.15.50:0/3768940303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc06cd80 msgr2=0x7f4dbc1f5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc1daa700 1 --2- 172.21.15.50:0/3768940303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc06cd80 0x7f4dbc1f5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc1daa700 1 -- 172.21.15.50:0/3768940303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dbc0ca310 msgr2=0x7f4dbc154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc1daa700 1 --2- 172.21.15.50:0/3768940303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dbc0ca310 0x7f4dbc154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f4dc1daa700 1 -- 172.21.15.50:0/3768940303 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4009a70 con 0x7f4dbc069eb0 2023-11-28T11:54:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f4dc1daa700 1 --2- 172.21.15.50:0/3768940303 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dbc069eb0 0x7f4dbc157690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4db4016000 tx=0x7f4db4004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d259c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67d406ad60 0x7f67d415f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d2d9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67d4160790 0x7f67d40b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d2d9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67d4160790 0x7f67d40b0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:55992/0 (socket says 172.21.15.50:55992) 2023-11-28T11:54:07.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f67d2d9d700 1 -- 172.21.15.50:0/1929959096 learned_addr learned my addr 172.21.15.50:0/1929959096 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:07.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f67d1d9b700 1 --2- 172.21.15.50:0/1929959096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d40ceb50 0x7f67d40d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f7ce4aea700 1 --2- 172.21.15.50:0/847386469 >> v2:172.21.15.50:3300/0 conn(0x7f7ce00cfdd0 0x7f7ce00b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f7cd7fff700 1 -- 172.21.15.50:0/847386469 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195687506 0 0) 0x7f7ce00cac70 con 0x7f7ce00cc590 2023-11-28T11:54:07.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f7ce5aec700 1 --2- 172.21.15.50:0/847386469 >> v2:172.21.15.50:3300/0 conn(0x7f7ce00cfdd0 0x7f7ce00b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f7ce5aec700 1 -- 172.21.15.50:0/847386469 >> v1:172.21.15.192:6789/0 conn(0x7f7ce00cc590 legacy=0x7f7ce00b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f7ce5aec700 1 -- 172.21.15.50:0/847386469 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce00d0340 con 0x7f7ce00b2570 2023-11-28T11:54:07.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.376+0000 7f7ce5aec700 1 --2- 172.21.15.50:0/847386469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ce00b2570 0x7f7ce00cea40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc009940 tx=0x7f7cdc009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44d092589f2ee444 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f7ce4aea700 1 --2- 172.21.15.50:0/847386469 >> v2:172.21.15.50:3300/0 conn(0x7f7ce00cfdd0 0x7f7ce00b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:54:07.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f6452998700 1 -- start start 2023-11-28T11:54:07.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f7cd7fff700 1 -- 172.21.15.50:0/847386469 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc00ba20 con 0x7f7ce00b2570 2023-11-28T11:54:07.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f7cd7fff700 1 -- 172.21.15.50:0/847386469 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cdc009e90 con 0x7f7ce00b2570 2023-11-28T11:54:07.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f7cd7fff700 1 -- 172.21.15.50:0/847386469 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc00bda0 con 0x7f7ce00b2570 2023-11-28T11:54:07.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f67d2d9d700 1 -- 172.21.15.50:0/1929959096 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67d406ad60 msgr2=0x7f67d415f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f67d2d9d700 1 --2- 172.21.15.50:0/1929959096 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67d406ad60 0x7f67d415f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f67d2d9d700 1 -- 172.21.15.50:0/1929959096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d40ceb50 msgr2=0x7f67d40d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f67d2d9d700 1 --2- 172.21.15.50:0/1929959096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d40ceb50 0x7f67d40d0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f67d2d9d700 1 -- 172.21.15.50:0/1929959096 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c4009570 con 0x7f67d4160790 2023-11-28T11:54:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f4db27fc700 1 -- 172.21.15.50:0/3768940303 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4025600 con 0x7f4dbc069eb0 2023-11-28T11:54:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f4dc2dac700 1 -- 172.21.15.50:0/3768940303 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc0c8a30 con 0x7f4dbc069eb0 2023-11-28T11:54:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f4dc2dac700 1 -- 172.21.15.50:0/3768940303 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc06ac30 con 0x7f4dbc069eb0 2023-11-28T11:54:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7fae3a59c700 1 --2- 172.21.15.50:0/2127979030 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fae1c064fb0 0x7fae1c067460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0014c0 tx=0x7fae2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f7ce754f700 1 -- 172.21.15.50:0/847386469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ce00b2570 msgr2=0x7f7ce00cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f7ce754f700 1 --2- 172.21.15.50:0/847386469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ce00b2570 0x7f7ce00cea40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc009940 tx=0x7f7cdc009c50 comp rx=0 tx=0).stop 2023-11-28T11:54:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f7ce754f700 1 -- 172.21.15.50:0/847386469 shutdown_connections 2023-11-28T11:54:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f7ce754f700 1 --2- 172.21.15.50:0/847386469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ce00b2570 0x7f7ce00cea40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f7ce754f700 1 --2- 172.21.15.50:0/847386469 >> v2:172.21.15.50:3300/0 conn(0x7f7ce00cfdd0 0x7f7ce00b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f7ce754f700 1 -- 172.21.15.50:0/847386469 >> 172.21.15.50:0/847386469 conn(0x7f7ce00cd0a0 msgr2=0x7f7ce00cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f67d2d9d700 1 --2- 172.21.15.50:0/1929959096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67d4160790 0x7f67d40b0dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00ba10 tx=0x7f67cc00bd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f4db27fc700 1 -- 172.21.15.50:0/3768940303 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db401f070 con 0x7f4dbc069eb0 2023-11-28T11:54:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f4db27fc700 1 -- 172.21.15.50:0/3768940303 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db40259c0 con 0x7f4dbc069eb0 2023-11-28T11:54:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f6452998700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f644c06a560 0x7f644c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f6452998700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644c06d700 con 0x7f644c0cee60 2023-11-28T11:54:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f6452998700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644c072220 con 0x7f644c0ca5e0 2023-11-28T11:54:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f6452998700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644c071610 con 0x7f644c06a560 2023-11-28T11:54:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f6450f35700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f644c06a560 0x7f644c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f6450f35700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f644c06a560 0x7f644c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53534/0 (socket says 172.21.15.50:53534) 2023-11-28T11:54:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f6450f35700 1 -- 172.21.15.50:0/2753260927 learned_addr learned my addr 172.21.15.50:0/2753260927 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f7ce754f700 1 -- 172.21.15.50:0/847386469 shutdown_connections 2023-11-28T11:54:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f7ce754f700 1 -- 172.21.15.50:0/847386469 wait complete. 2023-11-28T11:54:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f6450f35700 1 -- 172.21.15.50:0/2753260927 >> v1:172.21.15.192:6789/0 conn(0x7f644c0ca5e0 legacy=0x7f644c069e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f6450f35700 1 -- 172.21.15.50:0/2753260927 >> v1:172.21.15.50:6789/0 conn(0x7f644c0cee60 legacy=0x7f644c15ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f6450f35700 1 -- 172.21.15.50:0/2753260927 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c0718f0 con 0x7f644c06a560 2023-11-28T11:54:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f6450f35700 1 --2- 172.21.15.50:0/2753260927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f644c06a560 0x7f644c0cb6f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f643c009910 tx=0x7f643c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b581d73fe8b0bfdf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.380+0000 7f4db27fc700 1 -- 172.21.15.50:0/3768940303 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4db402d3f0 con 0x7f4dbc069eb0 2023-11-28T11:54:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce754f700 1 Processor -- start 2023-11-28T11:54:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce754f700 1 -- start start 2023-11-28T11:54:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7fdcdeddc700 1 -- 172.21.15.50:0/2573668359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd80cb710 con 0x7fdcd806a800 2023-11-28T11:54:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f67c2ffd700 1 -- 172.21.15.50:0/1929959096 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc00d8e0 con 0x7f67d4160790 2023-11-28T11:54:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f67c2ffd700 1 -- 172.21.15.50:0/1929959096 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc00da40 con 0x7f67d4160790 2023-11-28T11:54:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f67c2ffd700 1 -- 172.21.15.50:0/1929959096 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc00ddf0 con 0x7f67d4160790 2023-11-28T11:54:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f67d8a38700 1 -- 172.21.15.50:0/1929959096 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d4160be0 con 0x7f67d4160790 2023-11-28T11:54:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f4db27fc700 1 --2- 172.21.15.50:0/3768940303 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4da0064ee0 0x7f4da0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f67d8a38700 1 -- 172.21.15.50:0/1929959096 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d415c600 con 0x7f67d4160790 2023-11-28T11:54:07.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f4db27fc700 1 -- 172.21.15.50:0/3768940303 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4db4083930 con 0x7f4dbc069eb0 2023-11-28T11:54:07.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f4dc15a9700 1 --2- 172.21.15.50:0/3768940303 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4da0064ee0 0x7f4da0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce754f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce00b2570 0x7f7ce01f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce754f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ce00cfdd0 0x7f7ce0156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce754f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ce00c4150 0x7f7ce015c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce754f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce01f5ce0 con 0x7f7ce00b2570 2023-11-28T11:54:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce754f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce015f3e0 con 0x7f7ce00cfdd0 2023-11-28T11:54:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce754f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce0157380 con 0x7f7ce00c4150 2023-11-28T11:54:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f67d8a38700 1 -- 172.21.15.50:0/1929959096 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b8005310 con 0x7f67d4160790 2023-11-28T11:54:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce52eb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce00b2570 0x7f7ce01f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce5aec700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ce00c4150 0x7f7ce015c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce52eb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce00b2570 0x7f7ce01f57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53544/0 (socket says 172.21.15.50:53544) 2023-11-28T11:54:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce52eb700 1 -- 172.21.15.50:0/760170611 learned_addr learned my addr 172.21.15.50:0/760170611 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f4dc15a9700 1 --2- 172.21.15.50:0/3768940303 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4da0064ee0 0x7f4da0067390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc157620 tx=0x7f4db8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7fae2affd700 1 -- 172.21.15.50:0/2127979030 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fae3004fb00 con 0x7fae3c0cb460 2023-11-28T11:54:07.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f67c2ffd700 1 -- 172.21.15.50:0/1929959096 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f67cc015420 con 0x7f67d4160790 2023-11-28T11:54:07.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f67c2ffd700 1 --2- 172.21.15.50:0/1929959096 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f67b4064f30 0x7f67b40673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce52eb700 1 -- 172.21.15.50:0/760170611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ce00c4150 msgr2=0x7f7ce015c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce52eb700 1 --2- 172.21.15.50:0/760170611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ce00c4150 0x7f7ce015c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7fdcce7fc700 1 -- 172.21.15.50:0/2573668359 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdcd401a030 con 0x7fdcd806a800 2023-11-28T11:54:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce52eb700 1 -- 172.21.15.50:0/760170611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ce00cfdd0 msgr2=0x7f7ce0156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce52eb700 1 --2- 172.21.15.50:0/760170611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ce00cfdd0 0x7f7ce0156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce52eb700 1 -- 172.21.15.50:0/760170611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc009570 con 0x7f7ce00b2570 2023-11-28T11:54:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f7ce52eb700 1 --2- 172.21.15.50:0/760170611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce00b2570 0x7f7ce01f57a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800cea0 tx=0x7f7cd800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.384+0000 7f67c2ffd700 1 -- 172.21.15.50:0/1929959096 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f67cc011070 con 0x7f67d4160790 2023-11-28T11:54:07.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.388+0000 7f4dc2dac700 1 -- 172.21.15.50:0/3768940303 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da4005310 con 0x7f4dbc069eb0 2023-11-28T11:54:07.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.388+0000 7fdcce7fc700 1 --2- 172.21.15.50:0/2573668359 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdcbc064f60 0x7fdcbc067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.388+0000 7fdcce7fc700 1 -- 172.21.15.50:0/2573668359 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdcd4081a60 con 0x7fdcd806a800 2023-11-28T11:54:07.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.388+0000 7fdcdd5d9700 1 --2- 172.21.15.50:0/2573668359 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdcbc064f60 0x7fdcbc067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.388+0000 7f67d259c700 1 --2- 172.21.15.50:0/1929959096 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f67b4064f30 0x7f67b40673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.388+0000 7f67d259c700 1 --2- 172.21.15.50:0/1929959096 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f67b4064f30 0x7f67b40673e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f67d408b150 tx=0x7f67c4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.388+0000 7fdcdd5d9700 1 --2- 172.21.15.50:0/2573668359 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdcbc064f60 0x7fdcbc067410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80c9fb0 tx=0x7fdcc8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.392+0000 7f644affd700 1 -- 172.21.15.50:0/2753260927 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c004230 con 0x7f644c06a560 2023-11-28T11:54:07.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.392+0000 7f7cd5ffb700 1 -- 172.21.15.50:0/760170611 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd800abb0 con 0x7f7ce00b2570 2023-11-28T11:54:07.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.392+0000 7f7ce754f700 1 -- 172.21.15.50:0/760170611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce006d4b0 con 0x7f7ce00b2570 2023-11-28T11:54:07.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.392+0000 7f644affd700 1 -- 172.21.15.50:0/2753260927 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c004390 con 0x7f644c06a560 2023-11-28T11:54:07.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.392+0000 7f7ce754f700 1 -- 172.21.15.50:0/760170611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce006d1d0 con 0x7f7ce00b2570 2023-11-28T11:54:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.392+0000 7f6452998700 1 -- 172.21.15.50:0/2753260927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f644c06a560 msgr2=0x7f644c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.392+0000 7f6452998700 1 --2- 172.21.15.50:0/2753260927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f644c06a560 0x7f644c0cb6f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f643c009910 tx=0x7f643c009c20 comp rx=0 tx=0).stop 2023-11-28T11:54:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.392+0000 7f6452998700 1 -- 172.21.15.50:0/2753260927 shutdown_connections 2023-11-28T11:54:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.392+0000 7f6452998700 1 --2- 172.21.15.50:0/2753260927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f644c06a560 0x7f644c0cb6f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.392+0000 7f6452998700 1 -- 172.21.15.50:0/2753260927 >> 172.21.15.50:0/2753260927 conn(0x7f644c0b2010 msgr2=0x7f644c0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.392+0000 7f6452998700 1 -- 172.21.15.50:0/2753260927 shutdown_connections 2023-11-28T11:54:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.392+0000 7f6452998700 1 -- 172.21.15.50:0/2753260927 wait complete. 2023-11-28T11:54:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7fdcce7fc700 1 -- 172.21.15.50:0/2573668359 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdcd404f9b0 con 0x7fdcd806a800 2023-11-28T11:54:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f6452998700 1 Processor -- start 2023-11-28T11:54:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f67c2ffd700 1 -- 172.21.15.50:0/1929959096 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f67cc0507a0 con 0x7f67d4160790 2023-11-28T11:54:07.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f4db27fc700 1 -- 172.21.15.50:0/3768940303 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4db4051780 con 0x7f4dbc069eb0 2023-11-28T11:54:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f6452998700 1 -- start start 2023-11-28T11:54:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f6452998700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f644c06a560 0x7f644c0ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f6452998700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f644c0ca5e0 0x7f644c0cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f6452998700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f644c0cee60 0x7f644c0acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f6452998700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c1f7350 con 0x7f644c0cee60 2023-11-28T11:54:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f6452998700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c0cd8b0 con 0x7f644c06a560 2023-11-28T11:54:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f6452998700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644c0cdb90 con 0x7f644c0ca5e0 2023-11-28T11:54:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f644bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f644c06a560 0x7f644c0ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f644bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f644c06a560 0x7f644c0ac0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:56000/0 (socket says 172.21.15.50:56000) 2023-11-28T11:54:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f644bfff700 1 -- 172.21.15.50:0/690674163 learned_addr learned my addr 172.21.15.50:0/690674163 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f6450f35700 1 --2- 172.21.15.50:0/690674163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f644c0cee60 0x7f644c0acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f644b7fe700 1 --2- 172.21.15.50:0/690674163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f644c0ca5e0 0x7f644c0cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.400+0000 7f644bfff700 1 -- 172.21.15.50:0/690674163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f644c0ca5e0 msgr2=0x7f644c0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.400+0000 7f644bfff700 1 --2- 172.21.15.50:0/690674163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f644c0ca5e0 0x7f644c0cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.400+0000 7f644bfff700 1 -- 172.21.15.50:0/690674163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f644c0cee60 msgr2=0x7f644c0acaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.400+0000 7f644bfff700 1 --2- 172.21.15.50:0/690674163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f644c0cee60 0x7f644c0acaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.400+0000 7f644bfff700 1 -- 172.21.15.50:0/690674163 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c009570 con 0x7f644c06a560 2023-11-28T11:54:07.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.400+0000 7f644bfff700 1 --2- 172.21.15.50:0/690674163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f644c06a560 0x7f644c0ac0d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f644400cc50 tx=0x7f644400cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.404+0000 7f6448ff9700 1 -- 172.21.15.50:0/690674163 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644400ab80 con 0x7f644c06a560 2023-11-28T11:54:07.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.404+0000 7f6448ff9700 1 -- 172.21.15.50:0/690674163 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644400ace0 con 0x7f644c06a560 2023-11-28T11:54:07.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.404+0000 7f6452998700 1 -- 172.21.15.50:0/690674163 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644c071eb0 con 0x7f644c06a560 2023-11-28T11:54:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f7ce754f700 1 -- 172.21.15.50:0/760170611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce00ce520 con 0x7f7ce00b2570 2023-11-28T11:54:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f7cd5ffb700 1 -- 172.21.15.50:0/760170611 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd800ad10 con 0x7f7ce00b2570 2023-11-28T11:54:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f7cd5ffb700 1 -- 172.21.15.50:0/760170611 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd80072d0 con 0x7f7ce00b2570 2023-11-28T11:54:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f7cd5ffb700 1 -- 172.21.15.50:0/760170611 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7cd801a030 con 0x7f7ce00b2570 2023-11-28T11:54:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f7cd5ffb700 1 --2- 172.21.15.50:0/760170611 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7cc4064f90 0x7f7cc4067440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.396+0000 7f7ce4aea700 1 --2- 172.21.15.50:0/760170611 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7cc4064f90 0x7f7cc4067440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.400+0000 7f7cd5ffb700 1 -- 172.21.15.50:0/760170611 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7cd80824f0 con 0x7f7ce00b2570 2023-11-28T11:54:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.400+0000 7f7ce4aea700 1 --2- 172.21.15.50:0/760170611 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7cc4064f90 0x7f7cc4067440 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00c3e90 tx=0x7f7cd0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.404+0000 7f7cd5ffb700 1 -- 172.21.15.50:0/760170611 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7cd80503c0 con 0x7f7ce00b2570 2023-11-28T11:54:07.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.404+0000 7f6448ff9700 1 -- 172.21.15.50:0/690674163 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6444012660 con 0x7f644c06a560 2023-11-28T11:54:07.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.404+0000 7f6452998700 1 -- 172.21.15.50:0/690674163 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644c071bd0 con 0x7f644c06a560 2023-11-28T11:54:07.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.404+0000 7f6452998700 1 -- 172.21.15.50:0/690674163 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644c0c8ab0 con 0x7f644c06a560 2023-11-28T11:54:07.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.408+0000 7f6448ff9700 1 -- 172.21.15.50:0/690674163 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6444022070 con 0x7f644c06a560 2023-11-28T11:54:07.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.408+0000 7f6448ff9700 1 --2- 172.21.15.50:0/690674163 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6438064fb0 0x7f6438067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.408+0000 7f6448ff9700 1 -- 172.21.15.50:0/690674163 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6444082840 con 0x7f644c06a560 2023-11-28T11:54:07.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.408+0000 7f644b7fe700 1 --2- 172.21.15.50:0/690674163 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6438064fb0 0x7f6438067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.408+0000 7f644b7fe700 1 --2- 172.21.15.50:0/690674163 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6438064fb0 0x7f6438067460 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f644c0ac640 tx=0x7f6440009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.416+0000 7f6448ff9700 1 -- 172.21.15.50:0/690674163 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6444050680 con 0x7f644c06a560 2023-11-28T11:54:07.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.648+0000 7fec68cd8700 1 -- 172.21.15.50:0/1465622742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fec480055c0 con 0x7fec5c03a810 2023-11-28T11:54:07.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.648+0000 7f9b3f59e700 1 -- 172.21.15.50:0/1847565622 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9b24005890 con 0x7f9b4006f7c0 2023-11-28T11:54:07.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.648+0000 7fec52ffd700 1 -- 172.21.15.50:0/1465622742 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec58017020 con 0x7fec5c03a810 2023-11-28T11:54:07.653 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-11-28T11:54:07.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.648+0000 7f9b2effd700 1 -- 172.21.15.50:0/1847565622 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9b3802a020 con 0x7f9b4006f7c0 2023-11-28T11:54:07.655 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-11-28T11:54:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7fec50ff9700 1 -- 172.21.15.50:0/1465622742 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fec44064f30 msgr2=0x7fec440673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7fec50ff9700 1 --2- 172.21.15.50:0/1465622742 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fec44064f30 0x7fec440673e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fec54009fd0 tx=0x7fec54008030 comp rx=0 tx=0).stop 2023-11-28T11:54:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7fec50ff9700 1 -- 172.21.15.50:0/1465622742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5c03a810 msgr2=0x7fec5c0da200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7fec50ff9700 1 --2- 172.21.15.50:0/1465622742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5c03a810 0x7fec5c0da200 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fec5800c6b0 tx=0x7fec5800c9c0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7f9b2cff9700 1 -- 172.21.15.50:0/1847565622 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9b20064fe0 msgr2=0x7f9b20067490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7f9b2cff9700 1 --2- 172.21.15.50:0/1847565622 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9b20064fe0 0x7f9b20067490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9b400bdbe0 tx=0x7f9b30009110 comp rx=0 tx=0).stop 2023-11-28T11:54:07.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7f9b2cff9700 1 -- 172.21.15.50:0/1847565622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b4006f7c0 msgr2=0x7f9b400984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7fec50ff9700 1 -- 172.21.15.50:0/1465622742 shutdown_connections 2023-11-28T11:54:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7fec50ff9700 1 --2- 172.21.15.50:0/1465622742 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec5c054800 0x7fec5c0da740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7fec50ff9700 1 --2- 172.21.15.50:0/1465622742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec5c03a810 0x7fec5c0da200 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7fec50ff9700 1 --2- 172.21.15.50:0/1465622742 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fec44064f30 0x7fec440673e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7fec50ff9700 1 --2- 172.21.15.50:0/1465622742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c036cb0 0x7fec5c184a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7fec50ff9700 1 -- 172.21.15.50:0/1465622742 >> 172.21.15.50:0/1465622742 conn(0x7fec5c051770 msgr2=0x7fec5c0deef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:07.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7f9b2cff9700 1 --2- 172.21.15.50:0/1847565622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b4006f7c0 0x7f9b400984d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9b38000f80 tx=0x7f9b38004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7fec50ff9700 1 -- 172.21.15.50:0/1465622742 shutdown_connections 2023-11-28T11:54:07.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7f9b2cff9700 1 -- 172.21.15.50:0/1847565622 shutdown_connections 2023-11-28T11:54:07.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7fec50ff9700 1 -- 172.21.15.50:0/1465622742 wait complete. 2023-11-28T11:54:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7f9b2cff9700 1 --2- 172.21.15.50:0/1847565622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b400cb340 0x7f9b40202de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7f9b2cff9700 1 --2- 172.21.15.50:0/1847565622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b40071ca0 0x7f9b402028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7f9b2cff9700 1 --2- 172.21.15.50:0/1847565622 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9b20064fe0 0x7f9b20067490 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7f9b2cff9700 1 --2- 172.21.15.50:0/1847565622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b4006f7c0 0x7f9b400984d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7f9b2cff9700 1 -- 172.21.15.50:0/1847565622 >> 172.21.15.50:0/1847565622 conn(0x7f9b400b1f90 msgr2=0x7f9b400cb710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7f9b2cff9700 1 -- 172.21.15.50:0/1847565622 shutdown_connections 2023-11-28T11:54:07.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.656+0000 7f9b2cff9700 1 -- 172.21.15.50:0/1847565622 wait complete. 2023-11-28T11:54:07.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2023-11-28T11:54:07.675 DEBUG:teuthology.parallel:result is None 2023-11-28T11:54:07.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-11-28T11:54:07.681 DEBUG:teuthology.parallel:result is None 2023-11-28T11:54:07.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.688+0000 7fdcdeddc700 1 -- 172.21.15.50:0/2573668359 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdcd806f140 con 0x7fdcd806a800 2023-11-28T11:54:07.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.688+0000 7fdcce7fc700 1 -- 172.21.15.50:0/2573668359 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdcd4052fd0 con 0x7fdcd806a800 2023-11-28T11:54:07.693 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-11-28T11:54:07.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fae40bfd700 1 -- 172.21.15.50:0/2127979030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fae200055c0 con 0x7fae3c0cb460 2023-11-28T11:54:07.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fdcdeddc700 1 -- 172.21.15.50:0/2573668359 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdcbc064f60 msgr2=0x7fdcbc067410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fdcdeddc700 1 --2- 172.21.15.50:0/2573668359 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdcbc064f60 0x7fdcbc067410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80c9fb0 tx=0x7fdcc8008040 comp rx=0 tx=0).stop 2023-11-28T11:54:07.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fdcdeddc700 1 -- 172.21.15.50:0/2573668359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd806a800 msgr2=0x7fdcd81dc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fdcdeddc700 1 --2- 172.21.15.50:0/2573668359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd806a800 0x7fdcd81dc0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400c780 tx=0x7fdcd400cb40 comp rx=0 tx=0).stop 2023-11-28T11:54:07.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fae2affd700 1 -- 172.21.15.50:0/2127979030 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae30053120 con 0x7fae3c0cb460 2023-11-28T11:54:07.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fdcdeddc700 1 -- 172.21.15.50:0/2573668359 shutdown_connections 2023-11-28T11:54:07.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fdcdeddc700 1 --2- 172.21.15.50:0/2573668359 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdcbc064f60 0x7fdcbc067410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fdcdeddc700 1 --2- 172.21.15.50:0/2573668359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcd80cb340 0x7fdcd80cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fdcdeddc700 1 --2- 172.21.15.50:0/2573668359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcd806f7c0 0x7fdcd81e4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fdcdeddc700 1 --2- 172.21.15.50:0/2573668359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcd806a800 0x7fdcd81dc0a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fdcdeddc700 1 -- 172.21.15.50:0/2573668359 >> 172.21.15.50:0/2573668359 conn(0x7fdcd80b1f90 msgr2=0x7fdcd80cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:07.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fdcdeddc700 1 -- 172.21.15.50:0/2573668359 shutdown_connections 2023-11-28T11:54:07.697 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-11-28T11:54:07.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fdcdeddc700 1 -- 172.21.15.50:0/2573668359 wait complete. 2023-11-28T11:54:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fae40bfd700 1 -- 172.21.15.50:0/2127979030 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fae1c064fb0 msgr2=0x7fae1c067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fae40bfd700 1 --2- 172.21.15.50:0/2127979030 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fae1c064fb0 0x7fae1c067460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0014c0 tx=0x7fae2c009040 comp rx=0 tx=0).stop 2023-11-28T11:54:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fae40bfd700 1 -- 172.21.15.50:0/2127979030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae3c0cb460 msgr2=0x7fae3c0cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fae40bfd700 1 --2- 172.21.15.50:0/2127979030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae3c0cb460 0x7fae3c0cb890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0add10 tx=0x7fae3000e840 comp rx=0 tx=0).stop 2023-11-28T11:54:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fae40bfd700 1 -- 172.21.15.50:0/2127979030 shutdown_connections 2023-11-28T11:54:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fae40bfd700 1 --2- 172.21.15.50:0/2127979030 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fae1c064fb0 0x7fae1c067460 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fae40bfd700 1 --2- 172.21.15.50:0/2127979030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae3c155db0 0x7fae3c156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fae40bfd700 1 --2- 172.21.15.50:0/2127979030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae3c0cb460 0x7fae3c0cb890 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fae40bfd700 1 --2- 172.21.15.50:0/2127979030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae24005220 0x7fae3c0ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fae40bfd700 1 -- 172.21.15.50:0/2127979030 >> 172.21.15.50:0/2127979030 conn(0x7fae3c0ce460 msgr2=0x7fae3c163250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fae40bfd700 1 -- 172.21.15.50:0/2127979030 shutdown_connections 2023-11-28T11:54:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.692+0000 7fae40bfd700 1 -- 172.21.15.50:0/2127979030 wait complete. 2023-11-28T11:54:07.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.696+0000 7f7ce754f700 1 -- 172.21.15.50:0/760170611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7ce0072500 con 0x7f7ce00b2570 2023-11-28T11:54:07.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.696+0000 7f7cd5ffb700 1 -- 172.21.15.50:0/760170611 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7cd80539e0 con 0x7f7ce00b2570 2023-11-28T11:54:07.701 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-11-28T11:54:07.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.700+0000 7f7ce754f700 1 -- 172.21.15.50:0/760170611 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7cc4064f90 msgr2=0x7f7cc4067440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.700+0000 7f7ce754f700 1 --2- 172.21.15.50:0/760170611 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7cc4064f90 0x7f7cc4067440 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00c3e90 tx=0x7f7cd0008040 comp rx=0 tx=0).stop 2023-11-28T11:54:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.700+0000 7f7ce754f700 1 -- 172.21.15.50:0/760170611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce00b2570 msgr2=0x7f7ce01f57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.700+0000 7f7ce754f700 1 --2- 172.21.15.50:0/760170611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce00b2570 0x7f7ce01f57a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800cea0 tx=0x7f7cd800a340 comp rx=0 tx=0).stop 2023-11-28T11:54:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.700+0000 7f7ce754f700 1 -- 172.21.15.50:0/760170611 shutdown_connections 2023-11-28T11:54:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.700+0000 7f7ce754f700 1 --2- 172.21.15.50:0/760170611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ce00c4150 0x7f7ce015c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.700+0000 7f7ce754f700 1 --2- 172.21.15.50:0/760170611 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7cc4064f90 0x7f7cc4067440 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.700+0000 7f7ce754f700 1 --2- 172.21.15.50:0/760170611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ce00cfdd0 0x7f7ce0156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.700+0000 7f7ce754f700 1 --2- 172.21.15.50:0/760170611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ce00b2570 0x7f7ce01f57a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.700+0000 7f7ce754f700 1 -- 172.21.15.50:0/760170611 >> 172.21.15.50:0/760170611 conn(0x7f7ce00cd0a0 msgr2=0x7f7ce00cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.700+0000 7f7ce754f700 1 -- 172.21.15.50:0/760170611 shutdown_connections 2023-11-28T11:54:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.700+0000 7f7ce754f700 1 -- 172.21.15.50:0/760170611 wait complete. 2023-11-28T11:54:07.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-11-28T11:54:07.710 DEBUG:teuthology.parallel:result is None 2023-11-28T11:54:07.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2023-11-28T11:54:07.715 DEBUG:teuthology.parallel:result is None 2023-11-28T11:54:07.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2023-11-28T11:54:07.717 DEBUG:teuthology.parallel:result is None 2023-11-28T11:54:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.720+0000 7f6452998700 1 -- 172.21.15.50:0/690674163 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f644c072500 con 0x7f644c06a560 2023-11-28T11:54:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.720+0000 7f6448ff9700 1 -- 172.21.15.50:0/690674163 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6444053ca0 con 0x7f644c06a560 2023-11-28T11:54:07.726 INFO:teuthology.orchestra.run.smithi050.stdout:55834574856 2023-11-28T11:54:07.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.724+0000 7f6452998700 1 -- 172.21.15.50:0/690674163 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6438064fb0 msgr2=0x7f6438067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.724+0000 7f6452998700 1 --2- 172.21.15.50:0/690674163 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6438064fb0 0x7f6438067460 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f644c0ac640 tx=0x7f6440009040 comp rx=0 tx=0).stop 2023-11-28T11:54:07.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.724+0000 7f6452998700 1 -- 172.21.15.50:0/690674163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f644c06a560 msgr2=0x7f644c0ac0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.724+0000 7f6452998700 1 --2- 172.21.15.50:0/690674163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f644c06a560 0x7f644c0ac0d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f644400cc50 tx=0x7f644400cf60 comp rx=0 tx=0).stop 2023-11-28T11:54:07.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.724+0000 7f6452998700 1 -- 172.21.15.50:0/690674163 shutdown_connections 2023-11-28T11:54:07.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.724+0000 7f6452998700 1 --2- 172.21.15.50:0/690674163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f644c0cee60 0x7f644c0acaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.724+0000 7f6452998700 1 --2- 172.21.15.50:0/690674163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f644c0ca5e0 0x7f644c0cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.724+0000 7f6452998700 1 --2- 172.21.15.50:0/690674163 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6438064fb0 0x7f6438067460 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.724+0000 7f6452998700 1 --2- 172.21.15.50:0/690674163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f644c06a560 0x7f644c0ac0d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.724+0000 7f6452998700 1 -- 172.21.15.50:0/690674163 >> 172.21.15.50:0/690674163 conn(0x7f644c0b2010 msgr2=0x7f644c15f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:07.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.724+0000 7f6452998700 1 -- 172.21.15.50:0/690674163 shutdown_connections 2023-11-28T11:54:07.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.724+0000 7f6452998700 1 -- 172.21.15.50:0/690674163 wait complete. 2023-11-28T11:54:07.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.724+0000 7f4dc2dac700 1 -- 172.21.15.50:0/3768940303 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4da40055c0 con 0x7f4dbc069eb0 2023-11-28T11:54:07.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.724+0000 7f67d8a38700 1 -- 172.21.15.50:0/1929959096 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f67b8005890 con 0x7f67d4160790 2023-11-28T11:54:07.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f67c2ffd700 1 -- 172.21.15.50:0/1929959096 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67cc023090 con 0x7f67d4160790 2023-11-28T11:54:07.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f4db27fc700 1 -- 172.21.15.50:0/3768940303 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4db4021030 con 0x7f4dbc069eb0 2023-11-28T11:54:07.732 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-11-28T11:54:07.733 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-11-28T11:54:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f67d8a38700 1 -- 172.21.15.50:0/1929959096 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f67b4064f30 msgr2=0x7f67b40673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f67d8a38700 1 --2- 172.21.15.50:0/1929959096 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f67b4064f30 0x7f67b40673e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f67d408b150 tx=0x7f67c4008030 comp rx=0 tx=0).stop 2023-11-28T11:54:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f67d8a38700 1 -- 172.21.15.50:0/1929959096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67d4160790 msgr2=0x7f67d40b0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f67d8a38700 1 --2- 172.21.15.50:0/1929959096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67d4160790 0x7f67d40b0dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00ba10 tx=0x7f67cc00bd20 comp rx=0 tx=0).stop 2023-11-28T11:54:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f67d8a38700 1 -- 172.21.15.50:0/1929959096 shutdown_connections 2023-11-28T11:54:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f67d8a38700 1 --2- 172.21.15.50:0/1929959096 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f67b4064f30 0x7f67b40673e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f67d8a38700 1 --2- 172.21.15.50:0/1929959096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67d4160790 0x7f67d40b0dc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f67d8a38700 1 --2- 172.21.15.50:0/1929959096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67d40ceb50 0x7f67d40d0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f67d8a38700 1 --2- 172.21.15.50:0/1929959096 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67d406ad60 0x7f67d415f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f67d8a38700 1 -- 172.21.15.50:0/1929959096 >> 172.21.15.50:0/1929959096 conn(0x7f67d4089f70 msgr2=0x7f67d40b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f67d8a38700 1 -- 172.21.15.50:0/1929959096 shutdown_connections 2023-11-28T11:54:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f67d8a38700 1 -- 172.21.15.50:0/1929959096 wait complete. 2023-11-28T11:54:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f4dc2dac700 1 -- 172.21.15.50:0/3768940303 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4da0064ee0 msgr2=0x7f4da0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f4dc2dac700 1 --2- 172.21.15.50:0/3768940303 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4da0064ee0 0x7f4da0067390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc157620 tx=0x7f4db8009040 comp rx=0 tx=0).stop 2023-11-28T11:54:07.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f4dc2dac700 1 -- 172.21.15.50:0/3768940303 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dbc069eb0 msgr2=0x7f4dbc157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f4dc2dac700 1 --2- 172.21.15.50:0/3768940303 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dbc069eb0 0x7f4dbc157690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4db4016000 tx=0x7f4db4004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f4dc2dac700 1 -- 172.21.15.50:0/3768940303 shutdown_connections 2023-11-28T11:54:07.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f4dc2dac700 1 --2- 172.21.15.50:0/3768940303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dbc0ca310 0x7f4dbc154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f4dc2dac700 1 --2- 172.21.15.50:0/3768940303 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4da0064ee0 0x7f4da0067390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f4dc2dac700 1 --2- 172.21.15.50:0/3768940303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc06cd80 0x7f4dbc1f5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f4dc2dac700 1 --2- 172.21.15.50:0/3768940303 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dbc069eb0 0x7f4dbc157690 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f4dc2dac700 1 -- 172.21.15.50:0/3768940303 >> 172.21.15.50:0/3768940303 conn(0x7f4dbc0ce3e0 msgr2=0x7f4dbc0ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:07.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f4dc2dac700 1 -- 172.21.15.50:0/3768940303 shutdown_connections 2023-11-28T11:54:07.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.728+0000 7f4dc2dac700 1 -- 172.21.15.50:0/3768940303 wait complete. 2023-11-28T11:54:07.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-11-28T11:54:07.742 DEBUG:teuthology.parallel:result is None 2023-11-28T11:54:07.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2023-11-28T11:54:07.747 DEBUG:teuthology.parallel:result is None 2023-11-28T11:54:07.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2023-11-28T11:54:07.748 DEBUG:teuthology.parallel:result is None 2023-11-28T11:54:07.748 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T11:54:07.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:54:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.896+0000 7f854d84e700 1 Processor -- start 2023-11-28T11:54:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.896+0000 7f854d84e700 1 -- start start 2023-11-28T11:54:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.896+0000 7f854d84e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85480c1ac0 0x7f8548069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.896+0000 7f854d84e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85480cae70 con 0x7f85481606b0 2023-11-28T11:54:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.896+0000 7f854d84e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85480cbc10 con 0x7f85480ceef0 2023-11-28T11:54:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.896+0000 7f854d84e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85480cb130 con 0x7f85480c1ac0 2023-11-28T11:54:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.896+0000 7f8547fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85480c1ac0 0x7f8548069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.896+0000 7f854c84c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f85481606b0 0x7f85480c13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56494/0 (socket says 172.21.15.50:56494) 2023-11-28T11:54:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.896+0000 7f854c84c700 1 -- 172.21.15.50:0/2806636819 learned_addr learned my addr 172.21.15.50:0/2806636819 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.896+0000 7f8547fff700 1 -- 172.21.15.50:0/2806636819 >> v1:172.21.15.192:6789/0 conn(0x7f85480ceef0 legacy=0x7f854806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.896+0000 7f8547fff700 1 -- 172.21.15.50:0/2806636819 >> v1:172.21.15.50:6789/0 conn(0x7f85481606b0 legacy=0x7f85480c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.896+0000 7f85477fe700 1 -- 172.21.15.50:0/2806636819 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439709737 0 0) 0x7f85480cae70 con 0x7f85481606b0 2023-11-28T11:54:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.896+0000 7f8547fff700 1 -- 172.21.15.50:0/2806636819 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85480cb410 con 0x7f85480c1ac0 2023-11-28T11:54:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.900+0000 7f8547fff700 1 --2- 172.21.15.50:0/2806636819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85480c1ac0 0x7f8548069c40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8534009850 tx=0x7f8534009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccce91b8e86d06b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.900+0000 7f85477fe700 1 -- 172.21.15.50:0/2806636819 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8534011830 con 0x7f85480c1ac0 2023-11-28T11:54:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.900+0000 7f85477fe700 1 -- 172.21.15.50:0/2806636819 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8534011990 con 0x7f85480c1ac0 2023-11-28T11:54:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.900+0000 7f85477fe700 1 -- 172.21.15.50:0/2806636819 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8534011d20 con 0x7f85480c1ac0 2023-11-28T11:54:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.900+0000 7f854d84e700 1 -- 172.21.15.50:0/2806636819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85480c1ac0 msgr2=0x7f8548069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.900+0000 7f854d84e700 1 --2- 172.21.15.50:0/2806636819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85480c1ac0 0x7f8548069c40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8534009850 tx=0x7f8534009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.900+0000 7f854d84e700 1 -- 172.21.15.50:0/2806636819 shutdown_connections 2023-11-28T11:54:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.900+0000 7f854d84e700 1 --2- 172.21.15.50:0/2806636819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85480c1ac0 0x7f8548069c40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.900+0000 7f854d84e700 1 -- 172.21.15.50:0/2806636819 >> 172.21.15.50:0/2806636819 conn(0x7f85480ce3e0 msgr2=0x7f85480ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.900+0000 7f854d84e700 1 -- 172.21.15.50:0/2806636819 shutdown_connections 2023-11-28T11:54:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.900+0000 7f854d84e700 1 -- 172.21.15.50:0/2806636819 wait complete. 2023-11-28T11:54:07.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.900+0000 7f854d84e700 1 Processor -- start 2023-11-28T11:54:07.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.900+0000 7f854d84e700 1 -- start start 2023-11-28T11:54:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854d84e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85480c1ac0 0x7f8548157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854d84e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85480ceef0 0x7f85480c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854d84e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85481606b0 0x7f85480c2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854d84e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854806fe40 con 0x7f85480c1ac0 2023-11-28T11:54:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854d84e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8548160a80 con 0x7f85480ceef0 2023-11-28T11:54:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854d84e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854815f3f0 con 0x7f85481606b0 2023-11-28T11:54:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854c84c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85480c1ac0 0x7f8548157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854c84c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85480c1ac0 0x7f8548157400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53574/0 (socket says 172.21.15.50:53574) 2023-11-28T11:54:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854c84c700 1 -- 172.21.15.50:0/1370356974 learned_addr learned my addr 172.21.15.50:0/1370356974 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f8547fff700 1 --2- 172.21.15.50:0/1370356974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85480ceef0 0x7f85480c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854d04d700 1 --2- 172.21.15.50:0/1370356974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85481606b0 0x7f85480c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854c84c700 1 -- 172.21.15.50:0/1370356974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85481606b0 msgr2=0x7f85480c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854c84c700 1 --2- 172.21.15.50:0/1370356974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85481606b0 0x7f85480c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854c84c700 1 -- 172.21.15.50:0/1370356974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85480ceef0 msgr2=0x7f85480c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854c84c700 1 --2- 172.21.15.50:0/1370356974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85480ceef0 0x7f85480c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854c84c700 1 -- 172.21.15.50:0/1370356974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85340094b0 con 0x7f85480c1ac0 2023-11-28T11:54:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854c84c700 1 --2- 172.21.15.50:0/1370356974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85480c1ac0 0x7f8548157400 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f853c00c4a0 tx=0x7f853c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f85457fa700 1 -- 172.21.15.50:0/1370356974 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c004ca0 con 0x7f85480c1ac0 2023-11-28T11:54:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f85457fa700 1 -- 172.21.15.50:0/1370356974 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c004e00 con 0x7f85480c1ac0 2023-11-28T11:54:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854d84e700 1 -- 172.21.15.50:0/1370356974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85480b36c0 con 0x7f85480c1ac0 2023-11-28T11:54:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f85457fa700 1 -- 172.21.15.50:0/1370356974 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c007310 con 0x7f85480c1ac0 2023-11-28T11:54:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854d84e700 1 -- 172.21.15.50:0/1370356974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85480cb6f0 con 0x7f85480c1ac0 2023-11-28T11:54:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.904+0000 7f854d84e700 1 -- 172.21.15.50:0/1370356974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85480ad610 con 0x7f85480c1ac0 2023-11-28T11:54:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.908+0000 7f85457fa700 1 -- 172.21.15.50:0/1370356974 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f853c01a020 con 0x7f85480c1ac0 2023-11-28T11:54:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.908+0000 7f85457fa700 1 --2- 172.21.15.50:0/1370356974 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f852c064f10 0x7f852c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.908+0000 7f85457fa700 1 -- 172.21.15.50:0/1370356974 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f853c081b60 con 0x7f85480c1ac0 2023-11-28T11:54:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.908+0000 7f8547fff700 1 --2- 172.21.15.50:0/1370356974 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f852c064f10 0x7f852c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.908+0000 7f8547fff700 1 --2- 172.21.15.50:0/1370356974 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f852c064f10 0x7f852c0673c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f85480c1eb0 tx=0x7f8534008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:07.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:07.916+0000 7f85457fa700 1 -- 172.21.15.50:0/1370356974 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f853c04fa10 con 0x7f85480c1ac0 2023-11-28T11:54:08.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.068+0000 7f854d84e700 1 -- 172.21.15.50:0/1370356974 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8548072500 con 0x7f852c064f10 2023-11-28T11:54:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.084+0000 7f85457fa700 1 -- 172.21.15.50:0/1370356974 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367546 (secure 0 0 0) 0x7f8548072500 con 0x7f852c064f10 2023-11-28T11:54:08.097 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:08.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.092+0000 7f854d84e700 1 -- 172.21.15.50:0/1370356974 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f852c064f10 msgr2=0x7f852c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.092+0000 7f854d84e700 1 --2- 172.21.15.50:0/1370356974 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f852c064f10 0x7f852c0673c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f85480c1eb0 tx=0x7f8534008030 comp rx=0 tx=0).stop 2023-11-28T11:54:08.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.092+0000 7f854d84e700 1 -- 172.21.15.50:0/1370356974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85480c1ac0 msgr2=0x7f8548157400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.092+0000 7f854d84e700 1 --2- 172.21.15.50:0/1370356974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85480c1ac0 0x7f8548157400 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f853c00c4a0 tx=0x7f853c00c7b0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.092+0000 7f854d84e700 1 -- 172.21.15.50:0/1370356974 shutdown_connections 2023-11-28T11:54:08.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.092+0000 7f854d84e700 1 --2- 172.21.15.50:0/1370356974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85481606b0 0x7f85480c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.092+0000 7f854d84e700 1 --2- 172.21.15.50:0/1370356974 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f852c064f10 0x7f852c0673c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.092+0000 7f854d84e700 1 --2- 172.21.15.50:0/1370356974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85480ceef0 0x7f85480c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.092+0000 7f854d84e700 1 --2- 172.21.15.50:0/1370356974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85480c1ac0 0x7f8548157400 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.092+0000 7f854d84e700 1 -- 172.21.15.50:0/1370356974 >> 172.21.15.50:0/1370356974 conn(0x7f85480ce3e0 msgr2=0x7f85480aeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:08.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.096+0000 7f854d84e700 1 -- 172.21.15.50:0/1370356974 shutdown_connections 2023-11-28T11:54:08.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.096+0000 7f854d84e700 1 -- 172.21.15.50:0/1370356974 wait complete. 2023-11-28T11:54:08.101 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:54:08.115 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-11-28T11:54:06.868689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594895,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71384,"kb_used_data":3288,"kb_used_omap":0,"kb_used_meta":68032,"kb_avail":754903336,"statfs":{"total":773094113280,"available":773021016064,"internally_reserved":0,"allocated":3366912,"data_stored":2063942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69664768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005675"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889694+0000","last_change":"2023-11-28T11:53:44.882435+0000","last_active":"2023-11-28T11:53:44.889694+0000","last_peered":"2023-11-28T11:53:44.889694+0000","last_clean":"2023-11-28T11:53:44.889694+0000","last_became_active":"2023-11-28T11:53:44.882048+0000","last_became_peered":"2023-11-28T11:53:44.882048+0000","last_unstale":"2023-11-28T11:53:44.889694+0000","last_undegraded":"2023-11-28T11:53:44.889694+0000","last_fullsized":"2023-11-28T11:53:44.889694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:05.347162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867841+0000","last_change":"2023-11-28T11:53:40.436343+0000","last_active":"2023-11-28T11:53:44.867841+0000","last_peered":"2023-11-28T11:53:44.867841+0000","last_clean":"2023-11-28T11:53:44.867841+0000","last_became_active":"2023-11-28T11:53:40.435879+0000","last_became_peered":"2023-11-28T11:53:40.435879+0000","last_unstale":"2023-11-28T11:53:44.867841+0000","last_undegraded":"2023-11-28T11:53:44.867841+0000","last_fullsized":"2023-11-28T11:53:44.867841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:00.300889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859343+0000","last_change":"2023-11-28T11:53:40.821925+0000","last_active":"2023-11-28T11:53:44.859343+0000","last_peered":"2023-11-28T11:53:44.859343+0000","last_clean":"2023-11-28T11:53:44.859343+0000","last_became_active":"2023-11-28T11:53:40.821597+0000","last_became_peered":"2023-11-28T11:53:40.821597+0000","last_unstale":"2023-11-28T11:53:44.859343+0000","last_undegraded":"2023-11-28T11:53:44.859343+0000","last_fullsized":"2023-11-28T11:53:44.859343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:23.875985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.880793+0000","last_change":"2023-11-28T11:53:44.875925+0000","last_active":"2023-11-28T11:53:44.880793+0000","last_peered":"2023-11-28T11:53:44.880793+0000","last_clean":"2023-11-28T11:53:44.880793+0000","last_became_active":"2023-11-28T11:53:44.875558+0000","last_became_peered":"2023-11-28T11:53:44.875558+0000","last_unstale":"2023-11-28T11:53:44.880793+0000","last_undegraded":"2023-11-28T11:53:44.880793+0000","last_fullsized":"2023-11-28T11:53:44.880793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:12.753046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863282+0000","last_change":"2023-11-28T11:53:40.441515+0000","last_active":"2023-11-28T11:53:44.863282+0000","last_peered":"2023-11-28T11:53:44.863282+0000","last_clean":"2023-11-28T11:53:44.863282+0000","last_became_active":"2023-11-28T11:53:40.441208+0000","last_became_peered":"2023-11-28T11:53:40.441208+0000","last_unstale":"2023-11-28T11:53:44.863282+0000","last_undegraded":"2023-11-28T11:53:44.863282+0000","last_fullsized":"2023-11-28T11:53:44.863282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:35:19.888846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862872+0000","last_change":"2023-11-28T11:53:40.830197+0000","last_active":"2023-11-28T11:53:44.862872+0000","last_peered":"2023-11-28T11:53:44.862872+0000","last_clean":"2023-11-28T11:53:44.862872+0000","last_became_active":"2023-11-28T11:53:40.829740+0000","last_became_peered":"2023-11-28T11:53:40.829740+0000","last_unstale":"2023-11-28T11:53:44.862872+0000","last_undegraded":"2023-11-28T11:53:44.862872+0000","last_fullsized":"2023-11-28T11:53:44.862872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:38.089006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873088+0000","last_change":"2023-11-28T11:53:44.870606+0000","last_active":"2023-11-28T11:53:44.873088+0000","last_peered":"2023-11-28T11:53:44.873088+0000","last_clean":"2023-11-28T11:53:44.873088+0000","last_became_active":"2023-11-28T11:53:44.870208+0000","last_became_peered":"2023-11-28T11:53:44.870208+0000","last_unstale":"2023-11-28T11:53:44.873088+0000","last_undegraded":"2023-11-28T11:53:44.873088+0000","last_fullsized":"2023-11-28T11:53:44.873088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:09:00.740331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.855028+0000","last_change":"2023-11-28T11:53:40.448313+0000","last_active":"2023-11-28T11:53:44.855028+0000","last_peered":"2023-11-28T11:53:44.855028+0000","last_clean":"2023-11-28T11:53:44.855028+0000","last_became_active":"2023-11-28T11:53:40.448063+0000","last_became_peered":"2023-11-28T11:53:40.448063+0000","last_unstale":"2023-11-28T11:53:44.855028+0000","last_undegraded":"2023-11-28T11:53:44.855028+0000","last_fullsized":"2023-11-28T11:53:44.855028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:39.305975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859973+0000","last_change":"2023-11-28T11:53:40.820453+0000","last_active":"2023-11-28T11:53:44.859973+0000","last_peered":"2023-11-28T11:53:44.859973+0000","last_clean":"2023-11-28T11:53:44.859973+0000","last_became_active":"2023-11-28T11:53:40.820114+0000","last_became_peered":"2023-11-28T11:53:40.820114+0000","last_unstale":"2023-11-28T11:53:44.859973+0000","last_undegraded":"2023-11-28T11:53:44.859973+0000","last_fullsized":"2023-11-28T11:53:44.859973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:07:13.206788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.880082+0000","last_change":"2023-11-28T11:53:44.877852+0000","last_active":"2023-11-28T11:53:44.880082+0000","last_peered":"2023-11-28T11:53:44.880082+0000","last_clean":"2023-11-28T11:53:44.880082+0000","last_became_active":"2023-11-28T11:53:44.877334+0000","last_became_peered":"2023-11-28T11:53:44.877334+0000","last_unstale":"2023-11-28T11:53:44.880082+0000","last_undegraded":"2023-11-28T11:53:44.880082+0000","last_fullsized":"2023-11-28T11:53:44.880082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:29.010118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852090+0000","last_change":"2023-11-28T11:53:40.450034+0000","last_active":"2023-11-28T11:53:44.852090+0000","last_peered":"2023-11-28T11:53:44.852090+0000","last_clean":"2023-11-28T11:53:44.852090+0000","last_became_active":"2023-11-28T11:53:40.449802+0000","last_became_peered":"2023-11-28T11:53:40.449802+0000","last_unstale":"2023-11-28T11:53:44.852090+0000","last_undegraded":"2023-11-28T11:53:44.852090+0000","last_fullsized":"2023-11-28T11:53:44.852090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:41.874385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859657+0000","last_change":"2023-11-28T11:53:40.822841+0000","last_active":"2023-11-28T11:53:44.859657+0000","last_peered":"2023-11-28T11:53:44.859657+0000","last_clean":"2023-11-28T11:53:44.859657+0000","last_became_active":"2023-11-28T11:53:40.822586+0000","last_became_peered":"2023-11-28T11:53:40.822586+0000","last_unstale":"2023-11-28T11:53:44.859657+0000","last_undegraded":"2023-11-28T11:53:44.859657+0000","last_fullsized":"2023-11-28T11:53:44.859657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:03.251004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889865+0000","last_change":"2023-11-28T11:53:44.883848+0000","last_active":"2023-11-28T11:53:44.889865+0000","last_peered":"2023-11-28T11:53:44.889865+0000","last_clean":"2023-11-28T11:53:44.889865+0000","last_became_active":"2023-11-28T11:53:44.883452+0000","last_became_peered":"2023-11-28T11:53:44.883452+0000","last_unstale":"2023-11-28T11:53:44.889865+0000","last_undegraded":"2023-11-28T11:53:44.889865+0000","last_fullsized":"2023-11-28T11:53:44.889865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:38.035586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.869040+0000","last_change":"2023-11-28T11:53:40.449747+0000","last_active":"2023-11-28T11:53:44.869040+0000","last_peered":"2023-11-28T11:53:44.869040+0000","last_clean":"2023-11-28T11:53:44.869040+0000","last_became_active":"2023-11-28T11:53:40.449347+0000","last_became_peered":"2023-11-28T11:53:40.449347+0000","last_unstale":"2023-11-28T11:53:44.869040+0000","last_undegraded":"2023-11-28T11:53:44.869040+0000","last_fullsized":"2023-11-28T11:53:44.869040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:54.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852330+0000","last_change":"2023-11-28T11:53:40.827861+0000","last_active":"2023-11-28T11:53:44.852330+0000","last_peered":"2023-11-28T11:53:44.852330+0000","last_clean":"2023-11-28T11:53:44.852330+0000","last_became_active":"2023-11-28T11:53:40.827614+0000","last_became_peered":"2023-11-28T11:53:40.827614+0000","last_unstale":"2023-11-28T11:53:44.852330+0000","last_undegraded":"2023-11-28T11:53:44.852330+0000","last_fullsized":"2023-11-28T11:53:44.852330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:01.312325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.883955+0000","last_change":"2023-11-28T11:53:44.880640+0000","last_active":"2023-11-28T11:53:44.883955+0000","last_peered":"2023-11-28T11:53:44.883955+0000","last_clean":"2023-11-28T11:53:44.883955+0000","last_became_active":"2023-11-28T11:53:44.880247+0000","last_became_peered":"2023-11-28T11:53:44.880247+0000","last_unstale":"2023-11-28T11:53:44.883955+0000","last_undegraded":"2023-11-28T11:53:44.883955+0000","last_fullsized":"2023-11-28T11:53:44.883955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:51:39.277759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860162+0000","last_change":"2023-11-28T11:53:40.448452+0000","last_active":"2023-11-28T11:53:44.860162+0000","last_peered":"2023-11-28T11:53:44.860162+0000","last_clean":"2023-11-28T11:53:44.860162+0000","last_became_active":"2023-11-28T11:53:40.448154+0000","last_became_peered":"2023-11-28T11:53:40.448154+0000","last_unstale":"2023-11-28T11:53:44.860162+0000","last_undegraded":"2023-11-28T11:53:44.860162+0000","last_fullsized":"2023-11-28T11:53:44.860162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:41.874385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863052+0000","last_change":"2023-11-28T11:53:40.825987+0000","last_active":"2023-11-28T11:53:44.863052+0000","last_peered":"2023-11-28T11:53:44.863052+0000","last_clean":"2023-11-28T11:53:44.863052+0000","last_became_active":"2023-11-28T11:53:40.825706+0000","last_became_peered":"2023-11-28T11:53:40.825706+0000","last_unstale":"2023-11-28T11:53:44.863052+0000","last_undegraded":"2023-11-28T11:53:44.863052+0000","last_fullsized":"2023-11-28T11:53:44.863052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:27:28.269321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.886243+0000","last_change":"2023-11-28T11:53:44.883030+0000","last_active":"2023-11-28T11:53:44.886243+0000","last_peered":"2023-11-28T11:53:44.886243+0000","last_clean":"2023-11-28T11:53:44.886243+0000","last_became_active":"2023-11-28T11:53:44.882675+0000","last_became_peered":"2023-11-28T11:53:44.882675+0000","last_unstale":"2023-11-28T11:53:44.886243+0000","last_undegraded":"2023-11-28T11:53:44.886243+0000","last_fullsized":"2023-11-28T11:53:44.886243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:07:45.954153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.872964+0000","last_change":"2023-11-28T11:53:40.448373+0000","last_active":"2023-11-28T11:53:44.872964+0000","last_peered":"2023-11-28T11:53:44.872964+0000","last_clean":"2023-11-28T11:53:44.872964+0000","last_became_active":"2023-11-28T11:53:40.448029+0000","last_became_peered":"2023-11-28T11:53:40.448029+0000","last_unstale":"2023-11-28T11:53:44.872964+0000","last_undegraded":"2023-11-28T11:53:44.872964+0000","last_fullsized":"2023-11-28T11:53:44.872964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:57.826127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867262+0000","last_change":"2023-11-28T11:53:40.833512+0000","last_active":"2023-11-28T11:53:44.867262+0000","last_peered":"2023-11-28T11:53:44.867262+0000","last_clean":"2023-11-28T11:53:44.867262+0000","last_became_active":"2023-11-28T11:53:40.833244+0000","last_became_peered":"2023-11-28T11:53:40.833244+0000","last_unstale":"2023-11-28T11:53:44.867262+0000","last_undegraded":"2023-11-28T11:53:44.867262+0000","last_fullsized":"2023-11-28T11:53:44.867262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:58.623372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889172+0000","last_change":"2023-11-28T11:53:44.881845+0000","last_active":"2023-11-28T11:53:44.889172+0000","last_peered":"2023-11-28T11:53:44.889172+0000","last_clean":"2023-11-28T11:53:44.889172+0000","last_became_active":"2023-11-28T11:53:44.881453+0000","last_became_peered":"2023-11-28T11:53:44.881453+0000","last_unstale":"2023-11-28T11:53:44.889172+0000","last_undegraded":"2023-11-28T11:53:44.889172+0000","last_fullsized":"2023-11-28T11:53:44.889172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:41:45.095803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861569+0000","last_change":"2023-11-28T11:53:40.440029+0000","last_active":"2023-11-28T11:53:44.861569+0000","last_peered":"2023-11-28T11:53:44.861569+0000","last_clean":"2023-11-28T11:53:44.861569+0000","last_became_active":"2023-11-28T11:53:40.439844+0000","last_became_peered":"2023-11-28T11:53:40.439844+0000","last_unstale":"2023-11-28T11:53:44.861569+0000","last_undegraded":"2023-11-28T11:53:44.861569+0000","last_fullsized":"2023-11-28T11:53:44.861569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:00.300889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865451+0000","last_change":"2023-11-28T11:53:40.827603+0000","last_active":"2023-11-28T11:53:44.865451+0000","last_peered":"2023-11-28T11:53:44.865451+0000","last_clean":"2023-11-28T11:53:44.865451+0000","last_became_active":"2023-11-28T11:53:40.827305+0000","last_became_peered":"2023-11-28T11:53:40.827305+0000","last_unstale":"2023-11-28T11:53:44.865451+0000","last_undegraded":"2023-11-28T11:53:44.865451+0000","last_fullsized":"2023-11-28T11:53:44.865451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:06.422936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861418+0000","last_change":"2023-11-28T11:53:40.825931+0000","last_active":"2023-11-28T11:53:44.861418+0000","last_peered":"2023-11-28T11:53:44.861418+0000","last_clean":"2023-11-28T11:53:44.861418+0000","last_became_active":"2023-11-28T11:53:40.825661+0000","last_became_peered":"2023-11-28T11:53:40.825661+0000","last_unstale":"2023-11-28T11:53:44.861418+0000","last_undegraded":"2023-11-28T11:53:44.861418+0000","last_fullsized":"2023-11-28T11:53:44.861418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.868397+0000","last_change":"2023-11-28T11:53:40.435820+0000","last_active":"2023-11-28T11:53:44.868397+0000","last_peered":"2023-11-28T11:53:44.868397+0000","last_clean":"2023-11-28T11:53:44.868397+0000","last_became_active":"2023-11-28T11:53:40.435413+0000","last_became_peered":"2023-11-28T11:53:40.435413+0000","last_unstale":"2023-11-28T11:53:44.868397+0000","last_undegraded":"2023-11-28T11:53:44.868397+0000","last_fullsized":"2023-11-28T11:53:44.868397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:39.305975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.882057+0000","last_change":"2023-11-28T11:53:44.878777+0000","last_active":"2023-11-28T11:53:44.882057+0000","last_peered":"2023-11-28T11:53:44.882057+0000","last_clean":"2023-11-28T11:53:44.882057+0000","last_became_active":"2023-11-28T11:53:44.878407+0000","last_became_peered":"2023-11-28T11:53:44.878407+0000","last_unstale":"2023-11-28T11:53:44.882057+0000","last_undegraded":"2023-11-28T11:53:44.882057+0000","last_fullsized":"2023-11-28T11:53:44.882057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:17.214530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862966+0000","last_change":"2023-11-28T11:53:40.831099+0000","last_active":"2023-11-28T11:53:44.862966+0000","last_peered":"2023-11-28T11:53:44.862966+0000","last_clean":"2023-11-28T11:53:44.862966+0000","last_became_active":"2023-11-28T11:53:40.830838+0000","last_became_peered":"2023-11-28T11:53:40.830838+0000","last_unstale":"2023-11-28T11:53:44.862966+0000","last_undegraded":"2023-11-28T11:53:44.862966+0000","last_fullsized":"2023-11-28T11:53:44.862966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:49.919629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.854355+0000","last_change":"2023-11-28T11:53:40.443966+0000","last_active":"2023-11-28T11:53:44.854355+0000","last_peered":"2023-11-28T11:53:44.854355+0000","last_clean":"2023-11-28T11:53:44.854355+0000","last_became_active":"2023-11-28T11:53:40.443553+0000","last_became_peered":"2023-11-28T11:53:40.443553+0000","last_unstale":"2023-11-28T11:53:44.854355+0000","last_undegraded":"2023-11-28T11:53:44.854355+0000","last_fullsized":"2023-11-28T11:53:44.854355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:19.967407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.879723+0000","last_change":"2023-11-28T11:53:44.874157+0000","last_active":"2023-11-28T11:53:44.879723+0000","last_peered":"2023-11-28T11:53:44.879723+0000","last_clean":"2023-11-28T11:53:44.879723+0000","last_became_active":"2023-11-28T11:53:44.873721+0000","last_became_peered":"2023-11-28T11:53:44.873721+0000","last_unstale":"2023-11-28T11:53:44.879723+0000","last_undegraded":"2023-11-28T11:53:44.879723+0000","last_fullsized":"2023-11-28T11:53:44.879723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:38.035586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859711+0000","last_change":"2023-11-28T11:53:40.443961+0000","last_active":"2023-11-28T11:53:44.859711+0000","last_peered":"2023-11-28T11:53:44.859711+0000","last_clean":"2023-11-28T11:53:44.859711+0000","last_became_active":"2023-11-28T11:53:40.443600+0000","last_became_peered":"2023-11-28T11:53:40.443600+0000","last_unstale":"2023-11-28T11:53:44.859711+0000","last_undegraded":"2023-11-28T11:53:44.859711+0000","last_fullsized":"2023-11-28T11:53:44.859711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:05.411499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873244+0000","last_change":"2023-11-28T11:53:40.823833+0000","last_active":"2023-11-28T11:53:44.873244+0000","last_peered":"2023-11-28T11:53:44.873244+0000","last_clean":"2023-11-28T11:53:44.873244+0000","last_became_active":"2023-11-28T11:53:40.823583+0000","last_became_peered":"2023-11-28T11:53:40.823583+0000","last_unstale":"2023-11-28T11:53:44.873244+0000","last_undegraded":"2023-11-28T11:53:44.873244+0000","last_fullsized":"2023-11-28T11:53:44.873244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:18.454529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889155+0000","last_change":"2023-11-28T11:53:44.886943+0000","last_active":"2023-11-28T11:53:44.889155+0000","last_peered":"2023-11-28T11:53:44.889155+0000","last_clean":"2023-11-28T11:53:44.889155+0000","last_became_active":"2023-11-28T11:53:44.884458+0000","last_became_peered":"2023-11-28T11:53:44.884458+0000","last_unstale":"2023-11-28T11:53:44.889155+0000","last_undegraded":"2023-11-28T11:53:44.889155+0000","last_fullsized":"2023-11-28T11:53:44.889155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:09:00.740331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T11:53:49.771859+0000","last_change":"2023-11-28T11:53:40.445841+0000","last_active":"2023-11-28T11:53:49.771859+0000","last_peered":"2023-11-28T11:53:49.771859+0000","last_clean":"2023-11-28T11:53:49.771859+0000","last_became_active":"2023-11-28T11:53:40.445170+0000","last_became_peered":"2023-11-28T11:53:40.445170+0000","last_unstale":"2023-11-28T11:53:49.771859+0000","last_undegraded":"2023-11-28T11:53:49.771859+0000","last_fullsized":"2023-11-28T11:53:49.771859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:39.305975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859738+0000","last_change":"2023-11-28T11:53:40.822601+0000","last_active":"2023-11-28T11:53:44.859738+0000","last_peered":"2023-11-28T11:53:44.859738+0000","last_clean":"2023-11-28T11:53:44.859738+0000","last_became_active":"2023-11-28T11:53:40.822327+0000","last_became_peered":"2023-11-28T11:53:40.822327+0000","last_unstale":"2023-11-28T11:53:44.859738+0000","last_undegraded":"2023-11-28T11:53:44.859738+0000","last_fullsized":"2023-11-28T11:53:44.859738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:06.929054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889658+0000","last_change":"2023-11-28T11:53:44.881520+0000","last_active":"2023-11-28T11:53:44.889658+0000","last_peered":"2023-11-28T11:53:44.889658+0000","last_clean":"2023-11-28T11:53:44.889658+0000","last_became_active":"2023-11-28T11:53:44.881135+0000","last_became_peered":"2023-11-28T11:53:44.881135+0000","last_unstale":"2023-11-28T11:53:44.889658+0000","last_undegraded":"2023-11-28T11:53:44.889658+0000","last_fullsized":"2023-11-28T11:53:44.889658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:27.296993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873318+0000","last_change":"2023-11-28T11:53:40.833933+0000","last_active":"2023-11-28T11:53:44.873318+0000","last_peered":"2023-11-28T11:53:44.873318+0000","last_clean":"2023-11-28T11:53:44.873318+0000","last_became_active":"2023-11-28T11:53:40.833658+0000","last_became_peered":"2023-11-28T11:53:40.833658+0000","last_unstale":"2023-11-28T11:53:44.873318+0000","last_undegraded":"2023-11-28T11:53:44.873318+0000","last_fullsized":"2023-11-28T11:53:44.873318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:57.215796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865519+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:53:44.865519+0000","last_peered":"2023-11-28T11:53:44.865519+0000","last_clean":"2023-11-28T11:53:44.865519+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:53:44.865519+0000","last_undegraded":"2023-11-28T11:53:44.865519+0000","last_fullsized":"2023-11-28T11:53:44.865519+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.855082+0000","last_change":"2023-11-28T11:53:40.441530+0000","last_active":"2023-11-28T11:53:44.855082+0000","last_peered":"2023-11-28T11:53:44.855082+0000","last_clean":"2023-11-28T11:53:44.855082+0000","last_became_active":"2023-11-28T11:53:40.441317+0000","last_became_peered":"2023-11-28T11:53:40.441317+0000","last_unstale":"2023-11-28T11:53:44.855082+0000","last_undegraded":"2023-11-28T11:53:44.855082+0000","last_fullsized":"2023-11-28T11:53:44.855082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:54.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889193+0000","last_change":"2023-11-28T11:53:44.882186+0000","last_active":"2023-11-28T11:53:44.889193+0000","last_peered":"2023-11-28T11:53:44.889193+0000","last_clean":"2023-11-28T11:53:44.889193+0000","last_became_active":"2023-11-28T11:53:44.881794+0000","last_became_peered":"2023-11-28T11:53:44.881794+0000","last_unstale":"2023-11-28T11:53:44.889193+0000","last_undegraded":"2023-11-28T11:53:44.889193+0000","last_fullsized":"2023-11-28T11:53:44.889193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:05.347162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.868559+0000","last_change":"2023-11-28T11:53:40.836155+0000","last_active":"2023-11-28T11:53:44.868559+0000","last_peered":"2023-11-28T11:53:44.868559+0000","last_clean":"2023-11-28T11:53:44.868559+0000","last_became_active":"2023-11-28T11:53:40.834486+0000","last_became_peered":"2023-11-28T11:53:40.834486+0000","last_unstale":"2023-11-28T11:53:44.868559+0000","last_undegraded":"2023-11-28T11:53:44.868559+0000","last_fullsized":"2023-11-28T11:53:44.868559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865189+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:53:44.865189+0000","last_peered":"2023-11-28T11:53:44.865189+0000","last_clean":"2023-11-28T11:53:44.865189+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:53:44.865189+0000","last_undegraded":"2023-11-28T11:53:44.865189+0000","last_fullsized":"2023-11-28T11:53:44.865189+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873207+0000","last_change":"2023-11-28T11:53:40.448611+0000","last_active":"2023-11-28T11:53:44.873207+0000","last_peered":"2023-11-28T11:53:44.873207+0000","last_clean":"2023-11-28T11:53:44.873207+0000","last_became_active":"2023-11-28T11:53:40.445176+0000","last_became_peered":"2023-11-28T11:53:40.445176+0000","last_unstale":"2023-11-28T11:53:44.873207+0000","last_undegraded":"2023-11-28T11:53:44.873207+0000","last_fullsized":"2023-11-28T11:53:44.873207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:16:02.435885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.881976+0000","last_change":"2023-11-28T11:53:44.876201+0000","last_active":"2023-11-28T11:53:44.881976+0000","last_peered":"2023-11-28T11:53:44.881976+0000","last_clean":"2023-11-28T11:53:44.881976+0000","last_became_active":"2023-11-28T11:53:44.875772+0000","last_became_peered":"2023-11-28T11:53:44.875772+0000","last_unstale":"2023-11-28T11:53:44.881976+0000","last_undegraded":"2023-11-28T11:53:44.881976+0000","last_fullsized":"2023-11-28T11:53:44.881976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:45:22.911172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861493+0000","last_change":"2023-11-28T11:53:40.831017+0000","last_active":"2023-11-28T11:53:44.861493+0000","last_peered":"2023-11-28T11:53:44.861493+0000","last_clean":"2023-11-28T11:53:44.861493+0000","last_became_active":"2023-11-28T11:53:40.830653+0000","last_became_peered":"2023-11-28T11:53:40.830653+0000","last_unstale":"2023-11-28T11:53:44.861493+0000","last_undegraded":"2023-11-28T11:53:44.861493+0000","last_fullsized":"2023-11-28T11:53:44.861493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:57.213686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862754+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:53:44.862754+0000","last_peered":"2023-11-28T11:53:44.862754+0000","last_clean":"2023-11-28T11:53:44.862754+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:53:44.862754+0000","last_undegraded":"2023-11-28T11:53:44.862754+0000","last_fullsized":"2023-11-28T11:53:44.862754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.877834+0000","last_change":"2023-11-28T11:53:40.444866+0000","last_active":"2023-11-28T11:53:44.877834+0000","last_peered":"2023-11-28T11:53:44.877834+0000","last_clean":"2023-11-28T11:53:44.877834+0000","last_became_active":"2023-11-28T11:53:40.444600+0000","last_became_peered":"2023-11-28T11:53:40.444600+0000","last_unstale":"2023-11-28T11:53:44.877834+0000","last_undegraded":"2023-11-28T11:53:44.877834+0000","last_fullsized":"2023-11-28T11:53:44.877834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:54.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.881029+0000","last_change":"2023-11-28T11:53:44.877188+0000","last_active":"2023-11-28T11:53:44.881029+0000","last_peered":"2023-11-28T11:53:44.881029+0000","last_clean":"2023-11-28T11:53:44.881029+0000","last_became_active":"2023-11-28T11:53:44.876752+0000","last_became_peered":"2023-11-28T11:53:44.876752+0000","last_unstale":"2023-11-28T11:53:44.881029+0000","last_undegraded":"2023-11-28T11:53:44.881029+0000","last_fullsized":"2023-11-28T11:53:44.881029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:49.906382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860156+0000","last_change":"2023-11-28T11:53:40.832575+0000","last_active":"2023-11-28T11:53:44.860156+0000","last_peered":"2023-11-28T11:53:44.860156+0000","last_clean":"2023-11-28T11:53:44.860156+0000","last_became_active":"2023-11-28T11:53:40.832265+0000","last_became_peered":"2023-11-28T11:53:40.832265+0000","last_unstale":"2023-11-28T11:53:44.860156+0000","last_undegraded":"2023-11-28T11:53:44.860156+0000","last_fullsized":"2023-11-28T11:53:44.860156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:27:28.269321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863573+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:53:44.863573+0000","last_peered":"2023-11-28T11:53:44.863573+0000","last_clean":"2023-11-28T11:53:44.863573+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:53:44.863573+0000","last_undegraded":"2023-11-28T11:53:44.863573+0000","last_fullsized":"2023-11-28T11:53:44.863573+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T11:53:45.370919+0000","last_change":"2023-11-28T11:53:40.450301+0000","last_active":"2023-11-28T11:53:45.370919+0000","last_peered":"2023-11-28T11:53:45.370919+0000","last_clean":"2023-11-28T11:53:45.370919+0000","last_became_active":"2023-11-28T11:53:40.450014+0000","last_became_peered":"2023-11-28T11:53:40.450014+0000","last_unstale":"2023-11-28T11:53:45.370919+0000","last_undegraded":"2023-11-28T11:53:45.370919+0000","last_fullsized":"2023-11-28T11:53:45.370919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:57.826127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.883889+0000","last_change":"2023-11-28T11:53:44.880249+0000","last_active":"2023-11-28T11:53:44.883889+0000","last_peered":"2023-11-28T11:53:44.883889+0000","last_clean":"2023-11-28T11:53:44.883889+0000","last_became_active":"2023-11-28T11:53:44.879807+0000","last_became_peered":"2023-11-28T11:53:44.879807+0000","last_unstale":"2023-11-28T11:53:44.883889+0000","last_undegraded":"2023-11-28T11:53:44.883889+0000","last_fullsized":"2023-11-28T11:53:44.883889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:24:18.219732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867353+0000","last_change":"2023-11-28T11:53:40.822809+0000","last_active":"2023-11-28T11:53:44.867353+0000","last_peered":"2023-11-28T11:53:44.867353+0000","last_clean":"2023-11-28T11:53:44.867353+0000","last_became_active":"2023-11-28T11:53:40.822525+0000","last_became_peered":"2023-11-28T11:53:40.822525+0000","last_unstale":"2023-11-28T11:53:44.867353+0000","last_undegraded":"2023-11-28T11:53:44.867353+0000","last_fullsized":"2023-11-28T11:53:44.867353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:33.728842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863783+0000","last_change":"2023-11-28T11:53:40.447043+0000","last_active":"2023-11-28T11:53:44.863783+0000","last_peered":"2023-11-28T11:53:44.863783+0000","last_clean":"2023-11-28T11:53:44.863783+0000","last_became_active":"2023-11-28T11:53:40.446655+0000","last_became_peered":"2023-11-28T11:53:40.446655+0000","last_unstale":"2023-11-28T11:53:44.863783+0000","last_undegraded":"2023-11-28T11:53:44.863783+0000","last_fullsized":"2023-11-28T11:53:44.863783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:16:02.435885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.858559+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:53:44.858559+0000","last_peered":"2023-11-28T11:53:44.858559+0000","last_clean":"2023-11-28T11:53:44.858559+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:53:44.858559+0000","last_undegraded":"2023-11-28T11:53:44.858559+0000","last_fullsized":"2023-11-28T11:53:44.858559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873069+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:53:44.873069+0000","last_peered":"2023-11-28T11:53:44.873069+0000","last_clean":"2023-11-28T11:53:44.873069+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:53:44.873069+0000","last_undegraded":"2023-11-28T11:53:44.873069+0000","last_fullsized":"2023-11-28T11:53:44.873069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.881432+0000","last_change":"2023-11-28T11:53:44.877382+0000","last_active":"2023-11-28T11:53:44.881432+0000","last_peered":"2023-11-28T11:53:44.881432+0000","last_clean":"2023-11-28T11:53:44.881432+0000","last_became_active":"2023-11-28T11:53:44.876993+0000","last_became_peered":"2023-11-28T11:53:44.876993+0000","last_unstale":"2023-11-28T11:53:44.881432+0000","last_undegraded":"2023-11-28T11:53:44.881432+0000","last_fullsized":"2023-11-28T11:53:44.881432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:54:59.674019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.876641+0000","last_change":"2023-11-28T11:53:40.829307+0000","last_active":"2023-11-28T11:53:44.876641+0000","last_peered":"2023-11-28T11:53:44.876641+0000","last_clean":"2023-11-28T11:53:44.876641+0000","last_became_active":"2023-11-28T11:53:40.828558+0000","last_became_peered":"2023-11-28T11:53:40.828558+0000","last_unstale":"2023-11-28T11:53:44.876641+0000","last_undegraded":"2023-11-28T11:53:44.876641+0000","last_fullsized":"2023-11-28T11:53:44.876641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:03:21.599961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.871461+0000","last_change":"2023-11-28T11:53:40.446066+0000","last_active":"2023-11-28T11:53:44.871461+0000","last_peered":"2023-11-28T11:53:44.871461+0000","last_clean":"2023-11-28T11:53:44.871461+0000","last_became_active":"2023-11-28T11:53:40.445774+0000","last_became_peered":"2023-11-28T11:53:40.445774+0000","last_unstale":"2023-11-28T11:53:44.871461+0000","last_undegraded":"2023-11-28T11:53:44.871461+0000","last_fullsized":"2023-11-28T11:53:44.871461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:58:24.917085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861363+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:53:44.861363+0000","last_peered":"2023-11-28T11:53:44.861363+0000","last_clean":"2023-11-28T11:53:44.861363+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:53:44.861363+0000","last_undegraded":"2023-11-28T11:53:44.861363+0000","last_fullsized":"2023-11-28T11:53:44.861363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.888435+0000","last_change":"2023-11-28T11:53:44.881392+0000","last_active":"2023-11-28T11:53:44.888435+0000","last_peered":"2023-11-28T11:53:44.888435+0000","last_clean":"2023-11-28T11:53:44.888435+0000","last_became_active":"2023-11-28T11:53:44.880999+0000","last_became_peered":"2023-11-28T11:53:44.880999+0000","last_unstale":"2023-11-28T11:53:44.888435+0000","last_undegraded":"2023-11-28T11:53:44.888435+0000","last_fullsized":"2023-11-28T11:53:44.888435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:10.350062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873131+0000","last_change":"2023-11-28T11:53:40.829883+0000","last_active":"2023-11-28T11:53:44.873131+0000","last_peered":"2023-11-28T11:53:44.873131+0000","last_clean":"2023-11-28T11:53:44.873131+0000","last_became_active":"2023-11-28T11:53:40.828918+0000","last_became_peered":"2023-11-28T11:53:40.828918+0000","last_unstale":"2023-11-28T11:53:44.873131+0000","last_undegraded":"2023-11-28T11:53:44.873131+0000","last_fullsized":"2023-11-28T11:53:44.873131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:53.307980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859888+0000","last_change":"2023-11-28T11:53:40.444678+0000","last_active":"2023-11-28T11:53:44.859888+0000","last_peered":"2023-11-28T11:53:44.859888+0000","last_clean":"2023-11-28T11:53:44.859888+0000","last_became_active":"2023-11-28T11:53:40.444330+0000","last_became_peered":"2023-11-28T11:53:40.444330+0000","last_unstale":"2023-11-28T11:53:44.859888+0000","last_undegraded":"2023-11-28T11:53:44.859888+0000","last_fullsized":"2023-11-28T11:53:44.859888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:54.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852107+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:53:44.852107+0000","last_peered":"2023-11-28T11:53:44.852107+0000","last_clean":"2023-11-28T11:53:44.852107+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:53:44.852107+0000","last_undegraded":"2023-11-28T11:53:44.852107+0000","last_fullsized":"2023-11-28T11:53:44.852107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.887490+0000","last_change":"2023-11-28T11:53:44.879815+0000","last_active":"2023-11-28T11:53:44.887490+0000","last_peered":"2023-11-28T11:53:44.887490+0000","last_clean":"2023-11-28T11:53:44.887490+0000","last_became_active":"2023-11-28T11:53:44.879231+0000","last_became_peered":"2023-11-28T11:53:44.879231+0000","last_unstale":"2023-11-28T11:53:44.887490+0000","last_undegraded":"2023-11-28T11:53:44.887490+0000","last_fullsized":"2023-11-28T11:53:44.887490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:29.010118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865882+0000","last_change":"2023-11-28T11:53:40.825293+0000","last_active":"2023-11-28T11:53:44.865882+0000","last_peered":"2023-11-28T11:53:44.865882+0000","last_clean":"2023-11-28T11:53:44.865882+0000","last_became_active":"2023-11-28T11:53:40.824947+0000","last_became_peered":"2023-11-28T11:53:40.824947+0000","last_unstale":"2023-11-28T11:53:44.865882+0000","last_undegraded":"2023-11-28T11:53:44.865882+0000","last_fullsized":"2023-11-28T11:53:44.865882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:57.215796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862236+0000","last_change":"2023-11-28T11:53:40.442915+0000","last_active":"2023-11-28T11:53:44.862236+0000","last_peered":"2023-11-28T11:53:44.862236+0000","last_clean":"2023-11-28T11:53:44.862236+0000","last_became_active":"2023-11-28T11:53:40.442616+0000","last_became_peered":"2023-11-28T11:53:40.442616+0000","last_unstale":"2023-11-28T11:53:44.862236+0000","last_undegraded":"2023-11-28T11:53:44.862236+0000","last_fullsized":"2023-11-28T11:53:44.862236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:41.874385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.858675+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:53:44.858675+0000","last_peered":"2023-11-28T11:53:44.858675+0000","last_clean":"2023-11-28T11:53:44.858675+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:53:44.858675+0000","last_undegraded":"2023-11-28T11:53:44.858675+0000","last_fullsized":"2023-11-28T11:53:44.858675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.886370+0000","last_change":"2023-11-28T11:53:44.883518+0000","last_active":"2023-11-28T11:53:44.886370+0000","last_peered":"2023-11-28T11:53:44.886370+0000","last_clean":"2023-11-28T11:53:44.886370+0000","last_became_active":"2023-11-28T11:53:44.880294+0000","last_became_peered":"2023-11-28T11:53:44.880294+0000","last_unstale":"2023-11-28T11:53:44.886370+0000","last_undegraded":"2023-11-28T11:53:44.886370+0000","last_fullsized":"2023-11-28T11:53:44.886370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:18.531528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.876596+0000","last_change":"2023-11-28T11:53:40.823797+0000","last_active":"2023-11-28T11:53:44.876596+0000","last_peered":"2023-11-28T11:53:44.876596+0000","last_clean":"2023-11-28T11:53:44.876596+0000","last_became_active":"2023-11-28T11:53:40.823514+0000","last_became_peered":"2023-11-28T11:53:40.823514+0000","last_unstale":"2023-11-28T11:53:44.876596+0000","last_undegraded":"2023-11-28T11:53:44.876596+0000","last_fullsized":"2023-11-28T11:53:44.876596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861642+0000","last_change":"2023-11-28T11:53:40.450607+0000","last_active":"2023-11-28T11:53:44.861642+0000","last_peered":"2023-11-28T11:53:44.861642+0000","last_clean":"2023-11-28T11:53:44.861642+0000","last_became_active":"2023-11-28T11:53:40.450324+0000","last_became_peered":"2023-11-28T11:53:40.450324+0000","last_unstale":"2023-11-28T11:53:44.861642+0000","last_undegraded":"2023-11-28T11:53:44.861642+0000","last_fullsized":"2023-11-28T11:53:44.861642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:17.443093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.872261+0000","last_change":"2023-11-28T11:53:44.868741+0000","last_active":"2023-11-28T11:53:44.872261+0000","last_peered":"2023-11-28T11:53:44.872261+0000","last_clean":"2023-11-28T11:53:44.872261+0000","last_became_active":"2023-11-28T11:53:44.868320+0000","last_became_peered":"2023-11-28T11:53:44.868320+0000","last_unstale":"2023-11-28T11:53:44.872261+0000","last_undegraded":"2023-11-28T11:53:44.872261+0000","last_fullsized":"2023-11-28T11:53:44.872261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:54:58.724369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862814+0000","last_change":"2023-11-28T11:53:40.823419+0000","last_active":"2023-11-28T11:53:44.862814+0000","last_peered":"2023-11-28T11:53:44.862814+0000","last_clean":"2023-11-28T11:53:44.862814+0000","last_became_active":"2023-11-28T11:53:40.821588+0000","last_became_peered":"2023-11-28T11:53:40.821588+0000","last_unstale":"2023-11-28T11:53:44.862814+0000","last_undegraded":"2023-11-28T11:53:44.862814+0000","last_fullsized":"2023-11-28T11:53:44.862814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:13.793522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862499+0000","last_change":"2023-11-28T11:53:40.448234+0000","last_active":"2023-11-28T11:53:44.862499+0000","last_peered":"2023-11-28T11:53:44.862499+0000","last_clean":"2023-11-28T11:53:44.862499+0000","last_became_active":"2023-11-28T11:53:40.447793+0000","last_became_peered":"2023-11-28T11:53:40.447793+0000","last_unstale":"2023-11-28T11:53:44.862499+0000","last_undegraded":"2023-11-28T11:53:44.862499+0000","last_fullsized":"2023-11-28T11:53:44.862499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:57.826127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.871780+0000","last_change":"2023-11-28T11:53:44.868480+0000","last_active":"2023-11-28T11:53:44.871780+0000","last_peered":"2023-11-28T11:53:44.871780+0000","last_clean":"2023-11-28T11:53:44.871780+0000","last_became_active":"2023-11-28T11:53:44.868051+0000","last_became_peered":"2023-11-28T11:53:44.868051+0000","last_unstale":"2023-11-28T11:53:44.871780+0000","last_undegraded":"2023-11-28T11:53:44.871780+0000","last_fullsized":"2023-11-28T11:53:44.871780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:45:35.342963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862591+0000","last_change":"2023-11-28T11:53:40.826870+0000","last_active":"2023-11-28T11:53:44.862591+0000","last_peered":"2023-11-28T11:53:44.862591+0000","last_clean":"2023-11-28T11:53:44.862591+0000","last_became_active":"2023-11-28T11:53:40.826561+0000","last_became_peered":"2023-11-28T11:53:40.826561+0000","last_unstale":"2023-11-28T11:53:44.862591+0000","last_undegraded":"2023-11-28T11:53:44.862591+0000","last_fullsized":"2023-11-28T11:53:44.862591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:24:13.706573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865183+0000","last_change":"2023-11-28T11:53:40.450118+0000","last_active":"2023-11-28T11:53:44.865183+0000","last_peered":"2023-11-28T11:53:44.865183+0000","last_clean":"2023-11-28T11:53:44.865183+0000","last_became_active":"2023-11-28T11:53:40.449740+0000","last_became_peered":"2023-11-28T11:53:40.449740+0000","last_unstale":"2023-11-28T11:53:44.865183+0000","last_undegraded":"2023-11-28T11:53:44.865183+0000","last_fullsized":"2023-11-28T11:53:44.865183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:16:02.435885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889470+0000","last_change":"2023-11-28T11:53:44.880051+0000","last_active":"2023-11-28T11:53:44.889470+0000","last_peered":"2023-11-28T11:53:44.889470+0000","last_clean":"2023-11-28T11:53:44.889470+0000","last_became_active":"2023-11-28T11:53:44.879656+0000","last_became_peered":"2023-11-28T11:53:44.879656+0000","last_unstale":"2023-11-28T11:53:44.889470+0000","last_undegraded":"2023-11-28T11:53:44.889470+0000","last_fullsized":"2023-11-28T11:53:44.889470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:21:48.435615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859774+0000","last_change":"2023-11-28T11:53:40.822906+0000","last_active":"2023-11-28T11:53:44.859774+0000","last_peered":"2023-11-28T11:53:44.859774+0000","last_clean":"2023-11-28T11:53:44.859774+0000","last_became_active":"2023-11-28T11:53:40.822629+0000","last_became_peered":"2023-11-28T11:53:40.822629+0000","last_unstale":"2023-11-28T11:53:44.859774+0000","last_undegraded":"2023-11-28T11:53:44.859774+0000","last_fullsized":"2023-11-28T11:53:44.859774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:34.614578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862074+0000","last_change":"2023-11-28T11:53:40.441500+0000","last_active":"2023-11-28T11:53:44.862074+0000","last_peered":"2023-11-28T11:53:44.862074+0000","last_clean":"2023-11-28T11:53:44.862074+0000","last_became_active":"2023-11-28T11:53:40.441158+0000","last_became_peered":"2023-11-28T11:53:40.441158+0000","last_unstale":"2023-11-28T11:53:44.862074+0000","last_undegraded":"2023-11-28T11:53:44.862074+0000","last_fullsized":"2023-11-28T11:53:44.862074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:19.967407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873877+0000","last_change":"2023-11-28T11:53:44.872014+0000","last_active":"2023-11-28T11:53:44.873877+0000","last_peered":"2023-11-28T11:53:44.873877+0000","last_clean":"2023-11-28T11:53:44.873877+0000","last_became_active":"2023-11-28T11:53:44.871605+0000","last_became_peered":"2023-11-28T11:53:44.871605+0000","last_unstale":"2023-11-28T11:53:44.873877+0000","last_undegraded":"2023-11-28T11:53:44.873877+0000","last_fullsized":"2023-11-28T11:53:44.873877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:45:22.911172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.868467+0000","last_change":"2023-11-28T11:53:40.822940+0000","last_active":"2023-11-28T11:53:44.868467+0000","last_peered":"2023-11-28T11:53:44.868467+0000","last_clean":"2023-11-28T11:53:44.868467+0000","last_became_active":"2023-11-28T11:53:40.822043+0000","last_became_peered":"2023-11-28T11:53:40.822043+0000","last_unstale":"2023-11-28T11:53:44.868467+0000","last_undegraded":"2023-11-28T11:53:44.868467+0000","last_fullsized":"2023-11-28T11:53:44.868467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:57.213686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.851830+0000","last_change":"2023-11-28T11:53:40.443907+0000","last_active":"2023-11-28T11:53:44.851830+0000","last_peered":"2023-11-28T11:53:44.851830+0000","last_clean":"2023-11-28T11:53:44.851830+0000","last_became_active":"2023-11-28T11:53:40.443561+0000","last_became_peered":"2023-11-28T11:53:40.443561+0000","last_unstale":"2023-11-28T11:53:44.851830+0000","last_undegraded":"2023-11-28T11:53:44.851830+0000","last_fullsized":"2023-11-28T11:53:44.851830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:00.300889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.886453+0000","last_change":"2023-11-28T11:53:44.878401+0000","last_active":"2023-11-28T11:53:44.886453+0000","last_peered":"2023-11-28T11:53:44.886453+0000","last_clean":"2023-11-28T11:53:44.886453+0000","last_became_active":"2023-11-28T11:53:44.877984+0000","last_became_peered":"2023-11-28T11:53:44.877984+0000","last_unstale":"2023-11-28T11:53:44.886453+0000","last_undegraded":"2023-11-28T11:53:44.886453+0000","last_fullsized":"2023-11-28T11:53:44.886453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:41.510014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865016+0000","last_change":"2023-11-28T11:53:40.828665+0000","last_active":"2023-11-28T11:53:44.865016+0000","last_peered":"2023-11-28T11:53:44.865016+0000","last_clean":"2023-11-28T11:53:44.865016+0000","last_became_active":"2023-11-28T11:53:40.828391+0000","last_became_peered":"2023-11-28T11:53:40.828391+0000","last_unstale":"2023-11-28T11:53:44.865016+0000","last_undegraded":"2023-11-28T11:53:44.865016+0000","last_fullsized":"2023-11-28T11:53:44.865016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:26:32.332628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859809+0000","last_change":"2023-11-28T11:53:40.443223+0000","last_active":"2023-11-28T11:53:44.859809+0000","last_peered":"2023-11-28T11:53:44.859809+0000","last_clean":"2023-11-28T11:53:44.859809+0000","last_became_active":"2023-11-28T11:53:40.442898+0000","last_became_peered":"2023-11-28T11:53:40.442898+0000","last_unstale":"2023-11-28T11:53:44.859809+0000","last_undegraded":"2023-11-28T11:53:44.859809+0000","last_fullsized":"2023-11-28T11:53:44.859809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:55.478609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.872465+0000","last_change":"2023-11-28T11:53:44.870670+0000","last_active":"2023-11-28T11:53:44.872465+0000","last_peered":"2023-11-28T11:53:44.872465+0000","last_clean":"2023-11-28T11:53:44.872465+0000","last_became_active":"2023-11-28T11:53:44.870011+0000","last_became_peered":"2023-11-28T11:53:44.870011+0000","last_unstale":"2023-11-28T11:53:44.872465+0000","last_undegraded":"2023-11-28T11:53:44.872465+0000","last_fullsized":"2023-11-28T11:53:44.872465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:17.214530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859908+0000","last_change":"2023-11-28T11:53:40.816472+0000","last_active":"2023-11-28T11:53:44.859908+0000","last_peered":"2023-11-28T11:53:44.859908+0000","last_clean":"2023-11-28T11:53:44.859908+0000","last_became_active":"2023-11-28T11:53:40.816159+0000","last_became_peered":"2023-11-28T11:53:40.816159+0000","last_unstale":"2023-11-28T11:53:44.859908+0000","last_undegraded":"2023-11-28T11:53:44.859908+0000","last_fullsized":"2023-11-28T11:53:44.859908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:38.089006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.869315+0000","last_change":"2023-11-28T11:53:40.450339+0000","last_active":"2023-11-28T11:53:44.869315+0000","last_peered":"2023-11-28T11:53:44.869315+0000","last_clean":"2023-11-28T11:53:44.869315+0000","last_became_active":"2023-11-28T11:53:40.450046+0000","last_became_peered":"2023-11-28T11:53:40.450046+0000","last_unstale":"2023-11-28T11:53:44.869315+0000","last_undegraded":"2023-11-28T11:53:44.869315+0000","last_fullsized":"2023-11-28T11:53:44.869315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:17.443093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.888530+0000","last_change":"2023-11-28T11:53:44.882874+0000","last_active":"2023-11-28T11:53:44.888530+0000","last_peered":"2023-11-28T11:53:44.888530+0000","last_clean":"2023-11-28T11:53:44.888530+0000","last_became_active":"2023-11-28T11:53:44.882175+0000","last_became_peered":"2023-11-28T11:53:44.882175+0000","last_unstale":"2023-11-28T11:53:44.888530+0000","last_undegraded":"2023-11-28T11:53:44.888530+0000","last_fullsized":"2023-11-28T11:53:44.888530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:53.340638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.851850+0000","last_change":"2023-11-28T11:53:40.826543+0000","last_active":"2023-11-28T11:53:44.851850+0000","last_peered":"2023-11-28T11:53:44.851850+0000","last_clean":"2023-11-28T11:53:44.851850+0000","last_became_active":"2023-11-28T11:53:40.826182+0000","last_became_peered":"2023-11-28T11:53:40.826182+0000","last_unstale":"2023-11-28T11:53:44.851850+0000","last_undegraded":"2023-11-28T11:53:44.851850+0000","last_fullsized":"2023-11-28T11:53:44.851850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:03:21.599961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.869691+0000","last_change":"2023-11-28T11:53:40.450402+0000","last_active":"2023-11-28T11:53:44.869691+0000","last_peered":"2023-11-28T11:53:44.869691+0000","last_clean":"2023-11-28T11:53:44.869691+0000","last_became_active":"2023-11-28T11:53:40.450094+0000","last_became_peered":"2023-11-28T11:53:40.450094+0000","last_unstale":"2023-11-28T11:53:44.869691+0000","last_undegraded":"2023-11-28T11:53:44.869691+0000","last_fullsized":"2023-11-28T11:53:44.869691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:35:19.888846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.886156+0000","last_change":"2023-11-28T11:53:44.882776+0000","last_active":"2023-11-28T11:53:44.886156+0000","last_peered":"2023-11-28T11:53:44.886156+0000","last_clean":"2023-11-28T11:53:44.886156+0000","last_became_active":"2023-11-28T11:53:44.880222+0000","last_became_peered":"2023-11-28T11:53:44.880222+0000","last_unstale":"2023-11-28T11:53:44.886156+0000","last_undegraded":"2023-11-28T11:53:44.886156+0000","last_fullsized":"2023-11-28T11:53:44.886156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:05.347162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.882471+0000","last_change":"2023-11-28T11:53:44.879327+0000","last_active":"2023-11-28T11:53:44.882471+0000","last_peered":"2023-11-28T11:53:44.882471+0000","last_clean":"2023-11-28T11:53:44.882471+0000","last_became_active":"2023-11-28T11:53:44.878937+0000","last_became_peered":"2023-11-28T11:53:44.878937+0000","last_unstale":"2023-11-28T11:53:44.882471+0000","last_undegraded":"2023-11-28T11:53:44.882471+0000","last_fullsized":"2023-11-28T11:53:44.882471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:37.024091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.864801+0000","last_change":"2023-11-28T11:53:40.437606+0000","last_active":"2023-11-28T11:53:44.864801+0000","last_peered":"2023-11-28T11:53:44.864801+0000","last_clean":"2023-11-28T11:53:44.864801+0000","last_became_active":"2023-11-28T11:53:40.436841+0000","last_became_peered":"2023-11-28T11:53:40.436841+0000","last_unstale":"2023-11-28T11:53:44.864801+0000","last_undegraded":"2023-11-28T11:53:44.864801+0000","last_fullsized":"2023-11-28T11:53:44.864801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:57.826127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.877919+0000","last_change":"2023-11-28T11:53:40.830708+0000","last_active":"2023-11-28T11:53:44.877919+0000","last_peered":"2023-11-28T11:53:44.877919+0000","last_clean":"2023-11-28T11:53:44.877919+0000","last_became_active":"2023-11-28T11:53:40.830408+0000","last_became_peered":"2023-11-28T11:53:40.830408+0000","last_unstale":"2023-11-28T11:53:44.877919+0000","last_undegraded":"2023-11-28T11:53:44.877919+0000","last_fullsized":"2023-11-28T11:53:44.877919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:03.251004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889061+0000","last_change":"2023-11-28T11:53:44.883220+0000","last_active":"2023-11-28T11:53:44.889061+0000","last_peered":"2023-11-28T11:53:44.889061+0000","last_clean":"2023-11-28T11:53:44.889061+0000","last_became_active":"2023-11-28T11:53:44.881046+0000","last_became_peered":"2023-11-28T11:53:44.881046+0000","last_unstale":"2023-11-28T11:53:44.889061+0000","last_undegraded":"2023-11-28T11:53:44.889061+0000","last_fullsized":"2023-11-28T11:53:44.889061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:54:59.674019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861290+0000","last_change":"2023-11-28T11:53:40.451361+0000","last_active":"2023-11-28T11:53:44.861290+0000","last_peered":"2023-11-28T11:53:44.861290+0000","last_clean":"2023-11-28T11:53:44.861290+0000","last_became_active":"2023-11-28T11:53:40.451055+0000","last_became_peered":"2023-11-28T11:53:40.451055+0000","last_unstale":"2023-11-28T11:53:44.861290+0000","last_undegraded":"2023-11-28T11:53:44.861290+0000","last_fullsized":"2023-11-28T11:53:44.861290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:00.300889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867430+0000","last_change":"2023-11-28T11:53:40.832925+0000","last_active":"2023-11-28T11:53:44.867430+0000","last_peered":"2023-11-28T11:53:44.867430+0000","last_clean":"2023-11-28T11:53:44.867430+0000","last_became_active":"2023-11-28T11:53:40.824344+0000","last_became_peered":"2023-11-28T11:53:40.824344+0000","last_unstale":"2023-11-28T11:53:44.867430+0000","last_undegraded":"2023-11-28T11:53:44.867430+0000","last_fullsized":"2023-11-28T11:53:44.867430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:07:13.206788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862637+0000","last_change":"2023-11-28T11:53:40.444858+0000","last_active":"2023-11-28T11:53:44.862637+0000","last_peered":"2023-11-28T11:53:44.862637+0000","last_clean":"2023-11-28T11:53:44.862637+0000","last_became_active":"2023-11-28T11:53:40.444494+0000","last_became_peered":"2023-11-28T11:53:40.444494+0000","last_unstale":"2023-11-28T11:53:44.862637+0000","last_undegraded":"2023-11-28T11:53:44.862637+0000","last_fullsized":"2023-11-28T11:53:44.862637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:41.874385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.854924+0000","last_change":"2023-11-28T11:53:40.826741+0000","last_active":"2023-11-28T11:53:44.854924+0000","last_peered":"2023-11-28T11:53:44.854924+0000","last_clean":"2023-11-28T11:53:44.854924+0000","last_became_active":"2023-11-28T11:53:40.826438+0000","last_became_peered":"2023-11-28T11:53:40.826438+0000","last_unstale":"2023-11-28T11:53:44.854924+0000","last_undegraded":"2023-11-28T11:53:44.854924+0000","last_fullsized":"2023-11-28T11:53:44.854924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.887781+0000","last_change":"2023-11-28T11:53:44.881841+0000","last_active":"2023-11-28T11:53:44.887781+0000","last_peered":"2023-11-28T11:53:44.887781+0000","last_clean":"2023-11-28T11:53:44.887781+0000","last_became_active":"2023-11-28T11:53:44.880886+0000","last_became_peered":"2023-11-28T11:53:44.880886+0000","last_unstale":"2023-11-28T11:53:44.887781+0000","last_undegraded":"2023-11-28T11:53:44.887781+0000","last_fullsized":"2023-11-28T11:53:44.887781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:09:31.123351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861943+0000","last_change":"2023-11-28T11:53:40.450777+0000","last_active":"2023-11-28T11:53:44.861943+0000","last_peered":"2023-11-28T11:53:44.861943+0000","last_clean":"2023-11-28T11:53:44.861943+0000","last_became_active":"2023-11-28T11:53:40.449763+0000","last_became_peered":"2023-11-28T11:53:40.449763+0000","last_unstale":"2023-11-28T11:53:44.861943+0000","last_undegraded":"2023-11-28T11:53:44.861943+0000","last_fullsized":"2023-11-28T11:53:44.861943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:19.967407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863452+0000","last_change":"2023-11-28T11:53:40.826209+0000","last_active":"2023-11-28T11:53:44.863452+0000","last_peered":"2023-11-28T11:53:44.863452+0000","last_clean":"2023-11-28T11:53:44.863452+0000","last_became_active":"2023-11-28T11:53:40.825734+0000","last_became_peered":"2023-11-28T11:53:40.825734+0000","last_unstale":"2023-11-28T11:53:44.863452+0000","last_undegraded":"2023-11-28T11:53:44.863452+0000","last_fullsized":"2023-11-28T11:53:44.863452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:06.929054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.881708+0000","last_change":"2023-11-28T11:53:44.877701+0000","last_active":"2023-11-28T11:53:44.881708+0000","last_peered":"2023-11-28T11:53:44.881708+0000","last_clean":"2023-11-28T11:53:44.881708+0000","last_became_active":"2023-11-28T11:53:44.877282+0000","last_became_peered":"2023-11-28T11:53:44.877282+0000","last_unstale":"2023-11-28T11:53:44.881708+0000","last_undegraded":"2023-11-28T11:53:44.881708+0000","last_fullsized":"2023-11-28T11:53:44.881708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:31.365757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.864694+0000","last_change":"2023-11-28T11:53:40.828450+0000","last_active":"2023-11-28T11:53:44.864694+0000","last_peered":"2023-11-28T11:53:44.864694+0000","last_clean":"2023-11-28T11:53:44.864694+0000","last_became_active":"2023-11-28T11:53:40.828013+0000","last_became_peered":"2023-11-28T11:53:40.828013+0000","last_unstale":"2023-11-28T11:53:44.864694+0000","last_undegraded":"2023-11-28T11:53:44.864694+0000","last_fullsized":"2023-11-28T11:53:44.864694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:56.490046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.875831+0000","last_change":"2023-11-28T11:53:40.830008+0000","last_active":"2023-11-28T11:53:44.875831+0000","last_peered":"2023-11-28T11:53:44.875831+0000","last_clean":"2023-11-28T11:53:44.875831+0000","last_became_active":"2023-11-28T11:53:40.829403+0000","last_became_peered":"2023-11-28T11:53:40.829403+0000","last_unstale":"2023-11-28T11:53:44.875831+0000","last_undegraded":"2023-11-28T11:53:44.875831+0000","last_fullsized":"2023-11-28T11:53:44.875831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:33.728842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860063+0000","last_change":"2023-11-28T11:53:40.822203+0000","last_active":"2023-11-28T11:53:44.860063+0000","last_peered":"2023-11-28T11:53:44.860063+0000","last_clean":"2023-11-28T11:53:44.860063+0000","last_became_active":"2023-11-28T11:53:40.821925+0000","last_became_peered":"2023-11-28T11:53:40.821925+0000","last_unstale":"2023-11-28T11:53:44.860063+0000","last_undegraded":"2023-11-28T11:53:44.860063+0000","last_fullsized":"2023-11-28T11:53:44.860063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:21:45.014606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861940+0000","last_change":"2023-11-28T11:53:40.831266+0000","last_active":"2023-11-28T11:53:44.861940+0000","last_peered":"2023-11-28T11:53:44.861940+0000","last_clean":"2023-11-28T11:53:44.861940+0000","last_became_active":"2023-11-28T11:53:40.830547+0000","last_became_peered":"2023-11-28T11:53:40.830547+0000","last_unstale":"2023-11-28T11:53:44.861940+0000","last_undegraded":"2023-11-28T11:53:44.861940+0000","last_fullsized":"2023-11-28T11:53:44.861940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:51.196033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873045+0000","last_change":"2023-11-28T11:53:40.820563+0000","last_active":"2023-11-28T11:53:44.873045+0000","last_peered":"2023-11-28T11:53:44.873045+0000","last_clean":"2023-11-28T11:53:44.873045+0000","last_became_active":"2023-11-28T11:53:40.820312+0000","last_became_peered":"2023-11-28T11:53:40.820312+0000","last_unstale":"2023-11-28T11:53:44.873045+0000","last_undegraded":"2023-11-28T11:53:44.873045+0000","last_fullsized":"2023-11-28T11:53:44.873045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:53:09.778935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.854790+0000","last_change":"2023-11-28T11:53:40.831601+0000","last_active":"2023-11-28T11:53:44.854790+0000","last_peered":"2023-11-28T11:53:44.854790+0000","last_clean":"2023-11-28T11:53:44.854790+0000","last_became_active":"2023-11-28T11:53:40.831307+0000","last_became_peered":"2023-11-28T11:53:40.831307+0000","last_unstale":"2023-11-28T11:53:44.854790+0000","last_undegraded":"2023-11-28T11:53:44.854790+0000","last_fullsized":"2023-11-28T11:53:44.854790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:58.623372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.876637+0000","last_change":"2023-11-28T11:53:40.829422+0000","last_active":"2023-11-28T11:53:44.876637+0000","last_peered":"2023-11-28T11:53:44.876637+0000","last_clean":"2023-11-28T11:53:44.876637+0000","last_became_active":"2023-11-28T11:53:40.829178+0000","last_became_peered":"2023-11-28T11:53:40.829178+0000","last_unstale":"2023-11-28T11:53:44.876637+0000","last_undegraded":"2023-11-28T11:53:44.876637+0000","last_fullsized":"2023-11-28T11:53:44.876637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:58.623372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.876529+0000","last_change":"2023-11-28T11:53:40.826723+0000","last_active":"2023-11-28T11:53:44.876529+0000","last_peered":"2023-11-28T11:53:44.876529+0000","last_clean":"2023-11-28T11:53:44.876529+0000","last_became_active":"2023-11-28T11:53:40.826291+0000","last_became_peered":"2023-11-28T11:53:40.826291+0000","last_unstale":"2023-11-28T11:53:44.876529+0000","last_undegraded":"2023-11-28T11:53:44.876529+0000","last_fullsized":"2023-11-28T11:53:44.876529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:04.735416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.858446+0000","last_change":"2023-11-28T11:53:40.825388+0000","last_active":"2023-11-28T11:53:44.858446+0000","last_peered":"2023-11-28T11:53:44.858446+0000","last_clean":"2023-11-28T11:53:44.858446+0000","last_became_active":"2023-11-28T11:53:40.823486+0000","last_became_peered":"2023-11-28T11:53:40.823486+0000","last_unstale":"2023-11-28T11:53:44.858446+0000","last_undegraded":"2023-11-28T11:53:44.858446+0000","last_fullsized":"2023-11-28T11:53:44.858446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:07:13.206788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862735+0000","last_change":"2023-11-28T11:53:40.834673+0000","last_active":"2023-11-28T11:53:44.862735+0000","last_peered":"2023-11-28T11:53:44.862735+0000","last_clean":"2023-11-28T11:53:44.862735+0000","last_became_active":"2023-11-28T11:53:40.834446+0000","last_became_peered":"2023-11-28T11:53:40.834446+0000","last_unstale":"2023-11-28T11:53:44.862735+0000","last_undegraded":"2023-11-28T11:53:44.862735+0000","last_fullsized":"2023-11-28T11:53:44.862735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:45:19.490164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862539+0000","last_change":"2023-11-28T11:53:40.823930+0000","last_active":"2023-11-28T11:53:44.862539+0000","last_peered":"2023-11-28T11:53:44.862539+0000","last_clean":"2023-11-28T11:53:44.862539+0000","last_became_active":"2023-11-28T11:53:40.823085+0000","last_became_peered":"2023-11-28T11:53:40.823085+0000","last_unstale":"2023-11-28T11:53:44.862539+0000","last_undegraded":"2023-11-28T11:53:44.862539+0000","last_fullsized":"2023-11-28T11:53:44.862539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:03.251004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861847+0000","last_change":"2023-11-28T11:53:40.825318+0000","last_active":"2023-11-28T11:53:44.861847+0000","last_peered":"2023-11-28T11:53:44.861847+0000","last_clean":"2023-11-28T11:53:44.861847+0000","last_became_active":"2023-11-28T11:53:40.823580+0000","last_became_peered":"2023-11-28T11:53:40.823580+0000","last_unstale":"2023-11-28T11:53:44.861847+0000","last_undegraded":"2023-11-28T11:53:44.861847+0000","last_fullsized":"2023-11-28T11:53:44.861847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:53.307980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859699+0000","last_change":"2023-11-28T11:53:40.822632+0000","last_active":"2023-11-28T11:53:44.859699+0000","last_peered":"2023-11-28T11:53:44.859699+0000","last_clean":"2023-11-28T11:53:44.859699+0000","last_became_active":"2023-11-28T11:53:40.822041+0000","last_became_peered":"2023-11-28T11:53:40.822041+0000","last_unstale":"2023-11-28T11:53:44.859699+0000","last_undegraded":"2023-11-28T11:53:44.859699+0000","last_fullsized":"2023-11-28T11:53:44.859699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:25.589109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.853050+0000","last_change":"2023-11-28T11:53:40.827422+0000","last_active":"2023-11-28T11:53:44.853050+0000","last_peered":"2023-11-28T11:53:44.853050+0000","last_clean":"2023-11-28T11:53:44.853050+0000","last_became_active":"2023-11-28T11:53:40.827049+0000","last_became_peered":"2023-11-28T11:53:40.827049+0000","last_unstale":"2023-11-28T11:53:44.853050+0000","last_undegraded":"2023-11-28T11:53:44.853050+0000","last_fullsized":"2023-11-28T11:53:44.853050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:40.317412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862710+0000","last_change":"2023-11-28T11:53:40.830609+0000","last_active":"2023-11-28T11:53:44.862710+0000","last_peered":"2023-11-28T11:53:44.862710+0000","last_clean":"2023-11-28T11:53:44.862710+0000","last_became_active":"2023-11-28T11:53:40.830049+0000","last_became_peered":"2023-11-28T11:53:40.830049+0000","last_unstale":"2023-11-28T11:53:44.862710+0000","last_undegraded":"2023-11-28T11:53:44.862710+0000","last_fullsized":"2023-11-28T11:53:44.862710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:39:08.352832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867744+0000","last_change":"2023-11-28T11:53:40.834235+0000","last_active":"2023-11-28T11:53:44.867744+0000","last_peered":"2023-11-28T11:53:44.867744+0000","last_clean":"2023-11-28T11:53:44.867744+0000","last_became_active":"2023-11-28T11:53:40.833501+0000","last_became_peered":"2023-11-28T11:53:40.833501+0000","last_unstale":"2023-11-28T11:53:44.867744+0000","last_undegraded":"2023-11-28T11:53:44.867744+0000","last_fullsized":"2023-11-28T11:53:44.867744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:12.417672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859262+0000","last_change":"2023-11-28T11:53:40.814201+0000","last_active":"2023-11-28T11:53:44.859262+0000","last_peered":"2023-11-28T11:53:44.859262+0000","last_clean":"2023-11-28T11:53:44.859262+0000","last_became_active":"2023-11-28T11:53:40.813798+0000","last_became_peered":"2023-11-28T11:53:40.813798+0000","last_unstale":"2023-11-28T11:53:44.859262+0000","last_undegraded":"2023-11-28T11:53:44.859262+0000","last_fullsized":"2023-11-28T11:53:44.859262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:49.919629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861214+0000","last_change":"2023-11-28T11:53:40.819145+0000","last_active":"2023-11-28T11:53:44.861214+0000","last_peered":"2023-11-28T11:53:44.861214+0000","last_clean":"2023-11-28T11:53:44.861214+0000","last_became_active":"2023-11-28T11:53:40.818894+0000","last_became_peered":"2023-11-28T11:53:40.818894+0000","last_unstale":"2023-11-28T11:53:44.861214+0000","last_undegraded":"2023-11-28T11:53:44.861214+0000","last_fullsized":"2023-11-28T11:53:44.861214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852149+0000","last_change":"2023-11-28T11:53:40.831922+0000","last_active":"2023-11-28T11:53:44.852149+0000","last_peered":"2023-11-28T11:53:44.852149+0000","last_clean":"2023-11-28T11:53:44.852149+0000","last_became_active":"2023-11-28T11:53:40.831309+0000","last_became_peered":"2023-11-28T11:53:40.831309+0000","last_unstale":"2023-11-28T11:53:44.852149+0000","last_undegraded":"2023-11-28T11:53:44.852149+0000","last_fullsized":"2023-11-28T11:53:44.852149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:53.307980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852158+0000","last_change":"2023-11-28T11:53:40.828525+0000","last_active":"2023-11-28T11:53:44.852158+0000","last_peered":"2023-11-28T11:53:44.852158+0000","last_clean":"2023-11-28T11:53:44.852158+0000","last_became_active":"2023-11-28T11:53:40.827088+0000","last_became_peered":"2023-11-28T11:53:40.827088+0000","last_unstale":"2023-11-28T11:53:44.852158+0000","last_undegraded":"2023-11-28T11:53:44.852158+0000","last_fullsized":"2023-11-28T11:53:44.852158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:42.885822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852234+0000","last_change":"2023-11-28T11:53:40.827903+0000","last_active":"2023-11-28T11:53:44.852234+0000","last_peered":"2023-11-28T11:53:44.852234+0000","last_clean":"2023-11-28T11:53:44.852234+0000","last_became_active":"2023-11-28T11:53:40.827630+0000","last_became_peered":"2023-11-28T11:53:40.827630+0000","last_unstale":"2023-11-28T11:53:44.852234+0000","last_undegraded":"2023-11-28T11:53:44.852234+0000","last_fullsized":"2023-11-28T11:53:44.852234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:20.978843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860656+0000","last_change":"2023-11-28T11:53:40.817481+0000","last_active":"2023-11-28T11:53:44.860656+0000","last_peered":"2023-11-28T11:53:44.860656+0000","last_clean":"2023-11-28T11:53:44.860656+0000","last_became_active":"2023-11-28T11:53:40.816901+0000","last_became_peered":"2023-11-28T11:53:40.816901+0000","last_unstale":"2023-11-28T11:53:44.860656+0000","last_undegraded":"2023-11-28T11:53:44.860656+0000","last_fullsized":"2023-11-28T11:53:44.860656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:57.213686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.853557+0000","last_change":"2023-11-28T11:53:40.826671+0000","last_active":"2023-11-28T11:53:44.853557+0000","last_peered":"2023-11-28T11:53:44.853557+0000","last_clean":"2023-11-28T11:53:44.853557+0000","last_became_active":"2023-11-28T11:53:40.826306+0000","last_became_peered":"2023-11-28T11:53:40.826306+0000","last_unstale":"2023-11-28T11:53:44.853557+0000","last_undegraded":"2023-11-28T11:53:44.853557+0000","last_fullsized":"2023-11-28T11:53:44.853557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:07:13.206788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867648+0000","last_change":"2023-11-28T11:53:40.834257+0000","last_active":"2023-11-28T11:53:44.867648+0000","last_peered":"2023-11-28T11:53:44.867648+0000","last_clean":"2023-11-28T11:53:44.867648+0000","last_became_active":"2023-11-28T11:53:40.833624+0000","last_became_peered":"2023-11-28T11:53:40.833624+0000","last_unstale":"2023-11-28T11:53:44.867648+0000","last_undegraded":"2023-11-28T11:53:44.867648+0000","last_fullsized":"2023-11-28T11:53:44.867648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:51.196033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.851513+0000","last_change":"2023-11-28T11:53:40.827595+0000","last_active":"2023-11-28T11:53:44.851513+0000","last_peered":"2023-11-28T11:53:44.851513+0000","last_clean":"2023-11-28T11:53:44.851513+0000","last_became_active":"2023-11-28T11:53:40.827244+0000","last_became_peered":"2023-11-28T11:53:40.827244+0000","last_unstale":"2023-11-28T11:53:44.851513+0000","last_undegraded":"2023-11-28T11:53:44.851513+0000","last_fullsized":"2023-11-28T11:53:44.851513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:12.417672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861137+0000","last_change":"2023-11-28T11:53:40.818652+0000","last_active":"2023-11-28T11:53:44.861137+0000","last_peered":"2023-11-28T11:53:44.861137+0000","last_clean":"2023-11-28T11:53:44.861137+0000","last_became_active":"2023-11-28T11:53:40.818359+0000","last_became_peered":"2023-11-28T11:53:40.818359+0000","last_unstale":"2023-11-28T11:53:44.861137+0000","last_undegraded":"2023-11-28T11:53:44.861137+0000","last_fullsized":"2023-11-28T11:53:44.861137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:58.623372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859346+0000","last_change":"2023-11-28T11:53:40.815826+0000","last_active":"2023-11-28T11:53:44.859346+0000","last_peered":"2023-11-28T11:53:44.859346+0000","last_clean":"2023-11-28T11:53:44.859346+0000","last_became_active":"2023-11-28T11:53:40.815568+0000","last_became_peered":"2023-11-28T11:53:40.815568+0000","last_unstale":"2023-11-28T11:53:44.859346+0000","last_undegraded":"2023-11-28T11:53:44.859346+0000","last_fullsized":"2023-11-28T11:53:44.859346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:07:42.533145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.868655+0000","last_change":"2023-11-28T11:53:40.832666+0000","last_active":"2023-11-28T11:53:44.868655+0000","last_peered":"2023-11-28T11:53:44.868655+0000","last_clean":"2023-11-28T11:53:44.868655+0000","last_became_active":"2023-11-28T11:53:40.823823+0000","last_became_peered":"2023-11-28T11:53:40.823823+0000","last_unstale":"2023-11-28T11:53:44.868655+0000","last_undegraded":"2023-11-28T11:53:44.868655+0000","last_fullsized":"2023-11-28T11:53:44.868655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:53.307980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.864534+0000","last_change":"2023-11-28T11:53:40.821057+0000","last_active":"2023-11-28T11:53:44.864534+0000","last_peered":"2023-11-28T11:53:44.864534+0000","last_clean":"2023-11-28T11:53:44.864534+0000","last_became_active":"2023-11-28T11:53:40.820709+0000","last_became_peered":"2023-11-28T11:53:40.820709+0000","last_unstale":"2023-11-28T11:53:44.864534+0000","last_undegraded":"2023-11-28T11:53:44.864534+0000","last_fullsized":"2023-11-28T11:53:44.864534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:01.312325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860193+0000","last_change":"2023-11-28T11:53:40.817645+0000","last_active":"2023-11-28T11:53:44.860193+0000","last_peered":"2023-11-28T11:53:44.860193+0000","last_clean":"2023-11-28T11:53:44.860193+0000","last_became_active":"2023-11-28T11:53:40.817205+0000","last_became_peered":"2023-11-28T11:53:40.817205+0000","last_unstale":"2023-11-28T11:53:44.860193+0000","last_undegraded":"2023-11-28T11:53:44.860193+0000","last_fullsized":"2023-11-28T11:53:44.860193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:45:19.490164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.853399+0000","last_change":"2023-11-28T11:53:40.826609+0000","last_active":"2023-11-28T11:53:44.853399+0000","last_peered":"2023-11-28T11:53:44.853399+0000","last_clean":"2023-11-28T11:53:44.853399+0000","last_became_active":"2023-11-28T11:53:40.826314+0000","last_became_peered":"2023-11-28T11:53:40.826314+0000","last_unstale":"2023-11-28T11:53:44.853399+0000","last_undegraded":"2023-11-28T11:53:44.853399+0000","last_fullsized":"2023-11-28T11:53:44.853399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:51.196033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.853274+0000","last_change":"2023-11-28T11:53:40.828425+0000","last_active":"2023-11-28T11:53:44.853274+0000","last_peered":"2023-11-28T11:53:44.853274+0000","last_clean":"2023-11-28T11:53:44.853274+0000","last_became_active":"2023-11-28T11:53:40.828140+0000","last_became_peered":"2023-11-28T11:53:40.828140+0000","last_unstale":"2023-11-28T11:53:44.853274+0000","last_undegraded":"2023-11-28T11:53:44.853274+0000","last_fullsized":"2023-11-28T11:53:44.853274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:55.927473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4527,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9256,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362584,"statfs":{"total":96636764160,"available":96627286016,"internally_reserved":0,"allocated":884736,"data_stored":703105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":108776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8148,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363692,"statfs":{"total":96636764160,"available":96628420608,"internally_reserved":0,"allocated":274432,"data_stored":110398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8224,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363616,"statfs":{"total":96636764160,"available":96628342784,"internally_reserved":0,"allocated":286720,"data_stored":113563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8140,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363700,"statfs":{"total":96636764160,"available":96628428800,"internally_reserved":0,"allocated":266240,"data_stored":108866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":108776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9232,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362608,"statfs":{"total":96636764160,"available":96627310592,"internally_reserved":0,"allocated":860160,"data_stored":700130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12240,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359600,"statfs":{"total":96636764160,"available":96624230400,"internally_reserved":0,"allocated":270336,"data_stored":110328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:54:08.127 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:54:08.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a9a431700 1 Processor -- start 2023-11-28T11:54:08.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a9a431700 1 -- start start 2023-11-28T11:54:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a9a431700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a9406a530 0x7f7a940cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a9a431700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a9406dc70 con 0x7f7a9406d7d0 2023-11-28T11:54:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a9a431700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a9415c6d0 con 0x7f7a940cf050 2023-11-28T11:54:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a9a431700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a940b5320 con 0x7f7a9406a530 2023-11-28T11:54:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a98c2e700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7a9406d7d0 0x7f7a940b4c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56506/0 (socket says 172.21.15.50:56506) 2023-11-28T11:54:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a98c2e700 1 -- 172.21.15.50:0/801752247 learned_addr learned my addr 172.21.15.50:0/801752247 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a99c30700 1 --2- 172.21.15.50:0/801752247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a9406a530 0x7f7a940cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a87fff700 1 -- 172.21.15.50:0/801752247 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782522619 0 0) 0x7f7a88001490 con 0x7f7a9406d7d0 2023-11-28T11:54:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a87fff700 1 -- 172.21.15.50:0/801752247 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a800035d0 con 0x7f7a9406d7d0 2023-11-28T11:54:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a87fff700 1 -- 172.21.15.50:0/801752247 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3696593658 0 0) 0x7f7a800035d0 con 0x7f7a9406d7d0 2023-11-28T11:54:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a87fff700 1 -- 172.21.15.50:0/801752247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a9406a530 msgr2=0x7f7a940cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a87fff700 1 --2- 172.21.15.50:0/801752247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a9406a530 0x7f7a940cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a87fff700 1 -- 172.21.15.50:0/801752247 >> v1:172.21.15.192:6789/0 conn(0x7f7a940cf050 legacy=0x7f7a940cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a87fff700 1 -- 172.21.15.50:0/801752247 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9406a9b0 con 0x7f7a9406d7d0 2023-11-28T11:54:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a87fff700 1 -- 172.21.15.50:0/801752247 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f7a88001b80 con 0x7f7a9406d7d0 2023-11-28T11:54:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a87fff700 1 -- 172.21.15.50:0/801752247 >> v1:172.21.15.50:6789/0 conn(0x7f7a9406d7d0 legacy=0x7f7a940b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a87fff700 1 --2- 172.21.15.50:0/801752247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a9406a530 0x7f7a80003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a87fff700 1 --2- 172.21.15.50:0/801752247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a80003fd0 0x7f7a80004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a87fff700 1 --2- 172.21.15.50:0/801752247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a80004db0 0x7f7a80005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a87fff700 1 -- 172.21.15.50:0/801752247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a940b5320 con 0x7f7a80003fd0 2023-11-28T11:54:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a87fff700 1 -- 172.21.15.50:0/801752247 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8000bbc0 con 0x7f7a80004db0 2023-11-28T11:54:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.232+0000 7f7a87fff700 1 -- 172.21.15.50:0/801752247 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8000bd80 con 0x7f7a9406a530 2023-11-28T11:54:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a98c2e700 1 --2- 172.21.15.50:0/801752247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a80003fd0 0x7f7a80004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a9942f700 1 --2- 172.21.15.50:0/801752247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a9406a530 0x7f7a80003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a99c30700 1 --2- 172.21.15.50:0/801752247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a80004db0 0x7f7a80005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a98c2e700 1 -- 172.21.15.50:0/801752247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a9406a530 msgr2=0x7f7a80003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a98c2e700 1 --2- 172.21.15.50:0/801752247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a9406a530 0x7f7a80003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a98c2e700 1 -- 172.21.15.50:0/801752247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a80004db0 msgr2=0x7f7a80005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a98c2e700 1 --2- 172.21.15.50:0/801752247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a80004db0 0x7f7a80005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a98c2e700 1 -- 172.21.15.50:0/801752247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a800035d0 con 0x7f7a80003fd0 2023-11-28T11:54:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a98c2e700 1 --2- 172.21.15.50:0/801752247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a80003fd0 0x7f7a80004870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800a800 tx=0x7f7a800058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd86e34def5201db server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a87fff700 1 -- 172.21.15.50:0/801752247 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8800a490 con 0x7f7a80003fd0 2023-11-28T11:54:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a87fff700 1 -- 172.21.15.50:0/801752247 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a880072d0 con 0x7f7a80003fd0 2023-11-28T11:54:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a87fff700 1 -- 172.21.15.50:0/801752247 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88007660 con 0x7f7a80003fd0 2023-11-28T11:54:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a9a431700 1 -- 172.21.15.50:0/801752247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a80003fd0 msgr2=0x7f7a80004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a9a431700 1 --2- 172.21.15.50:0/801752247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a80003fd0 0x7f7a80004870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800a800 tx=0x7f7a800058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a99c30700 1 -- 172.21.15.50:0/801752247 reap_dead start 2023-11-28T11:54:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a9a431700 1 -- 172.21.15.50:0/801752247 shutdown_connections 2023-11-28T11:54:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a9a431700 1 -- 172.21.15.50:0/801752247 >> 172.21.15.50:0/801752247 conn(0x7f7a9409bb30 msgr2=0x7f7a940b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a9a431700 1 -- 172.21.15.50:0/801752247 shutdown_connections 2023-11-28T11:54:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.236+0000 7f7a9a431700 1 -- 172.21.15.50:0/801752247 wait complete. 2023-11-28T11:54:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.240+0000 7f7a9a431700 1 Processor -- start 2023-11-28T11:54:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.240+0000 7f7a9a431700 1 -- start start 2023-11-28T11:54:08.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.240+0000 7f7a9a431700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a941f1590 0x7f7a940b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.240+0000 7f7a9a431700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a941f1960 0x7f7a940b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.240+0000 7f7a9a431700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a941f5390 0x7f7a941f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.240+0000 7f7a9a431700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a941594f0 con 0x7f7a941f1960 2023-11-28T11:54:08.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.240+0000 7f7a9a431700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a941f5d40 con 0x7f7a941f5390 2023-11-28T11:54:08.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.240+0000 7f7a9a431700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a941f6250 con 0x7f7a941f1590 2023-11-28T11:54:08.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.240+0000 7f7a98c2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a941f1960 0x7f7a940b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.240+0000 7f7a98c2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a941f1960 0x7f7a940b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53602/0 (socket says 172.21.15.50:53602) 2023-11-28T11:54:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.240+0000 7f7a98c2e700 1 -- 172.21.15.50:0/197907107 learned_addr learned my addr 172.21.15.50:0/197907107 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.240+0000 7f7a9942f700 1 --2- 172.21.15.50:0/197907107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a941f1590 0x7f7a940b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.240+0000 7f7a99c30700 1 --2- 172.21.15.50:0/197907107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a941f5390 0x7f7a941f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.244+0000 7f7a98c2e700 1 -- 172.21.15.50:0/197907107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a941f1590 msgr2=0x7f7a940b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.244+0000 7f7a98c2e700 1 --2- 172.21.15.50:0/197907107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a941f1590 0x7f7a940b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.244+0000 7f7a98c2e700 1 -- 172.21.15.50:0/197907107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a941f5390 msgr2=0x7f7a941f5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.244+0000 7f7a98c2e700 1 --2- 172.21.15.50:0/197907107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a941f5390 0x7f7a941f5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.244+0000 7f7a98c2e700 1 -- 172.21.15.50:0/197907107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9406af40 con 0x7f7a941f1960 2023-11-28T11:54:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.244+0000 7f7a98c2e700 1 --2- 172.21.15.50:0/197907107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a941f1960 0x7f7a940b11e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7a80005830 tx=0x7f7a88001f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.244+0000 7f7a85ffb700 1 -- 172.21.15.50:0/197907107 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88001f80 con 0x7f7a941f1960 2023-11-28T11:54:08.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.244+0000 7f7a85ffb700 1 -- 172.21.15.50:0/197907107 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a88001940 con 0x7f7a941f1960 2023-11-28T11:54:08.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.244+0000 7f7a9a431700 1 -- 172.21.15.50:0/197907107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a9406ac60 con 0x7f7a941f1960 2023-11-28T11:54:08.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.244+0000 7f7a85ffb700 1 -- 172.21.15.50:0/197907107 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88012400 con 0x7f7a941f1960 2023-11-28T11:54:08.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.244+0000 7f7a9a431700 1 -- 172.21.15.50:0/197907107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a940b4410 con 0x7f7a941f1960 2023-11-28T11:54:08.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.244+0000 7f7a9a431700 1 -- 172.21.15.50:0/197907107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a940b29b0 con 0x7f7a941f1960 2023-11-28T11:54:08.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.244+0000 7f7a85ffb700 1 -- 172.21.15.50:0/197907107 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7a88010070 con 0x7f7a941f1960 2023-11-28T11:54:08.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.244+0000 7f7a85ffb700 1 --2- 172.21.15.50:0/197907107 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7a78064ee0 0x7f7a78067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.244+0000 7f7a85ffb700 1 -- 172.21.15.50:0/197907107 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7a88083a70 con 0x7f7a941f1960 2023-11-28T11:54:08.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.244+0000 7f7a9942f700 1 --2- 172.21.15.50:0/197907107 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7a78064ee0 0x7f7a78067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.244+0000 7f7a9942f700 1 --2- 172.21.15.50:0/197907107 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7a78064ee0 0x7f7a78067390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7a90000c00 tx=0x7f7a90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.252+0000 7f7a85ffb700 1 -- 172.21.15.50:0/197907107 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7a88051920 con 0x7f7a941f1960 2023-11-28T11:54:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.404+0000 7f7a9a431700 1 -- 172.21.15.50:0/197907107 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a9406dc70 con 0x7f7a78064ee0 2023-11-28T11:54:08.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.420+0000 7f7a85ffb700 1 -- 172.21.15.50:0/197907107 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367546 (secure 0 0 0) 0x7f7a9406dc70 con 0x7f7a78064ee0 2023-11-28T11:54:08.430 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.428+0000 7f7a9a431700 1 -- 172.21.15.50:0/197907107 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7a78064ee0 msgr2=0x7f7a78067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.428+0000 7f7a9a431700 1 --2- 172.21.15.50:0/197907107 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7a78064ee0 0x7f7a78067390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7a90000c00 tx=0x7f7a90009040 comp rx=0 tx=0).stop 2023-11-28T11:54:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.428+0000 7f7a9a431700 1 -- 172.21.15.50:0/197907107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a941f1960 msgr2=0x7f7a940b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.428+0000 7f7a9a431700 1 --2- 172.21.15.50:0/197907107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a941f1960 0x7f7a940b11e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7a80005830 tx=0x7f7a88001f10 comp rx=0 tx=0).stop 2023-11-28T11:54:08.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.428+0000 7f7a9a431700 1 -- 172.21.15.50:0/197907107 shutdown_connections 2023-11-28T11:54:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.428+0000 7f7a9a431700 1 --2- 172.21.15.50:0/197907107 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7a78064ee0 0x7f7a78067390 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.428+0000 7f7a9a431700 1 --2- 172.21.15.50:0/197907107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a941f5390 0x7f7a941f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.428+0000 7f7a9a431700 1 --2- 172.21.15.50:0/197907107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a941f1960 0x7f7a940b11e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.428+0000 7f7a9a431700 1 --2- 172.21.15.50:0/197907107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a941f1590 0x7f7a940b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.428+0000 7f7a9a431700 1 -- 172.21.15.50:0/197907107 >> 172.21.15.50:0/197907107 conn(0x7f7a9409bb30 msgr2=0x7f7a940b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.428+0000 7f7a9a431700 1 -- 172.21.15.50:0/197907107 shutdown_connections 2023-11-28T11:54:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.428+0000 7f7a9a431700 1 -- 172.21.15.50:0/197907107 wait complete. 2023-11-28T11:54:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:54:08.447 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-11-28T11:54:06.868689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594895,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71384,"kb_used_data":3288,"kb_used_omap":0,"kb_used_meta":68032,"kb_avail":754903336,"statfs":{"total":773094113280,"available":773021016064,"internally_reserved":0,"allocated":3366912,"data_stored":2063942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69664768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005675"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889694+0000","last_change":"2023-11-28T11:53:44.882435+0000","last_active":"2023-11-28T11:53:44.889694+0000","last_peered":"2023-11-28T11:53:44.889694+0000","last_clean":"2023-11-28T11:53:44.889694+0000","last_became_active":"2023-11-28T11:53:44.882048+0000","last_became_peered":"2023-11-28T11:53:44.882048+0000","last_unstale":"2023-11-28T11:53:44.889694+0000","last_undegraded":"2023-11-28T11:53:44.889694+0000","last_fullsized":"2023-11-28T11:53:44.889694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:05.347162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867841+0000","last_change":"2023-11-28T11:53:40.436343+0000","last_active":"2023-11-28T11:53:44.867841+0000","last_peered":"2023-11-28T11:53:44.867841+0000","last_clean":"2023-11-28T11:53:44.867841+0000","last_became_active":"2023-11-28T11:53:40.435879+0000","last_became_peered":"2023-11-28T11:53:40.435879+0000","last_unstale":"2023-11-28T11:53:44.867841+0000","last_undegraded":"2023-11-28T11:53:44.867841+0000","last_fullsized":"2023-11-28T11:53:44.867841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:00.300889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859343+0000","last_change":"2023-11-28T11:53:40.821925+0000","last_active":"2023-11-28T11:53:44.859343+0000","last_peered":"2023-11-28T11:53:44.859343+0000","last_clean":"2023-11-28T11:53:44.859343+0000","last_became_active":"2023-11-28T11:53:40.821597+0000","last_became_peered":"2023-11-28T11:53:40.821597+0000","last_unstale":"2023-11-28T11:53:44.859343+0000","last_undegraded":"2023-11-28T11:53:44.859343+0000","last_fullsized":"2023-11-28T11:53:44.859343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:23.875985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.880793+0000","last_change":"2023-11-28T11:53:44.875925+0000","last_active":"2023-11-28T11:53:44.880793+0000","last_peered":"2023-11-28T11:53:44.880793+0000","last_clean":"2023-11-28T11:53:44.880793+0000","last_became_active":"2023-11-28T11:53:44.875558+0000","last_became_peered":"2023-11-28T11:53:44.875558+0000","last_unstale":"2023-11-28T11:53:44.880793+0000","last_undegraded":"2023-11-28T11:53:44.880793+0000","last_fullsized":"2023-11-28T11:53:44.880793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:12.753046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863282+0000","last_change":"2023-11-28T11:53:40.441515+0000","last_active":"2023-11-28T11:53:44.863282+0000","last_peered":"2023-11-28T11:53:44.863282+0000","last_clean":"2023-11-28T11:53:44.863282+0000","last_became_active":"2023-11-28T11:53:40.441208+0000","last_became_peered":"2023-11-28T11:53:40.441208+0000","last_unstale":"2023-11-28T11:53:44.863282+0000","last_undegraded":"2023-11-28T11:53:44.863282+0000","last_fullsized":"2023-11-28T11:53:44.863282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:35:19.888846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862872+0000","last_change":"2023-11-28T11:53:40.830197+0000","last_active":"2023-11-28T11:53:44.862872+0000","last_peered":"2023-11-28T11:53:44.862872+0000","last_clean":"2023-11-28T11:53:44.862872+0000","last_became_active":"2023-11-28T11:53:40.829740+0000","last_became_peered":"2023-11-28T11:53:40.829740+0000","last_unstale":"2023-11-28T11:53:44.862872+0000","last_undegraded":"2023-11-28T11:53:44.862872+0000","last_fullsized":"2023-11-28T11:53:44.862872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:38.089006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873088+0000","last_change":"2023-11-28T11:53:44.870606+0000","last_active":"2023-11-28T11:53:44.873088+0000","last_peered":"2023-11-28T11:53:44.873088+0000","last_clean":"2023-11-28T11:53:44.873088+0000","last_became_active":"2023-11-28T11:53:44.870208+0000","last_became_peered":"2023-11-28T11:53:44.870208+0000","last_unstale":"2023-11-28T11:53:44.873088+0000","last_undegraded":"2023-11-28T11:53:44.873088+0000","last_fullsized":"2023-11-28T11:53:44.873088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:09:00.740331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.855028+0000","last_change":"2023-11-28T11:53:40.448313+0000","last_active":"2023-11-28T11:53:44.855028+0000","last_peered":"2023-11-28T11:53:44.855028+0000","last_clean":"2023-11-28T11:53:44.855028+0000","last_became_active":"2023-11-28T11:53:40.448063+0000","last_became_peered":"2023-11-28T11:53:40.448063+0000","last_unstale":"2023-11-28T11:53:44.855028+0000","last_undegraded":"2023-11-28T11:53:44.855028+0000","last_fullsized":"2023-11-28T11:53:44.855028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:39.305975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859973+0000","last_change":"2023-11-28T11:53:40.820453+0000","last_active":"2023-11-28T11:53:44.859973+0000","last_peered":"2023-11-28T11:53:44.859973+0000","last_clean":"2023-11-28T11:53:44.859973+0000","last_became_active":"2023-11-28T11:53:40.820114+0000","last_became_peered":"2023-11-28T11:53:40.820114+0000","last_unstale":"2023-11-28T11:53:44.859973+0000","last_undegraded":"2023-11-28T11:53:44.859973+0000","last_fullsized":"2023-11-28T11:53:44.859973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:07:13.206788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.880082+0000","last_change":"2023-11-28T11:53:44.877852+0000","last_active":"2023-11-28T11:53:44.880082+0000","last_peered":"2023-11-28T11:53:44.880082+0000","last_clean":"2023-11-28T11:53:44.880082+0000","last_became_active":"2023-11-28T11:53:44.877334+0000","last_became_peered":"2023-11-28T11:53:44.877334+0000","last_unstale":"2023-11-28T11:53:44.880082+0000","last_undegraded":"2023-11-28T11:53:44.880082+0000","last_fullsized":"2023-11-28T11:53:44.880082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:29.010118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852090+0000","last_change":"2023-11-28T11:53:40.450034+0000","last_active":"2023-11-28T11:53:44.852090+0000","last_peered":"2023-11-28T11:53:44.852090+0000","last_clean":"2023-11-28T11:53:44.852090+0000","last_became_active":"2023-11-28T11:53:40.449802+0000","last_became_peered":"2023-11-28T11:53:40.449802+0000","last_unstale":"2023-11-28T11:53:44.852090+0000","last_undegraded":"2023-11-28T11:53:44.852090+0000","last_fullsized":"2023-11-28T11:53:44.852090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:41.874385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859657+0000","last_change":"2023-11-28T11:53:40.822841+0000","last_active":"2023-11-28T11:53:44.859657+0000","last_peered":"2023-11-28T11:53:44.859657+0000","last_clean":"2023-11-28T11:53:44.859657+0000","last_became_active":"2023-11-28T11:53:40.822586+0000","last_became_peered":"2023-11-28T11:53:40.822586+0000","last_unstale":"2023-11-28T11:53:44.859657+0000","last_undegraded":"2023-11-28T11:53:44.859657+0000","last_fullsized":"2023-11-28T11:53:44.859657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:03.251004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889865+0000","last_change":"2023-11-28T11:53:44.883848+0000","last_active":"2023-11-28T11:53:44.889865+0000","last_peered":"2023-11-28T11:53:44.889865+0000","last_clean":"2023-11-28T11:53:44.889865+0000","last_became_active":"2023-11-28T11:53:44.883452+0000","last_became_peered":"2023-11-28T11:53:44.883452+0000","last_unstale":"2023-11-28T11:53:44.889865+0000","last_undegraded":"2023-11-28T11:53:44.889865+0000","last_fullsized":"2023-11-28T11:53:44.889865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:38.035586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.869040+0000","last_change":"2023-11-28T11:53:40.449747+0000","last_active":"2023-11-28T11:53:44.869040+0000","last_peered":"2023-11-28T11:53:44.869040+0000","last_clean":"2023-11-28T11:53:44.869040+0000","last_became_active":"2023-11-28T11:53:40.449347+0000","last_became_peered":"2023-11-28T11:53:40.449347+0000","last_unstale":"2023-11-28T11:53:44.869040+0000","last_undegraded":"2023-11-28T11:53:44.869040+0000","last_fullsized":"2023-11-28T11:53:44.869040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:54.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852330+0000","last_change":"2023-11-28T11:53:40.827861+0000","last_active":"2023-11-28T11:53:44.852330+0000","last_peered":"2023-11-28T11:53:44.852330+0000","last_clean":"2023-11-28T11:53:44.852330+0000","last_became_active":"2023-11-28T11:53:40.827614+0000","last_became_peered":"2023-11-28T11:53:40.827614+0000","last_unstale":"2023-11-28T11:53:44.852330+0000","last_undegraded":"2023-11-28T11:53:44.852330+0000","last_fullsized":"2023-11-28T11:53:44.852330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:01.312325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.883955+0000","last_change":"2023-11-28T11:53:44.880640+0000","last_active":"2023-11-28T11:53:44.883955+0000","last_peered":"2023-11-28T11:53:44.883955+0000","last_clean":"2023-11-28T11:53:44.883955+0000","last_became_active":"2023-11-28T11:53:44.880247+0000","last_became_peered":"2023-11-28T11:53:44.880247+0000","last_unstale":"2023-11-28T11:53:44.883955+0000","last_undegraded":"2023-11-28T11:53:44.883955+0000","last_fullsized":"2023-11-28T11:53:44.883955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:51:39.277759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860162+0000","last_change":"2023-11-28T11:53:40.448452+0000","last_active":"2023-11-28T11:53:44.860162+0000","last_peered":"2023-11-28T11:53:44.860162+0000","last_clean":"2023-11-28T11:53:44.860162+0000","last_became_active":"2023-11-28T11:53:40.448154+0000","last_became_peered":"2023-11-28T11:53:40.448154+0000","last_unstale":"2023-11-28T11:53:44.860162+0000","last_undegraded":"2023-11-28T11:53:44.860162+0000","last_fullsized":"2023-11-28T11:53:44.860162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:41.874385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863052+0000","last_change":"2023-11-28T11:53:40.825987+0000","last_active":"2023-11-28T11:53:44.863052+0000","last_peered":"2023-11-28T11:53:44.863052+0000","last_clean":"2023-11-28T11:53:44.863052+0000","last_became_active":"2023-11-28T11:53:40.825706+0000","last_became_peered":"2023-11-28T11:53:40.825706+0000","last_unstale":"2023-11-28T11:53:44.863052+0000","last_undegraded":"2023-11-28T11:53:44.863052+0000","last_fullsized":"2023-11-28T11:53:44.863052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:27:28.269321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.886243+0000","last_change":"2023-11-28T11:53:44.883030+0000","last_active":"2023-11-28T11:53:44.886243+0000","last_peered":"2023-11-28T11:53:44.886243+0000","last_clean":"2023-11-28T11:53:44.886243+0000","last_became_active":"2023-11-28T11:53:44.882675+0000","last_became_peered":"2023-11-28T11:53:44.882675+0000","last_unstale":"2023-11-28T11:53:44.886243+0000","last_undegraded":"2023-11-28T11:53:44.886243+0000","last_fullsized":"2023-11-28T11:53:44.886243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:07:45.954153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.872964+0000","last_change":"2023-11-28T11:53:40.448373+0000","last_active":"2023-11-28T11:53:44.872964+0000","last_peered":"2023-11-28T11:53:44.872964+0000","last_clean":"2023-11-28T11:53:44.872964+0000","last_became_active":"2023-11-28T11:53:40.448029+0000","last_became_peered":"2023-11-28T11:53:40.448029+0000","last_unstale":"2023-11-28T11:53:44.872964+0000","last_undegraded":"2023-11-28T11:53:44.872964+0000","last_fullsized":"2023-11-28T11:53:44.872964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:57.826127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867262+0000","last_change":"2023-11-28T11:53:40.833512+0000","last_active":"2023-11-28T11:53:44.867262+0000","last_peered":"2023-11-28T11:53:44.867262+0000","last_clean":"2023-11-28T11:53:44.867262+0000","last_became_active":"2023-11-28T11:53:40.833244+0000","last_became_peered":"2023-11-28T11:53:40.833244+0000","last_unstale":"2023-11-28T11:53:44.867262+0000","last_undegraded":"2023-11-28T11:53:44.867262+0000","last_fullsized":"2023-11-28T11:53:44.867262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:58.623372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889172+0000","last_change":"2023-11-28T11:53:44.881845+0000","last_active":"2023-11-28T11:53:44.889172+0000","last_peered":"2023-11-28T11:53:44.889172+0000","last_clean":"2023-11-28T11:53:44.889172+0000","last_became_active":"2023-11-28T11:53:44.881453+0000","last_became_peered":"2023-11-28T11:53:44.881453+0000","last_unstale":"2023-11-28T11:53:44.889172+0000","last_undegraded":"2023-11-28T11:53:44.889172+0000","last_fullsized":"2023-11-28T11:53:44.889172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:41:45.095803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861569+0000","last_change":"2023-11-28T11:53:40.440029+0000","last_active":"2023-11-28T11:53:44.861569+0000","last_peered":"2023-11-28T11:53:44.861569+0000","last_clean":"2023-11-28T11:53:44.861569+0000","last_became_active":"2023-11-28T11:53:40.439844+0000","last_became_peered":"2023-11-28T11:53:40.439844+0000","last_unstale":"2023-11-28T11:53:44.861569+0000","last_undegraded":"2023-11-28T11:53:44.861569+0000","last_fullsized":"2023-11-28T11:53:44.861569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:00.300889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865451+0000","last_change":"2023-11-28T11:53:40.827603+0000","last_active":"2023-11-28T11:53:44.865451+0000","last_peered":"2023-11-28T11:53:44.865451+0000","last_clean":"2023-11-28T11:53:44.865451+0000","last_became_active":"2023-11-28T11:53:40.827305+0000","last_became_peered":"2023-11-28T11:53:40.827305+0000","last_unstale":"2023-11-28T11:53:44.865451+0000","last_undegraded":"2023-11-28T11:53:44.865451+0000","last_fullsized":"2023-11-28T11:53:44.865451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:06.422936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861418+0000","last_change":"2023-11-28T11:53:40.825931+0000","last_active":"2023-11-28T11:53:44.861418+0000","last_peered":"2023-11-28T11:53:44.861418+0000","last_clean":"2023-11-28T11:53:44.861418+0000","last_became_active":"2023-11-28T11:53:40.825661+0000","last_became_peered":"2023-11-28T11:53:40.825661+0000","last_unstale":"2023-11-28T11:53:44.861418+0000","last_undegraded":"2023-11-28T11:53:44.861418+0000","last_fullsized":"2023-11-28T11:53:44.861418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.868397+0000","last_change":"2023-11-28T11:53:40.435820+0000","last_active":"2023-11-28T11:53:44.868397+0000","last_peered":"2023-11-28T11:53:44.868397+0000","last_clean":"2023-11-28T11:53:44.868397+0000","last_became_active":"2023-11-28T11:53:40.435413+0000","last_became_peered":"2023-11-28T11:53:40.435413+0000","last_unstale":"2023-11-28T11:53:44.868397+0000","last_undegraded":"2023-11-28T11:53:44.868397+0000","last_fullsized":"2023-11-28T11:53:44.868397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:39.305975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.882057+0000","last_change":"2023-11-28T11:53:44.878777+0000","last_active":"2023-11-28T11:53:44.882057+0000","last_peered":"2023-11-28T11:53:44.882057+0000","last_clean":"2023-11-28T11:53:44.882057+0000","last_became_active":"2023-11-28T11:53:44.878407+0000","last_became_peered":"2023-11-28T11:53:44.878407+0000","last_unstale":"2023-11-28T11:53:44.882057+0000","last_undegraded":"2023-11-28T11:53:44.882057+0000","last_fullsized":"2023-11-28T11:53:44.882057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:17.214530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862966+0000","last_change":"2023-11-28T11:53:40.831099+0000","last_active":"2023-11-28T11:53:44.862966+0000","last_peered":"2023-11-28T11:53:44.862966+0000","last_clean":"2023-11-28T11:53:44.862966+0000","last_became_active":"2023-11-28T11:53:40.830838+0000","last_became_peered":"2023-11-28T11:53:40.830838+0000","last_unstale":"2023-11-28T11:53:44.862966+0000","last_undegraded":"2023-11-28T11:53:44.862966+0000","last_fullsized":"2023-11-28T11:53:44.862966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:49.919629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.854355+0000","last_change":"2023-11-28T11:53:40.443966+0000","last_active":"2023-11-28T11:53:44.854355+0000","last_peered":"2023-11-28T11:53:44.854355+0000","last_clean":"2023-11-28T11:53:44.854355+0000","last_became_active":"2023-11-28T11:53:40.443553+0000","last_became_peered":"2023-11-28T11:53:40.443553+0000","last_unstale":"2023-11-28T11:53:44.854355+0000","last_undegraded":"2023-11-28T11:53:44.854355+0000","last_fullsized":"2023-11-28T11:53:44.854355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:19.967407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.879723+0000","last_change":"2023-11-28T11:53:44.874157+0000","last_active":"2023-11-28T11:53:44.879723+0000","last_peered":"2023-11-28T11:53:44.879723+0000","last_clean":"2023-11-28T11:53:44.879723+0000","last_became_active":"2023-11-28T11:53:44.873721+0000","last_became_peered":"2023-11-28T11:53:44.873721+0000","last_unstale":"2023-11-28T11:53:44.879723+0000","last_undegraded":"2023-11-28T11:53:44.879723+0000","last_fullsized":"2023-11-28T11:53:44.879723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:38.035586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859711+0000","last_change":"2023-11-28T11:53:40.443961+0000","last_active":"2023-11-28T11:53:44.859711+0000","last_peered":"2023-11-28T11:53:44.859711+0000","last_clean":"2023-11-28T11:53:44.859711+0000","last_became_active":"2023-11-28T11:53:40.443600+0000","last_became_peered":"2023-11-28T11:53:40.443600+0000","last_unstale":"2023-11-28T11:53:44.859711+0000","last_undegraded":"2023-11-28T11:53:44.859711+0000","last_fullsized":"2023-11-28T11:53:44.859711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:40:05.411499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873244+0000","last_change":"2023-11-28T11:53:40.823833+0000","last_active":"2023-11-28T11:53:44.873244+0000","last_peered":"2023-11-28T11:53:44.873244+0000","last_clean":"2023-11-28T11:53:44.873244+0000","last_became_active":"2023-11-28T11:53:40.823583+0000","last_became_peered":"2023-11-28T11:53:40.823583+0000","last_unstale":"2023-11-28T11:53:44.873244+0000","last_undegraded":"2023-11-28T11:53:44.873244+0000","last_fullsized":"2023-11-28T11:53:44.873244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:18.454529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889155+0000","last_change":"2023-11-28T11:53:44.886943+0000","last_active":"2023-11-28T11:53:44.889155+0000","last_peered":"2023-11-28T11:53:44.889155+0000","last_clean":"2023-11-28T11:53:44.889155+0000","last_became_active":"2023-11-28T11:53:44.884458+0000","last_became_peered":"2023-11-28T11:53:44.884458+0000","last_unstale":"2023-11-28T11:53:44.889155+0000","last_undegraded":"2023-11-28T11:53:44.889155+0000","last_fullsized":"2023-11-28T11:53:44.889155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:09:00.740331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T11:53:49.771859+0000","last_change":"2023-11-28T11:53:40.445841+0000","last_active":"2023-11-28T11:53:49.771859+0000","last_peered":"2023-11-28T11:53:49.771859+0000","last_clean":"2023-11-28T11:53:49.771859+0000","last_became_active":"2023-11-28T11:53:40.445170+0000","last_became_peered":"2023-11-28T11:53:40.445170+0000","last_unstale":"2023-11-28T11:53:49.771859+0000","last_undegraded":"2023-11-28T11:53:49.771859+0000","last_fullsized":"2023-11-28T11:53:49.771859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:39.305975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859738+0000","last_change":"2023-11-28T11:53:40.822601+0000","last_active":"2023-11-28T11:53:44.859738+0000","last_peered":"2023-11-28T11:53:44.859738+0000","last_clean":"2023-11-28T11:53:44.859738+0000","last_became_active":"2023-11-28T11:53:40.822327+0000","last_became_peered":"2023-11-28T11:53:40.822327+0000","last_unstale":"2023-11-28T11:53:44.859738+0000","last_undegraded":"2023-11-28T11:53:44.859738+0000","last_fullsized":"2023-11-28T11:53:44.859738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:06.929054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889658+0000","last_change":"2023-11-28T11:53:44.881520+0000","last_active":"2023-11-28T11:53:44.889658+0000","last_peered":"2023-11-28T11:53:44.889658+0000","last_clean":"2023-11-28T11:53:44.889658+0000","last_became_active":"2023-11-28T11:53:44.881135+0000","last_became_peered":"2023-11-28T11:53:44.881135+0000","last_unstale":"2023-11-28T11:53:44.889658+0000","last_undegraded":"2023-11-28T11:53:44.889658+0000","last_fullsized":"2023-11-28T11:53:44.889658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:53:27.296993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873318+0000","last_change":"2023-11-28T11:53:40.833933+0000","last_active":"2023-11-28T11:53:44.873318+0000","last_peered":"2023-11-28T11:53:44.873318+0000","last_clean":"2023-11-28T11:53:44.873318+0000","last_became_active":"2023-11-28T11:53:40.833658+0000","last_became_peered":"2023-11-28T11:53:40.833658+0000","last_unstale":"2023-11-28T11:53:44.873318+0000","last_undegraded":"2023-11-28T11:53:44.873318+0000","last_fullsized":"2023-11-28T11:53:44.873318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:57.215796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865519+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:53:44.865519+0000","last_peered":"2023-11-28T11:53:44.865519+0000","last_clean":"2023-11-28T11:53:44.865519+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:53:44.865519+0000","last_undegraded":"2023-11-28T11:53:44.865519+0000","last_fullsized":"2023-11-28T11:53:44.865519+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.855082+0000","last_change":"2023-11-28T11:53:40.441530+0000","last_active":"2023-11-28T11:53:44.855082+0000","last_peered":"2023-11-28T11:53:44.855082+0000","last_clean":"2023-11-28T11:53:44.855082+0000","last_became_active":"2023-11-28T11:53:40.441317+0000","last_became_peered":"2023-11-28T11:53:40.441317+0000","last_unstale":"2023-11-28T11:53:44.855082+0000","last_undegraded":"2023-11-28T11:53:44.855082+0000","last_fullsized":"2023-11-28T11:53:44.855082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:54.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889193+0000","last_change":"2023-11-28T11:53:44.882186+0000","last_active":"2023-11-28T11:53:44.889193+0000","last_peered":"2023-11-28T11:53:44.889193+0000","last_clean":"2023-11-28T11:53:44.889193+0000","last_became_active":"2023-11-28T11:53:44.881794+0000","last_became_peered":"2023-11-28T11:53:44.881794+0000","last_unstale":"2023-11-28T11:53:44.889193+0000","last_undegraded":"2023-11-28T11:53:44.889193+0000","last_fullsized":"2023-11-28T11:53:44.889193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:05.347162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.868559+0000","last_change":"2023-11-28T11:53:40.836155+0000","last_active":"2023-11-28T11:53:44.868559+0000","last_peered":"2023-11-28T11:53:44.868559+0000","last_clean":"2023-11-28T11:53:44.868559+0000","last_became_active":"2023-11-28T11:53:40.834486+0000","last_became_peered":"2023-11-28T11:53:40.834486+0000","last_unstale":"2023-11-28T11:53:44.868559+0000","last_undegraded":"2023-11-28T11:53:44.868559+0000","last_fullsized":"2023-11-28T11:53:44.868559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865189+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:53:44.865189+0000","last_peered":"2023-11-28T11:53:44.865189+0000","last_clean":"2023-11-28T11:53:44.865189+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:53:44.865189+0000","last_undegraded":"2023-11-28T11:53:44.865189+0000","last_fullsized":"2023-11-28T11:53:44.865189+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873207+0000","last_change":"2023-11-28T11:53:40.448611+0000","last_active":"2023-11-28T11:53:44.873207+0000","last_peered":"2023-11-28T11:53:44.873207+0000","last_clean":"2023-11-28T11:53:44.873207+0000","last_became_active":"2023-11-28T11:53:40.445176+0000","last_became_peered":"2023-11-28T11:53:40.445176+0000","last_unstale":"2023-11-28T11:53:44.873207+0000","last_undegraded":"2023-11-28T11:53:44.873207+0000","last_fullsized":"2023-11-28T11:53:44.873207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:16:02.435885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.881976+0000","last_change":"2023-11-28T11:53:44.876201+0000","last_active":"2023-11-28T11:53:44.881976+0000","last_peered":"2023-11-28T11:53:44.881976+0000","last_clean":"2023-11-28T11:53:44.881976+0000","last_became_active":"2023-11-28T11:53:44.875772+0000","last_became_peered":"2023-11-28T11:53:44.875772+0000","last_unstale":"2023-11-28T11:53:44.881976+0000","last_undegraded":"2023-11-28T11:53:44.881976+0000","last_fullsized":"2023-11-28T11:53:44.881976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:45:22.911172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861493+0000","last_change":"2023-11-28T11:53:40.831017+0000","last_active":"2023-11-28T11:53:44.861493+0000","last_peered":"2023-11-28T11:53:44.861493+0000","last_clean":"2023-11-28T11:53:44.861493+0000","last_became_active":"2023-11-28T11:53:40.830653+0000","last_became_peered":"2023-11-28T11:53:40.830653+0000","last_unstale":"2023-11-28T11:53:44.861493+0000","last_undegraded":"2023-11-28T11:53:44.861493+0000","last_fullsized":"2023-11-28T11:53:44.861493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:57.213686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862754+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:53:44.862754+0000","last_peered":"2023-11-28T11:53:44.862754+0000","last_clean":"2023-11-28T11:53:44.862754+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:53:44.862754+0000","last_undegraded":"2023-11-28T11:53:44.862754+0000","last_fullsized":"2023-11-28T11:53:44.862754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.877834+0000","last_change":"2023-11-28T11:53:40.444866+0000","last_active":"2023-11-28T11:53:44.877834+0000","last_peered":"2023-11-28T11:53:44.877834+0000","last_clean":"2023-11-28T11:53:44.877834+0000","last_became_active":"2023-11-28T11:53:40.444600+0000","last_became_peered":"2023-11-28T11:53:40.444600+0000","last_unstale":"2023-11-28T11:53:44.877834+0000","last_undegraded":"2023-11-28T11:53:44.877834+0000","last_fullsized":"2023-11-28T11:53:44.877834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:54.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.881029+0000","last_change":"2023-11-28T11:53:44.877188+0000","last_active":"2023-11-28T11:53:44.881029+0000","last_peered":"2023-11-28T11:53:44.881029+0000","last_clean":"2023-11-28T11:53:44.881029+0000","last_became_active":"2023-11-28T11:53:44.876752+0000","last_became_peered":"2023-11-28T11:53:44.876752+0000","last_unstale":"2023-11-28T11:53:44.881029+0000","last_undegraded":"2023-11-28T11:53:44.881029+0000","last_fullsized":"2023-11-28T11:53:44.881029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:49.906382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860156+0000","last_change":"2023-11-28T11:53:40.832575+0000","last_active":"2023-11-28T11:53:44.860156+0000","last_peered":"2023-11-28T11:53:44.860156+0000","last_clean":"2023-11-28T11:53:44.860156+0000","last_became_active":"2023-11-28T11:53:40.832265+0000","last_became_peered":"2023-11-28T11:53:40.832265+0000","last_unstale":"2023-11-28T11:53:44.860156+0000","last_undegraded":"2023-11-28T11:53:44.860156+0000","last_fullsized":"2023-11-28T11:53:44.860156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:27:28.269321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863573+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:53:44.863573+0000","last_peered":"2023-11-28T11:53:44.863573+0000","last_clean":"2023-11-28T11:53:44.863573+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:53:44.863573+0000","last_undegraded":"2023-11-28T11:53:44.863573+0000","last_fullsized":"2023-11-28T11:53:44.863573+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T11:53:45.370919+0000","last_change":"2023-11-28T11:53:40.450301+0000","last_active":"2023-11-28T11:53:45.370919+0000","last_peered":"2023-11-28T11:53:45.370919+0000","last_clean":"2023-11-28T11:53:45.370919+0000","last_became_active":"2023-11-28T11:53:40.450014+0000","last_became_peered":"2023-11-28T11:53:40.450014+0000","last_unstale":"2023-11-28T11:53:45.370919+0000","last_undegraded":"2023-11-28T11:53:45.370919+0000","last_fullsized":"2023-11-28T11:53:45.370919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:57.826127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.883889+0000","last_change":"2023-11-28T11:53:44.880249+0000","last_active":"2023-11-28T11:53:44.883889+0000","last_peered":"2023-11-28T11:53:44.883889+0000","last_clean":"2023-11-28T11:53:44.883889+0000","last_became_active":"2023-11-28T11:53:44.879807+0000","last_became_peered":"2023-11-28T11:53:44.879807+0000","last_unstale":"2023-11-28T11:53:44.883889+0000","last_undegraded":"2023-11-28T11:53:44.883889+0000","last_fullsized":"2023-11-28T11:53:44.883889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:24:18.219732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867353+0000","last_change":"2023-11-28T11:53:40.822809+0000","last_active":"2023-11-28T11:53:44.867353+0000","last_peered":"2023-11-28T11:53:44.867353+0000","last_clean":"2023-11-28T11:53:44.867353+0000","last_became_active":"2023-11-28T11:53:40.822525+0000","last_became_peered":"2023-11-28T11:53:40.822525+0000","last_unstale":"2023-11-28T11:53:44.867353+0000","last_undegraded":"2023-11-28T11:53:44.867353+0000","last_fullsized":"2023-11-28T11:53:44.867353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:33.728842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863783+0000","last_change":"2023-11-28T11:53:40.447043+0000","last_active":"2023-11-28T11:53:44.863783+0000","last_peered":"2023-11-28T11:53:44.863783+0000","last_clean":"2023-11-28T11:53:44.863783+0000","last_became_active":"2023-11-28T11:53:40.446655+0000","last_became_peered":"2023-11-28T11:53:40.446655+0000","last_unstale":"2023-11-28T11:53:44.863783+0000","last_undegraded":"2023-11-28T11:53:44.863783+0000","last_fullsized":"2023-11-28T11:53:44.863783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:16:02.435885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.858559+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:53:44.858559+0000","last_peered":"2023-11-28T11:53:44.858559+0000","last_clean":"2023-11-28T11:53:44.858559+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:53:44.858559+0000","last_undegraded":"2023-11-28T11:53:44.858559+0000","last_fullsized":"2023-11-28T11:53:44.858559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873069+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:53:44.873069+0000","last_peered":"2023-11-28T11:53:44.873069+0000","last_clean":"2023-11-28T11:53:44.873069+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:53:44.873069+0000","last_undegraded":"2023-11-28T11:53:44.873069+0000","last_fullsized":"2023-11-28T11:53:44.873069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.881432+0000","last_change":"2023-11-28T11:53:44.877382+0000","last_active":"2023-11-28T11:53:44.881432+0000","last_peered":"2023-11-28T11:53:44.881432+0000","last_clean":"2023-11-28T11:53:44.881432+0000","last_became_active":"2023-11-28T11:53:44.876993+0000","last_became_peered":"2023-11-28T11:53:44.876993+0000","last_unstale":"2023-11-28T11:53:44.881432+0000","last_undegraded":"2023-11-28T11:53:44.881432+0000","last_fullsized":"2023-11-28T11:53:44.881432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:54:59.674019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.876641+0000","last_change":"2023-11-28T11:53:40.829307+0000","last_active":"2023-11-28T11:53:44.876641+0000","last_peered":"2023-11-28T11:53:44.876641+0000","last_clean":"2023-11-28T11:53:44.876641+0000","last_became_active":"2023-11-28T11:53:40.828558+0000","last_became_peered":"2023-11-28T11:53:40.828558+0000","last_unstale":"2023-11-28T11:53:44.876641+0000","last_undegraded":"2023-11-28T11:53:44.876641+0000","last_fullsized":"2023-11-28T11:53:44.876641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:03:21.599961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.871461+0000","last_change":"2023-11-28T11:53:40.446066+0000","last_active":"2023-11-28T11:53:44.871461+0000","last_peered":"2023-11-28T11:53:44.871461+0000","last_clean":"2023-11-28T11:53:44.871461+0000","last_became_active":"2023-11-28T11:53:40.445774+0000","last_became_peered":"2023-11-28T11:53:40.445774+0000","last_unstale":"2023-11-28T11:53:44.871461+0000","last_undegraded":"2023-11-28T11:53:44.871461+0000","last_fullsized":"2023-11-28T11:53:44.871461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:58:24.917085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861363+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:53:44.861363+0000","last_peered":"2023-11-28T11:53:44.861363+0000","last_clean":"2023-11-28T11:53:44.861363+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:53:44.861363+0000","last_undegraded":"2023-11-28T11:53:44.861363+0000","last_fullsized":"2023-11-28T11:53:44.861363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.888435+0000","last_change":"2023-11-28T11:53:44.881392+0000","last_active":"2023-11-28T11:53:44.888435+0000","last_peered":"2023-11-28T11:53:44.888435+0000","last_clean":"2023-11-28T11:53:44.888435+0000","last_became_active":"2023-11-28T11:53:44.880999+0000","last_became_peered":"2023-11-28T11:53:44.880999+0000","last_unstale":"2023-11-28T11:53:44.888435+0000","last_undegraded":"2023-11-28T11:53:44.888435+0000","last_fullsized":"2023-11-28T11:53:44.888435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:10.350062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873131+0000","last_change":"2023-11-28T11:53:40.829883+0000","last_active":"2023-11-28T11:53:44.873131+0000","last_peered":"2023-11-28T11:53:44.873131+0000","last_clean":"2023-11-28T11:53:44.873131+0000","last_became_active":"2023-11-28T11:53:40.828918+0000","last_became_peered":"2023-11-28T11:53:40.828918+0000","last_unstale":"2023-11-28T11:53:44.873131+0000","last_undegraded":"2023-11-28T11:53:44.873131+0000","last_fullsized":"2023-11-28T11:53:44.873131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:53.307980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859888+0000","last_change":"2023-11-28T11:53:40.444678+0000","last_active":"2023-11-28T11:53:44.859888+0000","last_peered":"2023-11-28T11:53:44.859888+0000","last_clean":"2023-11-28T11:53:44.859888+0000","last_became_active":"2023-11-28T11:53:40.444330+0000","last_became_peered":"2023-11-28T11:53:40.444330+0000","last_unstale":"2023-11-28T11:53:44.859888+0000","last_undegraded":"2023-11-28T11:53:44.859888+0000","last_fullsized":"2023-11-28T11:53:44.859888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:54.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852107+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:53:44.852107+0000","last_peered":"2023-11-28T11:53:44.852107+0000","last_clean":"2023-11-28T11:53:44.852107+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:53:44.852107+0000","last_undegraded":"2023-11-28T11:53:44.852107+0000","last_fullsized":"2023-11-28T11:53:44.852107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.887490+0000","last_change":"2023-11-28T11:53:44.879815+0000","last_active":"2023-11-28T11:53:44.887490+0000","last_peered":"2023-11-28T11:53:44.887490+0000","last_clean":"2023-11-28T11:53:44.887490+0000","last_became_active":"2023-11-28T11:53:44.879231+0000","last_became_peered":"2023-11-28T11:53:44.879231+0000","last_unstale":"2023-11-28T11:53:44.887490+0000","last_undegraded":"2023-11-28T11:53:44.887490+0000","last_fullsized":"2023-11-28T11:53:44.887490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:29.010118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865882+0000","last_change":"2023-11-28T11:53:40.825293+0000","last_active":"2023-11-28T11:53:44.865882+0000","last_peered":"2023-11-28T11:53:44.865882+0000","last_clean":"2023-11-28T11:53:44.865882+0000","last_became_active":"2023-11-28T11:53:40.824947+0000","last_became_peered":"2023-11-28T11:53:40.824947+0000","last_unstale":"2023-11-28T11:53:44.865882+0000","last_undegraded":"2023-11-28T11:53:44.865882+0000","last_fullsized":"2023-11-28T11:53:44.865882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:57.215796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862236+0000","last_change":"2023-11-28T11:53:40.442915+0000","last_active":"2023-11-28T11:53:44.862236+0000","last_peered":"2023-11-28T11:53:44.862236+0000","last_clean":"2023-11-28T11:53:44.862236+0000","last_became_active":"2023-11-28T11:53:40.442616+0000","last_became_peered":"2023-11-28T11:53:40.442616+0000","last_unstale":"2023-11-28T11:53:44.862236+0000","last_undegraded":"2023-11-28T11:53:44.862236+0000","last_fullsized":"2023-11-28T11:53:44.862236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:41.874385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.858675+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:53:44.858675+0000","last_peered":"2023-11-28T11:53:44.858675+0000","last_clean":"2023-11-28T11:53:44.858675+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:53:44.858675+0000","last_undegraded":"2023-11-28T11:53:44.858675+0000","last_fullsized":"2023-11-28T11:53:44.858675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.886370+0000","last_change":"2023-11-28T11:53:44.883518+0000","last_active":"2023-11-28T11:53:44.886370+0000","last_peered":"2023-11-28T11:53:44.886370+0000","last_clean":"2023-11-28T11:53:44.886370+0000","last_became_active":"2023-11-28T11:53:44.880294+0000","last_became_peered":"2023-11-28T11:53:44.880294+0000","last_unstale":"2023-11-28T11:53:44.886370+0000","last_undegraded":"2023-11-28T11:53:44.886370+0000","last_fullsized":"2023-11-28T11:53:44.886370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:18.531528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.876596+0000","last_change":"2023-11-28T11:53:40.823797+0000","last_active":"2023-11-28T11:53:44.876596+0000","last_peered":"2023-11-28T11:53:44.876596+0000","last_clean":"2023-11-28T11:53:44.876596+0000","last_became_active":"2023-11-28T11:53:40.823514+0000","last_became_peered":"2023-11-28T11:53:40.823514+0000","last_unstale":"2023-11-28T11:53:44.876596+0000","last_undegraded":"2023-11-28T11:53:44.876596+0000","last_fullsized":"2023-11-28T11:53:44.876596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861642+0000","last_change":"2023-11-28T11:53:40.450607+0000","last_active":"2023-11-28T11:53:44.861642+0000","last_peered":"2023-11-28T11:53:44.861642+0000","last_clean":"2023-11-28T11:53:44.861642+0000","last_became_active":"2023-11-28T11:53:40.450324+0000","last_became_peered":"2023-11-28T11:53:40.450324+0000","last_unstale":"2023-11-28T11:53:44.861642+0000","last_undegraded":"2023-11-28T11:53:44.861642+0000","last_fullsized":"2023-11-28T11:53:44.861642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:17.443093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.872261+0000","last_change":"2023-11-28T11:53:44.868741+0000","last_active":"2023-11-28T11:53:44.872261+0000","last_peered":"2023-11-28T11:53:44.872261+0000","last_clean":"2023-11-28T11:53:44.872261+0000","last_became_active":"2023-11-28T11:53:44.868320+0000","last_became_peered":"2023-11-28T11:53:44.868320+0000","last_unstale":"2023-11-28T11:53:44.872261+0000","last_undegraded":"2023-11-28T11:53:44.872261+0000","last_fullsized":"2023-11-28T11:53:44.872261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:54:58.724369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862814+0000","last_change":"2023-11-28T11:53:40.823419+0000","last_active":"2023-11-28T11:53:44.862814+0000","last_peered":"2023-11-28T11:53:44.862814+0000","last_clean":"2023-11-28T11:53:44.862814+0000","last_became_active":"2023-11-28T11:53:40.821588+0000","last_became_peered":"2023-11-28T11:53:40.821588+0000","last_unstale":"2023-11-28T11:53:44.862814+0000","last_undegraded":"2023-11-28T11:53:44.862814+0000","last_fullsized":"2023-11-28T11:53:44.862814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:13.793522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862499+0000","last_change":"2023-11-28T11:53:40.448234+0000","last_active":"2023-11-28T11:53:44.862499+0000","last_peered":"2023-11-28T11:53:44.862499+0000","last_clean":"2023-11-28T11:53:44.862499+0000","last_became_active":"2023-11-28T11:53:40.447793+0000","last_became_peered":"2023-11-28T11:53:40.447793+0000","last_unstale":"2023-11-28T11:53:44.862499+0000","last_undegraded":"2023-11-28T11:53:44.862499+0000","last_fullsized":"2023-11-28T11:53:44.862499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:57.826127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.871780+0000","last_change":"2023-11-28T11:53:44.868480+0000","last_active":"2023-11-28T11:53:44.871780+0000","last_peered":"2023-11-28T11:53:44.871780+0000","last_clean":"2023-11-28T11:53:44.871780+0000","last_became_active":"2023-11-28T11:53:44.868051+0000","last_became_peered":"2023-11-28T11:53:44.868051+0000","last_unstale":"2023-11-28T11:53:44.871780+0000","last_undegraded":"2023-11-28T11:53:44.871780+0000","last_fullsized":"2023-11-28T11:53:44.871780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:45:35.342963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862591+0000","last_change":"2023-11-28T11:53:40.826870+0000","last_active":"2023-11-28T11:53:44.862591+0000","last_peered":"2023-11-28T11:53:44.862591+0000","last_clean":"2023-11-28T11:53:44.862591+0000","last_became_active":"2023-11-28T11:53:40.826561+0000","last_became_peered":"2023-11-28T11:53:40.826561+0000","last_unstale":"2023-11-28T11:53:44.862591+0000","last_undegraded":"2023-11-28T11:53:44.862591+0000","last_fullsized":"2023-11-28T11:53:44.862591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:24:13.706573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865183+0000","last_change":"2023-11-28T11:53:40.450118+0000","last_active":"2023-11-28T11:53:44.865183+0000","last_peered":"2023-11-28T11:53:44.865183+0000","last_clean":"2023-11-28T11:53:44.865183+0000","last_became_active":"2023-11-28T11:53:40.449740+0000","last_became_peered":"2023-11-28T11:53:40.449740+0000","last_unstale":"2023-11-28T11:53:44.865183+0000","last_undegraded":"2023-11-28T11:53:44.865183+0000","last_fullsized":"2023-11-28T11:53:44.865183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:16:02.435885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889470+0000","last_change":"2023-11-28T11:53:44.880051+0000","last_active":"2023-11-28T11:53:44.889470+0000","last_peered":"2023-11-28T11:53:44.889470+0000","last_clean":"2023-11-28T11:53:44.889470+0000","last_became_active":"2023-11-28T11:53:44.879656+0000","last_became_peered":"2023-11-28T11:53:44.879656+0000","last_unstale":"2023-11-28T11:53:44.889470+0000","last_undegraded":"2023-11-28T11:53:44.889470+0000","last_fullsized":"2023-11-28T11:53:44.889470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:21:48.435615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859774+0000","last_change":"2023-11-28T11:53:40.822906+0000","last_active":"2023-11-28T11:53:44.859774+0000","last_peered":"2023-11-28T11:53:44.859774+0000","last_clean":"2023-11-28T11:53:44.859774+0000","last_became_active":"2023-11-28T11:53:40.822629+0000","last_became_peered":"2023-11-28T11:53:40.822629+0000","last_unstale":"2023-11-28T11:53:44.859774+0000","last_undegraded":"2023-11-28T11:53:44.859774+0000","last_fullsized":"2023-11-28T11:53:44.859774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:34.614578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862074+0000","last_change":"2023-11-28T11:53:40.441500+0000","last_active":"2023-11-28T11:53:44.862074+0000","last_peered":"2023-11-28T11:53:44.862074+0000","last_clean":"2023-11-28T11:53:44.862074+0000","last_became_active":"2023-11-28T11:53:40.441158+0000","last_became_peered":"2023-11-28T11:53:40.441158+0000","last_unstale":"2023-11-28T11:53:44.862074+0000","last_undegraded":"2023-11-28T11:53:44.862074+0000","last_fullsized":"2023-11-28T11:53:44.862074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:19.967407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873877+0000","last_change":"2023-11-28T11:53:44.872014+0000","last_active":"2023-11-28T11:53:44.873877+0000","last_peered":"2023-11-28T11:53:44.873877+0000","last_clean":"2023-11-28T11:53:44.873877+0000","last_became_active":"2023-11-28T11:53:44.871605+0000","last_became_peered":"2023-11-28T11:53:44.871605+0000","last_unstale":"2023-11-28T11:53:44.873877+0000","last_undegraded":"2023-11-28T11:53:44.873877+0000","last_fullsized":"2023-11-28T11:53:44.873877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:45:22.911172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.868467+0000","last_change":"2023-11-28T11:53:40.822940+0000","last_active":"2023-11-28T11:53:44.868467+0000","last_peered":"2023-11-28T11:53:44.868467+0000","last_clean":"2023-11-28T11:53:44.868467+0000","last_became_active":"2023-11-28T11:53:40.822043+0000","last_became_peered":"2023-11-28T11:53:40.822043+0000","last_unstale":"2023-11-28T11:53:44.868467+0000","last_undegraded":"2023-11-28T11:53:44.868467+0000","last_fullsized":"2023-11-28T11:53:44.868467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:57.213686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.851830+0000","last_change":"2023-11-28T11:53:40.443907+0000","last_active":"2023-11-28T11:53:44.851830+0000","last_peered":"2023-11-28T11:53:44.851830+0000","last_clean":"2023-11-28T11:53:44.851830+0000","last_became_active":"2023-11-28T11:53:40.443561+0000","last_became_peered":"2023-11-28T11:53:40.443561+0000","last_unstale":"2023-11-28T11:53:44.851830+0000","last_undegraded":"2023-11-28T11:53:44.851830+0000","last_fullsized":"2023-11-28T11:53:44.851830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:00.300889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.886453+0000","last_change":"2023-11-28T11:53:44.878401+0000","last_active":"2023-11-28T11:53:44.886453+0000","last_peered":"2023-11-28T11:53:44.886453+0000","last_clean":"2023-11-28T11:53:44.886453+0000","last_became_active":"2023-11-28T11:53:44.877984+0000","last_became_peered":"2023-11-28T11:53:44.877984+0000","last_unstale":"2023-11-28T11:53:44.886453+0000","last_undegraded":"2023-11-28T11:53:44.886453+0000","last_fullsized":"2023-11-28T11:53:44.886453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:41.510014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.865016+0000","last_change":"2023-11-28T11:53:40.828665+0000","last_active":"2023-11-28T11:53:44.865016+0000","last_peered":"2023-11-28T11:53:44.865016+0000","last_clean":"2023-11-28T11:53:44.865016+0000","last_became_active":"2023-11-28T11:53:40.828391+0000","last_became_peered":"2023-11-28T11:53:40.828391+0000","last_unstale":"2023-11-28T11:53:44.865016+0000","last_undegraded":"2023-11-28T11:53:44.865016+0000","last_fullsized":"2023-11-28T11:53:44.865016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:26:32.332628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859809+0000","last_change":"2023-11-28T11:53:40.443223+0000","last_active":"2023-11-28T11:53:44.859809+0000","last_peered":"2023-11-28T11:53:44.859809+0000","last_clean":"2023-11-28T11:53:44.859809+0000","last_became_active":"2023-11-28T11:53:40.442898+0000","last_became_peered":"2023-11-28T11:53:40.442898+0000","last_unstale":"2023-11-28T11:53:44.859809+0000","last_undegraded":"2023-11-28T11:53:44.859809+0000","last_fullsized":"2023-11-28T11:53:44.859809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:55.478609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.872465+0000","last_change":"2023-11-28T11:53:44.870670+0000","last_active":"2023-11-28T11:53:44.872465+0000","last_peered":"2023-11-28T11:53:44.872465+0000","last_clean":"2023-11-28T11:53:44.872465+0000","last_became_active":"2023-11-28T11:53:44.870011+0000","last_became_peered":"2023-11-28T11:53:44.870011+0000","last_unstale":"2023-11-28T11:53:44.872465+0000","last_undegraded":"2023-11-28T11:53:44.872465+0000","last_fullsized":"2023-11-28T11:53:44.872465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:17.214530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859908+0000","last_change":"2023-11-28T11:53:40.816472+0000","last_active":"2023-11-28T11:53:44.859908+0000","last_peered":"2023-11-28T11:53:44.859908+0000","last_clean":"2023-11-28T11:53:44.859908+0000","last_became_active":"2023-11-28T11:53:40.816159+0000","last_became_peered":"2023-11-28T11:53:40.816159+0000","last_unstale":"2023-11-28T11:53:44.859908+0000","last_undegraded":"2023-11-28T11:53:44.859908+0000","last_fullsized":"2023-11-28T11:53:44.859908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:38.089006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.869315+0000","last_change":"2023-11-28T11:53:40.450339+0000","last_active":"2023-11-28T11:53:44.869315+0000","last_peered":"2023-11-28T11:53:44.869315+0000","last_clean":"2023-11-28T11:53:44.869315+0000","last_became_active":"2023-11-28T11:53:40.450046+0000","last_became_peered":"2023-11-28T11:53:40.450046+0000","last_unstale":"2023-11-28T11:53:44.869315+0000","last_undegraded":"2023-11-28T11:53:44.869315+0000","last_fullsized":"2023-11-28T11:53:44.869315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:17.443093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.888530+0000","last_change":"2023-11-28T11:53:44.882874+0000","last_active":"2023-11-28T11:53:44.888530+0000","last_peered":"2023-11-28T11:53:44.888530+0000","last_clean":"2023-11-28T11:53:44.888530+0000","last_became_active":"2023-11-28T11:53:44.882175+0000","last_became_peered":"2023-11-28T11:53:44.882175+0000","last_unstale":"2023-11-28T11:53:44.888530+0000","last_undegraded":"2023-11-28T11:53:44.888530+0000","last_fullsized":"2023-11-28T11:53:44.888530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:53.340638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.851850+0000","last_change":"2023-11-28T11:53:40.826543+0000","last_active":"2023-11-28T11:53:44.851850+0000","last_peered":"2023-11-28T11:53:44.851850+0000","last_clean":"2023-11-28T11:53:44.851850+0000","last_became_active":"2023-11-28T11:53:40.826182+0000","last_became_peered":"2023-11-28T11:53:40.826182+0000","last_unstale":"2023-11-28T11:53:44.851850+0000","last_undegraded":"2023-11-28T11:53:44.851850+0000","last_fullsized":"2023-11-28T11:53:44.851850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:03:21.599961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.869691+0000","last_change":"2023-11-28T11:53:40.450402+0000","last_active":"2023-11-28T11:53:44.869691+0000","last_peered":"2023-11-28T11:53:44.869691+0000","last_clean":"2023-11-28T11:53:44.869691+0000","last_became_active":"2023-11-28T11:53:40.450094+0000","last_became_peered":"2023-11-28T11:53:40.450094+0000","last_unstale":"2023-11-28T11:53:44.869691+0000","last_undegraded":"2023-11-28T11:53:44.869691+0000","last_fullsized":"2023-11-28T11:53:44.869691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:35:19.888846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.886156+0000","last_change":"2023-11-28T11:53:44.882776+0000","last_active":"2023-11-28T11:53:44.886156+0000","last_peered":"2023-11-28T11:53:44.886156+0000","last_clean":"2023-11-28T11:53:44.886156+0000","last_became_active":"2023-11-28T11:53:44.880222+0000","last_became_peered":"2023-11-28T11:53:44.880222+0000","last_unstale":"2023-11-28T11:53:44.886156+0000","last_undegraded":"2023-11-28T11:53:44.886156+0000","last_fullsized":"2023-11-28T11:53:44.886156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:23:05.347162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.882471+0000","last_change":"2023-11-28T11:53:44.879327+0000","last_active":"2023-11-28T11:53:44.882471+0000","last_peered":"2023-11-28T11:53:44.882471+0000","last_clean":"2023-11-28T11:53:44.882471+0000","last_became_active":"2023-11-28T11:53:44.878937+0000","last_became_peered":"2023-11-28T11:53:44.878937+0000","last_unstale":"2023-11-28T11:53:44.882471+0000","last_undegraded":"2023-11-28T11:53:44.882471+0000","last_fullsized":"2023-11-28T11:53:44.882471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:37.024091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.864801+0000","last_change":"2023-11-28T11:53:40.437606+0000","last_active":"2023-11-28T11:53:44.864801+0000","last_peered":"2023-11-28T11:53:44.864801+0000","last_clean":"2023-11-28T11:53:44.864801+0000","last_became_active":"2023-11-28T11:53:40.436841+0000","last_became_peered":"2023-11-28T11:53:40.436841+0000","last_unstale":"2023-11-28T11:53:44.864801+0000","last_undegraded":"2023-11-28T11:53:44.864801+0000","last_fullsized":"2023-11-28T11:53:44.864801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:29:57.826127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.877919+0000","last_change":"2023-11-28T11:53:40.830708+0000","last_active":"2023-11-28T11:53:44.877919+0000","last_peered":"2023-11-28T11:53:44.877919+0000","last_clean":"2023-11-28T11:53:44.877919+0000","last_became_active":"2023-11-28T11:53:40.830408+0000","last_became_peered":"2023-11-28T11:53:40.830408+0000","last_unstale":"2023-11-28T11:53:44.877919+0000","last_undegraded":"2023-11-28T11:53:44.877919+0000","last_fullsized":"2023-11-28T11:53:44.877919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:03.251004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.889061+0000","last_change":"2023-11-28T11:53:44.883220+0000","last_active":"2023-11-28T11:53:44.889061+0000","last_peered":"2023-11-28T11:53:44.889061+0000","last_clean":"2023-11-28T11:53:44.889061+0000","last_became_active":"2023-11-28T11:53:44.881046+0000","last_became_peered":"2023-11-28T11:53:44.881046+0000","last_unstale":"2023-11-28T11:53:44.889061+0000","last_undegraded":"2023-11-28T11:53:44.889061+0000","last_fullsized":"2023-11-28T11:53:44.889061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:54:59.674019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861290+0000","last_change":"2023-11-28T11:53:40.451361+0000","last_active":"2023-11-28T11:53:44.861290+0000","last_peered":"2023-11-28T11:53:44.861290+0000","last_clean":"2023-11-28T11:53:44.861290+0000","last_became_active":"2023-11-28T11:53:40.451055+0000","last_became_peered":"2023-11-28T11:53:40.451055+0000","last_unstale":"2023-11-28T11:53:44.861290+0000","last_undegraded":"2023-11-28T11:53:44.861290+0000","last_fullsized":"2023-11-28T11:53:44.861290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:00.300889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867430+0000","last_change":"2023-11-28T11:53:40.832925+0000","last_active":"2023-11-28T11:53:44.867430+0000","last_peered":"2023-11-28T11:53:44.867430+0000","last_clean":"2023-11-28T11:53:44.867430+0000","last_became_active":"2023-11-28T11:53:40.824344+0000","last_became_peered":"2023-11-28T11:53:40.824344+0000","last_unstale":"2023-11-28T11:53:44.867430+0000","last_undegraded":"2023-11-28T11:53:44.867430+0000","last_fullsized":"2023-11-28T11:53:44.867430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:07:13.206788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862637+0000","last_change":"2023-11-28T11:53:40.444858+0000","last_active":"2023-11-28T11:53:44.862637+0000","last_peered":"2023-11-28T11:53:44.862637+0000","last_clean":"2023-11-28T11:53:44.862637+0000","last_became_active":"2023-11-28T11:53:40.444494+0000","last_became_peered":"2023-11-28T11:53:40.444494+0000","last_unstale":"2023-11-28T11:53:44.862637+0000","last_undegraded":"2023-11-28T11:53:44.862637+0000","last_fullsized":"2023-11-28T11:53:44.862637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:41.874385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.854924+0000","last_change":"2023-11-28T11:53:40.826741+0000","last_active":"2023-11-28T11:53:44.854924+0000","last_peered":"2023-11-28T11:53:44.854924+0000","last_clean":"2023-11-28T11:53:44.854924+0000","last_became_active":"2023-11-28T11:53:40.826438+0000","last_became_peered":"2023-11-28T11:53:40.826438+0000","last_unstale":"2023-11-28T11:53:44.854924+0000","last_undegraded":"2023-11-28T11:53:44.854924+0000","last_fullsized":"2023-11-28T11:53:44.854924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.887781+0000","last_change":"2023-11-28T11:53:44.881841+0000","last_active":"2023-11-28T11:53:44.887781+0000","last_peered":"2023-11-28T11:53:44.887781+0000","last_clean":"2023-11-28T11:53:44.887781+0000","last_became_active":"2023-11-28T11:53:44.880886+0000","last_became_peered":"2023-11-28T11:53:44.880886+0000","last_unstale":"2023-11-28T11:53:44.887781+0000","last_undegraded":"2023-11-28T11:53:44.887781+0000","last_fullsized":"2023-11-28T11:53:44.887781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:09:31.123351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861943+0000","last_change":"2023-11-28T11:53:40.450777+0000","last_active":"2023-11-28T11:53:44.861943+0000","last_peered":"2023-11-28T11:53:44.861943+0000","last_clean":"2023-11-28T11:53:44.861943+0000","last_became_active":"2023-11-28T11:53:40.449763+0000","last_became_peered":"2023-11-28T11:53:40.449763+0000","last_unstale":"2023-11-28T11:53:44.861943+0000","last_undegraded":"2023-11-28T11:53:44.861943+0000","last_fullsized":"2023-11-28T11:53:44.861943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:39.392904+0000","last_clean_scrub_stamp":"2023-11-28T11:53:39.392904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:19.967407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.863452+0000","last_change":"2023-11-28T11:53:40.826209+0000","last_active":"2023-11-28T11:53:44.863452+0000","last_peered":"2023-11-28T11:53:44.863452+0000","last_clean":"2023-11-28T11:53:44.863452+0000","last_became_active":"2023-11-28T11:53:40.825734+0000","last_became_peered":"2023-11-28T11:53:40.825734+0000","last_unstale":"2023-11-28T11:53:44.863452+0000","last_undegraded":"2023-11-28T11:53:44.863452+0000","last_fullsized":"2023-11-28T11:53:44.863452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:06.929054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.881708+0000","last_change":"2023-11-28T11:53:44.877701+0000","last_active":"2023-11-28T11:53:44.881708+0000","last_peered":"2023-11-28T11:53:44.881708+0000","last_clean":"2023-11-28T11:53:44.881708+0000","last_became_active":"2023-11-28T11:53:44.877282+0000","last_became_peered":"2023-11-28T11:53:44.877282+0000","last_unstale":"2023-11-28T11:53:44.881708+0000","last_undegraded":"2023-11-28T11:53:44.881708+0000","last_fullsized":"2023-11-28T11:53:44.881708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:43.825349+0000","last_clean_scrub_stamp":"2023-11-28T11:53:43.825349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:31.365757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.864694+0000","last_change":"2023-11-28T11:53:40.828450+0000","last_active":"2023-11-28T11:53:44.864694+0000","last_peered":"2023-11-28T11:53:44.864694+0000","last_clean":"2023-11-28T11:53:44.864694+0000","last_became_active":"2023-11-28T11:53:40.828013+0000","last_became_peered":"2023-11-28T11:53:40.828013+0000","last_unstale":"2023-11-28T11:53:44.864694+0000","last_undegraded":"2023-11-28T11:53:44.864694+0000","last_fullsized":"2023-11-28T11:53:44.864694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:56.490046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.875831+0000","last_change":"2023-11-28T11:53:40.830008+0000","last_active":"2023-11-28T11:53:44.875831+0000","last_peered":"2023-11-28T11:53:44.875831+0000","last_clean":"2023-11-28T11:53:44.875831+0000","last_became_active":"2023-11-28T11:53:40.829403+0000","last_became_peered":"2023-11-28T11:53:40.829403+0000","last_unstale":"2023-11-28T11:53:44.875831+0000","last_undegraded":"2023-11-28T11:53:44.875831+0000","last_fullsized":"2023-11-28T11:53:44.875831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:54:33.728842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860063+0000","last_change":"2023-11-28T11:53:40.822203+0000","last_active":"2023-11-28T11:53:44.860063+0000","last_peered":"2023-11-28T11:53:44.860063+0000","last_clean":"2023-11-28T11:53:44.860063+0000","last_became_active":"2023-11-28T11:53:40.821925+0000","last_became_peered":"2023-11-28T11:53:40.821925+0000","last_unstale":"2023-11-28T11:53:44.860063+0000","last_undegraded":"2023-11-28T11:53:44.860063+0000","last_fullsized":"2023-11-28T11:53:44.860063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:21:45.014606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861940+0000","last_change":"2023-11-28T11:53:40.831266+0000","last_active":"2023-11-28T11:53:44.861940+0000","last_peered":"2023-11-28T11:53:44.861940+0000","last_clean":"2023-11-28T11:53:44.861940+0000","last_became_active":"2023-11-28T11:53:40.830547+0000","last_became_peered":"2023-11-28T11:53:40.830547+0000","last_unstale":"2023-11-28T11:53:44.861940+0000","last_undegraded":"2023-11-28T11:53:44.861940+0000","last_fullsized":"2023-11-28T11:53:44.861940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:51.196033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.873045+0000","last_change":"2023-11-28T11:53:40.820563+0000","last_active":"2023-11-28T11:53:44.873045+0000","last_peered":"2023-11-28T11:53:44.873045+0000","last_clean":"2023-11-28T11:53:44.873045+0000","last_became_active":"2023-11-28T11:53:40.820312+0000","last_became_peered":"2023-11-28T11:53:40.820312+0000","last_unstale":"2023-11-28T11:53:44.873045+0000","last_undegraded":"2023-11-28T11:53:44.873045+0000","last_fullsized":"2023-11-28T11:53:44.873045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:53:09.778935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.854790+0000","last_change":"2023-11-28T11:53:40.831601+0000","last_active":"2023-11-28T11:53:44.854790+0000","last_peered":"2023-11-28T11:53:44.854790+0000","last_clean":"2023-11-28T11:53:44.854790+0000","last_became_active":"2023-11-28T11:53:40.831307+0000","last_became_peered":"2023-11-28T11:53:40.831307+0000","last_unstale":"2023-11-28T11:53:44.854790+0000","last_undegraded":"2023-11-28T11:53:44.854790+0000","last_fullsized":"2023-11-28T11:53:44.854790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:58.623372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.876637+0000","last_change":"2023-11-28T11:53:40.829422+0000","last_active":"2023-11-28T11:53:44.876637+0000","last_peered":"2023-11-28T11:53:44.876637+0000","last_clean":"2023-11-28T11:53:44.876637+0000","last_became_active":"2023-11-28T11:53:40.829178+0000","last_became_peered":"2023-11-28T11:53:40.829178+0000","last_unstale":"2023-11-28T11:53:44.876637+0000","last_undegraded":"2023-11-28T11:53:44.876637+0000","last_fullsized":"2023-11-28T11:53:44.876637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:58.623372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.876529+0000","last_change":"2023-11-28T11:53:40.826723+0000","last_active":"2023-11-28T11:53:44.876529+0000","last_peered":"2023-11-28T11:53:44.876529+0000","last_clean":"2023-11-28T11:53:44.876529+0000","last_became_active":"2023-11-28T11:53:40.826291+0000","last_became_peered":"2023-11-28T11:53:40.826291+0000","last_unstale":"2023-11-28T11:53:44.876529+0000","last_undegraded":"2023-11-28T11:53:44.876529+0000","last_fullsized":"2023-11-28T11:53:44.876529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:04.735416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.858446+0000","last_change":"2023-11-28T11:53:40.825388+0000","last_active":"2023-11-28T11:53:44.858446+0000","last_peered":"2023-11-28T11:53:44.858446+0000","last_clean":"2023-11-28T11:53:44.858446+0000","last_became_active":"2023-11-28T11:53:40.823486+0000","last_became_peered":"2023-11-28T11:53:40.823486+0000","last_unstale":"2023-11-28T11:53:44.858446+0000","last_undegraded":"2023-11-28T11:53:44.858446+0000","last_fullsized":"2023-11-28T11:53:44.858446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:07:13.206788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862735+0000","last_change":"2023-11-28T11:53:40.834673+0000","last_active":"2023-11-28T11:53:44.862735+0000","last_peered":"2023-11-28T11:53:44.862735+0000","last_clean":"2023-11-28T11:53:44.862735+0000","last_became_active":"2023-11-28T11:53:40.834446+0000","last_became_peered":"2023-11-28T11:53:40.834446+0000","last_unstale":"2023-11-28T11:53:44.862735+0000","last_undegraded":"2023-11-28T11:53:44.862735+0000","last_fullsized":"2023-11-28T11:53:44.862735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:45:19.490164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862539+0000","last_change":"2023-11-28T11:53:40.823930+0000","last_active":"2023-11-28T11:53:44.862539+0000","last_peered":"2023-11-28T11:53:44.862539+0000","last_clean":"2023-11-28T11:53:44.862539+0000","last_became_active":"2023-11-28T11:53:40.823085+0000","last_became_peered":"2023-11-28T11:53:40.823085+0000","last_unstale":"2023-11-28T11:53:44.862539+0000","last_undegraded":"2023-11-28T11:53:44.862539+0000","last_fullsized":"2023-11-28T11:53:44.862539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:03.251004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861847+0000","last_change":"2023-11-28T11:53:40.825318+0000","last_active":"2023-11-28T11:53:44.861847+0000","last_peered":"2023-11-28T11:53:44.861847+0000","last_clean":"2023-11-28T11:53:44.861847+0000","last_became_active":"2023-11-28T11:53:40.823580+0000","last_became_peered":"2023-11-28T11:53:40.823580+0000","last_unstale":"2023-11-28T11:53:44.861847+0000","last_undegraded":"2023-11-28T11:53:44.861847+0000","last_fullsized":"2023-11-28T11:53:44.861847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:53.307980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859699+0000","last_change":"2023-11-28T11:53:40.822632+0000","last_active":"2023-11-28T11:53:44.859699+0000","last_peered":"2023-11-28T11:53:44.859699+0000","last_clean":"2023-11-28T11:53:44.859699+0000","last_became_active":"2023-11-28T11:53:40.822041+0000","last_became_peered":"2023-11-28T11:53:40.822041+0000","last_unstale":"2023-11-28T11:53:44.859699+0000","last_undegraded":"2023-11-28T11:53:44.859699+0000","last_fullsized":"2023-11-28T11:53:44.859699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:25.589109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.853050+0000","last_change":"2023-11-28T11:53:40.827422+0000","last_active":"2023-11-28T11:53:44.853050+0000","last_peered":"2023-11-28T11:53:44.853050+0000","last_clean":"2023-11-28T11:53:44.853050+0000","last_became_active":"2023-11-28T11:53:40.827049+0000","last_became_peered":"2023-11-28T11:53:40.827049+0000","last_unstale":"2023-11-28T11:53:44.853050+0000","last_undegraded":"2023-11-28T11:53:44.853050+0000","last_fullsized":"2023-11-28T11:53:44.853050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:40.317412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.862710+0000","last_change":"2023-11-28T11:53:40.830609+0000","last_active":"2023-11-28T11:53:44.862710+0000","last_peered":"2023-11-28T11:53:44.862710+0000","last_clean":"2023-11-28T11:53:44.862710+0000","last_became_active":"2023-11-28T11:53:40.830049+0000","last_became_peered":"2023-11-28T11:53:40.830049+0000","last_unstale":"2023-11-28T11:53:44.862710+0000","last_undegraded":"2023-11-28T11:53:44.862710+0000","last_fullsized":"2023-11-28T11:53:44.862710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:39:08.352832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867744+0000","last_change":"2023-11-28T11:53:40.834235+0000","last_active":"2023-11-28T11:53:44.867744+0000","last_peered":"2023-11-28T11:53:44.867744+0000","last_clean":"2023-11-28T11:53:44.867744+0000","last_became_active":"2023-11-28T11:53:40.833501+0000","last_became_peered":"2023-11-28T11:53:40.833501+0000","last_unstale":"2023-11-28T11:53:44.867744+0000","last_undegraded":"2023-11-28T11:53:44.867744+0000","last_fullsized":"2023-11-28T11:53:44.867744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:12.417672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859262+0000","last_change":"2023-11-28T11:53:40.814201+0000","last_active":"2023-11-28T11:53:44.859262+0000","last_peered":"2023-11-28T11:53:44.859262+0000","last_clean":"2023-11-28T11:53:44.859262+0000","last_became_active":"2023-11-28T11:53:40.813798+0000","last_became_peered":"2023-11-28T11:53:40.813798+0000","last_unstale":"2023-11-28T11:53:44.859262+0000","last_undegraded":"2023-11-28T11:53:44.859262+0000","last_fullsized":"2023-11-28T11:53:44.859262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:49.919629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861214+0000","last_change":"2023-11-28T11:53:40.819145+0000","last_active":"2023-11-28T11:53:44.861214+0000","last_peered":"2023-11-28T11:53:44.861214+0000","last_clean":"2023-11-28T11:53:44.861214+0000","last_became_active":"2023-11-28T11:53:40.818894+0000","last_became_peered":"2023-11-28T11:53:40.818894+0000","last_unstale":"2023-11-28T11:53:44.861214+0000","last_undegraded":"2023-11-28T11:53:44.861214+0000","last_fullsized":"2023-11-28T11:53:44.861214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:26.656336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852149+0000","last_change":"2023-11-28T11:53:40.831922+0000","last_active":"2023-11-28T11:53:44.852149+0000","last_peered":"2023-11-28T11:53:44.852149+0000","last_clean":"2023-11-28T11:53:44.852149+0000","last_became_active":"2023-11-28T11:53:40.831309+0000","last_became_peered":"2023-11-28T11:53:40.831309+0000","last_unstale":"2023-11-28T11:53:44.852149+0000","last_undegraded":"2023-11-28T11:53:44.852149+0000","last_fullsized":"2023-11-28T11:53:44.852149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:53.307980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852158+0000","last_change":"2023-11-28T11:53:40.828525+0000","last_active":"2023-11-28T11:53:44.852158+0000","last_peered":"2023-11-28T11:53:44.852158+0000","last_clean":"2023-11-28T11:53:44.852158+0000","last_became_active":"2023-11-28T11:53:40.827088+0000","last_became_peered":"2023-11-28T11:53:40.827088+0000","last_unstale":"2023-11-28T11:53:44.852158+0000","last_undegraded":"2023-11-28T11:53:44.852158+0000","last_fullsized":"2023-11-28T11:53:44.852158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:42.885822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.852234+0000","last_change":"2023-11-28T11:53:40.827903+0000","last_active":"2023-11-28T11:53:44.852234+0000","last_peered":"2023-11-28T11:53:44.852234+0000","last_clean":"2023-11-28T11:53:44.852234+0000","last_became_active":"2023-11-28T11:53:40.827630+0000","last_became_peered":"2023-11-28T11:53:40.827630+0000","last_unstale":"2023-11-28T11:53:44.852234+0000","last_undegraded":"2023-11-28T11:53:44.852234+0000","last_fullsized":"2023-11-28T11:53:44.852234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:20.978843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860656+0000","last_change":"2023-11-28T11:53:40.817481+0000","last_active":"2023-11-28T11:53:44.860656+0000","last_peered":"2023-11-28T11:53:44.860656+0000","last_clean":"2023-11-28T11:53:44.860656+0000","last_became_active":"2023-11-28T11:53:40.816901+0000","last_became_peered":"2023-11-28T11:53:40.816901+0000","last_unstale":"2023-11-28T11:53:44.860656+0000","last_undegraded":"2023-11-28T11:53:44.860656+0000","last_fullsized":"2023-11-28T11:53:44.860656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:57.213686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.853557+0000","last_change":"2023-11-28T11:53:40.826671+0000","last_active":"2023-11-28T11:53:44.853557+0000","last_peered":"2023-11-28T11:53:44.853557+0000","last_clean":"2023-11-28T11:53:44.853557+0000","last_became_active":"2023-11-28T11:53:40.826306+0000","last_became_peered":"2023-11-28T11:53:40.826306+0000","last_unstale":"2023-11-28T11:53:44.853557+0000","last_undegraded":"2023-11-28T11:53:44.853557+0000","last_fullsized":"2023-11-28T11:53:44.853557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:07:13.206788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.867648+0000","last_change":"2023-11-28T11:53:40.834257+0000","last_active":"2023-11-28T11:53:44.867648+0000","last_peered":"2023-11-28T11:53:44.867648+0000","last_clean":"2023-11-28T11:53:44.867648+0000","last_became_active":"2023-11-28T11:53:40.833624+0000","last_became_peered":"2023-11-28T11:53:40.833624+0000","last_unstale":"2023-11-28T11:53:44.867648+0000","last_undegraded":"2023-11-28T11:53:44.867648+0000","last_fullsized":"2023-11-28T11:53:44.867648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:51.196033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.851513+0000","last_change":"2023-11-28T11:53:40.827595+0000","last_active":"2023-11-28T11:53:44.851513+0000","last_peered":"2023-11-28T11:53:44.851513+0000","last_clean":"2023-11-28T11:53:44.851513+0000","last_became_active":"2023-11-28T11:53:40.827244+0000","last_became_peered":"2023-11-28T11:53:40.827244+0000","last_unstale":"2023-11-28T11:53:44.851513+0000","last_undegraded":"2023-11-28T11:53:44.851513+0000","last_fullsized":"2023-11-28T11:53:44.851513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:55:12.417672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.861137+0000","last_change":"2023-11-28T11:53:40.818652+0000","last_active":"2023-11-28T11:53:44.861137+0000","last_peered":"2023-11-28T11:53:44.861137+0000","last_clean":"2023-11-28T11:53:44.861137+0000","last_became_active":"2023-11-28T11:53:40.818359+0000","last_became_peered":"2023-11-28T11:53:40.818359+0000","last_unstale":"2023-11-28T11:53:44.861137+0000","last_undegraded":"2023-11-28T11:53:44.861137+0000","last_fullsized":"2023-11-28T11:53:44.861137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:58.623372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.859346+0000","last_change":"2023-11-28T11:53:40.815826+0000","last_active":"2023-11-28T11:53:44.859346+0000","last_peered":"2023-11-28T11:53:44.859346+0000","last_clean":"2023-11-28T11:53:44.859346+0000","last_became_active":"2023-11-28T11:53:40.815568+0000","last_became_peered":"2023-11-28T11:53:40.815568+0000","last_unstale":"2023-11-28T11:53:44.859346+0000","last_undegraded":"2023-11-28T11:53:44.859346+0000","last_fullsized":"2023-11-28T11:53:44.859346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:07:42.533145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.868655+0000","last_change":"2023-11-28T11:53:40.832666+0000","last_active":"2023-11-28T11:53:44.868655+0000","last_peered":"2023-11-28T11:53:44.868655+0000","last_clean":"2023-11-28T11:53:44.868655+0000","last_became_active":"2023-11-28T11:53:40.823823+0000","last_became_peered":"2023-11-28T11:53:40.823823+0000","last_unstale":"2023-11-28T11:53:44.868655+0000","last_undegraded":"2023-11-28T11:53:44.868655+0000","last_fullsized":"2023-11-28T11:53:44.868655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:53.307980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.864534+0000","last_change":"2023-11-28T11:53:40.821057+0000","last_active":"2023-11-28T11:53:44.864534+0000","last_peered":"2023-11-28T11:53:44.864534+0000","last_clean":"2023-11-28T11:53:44.864534+0000","last_became_active":"2023-11-28T11:53:40.820709+0000","last_became_peered":"2023-11-28T11:53:40.820709+0000","last_unstale":"2023-11-28T11:53:44.864534+0000","last_undegraded":"2023-11-28T11:53:44.864534+0000","last_fullsized":"2023-11-28T11:53:44.864534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:01.312325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.860193+0000","last_change":"2023-11-28T11:53:40.817645+0000","last_active":"2023-11-28T11:53:44.860193+0000","last_peered":"2023-11-28T11:53:44.860193+0000","last_clean":"2023-11-28T11:53:44.860193+0000","last_became_active":"2023-11-28T11:53:40.817205+0000","last_became_peered":"2023-11-28T11:53:40.817205+0000","last_unstale":"2023-11-28T11:53:44.860193+0000","last_undegraded":"2023-11-28T11:53:44.860193+0000","last_fullsized":"2023-11-28T11:53:44.860193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:45:19.490164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.853399+0000","last_change":"2023-11-28T11:53:40.826609+0000","last_active":"2023-11-28T11:53:44.853399+0000","last_peered":"2023-11-28T11:53:44.853399+0000","last_clean":"2023-11-28T11:53:44.853399+0000","last_became_active":"2023-11-28T11:53:40.826314+0000","last_became_peered":"2023-11-28T11:53:40.826314+0000","last_unstale":"2023-11-28T11:53:44.853399+0000","last_undegraded":"2023-11-28T11:53:44.853399+0000","last_fullsized":"2023-11-28T11:53:44.853399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:51.196033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T11:53:44.853274+0000","last_change":"2023-11-28T11:53:40.828425+0000","last_active":"2023-11-28T11:53:44.853274+0000","last_peered":"2023-11-28T11:53:44.853274+0000","last_clean":"2023-11-28T11:53:44.853274+0000","last_became_active":"2023-11-28T11:53:40.828140+0000","last_became_peered":"2023-11-28T11:53:40.828140+0000","last_unstale":"2023-11-28T11:53:44.853274+0000","last_undegraded":"2023-11-28T11:53:44.853274+0000","last_fullsized":"2023-11-28T11:53:44.853274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:40.404340+0000","last_clean_scrub_stamp":"2023-11-28T11:53:40.404340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:07:55.927473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4527,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9256,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362584,"statfs":{"total":96636764160,"available":96627286016,"internally_reserved":0,"allocated":884736,"data_stored":703105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":108776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8148,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363692,"statfs":{"total":96636764160,"available":96628420608,"internally_reserved":0,"allocated":274432,"data_stored":110398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8224,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363616,"statfs":{"total":96636764160,"available":96628342784,"internally_reserved":0,"allocated":286720,"data_stored":113563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8140,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363700,"statfs":{"total":96636764160,"available":96628428800,"internally_reserved":0,"allocated":266240,"data_stored":108866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":108776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9232,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362608,"statfs":{"total":96636764160,"available":96627310592,"internally_reserved":0,"allocated":860160,"data_stored":700130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12240,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359600,"statfs":{"total":96636764160,"available":96624230400,"internally_reserved":0,"allocated":270336,"data_stored":110328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:54:08.453 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T11:54:08.453 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-28T11:54:08.453 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-28T11:54:08.454 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:54:08.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b19e1700 1 Processor -- start 2023-11-28T11:54:08.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b19e1700 1 -- start start 2023-11-28T11:54:08.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b19e1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ac1606b0 0x7f29ac0c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b19e1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f29ac0ceef0 0x7f29ac0c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b19e1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29ac0ad610 0x7f29ac164040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b19e1700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ac0cae70 con 0x7f29ac0ad610 2023-11-28T11:54:08.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b19e1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ac0cbc10 con 0x7f29ac0ceef0 2023-11-28T11:54:08.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b19e1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0cb130 con 0x7f29ac1606b0 2023-11-28T11:54:08.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b11e0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29ac0ad610 0x7f29ac164040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b11e0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29ac0ad610 0x7f29ac164040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53612/0 (socket says 172.21.15.50:53612) 2023-11-28T11:54:08.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b11e0700 1 -- 172.21.15.50:0/3990676511 learned_addr learned my addr 172.21.15.50:0/3990676511 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:08.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b09df700 1 --2- 172.21.15.50:0/3990676511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ac1606b0 0x7f29ac0c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29abfff700 1 --2- 172.21.15.50:0/3990676511 >> v2:172.21.15.192:3300/0 conn(0x7f29ac0ceef0 0x7f29ac0c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b09df700 1 -- 172.21.15.50:0/3990676511 >> v2:172.21.15.192:3300/0 conn(0x7f29ac0ceef0 msgr2=0x7f29ac0c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:08.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b09df700 1 --2- 172.21.15.50:0/3990676511 >> v2:172.21.15.192:3300/0 conn(0x7f29ac0ceef0 0x7f29ac0c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b09df700 1 -- 172.21.15.50:0/3990676511 >> v2:172.21.15.50:3300/0 conn(0x7f29ac0ad610 msgr2=0x7f29ac164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:08.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b09df700 1 --2- 172.21.15.50:0/3990676511 >> v2:172.21.15.50:3300/0 conn(0x7f29ac0ad610 0x7f29ac164040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b09df700 1 -- 172.21.15.50:0/3990676511 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac0cb410 con 0x7f29ac1606b0 2023-11-28T11:54:08.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b09df700 1 --2- 172.21.15.50:0/3990676511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ac1606b0 0x7f29ac0c13b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0cbf00 tx=0x7f29a0009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0d7437dc5c5bf02 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:08.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29ab7fe700 1 -- 172.21.15.50:0/3990676511 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a0011830 con 0x7f29ac1606b0 2023-11-28T11:54:08.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29ab7fe700 1 -- 172.21.15.50:0/3990676511 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a0011990 con 0x7f29ac1606b0 2023-11-28T11:54:08.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29ab7fe700 1 -- 172.21.15.50:0/3990676511 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a0011d20 con 0x7f29ac1606b0 2023-11-28T11:54:08.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b19e1700 1 -- 172.21.15.50:0/3990676511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ac1606b0 msgr2=0x7f29ac0c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b19e1700 1 --2- 172.21.15.50:0/3990676511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ac1606b0 0x7f29ac0c13b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0cbf00 tx=0x7f29a0009b30 comp rx=0 tx=0).stop 2023-11-28T11:54:08.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b19e1700 1 -- 172.21.15.50:0/3990676511 shutdown_connections 2023-11-28T11:54:08.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b19e1700 1 --2- 172.21.15.50:0/3990676511 >> v2:172.21.15.50:3300/0 conn(0x7f29ac0ad610 0x7f29ac164040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b19e1700 1 --2- 172.21.15.50:0/3990676511 >> v2:172.21.15.192:3300/0 conn(0x7f29ac0ceef0 0x7f29ac0c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b19e1700 1 --2- 172.21.15.50:0/3990676511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ac1606b0 0x7f29ac0c13b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b19e1700 1 -- 172.21.15.50:0/3990676511 >> 172.21.15.50:0/3990676511 conn(0x7f29ac0ce3e0 msgr2=0x7f29ac0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:08.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b19e1700 1 -- 172.21.15.50:0/3990676511 shutdown_connections 2023-11-28T11:54:08.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.560+0000 7f29b19e1700 1 -- 172.21.15.50:0/3990676511 wait complete. 2023-11-28T11:54:08.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b19e1700 1 Processor -- start 2023-11-28T11:54:08.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b19e1700 1 -- start start 2023-11-28T11:54:08.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b19e1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ac0ad610 0x7f29ac15b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b19e1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29ac0ceef0 0x7f29ac0c3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b19e1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29ac1606b0 0x7f29ac1f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b19e1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0c3250 con 0x7f29ac0ceef0 2023-11-28T11:54:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b19e1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac15bb30 con 0x7f29ac1606b0 2023-11-28T11:54:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b19e1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0c2eb0 con 0x7f29ac0ad610 2023-11-28T11:54:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b09df700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ac0ad610 0x7f29ac15b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b09df700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ac0ad610 0x7f29ac15b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:54610/0 (socket says 172.21.15.50:54610) 2023-11-28T11:54:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b09df700 1 -- 172.21.15.50:0/3823854287 learned_addr learned my addr 172.21.15.50:0/3823854287 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b11e0700 1 --2- 172.21.15.50:0/3823854287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29ac1606b0 0x7f29ac1f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29abfff700 1 --2- 172.21.15.50:0/3823854287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29ac0ceef0 0x7f29ac0c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b09df700 1 -- 172.21.15.50:0/3823854287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29ac1606b0 msgr2=0x7f29ac1f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b09df700 1 --2- 172.21.15.50:0/3823854287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29ac1606b0 0x7f29ac1f5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b09df700 1 -- 172.21.15.50:0/3823854287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29ac0ceef0 msgr2=0x7f29ac0c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b09df700 1 --2- 172.21.15.50:0/3823854287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29ac0ceef0 0x7f29ac0c3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b09df700 1 -- 172.21.15.50:0/3823854287 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a00094b0 con 0x7f29ac0ad610 2023-11-28T11:54:08.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b09df700 1 --2- 172.21.15.50:0/3823854287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ac0ad610 0x7f29ac15b5f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009b70 tx=0x7f29a0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:08.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29a97fa700 1 -- 172.21.15.50:0/3823854287 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a0004450 con 0x7f29ac0ad610 2023-11-28T11:54:08.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29a97fa700 1 -- 172.21.15.50:0/3823854287 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a001e070 con 0x7f29ac0ad610 2023-11-28T11:54:08.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29a97fa700 1 -- 172.21.15.50:0/3823854287 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00038c0 con 0x7f29ac0ad610 2023-11-28T11:54:08.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b19e1700 1 -- 172.21.15.50:0/3823854287 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ac0b36c0 con 0x7f29ac0ad610 2023-11-28T11:54:08.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.564+0000 7f29b19e1700 1 -- 172.21.15.50:0/3823854287 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ac0cb6f0 con 0x7f29ac0ad610 2023-11-28T11:54:08.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.568+0000 7f29b19e1700 1 -- 172.21.15.50:0/3823854287 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ac164580 con 0x7f29ac0ad610 2023-11-28T11:54:08.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.568+0000 7f29a97fa700 1 -- 172.21.15.50:0/3823854287 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f29a000f050 con 0x7f29ac0ad610 2023-11-28T11:54:08.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.568+0000 7f29a97fa700 1 --2- 172.21.15.50:0/3823854287 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2990064ee0 0x7f2990067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.568+0000 7f29a97fa700 1 -- 172.21.15.50:0/3823854287 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f29a0083380 con 0x7f29ac0ad610 2023-11-28T11:54:08.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.568+0000 7f29abfff700 1 --2- 172.21.15.50:0/3823854287 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2990064ee0 0x7f2990067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.568+0000 7f29abfff700 1 --2- 172.21.15.50:0/3823854287 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2990064ee0 0x7f2990067390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2998009bf0 tx=0x7f2998009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:08.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.576+0000 7f29a97fa700 1 -- 172.21.15.50:0/3823854287 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f29a0051230 con 0x7f29ac0ad610 2023-11-28T11:54:08.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.768+0000 7f29b19e1700 1 -- 172.21.15.50:0/3823854287 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f29ac0c3390 con 0x7f29ac0ad610 2023-11-28T11:54:08.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.768+0000 7f29a97fa700 1 -- 172.21.15.50:0/3823854287 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f29a0054850 con 0x7f29ac0ad610 2023-11-28T11:54:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:08.773 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-28T11:54:08.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.768+0000 7f29b19e1700 1 -- 172.21.15.50:0/3823854287 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2990064ee0 msgr2=0x7f2990067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.768+0000 7f29b19e1700 1 --2- 172.21.15.50:0/3823854287 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2990064ee0 0x7f2990067390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2998009bf0 tx=0x7f2998009240 comp rx=0 tx=0).stop 2023-11-28T11:54:08.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.768+0000 7f29b19e1700 1 -- 172.21.15.50:0/3823854287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ac0ad610 msgr2=0x7f29ac15b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.768+0000 7f29b19e1700 1 --2- 172.21.15.50:0/3823854287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ac0ad610 0x7f29ac15b5f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009b70 tx=0x7f29a0004770 comp rx=0 tx=0).stop 2023-11-28T11:54:08.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.768+0000 7f29b19e1700 1 -- 172.21.15.50:0/3823854287 shutdown_connections 2023-11-28T11:54:08.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.768+0000 7f29b19e1700 1 --2- 172.21.15.50:0/3823854287 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2990064ee0 0x7f2990067390 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.768+0000 7f29b19e1700 1 --2- 172.21.15.50:0/3823854287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29ac1606b0 0x7f29ac1f5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.768+0000 7f29b19e1700 1 --2- 172.21.15.50:0/3823854287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29ac0ceef0 0x7f29ac0c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.768+0000 7f29b19e1700 1 --2- 172.21.15.50:0/3823854287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ac0ad610 0x7f29ac15b5f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.768+0000 7f29b19e1700 1 -- 172.21.15.50:0/3823854287 >> 172.21.15.50:0/3823854287 conn(0x7f29ac0ce3e0 msgr2=0x7f29ac0cd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:08.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.768+0000 7f29b19e1700 1 -- 172.21.15.50:0/3823854287 shutdown_connections 2023-11-28T11:54:08.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.768+0000 7f29b19e1700 1 -- 172.21.15.50:0/3823854287 wait complete. 2023-11-28T11:54:08.787 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-28T11:54:08.788 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc21f99700 1 Processor -- start 2023-11-28T11:54:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc21f99700 1 -- start start 2023-11-28T11:54:08.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc21f99700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc1c1607b0 0x7fdc1c0cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc21f99700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdc1c0cc430 0x7fdc1c0ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc21f99700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1c15c520 con 0x7fdc1c15c150 2023-11-28T11:54:08.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc21f99700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc1c160c00 con 0x7fdc1c0cc430 2023-11-28T11:54:08.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc21f99700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c0ca680 con 0x7fdc1c1607b0 2023-11-28T11:54:08.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc20f97700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdc1c15c150 0x7fdc1c0c9e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56518/0 (socket says 172.21.15.50:56518) 2023-11-28T11:54:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc20f97700 1 -- 172.21.15.50:0/3754528904 learned_addr learned my addr 172.21.15.50:0/3754528904 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc1bfff700 1 --2- 172.21.15.50:0/3754528904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc1c1607b0 0x7fdc1c0cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc21798700 1 --2- 172.21.15.50:0/3754528904 >> v2:172.21.15.192:3300/0 conn(0x7fdc1c0cc430 0x7fdc1c0ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc1b7fe700 1 -- 172.21.15.50:0/3754528904 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991704532 0 0) 0x7fdc1c15c520 con 0x7fdc1c15c150 2023-11-28T11:54:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc1b7fe700 1 -- 172.21.15.50:0/3754528904 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc0c0035d0 con 0x7fdc1c15c150 2023-11-28T11:54:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc1b7fe700 1 -- 172.21.15.50:0/3754528904 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 206325062 0 0) 0x7fdc0c0035d0 con 0x7fdc1c15c150 2023-11-28T11:54:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc1b7fe700 1 -- 172.21.15.50:0/3754528904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc1c1607b0 msgr2=0x7fdc1c0cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc1b7fe700 1 --2- 172.21.15.50:0/3754528904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc1c1607b0 0x7fdc1c0cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc1b7fe700 1 -- 172.21.15.50:0/3754528904 >> v2:172.21.15.192:3300/0 conn(0x7fdc1c0cc430 msgr2=0x7fdc1c0ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.896+0000 7fdc1b7fe700 1 --2- 172.21.15.50:0/3754528904 >> v2:172.21.15.192:3300/0 conn(0x7fdc1c0cc430 0x7fdc1c0ce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1b7fe700 1 -- 172.21.15.50:0/3754528904 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c0ca960 con 0x7fdc1c15c150 2023-11-28T11:54:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1b7fe700 1 -- 172.21.15.50:0/3754528904 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7fdc10001670 con 0x7fdc1c15c150 2023-11-28T11:54:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1b7fe700 1 -- 172.21.15.50:0/3754528904 >> v1:172.21.15.50:6789/0 conn(0x7fdc1c15c150 legacy=0x7fdc1c0c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1b7fe700 1 --2- 172.21.15.50:0/3754528904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc1c1607b0 0x7fdc0c003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1b7fe700 1 --2- 172.21.15.50:0/3754528904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc0c003fa0 0x7fdc0c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1b7fe700 1 --2- 172.21.15.50:0/3754528904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0c004db0 0x7fdc0c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1b7fe700 1 -- 172.21.15.50:0/3754528904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c160c00 con 0x7fdc0c003fa0 2023-11-28T11:54:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1b7fe700 1 -- 172.21.15.50:0/3754528904 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c0ca680 con 0x7fdc0c004db0 2023-11-28T11:54:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1b7fe700 1 -- 172.21.15.50:0/3754528904 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c00ba30 con 0x7fdc1c1607b0 2023-11-28T11:54:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1bfff700 1 --2- 172.21.15.50:0/3754528904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc0c003fa0 0x7fdc0c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc20f97700 1 --2- 172.21.15.50:0/3754528904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc1c1607b0 0x7fdc0c003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc21798700 1 --2- 172.21.15.50:0/3754528904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0c004db0 0x7fdc0c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1bfff700 1 -- 172.21.15.50:0/3754528904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc1c1607b0 msgr2=0x7fdc0c003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1bfff700 1 --2- 172.21.15.50:0/3754528904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc1c1607b0 0x7fdc0c003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1bfff700 1 -- 172.21.15.50:0/3754528904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0c004db0 msgr2=0x7fdc0c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1bfff700 1 --2- 172.21.15.50:0/3754528904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0c004db0 0x7fdc0c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1bfff700 1 -- 172.21.15.50:0/3754528904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c0035d0 con 0x7fdc0c003fa0 2023-11-28T11:54:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc21798700 1 --2- 172.21.15.50:0/3754528904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0c004db0 0x7fdc0c005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc20f97700 1 --2- 172.21.15.50:0/3754528904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc1c1607b0 0x7fdc0c003a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1bfff700 1 --2- 172.21.15.50:0/3754528904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc0c003fa0 0x7fdc0c004870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009b70 tx=0x7fdc0c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916435bc4e795eab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1b7fe700 1 -- 172.21.15.50:0/3754528904 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0800e6c0 con 0x7fdc0c003fa0 2023-11-28T11:54:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1b7fe700 1 -- 172.21.15.50:0/3754528904 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0800e820 con 0x7fdc0c003fa0 2023-11-28T11:54:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc1b7fe700 1 -- 172.21.15.50:0/3754528904 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0800eb90 con 0x7fdc0c003fa0 2023-11-28T11:54:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc21f99700 1 -- 172.21.15.50:0/3754528904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc0c003fa0 msgr2=0x7fdc0c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc21f99700 1 --2- 172.21.15.50:0/3754528904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc0c003fa0 0x7fdc0c004870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009b70 tx=0x7fdc0c0058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc21798700 1 -- 172.21.15.50:0/3754528904 reap_dead start 2023-11-28T11:54:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc21f99700 1 -- 172.21.15.50:0/3754528904 shutdown_connections 2023-11-28T11:54:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc21f99700 1 -- 172.21.15.50:0/3754528904 >> 172.21.15.50:0/3754528904 conn(0x7fdc1c06ec40 msgr2=0x7fdc1c0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc21f99700 1 -- 172.21.15.50:0/3754528904 shutdown_connections 2023-11-28T11:54:08.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc21f99700 1 -- 172.21.15.50:0/3754528904 wait complete. 2023-11-28T11:54:08.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc21f99700 1 Processor -- start 2023-11-28T11:54:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.900+0000 7fdc21f99700 1 -- start start 2023-11-28T11:54:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc21f99700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0c003fa0 0x7fdc1c0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc21f99700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc1c0ad270 0x7fdc1c0ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc21f99700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc1c156920 0x7fdc1c156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc21f99700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c1572d0 con 0x7fdc1c156920 2023-11-28T11:54:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc21f99700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c0b2500 con 0x7fdc0c003fa0 2023-11-28T11:54:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc21f99700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c0b27e0 con 0x7fdc1c0ad270 2023-11-28T11:54:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc21798700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc1c156920 0x7fdc1c156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc20f97700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0c003fa0 0x7fdc1c0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc21798700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc1c156920 0x7fdc1c156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53634/0 (socket says 172.21.15.50:53634) 2023-11-28T11:54:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc21798700 1 -- 172.21.15.50:0/2378982011 learned_addr learned my addr 172.21.15.50:0/2378982011 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc1bfff700 1 --2- 172.21.15.50:0/2378982011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc1c0ad270 0x7fdc1c0ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc21798700 1 -- 172.21.15.50:0/2378982011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc1c0ad270 msgr2=0x7fdc1c0ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc21798700 1 --2- 172.21.15.50:0/2378982011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc1c0ad270 0x7fdc1c0ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc21798700 1 -- 172.21.15.50:0/2378982011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0c003fa0 msgr2=0x7fdc1c0c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc21798700 1 --2- 172.21.15.50:0/2378982011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0c003fa0 0x7fdc1c0c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc21798700 1 -- 172.21.15.50:0/2378982011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c0cdb20 con 0x7fdc1c156920 2023-11-28T11:54:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc21798700 1 --2- 172.21.15.50:0/2378982011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc1c156920 0x7fdc1c156d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c072420 tx=0x7fdc140104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc197fa700 1 -- 172.21.15.50:0/2378982011 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1400e050 con 0x7fdc1c156920 2023-11-28T11:54:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc197fa700 1 -- 172.21.15.50:0/2378982011 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1400f040 con 0x7fdc1c156920 2023-11-28T11:54:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc21f99700 1 -- 172.21.15.50:0/2378982011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1c0cd840 con 0x7fdc1c156920 2023-11-28T11:54:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc197fa700 1 -- 172.21.15.50:0/2378982011 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14010d00 con 0x7fdc1c156920 2023-11-28T11:54:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.904+0000 7fdc21f99700 1 -- 172.21.15.50:0/2378982011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1c0cde00 con 0x7fdc1c156920 2023-11-28T11:54:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.908+0000 7fdc197fa700 1 -- 172.21.15.50:0/2378982011 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdc14015440 con 0x7fdc1c156920 2023-11-28T11:54:08.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.908+0000 7fdc21f99700 1 -- 172.21.15.50:0/2378982011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1c072c20 con 0x7fdc1c156920 2023-11-28T11:54:08.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.908+0000 7fdc197fa700 1 --2- 172.21.15.50:0/2378982011 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc00064f10 0x7fdc000673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:08.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.908+0000 7fdc197fa700 1 -- 172.21.15.50:0/2378982011 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdc14082340 con 0x7fdc1c156920 2023-11-28T11:54:08.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.908+0000 7fdc20f97700 1 --2- 172.21.15.50:0/2378982011 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc00064f10 0x7fdc000673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:08.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.908+0000 7fdc20f97700 1 --2- 172.21.15.50:0/2378982011 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc00064f10 0x7fdc000673c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c0b1680 tx=0x7fdc10007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:08.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:08.912+0000 7fdc197fa700 1 -- 172.21.15.50:0/2378982011 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdc14050190 con 0x7fdc1c156920 2023-11-28T11:54:09.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.076+0000 7fdc21f99700 1 -- 172.21.15.50:0/2378982011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc1c0b2920 con 0x7fdc1c156920 2023-11-28T11:54:09.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.080+0000 7fdc197fa700 1 -- 172.21.15.50:0/2378982011 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7fdc14007ea0 con 0x7fdc1c156920 2023-11-28T11:54:09.085 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:09.086 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:45.231747+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.084+0000 7fdc21f99700 1 -- 172.21.15.50:0/2378982011 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc00064f10 msgr2=0x7fdc000673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.084+0000 7fdc21f99700 1 --2- 172.21.15.50:0/2378982011 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc00064f10 0x7fdc000673c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c0b1680 tx=0x7fdc10007040 comp rx=0 tx=0).stop 2023-11-28T11:54:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.084+0000 7fdc21f99700 1 -- 172.21.15.50:0/2378982011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc1c156920 msgr2=0x7fdc1c156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.084+0000 7fdc21f99700 1 --2- 172.21.15.50:0/2378982011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc1c156920 0x7fdc1c156d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c072420 tx=0x7fdc140104a0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.084+0000 7fdc21f99700 1 -- 172.21.15.50:0/2378982011 shutdown_connections 2023-11-28T11:54:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.084+0000 7fdc21f99700 1 --2- 172.21.15.50:0/2378982011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc1c156920 0x7fdc1c156d90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.084+0000 7fdc21f99700 1 --2- 172.21.15.50:0/2378982011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc1c0ad270 0x7fdc1c0ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.084+0000 7fdc21f99700 1 --2- 172.21.15.50:0/2378982011 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc00064f10 0x7fdc000673c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.084+0000 7fdc21f99700 1 --2- 172.21.15.50:0/2378982011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0c003fa0 0x7fdc1c0c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.084+0000 7fdc21f99700 1 -- 172.21.15.50:0/2378982011 >> 172.21.15.50:0/2378982011 conn(0x7fdc1c06ec40 msgr2=0x7fdc1c157b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.084+0000 7fdc21f99700 1 -- 172.21.15.50:0/2378982011 shutdown_connections 2023-11-28T11:54:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.084+0000 7fdc21f99700 1 -- 172.21.15.50:0/2378982011 wait complete. 2023-11-28T11:54:09.100 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:53:38.462826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:53:39.778621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:53:42.870360+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:54:09.101 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:54:09.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b8cc1700 1 Processor -- start 2023-11-28T11:54:09.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b8cc1700 1 -- start start 2023-11-28T11:54:09.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b8cc1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3b415a430 0x7fe3b40cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b8cc1700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b406a490 con 0x7fe3b40ac230 2023-11-28T11:54:09.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b8cc1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b406a770 con 0x7fe3b415a060 2023-11-28T11:54:09.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b8cc1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b406aa50 con 0x7fe3b415a430 2023-11-28T11:54:09.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b3fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe3b40ac230 0x7fe3b40b1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56532/0 (socket says 172.21.15.50:56532) 2023-11-28T11:54:09.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b3fff700 1 -- 172.21.15.50:0/386135749 learned_addr learned my addr 172.21.15.50:0/386135749 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:09.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b2ffd700 1 --2- 172.21.15.50:0/386135749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3b415a430 0x7fe3b40cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b27fc700 1 -- 172.21.15.50:0/386135749 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13808426 0 0) 0x7fe3b406a490 con 0x7fe3b40ac230 2023-11-28T11:54:09.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b27fc700 1 -- 172.21.15.50:0/386135749 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3a00035d0 con 0x7fe3b40ac230 2023-11-28T11:54:09.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b27fc700 1 -- 172.21.15.50:0/386135749 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134879347 0 0) 0x7fe3b406a770 con 0x7fe3b415a060 2023-11-28T11:54:09.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b27fc700 1 -- 172.21.15.50:0/386135749 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3b406a490 con 0x7fe3b415a060 2023-11-28T11:54:09.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b27fc700 1 -- 172.21.15.50:0/386135749 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3699553490 0 0) 0x7fe3a00035d0 con 0x7fe3b40ac230 2023-11-28T11:54:09.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b27fc700 1 -- 172.21.15.50:0/386135749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3b415a430 msgr2=0x7fe3b40cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:09.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b27fc700 1 --2- 172.21.15.50:0/386135749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3b415a430 0x7fe3b40cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b27fc700 1 -- 172.21.15.50:0/386135749 >> v1:172.21.15.192:6789/0 conn(0x7fe3b415a060 legacy=0x7fe3b4069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b27fc700 1 -- 172.21.15.50:0/386135749 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b406ad30 con 0x7fe3b40ac230 2023-11-28T11:54:09.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b27fc700 1 -- 172.21.15.50:0/386135749 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7fe3ac0019f0 con 0x7fe3b40ac230 2023-11-28T11:54:09.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.212+0000 7fe3b27fc700 1 -- 172.21.15.50:0/386135749 >> v1:172.21.15.50:6789/0 conn(0x7fe3b40ac230 legacy=0x7fe3b40b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b27fc700 1 --2- 172.21.15.50:0/386135749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3b415a430 0x7fe3a0003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b27fc700 1 --2- 172.21.15.50:0/386135749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a0004140 0x7fe3a0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b27fc700 1 --2- 172.21.15.50:0/386135749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3a0004db0 0x7fe3a0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b27fc700 1 -- 172.21.15.50:0/386135749 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b406aa50 con 0x7fe3a0004140 2023-11-28T11:54:09.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b27fc700 1 -- 172.21.15.50:0/386135749 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a000bae0 con 0x7fe3a0004db0 2023-11-28T11:54:09.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b27fc700 1 -- 172.21.15.50:0/386135749 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a000bca0 con 0x7fe3b415a430 2023-11-28T11:54:09.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b37fe700 1 --2- 172.21.15.50:0/386135749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3b415a430 0x7fe3a0003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b2ffd700 1 --2- 172.21.15.50:0/386135749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a0004140 0x7fe3a0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b3fff700 1 --2- 172.21.15.50:0/386135749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3a0004db0 0x7fe3a0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b37fe700 1 -- 172.21.15.50:0/386135749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3a0004db0 msgr2=0x7fe3a0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:09.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b37fe700 1 --2- 172.21.15.50:0/386135749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3a0004db0 0x7fe3a0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b37fe700 1 -- 172.21.15.50:0/386135749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a0004140 msgr2=0x7fe3a0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:09.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b37fe700 1 --2- 172.21.15.50:0/386135749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3a0004140 0x7fe3a0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b37fe700 1 -- 172.21.15.50:0/386135749 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a00035d0 con 0x7fe3b415a430 2023-11-28T11:54:09.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b37fe700 1 --2- 172.21.15.50:0/386135749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3b415a430 0x7fe3a0003be0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4007fd0 tx=0x7fe3a00058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=914b4f7789717f9f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:09.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b27fc700 1 -- 172.21.15.50:0/386135749 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4001450 con 0x7fe3b415a430 2023-11-28T11:54:09.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b27fc700 1 -- 172.21.15.50:0/386135749 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a40052f0 con 0x7fe3b415a430 2023-11-28T11:54:09.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b27fc700 1 -- 172.21.15.50:0/386135749 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4001d60 con 0x7fe3b415a430 2023-11-28T11:54:09.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b8cc1700 1 -- 172.21.15.50:0/386135749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3b415a430 msgr2=0x7fe3a0003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b8cc1700 1 --2- 172.21.15.50:0/386135749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3b415a430 0x7fe3a0003be0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4007fd0 tx=0x7fe3a00058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b3fff700 1 -- 172.21.15.50:0/386135749 reap_dead start 2023-11-28T11:54:09.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b8cc1700 1 -- 172.21.15.50:0/386135749 shutdown_connections 2023-11-28T11:54:09.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b8cc1700 1 -- 172.21.15.50:0/386135749 >> 172.21.15.50:0/386135749 conn(0x7fe3b40cae70 msgr2=0x7fe3b40cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:09.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b8cc1700 1 -- 172.21.15.50:0/386135749 shutdown_connections 2023-11-28T11:54:09.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b8cc1700 1 -- 172.21.15.50:0/386135749 wait complete. 2023-11-28T11:54:09.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b8cc1700 1 Processor -- start 2023-11-28T11:54:09.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b8cc1700 1 -- start start 2023-11-28T11:54:09.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b8cc1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3b415a430 0x7fe3b414e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b8cc1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3b406fc40 0x7fe3b40700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.216+0000 7fe3b8cc1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b41565d0 0x7fe3b4156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3b8cc1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b414e980 con 0x7fe3b41565d0 2023-11-28T11:54:09.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3b8cc1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b40705f0 con 0x7fe3b406fc40 2023-11-28T11:54:09.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3b8cc1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b4156f80 con 0x7fe3b415a430 2023-11-28T11:54:09.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3b3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b41565d0 0x7fe3b4156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3b3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b41565d0 0x7fe3b4156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53640/0 (socket says 172.21.15.50:53640) 2023-11-28T11:54:09.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3b3fff700 1 -- 172.21.15.50:0/3270520610 learned_addr learned my addr 172.21.15.50:0/3270520610 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:09.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3b37fe700 1 --2- 172.21.15.50:0/3270520610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3b415a430 0x7fe3b414e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3b2ffd700 1 --2- 172.21.15.50:0/3270520610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3b406fc40 0x7fe3b40700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3b3fff700 1 -- 172.21.15.50:0/3270520610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3b415a430 msgr2=0x7fe3b414e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3b3fff700 1 --2- 172.21.15.50:0/3270520610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3b415a430 0x7fe3b414e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3b3fff700 1 -- 172.21.15.50:0/3270520610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3b406fc40 msgr2=0x7fe3b40700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3b3fff700 1 --2- 172.21.15.50:0/3270520610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3b406fc40 0x7fe3b40700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3b3fff700 1 -- 172.21.15.50:0/3270520610 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b406b530 con 0x7fe3b41565d0 2023-11-28T11:54:09.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3b3fff700 1 --2- 172.21.15.50:0/3270520610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b41565d0 0x7fe3b4156a40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40b0c30 tx=0x7fe3ac007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:09.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3abfff700 1 -- 172.21.15.50:0/3270520610 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac00abb0 con 0x7fe3b41565d0 2023-11-28T11:54:09.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3abfff700 1 -- 172.21.15.50:0/3270520610 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac00ad30 con 0x7fe3b41565d0 2023-11-28T11:54:09.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3b8cc1700 1 -- 172.21.15.50:0/3270520610 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b406b010 con 0x7fe3b41565d0 2023-11-28T11:54:09.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3abfff700 1 -- 172.21.15.50:0/3270520610 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac00aea0 con 0x7fe3b41565d0 2023-11-28T11:54:09.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3b8cc1700 1 -- 172.21.15.50:0/3270520610 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b40b1950 con 0x7fe3b41565d0 2023-11-28T11:54:09.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3b8cc1700 1 -- 172.21.15.50:0/3270520610 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b4072500 con 0x7fe3b41565d0 2023-11-28T11:54:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.220+0000 7fe3abfff700 1 -- 172.21.15.50:0/3270520610 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe3ac013630 con 0x7fe3b41565d0 2023-11-28T11:54:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.224+0000 7fe3abfff700 1 --2- 172.21.15.50:0/3270520610 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe394064f10 0x7fe3940673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.224+0000 7fe3abfff700 1 -- 172.21.15.50:0/3270520610 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe3ac0829d0 con 0x7fe3b41565d0 2023-11-28T11:54:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.224+0000 7fe3b37fe700 1 --2- 172.21.15.50:0/3270520610 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe394064f10 0x7fe3940673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.224+0000 7fe3b37fe700 1 --2- 172.21.15.50:0/3270520610 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe394064f10 0x7fe3940673c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4015040 tx=0x7fe3a400a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.232+0000 7fe3abfff700 1 -- 172.21.15.50:0/3270520610 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe3ac0507f0 con 0x7fe3b41565d0 2023-11-28T11:54:09.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.388+0000 7fe3b8cc1700 1 -- 172.21.15.50:0/3270520610 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe3b4070a70 con 0x7fe3b41565d0 2023-11-28T11:54:09.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.392+0000 7fe3abfff700 1 -- 172.21.15.50:0/3270520610 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe3ac053e10 con 0x7fe3b41565d0 2023-11-28T11:54:09.395 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:54:09.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.392+0000 7fe3b8cc1700 1 -- 172.21.15.50:0/3270520610 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe394064f10 msgr2=0x7fe3940673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.392+0000 7fe3b8cc1700 1 --2- 172.21.15.50:0/3270520610 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe394064f10 0x7fe3940673c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4015040 tx=0x7fe3a400a000 comp rx=0 tx=0).stop 2023-11-28T11:54:09.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.392+0000 7fe3b8cc1700 1 -- 172.21.15.50:0/3270520610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b41565d0 msgr2=0x7fe3b4156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.392+0000 7fe3b8cc1700 1 --2- 172.21.15.50:0/3270520610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b41565d0 0x7fe3b4156a40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40b0c30 tx=0x7fe3ac007ca0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.392+0000 7fe3b8cc1700 1 -- 172.21.15.50:0/3270520610 shutdown_connections 2023-11-28T11:54:09.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.392+0000 7fe3b8cc1700 1 --2- 172.21.15.50:0/3270520610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3b41565d0 0x7fe3b4156a40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.392+0000 7fe3b8cc1700 1 --2- 172.21.15.50:0/3270520610 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe394064f10 0x7fe3940673c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.392+0000 7fe3b8cc1700 1 --2- 172.21.15.50:0/3270520610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3b406fc40 0x7fe3b40700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.392+0000 7fe3b8cc1700 1 --2- 172.21.15.50:0/3270520610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3b415a430 0x7fe3b414e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.392+0000 7fe3b8cc1700 1 -- 172.21.15.50:0/3270520610 >> 172.21.15.50:0/3270520610 conn(0x7fe3b40cae70 msgr2=0x7fe3b4070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:09.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.392+0000 7fe3b8cc1700 1 -- 172.21.15.50:0/3270520610 shutdown_connections 2023-11-28T11:54:09.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.392+0000 7fe3b8cc1700 1 -- 172.21.15.50:0/3270520610 wait complete. 2023-11-28T11:54:09.415 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:54:09.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.524+0000 7f1cdcb07700 1 Processor -- start 2023-11-28T11:54:09.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.524+0000 7f1cdcb07700 1 -- start start 2023-11-28T11:54:09.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cdcb07700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1cd80b1ae0 0x7f1cd806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cdcb07700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cd806a4c0 0x7f1cd80d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cdcb07700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd806a9c0 con 0x7f1cd80cf0e0 2023-11-28T11:54:09.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cdcb07700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd806aca0 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cdcb07700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd806af80 con 0x7f1cd806a4c0 2023-11-28T11:54:09.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cd7fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1cd80cf0e0 0x7f1cd80b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56538/0 (socket says 172.21.15.50:56538) 2023-11-28T11:54:09.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cd7fff700 1 -- 172.21.15.50:0/1442066214 learned_addr learned my addr 172.21.15.50:0/1442066214 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:09.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cd77fe700 1 --2- 172.21.15.50:0/1442066214 >> v2:172.21.15.192:3300/0 conn(0x7f1cd80b1ae0 0x7f1cd806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cceffd700 1 --2- 172.21.15.50:0/1442066214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cd806a4c0 0x7f1cd80d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cd6ffd700 1 -- 172.21.15.50:0/1442066214 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727683104 0 0) 0x7f1cd806a9c0 con 0x7f1cd80cf0e0 2023-11-28T11:54:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cd6ffd700 1 -- 172.21.15.50:0/1442066214 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cc40035d0 con 0x7f1cd80cf0e0 2023-11-28T11:54:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cd77fe700 1 -- 172.21.15.50:0/1442066214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cd806a4c0 msgr2=0x7f1cd80d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cd77fe700 1 --2- 172.21.15.50:0/1442066214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cd806a4c0 0x7f1cd80d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cd77fe700 1 -- 172.21.15.50:0/1442066214 >> v1:172.21.15.50:6789/0 conn(0x7f1cd80cf0e0 legacy=0x7f1cd80b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cd6ffd700 1 -- 172.21.15.50:0/1442066214 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2978408519 0 0) 0x7f1cc40035d0 con 0x7f1cd80cf0e0 2023-11-28T11:54:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cd77fe700 1 -- 172.21.15.50:0/1442066214 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd80b4380 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cd77fe700 1 --2- 172.21.15.50:0/1442066214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cd80b1ae0 0x7f1cd806d8e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8009850 tx=0x7f1cc8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45e2192b663d95b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cd6ffd700 1 -- 172.21.15.50:0/1442066214 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00019f0 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cd6ffd700 1 -- 172.21.15.50:0/1442066214 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc8004030 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cd6ffd700 1 -- 172.21.15.50:0/1442066214 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc80043e0 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cdcb07700 1 -- 172.21.15.50:0/1442066214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cd80b1ae0 msgr2=0x7f1cd806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cdcb07700 1 --2- 172.21.15.50:0/1442066214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cd80b1ae0 0x7f1cd806d8e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8009850 tx=0x7f1cc8009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cdcb07700 1 -- 172.21.15.50:0/1442066214 shutdown_connections 2023-11-28T11:54:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cdcb07700 1 --2- 172.21.15.50:0/1442066214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cd806a4c0 0x7f1cd80d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cdcb07700 1 --2- 172.21.15.50:0/1442066214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cd80b1ae0 0x7f1cd806d8e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cdcb07700 1 -- 172.21.15.50:0/1442066214 >> 172.21.15.50:0/1442066214 conn(0x7f1cd809bbd0 msgr2=0x7f1cd80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cdcb07700 1 -- 172.21.15.50:0/1442066214 shutdown_connections 2023-11-28T11:54:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.528+0000 7f1cdcb07700 1 -- 172.21.15.50:0/1442066214 wait complete. 2023-11-28T11:54:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.532+0000 7f1cdcb07700 1 Processor -- start 2023-11-28T11:54:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.532+0000 7f1cdcb07700 1 -- start start 2023-11-28T11:54:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cdcb07700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cd806a4c0 0x7f1cd8157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cdcb07700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd80b1ae0 0x7f1cd815b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cdcb07700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cd80cf0e0 0x7f1cd815b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cdcb07700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd8159e90 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cdcb07700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd80c6830 con 0x7f1cd80cf0e0 2023-11-28T11:54:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cdcb07700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd8159310 con 0x7f1cd806a4c0 2023-11-28T11:54:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cceffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd80b1ae0 0x7f1cd815b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cceffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd80b1ae0 0x7f1cd815b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53646/0 (socket says 172.21.15.50:53646) 2023-11-28T11:54:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cceffd700 1 -- 172.21.15.50:0/264271184 learned_addr learned my addr 172.21.15.50:0/264271184 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cd7fff700 1 --2- 172.21.15.50:0/264271184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cd80cf0e0 0x7f1cd815b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cd77fe700 1 --2- 172.21.15.50:0/264271184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cd806a4c0 0x7f1cd8157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cceffd700 1 -- 172.21.15.50:0/264271184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cd806a4c0 msgr2=0x7f1cd8157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cceffd700 1 --2- 172.21.15.50:0/264271184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cd806a4c0 0x7f1cd8157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cceffd700 1 -- 172.21.15.50:0/264271184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cd80cf0e0 msgr2=0x7f1cd815b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cceffd700 1 --2- 172.21.15.50:0/264271184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cd80cf0e0 0x7f1cd815b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cceffd700 1 -- 172.21.15.50:0/264271184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc80094b0 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cd77fe700 1 --2- 172.21.15.50:0/264271184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cd806a4c0 0x7f1cd8157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:09.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cceffd700 1 --2- 172.21.15.50:0/264271184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd80b1ae0 0x7f1cd815b080 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009fd0 tx=0x7f1cc000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:09.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cd4ff9700 1 -- 172.21.15.50:0/264271184 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00095a0 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cd4ff9700 1 -- 172.21.15.50:0/264271184 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc0013680 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cdcb07700 1 -- 172.21.15.50:0/264271184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd80b60e0 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cd4ff9700 1 -- 172.21.15.50:0/264271184 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0013a30 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cdcb07700 1 -- 172.21.15.50:0/264271184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd80b1eb0 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.536+0000 7f1cdcb07700 1 -- 172.21.15.50:0/264271184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd80d08e0 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.540+0000 7f1cd4ff9700 1 -- 172.21.15.50:0/264271184 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1cc0023070 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.540+0000 7f1cd4ff9700 1 --2- 172.21.15.50:0/264271184 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1cb8064ee0 0x7f1cb8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.540+0000 7f1cd4ff9700 1 -- 172.21.15.50:0/264271184 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1cc00826c0 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.540+0000 7f1cd77fe700 1 --2- 172.21.15.50:0/264271184 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1cb8064ee0 0x7f1cb8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.540+0000 7f1cd77fe700 1 --2- 172.21.15.50:0/264271184 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1cb8064ee0 0x7f1cb8067390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80090b0 tx=0x7f1cc8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:09.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.544+0000 7f1cd4ff9700 1 -- 172.21.15.50:0/264271184 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1cc0050610 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.704+0000 7f1cdcb07700 1 -- 172.21.15.50:0/264271184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1cd80b1220 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.704+0000 7f1cd4ff9700 1 -- 172.21.15.50:0/264271184 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1cc0053c30 con 0x7f1cd80b1ae0 2023-11-28T11:54:09.709 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:54:09.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.704+0000 7f1cdcb07700 1 -- 172.21.15.50:0/264271184 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1cb8064ee0 msgr2=0x7f1cb8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.704+0000 7f1cdcb07700 1 --2- 172.21.15.50:0/264271184 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1cb8064ee0 0x7f1cb8067390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80090b0 tx=0x7f1cc8008030 comp rx=0 tx=0).stop 2023-11-28T11:54:09.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.704+0000 7f1cdcb07700 1 -- 172.21.15.50:0/264271184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd80b1ae0 msgr2=0x7f1cd815b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.704+0000 7f1cdcb07700 1 --2- 172.21.15.50:0/264271184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd80b1ae0 0x7f1cd815b080 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009fd0 tx=0x7f1cc000eb20 comp rx=0 tx=0).stop 2023-11-28T11:54:09.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.704+0000 7f1cdcb07700 1 -- 172.21.15.50:0/264271184 shutdown_connections 2023-11-28T11:54:09.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.704+0000 7f1cdcb07700 1 --2- 172.21.15.50:0/264271184 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1cb8064ee0 0x7f1cb8067390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.704+0000 7f1cdcb07700 1 --2- 172.21.15.50:0/264271184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cd80cf0e0 0x7f1cd815b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.704+0000 7f1cdcb07700 1 --2- 172.21.15.50:0/264271184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cd80b1ae0 0x7f1cd815b080 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.704+0000 7f1cdcb07700 1 --2- 172.21.15.50:0/264271184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cd806a4c0 0x7f1cd8157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.704+0000 7f1cdcb07700 1 -- 172.21.15.50:0/264271184 >> 172.21.15.50:0/264271184 conn(0x7f1cd809bbd0 msgr2=0x7f1cd80b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:09.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.704+0000 7f1cdcb07700 1 -- 172.21.15.50:0/264271184 shutdown_connections 2023-11-28T11:54:09.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.704+0000 7f1cdcb07700 1 -- 172.21.15.50:0/264271184 wait complete. 2023-11-28T11:54:09.724 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:54:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d3fff700 1 Processor -- start 2023-11-28T11:54:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d3fff700 1 -- start start 2023-11-28T11:54:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4d406cdd0 0x7fd4d406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d3fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4d406aef0 0x7fd4d40b4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d3fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d40d0140 con 0x7fd4d406b320 2023-11-28T11:54:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d3fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d406d6e0 con 0x7fd4d406cdd0 2023-11-28T11:54:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d3fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d415c670 con 0x7fd4d406aef0 2023-11-28T11:54:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d2ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4d406cdd0 0x7fd4d406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d2ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4d406cdd0 0x7fd4d406d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53650/0 (socket says 172.21.15.50:53650) 2023-11-28T11:54:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d2ffd700 1 -- 172.21.15.50:0/1306154044 learned_addr learned my addr 172.21.15.50:0/1306154044 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d27fc700 1 --2- 172.21.15.50:0/1306154044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4d406aef0 0x7fd4d40b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d2ffd700 1 -- 172.21.15.50:0/1306154044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4d406aef0 msgr2=0x7fd4d40b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d2ffd700 1 --2- 172.21.15.50:0/1306154044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4d406aef0 0x7fd4d40b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d2ffd700 1 -- 172.21.15.50:0/1306154044 >> v1:172.21.15.50:6789/0 conn(0x7fd4d406b320 legacy=0x7fd4d40b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d2ffd700 1 -- 172.21.15.50:0/1306154044 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d40cf530 con 0x7fd4d406cdd0 2023-11-28T11:54:09.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d2ffd700 1 --2- 172.21.15.50:0/1306154044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d406cdd0 0x7fd4d406d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009910 tx=0x7fd4c4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c886cd44f2050320 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d1ffb700 1 -- 172.21.15.50:0/1306154044 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4005e50 con 0x7fd4d406cdd0 2023-11-28T11:54:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d1ffb700 1 -- 172.21.15.50:0/1306154044 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c4009e60 con 0x7fd4d406cdd0 2023-11-28T11:54:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d1ffb700 1 -- 172.21.15.50:0/1306154044 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c400b870 con 0x7fd4d406cdd0 2023-11-28T11:54:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d3fff700 1 -- 172.21.15.50:0/1306154044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d406cdd0 msgr2=0x7fd4d406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d3fff700 1 --2- 172.21.15.50:0/1306154044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d406cdd0 0x7fd4d406d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009910 tx=0x7fd4c4009c20 comp rx=0 tx=0).stop 2023-11-28T11:54:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d3fff700 1 -- 172.21.15.50:0/1306154044 shutdown_connections 2023-11-28T11:54:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d3fff700 1 --2- 172.21.15.50:0/1306154044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4d406aef0 0x7fd4d40b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d3fff700 1 --2- 172.21.15.50:0/1306154044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d406cdd0 0x7fd4d406d1a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.840+0000 7fd4d3fff700 1 -- 172.21.15.50:0/1306154044 >> 172.21.15.50:0/1306154044 conn(0x7fd4d409bb10 msgr2=0x7fd4d40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:09.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.844+0000 7fd4d3fff700 1 -- 172.21.15.50:0/1306154044 shutdown_connections 2023-11-28T11:54:09.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.844+0000 7fd4d3fff700 1 -- 172.21.15.50:0/1306154044 wait complete. 2023-11-28T11:54:09.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.844+0000 7fd4d3fff700 1 Processor -- start 2023-11-28T11:54:09.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.844+0000 7fd4d3fff700 1 -- start start 2023-11-28T11:54:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.844+0000 7fd4d3fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4d406aef0 0x7fd4d40b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.844+0000 7fd4d3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4d406b320 0x7fd4d40d1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.844+0000 7fd4d3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d406cdd0 0x7fd4d40d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.844+0000 7fd4d3fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40d29f0 con 0x7fd4d406cdd0 2023-11-28T11:54:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.844+0000 7fd4d3fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40b2c10 con 0x7fd4d406b320 2023-11-28T11:54:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.844+0000 7fd4d3fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40b22e0 con 0x7fd4d406aef0 2023-11-28T11:54:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.844+0000 7fd4d37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d406cdd0 0x7fd4d40d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.844+0000 7fd4d37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d406cdd0 0x7fd4d40d23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53666/0 (socket says 172.21.15.50:53666) 2023-11-28T11:54:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.844+0000 7fd4d37fe700 1 -- 172.21.15.50:0/4265223879 learned_addr learned my addr 172.21.15.50:0/4265223879 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.844+0000 7fd4d27fc700 1 --2- 172.21.15.50:0/4265223879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4d406b320 0x7fd4d40d1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.844+0000 7fd4d2ffd700 1 --2- 172.21.15.50:0/4265223879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4d406aef0 0x7fd4d40b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.848+0000 7fd4d37fe700 1 -- 172.21.15.50:0/4265223879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4d406aef0 msgr2=0x7fd4d40b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.848+0000 7fd4d37fe700 1 --2- 172.21.15.50:0/4265223879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4d406aef0 0x7fd4d40b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.848+0000 7fd4d37fe700 1 -- 172.21.15.50:0/4265223879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4d406b320 msgr2=0x7fd4d40d1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.848+0000 7fd4d37fe700 1 --2- 172.21.15.50:0/4265223879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4d406b320 0x7fd4d40d1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.848+0000 7fd4d37fe700 1 -- 172.21.15.50:0/4265223879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c4009520 con 0x7fd4d406cdd0 2023-11-28T11:54:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.848+0000 7fd4d27fc700 1 --2- 172.21.15.50:0/4265223879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4d406b320 0x7fd4d40d1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.848+0000 7fd4d37fe700 1 --2- 172.21.15.50:0/4265223879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d406cdd0 0x7fd4d40d23c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00cbc0 tx=0x7fd4cc00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:09.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.848+0000 7fd4bbfff700 1 -- 172.21.15.50:0/4265223879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc003c20 con 0x7fd4d406cdd0 2023-11-28T11:54:09.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.848+0000 7fd4bbfff700 1 -- 172.21.15.50:0/4265223879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc003d80 con 0x7fd4d406cdd0 2023-11-28T11:54:09.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.848+0000 7fd4d3fff700 1 -- 172.21.15.50:0/4265223879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d40cfaf0 con 0x7fd4d406cdd0 2023-11-28T11:54:09.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.848+0000 7fd4bbfff700 1 -- 172.21.15.50:0/4265223879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc00ab90 con 0x7fd4d406cdd0 2023-11-28T11:54:09.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.848+0000 7fd4d3fff700 1 -- 172.21.15.50:0/4265223879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d40cf810 con 0x7fd4d406cdd0 2023-11-28T11:54:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.848+0000 7fd4d3fff700 1 -- 172.21.15.50:0/4265223879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d40cfdd0 con 0x7fd4d406cdd0 2023-11-28T11:54:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.848+0000 7fd4bbfff700 1 -- 172.21.15.50:0/4265223879 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd4cc010050 con 0x7fd4d406cdd0 2023-11-28T11:54:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.848+0000 7fd4bbfff700 1 --2- 172.21.15.50:0/4265223879 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd4c0064ee0 0x7fd4c0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.848+0000 7fd4bbfff700 1 -- 172.21.15.50:0/4265223879 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd4cc0820c0 con 0x7fd4d406cdd0 2023-11-28T11:54:09.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.852+0000 7fd4d2ffd700 1 --2- 172.21.15.50:0/4265223879 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd4c0064ee0 0x7fd4c0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:09.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.852+0000 7fd4d2ffd700 1 --2- 172.21.15.50:0/4265223879 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd4c0064ee0 0x7fd4c0067390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009c60 tx=0x7fd4c4008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:09.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:09.860+0000 7fd4bbfff700 1 -- 172.21.15.50:0/4265223879 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd4cc04fef0 con 0x7fd4d406cdd0 2023-11-28T11:54:10.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.024+0000 7fd4d3fff700 1 -- 172.21.15.50:0/4265223879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4d40008d0 con 0x7fd4d406cdd0 2023-11-28T11:54:10.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.024+0000 7fd4bbfff700 1 -- 172.21.15.50:0/4265223879 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd4cc053510 con 0x7fd4d406cdd0 2023-11-28T11:54:10.029 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:10.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.024+0000 7fd4d3fff700 1 -- 172.21.15.50:0/4265223879 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd4c0064ee0 msgr2=0x7fd4c0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.024+0000 7fd4d3fff700 1 --2- 172.21.15.50:0/4265223879 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd4c0064ee0 0x7fd4c0067390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009c60 tx=0x7fd4c4008070 comp rx=0 tx=0).stop 2023-11-28T11:54:10.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.024+0000 7fd4d3fff700 1 -- 172.21.15.50:0/4265223879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d406cdd0 msgr2=0x7fd4d40d23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.024+0000 7fd4d3fff700 1 --2- 172.21.15.50:0/4265223879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d406cdd0 0x7fd4d40d23c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00cbc0 tx=0x7fd4cc00cf80 comp rx=0 tx=0).stop 2023-11-28T11:54:10.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.024+0000 7fd4d3fff700 1 -- 172.21.15.50:0/4265223879 shutdown_connections 2023-11-28T11:54:10.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.024+0000 7fd4d3fff700 1 --2- 172.21.15.50:0/4265223879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4d406cdd0 0x7fd4d40d23c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.024+0000 7fd4d3fff700 1 --2- 172.21.15.50:0/4265223879 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd4c0064ee0 0x7fd4c0067390 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.024+0000 7fd4d3fff700 1 --2- 172.21.15.50:0/4265223879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4d406b320 0x7fd4d40d1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.024+0000 7fd4d3fff700 1 --2- 172.21.15.50:0/4265223879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4d406aef0 0x7fd4d40b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.024+0000 7fd4d3fff700 1 -- 172.21.15.50:0/4265223879 >> 172.21.15.50:0/4265223879 conn(0x7fd4d409bb10 msgr2=0x7fd4d415c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:10.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.024+0000 7fd4d3fff700 1 -- 172.21.15.50:0/4265223879 shutdown_connections 2023-11-28T11:54:10.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.024+0000 7fd4d3fff700 1 -- 172.21.15.50:0/4265223879 wait complete. 2023-11-28T11:54:10.043 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:54:10.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.160+0000 7fc8f72f3700 1 Processor -- start 2023-11-28T11:54:10.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.160+0000 7fc8f72f3700 1 -- start start 2023-11-28T11:54:10.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.160+0000 7fc8f72f3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc8f0159ec0 0x7fc8f00c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.160+0000 7fc8f72f3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8f00cf3e0 0x7fc8f00cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.160+0000 7fc8f72f3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f00ca400 con 0x7fc8f0069c40 2023-11-28T11:54:10.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.160+0000 7fc8f72f3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f006b6d0 con 0x7fc8f0159ec0 2023-11-28T11:54:10.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.160+0000 7fc8f72f3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f006b9b0 con 0x7fc8f00cf3e0 2023-11-28T11:54:10.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.160+0000 7fc8f5af0700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc8f0069c40 0x7fc8f00cecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56566/0 (socket says 172.21.15.50:56566) 2023-11-28T11:54:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.160+0000 7fc8f5af0700 1 -- 172.21.15.50:0/2183177599 learned_addr learned my addr 172.21.15.50:0/2183177599 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f62f1700 1 --2- 172.21.15.50:0/2183177599 >> v2:172.21.15.192:3300/0 conn(0x7fc8f0159ec0 0x7fc8f00c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f6af2700 1 --2- 172.21.15.50:0/2183177599 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8f00cf3e0 0x7fc8f00cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f52ef700 1 -- 172.21.15.50:0/2183177599 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669210352 0 0) 0x7fc8f00ca400 con 0x7fc8f0069c40 2023-11-28T11:54:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f52ef700 1 -- 172.21.15.50:0/2183177599 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8dc0035d0 con 0x7fc8f0069c40 2023-11-28T11:54:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f62f1700 1 -- 172.21.15.50:0/2183177599 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8f00cf3e0 msgr2=0x7fc8f00cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f62f1700 1 --2- 172.21.15.50:0/2183177599 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8f00cf3e0 0x7fc8f00cb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f62f1700 1 -- 172.21.15.50:0/2183177599 >> v1:172.21.15.50:6789/0 conn(0x7fc8f0069c40 legacy=0x7fc8f00cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f62f1700 1 -- 172.21.15.50:0/2183177599 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f00cafd0 con 0x7fc8f0159ec0 2023-11-28T11:54:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f6af2700 1 --2- 172.21.15.50:0/2183177599 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8f00cf3e0 0x7fc8f00cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f62f1700 1 --2- 172.21.15.50:0/2183177599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8f0159ec0 0x7fc8f00c9df0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009840 tx=0x7fc8ec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b60b03bf421cdbc7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f52ef700 1 -- 172.21.15.50:0/2183177599 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec005e50 con 0x7fc8f0159ec0 2023-11-28T11:54:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f52ef700 1 -- 172.21.15.50:0/2183177599 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec006030 con 0x7fc8f0159ec0 2023-11-28T11:54:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f52ef700 1 -- 172.21.15.50:0/2183177599 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec0063a0 con 0x7fc8f0159ec0 2023-11-28T11:54:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f72f3700 1 -- 172.21.15.50:0/2183177599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8f0159ec0 msgr2=0x7fc8f00c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f72f3700 1 --2- 172.21.15.50:0/2183177599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8f0159ec0 0x7fc8f00c9df0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009840 tx=0x7fc8ec009b50 comp rx=0 tx=0).stop 2023-11-28T11:54:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f72f3700 1 -- 172.21.15.50:0/2183177599 shutdown_connections 2023-11-28T11:54:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f72f3700 1 --2- 172.21.15.50:0/2183177599 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8f00cf3e0 0x7fc8f00cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f72f3700 1 --2- 172.21.15.50:0/2183177599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8f0159ec0 0x7fc8f00c9df0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f72f3700 1 -- 172.21.15.50:0/2183177599 >> 172.21.15.50:0/2183177599 conn(0x7fc8f006c660 msgr2=0x7fc8f006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f72f3700 1 -- 172.21.15.50:0/2183177599 shutdown_connections 2023-11-28T11:54:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.164+0000 7fc8f72f3700 1 -- 172.21.15.50:0/2183177599 wait complete. 2023-11-28T11:54:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.168+0000 7fc8f72f3700 1 Processor -- start 2023-11-28T11:54:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.168+0000 7fc8f72f3700 1 -- start start 2023-11-28T11:54:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.168+0000 7fc8f72f3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8f0069c40 0x7fc8f014e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.168+0000 7fc8f72f3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f00cf3e0 0x7fc8f0152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.168+0000 7fc8f72f3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8f0159ec0 0x7fc8f015bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.168+0000 7fc8f72f3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f00c6fc0 con 0x7fc8f00cf3e0 2023-11-28T11:54:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.168+0000 7fc8f72f3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f014ec70 con 0x7fc8f0159ec0 2023-11-28T11:54:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.168+0000 7fc8f72f3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f01523d0 con 0x7fc8f0069c40 2023-11-28T11:54:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.168+0000 7fc8f5af0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f00cf3e0 0x7fc8f0152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8f5af0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f00cf3e0 0x7fc8f0152de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53672/0 (socket says 172.21.15.50:53672) 2023-11-28T11:54:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8f5af0700 1 -- 172.21.15.50:0/2875315174 learned_addr learned my addr 172.21.15.50:0/2875315174 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8f62f1700 1 --2- 172.21.15.50:0/2875315174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8f0069c40 0x7fc8f014e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8f6af2700 1 --2- 172.21.15.50:0/2875315174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8f0159ec0 0x7fc8f015bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8f5af0700 1 -- 172.21.15.50:0/2875315174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8f0069c40 msgr2=0x7fc8f014e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8f5af0700 1 --2- 172.21.15.50:0/2875315174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8f0069c40 0x7fc8f014e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8f5af0700 1 -- 172.21.15.50:0/2875315174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8f0159ec0 msgr2=0x7fc8f015bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8f5af0700 1 --2- 172.21.15.50:0/2875315174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8f0159ec0 0x7fc8f015bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8f5af0700 1 -- 172.21.15.50:0/2875315174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e8009a70 con 0x7fc8f00cf3e0 2023-11-28T11:54:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8f5af0700 1 --2- 172.21.15.50:0/2875315174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f00cf3e0 0x7fc8f0152de0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00010e0 tx=0x7fc8e000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8e6ffd700 1 -- 172.21.15.50:0/2875315174 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0005d90 con 0x7fc8f00cf3e0 2023-11-28T11:54:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8e6ffd700 1 -- 172.21.15.50:0/2875315174 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e000ce50 con 0x7fc8f00cf3e0 2023-11-28T11:54:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8f72f3700 1 -- 172.21.15.50:0/2875315174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ec009450 con 0x7fc8f00cf3e0 2023-11-28T11:54:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8e6ffd700 1 -- 172.21.15.50:0/2875315174 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e00072f0 con 0x7fc8f00cf3e0 2023-11-28T11:54:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8f72f3700 1 -- 172.21.15.50:0/2875315174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f006bc90 con 0x7fc8f00cf3e0 2023-11-28T11:54:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8f72f3700 1 -- 172.21.15.50:0/2875315174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f00caa10 con 0x7fc8f00cf3e0 2023-11-28T11:54:10.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8e6ffd700 1 -- 172.21.15.50:0/2875315174 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc8e0019030 con 0x7fc8f00cf3e0 2023-11-28T11:54:10.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8e6ffd700 1 --2- 172.21.15.50:0/2875315174 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc8d4064ee0 0x7fc8d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.172+0000 7fc8e6ffd700 1 -- 172.21.15.50:0/2875315174 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc8e0081390 con 0x7fc8f00cf3e0 2023-11-28T11:54:10.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.176+0000 7fc8f62f1700 1 --2- 172.21.15.50:0/2875315174 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc8d4064ee0 0x7fc8d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.176+0000 7fc8f62f1700 1 --2- 172.21.15.50:0/2875315174 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc8d4064ee0 0x7fc8d4067390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009fd0 tx=0x7fc8ec008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.184+0000 7fc8e6ffd700 1 -- 172.21.15.50:0/2875315174 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc8e004f240 con 0x7fc8f00cf3e0 2023-11-28T11:54:10.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.344+0000 7fc8f72f3700 1 -- 172.21.15.50:0/2875315174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc8f015a290 con 0x7fc8f00cf3e0 2023-11-28T11:54:10.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.348+0000 7fc8e6ffd700 1 -- 172.21.15.50:0/2875315174 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc8e0017020 con 0x7fc8f00cf3e0 2023-11-28T11:54:10.352 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:54:10.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.352+0000 7fc8f72f3700 1 -- 172.21.15.50:0/2875315174 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc8d4064ee0 msgr2=0x7fc8d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.352+0000 7fc8f72f3700 1 --2- 172.21.15.50:0/2875315174 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc8d4064ee0 0x7fc8d4067390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009fd0 tx=0x7fc8ec008070 comp rx=0 tx=0).stop 2023-11-28T11:54:10.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.352+0000 7fc8f72f3700 1 -- 172.21.15.50:0/2875315174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f00cf3e0 msgr2=0x7fc8f0152de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.352+0000 7fc8f72f3700 1 --2- 172.21.15.50:0/2875315174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f00cf3e0 0x7fc8f0152de0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00010e0 tx=0x7fc8e000c7b0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.352+0000 7fc8f72f3700 1 -- 172.21.15.50:0/2875315174 shutdown_connections 2023-11-28T11:54:10.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.352+0000 7fc8f72f3700 1 --2- 172.21.15.50:0/2875315174 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc8d4064ee0 0x7fc8d4067390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.352+0000 7fc8f72f3700 1 --2- 172.21.15.50:0/2875315174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8f0159ec0 0x7fc8f015bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.352+0000 7fc8f72f3700 1 --2- 172.21.15.50:0/2875315174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f00cf3e0 0x7fc8f0152de0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.352+0000 7fc8f72f3700 1 --2- 172.21.15.50:0/2875315174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8f0069c40 0x7fc8f014e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.352+0000 7fc8f72f3700 1 -- 172.21.15.50:0/2875315174 >> 172.21.15.50:0/2875315174 conn(0x7fc8f006c660 msgr2=0x7fc8f006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:10.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.352+0000 7fc8f72f3700 1 -- 172.21.15.50:0/2875315174 shutdown_connections 2023-11-28T11:54:10.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.352+0000 7fc8f72f3700 1 -- 172.21.15.50:0/2875315174 wait complete. 2023-11-28T11:54:10.373 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:54:10.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97ddf15700 1 Processor -- start 2023-11-28T11:54:10.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97ddf15700 1 -- start start 2023-11-28T11:54:10.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97ddf15700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97d80b1ae0 0x7f97d806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97ddf15700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97d806a4c0 0x7f97d80d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97ddf15700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f97d80cf0e0 0x7f97d80cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97ddf15700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d80cfa80 con 0x7f97d80b1ae0 2023-11-28T11:54:10.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97ddf15700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d806a9c0 con 0x7f97d80cf0e0 2023-11-28T11:54:10.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97ddf15700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d806aca0 con 0x7f97d806a4c0 2023-11-28T11:54:10.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97dcf13700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97d80b1ae0 0x7f97d806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97dcf13700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97d80b1ae0 0x7f97d806d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53674/0 (socket says 172.21.15.50:53674) 2023-11-28T11:54:10.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97dcf13700 1 -- 172.21.15.50:0/3243841950 learned_addr learned my addr 172.21.15.50:0/3243841950 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:10.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97dd714700 1 --2- 172.21.15.50:0/3243841950 >> v2:172.21.15.192:3300/0 conn(0x7f97d80cf0e0 0x7f97d80cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97d7fff700 1 --2- 172.21.15.50:0/3243841950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97d806a4c0 0x7f97d80d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97dcf13700 1 -- 172.21.15.50:0/3243841950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97d806a4c0 msgr2=0x7f97d80d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:10.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97dcf13700 1 --2- 172.21.15.50:0/3243841950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97d806a4c0 0x7f97d80d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97dcf13700 1 -- 172.21.15.50:0/3243841950 >> v2:172.21.15.192:3300/0 conn(0x7f97d80cf0e0 msgr2=0x7f97d80cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:10.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97dcf13700 1 --2- 172.21.15.50:0/3243841950 >> v2:172.21.15.192:3300/0 conn(0x7f97d80cf0e0 0x7f97d80cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97dcf13700 1 -- 172.21.15.50:0/3243841950 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d806af80 con 0x7f97d80b1ae0 2023-11-28T11:54:10.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.488+0000 7f97dd714700 1 --2- 172.21.15.50:0/3243841950 >> v2:172.21.15.192:3300/0 conn(0x7f97d80cf0e0 0x7f97d80cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:10.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.492+0000 7f97dcf13700 1 --2- 172.21.15.50:0/3243841950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d80b1ae0 0x7f97d806d8e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f97d808bbc0 tx=0x7f97cc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d1941fed627f77 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:10.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.492+0000 7f97d77fe700 1 -- 172.21.15.50:0/3243841950 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc011830 con 0x7f97d80b1ae0 2023-11-28T11:54:10.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.492+0000 7f97d77fe700 1 -- 172.21.15.50:0/3243841950 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc011990 con 0x7f97d80b1ae0 2023-11-28T11:54:10.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.492+0000 7f97d77fe700 1 -- 172.21.15.50:0/3243841950 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc011d20 con 0x7f97d80b1ae0 2023-11-28T11:54:10.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.492+0000 7f97ddf15700 1 -- 172.21.15.50:0/3243841950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d80b1ae0 msgr2=0x7f97d806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.492+0000 7f97ddf15700 1 --2- 172.21.15.50:0/3243841950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d80b1ae0 0x7f97d806d8e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f97d808bbc0 tx=0x7f97cc009bf0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.492+0000 7f97ddf15700 1 -- 172.21.15.50:0/3243841950 shutdown_connections 2023-11-28T11:54:10.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.492+0000 7f97ddf15700 1 --2- 172.21.15.50:0/3243841950 >> v2:172.21.15.192:3300/0 conn(0x7f97d80cf0e0 0x7f97d80cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.492+0000 7f97ddf15700 1 --2- 172.21.15.50:0/3243841950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97d806a4c0 0x7f97d80d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.492+0000 7f97ddf15700 1 --2- 172.21.15.50:0/3243841950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d80b1ae0 0x7f97d806d8e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.492+0000 7f97ddf15700 1 -- 172.21.15.50:0/3243841950 >> 172.21.15.50:0/3243841950 conn(0x7f97d809bbd0 msgr2=0x7f97d80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:10.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.492+0000 7f97ddf15700 1 -- 172.21.15.50:0/3243841950 shutdown_connections 2023-11-28T11:54:10.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.492+0000 7f97ddf15700 1 -- 172.21.15.50:0/3243841950 wait complete. 2023-11-28T11:54:10.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97ddf15700 1 Processor -- start 2023-11-28T11:54:10.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97ddf15700 1 -- start start 2023-11-28T11:54:10.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97ddf15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d806a4c0 0x7f97d80c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97ddf15700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97d80b1ae0 0x7f97d815d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97ddf15700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97d80cf0e0 0x7f97d815de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97ddf15700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d814c4e0 con 0x7f97d806a4c0 2023-11-28T11:54:10.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97ddf15700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80c7890 con 0x7f97d80b1ae0 2023-11-28T11:54:10.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97ddf15700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80c7ae0 con 0x7f97d80cf0e0 2023-11-28T11:54:10.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97dcf13700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d806a4c0 0x7f97d80c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97dcf13700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d806a4c0 0x7f97d80c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53682/0 (socket says 172.21.15.50:53682) 2023-11-28T11:54:10.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97d7fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97d80b1ae0 0x7f97d815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97dcf13700 1 -- 172.21.15.50:0/1481398033 learned_addr learned my addr 172.21.15.50:0/1481398033 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:10.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97dd714700 1 --2- 172.21.15.50:0/1481398033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97d80cf0e0 0x7f97d815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97d7fff700 1 -- 172.21.15.50:0/1481398033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97d80cf0e0 msgr2=0x7f97d815de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97d7fff700 1 --2- 172.21.15.50:0/1481398033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97d80cf0e0 0x7f97d815de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97d7fff700 1 -- 172.21.15.50:0/1481398033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d806a4c0 msgr2=0x7f97d80c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97d7fff700 1 --2- 172.21.15.50:0/1481398033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d806a4c0 0x7f97d80c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97d7fff700 1 -- 172.21.15.50:0/1481398033 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d0009a70 con 0x7f97d80b1ae0 2023-11-28T11:54:10.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97dcf13700 1 --2- 172.21.15.50:0/1481398033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d806a4c0 0x7f97d80c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:10.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97d7fff700 1 --2- 172.21.15.50:0/1481398033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97d80b1ae0 0x7f97d815d910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f97c400e840 tx=0x7f97c400eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97d57fa700 1 -- 172.21.15.50:0/1481398033 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4013680 con 0x7f97d80b1ae0 2023-11-28T11:54:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97d57fa700 1 -- 172.21.15.50:0/1481398033 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c40137e0 con 0x7f97d80b1ae0 2023-11-28T11:54:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97ddf15700 1 -- 172.21.15.50:0/1481398033 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97cc009570 con 0x7f97d80b1ae0 2023-11-28T11:54:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.496+0000 7f97d57fa700 1 -- 172.21.15.50:0/1481398033 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4013b90 con 0x7f97d80b1ae0 2023-11-28T11:54:10.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.500+0000 7f97ddf15700 1 -- 172.21.15.50:0/1481398033 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d80b1eb0 con 0x7f97d80b1ae0 2023-11-28T11:54:10.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.500+0000 7f97ddf15700 1 -- 172.21.15.50:0/1481398033 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d80b4380 con 0x7f97d80b1ae0 2023-11-28T11:54:10.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.500+0000 7f97d57fa700 1 -- 172.21.15.50:0/1481398033 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f97c4019030 con 0x7f97d80b1ae0 2023-11-28T11:54:10.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.500+0000 7f97d57fa700 1 --2- 172.21.15.50:0/1481398033 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f97bc064ee0 0x7f97bc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.500+0000 7f97d57fa700 1 -- 172.21.15.50:0/1481398033 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f97c4082080 con 0x7f97d80b1ae0 2023-11-28T11:54:10.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.500+0000 7f97dcf13700 1 --2- 172.21.15.50:0/1481398033 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f97bc064ee0 0x7f97bc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.504+0000 7f97dcf13700 1 --2- 172.21.15.50:0/1481398033 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f97bc064ee0 0x7f97bc067390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009150 tx=0x7f97cc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:10.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.508+0000 7f97d57fa700 1 -- 172.21.15.50:0/1481398033 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f97c404fdc0 con 0x7f97d80b1ae0 2023-11-28T11:54:10.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.672+0000 7f97ddf15700 1 -- 172.21.15.50:0/1481398033 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f97d80b60e0 con 0x7f97d80b1ae0 2023-11-28T11:54:10.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.672+0000 7f97d57fa700 1 -- 172.21.15.50:0/1481398033 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f97c40533e0 con 0x7f97d80b1ae0 2023-11-28T11:54:10.678 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.676+0000 7f97ddf15700 1 -- 172.21.15.50:0/1481398033 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f97bc064ee0 msgr2=0x7f97bc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.676+0000 7f97ddf15700 1 --2- 172.21.15.50:0/1481398033 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f97bc064ee0 0x7f97bc067390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009150 tx=0x7f97cc008030 comp rx=0 tx=0).stop 2023-11-28T11:54:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.676+0000 7f97ddf15700 1 -- 172.21.15.50:0/1481398033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97d80b1ae0 msgr2=0x7f97d815d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.676+0000 7f97ddf15700 1 --2- 172.21.15.50:0/1481398033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97d80b1ae0 0x7f97d815d910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f97c400e840 tx=0x7f97c400eb50 comp rx=0 tx=0).stop 2023-11-28T11:54:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.676+0000 7f97ddf15700 1 -- 172.21.15.50:0/1481398033 shutdown_connections 2023-11-28T11:54:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.676+0000 7f97ddf15700 1 --2- 172.21.15.50:0/1481398033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97d80cf0e0 0x7f97d815de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.676+0000 7f97ddf15700 1 --2- 172.21.15.50:0/1481398033 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f97bc064ee0 0x7f97bc067390 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.676+0000 7f97ddf15700 1 --2- 172.21.15.50:0/1481398033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97d80b1ae0 0x7f97d815d910 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.676+0000 7f97ddf15700 1 --2- 172.21.15.50:0/1481398033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d806a4c0 0x7f97d80c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.676+0000 7f97ddf15700 1 -- 172.21.15.50:0/1481398033 >> 172.21.15.50:0/1481398033 conn(0x7f97d809bbd0 msgr2=0x7f97d80b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.676+0000 7f97ddf15700 1 -- 172.21.15.50:0/1481398033 shutdown_connections 2023-11-28T11:54:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.676+0000 7f97ddf15700 1 -- 172.21.15.50:0/1481398033 wait complete. 2023-11-28T11:54:10.694 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:54:10.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f6554886700 1 Processor -- start 2023-11-28T11:54:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f6554886700 1 -- start start 2023-11-28T11:54:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f6554886700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6550158e60 0x7f65500c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f6554886700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65500cd8f0 con 0x7f65500cb460 2023-11-28T11:54:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f6554886700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655006dc60 con 0x7f65500ad490 2023-11-28T11:54:10.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f6554886700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65500add00 con 0x7f6550158e60 2023-11-28T11:54:10.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f65500cb460 0x7f655006c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56574/0 (socket says 172.21.15.50:56574) 2023-11-28T11:54:10.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654ffff700 1 -- 172.21.15.50:0/410941677 learned_addr learned my addr 172.21.15.50:0/410941677 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:10.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654f7fe700 1 --2- 172.21.15.50:0/410941677 >> v2:172.21.15.192:3300/0 conn(0x7f6550158e60 0x7f65500c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654e7fc700 1 -- 172.21.15.50:0/410941677 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309739121 0 0) 0x7f65500cd8f0 con 0x7f65500cb460 2023-11-28T11:54:10.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654e7fc700 1 -- 172.21.15.50:0/410941677 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65380035d0 con 0x7f65500cb460 2023-11-28T11:54:10.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654e7fc700 1 -- 172.21.15.50:0/410941677 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494926180 0 0) 0x7f655006dc60 con 0x7f65500ad490 2023-11-28T11:54:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654e7fc700 1 -- 172.21.15.50:0/410941677 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65500cd8f0 con 0x7f65500ad490 2023-11-28T11:54:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654e7fc700 1 -- 172.21.15.50:0/410941677 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2852370249 0 0) 0x7f65380035d0 con 0x7f65500cb460 2023-11-28T11:54:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654e7fc700 1 -- 172.21.15.50:0/410941677 >> v2:172.21.15.192:3300/0 conn(0x7f6550158e60 msgr2=0x7f65500c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654e7fc700 1 --2- 172.21.15.50:0/410941677 >> v2:172.21.15.192:3300/0 conn(0x7f6550158e60 0x7f65500c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654e7fc700 1 -- 172.21.15.50:0/410941677 >> v1:172.21.15.192:6789/0 conn(0x7f65500ad490 legacy=0x7f65500cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654e7fc700 1 -- 172.21.15.50:0/410941677 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65500cde90 con 0x7f65500cb460 2023-11-28T11:54:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654e7fc700 1 -- 172.21.15.50:0/410941677 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f6548001670 con 0x7f65500cb460 2023-11-28T11:54:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654e7fc700 1 -- 172.21.15.50:0/410941677 >> v1:172.21.15.50:6789/0 conn(0x7f65500cb460 legacy=0x7f655006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654e7fc700 1 --2- 172.21.15.50:0/410941677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6538003c00 0x7f6538003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654e7fc700 1 --2- 172.21.15.50:0/410941677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6538004870 0x7f6538004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654e7fc700 1 --2- 172.21.15.50:0/410941677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6538005270 0x7f653800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654e7fc700 1 -- 172.21.15.50:0/410941677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65500add00 con 0x7f6538005270 2023-11-28T11:54:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654e7fc700 1 -- 172.21.15.50:0/410941677 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653800c180 con 0x7f6538003c00 2023-11-28T11:54:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654e7fc700 1 -- 172.21.15.50:0/410941677 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653800c340 con 0x7f6538004870 2023-11-28T11:54:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654ffff700 1 --2- 172.21.15.50:0/410941677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6538005270 0x7f653800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.804+0000 7f654f7fe700 1 --2- 172.21.15.50:0/410941677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6538003c00 0x7f6538003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f654effd700 1 --2- 172.21.15.50:0/410941677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6538004870 0x7f6538004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f654ffff700 1 -- 172.21.15.50:0/410941677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6538004870 msgr2=0x7f6538004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f654ffff700 1 --2- 172.21.15.50:0/410941677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6538004870 0x7f6538004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f654ffff700 1 -- 172.21.15.50:0/410941677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6538003c00 msgr2=0x7f6538003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f654ffff700 1 --2- 172.21.15.50:0/410941677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6538003c00 0x7f6538003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f654ffff700 1 -- 172.21.15.50:0/410941677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65380035d0 con 0x7f6538005270 2023-11-28T11:54:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f654effd700 1 --2- 172.21.15.50:0/410941677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6538004870 0x7f6538004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:54:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f654ffff700 1 -- 172.21.15.50:0/410941677 reap_dead start 2023-11-28T11:54:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f654ffff700 1 --2- 172.21.15.50:0/410941677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6538005270 0x7f653800ba30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f654800c160 tx=0x7f65380058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afb6959d3979a79 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f654e7fc700 1 -- 172.21.15.50:0/410941677 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548007b10 con 0x7f6538005270 2023-11-28T11:54:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f654e7fc700 1 -- 172.21.15.50:0/410941677 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654800ccc0 con 0x7f6538005270 2023-11-28T11:54:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f654e7fc700 1 -- 172.21.15.50:0/410941677 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548005bc0 con 0x7f6538005270 2023-11-28T11:54:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f6554886700 1 -- 172.21.15.50:0/410941677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6538005270 msgr2=0x7f653800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f6554886700 1 --2- 172.21.15.50:0/410941677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6538005270 0x7f653800ba30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f654800c160 tx=0x7f65380058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f6554886700 1 -- 172.21.15.50:0/410941677 shutdown_connections 2023-11-28T11:54:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f6554886700 1 --2- 172.21.15.50:0/410941677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6538005270 0x7f653800ba30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f6554886700 1 -- 172.21.15.50:0/410941677 >> 172.21.15.50:0/410941677 conn(0x7f65500ce3e0 msgr2=0x7f65500ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f6554886700 1 -- 172.21.15.50:0/410941677 shutdown_connections 2023-11-28T11:54:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f6554886700 1 -- 172.21.15.50:0/410941677 wait complete. 2023-11-28T11:54:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f6554886700 1 Processor -- start 2023-11-28T11:54:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.808+0000 7f6554886700 1 -- start start 2023-11-28T11:54:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f6554886700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6538005270 0x7f65500c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f6554886700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65500af590 0x7f6550156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f6554886700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f655006a6c0 0x7f655006ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f6554886700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655006b0a0 con 0x7f65500af590 2023-11-28T11:54:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f6554886700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65500afde0 con 0x7f6538005270 2023-11-28T11:54:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f6554886700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65500b00c0 con 0x7f655006a6c0 2023-11-28T11:54:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f654effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65500af590 0x7f6550156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f654effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65500af590 0x7f6550156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53690/0 (socket says 172.21.15.50:53690) 2023-11-28T11:54:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f654effd700 1 -- 172.21.15.50:0/1448429985 learned_addr learned my addr 172.21.15.50:0/1448429985 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f654f7fe700 1 --2- 172.21.15.50:0/1448429985 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6538005270 0x7f65500c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f654ffff700 1 --2- 172.21.15.50:0/1448429985 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f655006a6c0 0x7f655006ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f654effd700 1 -- 172.21.15.50:0/1448429985 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f655006a6c0 msgr2=0x7f655006ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f654effd700 1 --2- 172.21.15.50:0/1448429985 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f655006a6c0 0x7f655006ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f654effd700 1 -- 172.21.15.50:0/1448429985 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6538005270 msgr2=0x7f65500c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f654effd700 1 --2- 172.21.15.50:0/1448429985 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6538005270 0x7f65500c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f654effd700 1 -- 172.21.15.50:0/1448429985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655006d6a0 con 0x7f65500af590 2023-11-28T11:54:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f654effd700 1 --2- 172.21.15.50:0/1448429985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65500af590 0x7f6550156380 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6540002130 tx=0x7f654000b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f6537fff700 1 -- 172.21.15.50:0/1448429985 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65400123f0 con 0x7f65500af590 2023-11-28T11:54:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f6537fff700 1 -- 172.21.15.50:0/1448429985 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6540012550 con 0x7f65500af590 2023-11-28T11:54:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f6554886700 1 -- 172.21.15.50:0/1448429985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6550159230 con 0x7f65500af590 2023-11-28T11:54:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f6537fff700 1 -- 172.21.15.50:0/1448429985 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65400128e0 con 0x7f65500af590 2023-11-28T11:54:10.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f6554886700 1 -- 172.21.15.50:0/1448429985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655006d980 con 0x7f65500af590 2023-11-28T11:54:10.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.812+0000 7f6554886700 1 -- 172.21.15.50:0/1448429985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6550072500 con 0x7f65500af590 2023-11-28T11:54:10.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.816+0000 7f6537fff700 1 -- 172.21.15.50:0/1448429985 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6540022070 con 0x7f65500af590 2023-11-28T11:54:10.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.816+0000 7f6537fff700 1 --2- 172.21.15.50:0/1448429985 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f653c064f10 0x7f653c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:10.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.816+0000 7f6537fff700 1 -- 172.21.15.50:0/1448429985 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6540082910 con 0x7f65500af590 2023-11-28T11:54:10.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.816+0000 7f654f7fe700 1 --2- 172.21.15.50:0/1448429985 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f653c064f10 0x7f653c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:10.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.816+0000 7f654f7fe700 1 --2- 172.21.15.50:0/1448429985 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f653c064f10 0x7f653c0673c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f65500c50e0 tx=0x7f6544008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:10.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:10.820+0000 7f6537fff700 1 -- 172.21.15.50:0/1448429985 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f65400506d0 con 0x7f65500af590 2023-11-28T11:54:11.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.020+0000 7f6554886700 1 -- 172.21.15.50:0/1448429985 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65500ab680 con 0x7f65500af590 2023-11-28T11:54:11.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.020+0000 7f6537fff700 1 -- 172.21.15.50:0/1448429985 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7f6540053cf0 con 0x7f65500af590 2023-11-28T11:54:11.026 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:11.027 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2457318670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2457318670},{"type":"v1","addr":"172.21.15.192:6836","nonce":2457318670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3448258722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3448258722},{"type":"v1","addr":"172.21.15.192:6837","nonce":3448258722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/490368853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":490368853},{"type":"v1","addr":"172.21.15.50:6833","nonce":490368853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:53:40.797417+0000","modified":"2023-11-28T11:54:02.939902+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3764199418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3764199418},{"type":"v1","addr":"172.21.15.50:6835","nonce":3764199418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:54:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.024+0000 7f6554886700 1 -- 172.21.15.50:0/1448429985 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f653c064f10 msgr2=0x7f653c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.024+0000 7f6554886700 1 --2- 172.21.15.50:0/1448429985 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f653c064f10 0x7f653c0673c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f65500c50e0 tx=0x7f6544008040 comp rx=0 tx=0).stop 2023-11-28T11:54:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.024+0000 7f6554886700 1 -- 172.21.15.50:0/1448429985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65500af590 msgr2=0x7f6550156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.024+0000 7f6554886700 1 --2- 172.21.15.50:0/1448429985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65500af590 0x7f6550156380 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6540002130 tx=0x7f654000b3b0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.024+0000 7f6554886700 1 -- 172.21.15.50:0/1448429985 shutdown_connections 2023-11-28T11:54:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.024+0000 7f6554886700 1 --2- 172.21.15.50:0/1448429985 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f655006a6c0 0x7f655006ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.024+0000 7f6554886700 1 --2- 172.21.15.50:0/1448429985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65500af590 0x7f6550156380 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.024+0000 7f6554886700 1 --2- 172.21.15.50:0/1448429985 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f653c064f10 0x7f653c0673c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.024+0000 7f6554886700 1 --2- 172.21.15.50:0/1448429985 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6538005270 0x7f65500c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.024+0000 7f6554886700 1 -- 172.21.15.50:0/1448429985 >> 172.21.15.50:0/1448429985 conn(0x7f65500ce3e0 msgr2=0x7f65501582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.024+0000 7f6554886700 1 -- 172.21.15.50:0/1448429985 shutdown_connections 2023-11-28T11:54:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.024+0000 7f6554886700 1 -- 172.21.15.50:0/1448429985 wait complete. 2023-11-28T11:54:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-11-28T11:54:11.444 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T11:53:40.797417+0000', 'modified': '2023-11-28T11:54:02.939902+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/3764199418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 3764199418}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 3764199418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T11:54:11.444 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T11:54:11.445 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-28T11:54:11.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.568+0000 7f32d9b4c700 1 Processor -- start 2023-11-28T11:54:11.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.568+0000 7f32d9b4c700 1 -- start start 2023-11-28T11:54:11.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d9b4c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32d4158e60 0x7f32d40c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d9b4c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d40cb460 0x7f32d40cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d9b4c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d40cd8f0 con 0x7f32d40ad490 2023-11-28T11:54:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d9b4c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d40add00 con 0x7f32d4158e60 2023-11-28T11:54:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d9b4c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d40cc4f0 con 0x7f32d40cb460 2023-11-28T11:54:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d3fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f32d40ad490 0x7f32d40cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56588/0 (socket says 172.21.15.50:56588) 2023-11-28T11:54:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d3fff700 1 -- 172.21.15.50:0/99279323 learned_addr learned my addr 172.21.15.50:0/99279323 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d8b4a700 1 --2- 172.21.15.50:0/99279323 >> v2:172.21.15.50:3300/0 conn(0x7f32d4158e60 0x7f32d40c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d934b700 1 --2- 172.21.15.50:0/99279323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d40cb460 0x7f32d40cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 -- 172.21.15.50:0/99279323 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839637711 0 0) 0x7f32d40cd8f0 con 0x7f32d40ad490 2023-11-28T11:54:11.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 -- 172.21.15.50:0/99279323 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32c40035d0 con 0x7f32d40ad490 2023-11-28T11:54:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 -- 172.21.15.50:0/99279323 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 759963437 0 0) 0x7f32c40035d0 con 0x7f32d40ad490 2023-11-28T11:54:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 -- 172.21.15.50:0/99279323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d40cb460 msgr2=0x7f32d40cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 --2- 172.21.15.50:0/99279323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d40cb460 0x7f32d40cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 -- 172.21.15.50:0/99279323 >> v2:172.21.15.50:3300/0 conn(0x7f32d4158e60 msgr2=0x7f32d40c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 --2- 172.21.15.50:0/99279323 >> v2:172.21.15.50:3300/0 conn(0x7f32d4158e60 0x7f32d40c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 -- 172.21.15.50:0/99279323 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d406dc60 con 0x7f32d40ad490 2023-11-28T11:54:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 -- 172.21.15.50:0/99279323 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f32c0001670 con 0x7f32d40ad490 2023-11-28T11:54:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 -- 172.21.15.50:0/99279323 >> v1:172.21.15.50:6789/0 conn(0x7f32d40ad490 legacy=0x7f32d40cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 --2- 172.21.15.50:0/99279323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32c4003a20 0x7f32c4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 --2- 172.21.15.50:0/99279323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c4004450 0x7f32c4004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 --2- 172.21.15.50:0/99279323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d40cb460 0x7f32c4005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 -- 172.21.15.50:0/99279323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d40add00 con 0x7f32c4004450 2023-11-28T11:54:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 -- 172.21.15.50:0/99279323 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d40cc4f0 con 0x7f32c4003a20 2023-11-28T11:54:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 -- 172.21.15.50:0/99279323 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c400ba60 con 0x7f32d40cb460 2023-11-28T11:54:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d3fff700 1 --2- 172.21.15.50:0/99279323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c4004450 0x7f32c4004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d934b700 1 --2- 172.21.15.50:0/99279323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d40cb460 0x7f32c4005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d8b4a700 1 --2- 172.21.15.50:0/99279323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32c4003a20 0x7f32c4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d3fff700 1 -- 172.21.15.50:0/99279323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d40cb460 msgr2=0x7f32c4005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d3fff700 1 --2- 172.21.15.50:0/99279323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d40cb460 0x7f32c4005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d3fff700 1 -- 172.21.15.50:0/99279323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32c4003a20 msgr2=0x7f32c4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d3fff700 1 --2- 172.21.15.50:0/99279323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32c4003a20 0x7f32c4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d3fff700 1 -- 172.21.15.50:0/99279323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c40035d0 con 0x7f32c4004450 2023-11-28T11:54:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d3fff700 1 --2- 172.21.15.50:0/99279323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c4004450 0x7f32c4004910 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f32c000c2f0 tx=0x7f32c40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8a80c669ef2cd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 -- 172.21.15.50:0/99279323 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0007c80 con 0x7f32c4004450 2023-11-28T11:54:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 -- 172.21.15.50:0/99279323 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c000ce30 con 0x7f32c4004450 2023-11-28T11:54:11.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d37fe700 1 -- 172.21.15.50:0/99279323 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0005bc0 con 0x7f32c4004450 2023-11-28T11:54:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d9b4c700 1 -- 172.21.15.50:0/99279323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c4004450 msgr2=0x7f32c4004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d9b4c700 1 --2- 172.21.15.50:0/99279323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c4004450 0x7f32c4004910 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f32c000c2f0 tx=0x7f32c40058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d934b700 1 -- 172.21.15.50:0/99279323 reap_dead start 2023-11-28T11:54:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d9b4c700 1 -- 172.21.15.50:0/99279323 shutdown_connections 2023-11-28T11:54:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d9b4c700 1 -- 172.21.15.50:0/99279323 >> 172.21.15.50:0/99279323 conn(0x7f32d40ce3e0 msgr2=0x7f32d40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d9b4c700 1 -- 172.21.15.50:0/99279323 shutdown_connections 2023-11-28T11:54:11.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.572+0000 7f32d9b4c700 1 -- 172.21.15.50:0/99279323 wait complete. 2023-11-28T11:54:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.576+0000 7f32d9b4c700 1 Processor -- start 2023-11-28T11:54:11.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.576+0000 7f32d9b4c700 1 -- start start 2023-11-28T11:54:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d9b4c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c4004450 0x7f32d40c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d9b4c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32d4150450 0x7f32d41ec7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d9b4c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d41eccf0 0x7f32d4070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d9b4c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d40c3a20 con 0x7f32c4004450 2023-11-28T11:54:11.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d9b4c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d40c36d0 con 0x7f32d4150450 2023-11-28T11:54:11.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d9b4c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d40c59f0 con 0x7f32d41eccf0 2023-11-28T11:54:11.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d8b4a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c4004450 0x7f32d40c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d8b4a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c4004450 0x7f32d40c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53714/0 (socket says 172.21.15.50:53714) 2023-11-28T11:54:11.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32d4150450 0x7f32d41ec7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d8b4a700 1 -- 172.21.15.50:0/711910446 learned_addr learned my addr 172.21.15.50:0/711910446 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:11.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d934b700 1 --2- 172.21.15.50:0/711910446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d41eccf0 0x7f32d4070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d8b4a700 1 -- 172.21.15.50:0/711910446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d41eccf0 msgr2=0x7f32d4070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:11.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d8b4a700 1 --2- 172.21.15.50:0/711910446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d41eccf0 0x7f32d4070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d8b4a700 1 -- 172.21.15.50:0/711910446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32d4150450 msgr2=0x7f32d41ec7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:11.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d8b4a700 1 --2- 172.21.15.50:0/711910446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32d4150450 0x7f32d41ec7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d8b4a700 1 -- 172.21.15.50:0/711910446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d4159230 con 0x7f32c4004450 2023-11-28T11:54:11.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d8b4a700 1 --2- 172.21.15.50:0/711910446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c4004450 0x7f32d40c54b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f32c8012df0 tx=0x7f32c80106c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:11.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d17fa700 1 -- 172.21.15.50:0/711910446 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c800b8c0 con 0x7f32c4004450 2023-11-28T11:54:11.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d17fa700 1 -- 172.21.15.50:0/711910446 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c801c3f0 con 0x7f32c4004450 2023-11-28T11:54:11.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d17fa700 1 -- 172.21.15.50:0/711910446 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c801c7c0 con 0x7f32c4004450 2023-11-28T11:54:11.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d9b4c700 1 -- 172.21.15.50:0/711910446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d40cde90 con 0x7f32c4004450 2023-11-28T11:54:11.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.580+0000 7f32d9b4c700 1 -- 172.21.15.50:0/711910446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d406d6a0 con 0x7f32c4004450 2023-11-28T11:54:11.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.584+0000 7f32d17fa700 1 -- 172.21.15.50:0/711910446 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f32c801c920 con 0x7f32c4004450 2023-11-28T11:54:11.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.584+0000 7f32d17fa700 1 --2- 172.21.15.50:0/711910446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f32b8064ee0 0x7f32b8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.584+0000 7f32d17fa700 1 -- 172.21.15.50:0/711910446 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f32c8085110 con 0x7f32c4004450 2023-11-28T11:54:11.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.584+0000 7f32d3fff700 1 --2- 172.21.15.50:0/711910446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f32b8064ee0 0x7f32b8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.584+0000 7f32d3fff700 1 --2- 172.21.15.50:0/711910446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f32b8064ee0 0x7f32b8067390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f32d4071e90 tx=0x7f32c000a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:11.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.584+0000 7f32de02e740 1 Processor -- start 2023-11-28T11:54:11.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.584+0000 7f32de02e740 1 -- start start 2023-11-28T11:54:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.584+0000 7f32de02e740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78ae0 0x22273b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32de02e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1f78710 0x2237120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32de02e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x2239670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32de02e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x20e7ae0 con 0x1fc3790 2023-11-28T11:54:11.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32de02e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x2157bd0 con 0x1f78710 2023-11-28T11:54:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32de02e740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x2150ed0 con 0x1f78ae0 2023-11-28T11:54:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32d934b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x2239670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32d934b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x2239670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53716/0 (socket says 172.21.15.50:53716) 2023-11-28T11:54:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32d3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1f78710 0x2237120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32d934b700 1 -- 172.21.15.50:0/663070148 learned_addr learned my addr 172.21.15.50:0/663070148 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32d8b4a700 1 --2- 172.21.15.50:0/663070148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78ae0 0x22273b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32d934b700 1 -- 172.21.15.50:0/663070148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78ae0 msgr2=0x22273b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32d934b700 1 --2- 172.21.15.50:0/663070148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78ae0 0x22273b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32d934b700 1 -- 172.21.15.50:0/663070148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1f78710 msgr2=0x2237120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32d934b700 1 --2- 172.21.15.50:0/663070148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1f78710 0x2237120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32d934b700 1 -- 172.21.15.50:0/663070148 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2176cc0 con 0x1fc3790 2023-11-28T11:54:11.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32d934b700 1 --2- 172.21.15.50:0/663070148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x2239670 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f32cc003d10 tx=0x7f32cc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8844d7f19e6957a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32be7fc700 1 -- 172.21.15.50:0/663070148 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc00e030 con 0x1fc3790 2023-11-28T11:54:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32be7fc700 1 -- 172.21.15.50:0/663070148 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32cc00f040 con 0x1fc3790 2023-11-28T11:54:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32be7fc700 1 -- 172.21.15.50:0/663070148 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc017470 con 0x1fc3790 2023-11-28T11:54:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32de02e740 1 -- 172.21.15.50:0/663070148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 msgr2=0x2239670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32de02e740 1 --2- 172.21.15.50:0/663070148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x2239670 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f32cc003d10 tx=0x7f32cc009750 comp rx=0 tx=0).stop 2023-11-28T11:54:11.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32de02e740 1 -- 172.21.15.50:0/663070148 shutdown_connections 2023-11-28T11:54:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32de02e740 1 --2- 172.21.15.50:0/663070148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x2239670 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32de02e740 1 --2- 172.21.15.50:0/663070148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1f78710 0x2237120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32de02e740 1 --2- 172.21.15.50:0/663070148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78ae0 0x22273b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32de02e740 1 -- 172.21.15.50:0/663070148 >> 172.21.15.50:0/663070148 conn(0x1f78eb0 msgr2=0x2211700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32de02e740 1 -- 172.21.15.50:0/663070148 shutdown_connections 2023-11-28T11:54:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32de02e740 1 -- 172.21.15.50:0/663070148 wait complete. 2023-11-28T11:54:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32de02e740 1 -- start start 2023-11-28T11:54:11.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.588+0000 7f32de02e740 1 Processor -- start 2023-11-28T11:54:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32de02e740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78710 0x220ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32de02e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1f78ae0 0x2232c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32de02e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x222c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32de02e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ffdb20 con 0x1fc3790 2023-11-28T11:54:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32de02e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x22339f0 con 0x1f78ae0 2023-11-28T11:54:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32de02e740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x2233c90 con 0x1f78710 2023-11-28T11:54:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32de02e740 10 client.0 _ll_register_callbacks cb 0x21ad0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:54:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32d934b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x222c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32d3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1f78ae0 0x2232c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32d8b4a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78710 0x220ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32d934b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x222c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53718/0 (socket says 172.21.15.50:53718) 2023-11-28T11:54:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32d934b700 1 -- 172.21.15.50:0/609491160 learned_addr learned my addr 172.21.15.50:0/609491160 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32d3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1f78ae0 0x2232c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:56196/0 (socket says 172.21.15.50:56196) 2023-11-28T11:54:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32d934b700 1 -- 172.21.15.50:0/609491160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78710 msgr2=0x220ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32d934b700 1 --2- 172.21.15.50:0/609491160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78710 0x220ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32d934b700 1 -- 172.21.15.50:0/609491160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1f78ae0 msgr2=0x2232c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:11.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32d934b700 1 --2- 172.21.15.50:0/609491160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1f78ae0 0x2232c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32d934b700 1 -- 172.21.15.50:0/609491160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32cc003a40 con 0x1fc3790 2023-11-28T11:54:11.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32d934b700 1 --2- 172.21.15.50:0/609491160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x222c9b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009790 tx=0x7f32cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f43b4c58f15b016 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:11.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32b37fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:54:11.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32b37fe700 1 -- 172.21.15.50:0/609491160 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc017c30 con 0x1fc3790 2023-11-28T11:54:11.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32b37fe700 1 -- 172.21.15.50:0/609491160 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f32cc026070 con 0x1fc3790 2023-11-28T11:54:11.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32de02e740 1 -- 172.21.15.50:0/609491160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2149f50 con 0x1fc3790 2023-11-28T11:54:11.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32b37fe700 1 -- 172.21.15.50:0/609491160 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32cc009be0 con 0x1fc3790 2023-11-28T11:54:11.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32de02e740 10 client.4809 fetch_fsmap learned FSMap version 9 2023-11-28T11:54:11.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32de02e740 1 -- 172.21.15.50:0/609491160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x1fc49e0 con 0x1fc3790 2023-11-28T11:54:11.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32b37fe700 1 -- 172.21.15.50:0/609491160 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2149f50 con 0x1fc3790 2023-11-28T11:54:11.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32b37fe700 1 -- 172.21.15.50:0/609491160 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 9) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f32cc02b480 con 0x1fc3790 2023-11-28T11:54:11.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32de02e740 10 client.4809 fetch_fsmap finished waiting for FSMap version 9 2023-11-28T11:54:11.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32de02e740 10 client.4809 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T11:54:11.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32de02e740 20 client.4809 populate_metadata read hostname 'smithi050' 2023-11-28T11:54:11.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32de02e740 1 --2- 172.21.15.50:0/609491160 >> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] conn(0x2229de0 0x222a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32de02e740 4 client.4809 mds_command: new command op to 4260 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:54:11.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.592+0000 7f32de02e740 1 -- 172.21.15.50:0/609491160 --> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2149c70 con 0x2229de0 2023-11-28T11:54:11.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32d8b4a700 1 --2- 172.21.15.50:0/609491160 >> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] conn(0x2229de0 0x222a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32b37fe700 10 client.4809 ms_handle_connect on v2:172.21.15.50:6834/3764199418 2023-11-28T11:54:11.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32d8b4a700 1 --2- 172.21.15.50:0/609491160 >> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] conn(0x2229de0 0x222a1b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ab4ec90ad5cad17 server_cookie=9192ab8b2230180b in_seq=0 out_seq=0 2023-11-28T11:54:11.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32b37fe700 1 -- 172.21.15.50:0/609491160 <== mds.0 v2:172.21.15.50:6834/3764199418 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x2149c70 con 0x2229de0 2023-11-28T11:54:11.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32b37fe700 10 client.4809 handle_command_reply: tid=0 2023-11-28T11:54:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32de02e740 1 client.4809 shutdown 2023-11-28T11:54:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32de02e740 1 -- 172.21.15.50:0/609491160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 msgr2=0x222c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32de02e740 1 --2- 172.21.15.50:0/609491160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x222c9b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009790 tx=0x7f32cc016000 comp rx=0 tx=0).stop 2023-11-28T11:54:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32de02e740 1 -- 172.21.15.50:0/609491160 shutdown_connections 2023-11-28T11:54:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32de02e740 1 --2- 172.21.15.50:0/609491160 >> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] conn(0x2229de0 0x222a1b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32de02e740 1 --2- 172.21.15.50:0/609491160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x222c9b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32b37fe700 0 client.4809 ms_handle_reset on v2:172.21.15.50:6834/3764199418 2023-11-28T11:54:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32de02e740 1 --2- 172.21.15.50:0/609491160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1f78ae0 0x2232c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32de02e740 1 --2- 172.21.15.50:0/609491160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78710 0x220ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32de02e740 1 -- 172.21.15.50:0/609491160 >> 172.21.15.50:0/609491160 conn(0x1f78eb0 msgr2=0x222a760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32de02e740 1 -- 172.21.15.50:0/609491160 shutdown_connections 2023-11-28T11:54:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32de02e740 1 -- 172.21.15.50:0/609491160 wait complete. 2023-11-28T11:54:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.596+0000 7f32de02e740 20 client.4809 trim_cache size 0 max 16384 2023-11-28T11:54:11.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32de02e740 1 Processor -- start 2023-11-28T11:54:11.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32de02e740 1 -- start start 2023-11-28T11:54:11.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32de02e740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78710 0x22112e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32de02e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1f78ae0 0x2211820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32de02e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x222f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32de02e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2158e60 con 0x1fc3790 2023-11-28T11:54:11.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32de02e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x2153a30 con 0x1f78ae0 2023-11-28T11:54:11.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32de02e740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x2126de0 con 0x1f78710 2023-11-28T11:54:11.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32d934b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x222f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32d3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1f78ae0 0x2211820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32d934b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x222f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53720/0 (socket says 172.21.15.50:53720) 2023-11-28T11:54:11.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32d934b700 1 -- 172.21.15.50:0/1655218831 learned_addr learned my addr 172.21.15.50:0/1655218831 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:11.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32d8b4a700 1 --2- 172.21.15.50:0/1655218831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78710 0x22112e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32d934b700 1 -- 172.21.15.50:0/1655218831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78710 msgr2=0x22112e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:11.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32d934b700 1 --2- 172.21.15.50:0/1655218831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78710 0x22112e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32d934b700 1 -- 172.21.15.50:0/1655218831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1f78ae0 msgr2=0x2211820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:11.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32d934b700 1 --2- 172.21.15.50:0/1655218831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1f78ae0 0x2211820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.616+0000 7f32d934b700 1 -- 172.21.15.50:0/1655218831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2229720 con 0x1fc3790 2023-11-28T11:54:11.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.620+0000 7f32d8b4a700 1 --2- 172.21.15.50:0/1655218831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78710 0x22112e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:11.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.620+0000 7f32d934b700 1 --2- 172.21.15.50:0/1655218831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x222f4b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f32cc017680 tx=0x7f32cc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdd0a11ca0fa1a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:11.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.620+0000 7f32beffd700 1 -- 172.21.15.50:0/1655218831 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc00e040 con 0x1fc3790 2023-11-28T11:54:11.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.620+0000 7f32beffd700 1 -- 172.21.15.50:0/1655218831 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32cc024070 con 0x1fc3790 2023-11-28T11:54:11.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.620+0000 7f32beffd700 1 -- 172.21.15.50:0/1655218831 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc02bb50 con 0x1fc3790 2023-11-28T11:54:11.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.620+0000 7f32de02e740 1 -- 172.21.15.50:0/1655218831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 msgr2=0x222f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:11.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.620+0000 7f32de02e740 1 --2- 172.21.15.50:0/1655218831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x222f4b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f32cc017680 tx=0x7f32cc018000 comp rx=0 tx=0).stop 2023-11-28T11:54:11.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.620+0000 7f32de02e740 1 -- 172.21.15.50:0/1655218831 shutdown_connections 2023-11-28T11:54:11.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.620+0000 7f32de02e740 1 --2- 172.21.15.50:0/1655218831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1fc3790 0x222f4b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.620+0000 7f32de02e740 1 --2- 172.21.15.50:0/1655218831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1f78ae0 0x2211820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.620+0000 7f32de02e740 1 --2- 172.21.15.50:0/1655218831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78710 0x22112e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.620+0000 7f32de02e740 1 -- 172.21.15.50:0/1655218831 >> 172.21.15.50:0/1655218831 conn(0x1f78eb0 msgr2=0x2231e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:11.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.620+0000 7f32de02e740 1 -- 172.21.15.50:0/1655218831 shutdown_connections 2023-11-28T11:54:11.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.620+0000 7f32de02e740 1 -- 172.21.15.50:0/1655218831 wait complete. 2023-11-28T11:54:11.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.620+0000 7f32de02e740 1 -- start start 2023-11-28T11:54:11.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.620+0000 7f32de02e740 1 Processor -- start 2023-11-28T11:54:11.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32de02e740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78710 0x21e8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32de02e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1f78ae0 0x21e68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32de02e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1fc3790 0x21e4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32de02e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x214e6e0 con 0x1f78ae0 2023-11-28T11:54:11.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32de02e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x214c840 con 0x1fc3790 2023-11-28T11:54:11.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32de02e740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x21e7d30 con 0x1f78710 2023-11-28T11:54:11.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32de02e740 10 client.0 _ll_register_callbacks cb 0x20fd2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:54:11.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32d3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1f78ae0 0x21e68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32d934b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1fc3790 0x21e4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32d3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1f78ae0 0x21e68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38506/0 (socket says 172.21.15.50:38506) 2023-11-28T11:54:11.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32d3fff700 1 -- 172.21.15.50:0/597369960 learned_addr learned my addr 172.21.15.50:0/597369960 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:11.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32d8b4a700 1 --2- 172.21.15.50:0/597369960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78710 0x21e8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32d3fff700 1 -- 172.21.15.50:0/597369960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78710 msgr2=0x21e8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:11.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32d3fff700 1 --2- 172.21.15.50:0/597369960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78710 0x21e8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32d3fff700 1 -- 172.21.15.50:0/597369960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1fc3790 msgr2=0x21e4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:11.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32d3fff700 1 --2- 172.21.15.50:0/597369960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1fc3790 0x21e4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32d3fff700 1 -- 172.21.15.50:0/597369960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1fc49e0 con 0x1f78ae0 2023-11-28T11:54:11.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32d3fff700 1 --2- 172.21.15.50:0/597369960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1f78ae0 0x21e68f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f32c000c8e0 tx=0x7f32c0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a375b2b2fa79f59a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:11.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32b37fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:54:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32b37fe700 1 -- 172.21.15.50:0/597369960 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0007660 con 0x1f78ae0 2023-11-28T11:54:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32b37fe700 1 -- 172.21.15.50:0/597369960 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f32c00077c0 con 0x1f78ae0 2023-11-28T11:54:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32de02e740 1 -- 172.21.15.50:0/597369960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32cc00f040 con 0x1f78ae0 2023-11-28T11:54:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32b37fe700 1 -- 172.21.15.50:0/597369960 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32c002c430 con 0x1f78ae0 2023-11-28T11:54:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32de02e740 10 client.4815 fetch_fsmap learned FSMap version 9 2023-11-28T11:54:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32de02e740 1 -- 172.21.15.50:0/597369960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x21178a0 con 0x1f78ae0 2023-11-28T11:54:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32b37fe700 1 -- 172.21.15.50:0/597369960 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32cc00f040 con 0x1f78ae0 2023-11-28T11:54:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32b37fe700 1 -- 172.21.15.50:0/597369960 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 9) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f32c002c590 con 0x1f78ae0 2023-11-28T11:54:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32de02e740 10 client.4815 fetch_fsmap finished waiting for FSMap version 9 2023-11-28T11:54:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32de02e740 10 client.4815 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T11:54:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32de02e740 20 client.4815 populate_metadata read hostname 'smithi050' 2023-11-28T11:54:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32de02e740 1 --2- 172.21.15.50:0/597369960 >> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] conn(0x21e4e60 0x2293f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32de02e740 4 client.4815 mds_command: new command op to 4260 tid=0[{"prefix": "status"}] 2023-11-28T11:54:11.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32de02e740 1 -- 172.21.15.50:0/597369960 --> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1ff5260 con 0x21e4e60 2023-11-28T11:54:11.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32d8b4a700 1 --2- 172.21.15.50:0/597369960 >> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] conn(0x21e4e60 0x2293f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32b37fe700 10 client.4815 ms_handle_connect on v2:172.21.15.50:6834/3764199418 2023-11-28T11:54:11.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.624+0000 7f32d8b4a700 1 --2- 172.21.15.50:0/597369960 >> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] conn(0x21e4e60 0x2293f50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8a5dce9e000f7f2 server_cookie=f1738eb3ed7125d6 in_seq=0 out_seq=0 2023-11-28T11:54:11.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32b37fe700 1 -- 172.21.15.50:0/597369960 <== mds.0 v2:172.21.15.50:6834/3764199418 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x1ff5260 con 0x21e4e60 2023-11-28T11:54:11.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32b37fe700 10 client.4815 handle_command_reply: tid=0 2023-11-28T11:54:11.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32de02e740 1 client.4815 shutdown 2023-11-28T11:54:11.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32de02e740 1 -- 172.21.15.50:0/597369960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1f78ae0 msgr2=0x21e68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:11.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32de02e740 1 --2- 172.21.15.50:0/597369960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1f78ae0 0x21e68f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f32c000c8e0 tx=0x7f32c0001a00 comp rx=0 tx=0).stop 2023-11-28T11:54:11.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32de02e740 1 -- 172.21.15.50:0/597369960 shutdown_connections 2023-11-28T11:54:11.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32de02e740 1 --2- 172.21.15.50:0/597369960 >> [v2:172.21.15.50:6834/3764199418,v1:172.21.15.50:6835/3764199418] conn(0x21e4e60 0x2293f50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32de02e740 1 --2- 172.21.15.50:0/597369960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1fc3790 0x21e4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32b37fe700 0 client.4815 ms_handle_reset on v2:172.21.15.50:6834/3764199418 2023-11-28T11:54:11.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32de02e740 1 --2- 172.21.15.50:0/597369960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1f78ae0 0x21e68f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32de02e740 1 --2- 172.21.15.50:0/597369960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1f78710 0x21e8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32de02e740 1 -- 172.21.15.50:0/597369960 >> 172.21.15.50:0/597369960 conn(0x1f78eb0 msgr2=0x22112e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:11.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32de02e740 1 -- 172.21.15.50:0/597369960 shutdown_connections 2023-11-28T11:54:11.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32de02e740 1 -- 172.21.15.50:0/597369960 wait complete. 2023-11-28T11:54:11.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32de02e740 20 client.4815 trim_cache size 0 max 16384 2023-11-28T11:54:11.638 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:54:11.638 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "cfe07b6e-9334-49cb-bc97-5dba7caa4ff8", 2023-11-28T11:54:11.638 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-11-28T11:54:11.638 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4260, 2023-11-28T11:54:11.639 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-11-28T11:54:11.639 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-11-28T11:54:11.639 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-11-28T11:54:11.639 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 30.830912407, 2023-11-28T11:54:11.639 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 9, 2023-11-28T11:54:11.639 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 25, 2023-11-28T11:54:11.639 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 25, 2023-11-28T11:54:11.639 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 36.145575616000002 2023-11-28T11:54:11.639 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:54:11.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32d9b4c700 1 -- 172.21.15.50:0/711910446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f32b8064ee0 msgr2=0x7f32b8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:11.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32d9b4c700 1 --2- 172.21.15.50:0/711910446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f32b8064ee0 0x7f32b8067390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f32d4071e90 tx=0x7f32c000a000 comp rx=0 tx=0).stop 2023-11-28T11:54:11.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32d9b4c700 1 -- 172.21.15.50:0/711910446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c4004450 msgr2=0x7f32d40c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:11.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32d9b4c700 1 --2- 172.21.15.50:0/711910446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c4004450 0x7f32d40c54b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f32c8012df0 tx=0x7f32c80106c0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32d9b4c700 1 -- 172.21.15.50:0/711910446 shutdown_connections 2023-11-28T11:54:11.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32d9b4c700 1 --2- 172.21.15.50:0/711910446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32d41eccf0 0x7f32d4070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32d9b4c700 1 --2- 172.21.15.50:0/711910446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f32b8064ee0 0x7f32b8067390 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32d9b4c700 1 --2- 172.21.15.50:0/711910446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32d4150450 0x7f32d41ec7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32d9b4c700 1 --2- 172.21.15.50:0/711910446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32c4004450 0x7f32d40c54b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32d9b4c700 1 -- 172.21.15.50:0/711910446 >> 172.21.15.50:0/711910446 conn(0x7f32d40ce3e0 msgr2=0x7f32d40b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:11.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32d9b4c700 1 -- 172.21.15.50:0/711910446 shutdown_connections 2023-11-28T11:54:11.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.628+0000 7f32d9b4c700 1 -- 172.21.15.50:0/711910446 wait complete. 2023-11-28T11:54:11.652 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-28T11:54:11.664 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-28T11:54:11.665 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-28T11:54:11.665 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-28T11:54:11.665 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T11:54:11.665 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T11:54:11.665 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-28T11:54:11.665 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T11:54:11.665 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T11:54:11.665 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-28T11:54:11.666 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T11:54:11.666 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T11:54:11.666 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-28T11:54:11.666 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T11:54:11.666 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T11:54:11.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:11.666 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-11-28T11:54:11.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:11.675 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2023-11-28T11:54:11.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:54:11.695 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2023-11-28T11:54:11.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:11.695 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-11-28T11:54:11.703 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-28T11:54:11.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:11.703 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T11:54:11.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:11.717 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-11-28T11:54:11.821 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-28T11:54:11.821 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:54:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe9703a700 1 Processor -- start 2023-11-28T11:54:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe9703a700 1 -- start start 2023-11-28T11:54:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe9703a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe900ca310 0x7fbe9006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe9703a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbe90069eb0 0x7fbe9006c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe9703a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbe9006cbb0 0x7fbe9015b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe9703a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9006d000 con 0x7fbe9006cbb0 2023-11-28T11:54:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe9703a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe900cca10 con 0x7fbe90069eb0 2023-11-28T11:54:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe9703a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9006a670 con 0x7fbe900ca310 2023-11-28T11:54:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe96839700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbe9006cbb0 0x7fbe9015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe96839700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbe9006cbb0 0x7fbe9015b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38514/0 (socket says 172.21.15.50:38514) 2023-11-28T11:54:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe96839700 1 -- 172.21.15.50:0/3105917672 learned_addr learned my addr 172.21.15.50:0/3105917672 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe96038700 1 --2- 172.21.15.50:0/3105917672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe900ca310 0x7fbe9006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe95837700 1 --2- 172.21.15.50:0/3105917672 >> v2:172.21.15.192:3300/0 conn(0x7fbe90069eb0 0x7fbe9006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe96839700 1 -- 172.21.15.50:0/3105917672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe900ca310 msgr2=0x7fbe9006c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:11.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe96839700 1 --2- 172.21.15.50:0/3105917672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe900ca310 0x7fbe9006c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe96839700 1 -- 172.21.15.50:0/3105917672 >> v2:172.21.15.192:3300/0 conn(0x7fbe90069eb0 msgr2=0x7fbe9006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:11.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe96839700 1 --2- 172.21.15.50:0/3105917672 >> v2:172.21.15.192:3300/0 conn(0x7fbe90069eb0 0x7fbe9006c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe96839700 1 -- 172.21.15.50:0/3105917672 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9006a950 con 0x7fbe9006cbb0 2023-11-28T11:54:11.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe96839700 1 --2- 172.21.15.50:0/3105917672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe9006cbb0 0x7fbe9015b9f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbe9006fb90 tx=0x7fbe8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a186245457d707 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:11.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe95036700 1 -- 172.21.15.50:0/3105917672 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800e070 con 0x7fbe9006cbb0 2023-11-28T11:54:11.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe95036700 1 -- 172.21.15.50:0/3105917672 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8800b9c0 con 0x7fbe9006cbb0 2023-11-28T11:54:11.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe95036700 1 -- 172.21.15.50:0/3105917672 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800bd70 con 0x7fbe9006cbb0 2023-11-28T11:54:11.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe9703a700 1 -- 172.21.15.50:0/3105917672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe9006cbb0 msgr2=0x7fbe9015b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:11.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe9703a700 1 --2- 172.21.15.50:0/3105917672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe9006cbb0 0x7fbe9015b9f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbe9006fb90 tx=0x7fbe8800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:11.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe9703a700 1 -- 172.21.15.50:0/3105917672 shutdown_connections 2023-11-28T11:54:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe9703a700 1 --2- 172.21.15.50:0/3105917672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe9006cbb0 0x7fbe9015b9f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe9703a700 1 --2- 172.21.15.50:0/3105917672 >> v2:172.21.15.192:3300/0 conn(0x7fbe90069eb0 0x7fbe9006c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe9703a700 1 --2- 172.21.15.50:0/3105917672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe900ca310 0x7fbe9006c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe9703a700 1 -- 172.21.15.50:0/3105917672 >> 172.21.15.50:0/3105917672 conn(0x7fbe900ce3e0 msgr2=0x7fbe900ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe9703a700 1 -- 172.21.15.50:0/3105917672 shutdown_connections 2023-11-28T11:54:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.928+0000 7fbe9703a700 1 -- 172.21.15.50:0/3105917672 wait complete. 2023-11-28T11:54:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe9703a700 1 Processor -- start 2023-11-28T11:54:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe9703a700 1 -- start start 2023-11-28T11:54:11.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe9703a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe90069eb0 0x7fbe90098c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe9703a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe9006cbb0 0x7fbe901f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe9703a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe900ca310 0x7fbe900c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe9703a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe900991b0 con 0x7fbe900ca310 2023-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe9703a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe90156090 con 0x7fbe90069eb0 2023-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe9703a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe900989a0 con 0x7fbe9006cbb0 2023-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe96839700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe900ca310 0x7fbe900c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe96839700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe900ca310 0x7fbe900c7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38522/0 (socket says 172.21.15.50:38522) 2023-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe96839700 1 -- 172.21.15.50:0/2138875604 learned_addr learned my addr 172.21.15.50:0/2138875604 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe96038700 1 --2- 172.21.15.50:0/2138875604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe90069eb0 0x7fbe90098c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe95837700 1 --2- 172.21.15.50:0/2138875604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe9006cbb0 0x7fbe901f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe96839700 1 -- 172.21.15.50:0/2138875604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe9006cbb0 msgr2=0x7fbe901f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe96839700 1 --2- 172.21.15.50:0/2138875604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe9006cbb0 0x7fbe901f0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe96839700 1 -- 172.21.15.50:0/2138875604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe90069eb0 msgr2=0x7fbe90098c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe96839700 1 --2- 172.21.15.50:0/2138875604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe90069eb0 0x7fbe90098c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe96839700 1 -- 172.21.15.50:0/2138875604 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe88009b30 con 0x7fbe900ca310 2023-11-28T11:54:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe96038700 1 --2- 172.21.15.50:0/2138875604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe90069eb0 0x7fbe90098c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe95837700 1 --2- 172.21.15.50:0/2138875604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe9006cbb0 0x7fbe901f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:54:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe96839700 1 --2- 172.21.15.50:0/2138875604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe900ca310 0x7fbe900c7680 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800b370 tx=0x7fbe88004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe86ffd700 1 -- 172.21.15.50:0/2138875604 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88004250 con 0x7fbe900ca310 2023-11-28T11:54:11.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe86ffd700 1 -- 172.21.15.50:0/2138875604 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe880043b0 con 0x7fbe900ca310 2023-11-28T11:54:11.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe9703a700 1 -- 172.21.15.50:0/2138875604 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe900c8a30 con 0x7fbe900ca310 2023-11-28T11:54:11.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe86ffd700 1 -- 172.21.15.50:0/2138875604 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88004740 con 0x7fbe900ca310 2023-11-28T11:54:11.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.932+0000 7fbe9703a700 1 -- 172.21.15.50:0/2138875604 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9006ac30 con 0x7fbe900ca310 2023-11-28T11:54:11.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.936+0000 7fbe9703a700 1 -- 172.21.15.50:0/2138875604 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe9006af10 con 0x7fbe900ca310 2023-11-28T11:54:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.936+0000 7fbe86ffd700 1 -- 172.21.15.50:0/2138875604 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbe8802c020 con 0x7fbe900ca310 2023-11-28T11:54:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.936+0000 7fbe86ffd700 1 --2- 172.21.15.50:0/2138875604 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbe74064f30 0x7fbe740673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.936+0000 7fbe86ffd700 1 -- 172.21.15.50:0/2138875604 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbe88083430 con 0x7fbe900ca310 2023-11-28T11:54:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.936+0000 7fbe96038700 1 --2- 172.21.15.50:0/2138875604 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbe74064f30 0x7fbe740673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:11.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.936+0000 7fbe96038700 1 --2- 172.21.15.50:0/2138875604 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbe74064f30 0x7fbe740673e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c007a70 tx=0x7fbe8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:11.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:11.944+0000 7fbe86ffd700 1 -- 172.21.15.50:0/2138875604 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbe880511f0 con 0x7fbe900ca310 2023-11-28T11:54:12.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:12.144+0000 7fbe9703a700 1 -- 172.21.15.50:0/2138875604 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbe90072500 con 0x7fbe900ca310 2023-11-28T11:54:12.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:12.144+0000 7fbe86ffd700 1 -- 172.21.15.50:0/2138875604 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbe88020070 con 0x7fbe900ca310 2023-11-28T11:54:12.149 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-28T11:54:12.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:12.144+0000 7fbe9703a700 1 -- 172.21.15.50:0/2138875604 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbe74064f30 msgr2=0x7fbe740673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:12.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:12.144+0000 7fbe9703a700 1 --2- 172.21.15.50:0/2138875604 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbe74064f30 0x7fbe740673e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c007a70 tx=0x7fbe8c008040 comp rx=0 tx=0).stop 2023-11-28T11:54:12.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:12.144+0000 7fbe9703a700 1 -- 172.21.15.50:0/2138875604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe900ca310 msgr2=0x7fbe900c7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:12.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:12.144+0000 7fbe9703a700 1 --2- 172.21.15.50:0/2138875604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe900ca310 0x7fbe900c7680 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800b370 tx=0x7fbe88004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:12.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:12.144+0000 7fbe9703a700 1 -- 172.21.15.50:0/2138875604 shutdown_connections 2023-11-28T11:54:12.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:12.144+0000 7fbe9703a700 1 --2- 172.21.15.50:0/2138875604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe900ca310 0x7fbe900c7680 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:12.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:12.144+0000 7fbe9703a700 1 --2- 172.21.15.50:0/2138875604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe9006cbb0 0x7fbe901f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:12.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:12.144+0000 7fbe9703a700 1 --2- 172.21.15.50:0/2138875604 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbe74064f30 0x7fbe740673e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:12.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:12.144+0000 7fbe9703a700 1 --2- 172.21.15.50:0/2138875604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe90069eb0 0x7fbe90098c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:12.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:12.144+0000 7fbe9703a700 1 -- 172.21.15.50:0/2138875604 >> 172.21.15.50:0/2138875604 conn(0x7fbe900ce3e0 msgr2=0x7fbe900ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:12.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:12.144+0000 7fbe9703a700 1 -- 172.21.15.50:0/2138875604 shutdown_connections 2023-11-28T11:54:12.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:12.144+0000 7fbe9703a700 1 -- 172.21.15.50:0/2138875604 wait complete. 2023-11-28T11:54:12.164 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:54:12.164 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:54:12.164 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-11-28T11:54:12.164 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T11:54:12.164 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T11:54:12.164 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:54:12.164 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T11:54:12.164 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:54:12.164 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:54:12.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:12.165 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-11-28T11:54:12.170 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:54:12.170 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:54:12.170 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:54:12.170 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:12.170 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-11-28T11:54:12.170 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:12.170 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:54:12.170 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:12.171 INFO:teuthology.orchestra.run.smithi050.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:54:12.171 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:12.171 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T11:54:12.171 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42540sec preferred_lft 42540sec 2023-11-28T11:54:12.171 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-11-28T11:54:12.171 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:12.171 INFO:teuthology.orchestra.run.smithi050.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:54:12.171 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:12.171 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:54:12.171 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:12.171 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T11:54:12.171 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:5d:90:5e:15 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:12.172 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T11:54:12.172 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:12.172 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T11:54:12.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:12.172 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-11-28T11:54:12.172 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-11-28T11:54:12.172 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2023-11-28T11:54:12.172 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2023-11-28T11:54:12.172 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2023-11-28T11:54:12.172 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T11:54:12.173 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-11-28T11:54:12.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:12.262 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:54:12.273 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-11-28T11:54:12.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:12.275 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-11-28T11:54:12.282 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-11-28T11:54:12.282 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:54:12.283 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T11:54:12.284 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T11:54:12.284 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T11:54:12.284 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:54:12.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:12.286 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-11-28T11:54:12.286 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-11-28T11:54:12.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T11:54:12.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T11:54:12.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T11:54:12.286 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-11-28T11:54:12.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:12.365 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-11-28T11:54:12.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:12.373 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-11-28T11:54:12.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:12.381 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-11-28T11:54:12.381 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-11-28T11:54:12.381 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T11:54:12.381 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-28T11:54:12.382 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-11-28T11:54:12.413 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-28T11:54:12.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:12.413 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-11-28T11:54:12.413 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-11-28T11:54:12.413 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-28T11:54:12.413 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T11:54:12.413 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-28T11:54:12.413 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-28T11:54:12.414 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-28T11:54:12.414 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-11-28T11:54:12.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:12.521 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-11-28T11:54:12.521 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-11-28T11:54:12.522 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-11-28T11:54:12.522 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T11:54:12.522 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-11-28T11:54:12.550 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T11:54:12.550 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:54:12.551 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T11:54:12.558 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:54:12.558 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:54:12.558 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:54:12.605 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:54:12.622 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:54:12.623 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:54:12.632 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:54:12.633 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:54:12.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:12.634 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:54:12.638 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T11:54:12.639 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-28T11:54:12.681 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:54:12.698 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:54:12.698 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:54:12.707 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:54:12.708 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:54:12.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:12.709 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:54:12.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:2023-11-28T11:54:12.776+0000 7fb6a84a8640 -1 init, newargv = 0x55719e02a6a0 newargc=15 2023-11-28T11:54:12.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[43937]: starting ceph client 2023-11-28T11:54:12.791 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[43937]: starting fuse 2023-11-28T11:54:13.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:54:13.881 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:54:13.881 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:54:13.896 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:54:13.896 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:54:13.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:13.897 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:54:13.904 INFO:teuthology.orchestra.run.smithi050.stdout:52 2023-11-28T11:54:13.904 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-28T11:54:13.904 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:54:13.904 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-11-28T11:54:13.904 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-11-28T11:54:13.905 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-11-28T11:54:13.905 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-11-28T11:54:13.905 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:54:13.905 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-11-28T11:54:13.905 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T11:54:13.905 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-11-28T11:54:13.905 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T11:54:13.905 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:54:13.905 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-11-28T11:54:13.905 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-11-28T11:54:13.906 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-11-28T11:54:13.906 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-11-28T11:54:13.906 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:54:13.906 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-11-28T11:54:13.906 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T11:54:13.906 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T11:54:13.906 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T11:54:13.906 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-11-28T11:54:13.906 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-11-28T11:54:13.906 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-11-28T11:54:13.906 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T11:54:13.906 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:54:13.907 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.0")) 2023-11-28T11:54:13.907 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-11-28T11:54:13.990 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.0.43937.asok 2023-11-28T11:54:14.172 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43937.asok 2023-11-28T11:54:14.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:14.172 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43937.asok status 2023-11-28T11:54:14.314 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:54:14.314 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-11-28T11:54:14.314 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T11:54:14.314 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T11:54:14.314 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "0", 2023-11-28T11:54:14.314 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-11-28T11:54:14.314 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T11:54:14.315 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "43937", 2023-11-28T11:54:14.315 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-11-28T11:54:14.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:14.315 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-11-28T11:54:14.315 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-11-28T11:54:14.315 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4830, 2023-11-28T11:54:14.315 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-11-28T11:54:14.315 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-11-28T11:54:14.315 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-11-28T11:54:14.315 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 4830 2023-11-28T11:54:14.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:14.315 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-11-28T11:54:14.316 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-11-28T11:54:14.316 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:54:14.316 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1466240279 2023-11-28T11:54:14.316 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:14.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:14.316 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-11-28T11:54:14.316 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-11-28T11:54:14.316 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:54:14.316 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1466240279 2023-11-28T11:54:14.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:14.316 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.4830 192.168.0.1:0/1466240279", 2023-11-28T11:54:14.316 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/1466240279", 2023-11-28T11:54:14.317 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-11-28T11:54:14.317 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 9, 2023-11-28T11:54:14.317 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 25, 2023-11-28T11:54:14.317 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-11-28T11:54:14.317 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-11-28T11:54:14.317 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-11-28T11:54:14.317 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:54:14.324 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:54:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.428+0000 7fdf6b0fe700 1 Processor -- start 2023-11-28T11:54:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.428+0000 7fdf6b0fe700 1 -- start start 2023-11-28T11:54:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6b0fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdf641584c0 0x7fdf640cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6b0fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf6406ace0 0x7fdf640b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6b0fe700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf640b3c60 con 0x7fdf640b32e0 2023-11-28T11:54:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6b0fe700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6406dbd0 con 0x7fdf6406ace0 2023-11-28T11:54:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6b0fe700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf640cd0f0 con 0x7fdf641584c0 2023-11-28T11:54:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6a8fd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf6406ace0 0x7fdf640b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf698fb700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdf640b32e0 0x7fdf6406bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36366/0 (socket says 172.21.15.50:36366) 2023-11-28T11:54:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf698fb700 1 -- 172.21.15.50:0/3115838096 learned_addr learned my addr 172.21.15.50:0/3115838096 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6a0fc700 1 --2- 172.21.15.50:0/3115838096 >> v2:172.21.15.192:3300/0 conn(0x7fdf641584c0 0x7fdf640cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6a8fd700 1 -- 172.21.15.50:0/3115838096 >> v2:172.21.15.192:3300/0 conn(0x7fdf641584c0 msgr2=0x7fdf640cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6a8fd700 1 --2- 172.21.15.50:0/3115838096 >> v2:172.21.15.192:3300/0 conn(0x7fdf641584c0 0x7fdf640cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6a8fd700 1 -- 172.21.15.50:0/3115838096 >> v1:172.21.15.50:6789/0 conn(0x7fdf640b32e0 legacy=0x7fdf6406bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6a8fd700 1 -- 172.21.15.50:0/3115838096 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf640cd3d0 con 0x7fdf6406ace0 2023-11-28T11:54:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf690fa700 1 -- 172.21.15.50:0/3115838096 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525298452 0 0) 0x7fdf640b3c60 con 0x7fdf640b32e0 2023-11-28T11:54:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6a0fc700 1 --2- 172.21.15.50:0/3115838096 >> v2:172.21.15.192:3300/0 conn(0x7fdf641584c0 0x7fdf640cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6a8fd700 1 --2- 172.21.15.50:0/3115838096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf6406ace0 0x7fdf640b3720 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdf6406f8b0 tx=0x7fdf5c00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdff573b1596d02 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf690fa700 1 -- 172.21.15.50:0/3115838096 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c010070 con 0x7fdf6406ace0 2023-11-28T11:54:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf690fa700 1 -- 172.21.15.50:0/3115838096 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5c00b2e0 con 0x7fdf6406ace0 2023-11-28T11:54:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf690fa700 1 -- 172.21.15.50:0/3115838096 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c00dcc0 con 0x7fdf6406ace0 2023-11-28T11:54:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6b0fe700 1 -- 172.21.15.50:0/3115838096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf6406ace0 msgr2=0x7fdf640b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6b0fe700 1 --2- 172.21.15.50:0/3115838096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf6406ace0 0x7fdf640b3720 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdf6406f8b0 tx=0x7fdf5c00d330 comp rx=0 tx=0).stop 2023-11-28T11:54:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6b0fe700 1 -- 172.21.15.50:0/3115838096 shutdown_connections 2023-11-28T11:54:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6b0fe700 1 --2- 172.21.15.50:0/3115838096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf6406ace0 0x7fdf640b3720 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6b0fe700 1 --2- 172.21.15.50:0/3115838096 >> v2:172.21.15.192:3300/0 conn(0x7fdf641584c0 0x7fdf640cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6b0fe700 1 -- 172.21.15.50:0/3115838096 >> 172.21.15.50:0/3115838096 conn(0x7fdf640ce3e0 msgr2=0x7fdf640ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6b0fe700 1 -- 172.21.15.50:0/3115838096 shutdown_connections 2023-11-28T11:54:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.432+0000 7fdf6b0fe700 1 -- 172.21.15.50:0/3115838096 wait complete. 2023-11-28T11:54:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.436+0000 7fdf6b0fe700 1 Processor -- start 2023-11-28T11:54:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.436+0000 7fdf6b0fe700 1 -- start start 2023-11-28T11:54:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.436+0000 7fdf6b0fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf6406ace0 0x7fdf641543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.436+0000 7fdf6b0fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf640b32e0 0x7fdf641552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.436+0000 7fdf6b0fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf641584c0 0x7fdf64155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.436+0000 7fdf6b0fe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf640c5130 con 0x7fdf640b32e0 2023-11-28T11:54:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.436+0000 7fdf6b0fe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf640b0d20 con 0x7fdf641584c0 2023-11-28T11:54:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.436+0000 7fdf6b0fe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf641548f0 con 0x7fdf6406ace0 2023-11-28T11:54:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.436+0000 7fdf698fb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf640b32e0 0x7fdf641552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.436+0000 7fdf698fb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf640b32e0 0x7fdf641552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38540/0 (socket says 172.21.15.50:38540) 2023-11-28T11:54:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.436+0000 7fdf698fb700 1 -- 172.21.15.50:0/3517588422 learned_addr learned my addr 172.21.15.50:0/3517588422 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.436+0000 7fdf6a8fd700 1 --2- 172.21.15.50:0/3517588422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf641584c0 0x7fdf64155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.436+0000 7fdf6a0fc700 1 --2- 172.21.15.50:0/3517588422 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf6406ace0 0x7fdf641543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.440+0000 7fdf698fb700 1 -- 172.21.15.50:0/3517588422 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf6406ace0 msgr2=0x7fdf641543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.440+0000 7fdf698fb700 1 --2- 172.21.15.50:0/3517588422 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf6406ace0 0x7fdf641543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.440+0000 7fdf698fb700 1 -- 172.21.15.50:0/3517588422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf641584c0 msgr2=0x7fdf64155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.440+0000 7fdf698fb700 1 --2- 172.21.15.50:0/3517588422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf641584c0 0x7fdf64155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.440+0000 7fdf698fb700 1 -- 172.21.15.50:0/3517588422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c00bc80 con 0x7fdf640b32e0 2023-11-28T11:54:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.440+0000 7fdf698fb700 1 --2- 172.21.15.50:0/3517588422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf640b32e0 0x7fdf641552c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000c580 tx=0x7fdf6000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.440+0000 7fdf5affd700 1 -- 172.21.15.50:0/3517588422 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf60004ca0 con 0x7fdf640b32e0 2023-11-28T11:54:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.440+0000 7fdf5affd700 1 -- 172.21.15.50:0/3517588422 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf60004e20 con 0x7fdf640b32e0 2023-11-28T11:54:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.440+0000 7fdf6b0fe700 1 -- 172.21.15.50:0/3517588422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf640cd990 con 0x7fdf640b32e0 2023-11-28T11:54:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.440+0000 7fdf5affd700 1 -- 172.21.15.50:0/3517588422 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf60007310 con 0x7fdf640b32e0 2023-11-28T11:54:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.440+0000 7fdf6b0fe700 1 -- 172.21.15.50:0/3517588422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf640cd6b0 con 0x7fdf640b32e0 2023-11-28T11:54:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.440+0000 7fdf6b0fe700 1 -- 172.21.15.50:0/3517588422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf640cdc70 con 0x7fdf640b32e0 2023-11-28T11:54:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.440+0000 7fdf5affd700 1 -- 172.21.15.50:0/3517588422 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdf6001a020 con 0x7fdf640b32e0 2023-11-28T11:54:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.444+0000 7fdf5affd700 1 --2- 172.21.15.50:0/3517588422 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdf48064ee0 0x7fdf48067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:14.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.444+0000 7fdf5affd700 1 -- 172.21.15.50:0/3517588422 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdf60081cb0 con 0x7fdf640b32e0 2023-11-28T11:54:14.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.444+0000 7fdf6a0fc700 1 --2- 172.21.15.50:0/3517588422 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdf48064ee0 0x7fdf48067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:14.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.444+0000 7fdf6a0fc700 1 --2- 172.21.15.50:0/3517588422 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdf48064ee0 0x7fdf48067390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdf540044b0 tx=0x7fdf54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.452+0000 7fdf5affd700 1 -- 172.21.15.50:0/3517588422 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdf6004fb60 con 0x7fdf640b32e0 2023-11-28T11:54:14.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.644+0000 7fdf6b0fe700 1 -- 172.21.15.50:0/3517588422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdf64072500 con 0x7fdf640b32e0 2023-11-28T11:54:14.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.644+0000 7fdf5affd700 1 -- 172.21.15.50:0/3517588422 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fdf60053180 con 0x7fdf640b32e0 2023-11-28T11:54:14.650 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-28T11:54:14.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.648+0000 7fdf6b0fe700 1 -- 172.21.15.50:0/3517588422 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdf48064ee0 msgr2=0x7fdf48067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.648+0000 7fdf6b0fe700 1 --2- 172.21.15.50:0/3517588422 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdf48064ee0 0x7fdf48067390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdf540044b0 tx=0x7fdf54008040 comp rx=0 tx=0).stop 2023-11-28T11:54:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.648+0000 7fdf6b0fe700 1 -- 172.21.15.50:0/3517588422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf640b32e0 msgr2=0x7fdf641552c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.648+0000 7fdf6b0fe700 1 --2- 172.21.15.50:0/3517588422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf640b32e0 0x7fdf641552c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000c580 tx=0x7fdf6000c890 comp rx=0 tx=0).stop 2023-11-28T11:54:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.648+0000 7fdf6b0fe700 1 -- 172.21.15.50:0/3517588422 shutdown_connections 2023-11-28T11:54:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.648+0000 7fdf6b0fe700 1 --2- 172.21.15.50:0/3517588422 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdf48064ee0 0x7fdf48067390 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.648+0000 7fdf6b0fe700 1 --2- 172.21.15.50:0/3517588422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf641584c0 0x7fdf64155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.648+0000 7fdf6b0fe700 1 --2- 172.21.15.50:0/3517588422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf640b32e0 0x7fdf641552c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.648+0000 7fdf6b0fe700 1 --2- 172.21.15.50:0/3517588422 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf6406ace0 0x7fdf641543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.648+0000 7fdf6b0fe700 1 -- 172.21.15.50:0/3517588422 >> 172.21.15.50:0/3517588422 conn(0x7fdf640ce3e0 msgr2=0x7fdf640ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.648+0000 7fdf6b0fe700 1 -- 172.21.15.50:0/3517588422 shutdown_connections 2023-11-28T11:54:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:14.648+0000 7fdf6b0fe700 1 -- 172.21.15.50:0/3517588422 wait complete. 2023-11-28T11:54:14.665 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:54:14.665 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:54:14.665 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-11-28T11:54:14.665 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-28T11:54:14.665 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T11:54:14.665 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:54:14.665 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T11:54:14.666 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:54:14.666 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-28T11:54:14.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:14.666 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-11-28T11:54:14.674 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:54:14.674 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:54:14.674 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:54:14.674 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:14.674 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-11-28T11:54:14.674 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:14.674 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:54:14.674 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:14.675 INFO:teuthology.orchestra.run.smithi050.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:54:14.675 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:14.675 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T11:54:14.675 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42538sec preferred_lft 42538sec 2023-11-28T11:54:14.675 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-11-28T11:54:14.675 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:14.675 INFO:teuthology.orchestra.run.smithi050.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:54:14.675 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:14.675 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:54:14.675 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:14.675 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T11:54:14.676 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:5d:90:5e:15 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:14.676 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T11:54:14.676 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:14.676 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:54:14.676 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether da:3b:9e:d1:db:b2 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:14.676 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T11:54:14.676 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:14.676 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::8086:d1ff:fed7:f4c8/64 scope link 2023-11-28T11:54:14.676 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:14.676 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:54:14.676 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether da:3b:9e:d1:db:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T11:54:14.676 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d83b:9eff:fed1:dbb2/64 scope link 2023-11-28T11:54:14.677 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:14.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:14.677 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:54:14.694 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-11-28T11:54:14.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:14.695 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-11-28T11:54:14.744 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-11-28T11:54:14.744 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:54:14.744 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T11:54:14.744 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T11:54:14.745 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T11:54:14.745 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:54:14.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:14.745 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-11-28T11:54:14.745 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-11-28T11:54:14.745 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T11:54:14.745 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T11:54:14.745 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T11:54:14.745 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-11-28T11:54:14.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:14.784 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-11-28T11:54:14.791 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T11:54:14.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:14.792 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-11-28T11:54:14.797 INFO:teuthology.orchestra.run.smithi050.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-28T11:54:14.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:14.798 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-11-28T11:54:14.798 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-11-28T11:54:14.798 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T11:54:14.798 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-28T11:54:14.798 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-11-28T11:54:14.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:14.828 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T11:54:14.886 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:54:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:54:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:54:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-11-28T11:54:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:14.887 INFO:teuthology.orchestra.run.smithi050.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:54:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 6e:96:1b:06:a4:73 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T11:54:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T11:54:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::6c96:1bff:fe06:a473/64 scope link 2023-11-28T11:54:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:14.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:14.889 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T11:54:14.903 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:54:14.903 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:54:14.903 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:54:14.903 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:14.903 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-11-28T11:54:14.903 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:14.903 INFO:teuthology.orchestra.run.smithi050.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:54:14.904 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 6e:96:1b:06:a4:73 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T11:54:14.904 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T11:54:14.904 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:14.904 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::6c96:1bff:fe06:a473/64 scope link 2023-11-28T11:54:14.904 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:14.905 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-28T11:54:14.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:14.905 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-11-28T11:54:14.905 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-11-28T11:54:14.905 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-28T11:54:14.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T11:54:14.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-28T11:54:14.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-28T11:54:14.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-28T11:54:14.906 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-11-28T11:54:14.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:14.969 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-11-28T11:54:14.969 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-11-28T11:54:14.969 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.1 up 2023-11-28T11:54:14.969 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T11:54:14.969 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-11-28T11:54:14.997 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-28T11:54:14.997 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:54:14.997 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-28T11:54:15.005 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-28T11:54:15.005 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:54:15.005 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-28T11:54:15.010 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:54:15.024 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:54:15.024 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:54:15.036 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:54:15.037 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:54:15.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:15.037 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:54:15.042 INFO:teuthology.orchestra.run.smithi050.stdout:52 2023-11-28T11:54:15.042 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2023-11-28T11:54:15.042 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2 --client_mountpoint=/) 2023-11-28T11:54:15.044 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:54:15.059 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:54:15.060 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:54:15.118 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:54:15.119 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:54:15.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:15.119 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:54:15.124 INFO:teuthology.orchestra.run.smithi050.stdout:52 2023-11-28T11:54:15.137 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi050.stderr:2023-11-28T11:54:15.132+0000 7fe8b4346640 -1 init, newargv = 0x560853a84a60 newargc=15 2023-11-28T11:54:15.137 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi050.stderr:ceph-fuse[44076]: starting ceph client 2023-11-28T11:54:15.146 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi050.stderr:ceph-fuse[44076]: starting fuse 2023-11-28T11:54:16.225 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:54:16.245 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:54:16.245 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:54:16.305 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:54:16.306 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:54:16.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:16.307 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:54:16.312 INFO:teuthology.orchestra.run.smithi050.stdout:52 2023-11-28T11:54:16.312 INFO:teuthology.orchestra.run.smithi050.stdout:53 2023-11-28T11:54:16.312 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2023-11-28T11:54:16.313 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:54:16.313 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-11-28T11:54:16.313 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-11-28T11:54:16.313 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-11-28T11:54:16.313 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-11-28T11:54:16.313 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:54:16.313 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-11-28T11:54:16.313 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-28T11:54:16.313 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-11-28T11:54:16.313 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-28T11:54:16.313 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:54:16.313 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-11-28T11:54:16.313 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-11-28T11:54:16.314 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-11-28T11:54:16.314 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-11-28T11:54:16.314 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:54:16.314 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-11-28T11:54:16.314 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T11:54:16.314 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T11:54:16.314 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T11:54:16.314 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-11-28T11:54:16.314 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-11-28T11:54:16.314 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-11-28T11:54:16.314 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T11:54:16.314 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:54:16.314 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.2")) 2023-11-28T11:54:16.315 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-11-28T11:54:16.400 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.2.44076.asok 2023-11-28T11:54:16.583 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.44076.asok 2023-11-28T11:54:16.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:16.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.44076.asok status 2023-11-28T11:54:16.730 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:54:16.730 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-11-28T11:54:16.731 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T11:54:16.731 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T11:54:16.731 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "2", 2023-11-28T11:54:16.731 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-11-28T11:54:16.731 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-28T11:54:16.731 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "44076", 2023-11-28T11:54:16.731 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-11-28T11:54:16.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:16.731 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-11-28T11:54:16.732 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-11-28T11:54:16.732 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4845, 2023-11-28T11:54:16.732 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-11-28T11:54:16.732 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-11-28T11:54:16.732 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-11-28T11:54:16.732 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 4845 2023-11-28T11:54:16.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:16.732 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-11-28T11:54:16.732 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-11-28T11:54:16.732 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.2:0", 2023-11-28T11:54:16.732 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1006078431 2023-11-28T11:54:16.732 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:16.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:16.733 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-11-28T11:54:16.733 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-11-28T11:54:16.733 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.2:0", 2023-11-28T11:54:16.733 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1006078431 2023-11-28T11:54:16.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:16.733 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.4845 192.168.0.2:0/1006078431", 2023-11-28T11:54:16.733 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.2:0/1006078431", 2023-11-28T11:54:16.733 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-11-28T11:54:16.733 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 9, 2023-11-28T11:54:16.733 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 25, 2023-11-28T11:54:16.733 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-11-28T11:54:16.733 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-11-28T11:54:16.734 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-11-28T11:54:16.734 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:54:16.741 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:54:16.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8032a82700 1 Processor -- start 2023-11-28T11:54:16.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8032a82700 1 -- start start 2023-11-28T11:54:16.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8032a82700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f802c159e70 0x7f802c06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:16.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8032a82700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802c06ace0 con 0x7f802c0cb470 2023-11-28T11:54:16.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8032a82700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802c06a0d0 con 0x7f802c069c40 2023-11-28T11:54:16.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8032a82700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802c06a3b0 con 0x7f802c159e70 2023-11-28T11:54:16.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8032281700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f802c0cb470 0x7f802c0c91d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36368/0 (socket says 172.21.15.50:36368) 2023-11-28T11:54:16.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8032281700 1 -- 172.21.15.50:0/4109594749 learned_addr learned my addr 172.21.15.50:0/4109594749 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:16.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8031a80700 1 --2- 172.21.15.50:0/4109594749 >> v2:172.21.15.192:3300/0 conn(0x7f802c159e70 0x7f802c06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:16.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8030a7e700 1 -- 172.21.15.50:0/4109594749 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794512012 0 0) 0x7f802c06ace0 con 0x7f802c0cb470 2023-11-28T11:54:16.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8030a7e700 1 -- 172.21.15.50:0/4109594749 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80180035d0 con 0x7f802c0cb470 2023-11-28T11:54:16.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8030a7e700 1 -- 172.21.15.50:0/4109594749 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112322085 0 0) 0x7f802c06a0d0 con 0x7f802c069c40 2023-11-28T11:54:16.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8030a7e700 1 -- 172.21.15.50:0/4109594749 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f802c06ace0 con 0x7f802c069c40 2023-11-28T11:54:16.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8031a80700 1 -- 172.21.15.50:0/4109594749 >> v1:172.21.15.192:6789/0 conn(0x7f802c069c40 legacy=0x7f802c0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:16.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8031a80700 1 -- 172.21.15.50:0/4109594749 >> v1:172.21.15.50:6789/0 conn(0x7f802c0cb470 legacy=0x7f802c0c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:16.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8030a7e700 1 -- 172.21.15.50:0/4109594749 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1706149843 0 0) 0x7f80180035d0 con 0x7f802c0cb470 2023-11-28T11:54:16.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8031a80700 1 -- 172.21.15.50:0/4109594749 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c06a690 con 0x7f802c159e70 2023-11-28T11:54:16.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8031a80700 1 --2- 172.21.15.50:0/4109594749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f802c159e70 0x7f802c06c9a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f801c009850 tx=0x7f801c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cc3a59bce4e086f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:16.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.848+0000 7f8030a7e700 1 -- 172.21.15.50:0/4109594749 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80240019f0 con 0x7f802c159e70 2023-11-28T11:54:16.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8030a7e700 1 -- 172.21.15.50:0/4109594749 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c004030 con 0x7f802c159e70 2023-11-28T11:54:16.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8030a7e700 1 -- 172.21.15.50:0/4109594749 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c0043c0 con 0x7f802c159e70 2023-11-28T11:54:16.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8032a82700 1 -- 172.21.15.50:0/4109594749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f802c159e70 msgr2=0x7f802c06c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:16.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8032a82700 1 --2- 172.21.15.50:0/4109594749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f802c159e70 0x7f802c06c9a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f801c009850 tx=0x7f801c009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:16.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8032a82700 1 -- 172.21.15.50:0/4109594749 shutdown_connections 2023-11-28T11:54:16.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8032a82700 1 --2- 172.21.15.50:0/4109594749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f802c159e70 0x7f802c06c9a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:16.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8032a82700 1 -- 172.21.15.50:0/4109594749 >> 172.21.15.50:0/4109594749 conn(0x7f802c0ce3e0 msgr2=0x7f802c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:16.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8032a82700 1 -- 172.21.15.50:0/4109594749 shutdown_connections 2023-11-28T11:54:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8032a82700 1 -- 172.21.15.50:0/4109594749 wait complete. 2023-11-28T11:54:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8032a82700 1 Processor -- start 2023-11-28T11:54:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8032a82700 1 -- start start 2023-11-28T11:54:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8032a82700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f802c069c40 0x7f802c0c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8032a82700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f802c0cb470 0x7f802c1eeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:16.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8032a82700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f802c159e70 0x7f802c157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:16.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8032a82700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0acca0 con 0x7f802c069c40 2023-11-28T11:54:16.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8032a82700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0c4da0 con 0x7f802c159e70 2023-11-28T11:54:16.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8032a82700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0c21c0 con 0x7f802c0cb470 2023-11-28T11:54:16.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8031a80700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f802c069c40 0x7f802c0c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:16.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8031a80700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f802c069c40 0x7f802c0c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38548/0 (socket says 172.21.15.50:38548) 2023-11-28T11:54:16.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.852+0000 7f8031a80700 1 -- 172.21.15.50:0/2833554327 learned_addr learned my addr 172.21.15.50:0/2833554327 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:16.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.856+0000 7f803127f700 1 --2- 172.21.15.50:0/2833554327 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f802c0cb470 0x7f802c1eeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:16.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.856+0000 7f8032281700 1 --2- 172.21.15.50:0/2833554327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f802c159e70 0x7f802c157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:16.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.856+0000 7f8031a80700 1 -- 172.21.15.50:0/2833554327 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f802c0cb470 msgr2=0x7f802c1eeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:16.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.856+0000 7f8031a80700 1 --2- 172.21.15.50:0/2833554327 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f802c0cb470 0x7f802c1eeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.856+0000 7f8031a80700 1 -- 172.21.15.50:0/2833554327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f802c159e70 msgr2=0x7f802c157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.856+0000 7f8031a80700 1 --2- 172.21.15.50:0/2833554327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f802c159e70 0x7f802c157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.856+0000 7f8031a80700 1 -- 172.21.15.50:0/2833554327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c0094b0 con 0x7f802c069c40 2023-11-28T11:54:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.856+0000 7f8031a80700 1 --2- 172.21.15.50:0/2833554327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f802c069c40 0x7f802c0c8090 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f802c06f4b0 tx=0x7f801c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.856+0000 7f80227fc700 1 -- 172.21.15.50:0/2833554327 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c003d60 con 0x7f802c069c40 2023-11-28T11:54:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.856+0000 7f80227fc700 1 -- 172.21.15.50:0/2833554327 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c01f070 con 0x7f802c069c40 2023-11-28T11:54:16.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.856+0000 7f8032a82700 1 -- 172.21.15.50:0/2833554327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802c15a240 con 0x7f802c069c40 2023-11-28T11:54:16.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.856+0000 7f80227fc700 1 -- 172.21.15.50:0/2833554327 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c011870 con 0x7f802c069c40 2023-11-28T11:54:16.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.856+0000 7f8032a82700 1 -- 172.21.15.50:0/2833554327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802c06a970 con 0x7f802c069c40 2023-11-28T11:54:16.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.856+0000 7f8032a82700 1 -- 172.21.15.50:0/2833554327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802c06cee0 con 0x7f802c069c40 2023-11-28T11:54:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.856+0000 7f80227fc700 1 -- 172.21.15.50:0/2833554327 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f801c02a020 con 0x7f802c069c40 2023-11-28T11:54:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.856+0000 7f80227fc700 1 --2- 172.21.15.50:0/2833554327 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8010064ee0 0x7f8010067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.860+0000 7f80227fc700 1 -- 172.21.15.50:0/2833554327 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f801c0835d0 con 0x7f802c069c40 2023-11-28T11:54:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.860+0000 7f803127f700 1 --2- 172.21.15.50:0/2833554327 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8010064ee0 0x7f8010067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.860+0000 7f803127f700 1 --2- 172.21.15.50:0/2833554327 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8010064ee0 0x7f8010067390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f802c06c1b0 tx=0x7f8028009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:16.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:16.864+0000 7f80227fc700 1 -- 172.21.15.50:0/2833554327 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f801c051400 con 0x7f802c069c40 2023-11-28T11:54:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:17.068+0000 7f8032a82700 1 -- 172.21.15.50:0/2833554327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f802c072500 con 0x7f802c069c40 2023-11-28T11:54:17.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:17.072+0000 7f80227fc700 1 -- 172.21.15.50:0/2833554327 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f801c054a20 con 0x7f802c069c40 2023-11-28T11:54:17.076 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-28T11:54:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:17.072+0000 7f8032a82700 1 -- 172.21.15.50:0/2833554327 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8010064ee0 msgr2=0x7f8010067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:17.072+0000 7f8032a82700 1 --2- 172.21.15.50:0/2833554327 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8010064ee0 0x7f8010067390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f802c06c1b0 tx=0x7f8028009040 comp rx=0 tx=0).stop 2023-11-28T11:54:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:17.072+0000 7f8032a82700 1 -- 172.21.15.50:0/2833554327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f802c069c40 msgr2=0x7f802c0c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:17.072+0000 7f8032a82700 1 --2- 172.21.15.50:0/2833554327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f802c069c40 0x7f802c0c8090 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f802c06f4b0 tx=0x7f801c004770 comp rx=0 tx=0).stop 2023-11-28T11:54:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:17.072+0000 7f8032a82700 1 -- 172.21.15.50:0/2833554327 shutdown_connections 2023-11-28T11:54:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:17.072+0000 7f8032a82700 1 --2- 172.21.15.50:0/2833554327 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8010064ee0 0x7f8010067390 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:17.072+0000 7f8032a82700 1 --2- 172.21.15.50:0/2833554327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f802c159e70 0x7f802c157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:17.072+0000 7f8032a82700 1 --2- 172.21.15.50:0/2833554327 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f802c0cb470 0x7f802c1eeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:17.072+0000 7f8032a82700 1 --2- 172.21.15.50:0/2833554327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f802c069c40 0x7f802c0c8090 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:17.072+0000 7f8032a82700 1 -- 172.21.15.50:0/2833554327 >> 172.21.15.50:0/2833554327 conn(0x7f802c0ce3e0 msgr2=0x7f802c071840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:17.072+0000 7f8032a82700 1 -- 172.21.15.50:0/2833554327 shutdown_connections 2023-11-28T11:54:17.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:17.072+0000 7f8032a82700 1 -- 172.21.15.50:0/2833554327 wait complete. 2023-11-28T11:54:17.091 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:54:17.091 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:54:17.091 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-11-28T11:54:17.091 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T11:54:17.091 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T11:54:17.091 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:54:17.091 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T11:54:17.091 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:54:17.091 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T11:54:17.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:17.092 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-11-28T11:54:17.100 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:54:17.100 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:54:17.100 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:54:17.100 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:17.100 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-11-28T11:54:17.100 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:17.100 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:54:17.100 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:17.100 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:54:17.100 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:17.100 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:54:17.101 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:17.101 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:54:17.101 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:17.101 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T11:54:17.101 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42525sec preferred_lft 42525sec 2023-11-28T11:54:17.101 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-11-28T11:54:17.101 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:17.101 INFO:teuthology.orchestra.run.smithi192.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T11:54:17.101 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 02:42:8e:c8:13:a8 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:17.101 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T11:54:17.101 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:17.101 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T11:54:17.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:17.102 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-28T11:54:17.102 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-28T11:54:17.102 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add name ceph-brx type bridge 2023-11-28T11:54:17.102 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr flush dev ceph-brx 2023-11-28T11:54:17.102 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set ceph-brx up 2023-11-28T11:54:17.102 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T11:54:17.102 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-28T11:54:17.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:17.149 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:54:17.160 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-11-28T11:54:17.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:17.162 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-11-28T11:54:17.234 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-11-28T11:54:17.235 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:54:17.235 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T11:54:17.235 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T11:54:17.235 INFO:teuthology.orchestra.run.smithi192.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T11:54:17.235 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-28T11:54:17.236 INFO:teuthology.orchestra.run.smithi192.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T11:54:17.236 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:54:17.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:17.236 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-28T11:54:17.237 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-28T11:54:17.237 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T11:54:17.237 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T11:54:17.237 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T11:54:17.237 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-28T11:54:17.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:17.280 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-11-28T11:54:17.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:17.286 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list-id 2023-11-28T11:54:17.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:17.293 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-28T11:54:17.294 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-28T11:54:17.294 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T11:54:17.294 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-28T11:54:17.294 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-28T11:54:17.323 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-28T11:54:17.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:17.324 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-28T11:54:17.324 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-28T11:54:17.324 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-28T11:54:17.324 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T11:54:17.324 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-28T11:54:17.324 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-28T11:54:17.324 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-28T11:54:17.324 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-28T11:54:17.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:17.444 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-28T11:54:17.445 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-28T11:54:17.445 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-11-28T11:54:17.445 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T11:54:17.445 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-28T11:54:17.472 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-28T11:54:17.472 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:54:17.472 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T11:54:17.505 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T11:54:17.505 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:54:17.505 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T11:54:17.512 DEBUG:teuthology.orchestra.run.smithi192:> sudo modprobe fuse 2023-11-28T11:54:17.571 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:54:17.571 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:54:17.587 INFO:teuthology.orchestra.run.smithi192.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:54:17.588 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:54:17.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:17.588 DEBUG:teuthology.orchestra.run.smithi192:> ls /sys/fs/fuse/connections 2023-11-28T11:54:17.593 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T11:54:17.593 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_mountpoint=/) 2023-11-28T11:54:17.597 DEBUG:teuthology.orchestra.run.smithi192:> sudo modprobe fuse 2023-11-28T11:54:17.615 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:54:17.615 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:54:17.673 INFO:teuthology.orchestra.run.smithi192.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:54:17.674 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:54:17.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:17.675 DEBUG:teuthology.orchestra.run.smithi192:> ls /sys/fs/fuse/connections 2023-11-28T11:54:17.682 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi192.stderr:2023-11-28T11:54:17.679+0000 7f0449c32640 -1 init, newargv = 0x55d8d4900e90 newargc=15 2023-11-28T11:54:17.682 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi192.stderr:ceph-fuse[42463]: starting ceph client 2023-11-28T11:54:17.692 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi192.stderr:ceph-fuse[42463]: starting fuse 2023-11-28T11:54:18.780 DEBUG:teuthology.orchestra.run.smithi192:> sudo modprobe fuse 2023-11-28T11:54:18.799 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:54:18.799 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:54:18.855 INFO:teuthology.orchestra.run.smithi192.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:54:18.856 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:54:18.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:18.858 DEBUG:teuthology.orchestra.run.smithi192:> ls /sys/fs/fuse/connections 2023-11-28T11:54:18.863 INFO:teuthology.orchestra.run.smithi192.stdout:52 2023-11-28T11:54:18.863 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-28T11:54:18.864 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:54:18.864 DEBUG:teuthology.orchestra.run.smithi192:> import glob 2023-11-28T11:54:18.864 DEBUG:teuthology.orchestra.run.smithi192:> import re 2023-11-28T11:54:18.864 DEBUG:teuthology.orchestra.run.smithi192:> import os 2023-11-28T11:54:18.864 DEBUG:teuthology.orchestra.run.smithi192:> import subprocess 2023-11-28T11:54:18.864 DEBUG:teuthology.orchestra.run.smithi192:> 2023-11-28T11:54:18.864 DEBUG:teuthology.orchestra.run.smithi192:> def _find_admin_socket(client_name): 2023-11-28T11:54:18.864 DEBUG:teuthology.orchestra.run.smithi192:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-28T11:54:18.864 DEBUG:teuthology.orchestra.run.smithi192:> files = glob.glob(asok_path) 2023-11-28T11:54:18.864 DEBUG:teuthology.orchestra.run.smithi192:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-28T11:54:18.864 DEBUG:teuthology.orchestra.run.smithi192:> 2023-11-28T11:54:18.864 DEBUG:teuthology.orchestra.run.smithi192:> # Given a non-glob path, it better be there 2023-11-28T11:54:18.865 DEBUG:teuthology.orchestra.run.smithi192:> if "*" not in asok_path: 2023-11-28T11:54:18.865 DEBUG:teuthology.orchestra.run.smithi192:> assert(len(files) == 1) 2023-11-28T11:54:18.865 DEBUG:teuthology.orchestra.run.smithi192:> return files[0] 2023-11-28T11:54:18.865 DEBUG:teuthology.orchestra.run.smithi192:> 2023-11-28T11:54:18.865 DEBUG:teuthology.orchestra.run.smithi192:> for f in files: 2023-11-28T11:54:18.865 DEBUG:teuthology.orchestra.run.smithi192:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T11:54:18.865 DEBUG:teuthology.orchestra.run.smithi192:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T11:54:18.865 DEBUG:teuthology.orchestra.run.smithi192:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T11:54:18.865 DEBUG:teuthology.orchestra.run.smithi192:> contents = proc_f.read() 2023-11-28T11:54:18.865 DEBUG:teuthology.orchestra.run.smithi192:> if mountpoint in contents: 2023-11-28T11:54:18.865 DEBUG:teuthology.orchestra.run.smithi192:> return f 2023-11-28T11:54:18.865 DEBUG:teuthology.orchestra.run.smithi192:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T11:54:18.865 DEBUG:teuthology.orchestra.run.smithi192:> 2023-11-28T11:54:18.865 DEBUG:teuthology.orchestra.run.smithi192:> print(_find_admin_socket("client.1")) 2023-11-28T11:54:18.866 DEBUG:teuthology.orchestra.run.smithi192:> ' 2023-11-28T11:54:18.945 INFO:teuthology.orchestra.run.smithi192.stdout:/var/run/ceph/ceph-client.1.42463.asok 2023-11-28T11:54:19.131 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.42463.asok 2023-11-28T11:54:19.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:19.131 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.42463.asok status 2023-11-28T11:54:19.278 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2023-11-28T11:54:19.278 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": { 2023-11-28T11:54:19.278 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T11:54:19.279 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T11:54:19.279 INFO:teuthology.orchestra.run.smithi192.stdout: "entity_id": "1", 2023-11-28T11:54:19.279 INFO:teuthology.orchestra.run.smithi192.stdout: "hostname": "smithi192", 2023-11-28T11:54:19.279 INFO:teuthology.orchestra.run.smithi192.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-28T11:54:19.279 INFO:teuthology.orchestra.run.smithi192.stdout: "pid": "42463", 2023-11-28T11:54:19.279 INFO:teuthology.orchestra.run.smithi192.stdout: "root": "/" 2023-11-28T11:54:19.279 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2023-11-28T11:54:19.279 INFO:teuthology.orchestra.run.smithi192.stdout: "dentry_count": 0, 2023-11-28T11:54:19.279 INFO:teuthology.orchestra.run.smithi192.stdout: "dentry_pinned_count": 0, 2023-11-28T11:54:19.279 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 4667, 2023-11-28T11:54:19.279 INFO:teuthology.orchestra.run.smithi192.stdout: "inst": { 2023-11-28T11:54:19.279 INFO:teuthology.orchestra.run.smithi192.stdout: "name": { 2023-11-28T11:54:19.280 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "client", 2023-11-28T11:54:19.280 INFO:teuthology.orchestra.run.smithi192.stdout: "num": 4667 2023-11-28T11:54:19.280 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2023-11-28T11:54:19.280 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": { 2023-11-28T11:54:19.280 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2023-11-28T11:54:19.280 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:54:19.280 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1785796797 2023-11-28T11:54:19.280 INFO:teuthology.orchestra.run.smithi192.stdout: } 2023-11-28T11:54:19.280 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2023-11-28T11:54:19.280 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": { 2023-11-28T11:54:19.280 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2023-11-28T11:54:19.280 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:54:19.281 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1785796797 2023-11-28T11:54:19.281 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2023-11-28T11:54:19.281 INFO:teuthology.orchestra.run.smithi192.stdout: "inst_str": "client.4667 192.168.0.1:0/1785796797", 2023-11-28T11:54:19.281 INFO:teuthology.orchestra.run.smithi192.stdout: "addr_str": "192.168.0.1:0/1785796797", 2023-11-28T11:54:19.281 INFO:teuthology.orchestra.run.smithi192.stdout: "inode_count": 1, 2023-11-28T11:54:19.281 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_epoch": 9, 2023-11-28T11:54:19.281 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_epoch": 25, 2023-11-28T11:54:19.281 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_epoch_barrier": 0, 2023-11-28T11:54:19.281 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklisted": false, 2023-11-28T11:54:19.281 INFO:teuthology.orchestra.run.smithi192.stdout: "fs_name": "cephfs" 2023-11-28T11:54:19.281 INFO:teuthology.orchestra.run.smithi192.stdout:} 2023-11-28T11:54:19.289 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:54:19.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.404+0000 7f6783fff700 1 Processor -- start 2023-11-28T11:54:19.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.404+0000 7f6783fff700 1 -- start start 2023-11-28T11:54:19.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.404+0000 7f6783fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f678406cd80 0x7f678415b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:19.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.404+0000 7f6783fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67840cdeb0 con 0x7f678406c0a0 2023-11-28T11:54:19.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.404+0000 7f6783fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67840cca10 con 0x7f67840ca310 2023-11-28T11:54:19.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.404+0000 7f6783fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678406c4f0 con 0x7f678406cd80 2023-11-28T11:54:19.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.404+0000 7f67827fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f678406c0a0 0x7f678406c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36384/0 (socket says 172.21.15.50:36384) 2023-11-28T11:54:19.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.404+0000 7f67827fc700 1 -- 172.21.15.50:0/2133563741 learned_addr learned my addr 172.21.15.50:0/2133563741 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:19.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.408+0000 7f67837fe700 1 --2- 172.21.15.50:0/2133563741 >> v2:172.21.15.192:3300/0 conn(0x7f678406cd80 0x7f678415b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:19.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.408+0000 7f6781ffb700 1 -- 172.21.15.50:0/2133563741 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27927032 0 0) 0x7f6774001110 con 0x7f678406c0a0 2023-11-28T11:54:19.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.408+0000 7f6781ffb700 1 -- 172.21.15.50:0/2133563741 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67640035d0 con 0x7f678406c0a0 2023-11-28T11:54:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.408+0000 7f67837fe700 1 -- 172.21.15.50:0/2133563741 >> v1:172.21.15.192:6789/0 conn(0x7f67840ca310 legacy=0x7f6784069eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.408+0000 7f67837fe700 1 -- 172.21.15.50:0/2133563741 >> v1:172.21.15.50:6789/0 conn(0x7f678406c0a0 legacy=0x7f678406c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.408+0000 7f67837fe700 1 -- 172.21.15.50:0/2133563741 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678406a670 con 0x7f678406cd80 2023-11-28T11:54:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.408+0000 7f67837fe700 1 --2- 172.21.15.50:0/2133563741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f678406cd80 0x7f678415b9f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f677c009d90 tx=0x7f677c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=220f52ba2fc3be00 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.408+0000 7f6781ffb700 1 -- 172.21.15.50:0/2133563741 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c00e070 con 0x7f678406cd80 2023-11-28T11:54:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.408+0000 7f6781ffb700 1 -- 172.21.15.50:0/2133563741 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c00bb20 con 0x7f678406cd80 2023-11-28T11:54:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.408+0000 7f6781ffb700 1 -- 172.21.15.50:0/2133563741 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c00be90 con 0x7f678406cd80 2023-11-28T11:54:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.408+0000 7f6783fff700 1 -- 172.21.15.50:0/2133563741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f678406cd80 msgr2=0x7f678415b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.408+0000 7f6783fff700 1 --2- 172.21.15.50:0/2133563741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f678406cd80 0x7f678415b9f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f677c009d90 tx=0x7f677c00b330 comp rx=0 tx=0).stop 2023-11-28T11:54:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.408+0000 7f6783fff700 1 -- 172.21.15.50:0/2133563741 shutdown_connections 2023-11-28T11:54:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.408+0000 7f6783fff700 1 --2- 172.21.15.50:0/2133563741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f678406cd80 0x7f678415b9f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.408+0000 7f6783fff700 1 -- 172.21.15.50:0/2133563741 >> 172.21.15.50:0/2133563741 conn(0x7f67840ce3e0 msgr2=0x7f67840ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:19.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.408+0000 7f6783fff700 1 -- 172.21.15.50:0/2133563741 shutdown_connections 2023-11-28T11:54:19.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.408+0000 7f6783fff700 1 -- 172.21.15.50:0/2133563741 wait complete. 2023-11-28T11:54:19.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.412+0000 7f6783fff700 1 Processor -- start 2023-11-28T11:54:19.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.412+0000 7f6783fff700 1 -- start start 2023-11-28T11:54:19.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.412+0000 7f6783fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f678406c0a0 0x7f6784154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:19.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f6783fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f678406cd80 0x7f67840b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:19.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f6783fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67840ca310 0x7f67840c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:19.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f6783fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67841553f0 con 0x7f67840ca310 2023-11-28T11:54:19.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f6783fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67841f4f40 con 0x7f678406cd80 2023-11-28T11:54:19.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f6783fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67841f5220 con 0x7f678406c0a0 2023-11-28T11:54:19.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f67837fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67840ca310 0x7f67840c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:19.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f67827fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f678406cd80 0x7f67840b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:19.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f67837fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67840ca310 0x7f67840c1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38560/0 (socket says 172.21.15.50:38560) 2023-11-28T11:54:19.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f67837fe700 1 -- 172.21.15.50:0/2737834024 learned_addr learned my addr 172.21.15.50:0/2737834024 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:19.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f6782ffd700 1 --2- 172.21.15.50:0/2737834024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f678406c0a0 0x7f6784154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:19.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f67837fe700 1 -- 172.21.15.50:0/2737834024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f678406c0a0 msgr2=0x7f6784154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:19.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f67837fe700 1 --2- 172.21.15.50:0/2737834024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f678406c0a0 0x7f6784154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:19.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f67837fe700 1 -- 172.21.15.50:0/2737834024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f678406cd80 msgr2=0x7f67840b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:19.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f67837fe700 1 --2- 172.21.15.50:0/2737834024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f678406cd80 0x7f67840b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:19.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f67837fe700 1 -- 172.21.15.50:0/2737834024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c009a70 con 0x7f67840ca310 2023-11-28T11:54:19.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f6782ffd700 1 --2- 172.21.15.50:0/2737834024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f678406c0a0 0x7f6784154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:19.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f67837fe700 1 --2- 172.21.15.50:0/2737834024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67840ca310 0x7f67840c1f10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f677c00b370 tx=0x7f677c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:19.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f677b7fe700 1 -- 172.21.15.50:0/2737834024 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c007000 con 0x7f67840ca310 2023-11-28T11:54:19.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f677b7fe700 1 -- 172.21.15.50:0/2737834024 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c012650 con 0x7f67840ca310 2023-11-28T11:54:19.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f6783fff700 1 -- 172.21.15.50:0/2737834024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678406ac30 con 0x7f67840ca310 2023-11-28T11:54:19.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f677b7fe700 1 -- 172.21.15.50:0/2737834024 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c012a00 con 0x7f67840ca310 2023-11-28T11:54:19.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f6783fff700 1 -- 172.21.15.50:0/2737834024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678406a950 con 0x7f67840ca310 2023-11-28T11:54:19.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f6783fff700 1 -- 172.21.15.50:0/2737834024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67840c8a30 con 0x7f67840ca310 2023-11-28T11:54:19.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f677b7fe700 1 -- 172.21.15.50:0/2737834024 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f677c012b60 con 0x7f67840ca310 2023-11-28T11:54:19.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.416+0000 7f677b7fe700 1 --2- 172.21.15.50:0/2737834024 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6768064ee0 0x7f6768067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:19.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.420+0000 7f677b7fe700 1 -- 172.21.15.50:0/2737834024 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f677c0844c0 con 0x7f67840ca310 2023-11-28T11:54:19.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.420+0000 7f6782ffd700 1 --2- 172.21.15.50:0/2737834024 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6768064ee0 0x7f6768067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:19.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.420+0000 7f6782ffd700 1 --2- 172.21.15.50:0/2737834024 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6768064ee0 0x7f6768067390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f676c001700 tx=0x7f676c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:19.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.424+0000 7f677b7fe700 1 -- 172.21.15.50:0/2737834024 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f677c052310 con 0x7f67840ca310 2023-11-28T11:54:19.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.624+0000 7f6783fff700 1 -- 172.21.15.50:0/2737834024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6784072500 con 0x7f67840ca310 2023-11-28T11:54:19.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.624+0000 7f677b7fe700 1 -- 172.21.15.50:0/2737834024 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f677c055930 con 0x7f67840ca310 2023-11-28T11:54:19.630 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-28T11:54:19.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.628+0000 7f6783fff700 1 -- 172.21.15.50:0/2737834024 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6768064ee0 msgr2=0x7f6768067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:19.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.628+0000 7f6783fff700 1 --2- 172.21.15.50:0/2737834024 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6768064ee0 0x7f6768067390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f676c001700 tx=0x7f676c009040 comp rx=0 tx=0).stop 2023-11-28T11:54:19.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.628+0000 7f6783fff700 1 -- 172.21.15.50:0/2737834024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67840ca310 msgr2=0x7f67840c1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:19.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.628+0000 7f6783fff700 1 --2- 172.21.15.50:0/2737834024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67840ca310 0x7f67840c1f10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f677c00b370 tx=0x7f677c004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:19.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.628+0000 7f6783fff700 1 -- 172.21.15.50:0/2737834024 shutdown_connections 2023-11-28T11:54:19.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.628+0000 7f6783fff700 1 --2- 172.21.15.50:0/2737834024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67840ca310 0x7f67840c1f10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:19.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.628+0000 7f6783fff700 1 --2- 172.21.15.50:0/2737834024 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6768064ee0 0x7f6768067390 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:19.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.628+0000 7f6783fff700 1 --2- 172.21.15.50:0/2737834024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f678406cd80 0x7f67840b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:19.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.628+0000 7f6783fff700 1 --2- 172.21.15.50:0/2737834024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f678406c0a0 0x7f6784154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:19.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.628+0000 7f6783fff700 1 -- 172.21.15.50:0/2737834024 >> 172.21.15.50:0/2737834024 conn(0x7f67840ce3e0 msgr2=0x7f678415efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:19.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.628+0000 7f6783fff700 1 -- 172.21.15.50:0/2737834024 shutdown_connections 2023-11-28T11:54:19.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:19.628+0000 7f6783fff700 1 -- 172.21.15.50:0/2737834024 wait complete. 2023-11-28T11:54:19.652 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:54:19.652 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:54:19.652 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-11-28T11:54:19.652 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-28T11:54:19.652 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T11:54:19.652 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:54:19.652 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T11:54:19.652 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:54:19.652 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-28T11:54:19.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:19.653 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-11-28T11:54:19.661 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:54:19.661 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:54:19.661 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:54:19.661 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:19.661 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-11-28T11:54:19.661 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:19.661 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:54:19.661 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:19.661 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:54:19.661 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:19.662 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:54:19.662 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:19.662 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:54:19.662 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:19.662 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T11:54:19.662 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42522sec preferred_lft 42522sec 2023-11-28T11:54:19.662 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-11-28T11:54:19.662 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:19.662 INFO:teuthology.orchestra.run.smithi192.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T11:54:19.662 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 02:42:8e:c8:13:a8 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:19.662 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T11:54:19.662 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:19.663 INFO:teuthology.orchestra.run.smithi192.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:54:19.663 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 2a:7f:4e:0a:d5:53 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:54:19.663 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T11:54:19.663 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:19.663 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::e86a:4ff:fe2e:3924/64 scope link 2023-11-28T11:54:19.663 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:19.663 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:54:19.663 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 2a:7f:4e:0a:d5:53 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T11:54:19.663 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::287f:4eff:fe0a:d553/64 scope link 2023-11-28T11:54:19.663 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:19.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:19.664 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:54:19.679 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-11-28T11:54:19.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:19.681 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-11-28T11:54:19.730 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-11-28T11:54:19.730 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:54:19.730 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T11:54:19.730 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T11:54:19.730 INFO:teuthology.orchestra.run.smithi192.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T11:54:19.731 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-28T11:54:19.731 INFO:teuthology.orchestra.run.smithi192.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T11:54:19.731 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:54:19.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:19.731 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-28T11:54:19.731 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-28T11:54:19.731 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T11:54:19.731 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T11:54:19.731 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T11:54:19.731 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-28T11:54:19.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:19.771 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-11-28T11:54:19.777 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T11:54:19.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:19.777 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list-id 2023-11-28T11:54:19.783 INFO:teuthology.orchestra.run.smithi192.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-28T11:54:19.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:19.784 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-28T11:54:19.784 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-28T11:54:19.784 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T11:54:19.784 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-28T11:54:19.784 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-28T11:54:19.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:19.857 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T11:54:19.868 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:54:19.868 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:54:19.868 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:54:19.868 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:19.868 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-11-28T11:54:19.869 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:19.869 INFO:teuthology.orchestra.run.smithi192.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:54:19.869 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 72:0f:46:09:20:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T11:54:19.869 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T11:54:19.869 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:19.869 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::700f:46ff:fe09:2057/64 scope link 2023-11-28T11:54:19.869 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:19.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:19.870 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T11:54:19.883 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:54:19.883 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:54:19.883 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:54:19.883 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:19.883 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-11-28T11:54:19.884 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:19.884 INFO:teuthology.orchestra.run.smithi192.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:54:19.884 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 72:0f:46:09:20:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T11:54:19.884 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T11:54:19.884 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:19.884 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::700f:46ff:fe09:2057/64 scope link 2023-11-28T11:54:19.884 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:54:19.885 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-28T11:54:19.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:19.885 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-28T11:54:19.885 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-28T11:54:19.885 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-28T11:54:19.886 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T11:54:19.886 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-28T11:54:19.886 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-28T11:54:19.886 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-28T11:54:19.886 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-28T11:54:19.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:19.984 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-28T11:54:19.984 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-28T11:54:19.985 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.1 up 2023-11-28T11:54:19.985 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T11:54:19.985 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-28T11:54:20.009 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-28T11:54:20.009 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:54:20.009 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-28T11:54:20.017 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-28T11:54:20.017 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:54:20.017 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-28T11:54:20.022 DEBUG:teuthology.orchestra.run.smithi192:> sudo modprobe fuse 2023-11-28T11:54:20.082 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:54:20.082 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:54:20.096 INFO:teuthology.orchestra.run.smithi192.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:54:20.098 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:54:20.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:20.098 DEBUG:teuthology.orchestra.run.smithi192:> ls /sys/fs/fuse/connections 2023-11-28T11:54:20.104 INFO:teuthology.orchestra.run.smithi192.stdout:52 2023-11-28T11:54:20.104 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2023-11-28T11:54:20.104 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3 --client_mountpoint=/) 2023-11-28T11:54:20.107 DEBUG:teuthology.orchestra.run.smithi192:> sudo modprobe fuse 2023-11-28T11:54:20.123 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:54:20.123 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:54:20.182 INFO:teuthology.orchestra.run.smithi192.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:54:20.183 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:54:20.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:20.184 DEBUG:teuthology.orchestra.run.smithi192:> ls /sys/fs/fuse/connections 2023-11-28T11:54:20.188 INFO:teuthology.orchestra.run.smithi192.stdout:52 2023-11-28T11:54:20.193 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi192.stderr:2023-11-28T11:54:20.187+0000 7f624ca6c640 -1 init, newargv = 0x5614f54a9320 newargc=15 2023-11-28T11:54:20.193 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi192.stderr:ceph-fuse[42577]: starting ceph client 2023-11-28T11:54:20.202 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi192.stderr:ceph-fuse[42577]: starting fuse 2023-11-28T11:54:21.290 DEBUG:teuthology.orchestra.run.smithi192:> sudo modprobe fuse 2023-11-28T11:54:21.309 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:54:21.309 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:54:21.319 INFO:teuthology.orchestra.run.smithi192.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:54:21.320 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:54:21.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:21.321 DEBUG:teuthology.orchestra.run.smithi192:> ls /sys/fs/fuse/connections 2023-11-28T11:54:21.368 INFO:teuthology.orchestra.run.smithi192.stdout:52 2023-11-28T11:54:21.368 INFO:teuthology.orchestra.run.smithi192.stdout:53 2023-11-28T11:54:21.368 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2023-11-28T11:54:21.369 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:54:21.369 DEBUG:teuthology.orchestra.run.smithi192:> import glob 2023-11-28T11:54:21.369 DEBUG:teuthology.orchestra.run.smithi192:> import re 2023-11-28T11:54:21.369 DEBUG:teuthology.orchestra.run.smithi192:> import os 2023-11-28T11:54:21.369 DEBUG:teuthology.orchestra.run.smithi192:> import subprocess 2023-11-28T11:54:21.369 DEBUG:teuthology.orchestra.run.smithi192:> 2023-11-28T11:54:21.369 DEBUG:teuthology.orchestra.run.smithi192:> def _find_admin_socket(client_name): 2023-11-28T11:54:21.369 DEBUG:teuthology.orchestra.run.smithi192:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-28T11:54:21.369 DEBUG:teuthology.orchestra.run.smithi192:> files = glob.glob(asok_path) 2023-11-28T11:54:21.369 DEBUG:teuthology.orchestra.run.smithi192:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-28T11:54:21.369 DEBUG:teuthology.orchestra.run.smithi192:> 2023-11-28T11:54:21.369 DEBUG:teuthology.orchestra.run.smithi192:> # Given a non-glob path, it better be there 2023-11-28T11:54:21.370 DEBUG:teuthology.orchestra.run.smithi192:> if "*" not in asok_path: 2023-11-28T11:54:21.370 DEBUG:teuthology.orchestra.run.smithi192:> assert(len(files) == 1) 2023-11-28T11:54:21.370 DEBUG:teuthology.orchestra.run.smithi192:> return files[0] 2023-11-28T11:54:21.370 DEBUG:teuthology.orchestra.run.smithi192:> 2023-11-28T11:54:21.370 DEBUG:teuthology.orchestra.run.smithi192:> for f in files: 2023-11-28T11:54:21.370 DEBUG:teuthology.orchestra.run.smithi192:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T11:54:21.370 DEBUG:teuthology.orchestra.run.smithi192:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T11:54:21.370 DEBUG:teuthology.orchestra.run.smithi192:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T11:54:21.370 DEBUG:teuthology.orchestra.run.smithi192:> contents = proc_f.read() 2023-11-28T11:54:21.370 DEBUG:teuthology.orchestra.run.smithi192:> if mountpoint in contents: 2023-11-28T11:54:21.370 DEBUG:teuthology.orchestra.run.smithi192:> return f 2023-11-28T11:54:21.370 DEBUG:teuthology.orchestra.run.smithi192:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T11:54:21.370 DEBUG:teuthology.orchestra.run.smithi192:> 2023-11-28T11:54:21.371 DEBUG:teuthology.orchestra.run.smithi192:> print(_find_admin_socket("client.3")) 2023-11-28T11:54:21.371 DEBUG:teuthology.orchestra.run.smithi192:> ' 2023-11-28T11:54:21.451 INFO:teuthology.orchestra.run.smithi192.stdout:/var/run/ceph/ceph-client.3.42577.asok 2023-11-28T11:54:21.636 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.42577.asok 2023-11-28T11:54:21.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:21.636 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.42577.asok status 2023-11-28T11:54:21.738 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2023-11-28T11:54:21.739 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": { 2023-11-28T11:54:21.739 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T11:54:21.739 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T11:54:21.739 INFO:teuthology.orchestra.run.smithi192.stdout: "entity_id": "3", 2023-11-28T11:54:21.739 INFO:teuthology.orchestra.run.smithi192.stdout: "hostname": "smithi192", 2023-11-28T11:54:21.739 INFO:teuthology.orchestra.run.smithi192.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-28T11:54:21.739 INFO:teuthology.orchestra.run.smithi192.stdout: "pid": "42577", 2023-11-28T11:54:21.739 INFO:teuthology.orchestra.run.smithi192.stdout: "root": "/" 2023-11-28T11:54:21.739 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2023-11-28T11:54:21.739 INFO:teuthology.orchestra.run.smithi192.stdout: "dentry_count": 0, 2023-11-28T11:54:21.739 INFO:teuthology.orchestra.run.smithi192.stdout: "dentry_pinned_count": 0, 2023-11-28T11:54:21.739 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 4876, 2023-11-28T11:54:21.739 INFO:teuthology.orchestra.run.smithi192.stdout: "inst": { 2023-11-28T11:54:21.740 INFO:teuthology.orchestra.run.smithi192.stdout: "name": { 2023-11-28T11:54:21.740 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "client", 2023-11-28T11:54:21.740 INFO:teuthology.orchestra.run.smithi192.stdout: "num": 4876 2023-11-28T11:54:21.740 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2023-11-28T11:54:21.740 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": { 2023-11-28T11:54:21.740 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2023-11-28T11:54:21.740 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "192.168.0.2:0", 2023-11-28T11:54:21.740 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3296478511 2023-11-28T11:54:21.740 INFO:teuthology.orchestra.run.smithi192.stdout: } 2023-11-28T11:54:21.740 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2023-11-28T11:54:21.740 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": { 2023-11-28T11:54:21.740 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2023-11-28T11:54:21.740 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "192.168.0.2:0", 2023-11-28T11:54:21.740 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3296478511 2023-11-28T11:54:21.741 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2023-11-28T11:54:21.741 INFO:teuthology.orchestra.run.smithi192.stdout: "inst_str": "client.4876 192.168.0.2:0/3296478511", 2023-11-28T11:54:21.741 INFO:teuthology.orchestra.run.smithi192.stdout: "addr_str": "192.168.0.2:0/3296478511", 2023-11-28T11:54:21.741 INFO:teuthology.orchestra.run.smithi192.stdout: "inode_count": 1, 2023-11-28T11:54:21.741 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_epoch": 9, 2023-11-28T11:54:21.741 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_epoch": 25, 2023-11-28T11:54:21.741 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_epoch_barrier": 0, 2023-11-28T11:54:21.741 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklisted": false, 2023-11-28T11:54:21.741 INFO:teuthology.orchestra.run.smithi192.stdout: "fs_name": "cephfs" 2023-11-28T11:54:21.741 INFO:teuthology.orchestra.run.smithi192.stdout:} 2023-11-28T11:54:21.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:21.748 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-11-28T11:54:21.748 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T11:54:21.757 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-11-28T11:54:21.757 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T11:54:21.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:21.758 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:54:21.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:21.815 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-11-28T11:54:21.815 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-28T11:54:21.821 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-11-28T11:54:21.821 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-28T11:54:21.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:21.822 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-28T11:54:21.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:21.840 DEBUG:teuthology.orchestra.run.smithi192:> stat --file-system '--printf=%T 2023-11-28T11:54:21.840 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-28T11:54:21.849 INFO:teuthology.orchestra.run.smithi192.stdout:fuseblk 2023-11-28T11:54:21.849 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-28T11:54:21.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:21.849 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T11:54:21.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:21.863 DEBUG:teuthology.orchestra.run.smithi192:> stat --file-system '--printf=%T 2023-11-28T11:54:21.863 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-28T11:54:21.917 INFO:teuthology.orchestra.run.smithi192.stdout:fuseblk 2023-11-28T11:54:21.917 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-28T11:54:21.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:21.917 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-28T11:54:21.932 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-28T11:54:21.952 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:22.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.072+0000 7f2a3893a700 1 Processor -- start 2023-11-28T11:54:22.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.072+0000 7f2a3893a700 1 -- start start 2023-11-28T11:54:22.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.072+0000 7f2a3893a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a3406a530 0x7f2a340cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.072+0000 7f2a3893a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3406dc70 con 0x7f2a3406d7d0 2023-11-28T11:54:22.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.072+0000 7f2a3893a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3415c6d0 con 0x7f2a340cf050 2023-11-28T11:54:22.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.072+0000 7f2a3893a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a340b5320 con 0x7f2a3406a530 2023-11-28T11:54:22.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.072+0000 7f2a2a59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2a3406d7d0 0x7f2a340b4c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44250/0 (socket says 172.21.15.50:44250) 2023-11-28T11:54:22.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.072+0000 7f2a2a59c700 1 -- 172.21.15.50:0/1275300984 learned_addr learned my addr 172.21.15.50:0/1275300984 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:22.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.072+0000 7f2a3359e700 1 --2- 172.21.15.50:0/1275300984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a3406a530 0x7f2a340cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3259c700 1 -- 172.21.15.50:0/1275300984 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663455805 0 0) 0x7f2a1c001110 con 0x7f2a3406d7d0 2023-11-28T11:54:22.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3259c700 1 -- 172.21.15.50:0/1275300984 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a200035d0 con 0x7f2a3406d7d0 2023-11-28T11:54:22.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3259c700 1 -- 172.21.15.50:0/1275300984 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963503775 0 0) 0x7f2a3415c6d0 con 0x7f2a340cf050 2023-11-28T11:54:22.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3259c700 1 -- 172.21.15.50:0/1275300984 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a1c001110 con 0x7f2a340cf050 2023-11-28T11:54:22.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3359e700 1 -- 172.21.15.50:0/1275300984 >> v1:172.21.15.192:6789/0 conn(0x7f2a340cf050 legacy=0x7f2a340cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3359e700 1 -- 172.21.15.50:0/1275300984 >> v1:172.21.15.50:6789/0 conn(0x7f2a3406d7d0 legacy=0x7f2a340b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3359e700 1 -- 172.21.15.50:0/1275300984 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3406a9b0 con 0x7f2a3406a530 2023-11-28T11:54:22.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3359e700 1 --2- 172.21.15.50:0/1275300984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a3406a530 0x7f2a340cce20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009dc0 tx=0x7f2a2c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7d4e740d5e489ab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:22.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3259c700 1 -- 172.21.15.50:0/1275300984 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00e070 con 0x7f2a3406a530 2023-11-28T11:54:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3259c700 1 -- 172.21.15.50:0/1275300984 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c00bb20 con 0x7f2a3406a530 2023-11-28T11:54:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3259c700 1 -- 172.21.15.50:0/1275300984 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00be90 con 0x7f2a3406a530 2023-11-28T11:54:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3893a700 1 -- 172.21.15.50:0/1275300984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a3406a530 msgr2=0x7f2a340cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3893a700 1 --2- 172.21.15.50:0/1275300984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a3406a530 0x7f2a340cce20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009dc0 tx=0x7f2a2c00b330 comp rx=0 tx=0).stop 2023-11-28T11:54:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3893a700 1 -- 172.21.15.50:0/1275300984 shutdown_connections 2023-11-28T11:54:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3893a700 1 --2- 172.21.15.50:0/1275300984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a3406a530 0x7f2a340cce20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3893a700 1 -- 172.21.15.50:0/1275300984 >> 172.21.15.50:0/1275300984 conn(0x7f2a3409bb30 msgr2=0x7f2a340b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:22.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3893a700 1 -- 172.21.15.50:0/1275300984 shutdown_connections 2023-11-28T11:54:22.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.076+0000 7f2a3893a700 1 -- 172.21.15.50:0/1275300984 wait complete. 2023-11-28T11:54:22.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a3893a700 1 Processor -- start 2023-11-28T11:54:22.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a3893a700 1 -- start start 2023-11-28T11:54:22.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a3893a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a3406a530 0x7f2a3414fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a3893a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a3406d7d0 0x7f2a3415d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a3893a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a340cf050 0x7f2a34159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a3893a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3415e9a0 con 0x7f2a340cf050 2023-11-28T11:54:22.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a3893a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3415edc0 con 0x7f2a3406d7d0 2023-11-28T11:54:22.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a3893a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3415dd20 con 0x7f2a3406a530 2023-11-28T11:54:22.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a3359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a340cf050 0x7f2a34159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a3359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a340cf050 0x7f2a34159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59898/0 (socket says 172.21.15.50:59898) 2023-11-28T11:54:22.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a3359e700 1 -- 172.21.15.50:0/858461468 learned_addr learned my addr 172.21.15.50:0/858461468 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:22.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a2a59c700 1 --2- 172.21.15.50:0/858461468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a3406d7d0 0x7f2a3415d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a32d9d700 1 --2- 172.21.15.50:0/858461468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a3406a530 0x7f2a3414fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a3359e700 1 -- 172.21.15.50:0/858461468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a3406a530 msgr2=0x7f2a3414fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a3359e700 1 --2- 172.21.15.50:0/858461468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a3406a530 0x7f2a3414fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a3359e700 1 -- 172.21.15.50:0/858461468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a3406d7d0 msgr2=0x7f2a3415d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a3359e700 1 --2- 172.21.15.50:0/858461468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a3406d7d0 0x7f2a3415d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a3359e700 1 -- 172.21.15.50:0/858461468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c009a70 con 0x7f2a340cf050 2023-11-28T11:54:22.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a2a59c700 1 --2- 172.21.15.50:0/858461468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a3406d7d0 0x7f2a3415d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:22.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.080+0000 7f2a32d9d700 1 --2- 172.21.15.50:0/858461468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a3406a530 0x7f2a3414fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:22.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.084+0000 7f2a3359e700 1 --2- 172.21.15.50:0/858461468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a340cf050 0x7f2a34159d70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c014040 tx=0x7f2a2c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:22.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.084+0000 7f2a2bfff700 1 -- 172.21.15.50:0/858461468 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0098f0 con 0x7f2a340cf050 2023-11-28T11:54:22.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.084+0000 7f2a2bfff700 1 -- 172.21.15.50:0/858461468 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c020070 con 0x7f2a340cf050 2023-11-28T11:54:22.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.084+0000 7f2a2bfff700 1 -- 172.21.15.50:0/858461468 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c027680 con 0x7f2a340cf050 2023-11-28T11:54:22.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.084+0000 7f2a3893a700 1 -- 172.21.15.50:0/858461468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3406af40 con 0x7f2a340cf050 2023-11-28T11:54:22.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.084+0000 7f2a3893a700 1 -- 172.21.15.50:0/858461468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3406ac60 con 0x7f2a340cf050 2023-11-28T11:54:22.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.084+0000 7f2a3893a700 1 -- 172.21.15.50:0/858461468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a340b4410 con 0x7f2a340cf050 2023-11-28T11:54:22.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.084+0000 7f2a2bfff700 1 -- 172.21.15.50:0/858461468 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2a2c02e070 con 0x7f2a340cf050 2023-11-28T11:54:22.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.084+0000 7f2a2bfff700 1 --2- 172.21.15.50:0/858461468 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2a14064ee0 0x7f2a14067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.084+0000 7f2a2bfff700 1 -- 172.21.15.50:0/858461468 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2a2c022070 con 0x7f2a340cf050 2023-11-28T11:54:22.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.088+0000 7f2a32d9d700 1 --2- 172.21.15.50:0/858461468 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2a14064ee0 0x7f2a14067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.088+0000 7f2a32d9d700 1 --2- 172.21.15.50:0/858461468 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2a14064ee0 0x7f2a14067390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2a24001730 tx=0x7f2a24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:22.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.092+0000 7f2a2bfff700 1 -- 172.21.15.50:0/858461468 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2a2c051cb0 con 0x7f2a340cf050 2023-11-28T11:54:22.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.264+0000 7f2a3893a700 1 -- 172.21.15.50:0/858461468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a3415eae0 con 0x7f2a340cf050 2023-11-28T11:54:22.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.264+0000 7f2a2bfff700 1 -- 172.21.15.50:0/858461468 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f2a3415eae0 con 0x7f2a340cf050 2023-11-28T11:54:22.271 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:22.271 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:45.231747+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:22.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.268+0000 7f2a3893a700 1 -- 172.21.15.50:0/858461468 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2a14064ee0 msgr2=0x7f2a14067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.268+0000 7f2a3893a700 1 --2- 172.21.15.50:0/858461468 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2a14064ee0 0x7f2a14067390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2a24001730 tx=0x7f2a24009040 comp rx=0 tx=0).stop 2023-11-28T11:54:22.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.268+0000 7f2a3893a700 1 -- 172.21.15.50:0/858461468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a340cf050 msgr2=0x7f2a34159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.268+0000 7f2a3893a700 1 --2- 172.21.15.50:0/858461468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a340cf050 0x7f2a34159d70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c014040 tx=0x7f2a2c004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.268+0000 7f2a3893a700 1 -- 172.21.15.50:0/858461468 shutdown_connections 2023-11-28T11:54:22.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.268+0000 7f2a3893a700 1 --2- 172.21.15.50:0/858461468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a340cf050 0x7f2a34159d70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.268+0000 7f2a3893a700 1 --2- 172.21.15.50:0/858461468 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2a14064ee0 0x7f2a14067390 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.268+0000 7f2a3893a700 1 --2- 172.21.15.50:0/858461468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a3406d7d0 0x7f2a3415d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.268+0000 7f2a3893a700 1 --2- 172.21.15.50:0/858461468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a3406a530 0x7f2a3414fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.268+0000 7f2a3893a700 1 -- 172.21.15.50:0/858461468 >> 172.21.15.50:0/858461468 conn(0x7f2a3409bb30 msgr2=0x7f2a340b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:22.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.268+0000 7f2a3893a700 1 -- 172.21.15.50:0/858461468 shutdown_connections 2023-11-28T11:54:22.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.268+0000 7f2a3893a700 1 -- 172.21.15.50:0/858461468 wait complete. 2023-11-28T11:54:22.286 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:53:38.462826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:53:39.778621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:53:42.870360+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:54:22.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:54:22.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e73e9700 1 Processor -- start 2023-11-28T11:54:22.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e73e9700 1 -- start start 2023-11-28T11:54:22.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e73e9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8d8053850 0x7fa8d8057b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e73e9700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d8056dd0 con 0x7fa8d8058040 2023-11-28T11:54:22.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e73e9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d8057670 con 0x7fa8d80385e0 2023-11-28T11:54:22.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e73e9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d8053c80 con 0x7fa8d8053850 2023-11-28T11:54:22.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e6be8700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa8d8058040 0x7fa8d803c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44260/0 (socket says 172.21.15.50:44260) 2023-11-28T11:54:22.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e6be8700 1 -- 172.21.15.50:0/2541435879 learned_addr learned my addr 172.21.15.50:0/2541435879 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:22.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e5be6700 1 --2- 172.21.15.50:0/2541435879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8d8053850 0x7fa8d8057b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 -- 172.21.15.50:0/2541435879 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314289021 0 0) 0x7fa8d8056dd0 con 0x7fa8d8058040 2023-11-28T11:54:22.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 -- 172.21.15.50:0/2541435879 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8cc0035d0 con 0x7fa8d8058040 2023-11-28T11:54:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 -- 172.21.15.50:0/2541435879 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2542698736 0 0) 0x7fa8cc0035d0 con 0x7fa8d8058040 2023-11-28T11:54:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 -- 172.21.15.50:0/2541435879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8d8053850 msgr2=0x7fa8d8057b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 --2- 172.21.15.50:0/2541435879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8d8053850 0x7fa8d8057b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 -- 172.21.15.50:0/2541435879 >> v1:172.21.15.192:6789/0 conn(0x7fa8d80385e0 legacy=0x7fa8d8006dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 -- 172.21.15.50:0/2541435879 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d8053ea0 con 0x7fa8d8058040 2023-11-28T11:54:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 -- 172.21.15.50:0/2541435879 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7fa8e00008d0 con 0x7fa8d8058040 2023-11-28T11:54:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 -- 172.21.15.50:0/2541435879 >> v1:172.21.15.50:6789/0 conn(0x7fa8d8058040 legacy=0x7fa8d803c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 --2- 172.21.15.50:0/2541435879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8cc003a50 0x7fa8cc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 --2- 172.21.15.50:0/2541435879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8d8053850 0x7fa8cc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 --2- 172.21.15.50:0/2541435879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8cc004db0 0x7fa8cc005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 -- 172.21.15.50:0/2541435879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d8053c80 con 0x7fa8cc003a50 2023-11-28T11:54:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 -- 172.21.15.50:0/2541435879 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc00ba20 con 0x7fa8cc004db0 2023-11-28T11:54:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 -- 172.21.15.50:0/2541435879 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc00bbb0 con 0x7fa8d8053850 2023-11-28T11:54:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e63e7700 1 --2- 172.21.15.50:0/2541435879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8cc003a50 0x7fa8cc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e6be8700 1 --2- 172.21.15.50:0/2541435879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8cc004db0 0x7fa8cc005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e5be6700 1 --2- 172.21.15.50:0/2541435879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8d8053850 0x7fa8cc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e63e7700 1 -- 172.21.15.50:0/2541435879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8d8053850 msgr2=0x7fa8cc004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e63e7700 1 --2- 172.21.15.50:0/2541435879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8d8053850 0x7fa8cc004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e63e7700 1 -- 172.21.15.50:0/2541435879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8cc004db0 msgr2=0x7fa8cc005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e63e7700 1 --2- 172.21.15.50:0/2541435879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8cc004db0 0x7fa8cc005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e63e7700 1 -- 172.21.15.50:0/2541435879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc0035d0 con 0x7fa8cc003a50 2023-11-28T11:54:22.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e63e7700 1 --2- 172.21.15.50:0/2541435879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8cc003a50 0x7fa8cc003e60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc007fd0 tx=0x7fa8cc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f872e9d09efdd16 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 -- 172.21.15.50:0/2541435879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc0052d0 con 0x7fa8cc003a50 2023-11-28T11:54:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 -- 172.21.15.50:0/2541435879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8dc005430 con 0x7fa8cc003a50 2023-11-28T11:54:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.404+0000 7fa8e53e5700 1 -- 172.21.15.50:0/2541435879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc0055a0 con 0x7fa8cc003a50 2023-11-28T11:54:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e73e9700 1 -- 172.21.15.50:0/2541435879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8cc003a50 msgr2=0x7fa8cc003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e73e9700 1 --2- 172.21.15.50:0/2541435879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8cc003a50 0x7fa8cc003e60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc007fd0 tx=0x7fa8cc0058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e6be8700 1 -- 172.21.15.50:0/2541435879 reap_dead start 2023-11-28T11:54:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e73e9700 1 -- 172.21.15.50:0/2541435879 shutdown_connections 2023-11-28T11:54:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e73e9700 1 -- 172.21.15.50:0/2541435879 >> 172.21.15.50:0/2541435879 conn(0x7fa8d8055c80 msgr2=0x7fa8d8056050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e73e9700 1 -- 172.21.15.50:0/2541435879 shutdown_connections 2023-11-28T11:54:22.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e73e9700 1 -- 172.21.15.50:0/2541435879 wait complete. 2023-11-28T11:54:22.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e73e9700 1 Processor -- start 2023-11-28T11:54:22.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e73e9700 1 -- start start 2023-11-28T11:54:22.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e73e9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc003a50 0x7fa8d80d2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e73e9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8d80e2620 0x7fa8d80e2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e73e9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d804f800 0x7fa8d817bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e73e9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d80d2c70 con 0x7fa8d804f800 2023-11-28T11:54:22.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e73e9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d80e2b20 con 0x7fa8d80e2620 2023-11-28T11:54:22.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e73e9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d804ea40 con 0x7fa8cc003a50 2023-11-28T11:54:22.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e6be8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d804f800 0x7fa8d817bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e6be8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d804f800 0x7fa8d817bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59916/0 (socket says 172.21.15.50:59916) 2023-11-28T11:54:22.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e6be8700 1 -- 172.21.15.50:0/4129603576 learned_addr learned my addr 172.21.15.50:0/4129603576 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:22.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.408+0000 7fa8e5be6700 1 --2- 172.21.15.50:0/4129603576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8d80e2620 0x7fa8d80e2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.412+0000 7fa8e63e7700 1 --2- 172.21.15.50:0/4129603576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc003a50 0x7fa8d80d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.412+0000 7fa8e6be8700 1 -- 172.21.15.50:0/4129603576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc003a50 msgr2=0x7fa8d80d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.412+0000 7fa8e6be8700 1 --2- 172.21.15.50:0/4129603576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc003a50 0x7fa8d80d2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.412+0000 7fa8e6be8700 1 -- 172.21.15.50:0/4129603576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8d80e2620 msgr2=0x7fa8d80e2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.412+0000 7fa8e6be8700 1 --2- 172.21.15.50:0/4129603576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8d80e2620 0x7fa8d80e2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.412+0000 7fa8e6be8700 1 -- 172.21.15.50:0/4129603576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d8057300 con 0x7fa8d804f800 2023-11-28T11:54:22.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.412+0000 7fa8e6be8700 1 --2- 172.21.15.50:0/4129603576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d804f800 0x7fa8d817bab0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00617e0 tx=0x7fa8e0072ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:22.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.412+0000 7fa8d6ffd700 1 -- 172.21.15.50:0/4129603576 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0066ff0 con 0x7fa8d804f800 2023-11-28T11:54:22.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.412+0000 7fa8d6ffd700 1 -- 172.21.15.50:0/4129603576 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e0067b20 con 0x7fa8d804f800 2023-11-28T11:54:22.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.412+0000 7fa8e73e9700 1 -- 172.21.15.50:0/4129603576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d8057020 con 0x7fa8d804f800 2023-11-28T11:54:22.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.412+0000 7fa8d6ffd700 1 -- 172.21.15.50:0/4129603576 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0067ed0 con 0x7fa8d804f800 2023-11-28T11:54:22.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.412+0000 7fa8e73e9700 1 -- 172.21.15.50:0/4129603576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d803c760 con 0x7fa8d804f800 2023-11-28T11:54:22.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.412+0000 7fa8e73e9700 1 -- 172.21.15.50:0/4129603576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d80059c0 con 0x7fa8d804f800 2023-11-28T11:54:22.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.416+0000 7fa8d6ffd700 1 -- 172.21.15.50:0/4129603576 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa8e0099070 con 0x7fa8d804f800 2023-11-28T11:54:22.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.416+0000 7fa8d6ffd700 1 --2- 172.21.15.50:0/4129603576 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa8c4064ee0 0x7fa8c4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.416+0000 7fa8d6ffd700 1 -- 172.21.15.50:0/4129603576 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa8e00fb800 con 0x7fa8d804f800 2023-11-28T11:54:22.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.416+0000 7fa8e63e7700 1 --2- 172.21.15.50:0/4129603576 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa8c4064ee0 0x7fa8c4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.416+0000 7fa8e63e7700 1 --2- 172.21.15.50:0/4129603576 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa8c4064ee0 0x7fa8c4067390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc000c00 tx=0x7fa8dc009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:22.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.424+0000 7fa8d6ffd700 1 -- 172.21.15.50:0/4129603576 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa8e00c95f0 con 0x7fa8d804f800 2023-11-28T11:54:22.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.580+0000 7fa8e73e9700 1 -- 172.21.15.50:0/4129603576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa8d8007790 con 0x7fa8d804f800 2023-11-28T11:54:22.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.580+0000 7fa8d6ffd700 1 -- 172.21.15.50:0/4129603576 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa8e00970a0 con 0x7fa8d804f800 2023-11-28T11:54:22.585 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:54:22.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.584+0000 7fa8e73e9700 1 -- 172.21.15.50:0/4129603576 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa8c4064ee0 msgr2=0x7fa8c4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.584+0000 7fa8e73e9700 1 --2- 172.21.15.50:0/4129603576 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa8c4064ee0 0x7fa8c4067390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc000c00 tx=0x7fa8dc009030 comp rx=0 tx=0).stop 2023-11-28T11:54:22.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.584+0000 7fa8e73e9700 1 -- 172.21.15.50:0/4129603576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d804f800 msgr2=0x7fa8d817bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.584+0000 7fa8e73e9700 1 --2- 172.21.15.50:0/4129603576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d804f800 0x7fa8d817bab0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00617e0 tx=0x7fa8e0072ab0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.584+0000 7fa8e73e9700 1 -- 172.21.15.50:0/4129603576 shutdown_connections 2023-11-28T11:54:22.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.584+0000 7fa8e73e9700 1 --2- 172.21.15.50:0/4129603576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8d804f800 0x7fa8d817bab0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.584+0000 7fa8e73e9700 1 --2- 172.21.15.50:0/4129603576 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa8c4064ee0 0x7fa8c4067390 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.584+0000 7fa8e73e9700 1 --2- 172.21.15.50:0/4129603576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8d80e2620 0x7fa8d80e2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.584+0000 7fa8e73e9700 1 --2- 172.21.15.50:0/4129603576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc003a50 0x7fa8d80d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.584+0000 7fa8e73e9700 1 -- 172.21.15.50:0/4129603576 >> 172.21.15.50:0/4129603576 conn(0x7fa8d8055c80 msgr2=0x7fa8d803da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:22.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.584+0000 7fa8e73e9700 1 -- 172.21.15.50:0/4129603576 shutdown_connections 2023-11-28T11:54:22.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.584+0000 7fa8e73e9700 1 -- 172.21.15.50:0/4129603576 wait complete. 2023-11-28T11:54:22.600 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:54:22.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.712+0000 7fb83edc7700 1 Processor -- start 2023-11-28T11:54:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.712+0000 7fb83edc7700 1 -- start start 2023-11-28T11:54:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.712+0000 7fb83edc7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb8300e6e60 0x7fb83004f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.712+0000 7fb83edc7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8300512b0 0x7fb830036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.712+0000 7fb83edc7700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb830053df0 con 0x7fb830036cb0 2023-11-28T11:54:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.712+0000 7fb83edc7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb830037150 con 0x7fb8300e6e60 2023-11-28T11:54:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.712+0000 7fb83edc7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8300486b0 con 0x7fb8300512b0 2023-11-28T11:54:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.712+0000 7fb83e5c6700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb830036cb0 0x7fb8300060c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44270/0 (socket says 172.21.15.50:44270) 2023-11-28T11:54:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.712+0000 7fb83e5c6700 1 -- 172.21.15.50:0/614609787 learned_addr learned my addr 172.21.15.50:0/614609787 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.712+0000 7fb83ddc5700 1 --2- 172.21.15.50:0/614609787 >> v2:172.21.15.192:3300/0 conn(0x7fb8300e6e60 0x7fb83004f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.712+0000 7fb83d5c4700 1 --2- 172.21.15.50:0/614609787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8300512b0 0x7fb830036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.712+0000 7fb83cdc3700 1 -- 172.21.15.50:0/614609787 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962963356 0 0) 0x7fb830053df0 con 0x7fb830036cb0 2023-11-28T11:54:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.712+0000 7fb83cdc3700 1 -- 172.21.15.50:0/614609787 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8240035d0 con 0x7fb830036cb0 2023-11-28T11:54:22.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83cdc3700 1 -- 172.21.15.50:0/614609787 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3789166515 0 0) 0x7fb8240035d0 con 0x7fb830036cb0 2023-11-28T11:54:22.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83cdc3700 1 -- 172.21.15.50:0/614609787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8300512b0 msgr2=0x7fb830036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:22.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83cdc3700 1 --2- 172.21.15.50:0/614609787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8300512b0 0x7fb830036770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83cdc3700 1 -- 172.21.15.50:0/614609787 >> v2:172.21.15.192:3300/0 conn(0x7fb8300e6e60 msgr2=0x7fb83004f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83cdc3700 1 --2- 172.21.15.50:0/614609787 >> v2:172.21.15.192:3300/0 conn(0x7fb8300e6e60 0x7fb83004f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83cdc3700 1 -- 172.21.15.50:0/614609787 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb830033a80 con 0x7fb830036cb0 2023-11-28T11:54:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83cdc3700 1 -- 172.21.15.50:0/614609787 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7fb8380008d0 con 0x7fb830036cb0 2023-11-28T11:54:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83cdc3700 1 -- 172.21.15.50:0/614609787 >> v1:172.21.15.50:6789/0 conn(0x7fb830036cb0 legacy=0x7fb8300060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83cdc3700 1 --2- 172.21.15.50:0/614609787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb824003a20 0x7fb824003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83cdc3700 1 --2- 172.21.15.50:0/614609787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8240043b0 0x7fb824004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83cdc3700 1 --2- 172.21.15.50:0/614609787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8300512b0 0x7fb824004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83cdc3700 1 -- 172.21.15.50:0/614609787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8300486b0 con 0x7fb8240043b0 2023-11-28T11:54:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83cdc3700 1 -- 172.21.15.50:0/614609787 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb824005680 con 0x7fb824003a20 2023-11-28T11:54:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83cdc3700 1 -- 172.21.15.50:0/614609787 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82400ba20 con 0x7fb8300512b0 2023-11-28T11:54:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83ddc5700 1 --2- 172.21.15.50:0/614609787 >> v2:172.21.15.192:3300/0 conn(0x7fb8300e6e60 0x7fb83004f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83d5c4700 1 --2- 172.21.15.50:0/614609787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8240043b0 0x7fb824004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83e5c6700 1 --2- 172.21.15.50:0/614609787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8300512b0 0x7fb824004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83ddc5700 1 --2- 172.21.15.50:0/614609787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb824003a20 0x7fb824003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83d5c4700 1 -- 172.21.15.50:0/614609787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8300512b0 msgr2=0x7fb824004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83d5c4700 1 --2- 172.21.15.50:0/614609787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8300512b0 0x7fb824004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83d5c4700 1 -- 172.21.15.50:0/614609787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb824003a20 msgr2=0x7fb824003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83d5c4700 1 --2- 172.21.15.50:0/614609787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb824003a20 0x7fb824003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83d5c4700 1 -- 172.21.15.50:0/614609787 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8240035d0 con 0x7fb8240043b0 2023-11-28T11:54:22.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83ddc5700 1 --2- 172.21.15.50:0/614609787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb824003a20 0x7fb824003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:54:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83d5c4700 1 --2- 172.21.15.50:0/614609787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8240043b0 0x7fb824004870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb828009ba0 tx=0x7fb8240058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3774bff4c762a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83cdc3700 1 -- 172.21.15.50:0/614609787 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82800e6c0 con 0x7fb8240043b0 2023-11-28T11:54:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83cdc3700 1 -- 172.21.15.50:0/614609787 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82800e820 con 0x7fb8240043b0 2023-11-28T11:54:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83cdc3700 1 -- 172.21.15.50:0/614609787 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82800eb90 con 0x7fb8240043b0 2023-11-28T11:54:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83edc7700 1 -- 172.21.15.50:0/614609787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8240043b0 msgr2=0x7fb824004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83edc7700 1 --2- 172.21.15.50:0/614609787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8240043b0 0x7fb824004870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb828009ba0 tx=0x7fb8240058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83e5c6700 1 -- 172.21.15.50:0/614609787 reap_dead start 2023-11-28T11:54:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83edc7700 1 -- 172.21.15.50:0/614609787 shutdown_connections 2023-11-28T11:54:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83edc7700 1 -- 172.21.15.50:0/614609787 >> 172.21.15.50:0/614609787 conn(0x7fb830051770 msgr2=0x7fb830051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83edc7700 1 -- 172.21.15.50:0/614609787 shutdown_connections 2023-11-28T11:54:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83edc7700 1 -- 172.21.15.50:0/614609787 wait complete. 2023-11-28T11:54:22.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83edc7700 1 Processor -- start 2023-11-28T11:54:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.716+0000 7fb83edc7700 1 -- start start 2023-11-28T11:54:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83edc7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8240043b0 0x7fb8300e7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83edc7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8300e7770 0x7fb8300cee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83edc7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8300cf390 0x7fb8300db7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83edc7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8300cf830 con 0x7fb8240043b0 2023-11-28T11:54:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83edc7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8300dc710 con 0x7fb8300cf390 2023-11-28T11:54:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83edc7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8300de820 con 0x7fb8300e7770 2023-11-28T11:54:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83ddc5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8240043b0 0x7fb8300e7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83ddc5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8240043b0 0x7fb8300e7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59930/0 (socket says 172.21.15.50:59930) 2023-11-28T11:54:22.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83ddc5700 1 -- 172.21.15.50:0/1806288207 learned_addr learned my addr 172.21.15.50:0/1806288207 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:22.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83e5c6700 1 --2- 172.21.15.50:0/1806288207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8300cf390 0x7fb8300db7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83d5c4700 1 --2- 172.21.15.50:0/1806288207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8300e7770 0x7fb8300cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83ddc5700 1 -- 172.21.15.50:0/1806288207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8300e7770 msgr2=0x7fb8300cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83ddc5700 1 --2- 172.21.15.50:0/1806288207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8300e7770 0x7fb8300cee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83ddc5700 1 -- 172.21.15.50:0/1806288207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8300cf390 msgr2=0x7fb8300db7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83ddc5700 1 --2- 172.21.15.50:0/1806288207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8300cf390 0x7fb8300db7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83ddc5700 1 -- 172.21.15.50:0/1806288207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb830034040 con 0x7fb8240043b0 2023-11-28T11:54:22.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83ddc5700 1 --2- 172.21.15.50:0/1806288207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8240043b0 0x7fb8300e7230 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb834010c00 tx=0x7fb834009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:22.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb82e7fc700 1 -- 172.21.15.50:0/1806288207 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83400eb90 con 0x7fb8240043b0 2023-11-28T11:54:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83edc7700 1 -- 172.21.15.50:0/1806288207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb830033d60 con 0x7fb8240043b0 2023-11-28T11:54:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83edc7700 1 -- 172.21.15.50:0/1806288207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb830034320 con 0x7fb8240043b0 2023-11-28T11:54:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb82e7fc700 1 -- 172.21.15.50:0/1806288207 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83400ecf0 con 0x7fb8240043b0 2023-11-28T11:54:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb82e7fc700 1 -- 172.21.15.50:0/1806288207 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb834005c40 con 0x7fb8240043b0 2023-11-28T11:54:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb83edc7700 1 -- 172.21.15.50:0/1806288207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb820005310 con 0x7fb8240043b0 2023-11-28T11:54:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.720+0000 7fb82e7fc700 1 -- 172.21.15.50:0/1806288207 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb834012040 con 0x7fb8240043b0 2023-11-28T11:54:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.724+0000 7fb82e7fc700 1 --2- 172.21.15.50:0/1806288207 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb81c064ee0 0x7fb81c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.724+0000 7fb82e7fc700 1 -- 172.21.15.50:0/1806288207 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb834082730 con 0x7fb8240043b0 2023-11-28T11:54:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.724+0000 7fb83d5c4700 1 --2- 172.21.15.50:0/1806288207 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb81c064ee0 0x7fb81c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:22.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.724+0000 7fb83d5c4700 1 --2- 172.21.15.50:0/1806288207 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb81c064ee0 0x7fb81c067390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb8300e58e0 tx=0x7fb828008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:22.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.736+0000 7fb82e7fc700 1 -- 172.21.15.50:0/1806288207 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb8340504f0 con 0x7fb8240043b0 2023-11-28T11:54:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.892+0000 7fb83edc7700 1 -- 172.21.15.50:0/1806288207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb820005b40 con 0x7fb8240043b0 2023-11-28T11:54:22.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.892+0000 7fb82e7fc700 1 -- 172.21.15.50:0/1806288207 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb83400ee60 con 0x7fb8240043b0 2023-11-28T11:54:22.898 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:54:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.896+0000 7fb83edc7700 1 -- 172.21.15.50:0/1806288207 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb81c064ee0 msgr2=0x7fb81c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.896+0000 7fb83edc7700 1 --2- 172.21.15.50:0/1806288207 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb81c064ee0 0x7fb81c067390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb8300e58e0 tx=0x7fb828008030 comp rx=0 tx=0).stop 2023-11-28T11:54:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.896+0000 7fb83edc7700 1 -- 172.21.15.50:0/1806288207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8240043b0 msgr2=0x7fb8300e7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.896+0000 7fb83edc7700 1 --2- 172.21.15.50:0/1806288207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8240043b0 0x7fb8300e7230 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb834010c00 tx=0x7fb834009ed0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.896+0000 7fb83edc7700 1 -- 172.21.15.50:0/1806288207 shutdown_connections 2023-11-28T11:54:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.896+0000 7fb83edc7700 1 --2- 172.21.15.50:0/1806288207 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb81c064ee0 0x7fb81c067390 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.896+0000 7fb83edc7700 1 --2- 172.21.15.50:0/1806288207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8300cf390 0x7fb8300db7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.896+0000 7fb83edc7700 1 --2- 172.21.15.50:0/1806288207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8300e7770 0x7fb8300cee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.896+0000 7fb83edc7700 1 --2- 172.21.15.50:0/1806288207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8240043b0 0x7fb8300e7230 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.896+0000 7fb83edc7700 1 -- 172.21.15.50:0/1806288207 >> 172.21.15.50:0/1806288207 conn(0x7fb830051770 msgr2=0x7fb830051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.896+0000 7fb83edc7700 1 -- 172.21.15.50:0/1806288207 shutdown_connections 2023-11-28T11:54:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:22.896+0000 7fb83edc7700 1 -- 172.21.15.50:0/1806288207 wait complete. 2023-11-28T11:54:22.913 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:54:23.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.028+0000 7f6d09427700 1 Processor -- start 2023-11-28T11:54:23.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.028+0000 7f6d09427700 1 -- start start 2023-11-28T11:54:23.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.028+0000 7f6d09427700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d0406ce60 0x7f6d040d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:23.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.028+0000 7f6d09427700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6d040cf470 0x7f6d040cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:23.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.028+0000 7f6d09427700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d040cd2d0 con 0x7f6d040cce60 2023-11-28T11:54:23.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.028+0000 7f6d09427700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d0415c8b0 con 0x7f6d040cf470 2023-11-28T11:54:23.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.028+0000 7f6d09427700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0406a7f0 con 0x7f6d0406ce60 2023-11-28T11:54:23.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.028+0000 7f6d037fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6d040cce60 0x7f6d0406d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44280/0 (socket says 172.21.15.50:44280) 2023-11-28T11:54:23.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.028+0000 7f6d037fe700 1 -- 172.21.15.50:0/3956732125 learned_addr learned my addr 172.21.15.50:0/3956732125 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:23.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.028+0000 7f6d03fff700 1 --2- 172.21.15.50:0/3956732125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d0406ce60 0x7f6d040d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:23.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.028+0000 7f6d08c26700 1 --2- 172.21.15.50:0/3956732125 >> v2:172.21.15.192:3300/0 conn(0x7f6d040cf470 0x7f6d040cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:23.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.028+0000 7f6d02ffd700 1 -- 172.21.15.50:0/3956732125 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287725119 0 0) 0x7f6d040cd2d0 con 0x7f6d040cce60 2023-11-28T11:54:23.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.028+0000 7f6d02ffd700 1 -- 172.21.15.50:0/3956732125 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cf00035d0 con 0x7f6d040cce60 2023-11-28T11:54:23.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.028+0000 7f6d03fff700 1 -- 172.21.15.50:0/3956732125 >> v2:172.21.15.192:3300/0 conn(0x7f6d040cf470 msgr2=0x7f6d040cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:23.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.028+0000 7f6d03fff700 1 --2- 172.21.15.50:0/3956732125 >> v2:172.21.15.192:3300/0 conn(0x7f6d040cf470 0x7f6d040cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.028+0000 7f6d03fff700 1 -- 172.21.15.50:0/3956732125 >> v1:172.21.15.50:6789/0 conn(0x7f6d040cce60 legacy=0x7f6d0406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.028+0000 7f6d03fff700 1 -- 172.21.15.50:0/3956732125 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0406aad0 con 0x7f6d0406ce60 2023-11-28T11:54:23.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.032+0000 7f6d03fff700 1 --2- 172.21.15.50:0/3956732125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d0406ce60 0x7f6d040d31b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009850 tx=0x7f6cf4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b91e5ba48bae7620 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:23.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.032+0000 7f6d02ffd700 1 -- 172.21.15.50:0/3956732125 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4011830 con 0x7f6d0406ce60 2023-11-28T11:54:23.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.032+0000 7f6d02ffd700 1 -- 172.21.15.50:0/3956732125 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf4011990 con 0x7f6d0406ce60 2023-11-28T11:54:23.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.032+0000 7f6d02ffd700 1 -- 172.21.15.50:0/3956732125 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4011d40 con 0x7f6d0406ce60 2023-11-28T11:54:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.032+0000 7f6d09427700 1 -- 172.21.15.50:0/3956732125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d0406ce60 msgr2=0x7f6d040d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.032+0000 7f6d09427700 1 --2- 172.21.15.50:0/3956732125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d0406ce60 0x7f6d040d31b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009850 tx=0x7f6cf4009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.032+0000 7f6d09427700 1 -- 172.21.15.50:0/3956732125 shutdown_connections 2023-11-28T11:54:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.032+0000 7f6d09427700 1 --2- 172.21.15.50:0/3956732125 >> v2:172.21.15.192:3300/0 conn(0x7f6d040cf470 0x7f6d040cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.032+0000 7f6d09427700 1 --2- 172.21.15.50:0/3956732125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d0406ce60 0x7f6d040d31b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.032+0000 7f6d09427700 1 -- 172.21.15.50:0/3956732125 >> 172.21.15.50:0/3956732125 conn(0x7f6d040b5760 msgr2=0x7f6d040b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.032+0000 7f6d09427700 1 -- 172.21.15.50:0/3956732125 shutdown_connections 2023-11-28T11:54:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.032+0000 7f6d09427700 1 -- 172.21.15.50:0/3956732125 wait complete. 2023-11-28T11:54:23.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d09427700 1 Processor -- start 2023-11-28T11:54:23.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d09427700 1 -- start start 2023-11-28T11:54:23.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d09427700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d0406ce60 0x7f6d04159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:23.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d09427700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d040cce60 0x7f6d040b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:23.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d09427700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d040cf470 0x7f6d04158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:23.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d09427700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0415a400 con 0x7f6d040cce60 2023-11-28T11:54:23.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d09427700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040b3450 con 0x7f6d0406ce60 2023-11-28T11:54:23.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d09427700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040b3730 con 0x7f6d040cf470 2023-11-28T11:54:23.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d037fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d040cce60 0x7f6d040b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:23.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d037fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d040cce60 0x7f6d040b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59942/0 (socket says 172.21.15.50:59942) 2023-11-28T11:54:23.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d037fe700 1 -- 172.21.15.50:0/1896759606 learned_addr learned my addr 172.21.15.50:0/1896759606 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:23.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d03fff700 1 --2- 172.21.15.50:0/1896759606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d0406ce60 0x7f6d04159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:23.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d08c26700 1 --2- 172.21.15.50:0/1896759606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d040cf470 0x7f6d04158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:23.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d037fe700 1 -- 172.21.15.50:0/1896759606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d040cf470 msgr2=0x7f6d04158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d037fe700 1 --2- 172.21.15.50:0/1896759606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d040cf470 0x7f6d04158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d037fe700 1 -- 172.21.15.50:0/1896759606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d0406ce60 msgr2=0x7f6d04159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d037fe700 1 --2- 172.21.15.50:0/1896759606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d0406ce60 0x7f6d04159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d037fe700 1 -- 172.21.15.50:0/1896759606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf40094b0 con 0x7f6d040cce60 2023-11-28T11:54:23.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d037fe700 1 --2- 172.21.15.50:0/1896759606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d040cce60 0x7f6d040b4210 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00c4d0 tx=0x7f6cec00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:23.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d00ff9700 1 -- 172.21.15.50:0/1896759606 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec005d90 con 0x7f6d040cce60 2023-11-28T11:54:23.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d00ff9700 1 -- 172.21.15.50:0/1896759606 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec0070d0 con 0x7f6d040cce60 2023-11-28T11:54:23.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d09427700 1 -- 172.21.15.50:0/1896759606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0406b090 con 0x7f6d040cce60 2023-11-28T11:54:23.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d00ff9700 1 -- 172.21.15.50:0/1896759606 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec007480 con 0x7f6d040cce60 2023-11-28T11:54:23.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.036+0000 7f6d09427700 1 -- 172.21.15.50:0/1896759606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0406adb0 con 0x7f6d040cce60 2023-11-28T11:54:23.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.040+0000 7f6d09427700 1 -- 172.21.15.50:0/1896759606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d040b6470 con 0x7f6d040cce60 2023-11-28T11:54:23.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.040+0000 7f6d00ff9700 1 -- 172.21.15.50:0/1896759606 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6cec019030 con 0x7f6d040cce60 2023-11-28T11:54:23.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.040+0000 7f6d00ff9700 1 --2- 172.21.15.50:0/1896759606 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6ce4064ee0 0x7f6ce4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:23.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.040+0000 7f6d00ff9700 1 -- 172.21.15.50:0/1896759606 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6cec0814e0 con 0x7f6d040cce60 2023-11-28T11:54:23.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.040+0000 7f6d03fff700 1 --2- 172.21.15.50:0/1896759606 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6ce4064ee0 0x7f6ce4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:23.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.044+0000 7f6d03fff700 1 --2- 172.21.15.50:0/1896759606 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6ce4064ee0 0x7f6ce4067390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40090b0 tx=0x7f6cf4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:23.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.060+0000 7f6d00ff9700 1 -- 172.21.15.50:0/1896759606 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6cec04f310 con 0x7f6d040cce60 2023-11-28T11:54:23.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.220+0000 7f6d09427700 1 -- 172.21.15.50:0/1896759606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6d04072c20 con 0x7f6d040cce60 2023-11-28T11:54:23.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.220+0000 7f6d00ff9700 1 -- 172.21.15.50:0/1896759606 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6cec052930 con 0x7f6d040cce60 2023-11-28T11:54:23.225 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.224+0000 7f6d09427700 1 -- 172.21.15.50:0/1896759606 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6ce4064ee0 msgr2=0x7f6ce4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.224+0000 7f6d09427700 1 --2- 172.21.15.50:0/1896759606 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6ce4064ee0 0x7f6ce4067390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40090b0 tx=0x7f6cf4008030 comp rx=0 tx=0).stop 2023-11-28T11:54:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.224+0000 7f6d09427700 1 -- 172.21.15.50:0/1896759606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d040cce60 msgr2=0x7f6d040b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.224+0000 7f6d09427700 1 --2- 172.21.15.50:0/1896759606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d040cce60 0x7f6d040b4210 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00c4d0 tx=0x7f6cec00c7e0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.224+0000 7f6d09427700 1 -- 172.21.15.50:0/1896759606 shutdown_connections 2023-11-28T11:54:23.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.224+0000 7f6d09427700 1 --2- 172.21.15.50:0/1896759606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d040cf470 0x7f6d04158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.224+0000 7f6d09427700 1 --2- 172.21.15.50:0/1896759606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d040cce60 0x7f6d040b4210 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.224+0000 7f6d09427700 1 --2- 172.21.15.50:0/1896759606 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6ce4064ee0 0x7f6ce4067390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.224+0000 7f6d09427700 1 --2- 172.21.15.50:0/1896759606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d0406ce60 0x7f6d04159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.224+0000 7f6d09427700 1 -- 172.21.15.50:0/1896759606 >> 172.21.15.50:0/1896759606 conn(0x7f6d040b5760 msgr2=0x7f6d040d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:23.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.224+0000 7f6d09427700 1 -- 172.21.15.50:0/1896759606 shutdown_connections 2023-11-28T11:54:23.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.224+0000 7f6d09427700 1 -- 172.21.15.50:0/1896759606 wait complete. 2023-11-28T11:54:23.246 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:54:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f866b254700 1 Processor -- start 2023-11-28T11:54:23.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f866b254700 1 -- start start 2023-11-28T11:54:23.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f866b254700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f866406a4c0 0x7f866406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:23.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f866b254700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f86640cf0e0 0x7f86640cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:23.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f866b254700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86640cfa80 con 0x7f86640b1ae0 2023-11-28T11:54:23.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f866b254700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86640d0ab0 con 0x7f86640cf0e0 2023-11-28T11:54:23.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f866b254700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866406a9c0 con 0x7f866406a4c0 2023-11-28T11:54:23.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f866a252700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f86640b1ae0 0x7f86640d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44292/0 (socket says 172.21.15.50:44292) 2023-11-28T11:54:23.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f866a252700 1 -- 172.21.15.50:0/1366028004 learned_addr learned my addr 172.21.15.50:0/1366028004 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:23.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f8669a51700 1 --2- 172.21.15.50:0/1366028004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f866406a4c0 0x7f866406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:23.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f866aa53700 1 --2- 172.21.15.50:0/1366028004 >> v2:172.21.15.192:3300/0 conn(0x7f86640cf0e0 0x7f86640cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f8669250700 1 -- 172.21.15.50:0/1366028004 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745792238 0 0) 0x7f86640cfa80 con 0x7f86640b1ae0 2023-11-28T11:54:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f8669250700 1 -- 172.21.15.50:0/1366028004 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86500035d0 con 0x7f86640b1ae0 2023-11-28T11:54:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f8669a51700 1 -- 172.21.15.50:0/1366028004 >> v2:172.21.15.192:3300/0 conn(0x7f86640cf0e0 msgr2=0x7f86640cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f8669a51700 1 --2- 172.21.15.50:0/1366028004 >> v2:172.21.15.192:3300/0 conn(0x7f86640cf0e0 0x7f86640cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f8669a51700 1 -- 172.21.15.50:0/1366028004 >> v1:172.21.15.50:6789/0 conn(0x7f86640b1ae0 legacy=0x7f86640d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f8669250700 1 -- 172.21.15.50:0/1366028004 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3034363505 0 0) 0x7f86500035d0 con 0x7f86640b1ae0 2023-11-28T11:54:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.360+0000 7f8669a51700 1 -- 172.21.15.50:0/1366028004 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866406aca0 con 0x7f866406a4c0 2023-11-28T11:54:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.364+0000 7f8669a51700 1 --2- 172.21.15.50:0/1366028004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f866406a4c0 0x7f866406d8e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8654009850 tx=0x7f8654009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f74a82aa1c6a92ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.364+0000 7f8669250700 1 -- 172.21.15.50:0/1366028004 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660001670 con 0x7f866406a4c0 2023-11-28T11:54:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.364+0000 7f8669250700 1 -- 172.21.15.50:0/1366028004 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8654004030 con 0x7f866406a4c0 2023-11-28T11:54:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.364+0000 7f8669250700 1 -- 172.21.15.50:0/1366028004 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86540043a0 con 0x7f866406a4c0 2023-11-28T11:54:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.364+0000 7f866b254700 1 -- 172.21.15.50:0/1366028004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f866406a4c0 msgr2=0x7f866406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.364+0000 7f866b254700 1 --2- 172.21.15.50:0/1366028004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f866406a4c0 0x7f866406d8e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8654009850 tx=0x7f8654009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.364+0000 7f866b254700 1 -- 172.21.15.50:0/1366028004 shutdown_connections 2023-11-28T11:54:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.364+0000 7f866b254700 1 --2- 172.21.15.50:0/1366028004 >> v2:172.21.15.192:3300/0 conn(0x7f86640cf0e0 0x7f86640cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.364+0000 7f866b254700 1 --2- 172.21.15.50:0/1366028004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f866406a4c0 0x7f866406d8e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.364+0000 7f866b254700 1 -- 172.21.15.50:0/1366028004 >> 172.21.15.50:0/1366028004 conn(0x7f866409bbd0 msgr2=0x7f86640b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.364+0000 7f866b254700 1 -- 172.21.15.50:0/1366028004 shutdown_connections 2023-11-28T11:54:23.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.364+0000 7f866b254700 1 -- 172.21.15.50:0/1366028004 wait complete. 2023-11-28T11:54:23.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866b254700 1 Processor -- start 2023-11-28T11:54:23.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866b254700 1 -- start start 2023-11-28T11:54:23.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866b254700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866406a4c0 0x7f86641f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:23.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866b254700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86640b1ae0 0x7f8664155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866b254700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86640cf0e0 0x7f86640affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866b254700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86641f6170 con 0x7f866406a4c0 2023-11-28T11:54:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866b254700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86640c65a0 con 0x7f86640cf0e0 2023-11-28T11:54:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866b254700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86640c8930 con 0x7f86640b1ae0 2023-11-28T11:54:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866a252700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866406a4c0 0x7f86641f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866a252700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866406a4c0 0x7f86641f5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59950/0 (socket says 172.21.15.50:59950) 2023-11-28T11:54:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866a252700 1 -- 172.21.15.50:0/2865286113 learned_addr learned my addr 172.21.15.50:0/2865286113 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f8669a51700 1 --2- 172.21.15.50:0/2865286113 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86640b1ae0 0x7f8664155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866aa53700 1 --2- 172.21.15.50:0/2865286113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86640cf0e0 0x7f86640affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866a252700 1 -- 172.21.15.50:0/2865286113 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86640b1ae0 msgr2=0x7f8664155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866a252700 1 --2- 172.21.15.50:0/2865286113 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86640b1ae0 0x7f8664155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866a252700 1 -- 172.21.15.50:0/2865286113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86640cf0e0 msgr2=0x7f86640affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866a252700 1 --2- 172.21.15.50:0/2865286113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86640cf0e0 0x7f86640affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866a252700 1 -- 172.21.15.50:0/2865286113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86540094b0 con 0x7f866406a4c0 2023-11-28T11:54:23.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f8669a51700 1 --2- 172.21.15.50:0/2865286113 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86640b1ae0 0x7f8664155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:23.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866a252700 1 --2- 172.21.15.50:0/2865286113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866406a4c0 0x7f86641f5c30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f866000c540 tx=0x7f866000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:23.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f865affd700 1 -- 172.21.15.50:0/2865286113 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660004ca0 con 0x7f866406a4c0 2023-11-28T11:54:23.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f865affd700 1 -- 172.21.15.50:0/2865286113 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8660004e00 con 0x7f866406a4c0 2023-11-28T11:54:23.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866b254700 1 -- 172.21.15.50:0/2865286113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86640b4380 con 0x7f866406a4c0 2023-11-28T11:54:23.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f865affd700 1 -- 172.21.15.50:0/2865286113 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660007310 con 0x7f866406a4c0 2023-11-28T11:54:23.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.368+0000 7f866b254700 1 -- 172.21.15.50:0/2865286113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866406af80 con 0x7f866406a4c0 2023-11-28T11:54:23.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.372+0000 7f866b254700 1 -- 172.21.15.50:0/2865286113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86640b1eb0 con 0x7f866406a4c0 2023-11-28T11:54:23.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.372+0000 7f865affd700 1 -- 172.21.15.50:0/2865286113 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f866001a020 con 0x7f866406a4c0 2023-11-28T11:54:23.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.372+0000 7f865affd700 1 --2- 172.21.15.50:0/2865286113 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8648064ee0 0x7f8648067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:23.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.372+0000 7f865affd700 1 -- 172.21.15.50:0/2865286113 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8660081e90 con 0x7f866406a4c0 2023-11-28T11:54:23.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.372+0000 7f8669a51700 1 --2- 172.21.15.50:0/2865286113 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8648064ee0 0x7f8648067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:23.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.376+0000 7f8669a51700 1 --2- 172.21.15.50:0/2865286113 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8648064ee0 0x7f8648067390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f866406a8f0 tx=0x7f8654013040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.384+0000 7f865affd700 1 -- 172.21.15.50:0/2865286113 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f866004fd40 con 0x7f866406a4c0 2023-11-28T11:54:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.544+0000 7f866b254700 1 -- 172.21.15.50:0/2865286113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f86640b5dc0 con 0x7f866406a4c0 2023-11-28T11:54:23.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.544+0000 7f865affd700 1 -- 172.21.15.50:0/2865286113 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8660053360 con 0x7f866406a4c0 2023-11-28T11:54:23.551 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:54:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.548+0000 7f866b254700 1 -- 172.21.15.50:0/2865286113 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8648064ee0 msgr2=0x7f8648067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.548+0000 7f866b254700 1 --2- 172.21.15.50:0/2865286113 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8648064ee0 0x7f8648067390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f866406a8f0 tx=0x7f8654013040 comp rx=0 tx=0).stop 2023-11-28T11:54:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.548+0000 7f866b254700 1 -- 172.21.15.50:0/2865286113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866406a4c0 msgr2=0x7f86641f5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.548+0000 7f866b254700 1 --2- 172.21.15.50:0/2865286113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866406a4c0 0x7f86641f5c30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f866000c540 tx=0x7f866000c900 comp rx=0 tx=0).stop 2023-11-28T11:54:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.548+0000 7f866b254700 1 -- 172.21.15.50:0/2865286113 shutdown_connections 2023-11-28T11:54:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.548+0000 7f866b254700 1 --2- 172.21.15.50:0/2865286113 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8648064ee0 0x7f8648067390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.548+0000 7f866b254700 1 --2- 172.21.15.50:0/2865286113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86640cf0e0 0x7f86640affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.548+0000 7f866b254700 1 --2- 172.21.15.50:0/2865286113 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86640b1ae0 0x7f8664155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.548+0000 7f866b254700 1 --2- 172.21.15.50:0/2865286113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f866406a4c0 0x7f86641f5c30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.552+0000 7f866b254700 1 -- 172.21.15.50:0/2865286113 >> 172.21.15.50:0/2865286113 conn(0x7f866409bbd0 msgr2=0x7f866406d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:23.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.552+0000 7f866b254700 1 -- 172.21.15.50:0/2865286113 shutdown_connections 2023-11-28T11:54:23.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.552+0000 7f866b254700 1 -- 172.21.15.50:0/2865286113 wait complete. 2023-11-28T11:54:23.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:54:23.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b64f59700 1 Processor -- start 2023-11-28T11:54:23.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b64f59700 1 -- start start 2023-11-28T11:54:23.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b64f59700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0b6015bb80 0x7f0b600b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:23.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b64f59700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b600ccd00 con 0x7f0b600aaf40 2023-11-28T11:54:23.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b64f59700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b600b19b0 con 0x7f0b6006b370 2023-11-28T11:54:23.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b64f59700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b600cd510 con 0x7f0b6015bb80 2023-11-28T11:54:23.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b5effd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0b600aaf40 0x7f0b600b2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44308/0 (socket says 172.21.15.50:44308) 2023-11-28T11:54:23.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b5effd700 1 -- 172.21.15.50:0/2887347435 learned_addr learned my addr 172.21.15.50:0/2887347435 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:23.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b5f7fe700 1 --2- 172.21.15.50:0/2887347435 >> v2:172.21.15.192:3300/0 conn(0x7f0b6015bb80 0x7f0b600b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:23.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b5e7fc700 1 -- 172.21.15.50:0/2887347435 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264286165 0 0) 0x7f0b600ccd00 con 0x7f0b600aaf40 2023-11-28T11:54:23.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b5e7fc700 1 -- 172.21.15.50:0/2887347435 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b480035d0 con 0x7f0b600aaf40 2023-11-28T11:54:23.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b5f7fe700 1 -- 172.21.15.50:0/2887347435 >> v1:172.21.15.192:6789/0 conn(0x7f0b6006b370 legacy=0x7f0b6015c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b5f7fe700 1 -- 172.21.15.50:0/2887347435 >> v1:172.21.15.50:6789/0 conn(0x7f0b600aaf40 legacy=0x7f0b600b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b5f7fe700 1 -- 172.21.15.50:0/2887347435 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b600ccf50 con 0x7f0b6015bb80 2023-11-28T11:54:23.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b5f7fe700 1 --2- 172.21.15.50:0/2887347435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6015bb80 0x7f0b600b2450 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009850 tx=0x7f0b50009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1870fc3161b69588 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:23.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b5e7fc700 1 -- 172.21.15.50:0/2887347435 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50010800 con 0x7f0b6015bb80 2023-11-28T11:54:23.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b5e7fc700 1 -- 172.21.15.50:0/2887347435 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b50010960 con 0x7f0b6015bb80 2023-11-28T11:54:23.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b5e7fc700 1 -- 172.21.15.50:0/2887347435 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50010d10 con 0x7f0b6015bb80 2023-11-28T11:54:23.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b64f59700 1 -- 172.21.15.50:0/2887347435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6015bb80 msgr2=0x7f0b600b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b64f59700 1 --2- 172.21.15.50:0/2887347435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6015bb80 0x7f0b600b2450 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009850 tx=0x7f0b50009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:23.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b64f59700 1 -- 172.21.15.50:0/2887347435 shutdown_connections 2023-11-28T11:54:23.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b64f59700 1 --2- 172.21.15.50:0/2887347435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6015bb80 0x7f0b600b2450 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b64f59700 1 -- 172.21.15.50:0/2887347435 >> 172.21.15.50:0/2887347435 conn(0x7f0b600cae70 msgr2=0x7f0b600cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:23.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b64f59700 1 -- 172.21.15.50:0/2887347435 shutdown_connections 2023-11-28T11:54:23.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b64f59700 1 -- 172.21.15.50:0/2887347435 wait complete. 2023-11-28T11:54:23.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.688+0000 7f0b64f59700 1 Processor -- start 2023-11-28T11:54:23.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b64f59700 1 -- start start 2023-11-28T11:54:23.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b64f59700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6006b370 0x7f0b600c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:23.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b64f59700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b600aaf40 0x7f0b601e32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:23.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b64f59700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b6015bb80 0x7f0b6014f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:23.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b64f59700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6009c090 con 0x7f0b6015bb80 2023-11-28T11:54:23.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b64f59700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6009b480 con 0x7f0b6006b370 2023-11-28T11:54:23.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b64f59700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6009b760 con 0x7f0b600aaf40 2023-11-28T11:54:23.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b5ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b6015bb80 0x7f0b6014f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:23.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b5ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b6015bb80 0x7f0b6014f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59962/0 (socket says 172.21.15.50:59962) 2023-11-28T11:54:23.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b5ffff700 1 -- 172.21.15.50:0/4058221127 learned_addr learned my addr 172.21.15.50:0/4058221127 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:23.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b5f7fe700 1 --2- 172.21.15.50:0/4058221127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6006b370 0x7f0b600c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:23.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b5effd700 1 --2- 172.21.15.50:0/4058221127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b600aaf40 0x7f0b601e32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:23.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b5ffff700 1 -- 172.21.15.50:0/4058221127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b600aaf40 msgr2=0x7f0b601e32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b5ffff700 1 --2- 172.21.15.50:0/4058221127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b600aaf40 0x7f0b601e32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b5ffff700 1 -- 172.21.15.50:0/4058221127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6006b370 msgr2=0x7f0b600c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b5ffff700 1 --2- 172.21.15.50:0/4058221127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6006b370 0x7f0b600c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b5ffff700 1 -- 172.21.15.50:0/4058221127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b500094b0 con 0x7f0b6015bb80 2023-11-28T11:54:23.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b5effd700 1 --2- 172.21.15.50:0/4058221127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b600aaf40 0x7f0b601e32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:23.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b5ffff700 1 --2- 172.21.15.50:0/4058221127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b6015bb80 0x7f0b6014f490 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800cb50 tx=0x7f0b5800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:23.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b47fff700 1 -- 172.21.15.50:0/4058221127 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58003c20 con 0x7f0b6015bb80 2023-11-28T11:54:23.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b47fff700 1 -- 172.21.15.50:0/4058221127 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b58003d80 con 0x7f0b6015bb80 2023-11-28T11:54:23.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b64f59700 1 -- 172.21.15.50:0/4058221127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b600b1c50 con 0x7f0b6015bb80 2023-11-28T11:54:23.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b47fff700 1 -- 172.21.15.50:0/4058221127 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800aac0 con 0x7f0b6015bb80 2023-11-28T11:54:23.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.692+0000 7f0b64f59700 1 -- 172.21.15.50:0/4058221127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b600cd230 con 0x7f0b6015bb80 2023-11-28T11:54:23.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.696+0000 7f0b64f59700 1 -- 172.21.15.50:0/4058221127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b600b1f30 con 0x7f0b6015bb80 2023-11-28T11:54:23.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.696+0000 7f0b47fff700 1 -- 172.21.15.50:0/4058221127 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0b58010050 con 0x7f0b6015bb80 2023-11-28T11:54:23.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.696+0000 7f0b47fff700 1 --2- 172.21.15.50:0/4058221127 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0b4c064ee0 0x7f0b4c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:23.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.696+0000 7f0b47fff700 1 -- 172.21.15.50:0/4058221127 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0b58082010 con 0x7f0b6015bb80 2023-11-28T11:54:23.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.696+0000 7f0b5f7fe700 1 --2- 172.21.15.50:0/4058221127 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0b4c064ee0 0x7f0b4c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:23.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.700+0000 7f0b5f7fe700 1 --2- 172.21.15.50:0/4058221127 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0b4c064ee0 0x7f0b4c067390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0b500090b0 tx=0x7f0b5001b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:23.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.704+0000 7f0b47fff700 1 -- 172.21.15.50:0/4058221127 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0b5804fec0 con 0x7f0b6015bb80 2023-11-28T11:54:23.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.872+0000 7f0b64f59700 1 -- 172.21.15.50:0/4058221127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0b600c8890 con 0x7f0b6015bb80 2023-11-28T11:54:23.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.872+0000 7f0b47fff700 1 -- 172.21.15.50:0/4058221127 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0b580534e0 con 0x7f0b6015bb80 2023-11-28T11:54:23.874 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:23.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.876+0000 7f0b64f59700 1 -- 172.21.15.50:0/4058221127 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0b4c064ee0 msgr2=0x7f0b4c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.876+0000 7f0b64f59700 1 --2- 172.21.15.50:0/4058221127 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0b4c064ee0 0x7f0b4c067390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0b500090b0 tx=0x7f0b5001b040 comp rx=0 tx=0).stop 2023-11-28T11:54:23.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.876+0000 7f0b64f59700 1 -- 172.21.15.50:0/4058221127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b6015bb80 msgr2=0x7f0b6014f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:23.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.876+0000 7f0b64f59700 1 --2- 172.21.15.50:0/4058221127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b6015bb80 0x7f0b6014f490 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800cb50 tx=0x7f0b5800ce60 comp rx=0 tx=0).stop 2023-11-28T11:54:23.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.876+0000 7f0b64f59700 1 -- 172.21.15.50:0/4058221127 shutdown_connections 2023-11-28T11:54:23.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.876+0000 7f0b64f59700 1 --2- 172.21.15.50:0/4058221127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b6015bb80 0x7f0b6014f490 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.876+0000 7f0b64f59700 1 --2- 172.21.15.50:0/4058221127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b600aaf40 0x7f0b601e32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.876+0000 7f0b64f59700 1 --2- 172.21.15.50:0/4058221127 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0b4c064ee0 0x7f0b4c067390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.876+0000 7f0b64f59700 1 --2- 172.21.15.50:0/4058221127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6006b370 0x7f0b600c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:23.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.876+0000 7f0b64f59700 1 -- 172.21.15.50:0/4058221127 >> 172.21.15.50:0/4058221127 conn(0x7f0b600cae70 msgr2=0x7f0b600ab400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:23.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.876+0000 7f0b64f59700 1 -- 172.21.15.50:0/4058221127 shutdown_connections 2023-11-28T11:54:23.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:23.876+0000 7f0b64f59700 1 -- 172.21.15.50:0/4058221127 wait complete. 2023-11-28T11:54:23.889 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:24.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c759e700 1 Processor -- start 2023-11-28T11:54:24.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c759e700 1 -- start start 2023-11-28T11:54:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c806d980 0x7f24c80cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24c806cc50 0x7f24c806d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c759e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c80cf180 con 0x7f24c80b1e60 2023-11-28T11:54:24.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c80cf460 con 0x7f24c806cc50 2023-11-28T11:54:24.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c80cf740 con 0x7f24c806d980 2023-11-28T11:54:24.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c6d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24c806cc50 0x7f24c806d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c6d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24c806cc50 0x7f24c806d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59964/0 (socket says 172.21.15.50:59964) 2023-11-28T11:54:24.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c6d9d700 1 -- 172.21.15.50:0/2196372139 learned_addr learned my addr 172.21.15.50:0/2196372139 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:24.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c5d9b700 1 --2- 172.21.15.50:0/2196372139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c806d980 0x7f24c80cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c6d9d700 1 -- 172.21.15.50:0/2196372139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c806d980 msgr2=0x7f24c80cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c6d9d700 1 --2- 172.21.15.50:0/2196372139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c806d980 0x7f24c80cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c6d9d700 1 -- 172.21.15.50:0/2196372139 >> v1:172.21.15.192:6789/0 conn(0x7f24c80b1e60 legacy=0x7f24c806ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c6d9d700 1 -- 172.21.15.50:0/2196372139 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c80cfa20 con 0x7f24c806cc50 2023-11-28T11:54:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c6d9d700 1 --2- 172.21.15.50:0/2196372139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24c806cc50 0x7f24c806d0d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009910 tx=0x7f24b8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e875423832cb8cc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:24.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c559a700 1 -- 172.21.15.50:0/2196372139 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b800ba60 con 0x7f24c806cc50 2023-11-28T11:54:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c559a700 1 -- 172.21.15.50:0/2196372139 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b800bbc0 con 0x7f24c806cc50 2023-11-28T11:54:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c559a700 1 -- 172.21.15.50:0/2196372139 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8009e60 con 0x7f24c806cc50 2023-11-28T11:54:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c759e700 1 -- 172.21.15.50:0/2196372139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24c806cc50 msgr2=0x7f24c806d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.000+0000 7f24c759e700 1 --2- 172.21.15.50:0/2196372139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24c806cc50 0x7f24c806d0d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009910 tx=0x7f24b8009c20 comp rx=0 tx=0).stop 2023-11-28T11:54:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c759e700 1 -- 172.21.15.50:0/2196372139 shutdown_connections 2023-11-28T11:54:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c759e700 1 --2- 172.21.15.50:0/2196372139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24c806cc50 0x7f24c806d0d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c759e700 1 --2- 172.21.15.50:0/2196372139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c806d980 0x7f24c80cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c759e700 1 -- 172.21.15.50:0/2196372139 >> 172.21.15.50:0/2196372139 conn(0x7f24c8089f70 msgr2=0x7f24c809bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c759e700 1 -- 172.21.15.50:0/2196372139 shutdown_connections 2023-11-28T11:54:24.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c759e700 1 -- 172.21.15.50:0/2196372139 wait complete. 2023-11-28T11:54:24.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c759e700 1 Processor -- start 2023-11-28T11:54:24.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c759e700 1 -- start start 2023-11-28T11:54:24.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c806cc50 0x7f24c815fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c80b1e60 0x7f24c80d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24c80d08f0 0x7f24c815de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c81f5e30 con 0x7f24c80d08f0 2023-11-28T11:54:24.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c759e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c80d2600 con 0x7f24c806cc50 2023-11-28T11:54:24.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c80d28e0 con 0x7f24c80b1e60 2023-11-28T11:54:24.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24c80d08f0 0x7f24c815de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24c80d08f0 0x7f24c815de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59976/0 (socket says 172.21.15.50:59976) 2023-11-28T11:54:24.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c6d9d700 1 -- 172.21.15.50:0/3935432095 learned_addr learned my addr 172.21.15.50:0/3935432095 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:24.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c659c700 1 --2- 172.21.15.50:0/3935432095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c806cc50 0x7f24c815fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.004+0000 7f24c5d9b700 1 --2- 172.21.15.50:0/3935432095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c80b1e60 0x7f24c80d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.008+0000 7f24c6d9d700 1 -- 172.21.15.50:0/3935432095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c80b1e60 msgr2=0x7f24c80d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.008+0000 7f24c6d9d700 1 --2- 172.21.15.50:0/3935432095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c80b1e60 0x7f24c80d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.008+0000 7f24c6d9d700 1 -- 172.21.15.50:0/3935432095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c806cc50 msgr2=0x7f24c815fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.008+0000 7f24c6d9d700 1 --2- 172.21.15.50:0/3935432095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c806cc50 0x7f24c815fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.008+0000 7f24c6d9d700 1 -- 172.21.15.50:0/3935432095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b8009570 con 0x7f24c80d08f0 2023-11-28T11:54:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.008+0000 7f24c659c700 1 --2- 172.21.15.50:0/3935432095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c806cc50 0x7f24c815fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.008+0000 7f24c6d9d700 1 --2- 172.21.15.50:0/3935432095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24c80d08f0 0x7f24c815de10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009c60 tx=0x7f24b8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.008+0000 7f24beffd700 1 -- 172.21.15.50:0/3935432095 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8004610 con 0x7f24c80d08f0 2023-11-28T11:54:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.008+0000 7f24beffd700 1 -- 172.21.15.50:0/3935432095 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b801e070 con 0x7f24c80d08f0 2023-11-28T11:54:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.008+0000 7f24beffd700 1 -- 172.21.15.50:0/3935432095 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b80038e0 con 0x7f24c80d08f0 2023-11-28T11:54:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.008+0000 7f24c759e700 1 -- 172.21.15.50:0/3935432095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c80cffe0 con 0x7f24c80d08f0 2023-11-28T11:54:24.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.008+0000 7f24c759e700 1 -- 172.21.15.50:0/3935432095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c80cfd00 con 0x7f24c80d08f0 2023-11-28T11:54:24.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.008+0000 7f24c759e700 1 -- 172.21.15.50:0/3935432095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c806d610 con 0x7f24c80d08f0 2023-11-28T11:54:24.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.008+0000 7f24beffd700 1 -- 172.21.15.50:0/3935432095 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f24b800f050 con 0x7f24c80d08f0 2023-11-28T11:54:24.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.012+0000 7f24beffd700 1 --2- 172.21.15.50:0/3935432095 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f24a8064ee0 0x7f24a8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.012+0000 7f24beffd700 1 -- 172.21.15.50:0/3935432095 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f24b8020070 con 0x7f24c80d08f0 2023-11-28T11:54:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.012+0000 7f24c659c700 1 --2- 172.21.15.50:0/3935432095 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f24a8064ee0 0x7f24a8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.012+0000 7f24c659c700 1 --2- 172.21.15.50:0/3935432095 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f24a8064ee0 0x7f24a8067390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f24c00012e0 tx=0x7f24c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:24.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.016+0000 7f24beffd700 1 -- 172.21.15.50:0/3935432095 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f24b8051510 con 0x7f24c80d08f0 2023-11-28T11:54:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.176+0000 7f24c759e700 1 -- 172.21.15.50:0/3935432095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24c808ba30 con 0x7f24c80d08f0 2023-11-28T11:54:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.180+0000 7f24beffd700 1 -- 172.21.15.50:0/3935432095 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f24b8015090 con 0x7f24c80d08f0 2023-11-28T11:54:24.181 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:24.181 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:45.231747+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.180+0000 7f24c759e700 1 -- 172.21.15.50:0/3935432095 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f24a8064ee0 msgr2=0x7f24a8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.180+0000 7f24c759e700 1 --2- 172.21.15.50:0/3935432095 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f24a8064ee0 0x7f24a8067390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f24c00012e0 tx=0x7f24c0009040 comp rx=0 tx=0).stop 2023-11-28T11:54:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.180+0000 7f24c759e700 1 -- 172.21.15.50:0/3935432095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24c80d08f0 msgr2=0x7f24c815de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.180+0000 7f24c759e700 1 --2- 172.21.15.50:0/3935432095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24c80d08f0 0x7f24c815de10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009c60 tx=0x7f24b8004770 comp rx=0 tx=0).stop 2023-11-28T11:54:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.180+0000 7f24c759e700 1 -- 172.21.15.50:0/3935432095 shutdown_connections 2023-11-28T11:54:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.180+0000 7f24c759e700 1 --2- 172.21.15.50:0/3935432095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24c80d08f0 0x7f24c815de10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.180+0000 7f24c759e700 1 --2- 172.21.15.50:0/3935432095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c80b1e60 0x7f24c80d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.180+0000 7f24c759e700 1 --2- 172.21.15.50:0/3935432095 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f24a8064ee0 0x7f24a8067390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.180+0000 7f24c759e700 1 --2- 172.21.15.50:0/3935432095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c806cc50 0x7f24c815fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.180+0000 7f24c759e700 1 -- 172.21.15.50:0/3935432095 >> 172.21.15.50:0/3935432095 conn(0x7f24c8089f70 msgr2=0x7f24c815ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.184+0000 7f24c759e700 1 -- 172.21.15.50:0/3935432095 shutdown_connections 2023-11-28T11:54:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.184+0000 7f24c759e700 1 -- 172.21.15.50:0/3935432095 wait complete. 2023-11-28T11:54:24.197 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:53:38.462826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:53:39.778621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:53:42.870360+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:54:24.198 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:54:24.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.316+0000 7fa9619ab700 1 Processor -- start 2023-11-28T11:54:24.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.316+0000 7fa9619ab700 1 -- start start 2023-11-28T11:54:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.316+0000 7fa9619ab700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa95c0b1ae0 0x7fa95c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.316+0000 7fa9619ab700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa95c0cf0e0 0x7fa95c0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.316+0000 7fa9619ab700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa95c0cfa80 con 0x7fa95c06a4c0 2023-11-28T11:54:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.316+0000 7fa9619ab700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa95c0d0ab0 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.316+0000 7fa9619ab700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c06a9c0 con 0x7fa95c0b1ae0 2023-11-28T11:54:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa9611aa700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa95c0cf0e0 0x7fa95c0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa95bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa95c06a4c0 0x7fa95c0d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44324/0 (socket says 172.21.15.50:44324) 2023-11-28T11:54:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa95bfff700 1 -- 172.21.15.50:0/792104733 learned_addr learned my addr 172.21.15.50:0/792104733 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa9609a9700 1 --2- 172.21.15.50:0/792104733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa95c0b1ae0 0x7fa95c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa9611aa700 1 -- 172.21.15.50:0/792104733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa95c0b1ae0 msgr2=0x7fa95c06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa9611aa700 1 --2- 172.21.15.50:0/792104733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa95c0b1ae0 0x7fa95c06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa9611aa700 1 -- 172.21.15.50:0/792104733 >> v1:172.21.15.50:6789/0 conn(0x7fa95c06a4c0 legacy=0x7fa95c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa95b7fe700 1 -- 172.21.15.50:0/792104733 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469615383 0 0) 0x7fa95c0cfa80 con 0x7fa95c06a4c0 2023-11-28T11:54:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa9611aa700 1 -- 172.21.15.50:0/792104733 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95c06aca0 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa9611aa700 1 --2- 172.21.15.50:0/792104733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa95c0cf0e0 0x7fa95c0cf540 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa954009d90 tx=0x7fa95400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2edba007f276e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa95b7fe700 1 -- 172.21.15.50:0/792104733 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95400e070 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa95b7fe700 1 -- 172.21.15.50:0/792104733 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95400bb20 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa95b7fe700 1 -- 172.21.15.50:0/792104733 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954012430 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa9619ab700 1 -- 172.21.15.50:0/792104733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa95c0cf0e0 msgr2=0x7fa95c0cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa9619ab700 1 --2- 172.21.15.50:0/792104733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa95c0cf0e0 0x7fa95c0cf540 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa954009d90 tx=0x7fa95400b330 comp rx=0 tx=0).stop 2023-11-28T11:54:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa9619ab700 1 -- 172.21.15.50:0/792104733 shutdown_connections 2023-11-28T11:54:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa9619ab700 1 --2- 172.21.15.50:0/792104733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa95c0cf0e0 0x7fa95c0cf540 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa9619ab700 1 --2- 172.21.15.50:0/792104733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa95c0b1ae0 0x7fa95c06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa9619ab700 1 -- 172.21.15.50:0/792104733 >> 172.21.15.50:0/792104733 conn(0x7fa95c09bbd0 msgr2=0x7fa95c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa9619ab700 1 -- 172.21.15.50:0/792104733 shutdown_connections 2023-11-28T11:54:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.320+0000 7fa9619ab700 1 -- 172.21.15.50:0/792104733 wait complete. 2023-11-28T11:54:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.324+0000 7fa9619ab700 1 Processor -- start 2023-11-28T11:54:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.324+0000 7fa9619ab700 1 -- start start 2023-11-28T11:54:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.324+0000 7fa9619ab700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa95c06a4c0 0x7fa95c15f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.324+0000 7fa9619ab700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa95c0b1ae0 0x7fa95c15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.324+0000 7fa9619ab700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa95c0cf0e0 0x7fa95c159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.324+0000 7fa9619ab700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c159e40 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.324+0000 7fa9619ab700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c15c6d0 con 0x7fa95c0b1ae0 2023-11-28T11:54:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.324+0000 7fa9619ab700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c15c9b0 con 0x7fa95c06a4c0 2023-11-28T11:54:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.324+0000 7fa9611aa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa95c0cf0e0 0x7fa95c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.324+0000 7fa9611aa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa95c0cf0e0 0x7fa95c159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60006/0 (socket says 172.21.15.50:60006) 2023-11-28T11:54:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.324+0000 7fa9611aa700 1 -- 172.21.15.50:0/892364984 learned_addr learned my addr 172.21.15.50:0/892364984 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.324+0000 7fa9609a9700 1 --2- 172.21.15.50:0/892364984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa95c06a4c0 0x7fa95c15f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.324+0000 7fa95bfff700 1 --2- 172.21.15.50:0/892364984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa95c0b1ae0 0x7fa95c15a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.328+0000 7fa9611aa700 1 -- 172.21.15.50:0/892364984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa95c06a4c0 msgr2=0x7fa95c15f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.328+0000 7fa9611aa700 1 --2- 172.21.15.50:0/892364984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa95c06a4c0 0x7fa95c15f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.328+0000 7fa9611aa700 1 -- 172.21.15.50:0/892364984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa95c0b1ae0 msgr2=0x7fa95c15a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.328+0000 7fa9611aa700 1 --2- 172.21.15.50:0/892364984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa95c0b1ae0 0x7fa95c15a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.328+0000 7fa9611aa700 1 -- 172.21.15.50:0/892364984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa954009a70 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.328+0000 7fa9611aa700 1 --2- 172.21.15.50:0/892364984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa95c0cf0e0 0x7fa95c159900 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa95400b680 tx=0x7fa954004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:24.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.328+0000 7fa9597fa700 1 -- 172.21.15.50:0/892364984 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954012430 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.328+0000 7fa9597fa700 1 -- 172.21.15.50:0/892364984 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa954020070 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.328+0000 7fa9619ab700 1 -- 172.21.15.50:0/892364984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa95c0b4380 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.328+0000 7fa9597fa700 1 -- 172.21.15.50:0/892364984 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954004280 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.328+0000 7fa9619ab700 1 -- 172.21.15.50:0/892364984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa95c06af80 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.328+0000 7fa9619ab700 1 -- 172.21.15.50:0/892364984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa95c0b1eb0 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.328+0000 7fa9597fa700 1 -- 172.21.15.50:0/892364984 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa95402e070 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.328+0000 7fa9597fa700 1 --2- 172.21.15.50:0/892364984 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa93c064ee0 0x7fa93c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.332+0000 7fa9597fa700 1 -- 172.21.15.50:0/892364984 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa954022070 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.332+0000 7fa9609a9700 1 --2- 172.21.15.50:0/892364984 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa93c064ee0 0x7fa93c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.332+0000 7fa9609a9700 1 --2- 172.21.15.50:0/892364984 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa93c064ee0 0x7fa93c067390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009bf0 tx=0x7fa94c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:24.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.336+0000 7fa9597fa700 1 -- 172.21.15.50:0/892364984 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa954089020 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.500+0000 7fa9619ab700 1 -- 172.21.15.50:0/892364984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa95c0c96b0 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.500+0000 7fa9597fa700 1 -- 172.21.15.50:0/892364984 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa95402c020 con 0x7fa95c0cf0e0 2023-11-28T11:54:24.503 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:54:24.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.504+0000 7fa9619ab700 1 -- 172.21.15.50:0/892364984 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa93c064ee0 msgr2=0x7fa93c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.504+0000 7fa9619ab700 1 --2- 172.21.15.50:0/892364984 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa93c064ee0 0x7fa93c067390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009bf0 tx=0x7fa94c009240 comp rx=0 tx=0).stop 2023-11-28T11:54:24.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.504+0000 7fa9619ab700 1 -- 172.21.15.50:0/892364984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa95c0cf0e0 msgr2=0x7fa95c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.504+0000 7fa9619ab700 1 --2- 172.21.15.50:0/892364984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa95c0cf0e0 0x7fa95c159900 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa95400b680 tx=0x7fa954004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.504+0000 7fa9619ab700 1 -- 172.21.15.50:0/892364984 shutdown_connections 2023-11-28T11:54:24.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.504+0000 7fa9619ab700 1 --2- 172.21.15.50:0/892364984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa95c0cf0e0 0x7fa95c159900 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.504+0000 7fa9619ab700 1 --2- 172.21.15.50:0/892364984 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa93c064ee0 0x7fa93c067390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.504+0000 7fa9619ab700 1 --2- 172.21.15.50:0/892364984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa95c0b1ae0 0x7fa95c15a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.504+0000 7fa9619ab700 1 --2- 172.21.15.50:0/892364984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa95c06a4c0 0x7fa95c15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.504+0000 7fa9619ab700 1 -- 172.21.15.50:0/892364984 >> 172.21.15.50:0/892364984 conn(0x7fa95c09bbd0 msgr2=0x7fa95c0d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:24.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.504+0000 7fa9619ab700 1 -- 172.21.15.50:0/892364984 shutdown_connections 2023-11-28T11:54:24.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.504+0000 7fa9619ab700 1 -- 172.21.15.50:0/892364984 wait complete. 2023-11-28T11:54:24.518 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:54:24.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.640+0000 7fee109cc700 1 Processor -- start 2023-11-28T11:54:24.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.640+0000 7fee109cc700 1 -- start start 2023-11-28T11:54:24.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.640+0000 7fee109cc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee0c160880 0x7fee0c06aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.640+0000 7fee109cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee0c0c1ad0 0x7fee0c1642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.640+0000 7fee109cc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0c160c50 con 0x7fee0c06b000 2023-11-28T11:54:24.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.640+0000 7fee109cc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0c06b450 con 0x7fee0c0c1ad0 2023-11-28T11:54:24.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.640+0000 7fee109cc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c0b3050 con 0x7fee0c160880 2023-11-28T11:54:24.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.640+0000 7fee0bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee0c0c1ad0 0x7fee0c1642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.640+0000 7fee0affd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fee0c06b000 0x7fee0c0c13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44334/0 (socket says 172.21.15.50:44334) 2023-11-28T11:54:24.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.640+0000 7fee0affd700 1 -- 172.21.15.50:0/818658571 learned_addr learned my addr 172.21.15.50:0/818658571 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:24.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.640+0000 7fee0b7fe700 1 --2- 172.21.15.50:0/818658571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee0c160880 0x7fee0c06aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.640+0000 7fee0a7fc700 1 -- 172.21.15.50:0/818658571 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205275564 0 0) 0x7fee0c160c50 con 0x7fee0c06b000 2023-11-28T11:54:24.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.640+0000 7fee0bfff700 1 -- 172.21.15.50:0/818658571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee0c160880 msgr2=0x7fee0c06aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:24.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.640+0000 7fee0bfff700 1 --2- 172.21.15.50:0/818658571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee0c160880 0x7fee0c06aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.640+0000 7fee0bfff700 1 -- 172.21.15.50:0/818658571 >> v1:172.21.15.50:6789/0 conn(0x7fee0c06b000 legacy=0x7fee0c0c13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.640+0000 7fee0bfff700 1 -- 172.21.15.50:0/818658571 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c06b630 con 0x7fee0c0c1ad0 2023-11-28T11:54:24.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.640+0000 7fee0bfff700 1 --2- 172.21.15.50:0/818658571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c0c1ad0 0x7fee0c1642e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fee04009850 tx=0x7fee04009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a8bc31b916c70f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:24.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.644+0000 7fee0a7fc700 1 -- 172.21.15.50:0/818658571 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04011830 con 0x7fee0c0c1ad0 2023-11-28T11:54:24.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.644+0000 7fee0a7fc700 1 -- 172.21.15.50:0/818658571 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee04011990 con 0x7fee0c0c1ad0 2023-11-28T11:54:24.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.644+0000 7fee0a7fc700 1 -- 172.21.15.50:0/818658571 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04011d20 con 0x7fee0c0c1ad0 2023-11-28T11:54:24.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.644+0000 7fee109cc700 1 -- 172.21.15.50:0/818658571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c0c1ad0 msgr2=0x7fee0c1642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.644+0000 7fee109cc700 1 --2- 172.21.15.50:0/818658571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c0c1ad0 0x7fee0c1642e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fee04009850 tx=0x7fee04009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:24.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.644+0000 7fee109cc700 1 -- 172.21.15.50:0/818658571 shutdown_connections 2023-11-28T11:54:24.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.644+0000 7fee109cc700 1 --2- 172.21.15.50:0/818658571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c0c1ad0 0x7fee0c1642e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.644+0000 7fee109cc700 1 --2- 172.21.15.50:0/818658571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee0c160880 0x7fee0c06aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.644+0000 7fee109cc700 1 -- 172.21.15.50:0/818658571 >> 172.21.15.50:0/818658571 conn(0x7fee0c0cae70 msgr2=0x7fee0c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:24.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.644+0000 7fee109cc700 1 -- 172.21.15.50:0/818658571 shutdown_connections 2023-11-28T11:54:24.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.644+0000 7fee109cc700 1 -- 172.21.15.50:0/818658571 wait complete. 2023-11-28T11:54:24.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.644+0000 7fee109cc700 1 Processor -- start 2023-11-28T11:54:24.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.644+0000 7fee109cc700 1 -- start start 2023-11-28T11:54:24.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee109cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c06b000 0x7fee0c0c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee109cc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee0c0c1ad0 0x7fee0c0afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee109cc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee0c160880 0x7fee0c0b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee109cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c09a350 con 0x7fee0c06b000 2023-11-28T11:54:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee109cc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c0c34b0 con 0x7fee0c0c1ad0 2023-11-28T11:54:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee109cc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c099d00 con 0x7fee0c160880 2023-11-28T11:54:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee0b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c06b000 0x7fee0c0c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee0b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c06b000 0x7fee0c0c2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60034/0 (socket says 172.21.15.50:60034) 2023-11-28T11:54:24.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee0b7fe700 1 -- 172.21.15.50:0/2555354620 learned_addr learned my addr 172.21.15.50:0/2555354620 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:24.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee0affd700 1 --2- 172.21.15.50:0/2555354620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee0c0c1ad0 0x7fee0c0afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee0bfff700 1 --2- 172.21.15.50:0/2555354620 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee0c160880 0x7fee0c0b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee0b7fe700 1 -- 172.21.15.50:0/2555354620 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee0c160880 msgr2=0x7fee0c0b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee0b7fe700 1 --2- 172.21.15.50:0/2555354620 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee0c160880 0x7fee0c0b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee0b7fe700 1 -- 172.21.15.50:0/2555354620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee0c0c1ad0 msgr2=0x7fee0c0afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee0b7fe700 1 --2- 172.21.15.50:0/2555354620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee0c0c1ad0 0x7fee0c0afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee0b7fe700 1 -- 172.21.15.50:0/2555354620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee040094b0 con 0x7fee0c06b000 2023-11-28T11:54:24.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee0bfff700 1 --2- 172.21.15.50:0/2555354620 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee0c160880 0x7fee0c0b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:24.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee0b7fe700 1 --2- 172.21.15.50:0/2555354620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c06b000 0x7fee0c0c2e10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fedf4007e40 tx=0x7fedf400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:24.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee03fff700 1 -- 172.21.15.50:0/2555354620 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf400ede0 con 0x7fee0c06b000 2023-11-28T11:54:24.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee03fff700 1 -- 172.21.15.50:0/2555354620 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf4014420 con 0x7fee0c06b000 2023-11-28T11:54:24.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee109cc700 1 -- 172.21.15.50:0/2555354620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0c069fc0 con 0x7fee0c06b000 2023-11-28T11:54:24.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee03fff700 1 -- 172.21.15.50:0/2555354620 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf40147d0 con 0x7fee0c06b000 2023-11-28T11:54:24.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.648+0000 7fee109cc700 1 -- 172.21.15.50:0/2555354620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0c069ce0 con 0x7fee0c06b000 2023-11-28T11:54:24.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.652+0000 7fee109cc700 1 -- 172.21.15.50:0/2555354620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0c06a2a0 con 0x7fee0c06b000 2023-11-28T11:54:24.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.652+0000 7fee03fff700 1 -- 172.21.15.50:0/2555354620 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fedf4012050 con 0x7fee0c06b000 2023-11-28T11:54:24.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.652+0000 7fee03fff700 1 --2- 172.21.15.50:0/2555354620 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fedec064f10 0x7fedec0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.652+0000 7fee03fff700 1 -- 172.21.15.50:0/2555354620 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fedf4082720 con 0x7fee0c06b000 2023-11-28T11:54:24.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.652+0000 7fee0affd700 1 --2- 172.21.15.50:0/2555354620 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fedec064f10 0x7fedec0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.652+0000 7fee0affd700 1 --2- 172.21.15.50:0/2555354620 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fedec064f10 0x7fedec0673c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fee0c06c5f0 tx=0x7fedfc007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:24.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.660+0000 7fee03fff700 1 -- 172.21.15.50:0/2555354620 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fedf40505d0 con 0x7fee0c06b000 2023-11-28T11:54:24.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.820+0000 7fee109cc700 1 -- 172.21.15.50:0/2555354620 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee0c072500 con 0x7fee0c06b000 2023-11-28T11:54:24.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.820+0000 7fee03fff700 1 -- 172.21.15.50:0/2555354620 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedf4053bf0 con 0x7fee0c06b000 2023-11-28T11:54:24.820 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:54:24.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.820+0000 7fee109cc700 1 -- 172.21.15.50:0/2555354620 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fedec064f10 msgr2=0x7fedec0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.820+0000 7fee109cc700 1 --2- 172.21.15.50:0/2555354620 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fedec064f10 0x7fedec0673c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fee0c06c5f0 tx=0x7fedfc007e90 comp rx=0 tx=0).stop 2023-11-28T11:54:24.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.820+0000 7fee109cc700 1 -- 172.21.15.50:0/2555354620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c06b000 msgr2=0x7fee0c0c2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.820+0000 7fee109cc700 1 --2- 172.21.15.50:0/2555354620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c06b000 0x7fee0c0c2e10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fedf4007e40 tx=0x7fedf400e3c0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.820+0000 7fee109cc700 1 -- 172.21.15.50:0/2555354620 shutdown_connections 2023-11-28T11:54:24.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.820+0000 7fee109cc700 1 --2- 172.21.15.50:0/2555354620 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee0c160880 0x7fee0c0b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.820+0000 7fee109cc700 1 --2- 172.21.15.50:0/2555354620 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fedec064f10 0x7fedec0673c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.820+0000 7fee109cc700 1 --2- 172.21.15.50:0/2555354620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee0c0c1ad0 0x7fee0c0afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.820+0000 7fee109cc700 1 --2- 172.21.15.50:0/2555354620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee0c06b000 0x7fee0c0c2e10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.820+0000 7fee109cc700 1 -- 172.21.15.50:0/2555354620 >> 172.21.15.50:0/2555354620 conn(0x7fee0c0cae70 msgr2=0x7fee0c071c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:24.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.820+0000 7fee109cc700 1 -- 172.21.15.50:0/2555354620 shutdown_connections 2023-11-28T11:54:24.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.820+0000 7fee109cc700 1 -- 172.21.15.50:0/2555354620 wait complete. 2023-11-28T11:54:24.835 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:54:24.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.956+0000 7ff455bb3700 1 Processor -- start 2023-11-28T11:54:24.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.956+0000 7ff455bb3700 1 -- start start 2023-11-28T11:54:24.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.956+0000 7ff455bb3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff450158ee0 0x7ff4500ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.956+0000 7ff455bb3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45006d1c0 con 0x7ff4500cd5d0 2023-11-28T11:54:24.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.956+0000 7ff455bb3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4500ca3a0 con 0x7ff4500ce230 2023-11-28T11:54:24.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.956+0000 7ff455bb3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45006e000 con 0x7ff450158ee0 2023-11-28T11:54:24.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff44ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff4500cd5d0 0x7ff4500cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44346/0 (socket says 172.21.15.50:44346) 2023-11-28T11:54:24.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff44ffff700 1 -- 172.21.15.50:0/1938077848 learned_addr learned my addr 172.21.15.50:0/1938077848 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:24.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff454bb1700 1 --2- 172.21.15.50:0/1938077848 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff450158ee0 0x7ff4500ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff44f7fe700 1 -- 172.21.15.50:0/1938077848 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6002826 0 0) 0x7ff438001290 con 0x7ff4500cd5d0 2023-11-28T11:54:24.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff44f7fe700 1 -- 172.21.15.50:0/1938077848 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff43c0035d0 con 0x7ff4500cd5d0 2023-11-28T11:54:24.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff454bb1700 1 -- 172.21.15.50:0/1938077848 >> v1:172.21.15.192:6789/0 conn(0x7ff4500ce230 legacy=0x7ff4500cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff44f7fe700 1 -- 172.21.15.50:0/1938077848 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57825230 0 0) 0x7ff4500ca3a0 con 0x7ff4500ce230 2023-11-28T11:54:24.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff454bb1700 1 -- 172.21.15.50:0/1938077848 >> v1:172.21.15.50:6789/0 conn(0x7ff4500cd5d0 legacy=0x7ff4500cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff454bb1700 1 -- 172.21.15.50:0/1938077848 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45006c920 con 0x7ff450158ee0 2023-11-28T11:54:24.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff454bb1700 1 --2- 172.21.15.50:0/1938077848 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff450158ee0 0x7ff4500ae760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff440009880 tx=0x7ff440009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53c62cf7204cc0ed server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:24.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff44f7fe700 1 -- 172.21.15.50:0/1938077848 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff440011830 con 0x7ff450158ee0 2023-11-28T11:54:24.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff44f7fe700 1 -- 172.21.15.50:0/1938077848 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff440011990 con 0x7ff450158ee0 2023-11-28T11:54:24.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff44f7fe700 1 -- 172.21.15.50:0/1938077848 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff440011d20 con 0x7ff450158ee0 2023-11-28T11:54:24.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff455bb3700 1 -- 172.21.15.50:0/1938077848 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff450158ee0 msgr2=0x7ff4500ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff455bb3700 1 --2- 172.21.15.50:0/1938077848 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff450158ee0 0x7ff4500ae760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff440009880 tx=0x7ff440009b90 comp rx=0 tx=0).stop 2023-11-28T11:54:24.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff455bb3700 1 -- 172.21.15.50:0/1938077848 shutdown_connections 2023-11-28T11:54:24.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff455bb3700 1 --2- 172.21.15.50:0/1938077848 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff450158ee0 0x7ff4500ae760 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff455bb3700 1 -- 172.21.15.50:0/1938077848 >> 172.21.15.50:0/1938077848 conn(0x7ff4500d0240 msgr2=0x7ff4500cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:24.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff455bb3700 1 -- 172.21.15.50:0/1938077848 shutdown_connections 2023-11-28T11:54:24.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.960+0000 7ff455bb3700 1 -- 172.21.15.50:0/1938077848 wait complete. 2023-11-28T11:54:24.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff455bb3700 1 Processor -- start 2023-11-28T11:54:24.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff455bb3700 1 -- start start 2023-11-28T11:54:24.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff455bb3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4500cd5d0 0x7ff45014f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff455bb3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4500ce230 0x7ff450155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff455bb3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff450158ee0 0x7ff450156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff455bb3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45014fbd0 con 0x7ff450158ee0 2023-11-28T11:54:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff455bb3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4501ee240 con 0x7ff4500ce230 2023-11-28T11:54:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff455bb3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4501ee520 con 0x7ff4500cd5d0 2023-11-28T11:54:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff44ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4500ce230 0x7ff450155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff454bb1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4500cd5d0 0x7ff45014f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff4553b2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff450158ee0 0x7ff450156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff44ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4500ce230 0x7ff450155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:34818/0 (socket says 172.21.15.50:34818) 2023-11-28T11:54:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff454bb1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4500cd5d0 0x7ff45014f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:60428/0 (socket says 172.21.15.50:60428) 2023-11-28T11:54:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff44ffff700 1 -- 172.21.15.50:0/1658026143 learned_addr learned my addr 172.21.15.50:0/1658026143 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff454bb1700 1 -- 172.21.15.50:0/1658026143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4500ce230 msgr2=0x7ff450155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff454bb1700 1 --2- 172.21.15.50:0/1658026143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4500ce230 0x7ff450155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff454bb1700 1 -- 172.21.15.50:0/1658026143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff450158ee0 msgr2=0x7ff450156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff454bb1700 1 --2- 172.21.15.50:0/1658026143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff450158ee0 0x7ff450156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff454bb1700 1 -- 172.21.15.50:0/1658026143 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4400094b0 con 0x7ff4500cd5d0 2023-11-28T11:54:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff44ffff700 1 --2- 172.21.15.50:0/1658026143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4500ce230 0x7ff450155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff4553b2700 1 --2- 172.21.15.50:0/1658026143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff450158ee0 0x7ff450156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff454bb1700 1 --2- 172.21.15.50:0/1658026143 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4500cd5d0 0x7ff45014f690 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff440015000 tx=0x7ff440004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff44d7fa700 1 -- 172.21.15.50:0/1658026143 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4400198d0 con 0x7ff4500cd5d0 2023-11-28T11:54:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff44d7fa700 1 -- 172.21.15.50:0/1658026143 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44001e070 con 0x7ff4500cd5d0 2023-11-28T11:54:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff455bb3700 1 -- 172.21.15.50:0/1658026143 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45006cee0 con 0x7ff4500cd5d0 2023-11-28T11:54:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff44d7fa700 1 -- 172.21.15.50:0/1658026143 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff440019c70 con 0x7ff4500cd5d0 2023-11-28T11:54:24.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.964+0000 7ff455bb3700 1 -- 172.21.15.50:0/1658026143 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45006cc00 con 0x7ff4500cd5d0 2023-11-28T11:54:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.968+0000 7ff455bb3700 1 -- 172.21.15.50:0/1658026143 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4500ca640 con 0x7ff4500cd5d0 2023-11-28T11:54:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.968+0000 7ff44d7fa700 1 -- 172.21.15.50:0/1658026143 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff44000f050 con 0x7ff4500cd5d0 2023-11-28T11:54:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.968+0000 7ff44d7fa700 1 --2- 172.21.15.50:0/1658026143 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff430064ee0 0x7ff430067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.968+0000 7ff44d7fa700 1 -- 172.21.15.50:0/1658026143 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff440083110 con 0x7ff4500cd5d0 2023-11-28T11:54:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.968+0000 7ff44ffff700 1 --2- 172.21.15.50:0/1658026143 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff430064ee0 0x7ff430067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.972+0000 7ff44ffff700 1 --2- 172.21.15.50:0/1658026143 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff430064ee0 0x7ff430067390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff450158320 tx=0x7ff438007b30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:24.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:24.980+0000 7ff44d7fa700 1 -- 172.21.15.50:0/1658026143 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff440050ed0 con 0x7ff4500cd5d0 2023-11-28T11:54:25.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.144+0000 7ff455bb3700 1 -- 172.21.15.50:0/1658026143 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff450072c20 con 0x7ff4500cd5d0 2023-11-28T11:54:25.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.144+0000 7ff44d7fa700 1 -- 172.21.15.50:0/1658026143 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff440020020 con 0x7ff4500cd5d0 2023-11-28T11:54:25.145 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:25.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.148+0000 7ff455bb3700 1 -- 172.21.15.50:0/1658026143 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff430064ee0 msgr2=0x7ff430067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:25.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.148+0000 7ff455bb3700 1 --2- 172.21.15.50:0/1658026143 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff430064ee0 0x7ff430067390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff450158320 tx=0x7ff438007b30 comp rx=0 tx=0).stop 2023-11-28T11:54:25.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.148+0000 7ff455bb3700 1 -- 172.21.15.50:0/1658026143 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4500cd5d0 msgr2=0x7ff45014f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:25.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.148+0000 7ff455bb3700 1 --2- 172.21.15.50:0/1658026143 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4500cd5d0 0x7ff45014f690 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff440015000 tx=0x7ff440004770 comp rx=0 tx=0).stop 2023-11-28T11:54:25.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.148+0000 7ff455bb3700 1 -- 172.21.15.50:0/1658026143 shutdown_connections 2023-11-28T11:54:25.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.148+0000 7ff455bb3700 1 --2- 172.21.15.50:0/1658026143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff450158ee0 0x7ff450156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.148+0000 7ff455bb3700 1 --2- 172.21.15.50:0/1658026143 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff430064ee0 0x7ff430067390 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.148+0000 7ff455bb3700 1 --2- 172.21.15.50:0/1658026143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4500ce230 0x7ff450155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.148+0000 7ff455bb3700 1 --2- 172.21.15.50:0/1658026143 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4500cd5d0 0x7ff45014f690 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.148+0000 7ff455bb3700 1 -- 172.21.15.50:0/1658026143 >> 172.21.15.50:0/1658026143 conn(0x7ff4500d0240 msgr2=0x7ff4500b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:25.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.148+0000 7ff455bb3700 1 -- 172.21.15.50:0/1658026143 shutdown_connections 2023-11-28T11:54:25.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.148+0000 7ff455bb3700 1 -- 172.21.15.50:0/1658026143 wait complete. 2023-11-28T11:54:25.161 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:54:25.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.280+0000 7fb82a75d700 1 Processor -- start 2023-11-28T11:54:25.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.280+0000 7fb82a75d700 1 -- start start 2023-11-28T11:54:25.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.280+0000 7fb82a75d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb8240b1ae0 0x7fb82406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:25.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.280+0000 7fb82a75d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb8240cf0e0 0x7fb8240cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:25.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82a75d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8240cfa40 con 0x7fb82406a4c0 2023-11-28T11:54:25.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82a75d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8240d0ab0 con 0x7fb8240b1ae0 2023-11-28T11:54:25.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82a75d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82406a9c0 con 0x7fb8240cf0e0 2023-11-28T11:54:25.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82975b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb8240b1ae0 0x7fb82406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:25.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82975b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb8240b1ae0 0x7fb82406d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60058/0 (socket says 172.21.15.50:60058) 2023-11-28T11:54:25.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82975b700 1 -- 172.21.15.50:0/2460798249 learned_addr learned my addr 172.21.15.50:0/2460798249 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:25.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb829f5c700 1 --2- 172.21.15.50:0/2460798249 >> v2:172.21.15.192:3300/0 conn(0x7fb8240cf0e0 0x7fb8240cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82975b700 1 -- 172.21.15.50:0/2460798249 >> v2:172.21.15.192:3300/0 conn(0x7fb8240cf0e0 msgr2=0x7fb8240cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82975b700 1 --2- 172.21.15.50:0/2460798249 >> v2:172.21.15.192:3300/0 conn(0x7fb8240cf0e0 0x7fb8240cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82975b700 1 -- 172.21.15.50:0/2460798249 >> v1:172.21.15.192:6789/0 conn(0x7fb82406a4c0 legacy=0x7fb8240d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82975b700 1 -- 172.21.15.50:0/2460798249 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82406aca0 con 0x7fb8240b1ae0 2023-11-28T11:54:25.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82975b700 1 --2- 172.21.15.50:0/2460798249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8240b1ae0 0x7fb82406d8e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb8240b6440 tx=0x7fb820009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4549fe29e474022a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:25.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb81bfff700 1 -- 172.21.15.50:0/2460798249 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820004230 con 0x7fb8240b1ae0 2023-11-28T11:54:25.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb81bfff700 1 -- 172.21.15.50:0/2460798249 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb820004390 con 0x7fb8240b1ae0 2023-11-28T11:54:25.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb81bfff700 1 -- 172.21.15.50:0/2460798249 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8200036c0 con 0x7fb8240b1ae0 2023-11-28T11:54:25.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82a75d700 1 -- 172.21.15.50:0/2460798249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8240b1ae0 msgr2=0x7fb82406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:25.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82a75d700 1 --2- 172.21.15.50:0/2460798249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8240b1ae0 0x7fb82406d8e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb8240b6440 tx=0x7fb820009bf0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82a75d700 1 -- 172.21.15.50:0/2460798249 shutdown_connections 2023-11-28T11:54:25.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82a75d700 1 --2- 172.21.15.50:0/2460798249 >> v2:172.21.15.192:3300/0 conn(0x7fb8240cf0e0 0x7fb8240cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82a75d700 1 --2- 172.21.15.50:0/2460798249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8240b1ae0 0x7fb82406d8e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82a75d700 1 -- 172.21.15.50:0/2460798249 >> 172.21.15.50:0/2460798249 conn(0x7fb82409bbd0 msgr2=0x7fb8240b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:25.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82a75d700 1 -- 172.21.15.50:0/2460798249 shutdown_connections 2023-11-28T11:54:25.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.284+0000 7fb82a75d700 1 -- 172.21.15.50:0/2460798249 wait complete. 2023-11-28T11:54:25.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82a75d700 1 Processor -- start 2023-11-28T11:54:25.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82a75d700 1 -- start start 2023-11-28T11:54:25.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82a75d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82406a4c0 0x7fb824158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:25.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82a75d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8240b1ae0 0x7fb82415ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:25.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82a75d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8240cf0e0 0x7fb82409f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:25.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82a75d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82415d0e0 con 0x7fb82406a4c0 2023-11-28T11:54:25.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82a75d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82415d940 con 0x7fb8240cf0e0 2023-11-28T11:54:25.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82a75d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240a0310 con 0x7fb8240b1ae0 2023-11-28T11:54:25.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82975b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82406a4c0 0x7fb824158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:25.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82975b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82406a4c0 0x7fb824158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60060/0 (socket says 172.21.15.50:60060) 2023-11-28T11:54:25.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82975b700 1 -- 172.21.15.50:0/4202463902 learned_addr learned my addr 172.21.15.50:0/4202463902 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:25.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb829f5c700 1 --2- 172.21.15.50:0/4202463902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8240cf0e0 0x7fb82409f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:25.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb828f5a700 1 --2- 172.21.15.50:0/4202463902 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8240b1ae0 0x7fb82415ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:25.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82975b700 1 -- 172.21.15.50:0/4202463902 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8240b1ae0 msgr2=0x7fb82415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:25.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82975b700 1 --2- 172.21.15.50:0/4202463902 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8240b1ae0 0x7fb82415ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82975b700 1 -- 172.21.15.50:0/4202463902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8240cf0e0 msgr2=0x7fb82409f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:25.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82975b700 1 --2- 172.21.15.50:0/4202463902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8240cf0e0 0x7fb82409f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82975b700 1 -- 172.21.15.50:0/4202463902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb820009570 con 0x7fb82406a4c0 2023-11-28T11:54:25.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82975b700 1 --2- 172.21.15.50:0/4202463902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82406a4c0 0x7fb824158ff0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb824066b70 tx=0x7fb820004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:25.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb819ffb700 1 -- 172.21.15.50:0/4202463902 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820003db0 con 0x7fb82406a4c0 2023-11-28T11:54:25.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb819ffb700 1 -- 172.21.15.50:0/4202463902 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82001f070 con 0x7fb82406a4c0 2023-11-28T11:54:25.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb819ffb700 1 -- 172.21.15.50:0/4202463902 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82000b8a0 con 0x7fb82406a4c0 2023-11-28T11:54:25.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82a75d700 1 -- 172.21.15.50:0/4202463902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8240b4380 con 0x7fb82406a4c0 2023-11-28T11:54:25.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.288+0000 7fb82a75d700 1 -- 172.21.15.50:0/4202463902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82406af80 con 0x7fb82406a4c0 2023-11-28T11:54:25.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.292+0000 7fb819ffb700 1 -- 172.21.15.50:0/4202463902 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb82002a020 con 0x7fb82406a4c0 2023-11-28T11:54:25.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.292+0000 7fb82a75d700 1 -- 172.21.15.50:0/4202463902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8240b1eb0 con 0x7fb82406a4c0 2023-11-28T11:54:25.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.292+0000 7fb819ffb700 1 --2- 172.21.15.50:0/4202463902 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb808064ee0 0x7fb808067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:25.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.292+0000 7fb819ffb700 1 -- 172.21.15.50:0/4202463902 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb820083820 con 0x7fb82406a4c0 2023-11-28T11:54:25.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.292+0000 7fb828f5a700 1 --2- 172.21.15.50:0/4202463902 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb808064ee0 0x7fb808067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:25.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.292+0000 7fb828f5a700 1 --2- 172.21.15.50:0/4202463902 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb808064ee0 0x7fb808067390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb82406b590 tx=0x7fb814008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:25.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.300+0000 7fb819ffb700 1 -- 172.21.15.50:0/4202463902 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb8200516d0 con 0x7fb82406a4c0 2023-11-28T11:54:25.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.460+0000 7fb82a75d700 1 -- 172.21.15.50:0/4202463902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8240b1eb0 con 0x7fb82406a4c0 2023-11-28T11:54:25.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.460+0000 7fb819ffb700 1 -- 172.21.15.50:0/4202463902 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb820054cf0 con 0x7fb82406a4c0 2023-11-28T11:54:25.463 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:54:25.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.464+0000 7fb82a75d700 1 -- 172.21.15.50:0/4202463902 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb808064ee0 msgr2=0x7fb808067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:25.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.464+0000 7fb82a75d700 1 --2- 172.21.15.50:0/4202463902 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb808064ee0 0x7fb808067390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb82406b590 tx=0x7fb814008040 comp rx=0 tx=0).stop 2023-11-28T11:54:25.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.464+0000 7fb82a75d700 1 -- 172.21.15.50:0/4202463902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82406a4c0 msgr2=0x7fb824158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:25.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.464+0000 7fb82a75d700 1 --2- 172.21.15.50:0/4202463902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82406a4c0 0x7fb824158ff0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb824066b70 tx=0x7fb820004770 comp rx=0 tx=0).stop 2023-11-28T11:54:25.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.464+0000 7fb82a75d700 1 -- 172.21.15.50:0/4202463902 shutdown_connections 2023-11-28T11:54:25.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.464+0000 7fb82a75d700 1 --2- 172.21.15.50:0/4202463902 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb808064ee0 0x7fb808067390 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.464+0000 7fb82a75d700 1 --2- 172.21.15.50:0/4202463902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8240cf0e0 0x7fb82409f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.464+0000 7fb82a75d700 1 --2- 172.21.15.50:0/4202463902 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8240b1ae0 0x7fb82415ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.464+0000 7fb82a75d700 1 --2- 172.21.15.50:0/4202463902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb82406a4c0 0x7fb824158ff0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.464+0000 7fb82a75d700 1 -- 172.21.15.50:0/4202463902 >> 172.21.15.50:0/4202463902 conn(0x7fb82409bbd0 msgr2=0x7fb8240d1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:25.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.464+0000 7fb82a75d700 1 -- 172.21.15.50:0/4202463902 shutdown_connections 2023-11-28T11:54:25.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.464+0000 7fb82a75d700 1 -- 172.21.15.50:0/4202463902 wait complete. 2023-11-28T11:54:25.478 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:54:25.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.600+0000 7f5b63fff700 1 Processor -- start 2023-11-28T11:54:25.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.600+0000 7f5b63fff700 1 -- start start 2023-11-28T11:54:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.600+0000 7f5b63fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b640d31b0 0x7f5b640cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.600+0000 7f5b63fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b6406a7f0 con 0x7f5b6406ce60 2023-11-28T11:54:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.600+0000 7f5b63fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b6406aad0 con 0x7f5b640cf470 2023-11-28T11:54:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.600+0000 7f5b63fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b640d3650 con 0x7f5b640d31b0 2023-11-28T11:54:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.600+0000 7f5b627fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b640d31b0 0x7f5b640cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.600+0000 7f5b62ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5b6406ce60 0x7f5b6406d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44362/0 (socket says 172.21.15.50:44362) 2023-11-28T11:54:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.600+0000 7f5b62ffd700 1 -- 172.21.15.50:0/2277401214 learned_addr learned my addr 172.21.15.50:0/2277401214 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.600+0000 7f5b627fc700 1 -- 172.21.15.50:0/2277401214 >> v1:172.21.15.192:6789/0 conn(0x7f5b640cf470 legacy=0x7f5b640cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.600+0000 7f5b627fc700 1 -- 172.21.15.50:0/2277401214 >> v1:172.21.15.50:6789/0 conn(0x7f5b6406ce60 legacy=0x7f5b6406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:25.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.600+0000 7f5b627fc700 1 -- 172.21.15.50:0/2277401214 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6406adb0 con 0x7f5b640d31b0 2023-11-28T11:54:25.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.600+0000 7f5b627fc700 1 --2- 172.21.15.50:0/2277401214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b640d31b0 0x7f5b640cce60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009880 tx=0x7f5b4c009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e99c77bc988e15b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:25.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.604+0000 7f5b61ffb700 1 -- 172.21.15.50:0/2277401214 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c004230 con 0x7f5b640d31b0 2023-11-28T11:54:25.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.604+0000 7f5b61ffb700 1 -- 172.21.15.50:0/2277401214 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c004390 con 0x7f5b640d31b0 2023-11-28T11:54:25.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.604+0000 7f5b61ffb700 1 -- 172.21.15.50:0/2277401214 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0036c0 con 0x7f5b640d31b0 2023-11-28T11:54:25.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.604+0000 7f5b63fff700 1 -- 172.21.15.50:0/2277401214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b640d31b0 msgr2=0x7f5b640cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:25.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.604+0000 7f5b63fff700 1 --2- 172.21.15.50:0/2277401214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b640d31b0 0x7f5b640cce60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009880 tx=0x7f5b4c009b90 comp rx=0 tx=0).stop 2023-11-28T11:54:25.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.604+0000 7f5b63fff700 1 -- 172.21.15.50:0/2277401214 shutdown_connections 2023-11-28T11:54:25.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.604+0000 7f5b63fff700 1 --2- 172.21.15.50:0/2277401214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b640d31b0 0x7f5b640cce60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.604+0000 7f5b63fff700 1 -- 172.21.15.50:0/2277401214 >> 172.21.15.50:0/2277401214 conn(0x7f5b640b5760 msgr2=0x7f5b640b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:25.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.604+0000 7f5b63fff700 1 -- 172.21.15.50:0/2277401214 shutdown_connections 2023-11-28T11:54:25.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.604+0000 7f5b63fff700 1 -- 172.21.15.50:0/2277401214 wait complete. 2023-11-28T11:54:25.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b63fff700 1 Processor -- start 2023-11-28T11:54:25.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b63fff700 1 -- start start 2023-11-28T11:54:25.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b63fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b6406ce60 0x7f5b641557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:25.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b63fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b640cf470 0x7f5b640b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:25.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b63fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b640d31b0 0x7f5b640b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:25.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b63fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b641568f0 con 0x7f5b640cf470 2023-11-28T11:54:25.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b63fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b64156bd0 con 0x7f5b640d31b0 2023-11-28T11:54:25.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b63fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b64156eb0 con 0x7f5b6406ce60 2023-11-28T11:54:25.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b627fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b640cf470 0x7f5b640b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:25.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b627fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b640cf470 0x7f5b640b0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60092/0 (socket says 172.21.15.50:60092) 2023-11-28T11:54:25.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b627fc700 1 -- 172.21.15.50:0/3353390239 learned_addr learned my addr 172.21.15.50:0/3353390239 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:25.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b637fe700 1 --2- 172.21.15.50:0/3353390239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b640d31b0 0x7f5b640b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:25.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b62ffd700 1 --2- 172.21.15.50:0/3353390239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b6406ce60 0x7f5b641557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:25.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b627fc700 1 -- 172.21.15.50:0/3353390239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b6406ce60 msgr2=0x7f5b641557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:25.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b627fc700 1 --2- 172.21.15.50:0/3353390239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b6406ce60 0x7f5b641557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b627fc700 1 -- 172.21.15.50:0/3353390239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b640d31b0 msgr2=0x7f5b640b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:25.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b627fc700 1 --2- 172.21.15.50:0/3353390239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b640d31b0 0x7f5b640b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b627fc700 1 -- 172.21.15.50:0/3353390239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c0094b0 con 0x7f5b640cf470 2023-11-28T11:54:25.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b637fe700 1 --2- 172.21.15.50:0/3353390239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b640d31b0 0x7f5b640b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:25.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b627fc700 1 --2- 172.21.15.50:0/3353390239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b640cf470 0x7f5b640b0b60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c000c00 tx=0x7f5b4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:25.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b5bfff700 1 -- 172.21.15.50:0/3353390239 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c006ea0 con 0x7f5b640cf470 2023-11-28T11:54:25.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b5bfff700 1 -- 172.21.15.50:0/3353390239 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c01f070 con 0x7f5b640cf470 2023-11-28T11:54:25.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.608+0000 7f5b5bfff700 1 -- 172.21.15.50:0/3353390239 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c011a70 con 0x7f5b640cf470 2023-11-28T11:54:25.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.612+0000 7f5b63fff700 1 -- 172.21.15.50:0/3353390239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b640d0000 con 0x7f5b640cf470 2023-11-28T11:54:25.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.612+0000 7f5b63fff700 1 -- 172.21.15.50:0/3353390239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6406b090 con 0x7f5b640cf470 2023-11-28T11:54:25.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.612+0000 7f5b5bfff700 1 -- 172.21.15.50:0/3353390239 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5b4c02a020 con 0x7f5b640cf470 2023-11-28T11:54:25.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.612+0000 7f5b63fff700 1 -- 172.21.15.50:0/3353390239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b640b6470 con 0x7f5b640cf470 2023-11-28T11:54:25.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.612+0000 7f5b5bfff700 1 --2- 172.21.15.50:0/3353390239 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b48064f10 0x7f5b480673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:25.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.612+0000 7f5b5bfff700 1 -- 172.21.15.50:0/3353390239 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5b4c083c20 con 0x7f5b640cf470 2023-11-28T11:54:25.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.612+0000 7f5b62ffd700 1 --2- 172.21.15.50:0/3353390239 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b48064f10 0x7f5b480673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:25.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.616+0000 7f5b62ffd700 1 --2- 172.21.15.50:0/3353390239 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b48064f10 0x7f5b480673c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5b54000f60 tx=0x7f5b54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:25.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.620+0000 7f5b5bfff700 1 -- 172.21.15.50:0/3353390239 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5b4c051aa0 con 0x7f5b640cf470 2023-11-28T11:54:25.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.780+0000 7f5b63fff700 1 -- 172.21.15.50:0/3353390239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5b640b6470 con 0x7f5b640cf470 2023-11-28T11:54:25.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.780+0000 7f5b5bfff700 1 -- 172.21.15.50:0/3353390239 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5b4c0550c0 con 0x7f5b640cf470 2023-11-28T11:54:25.782 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:25.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.784+0000 7f5b63fff700 1 -- 172.21.15.50:0/3353390239 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b48064f10 msgr2=0x7f5b480673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:25.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.784+0000 7f5b63fff700 1 --2- 172.21.15.50:0/3353390239 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b48064f10 0x7f5b480673c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5b54000f60 tx=0x7f5b54009040 comp rx=0 tx=0).stop 2023-11-28T11:54:25.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.784+0000 7f5b63fff700 1 -- 172.21.15.50:0/3353390239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b640cf470 msgr2=0x7f5b640b0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:25.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.784+0000 7f5b63fff700 1 --2- 172.21.15.50:0/3353390239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b640cf470 0x7f5b640b0b60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c000c00 tx=0x7f5b4c004770 comp rx=0 tx=0).stop 2023-11-28T11:54:25.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.784+0000 7f5b63fff700 1 -- 172.21.15.50:0/3353390239 shutdown_connections 2023-11-28T11:54:25.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.784+0000 7f5b63fff700 1 --2- 172.21.15.50:0/3353390239 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b48064f10 0x7f5b480673c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.784+0000 7f5b63fff700 1 --2- 172.21.15.50:0/3353390239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b640d31b0 0x7f5b640b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.784+0000 7f5b63fff700 1 --2- 172.21.15.50:0/3353390239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b640cf470 0x7f5b640b0b60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.784+0000 7f5b63fff700 1 --2- 172.21.15.50:0/3353390239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b6406ce60 0x7f5b641557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.784+0000 7f5b63fff700 1 -- 172.21.15.50:0/3353390239 >> 172.21.15.50:0/3353390239 conn(0x7f5b640b5760 msgr2=0x7f5b640657e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:25.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.784+0000 7f5b63fff700 1 -- 172.21.15.50:0/3353390239 shutdown_connections 2023-11-28T11:54:25.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.784+0000 7f5b63fff700 1 -- 172.21.15.50:0/3353390239 wait complete. 2023-11-28T11:54:25.802 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:25.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.908+0000 7fed6f59e700 1 Processor -- start 2023-11-28T11:54:25.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.908+0000 7fed6f59e700 1 -- start start 2023-11-28T11:54:25.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6f59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fed700cf050 0x7fed7006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:25.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed700b4c10 0x7fed700cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:25.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed7015c6d0 con 0x7fed7006a530 2023-11-28T11:54:25.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6f59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed7006a9d0 con 0x7fed700cf050 2023-11-28T11:54:25.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7006ac60 con 0x7fed700b4c10 2023-11-28T11:54:25.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fed700cf050 0x7fed7006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:25.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed65d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fed7006a530 0x7fed700cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44366/0 (socket says 172.21.15.50:44366) 2023-11-28T11:54:25.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed65d9b700 1 -- 172.21.15.50:0/140603747 learned_addr learned my addr 172.21.15.50:0/140603747 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:25.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6ed9d700 1 --2- 172.21.15.50:0/140603747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed700b4c10 0x7fed700cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:25.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6dd9b700 1 -- 172.21.15.50:0/140603747 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917128928 0 0) 0x7fed7015c6d0 con 0x7fed7006a530 2023-11-28T11:54:25.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6dd9b700 1 -- 172.21.15.50:0/140603747 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed5c0035d0 con 0x7fed7006a530 2023-11-28T11:54:25.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6e59c700 1 -- 172.21.15.50:0/140603747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed700b4c10 msgr2=0x7fed700cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:25.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6e59c700 1 --2- 172.21.15.50:0/140603747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed700b4c10 0x7fed700cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6e59c700 1 -- 172.21.15.50:0/140603747 >> v1:172.21.15.50:6789/0 conn(0x7fed7006a530 legacy=0x7fed700cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:25.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6e59c700 1 -- 172.21.15.50:0/140603747 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7006af40 con 0x7fed700cf050 2023-11-28T11:54:25.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6e59c700 1 --2- 172.21.15.50:0/140603747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed700cf050 0x7fed7006d7d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fed60009850 tx=0x7fed60009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac93db238be340f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:25.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6dd9b700 1 -- 172.21.15.50:0/140603747 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed60011830 con 0x7fed700cf050 2023-11-28T11:54:25.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6dd9b700 1 -- 172.21.15.50:0/140603747 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed60011990 con 0x7fed700cf050 2023-11-28T11:54:25.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6dd9b700 1 -- 172.21.15.50:0/140603747 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed60011d00 con 0x7fed700cf050 2023-11-28T11:54:25.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6f59e700 1 -- 172.21.15.50:0/140603747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed700cf050 msgr2=0x7fed7006d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:25.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6f59e700 1 --2- 172.21.15.50:0/140603747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed700cf050 0x7fed7006d7d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fed60009850 tx=0x7fed60009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:25.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6f59e700 1 -- 172.21.15.50:0/140603747 shutdown_connections 2023-11-28T11:54:25.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6f59e700 1 --2- 172.21.15.50:0/140603747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed700b4c10 0x7fed700cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6f59e700 1 --2- 172.21.15.50:0/140603747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed700cf050 0x7fed7006d7d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6f59e700 1 -- 172.21.15.50:0/140603747 >> 172.21.15.50:0/140603747 conn(0x7fed7009bb30 msgr2=0x7fed700b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:25.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6f59e700 1 -- 172.21.15.50:0/140603747 shutdown_connections 2023-11-28T11:54:25.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.912+0000 7fed6f59e700 1 -- 172.21.15.50:0/140603747 wait complete. 2023-11-28T11:54:25.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6f59e700 1 Processor -- start 2023-11-28T11:54:25.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6f59e700 1 -- start start 2023-11-28T11:54:25.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed7006a530 0x7fed700c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:25.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed700b4c10 0x7fed7015f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:25.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed700cf050 0x7fed7014f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:25.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed700c7020 con 0x7fed700cf050 2023-11-28T11:54:25.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6f59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed700c63a0 con 0x7fed7006a530 2023-11-28T11:54:25.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed700c6680 con 0x7fed700b4c10 2023-11-28T11:54:25.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed700cf050 0x7fed7014f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:25.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed700cf050 0x7fed7014f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60116/0 (socket says 172.21.15.50:60116) 2023-11-28T11:54:25.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6ed9d700 1 -- 172.21.15.50:0/2667401029 learned_addr learned my addr 172.21.15.50:0/2667401029 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:25.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed65d9b700 1 --2- 172.21.15.50:0/2667401029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed700b4c10 0x7fed7015f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:25.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6e59c700 1 --2- 172.21.15.50:0/2667401029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed7006a530 0x7fed700c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:25.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6ed9d700 1 -- 172.21.15.50:0/2667401029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed700b4c10 msgr2=0x7fed7015f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:25.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6ed9d700 1 --2- 172.21.15.50:0/2667401029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed700b4c10 0x7fed7015f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6ed9d700 1 -- 172.21.15.50:0/2667401029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed7006a530 msgr2=0x7fed700c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:25.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6ed9d700 1 --2- 172.21.15.50:0/2667401029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed7006a530 0x7fed700c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:25.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6ed9d700 1 -- 172.21.15.50:0/2667401029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed600094b0 con 0x7fed700cf050 2023-11-28T11:54:25.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.916+0000 7fed6ed9d700 1 --2- 172.21.15.50:0/2667401029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed700cf050 0x7fed7014f880 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fed6800efc0 tx=0x7fed6800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:25.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.920+0000 7fed677fe700 1 -- 172.21.15.50:0/2667401029 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed68009ea0 con 0x7fed700cf050 2023-11-28T11:54:25.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.920+0000 7fed677fe700 1 -- 172.21.15.50:0/2667401029 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6800f040 con 0x7fed700cf050 2023-11-28T11:54:25.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.920+0000 7fed6f59e700 1 -- 172.21.15.50:0/2667401029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed700b46f0 con 0x7fed700cf050 2023-11-28T11:54:25.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.920+0000 7fed677fe700 1 -- 172.21.15.50:0/2667401029 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6800ced0 con 0x7fed700cf050 2023-11-28T11:54:25.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.920+0000 7fed6f59e700 1 -- 172.21.15.50:0/2667401029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed700b4410 con 0x7fed700cf050 2023-11-28T11:54:25.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.920+0000 7fed6f59e700 1 -- 172.21.15.50:0/2667401029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7006b220 con 0x7fed700cf050 2023-11-28T11:54:25.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.924+0000 7fed677fe700 1 -- 172.21.15.50:0/2667401029 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fed68014480 con 0x7fed700cf050 2023-11-28T11:54:25.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.924+0000 7fed677fe700 1 --2- 172.21.15.50:0/2667401029 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fed50064ee0 0x7fed50067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:25.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.924+0000 7fed677fe700 1 -- 172.21.15.50:0/2667401029 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fed68082ae0 con 0x7fed700cf050 2023-11-28T11:54:25.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.924+0000 7fed6e59c700 1 --2- 172.21.15.50:0/2667401029 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fed50064ee0 0x7fed50067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:25.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.924+0000 7fed6e59c700 1 --2- 172.21.15.50:0/2667401029 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fed50064ee0 0x7fed50067390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fed600090b0 tx=0x7fed60008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:25.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:25.928+0000 7fed677fe700 1 -- 172.21.15.50:0/2667401029 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fed68050930 con 0x7fed700cf050 2023-11-28T11:54:26.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.092+0000 7fed6f59e700 1 -- 172.21.15.50:0/2667401029 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed700c7160 con 0x7fed700cf050 2023-11-28T11:54:26.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.096+0000 7fed677fe700 1 -- 172.21.15.50:0/2667401029 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7fed700c7160 con 0x7fed700cf050 2023-11-28T11:54:26.098 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:26.098 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:45.231747+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:26.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.100+0000 7fed6f59e700 1 -- 172.21.15.50:0/2667401029 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fed50064ee0 msgr2=0x7fed50067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:26.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.100+0000 7fed6f59e700 1 --2- 172.21.15.50:0/2667401029 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fed50064ee0 0x7fed50067390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fed600090b0 tx=0x7fed60008030 comp rx=0 tx=0).stop 2023-11-28T11:54:26.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.100+0000 7fed6f59e700 1 -- 172.21.15.50:0/2667401029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed700cf050 msgr2=0x7fed7014f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:26.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.100+0000 7fed6f59e700 1 --2- 172.21.15.50:0/2667401029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed700cf050 0x7fed7014f880 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fed6800efc0 tx=0x7fed6800c3a0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.100+0000 7fed6f59e700 1 -- 172.21.15.50:0/2667401029 shutdown_connections 2023-11-28T11:54:26.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.100+0000 7fed6f59e700 1 --2- 172.21.15.50:0/2667401029 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed700cf050 0x7fed7014f880 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.100+0000 7fed6f59e700 1 --2- 172.21.15.50:0/2667401029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed700b4c10 0x7fed7015f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.100+0000 7fed6f59e700 1 --2- 172.21.15.50:0/2667401029 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fed50064ee0 0x7fed50067390 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.100+0000 7fed6f59e700 1 --2- 172.21.15.50:0/2667401029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed7006a530 0x7fed700c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.100+0000 7fed6f59e700 1 -- 172.21.15.50:0/2667401029 >> 172.21.15.50:0/2667401029 conn(0x7fed7009bb30 msgr2=0x7fed7015bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:26.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.100+0000 7fed6f59e700 1 -- 172.21.15.50:0/2667401029 shutdown_connections 2023-11-28T11:54:26.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.100+0000 7fed6f59e700 1 -- 172.21.15.50:0/2667401029 wait complete. 2023-11-28T11:54:26.113 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:53:38.462826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:53:39.778621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:53:42.870360+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:54:26.113 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:54:26.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.232+0000 7f10cccb5700 1 Processor -- start 2023-11-28T11:54:26.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.232+0000 7f10cccb5700 1 -- start start 2023-11-28T11:54:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.232+0000 7f10cccb5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10c80c9c00 0x7f10c806cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.232+0000 7f10cccb5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10c815c160 0x7f10c806ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.232+0000 7f10cccb5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f10c80c9fd0 0x7f10c815fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.232+0000 7f10cccb5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c806a4d0 con 0x7f10c80c9c00 2023-11-28T11:54:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.232+0000 7f10cccb5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c806f990 con 0x7f10c80c9fd0 2023-11-28T11:54:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.232+0000 7f10cccb5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c806f0f0 con 0x7f10c815c160 2023-11-28T11:54:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.232+0000 7f10c77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10c80c9c00 0x7f10c806cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.232+0000 7f10c77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10c80c9c00 0x7f10c806cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60118/0 (socket says 172.21.15.50:60118) 2023-11-28T11:54:26.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.232+0000 7f10c77fe700 1 -- 172.21.15.50:0/909981808 learned_addr learned my addr 172.21.15.50:0/909981808 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10c6ffd700 1 --2- 172.21.15.50:0/909981808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10c815c160 0x7f10c806ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10c7fff700 1 --2- 172.21.15.50:0/909981808 >> v2:172.21.15.192:3300/0 conn(0x7f10c80c9fd0 0x7f10c815fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10c77fe700 1 -- 172.21.15.50:0/909981808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10c815c160 msgr2=0x7f10c806ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10c77fe700 1 --2- 172.21.15.50:0/909981808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10c815c160 0x7f10c806ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10c77fe700 1 -- 172.21.15.50:0/909981808 >> v2:172.21.15.192:3300/0 conn(0x7f10c80c9fd0 msgr2=0x7f10c815fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10c77fe700 1 --2- 172.21.15.50:0/909981808 >> v2:172.21.15.192:3300/0 conn(0x7f10c80c9fd0 0x7f10c815fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10c77fe700 1 -- 172.21.15.50:0/909981808 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c806f3d0 con 0x7f10c80c9c00 2023-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10c6ffd700 1 --2- 172.21.15.50:0/909981808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10c815c160 0x7f10c806ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10c7fff700 1 --2- 172.21.15.50:0/909981808 >> v2:172.21.15.192:3300/0 conn(0x7f10c80c9fd0 0x7f10c815fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10c77fe700 1 --2- 172.21.15.50:0/909981808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c80c9c00 0x7f10c806cd30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f10c8070860 tx=0x7f10b8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d31366fff402ee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10c67fc700 1 -- 172.21.15.50:0/909981808 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b800b8a0 con 0x7f10c80c9c00 2023-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10c67fc700 1 -- 172.21.15.50:0/909981808 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b800ba00 con 0x7f10c80c9c00 2023-11-28T11:54:26.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10c67fc700 1 -- 172.21.15.50:0/909981808 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b800bd90 con 0x7f10c80c9c00 2023-11-28T11:54:26.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10cccb5700 1 -- 172.21.15.50:0/909981808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c80c9c00 msgr2=0x7f10c806cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:26.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10cccb5700 1 --2- 172.21.15.50:0/909981808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c80c9c00 0x7f10c806cd30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f10c8070860 tx=0x7f10b8009bf0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10cccb5700 1 -- 172.21.15.50:0/909981808 shutdown_connections 2023-11-28T11:54:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10cccb5700 1 --2- 172.21.15.50:0/909981808 >> v2:172.21.15.192:3300/0 conn(0x7f10c80c9fd0 0x7f10c815fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10cccb5700 1 --2- 172.21.15.50:0/909981808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10c815c160 0x7f10c806ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10cccb5700 1 --2- 172.21.15.50:0/909981808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c80c9c00 0x7f10c806cd30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10cccb5700 1 -- 172.21.15.50:0/909981808 >> 172.21.15.50:0/909981808 conn(0x7f10c80d0240 msgr2=0x7f10c80cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10cccb5700 1 -- 172.21.15.50:0/909981808 shutdown_connections 2023-11-28T11:54:26.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.236+0000 7f10cccb5700 1 -- 172.21.15.50:0/909981808 wait complete. 2023-11-28T11:54:26.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10cccb5700 1 Processor -- start 2023-11-28T11:54:26.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10cccb5700 1 -- start start 2023-11-28T11:54:26.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10cccb5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10c80c9c00 0x7f10c81f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10cccb5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c80c9fd0 0x7f10c80c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10cccb5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10c815c160 0x7f10c80c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10cccb5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c80c6f80 con 0x7f10c80c9fd0 2023-11-28T11:54:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10cccb5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c81f19e0 con 0x7f10c80c9c00 2023-11-28T11:54:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10cccb5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c81f1cc0 con 0x7f10c815c160 2023-11-28T11:54:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10c6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c80c9fd0 0x7f10c80c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10c6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c80c9fd0 0x7f10c80c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60126/0 (socket says 172.21.15.50:60126) 2023-11-28T11:54:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10c6ffd700 1 -- 172.21.15.50:0/3681320035 learned_addr learned my addr 172.21.15.50:0/3681320035 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10c77fe700 1 --2- 172.21.15.50:0/3681320035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10c80c9c00 0x7f10c81f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10c7fff700 1 --2- 172.21.15.50:0/3681320035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10c815c160 0x7f10c80c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10c6ffd700 1 -- 172.21.15.50:0/3681320035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10c815c160 msgr2=0x7f10c80c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:26.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10c6ffd700 1 --2- 172.21.15.50:0/3681320035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10c815c160 0x7f10c80c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10c6ffd700 1 -- 172.21.15.50:0/3681320035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10c80c9c00 msgr2=0x7f10c81f24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10c6ffd700 1 --2- 172.21.15.50:0/3681320035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10c80c9c00 0x7f10c81f24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10c6ffd700 1 -- 172.21.15.50:0/3681320035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b8009570 con 0x7f10c80c9fd0 2023-11-28T11:54:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10c6ffd700 1 --2- 172.21.15.50:0/3681320035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c80c9fd0 0x7f10c80c6680 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00c770 tx=0x7f10bc00ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10affff700 1 -- 172.21.15.50:0/3681320035 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc005c40 con 0x7f10c80c9fd0 2023-11-28T11:54:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10affff700 1 -- 172.21.15.50:0/3681320035 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc005da0 con 0x7f10c80c9fd0 2023-11-28T11:54:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10cccb5700 1 -- 172.21.15.50:0/3681320035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c80cd910 con 0x7f10c80c9fd0 2023-11-28T11:54:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10affff700 1 -- 172.21.15.50:0/3681320035 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc011820 con 0x7f10c80c9fd0 2023-11-28T11:54:26.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.240+0000 7f10cccb5700 1 -- 172.21.15.50:0/3681320035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c806f6b0 con 0x7f10c80c9fd0 2023-11-28T11:54:26.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.244+0000 7f10cccb5700 1 -- 172.21.15.50:0/3681320035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c80ca450 con 0x7f10c80c9fd0 2023-11-28T11:54:26.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.244+0000 7f10affff700 1 -- 172.21.15.50:0/3681320035 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f10bc020070 con 0x7f10c80c9fd0 2023-11-28T11:54:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.244+0000 7f10affff700 1 --2- 172.21.15.50:0/3681320035 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f10b4064f10 0x7f10b40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.244+0000 7f10affff700 1 -- 172.21.15.50:0/3681320035 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f10bc0827a0 con 0x7f10c80c9fd0 2023-11-28T11:54:26.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.244+0000 7f10c77fe700 1 --2- 172.21.15.50:0/3681320035 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f10b4064f10 0x7f10b40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.248+0000 7f10c77fe700 1 --2- 172.21.15.50:0/3681320035 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f10b4064f10 0x7f10b40673c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f10b8014040 tx=0x7f10b8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:26.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.248+0000 7f10affff700 1 -- 172.21.15.50:0/3681320035 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f10bc054120 con 0x7f10c80c9fd0 2023-11-28T11:54:26.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.412+0000 7f10cccb5700 1 -- 172.21.15.50:0/3681320035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f10c8072c20 con 0x7f10c80c9fd0 2023-11-28T11:54:26.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.412+0000 7f10affff700 1 -- 172.21.15.50:0/3681320035 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f10bc053d10 con 0x7f10c80c9fd0 2023-11-28T11:54:26.414 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:54:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.416+0000 7f10cccb5700 1 -- 172.21.15.50:0/3681320035 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f10b4064f10 msgr2=0x7f10b40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.416+0000 7f10cccb5700 1 --2- 172.21.15.50:0/3681320035 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f10b4064f10 0x7f10b40673c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f10b8014040 tx=0x7f10b8008030 comp rx=0 tx=0).stop 2023-11-28T11:54:26.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.416+0000 7f10cccb5700 1 -- 172.21.15.50:0/3681320035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c80c9fd0 msgr2=0x7f10c80c6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.416+0000 7f10cccb5700 1 --2- 172.21.15.50:0/3681320035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c80c9fd0 0x7f10c80c6680 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00c770 tx=0x7f10bc00ca80 comp rx=0 tx=0).stop 2023-11-28T11:54:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.416+0000 7f10cccb5700 1 -- 172.21.15.50:0/3681320035 shutdown_connections 2023-11-28T11:54:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.416+0000 7f10cccb5700 1 --2- 172.21.15.50:0/3681320035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10c815c160 0x7f10c80c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.416+0000 7f10cccb5700 1 --2- 172.21.15.50:0/3681320035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10c80c9fd0 0x7f10c80c6680 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.416+0000 7f10cccb5700 1 --2- 172.21.15.50:0/3681320035 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f10b4064f10 0x7f10b40673c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.416+0000 7f10cccb5700 1 --2- 172.21.15.50:0/3681320035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10c80c9c00 0x7f10c81f24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.416+0000 7f10cccb5700 1 -- 172.21.15.50:0/3681320035 >> 172.21.15.50:0/3681320035 conn(0x7f10c80d0240 msgr2=0x7f10c80aec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.416+0000 7f10cccb5700 1 -- 172.21.15.50:0/3681320035 shutdown_connections 2023-11-28T11:54:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.416+0000 7f10cccb5700 1 -- 172.21.15.50:0/3681320035 wait complete. 2023-11-28T11:54:26.428 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:54:26.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.548+0000 7f2063fff700 1 Processor -- start 2023-11-28T11:54:26.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.548+0000 7f2063fff700 1 -- start start 2023-11-28T11:54:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.548+0000 7f2063fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f20640cc590 0x7f20640b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.548+0000 7f2063fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f20640b2740 0x7f20640cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.548+0000 7f2063fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20640cac70 con 0x7f20640cfdd0 2023-11-28T11:54:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.548+0000 7f2063fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206406c8e0 con 0x7f20640cc590 2023-11-28T11:54:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.548+0000 7f2063fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20640d0340 con 0x7f20640b2740 2023-11-28T11:54:26.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.548+0000 7f2062ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f20640cc590 0x7f20640b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2062ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f20640cc590 0x7f20640b0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60138/0 (socket says 172.21.15.50:60138) 2023-11-28T11:54:26.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2062ffd700 1 -- 172.21.15.50:0/56275337 learned_addr learned my addr 172.21.15.50:0/56275337 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:26.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f20637fe700 1 --2- 172.21.15.50:0/56275337 >> v2:172.21.15.192:3300/0 conn(0x7f20640b2740 0x7f20640cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2062ffd700 1 -- 172.21.15.50:0/56275337 >> v2:172.21.15.192:3300/0 conn(0x7f20640b2740 msgr2=0x7f20640cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:26.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2062ffd700 1 --2- 172.21.15.50:0/56275337 >> v2:172.21.15.192:3300/0 conn(0x7f20640b2740 0x7f20640cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2062ffd700 1 -- 172.21.15.50:0/56275337 >> v1:172.21.15.192:6789/0 conn(0x7f20640cfdd0 legacy=0x7f20640b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:26.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2062ffd700 1 -- 172.21.15.50:0/56275337 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206406d1d0 con 0x7f20640cc590 2023-11-28T11:54:26.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2062ffd700 1 --2- 172.21.15.50:0/56275337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20640cc590 0x7f20640b0940 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2054009e50 tx=0x7f205400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a4b573387a04ce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:26.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2061ffb700 1 -- 172.21.15.50:0/56275337 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205400e070 con 0x7f20640cc590 2023-11-28T11:54:26.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2061ffb700 1 -- 172.21.15.50:0/56275337 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205400b8d0 con 0x7f20640cc590 2023-11-28T11:54:26.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2061ffb700 1 -- 172.21.15.50:0/56275337 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205400bc80 con 0x7f20640cc590 2023-11-28T11:54:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2063fff700 1 -- 172.21.15.50:0/56275337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20640cc590 msgr2=0x7f20640b0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2063fff700 1 --2- 172.21.15.50:0/56275337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20640cc590 0x7f20640b0940 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2054009e50 tx=0x7f205400b330 comp rx=0 tx=0).stop 2023-11-28T11:54:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2063fff700 1 -- 172.21.15.50:0/56275337 shutdown_connections 2023-11-28T11:54:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2063fff700 1 --2- 172.21.15.50:0/56275337 >> v2:172.21.15.192:3300/0 conn(0x7f20640b2740 0x7f20640cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2063fff700 1 --2- 172.21.15.50:0/56275337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20640cc590 0x7f20640b0940 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2063fff700 1 -- 172.21.15.50:0/56275337 >> 172.21.15.50:0/56275337 conn(0x7f20640cd0a0 msgr2=0x7f20640cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2063fff700 1 -- 172.21.15.50:0/56275337 shutdown_connections 2023-11-28T11:54:26.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2063fff700 1 -- 172.21.15.50:0/56275337 wait complete. 2023-11-28T11:54:26.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2063fff700 1 Processor -- start 2023-11-28T11:54:26.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.552+0000 7f2063fff700 1 -- start start 2023-11-28T11:54:26.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f2063fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20640b2740 0x7f20641f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f2063fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20640cfdd0 0x7f20640c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f2063fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20640b6080 0x7f20640d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f2063fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20640c6660 con 0x7f20640b6080 2023-11-28T11:54:26.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f2063fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20641f67c0 con 0x7f20640cfdd0 2023-11-28T11:54:26.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f2063fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20641f5df0 con 0x7f20640b2740 2023-11-28T11:54:26.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f20637fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20640b6080 0x7f20640d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f20637fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20640b6080 0x7f20640d0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60140/0 (socket says 172.21.15.50:60140) 2023-11-28T11:54:26.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f20637fe700 1 -- 172.21.15.50:0/1314017636 learned_addr learned my addr 172.21.15.50:0/1314017636 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:26.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f2062ffd700 1 --2- 172.21.15.50:0/1314017636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20640b2740 0x7f20641f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f20627fc700 1 --2- 172.21.15.50:0/1314017636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20640cfdd0 0x7f20640c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f20637fe700 1 -- 172.21.15.50:0/1314017636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20640b2740 msgr2=0x7f20641f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:26.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f20637fe700 1 --2- 172.21.15.50:0/1314017636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20640b2740 0x7f20641f6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f20637fe700 1 -- 172.21.15.50:0/1314017636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20640cfdd0 msgr2=0x7f20640c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:26.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f20637fe700 1 --2- 172.21.15.50:0/1314017636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20640cfdd0 0x7f20640c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f20637fe700 1 -- 172.21.15.50:0/1314017636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2054009b30 con 0x7f20640b6080 2023-11-28T11:54:26.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f20637fe700 1 --2- 172.21.15.50:0/1314017636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20640b6080 0x7f20640d0a20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f205c00e750 tx=0x7f205c00ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:26.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f205bfff700 1 -- 172.21.15.50:0/1314017636 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c009560 con 0x7f20640b6080 2023-11-28T11:54:26.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f2063fff700 1 -- 172.21.15.50:0/1314017636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20640ce520 con 0x7f20640b6080 2023-11-28T11:54:26.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f205bfff700 1 -- 172.21.15.50:0/1314017636 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205c013680 con 0x7f20640b6080 2023-11-28T11:54:26.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f2063fff700 1 -- 172.21.15.50:0/1314017636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206406d4b0 con 0x7f20640b6080 2023-11-28T11:54:26.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f205bfff700 1 -- 172.21.15.50:0/1314017636 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c013a10 con 0x7f20640b6080 2023-11-28T11:54:26.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.556+0000 7f2063fff700 1 -- 172.21.15.50:0/1314017636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20640b0e80 con 0x7f20640b6080 2023-11-28T11:54:26.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.560+0000 7f205bfff700 1 -- 172.21.15.50:0/1314017636 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f205c019030 con 0x7f20640b6080 2023-11-28T11:54:26.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.560+0000 7f205bfff700 1 --2- 172.21.15.50:0/1314017636 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2044064ee0 0x7f2044067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.560+0000 7f205bfff700 1 -- 172.21.15.50:0/1314017636 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f205c082710 con 0x7f20640b6080 2023-11-28T11:54:26.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.560+0000 7f2062ffd700 1 --2- 172.21.15.50:0/1314017636 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2044064ee0 0x7f2044067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.560+0000 7f2062ffd700 1 --2- 172.21.15.50:0/1314017636 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2044064ee0 0x7f2044067390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f205400b370 tx=0x7f2054009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:26.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.568+0000 7f205bfff700 1 -- 172.21.15.50:0/1314017636 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f205c0504d0 con 0x7f20640b6080 2023-11-28T11:54:26.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.732+0000 7f2063fff700 1 -- 172.21.15.50:0/1314017636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2064072c20 con 0x7f20640b6080 2023-11-28T11:54:26.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.732+0000 7f205bfff700 1 -- 172.21.15.50:0/1314017636 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f205c017020 con 0x7f20640b6080 2023-11-28T11:54:26.733 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:54:26.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.736+0000 7f2063fff700 1 -- 172.21.15.50:0/1314017636 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2044064ee0 msgr2=0x7f2044067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:26.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.736+0000 7f2063fff700 1 --2- 172.21.15.50:0/1314017636 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2044064ee0 0x7f2044067390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f205400b370 tx=0x7f2054009000 comp rx=0 tx=0).stop 2023-11-28T11:54:26.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.736+0000 7f2063fff700 1 -- 172.21.15.50:0/1314017636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20640b6080 msgr2=0x7f20640d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:26.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.736+0000 7f2063fff700 1 --2- 172.21.15.50:0/1314017636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20640b6080 0x7f20640d0a20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f205c00e750 tx=0x7f205c00ea60 comp rx=0 tx=0).stop 2023-11-28T11:54:26.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.736+0000 7f2063fff700 1 -- 172.21.15.50:0/1314017636 shutdown_connections 2023-11-28T11:54:26.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.736+0000 7f2063fff700 1 --2- 172.21.15.50:0/1314017636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20640b6080 0x7f20640d0a20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.736+0000 7f2063fff700 1 --2- 172.21.15.50:0/1314017636 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2044064ee0 0x7f2044067390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.736+0000 7f2063fff700 1 --2- 172.21.15.50:0/1314017636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20640cfdd0 0x7f20640c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.736+0000 7f2063fff700 1 --2- 172.21.15.50:0/1314017636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20640b2740 0x7f20641f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.736+0000 7f2063fff700 1 -- 172.21.15.50:0/1314017636 >> 172.21.15.50:0/1314017636 conn(0x7f20640cd0a0 msgr2=0x7f20640cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:26.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.736+0000 7f2063fff700 1 -- 172.21.15.50:0/1314017636 shutdown_connections 2023-11-28T11:54:26.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.736+0000 7f2063fff700 1 -- 172.21.15.50:0/1314017636 wait complete. 2023-11-28T11:54:26.748 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:54:26.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.868+0000 7f3b19713700 1 Processor -- start 2023-11-28T11:54:26.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.868+0000 7f3b19713700 1 -- start start 2023-11-28T11:54:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b19713700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3b140cc590 0x7f3b140b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b19713700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b140cfdd0 0x7f3b140b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b19713700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b140cac70 con 0x7f3b140b2570 2023-11-28T11:54:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b19713700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1406c8e0 con 0x7f3b140cc590 2023-11-28T11:54:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b19713700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140b29f0 con 0x7f3b140cfdd0 2023-11-28T11:54:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b13fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3b140cc590 0x7f3b140b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b18f12700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3b140b2570 0x7f3b1415fbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44382/0 (socket says 172.21.15.50:44382) 2023-11-28T11:54:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b18f12700 1 -- 172.21.15.50:0/687878635 learned_addr learned my addr 172.21.15.50:0/687878635 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:26.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b0bfff700 1 --2- 172.21.15.50:0/687878635 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b140cfdd0 0x7f3b140b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b137fe700 1 -- 172.21.15.50:0/687878635 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3923128964 0 0) 0x7f3b140cac70 con 0x7f3b140b2570 2023-11-28T11:54:26.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b137fe700 1 -- 172.21.15.50:0/687878635 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3af40035d0 con 0x7f3b140b2570 2023-11-28T11:54:26.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b13fff700 1 -- 172.21.15.50:0/687878635 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b140cfdd0 msgr2=0x7f3b140b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:26.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b13fff700 1 --2- 172.21.15.50:0/687878635 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b140cfdd0 0x7f3b140b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b13fff700 1 -- 172.21.15.50:0/687878635 >> v1:172.21.15.50:6789/0 conn(0x7f3b140b2570 legacy=0x7f3b1415fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:26.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b13fff700 1 -- 172.21.15.50:0/687878635 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b140cfa50 con 0x7f3b140cc590 2023-11-28T11:54:26.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b13fff700 1 --2- 172.21.15.50:0/687878635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b140cc590 0x7f3b140b0940 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009850 tx=0x7f3b04009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103c3f0f85af7b49 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:26.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b137fe700 1 -- 172.21.15.50:0/687878635 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04011830 con 0x7f3b140cc590 2023-11-28T11:54:26.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b137fe700 1 -- 172.21.15.50:0/687878635 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b04011990 con 0x7f3b140cc590 2023-11-28T11:54:26.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b137fe700 1 -- 172.21.15.50:0/687878635 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04011d40 con 0x7f3b140cc590 2023-11-28T11:54:26.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b19713700 1 -- 172.21.15.50:0/687878635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b140cc590 msgr2=0x7f3b140b0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:26.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b19713700 1 --2- 172.21.15.50:0/687878635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b140cc590 0x7f3b140b0940 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009850 tx=0x7f3b04009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:26.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b19713700 1 -- 172.21.15.50:0/687878635 shutdown_connections 2023-11-28T11:54:26.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b19713700 1 --2- 172.21.15.50:0/687878635 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b140cfdd0 0x7f3b140b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b19713700 1 --2- 172.21.15.50:0/687878635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b140cc590 0x7f3b140b0940 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b19713700 1 -- 172.21.15.50:0/687878635 >> 172.21.15.50:0/687878635 conn(0x7f3b140cd0a0 msgr2=0x7f3b140cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:26.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.872+0000 7f3b19713700 1 -- 172.21.15.50:0/687878635 shutdown_connections 2023-11-28T11:54:26.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.876+0000 7f3b19713700 1 -- 172.21.15.50:0/687878635 wait complete. 2023-11-28T11:54:26.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.876+0000 7f3b19713700 1 Processor -- start 2023-11-28T11:54:26.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.876+0000 7f3b19713700 1 -- start start 2023-11-28T11:54:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b19713700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b140b2570 0x7f3b140b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b19713700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b140cfdd0 0x7f3b1406e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b19713700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b140c4150 0x7f3b1406ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b19713700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14159480 con 0x7f3b140b2570 2023-11-28T11:54:26.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b19713700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140c45e0 con 0x7f3b140cfdd0 2023-11-28T11:54:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b19713700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140c48c0 con 0x7f3b140c4150 2023-11-28T11:54:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b13fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b140b2570 0x7f3b140b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b13fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b140b2570 0x7f3b140b5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60164/0 (socket says 172.21.15.50:60164) 2023-11-28T11:54:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b13fff700 1 -- 172.21.15.50:0/732329314 learned_addr learned my addr 172.21.15.50:0/732329314 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b0bfff700 1 --2- 172.21.15.50:0/732329314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b140cfdd0 0x7f3b1406e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b18f12700 1 --2- 172.21.15.50:0/732329314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b140c4150 0x7f3b1406ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b13fff700 1 -- 172.21.15.50:0/732329314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b140c4150 msgr2=0x7f3b1406ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b13fff700 1 --2- 172.21.15.50:0/732329314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b140c4150 0x7f3b1406ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b13fff700 1 -- 172.21.15.50:0/732329314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b140cfdd0 msgr2=0x7f3b1406e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b13fff700 1 --2- 172.21.15.50:0/732329314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b140cfdd0 0x7f3b1406e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b13fff700 1 -- 172.21.15.50:0/732329314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b040094b0 con 0x7f3b140b2570 2023-11-28T11:54:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b18f12700 1 --2- 172.21.15.50:0/732329314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b140c4150 0x7f3b1406ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:54:26.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b13fff700 1 --2- 172.21.15.50:0/732329314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b140b2570 0x7f3b140b5290 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3b040090b0 tx=0x7f3b04004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:26.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b117fa700 1 -- 172.21.15.50:0/732329314 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04004480 con 0x7f3b140b2570 2023-11-28T11:54:26.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b117fa700 1 -- 172.21.15.50:0/732329314 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0401f070 con 0x7f3b140b2570 2023-11-28T11:54:26.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b19713700 1 -- 172.21.15.50:0/732329314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1406d1d0 con 0x7f3b140b2570 2023-11-28T11:54:26.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b117fa700 1 -- 172.21.15.50:0/732329314 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04003900 con 0x7f3b140b2570 2023-11-28T11:54:26.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b19713700 1 -- 172.21.15.50:0/732329314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b140d0340 con 0x7f3b140b2570 2023-11-28T11:54:26.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.880+0000 7f3b19713700 1 -- 172.21.15.50:0/732329314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1406d4b0 con 0x7f3b140b2570 2023-11-28T11:54:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.884+0000 7f3b117fa700 1 -- 172.21.15.50:0/732329314 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3b0402a020 con 0x7f3b140b2570 2023-11-28T11:54:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.884+0000 7f3b117fa700 1 --2- 172.21.15.50:0/732329314 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3af8064ee0 0x7f3af8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:26.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.884+0000 7f3b117fa700 1 -- 172.21.15.50:0/732329314 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3b04083670 con 0x7f3b140b2570 2023-11-28T11:54:26.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.884+0000 7f3b0bfff700 1 --2- 172.21.15.50:0/732329314 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3af8064ee0 0x7f3af8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:26.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.884+0000 7f3b0bfff700 1 --2- 172.21.15.50:0/732329314 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3af8064ee0 0x7f3af8067390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3b1406f370 tx=0x7f3afc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:26.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:26.896+0000 7f3b117fa700 1 -- 172.21.15.50:0/732329314 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3b04051520 con 0x7f3b140b2570 2023-11-28T11:54:27.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.056+0000 7f3b19713700 1 -- 172.21.15.50:0/732329314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b14072c20 con 0x7f3b140b2570 2023-11-28T11:54:27.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.056+0000 7f3b117fa700 1 -- 172.21.15.50:0/732329314 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b04006ce0 con 0x7f3b140b2570 2023-11-28T11:54:27.058 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:27.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.060+0000 7f3b19713700 1 -- 172.21.15.50:0/732329314 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3af8064ee0 msgr2=0x7f3af8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.060+0000 7f3b19713700 1 --2- 172.21.15.50:0/732329314 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3af8064ee0 0x7f3af8067390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3b1406f370 tx=0x7f3afc008040 comp rx=0 tx=0).stop 2023-11-28T11:54:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.060+0000 7f3b19713700 1 -- 172.21.15.50:0/732329314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b140b2570 msgr2=0x7f3b140b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.060+0000 7f3b19713700 1 --2- 172.21.15.50:0/732329314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b140b2570 0x7f3b140b5290 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3b040090b0 tx=0x7f3b04004770 comp rx=0 tx=0).stop 2023-11-28T11:54:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.060+0000 7f3b19713700 1 -- 172.21.15.50:0/732329314 shutdown_connections 2023-11-28T11:54:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.060+0000 7f3b19713700 1 --2- 172.21.15.50:0/732329314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b140c4150 0x7f3b1406ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.060+0000 7f3b19713700 1 --2- 172.21.15.50:0/732329314 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3af8064ee0 0x7f3af8067390 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.060+0000 7f3b19713700 1 --2- 172.21.15.50:0/732329314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b140cfdd0 0x7f3b1406e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.060+0000 7f3b19713700 1 --2- 172.21.15.50:0/732329314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b140b2570 0x7f3b140b5290 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.060+0000 7f3b19713700 1 -- 172.21.15.50:0/732329314 >> 172.21.15.50:0/732329314 conn(0x7f3b140cd0a0 msgr2=0x7f3b14160240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:27.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.060+0000 7f3b19713700 1 -- 172.21.15.50:0/732329314 shutdown_connections 2023-11-28T11:54:27.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.060+0000 7f3b19713700 1 -- 172.21.15.50:0/732329314 wait complete. 2023-11-28T11:54:27.074 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:54:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.200+0000 7f15677c2700 1 Processor -- start 2023-11-28T11:54:27.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.200+0000 7f15677c2700 1 -- start start 2023-11-28T11:54:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.200+0000 7f15677c2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1560160ac0 0x7f15600b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.200+0000 7f15677c2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f15600cd1c0 0x7f15600b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.200+0000 7f15677c2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15600d0740 con 0x7f15600b45f0 2023-11-28T11:54:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.200+0000 7f15677c2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15600b4f00 con 0x7f1560160ac0 2023-11-28T11:54:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.200+0000 7f15677c2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15600d0990 con 0x7f15600cd1c0 2023-11-28T11:54:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.200+0000 7f1564d5d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1560160ac0 0x7f15600b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.200+0000 7f1564d5d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1560160ac0 0x7f15600b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60180/0 (socket says 172.21.15.50:60180) 2023-11-28T11:54:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.200+0000 7f1564d5d700 1 -- 172.21.15.50:0/216708805 learned_addr learned my addr 172.21.15.50:0/216708805 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:27.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.200+0000 7f1565d5f700 1 --2- 172.21.15.50:0/216708805 >> v2:172.21.15.192:3300/0 conn(0x7f15600cd1c0 0x7f15600b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.200+0000 7f1564d5d700 1 -- 172.21.15.50:0/216708805 >> v2:172.21.15.192:3300/0 conn(0x7f15600cd1c0 msgr2=0x7f15600b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.200+0000 7f1564d5d700 1 --2- 172.21.15.50:0/216708805 >> v2:172.21.15.192:3300/0 conn(0x7f15600cd1c0 0x7f15600b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.200+0000 7f1564d5d700 1 -- 172.21.15.50:0/216708805 >> v1:172.21.15.192:6789/0 conn(0x7f15600b45f0 legacy=0x7f15600d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.200+0000 7f1564d5d700 1 -- 172.21.15.50:0/216708805 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15600d0c70 con 0x7f1560160ac0 2023-11-28T11:54:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f1564d5d700 1 --2- 172.21.15.50:0/216708805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1560160ac0 0x7f15600b49c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f156006b5c0 tx=0x7f1550009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d54bf04985c82f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f1557fff700 1 -- 172.21.15.50:0/216708805 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1550011830 con 0x7f1560160ac0 2023-11-28T11:54:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f1557fff700 1 -- 172.21.15.50:0/216708805 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1550011990 con 0x7f1560160ac0 2023-11-28T11:54:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f1557fff700 1 -- 172.21.15.50:0/216708805 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1550011d20 con 0x7f1560160ac0 2023-11-28T11:54:27.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f15677c2700 1 -- 172.21.15.50:0/216708805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1560160ac0 msgr2=0x7f15600b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f15677c2700 1 --2- 172.21.15.50:0/216708805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1560160ac0 0x7f15600b49c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f156006b5c0 tx=0x7f1550009bf0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f15677c2700 1 -- 172.21.15.50:0/216708805 shutdown_connections 2023-11-28T11:54:27.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f15677c2700 1 --2- 172.21.15.50:0/216708805 >> v2:172.21.15.192:3300/0 conn(0x7f15600cd1c0 0x7f15600b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f15677c2700 1 --2- 172.21.15.50:0/216708805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1560160ac0 0x7f15600b49c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f15677c2700 1 -- 172.21.15.50:0/216708805 >> 172.21.15.50:0/216708805 conn(0x7f156006cb40 msgr2=0x7f15600cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:27.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f15677c2700 1 -- 172.21.15.50:0/216708805 shutdown_connections 2023-11-28T11:54:27.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f15677c2700 1 -- 172.21.15.50:0/216708805 wait complete. 2023-11-28T11:54:27.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f15677c2700 1 Processor -- start 2023-11-28T11:54:27.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f15677c2700 1 -- start start 2023-11-28T11:54:27.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f15677c2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15600b45f0 0x7f15600cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f15677c2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15600cd1c0 0x7f156015c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f15677c2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1560160ac0 0x7f1560152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f15677c2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156015cdc0 con 0x7f15600b45f0 2023-11-28T11:54:27.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f15677c2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156015d040 con 0x7f1560160ac0 2023-11-28T11:54:27.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f15677c2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156015d320 con 0x7f15600cd1c0 2023-11-28T11:54:27.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f156555e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15600b45f0 0x7f15600cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f156555e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15600b45f0 0x7f15600cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60184/0 (socket says 172.21.15.50:60184) 2023-11-28T11:54:27.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f156555e700 1 -- 172.21.15.50:0/1961328994 learned_addr learned my addr 172.21.15.50:0/1961328994 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:27.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f1565d5f700 1 --2- 172.21.15.50:0/1961328994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1560160ac0 0x7f1560152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.204+0000 7f1564d5d700 1 --2- 172.21.15.50:0/1961328994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15600cd1c0 0x7f156015c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.208+0000 7f156555e700 1 -- 172.21.15.50:0/1961328994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15600cd1c0 msgr2=0x7f156015c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.208+0000 7f156555e700 1 --2- 172.21.15.50:0/1961328994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15600cd1c0 0x7f156015c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.208+0000 7f156555e700 1 -- 172.21.15.50:0/1961328994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1560160ac0 msgr2=0x7f1560152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.208+0000 7f156555e700 1 --2- 172.21.15.50:0/1961328994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1560160ac0 0x7f1560152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.208+0000 7f156555e700 1 -- 172.21.15.50:0/1961328994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1550009570 con 0x7f15600b45f0 2023-11-28T11:54:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.208+0000 7f1564d5d700 1 --2- 172.21.15.50:0/1961328994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15600cd1c0 0x7f156015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.208+0000 7f156555e700 1 --2- 172.21.15.50:0/1961328994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15600b45f0 0x7f15600cc0a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f155c00c500 tx=0x7f155c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.208+0000 7f1555ffb700 1 -- 172.21.15.50:0/1961328994 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c0052d0 con 0x7f15600b45f0 2023-11-28T11:54:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.208+0000 7f1555ffb700 1 -- 172.21.15.50:0/1961328994 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c005430 con 0x7f15600b45f0 2023-11-28T11:54:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.208+0000 7f15677c2700 1 -- 172.21.15.50:0/1961328994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15600d1230 con 0x7f15600b45f0 2023-11-28T11:54:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.208+0000 7f1555ffb700 1 -- 172.21.15.50:0/1961328994 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c0055a0 con 0x7f15600b45f0 2023-11-28T11:54:27.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.208+0000 7f15677c2700 1 -- 172.21.15.50:0/1961328994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15600d0f50 con 0x7f15600b45f0 2023-11-28T11:54:27.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.208+0000 7f15677c2700 1 -- 172.21.15.50:0/1961328994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156015c660 con 0x7f15600b45f0 2023-11-28T11:54:27.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.208+0000 7f1555ffb700 1 -- 172.21.15.50:0/1961328994 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f155c019030 con 0x7f15600b45f0 2023-11-28T11:54:27.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.212+0000 7f1555ffb700 1 --2- 172.21.15.50:0/1961328994 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1544064ee0 0x7f1544067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.212+0000 7f1555ffb700 1 -- 172.21.15.50:0/1961328994 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f155c081540 con 0x7f15600b45f0 2023-11-28T11:54:27.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.212+0000 7f1564d5d700 1 --2- 172.21.15.50:0/1961328994 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1544064ee0 0x7f1544067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.212+0000 7f1564d5d700 1 --2- 172.21.15.50:0/1961328994 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1544064ee0 0x7f1544067390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1550014040 tx=0x7f1550008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:27.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.216+0000 7f1555ffb700 1 -- 172.21.15.50:0/1961328994 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f155c04f370 con 0x7f15600b45f0 2023-11-28T11:54:27.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.384+0000 7f15677c2700 1 -- 172.21.15.50:0/1961328994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1560072c20 con 0x7f15600b45f0 2023-11-28T11:54:27.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.384+0000 7f1555ffb700 1 -- 172.21.15.50:0/1961328994 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f155c052990 con 0x7f15600b45f0 2023-11-28T11:54:27.386 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:54:27.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.384+0000 7f15677c2700 1 -- 172.21.15.50:0/1961328994 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1544064ee0 msgr2=0x7f1544067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.384+0000 7f15677c2700 1 --2- 172.21.15.50:0/1961328994 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1544064ee0 0x7f1544067390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1550014040 tx=0x7f1550008030 comp rx=0 tx=0).stop 2023-11-28T11:54:27.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.384+0000 7f15677c2700 1 -- 172.21.15.50:0/1961328994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15600b45f0 msgr2=0x7f15600cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.384+0000 7f15677c2700 1 --2- 172.21.15.50:0/1961328994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15600b45f0 0x7f15600cc0a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f155c00c500 tx=0x7f155c00c810 comp rx=0 tx=0).stop 2023-11-28T11:54:27.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.384+0000 7f15677c2700 1 -- 172.21.15.50:0/1961328994 shutdown_connections 2023-11-28T11:54:27.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.384+0000 7f15677c2700 1 --2- 172.21.15.50:0/1961328994 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1544064ee0 0x7f1544067390 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.384+0000 7f15677c2700 1 --2- 172.21.15.50:0/1961328994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1560160ac0 0x7f1560152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.384+0000 7f15677c2700 1 --2- 172.21.15.50:0/1961328994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15600cd1c0 0x7f156015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.384+0000 7f15677c2700 1 --2- 172.21.15.50:0/1961328994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15600b45f0 0x7f15600cc0a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.384+0000 7f15677c2700 1 -- 172.21.15.50:0/1961328994 >> 172.21.15.50:0/1961328994 conn(0x7f156006cb40 msgr2=0x7f156015fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:27.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.384+0000 7f15677c2700 1 -- 172.21.15.50:0/1961328994 shutdown_connections 2023-11-28T11:54:27.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.388+0000 7f15677c2700 1 -- 172.21.15.50:0/1961328994 wait complete. 2023-11-28T11:54:27.400 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:54:27.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.508+0000 7f08bdd03700 1 Processor -- start 2023-11-28T11:54:27.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.508+0000 7f08bdd03700 1 -- start start 2023-11-28T11:54:27.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.508+0000 7f08bdd03700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08b815c1b0 0x7f08b8160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.508+0000 7f08bdd03700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08b8069c40 0x7f08b806a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.508+0000 7f08bdd03700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b8160cd0 con 0x7f08b806a5d0 2023-11-28T11:54:27.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.508+0000 7f08bdd03700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b806aa30 con 0x7f08b815c1b0 2023-11-28T11:54:27.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.508+0000 7f08bdd03700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80cd1e0 con 0x7f08b8069c40 2023-11-28T11:54:27.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.508+0000 7f08b77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08b815c1b0 0x7f08b8160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.508+0000 7f08b7fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f08b806a5d0 0x7f08b80cedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44388/0 (socket says 172.21.15.50:44388) 2023-11-28T11:54:27.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.508+0000 7f08b7fff700 1 -- 172.21.15.50:0/3799765714 learned_addr learned my addr 172.21.15.50:0/3799765714 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:27.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.508+0000 7f08b6ffd700 1 --2- 172.21.15.50:0/3799765714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08b8069c40 0x7f08b806a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.508+0000 7f08b77fe700 1 -- 172.21.15.50:0/3799765714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08b8069c40 msgr2=0x7f08b806a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.508+0000 7f08b77fe700 1 --2- 172.21.15.50:0/3799765714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08b8069c40 0x7f08b806a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.508+0000 7f08b77fe700 1 -- 172.21.15.50:0/3799765714 >> v1:172.21.15.50:6789/0 conn(0x7f08b806a5d0 legacy=0x7f08b80cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.508+0000 7f08b77fe700 1 -- 172.21.15.50:0/3799765714 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b80cd4c0 con 0x7f08b815c1b0 2023-11-28T11:54:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.508+0000 7f08b67fc700 1 -- 172.21.15.50:0/3799765714 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383759254 0 0) 0x7f08b8160cd0 con 0x7f08b806a5d0 2023-11-28T11:54:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.508+0000 7f08b77fe700 1 --2- 172.21.15.50:0/3799765714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08b815c1b0 0x7f08b8160790 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009850 tx=0x7f08a8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a9bda5091ceba7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.512+0000 7f08b67fc700 1 -- 172.21.15.50:0/3799765714 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8011830 con 0x7f08b815c1b0 2023-11-28T11:54:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.512+0000 7f08b67fc700 1 -- 172.21.15.50:0/3799765714 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a8011990 con 0x7f08b815c1b0 2023-11-28T11:54:27.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.512+0000 7f08b67fc700 1 -- 172.21.15.50:0/3799765714 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8011d40 con 0x7f08b815c1b0 2023-11-28T11:54:27.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.512+0000 7f08bdd03700 1 -- 172.21.15.50:0/3799765714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08b815c1b0 msgr2=0x7f08b8160790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.512+0000 7f08bdd03700 1 --2- 172.21.15.50:0/3799765714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08b815c1b0 0x7f08b8160790 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009850 tx=0x7f08a8009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:27.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.512+0000 7f08bdd03700 1 -- 172.21.15.50:0/3799765714 shutdown_connections 2023-11-28T11:54:27.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.512+0000 7f08bdd03700 1 --2- 172.21.15.50:0/3799765714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08b8069c40 0x7f08b806a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.512+0000 7f08bdd03700 1 --2- 172.21.15.50:0/3799765714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08b815c1b0 0x7f08b8160790 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.512+0000 7f08bdd03700 1 -- 172.21.15.50:0/3799765714 >> 172.21.15.50:0/3799765714 conn(0x7f08b806beb0 msgr2=0x7f08b806c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:27.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.512+0000 7f08bdd03700 1 -- 172.21.15.50:0/3799765714 shutdown_connections 2023-11-28T11:54:27.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.512+0000 7f08bdd03700 1 -- 172.21.15.50:0/3799765714 wait complete. 2023-11-28T11:54:27.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.512+0000 7f08bdd03700 1 Processor -- start 2023-11-28T11:54:27.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.512+0000 7f08bdd03700 1 -- start start 2023-11-28T11:54:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08bdd03700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08b8069c40 0x7f08b80d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08bdd03700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08b806a5d0 0x7f08b8158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08bdd03700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08b815c1b0 0x7f08b80c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08bdd03700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b81e5e50 con 0x7f08b8069c40 2023-11-28T11:54:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08bdd03700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b81e54b0 con 0x7f08b806a5d0 2023-11-28T11:54:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08bdd03700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b81e5790 con 0x7f08b815c1b0 2023-11-28T11:54:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08b77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08b8069c40 0x7f08b80d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08b77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08b8069c40 0x7f08b80d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60208/0 (socket says 172.21.15.50:60208) 2023-11-28T11:54:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08b77fe700 1 -- 172.21.15.50:0/126655465 learned_addr learned my addr 172.21.15.50:0/126655465 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08b6ffd700 1 --2- 172.21.15.50:0/126655465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08b806a5d0 0x7f08b8158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08b7fff700 1 --2- 172.21.15.50:0/126655465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08b815c1b0 0x7f08b80c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08b77fe700 1 -- 172.21.15.50:0/126655465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08b815c1b0 msgr2=0x7f08b80c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08b77fe700 1 --2- 172.21.15.50:0/126655465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08b815c1b0 0x7f08b80c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08b77fe700 1 -- 172.21.15.50:0/126655465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08b806a5d0 msgr2=0x7f08b8158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08b77fe700 1 --2- 172.21.15.50:0/126655465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08b806a5d0 0x7f08b8158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08b77fe700 1 -- 172.21.15.50:0/126655465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a80094b0 con 0x7f08b8069c40 2023-11-28T11:54:27.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08b6ffd700 1 --2- 172.21.15.50:0/126655465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08b806a5d0 0x7f08b8158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:27.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08b77fe700 1 --2- 172.21.15.50:0/126655465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08b8069c40 0x7f08b80d1c40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f08a8014040 tx=0x7f08a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:27.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08affff700 1 -- 172.21.15.50:0/126655465 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8019980 con 0x7f08b8069c40 2023-11-28T11:54:27.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08affff700 1 -- 172.21.15.50:0/126655465 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a801e070 con 0x7f08b8069c40 2023-11-28T11:54:27.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08bdd03700 1 -- 172.21.15.50:0/126655465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b80d06c0 con 0x7f08b8069c40 2023-11-28T11:54:27.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08affff700 1 -- 172.21.15.50:0/126655465 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8019d20 con 0x7f08b8069c40 2023-11-28T11:54:27.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.516+0000 7f08bdd03700 1 -- 172.21.15.50:0/126655465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b80cd7a0 con 0x7f08b8069c40 2023-11-28T11:54:27.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.520+0000 7f08bdd03700 1 -- 172.21.15.50:0/126655465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b80d09a0 con 0x7f08b8069c40 2023-11-28T11:54:27.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.520+0000 7f08affff700 1 -- 172.21.15.50:0/126655465 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f08a800f050 con 0x7f08b8069c40 2023-11-28T11:54:27.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.520+0000 7f08affff700 1 --2- 172.21.15.50:0/126655465 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0898064ee0 0x7f0898067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.520+0000 7f08affff700 1 -- 172.21.15.50:0/126655465 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f08a80831c0 con 0x7f08b8069c40 2023-11-28T11:54:27.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.520+0000 7f08b6ffd700 1 --2- 172.21.15.50:0/126655465 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0898064ee0 0x7f0898067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.524+0000 7f08b6ffd700 1 --2- 172.21.15.50:0/126655465 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0898064ee0 0x7f0898067390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f08b80b8340 tx=0x7f08a000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:27.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.528+0000 7f08affff700 1 -- 172.21.15.50:0/126655465 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f08a8050f80 con 0x7f08b8069c40 2023-11-28T11:54:27.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.692+0000 7f08bdd03700 1 -- 172.21.15.50:0/126655465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f08b8072500 con 0x7f08b8069c40 2023-11-28T11:54:27.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.692+0000 7f08affff700 1 -- 172.21.15.50:0/126655465 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f08a80200a0 con 0x7f08b8069c40 2023-11-28T11:54:27.693 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:27.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.696+0000 7f08bdd03700 1 -- 172.21.15.50:0/126655465 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0898064ee0 msgr2=0x7f0898067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.696+0000 7f08bdd03700 1 --2- 172.21.15.50:0/126655465 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0898064ee0 0x7f0898067390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f08b80b8340 tx=0x7f08a000b040 comp rx=0 tx=0).stop 2023-11-28T11:54:27.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.696+0000 7f08bdd03700 1 -- 172.21.15.50:0/126655465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08b8069c40 msgr2=0x7f08b80d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.696+0000 7f08bdd03700 1 --2- 172.21.15.50:0/126655465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08b8069c40 0x7f08b80d1c40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f08a8014040 tx=0x7f08a8004770 comp rx=0 tx=0).stop 2023-11-28T11:54:27.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.696+0000 7f08bdd03700 1 -- 172.21.15.50:0/126655465 shutdown_connections 2023-11-28T11:54:27.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.696+0000 7f08bdd03700 1 --2- 172.21.15.50:0/126655465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08b815c1b0 0x7f08b80c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.696+0000 7f08bdd03700 1 --2- 172.21.15.50:0/126655465 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0898064ee0 0x7f0898067390 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.696+0000 7f08bdd03700 1 --2- 172.21.15.50:0/126655465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08b806a5d0 0x7f08b8158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.696+0000 7f08bdd03700 1 --2- 172.21.15.50:0/126655465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08b8069c40 0x7f08b80d1c40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.696+0000 7f08bdd03700 1 -- 172.21.15.50:0/126655465 >> 172.21.15.50:0/126655465 conn(0x7f08b806beb0 msgr2=0x7f08b80b3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:27.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.696+0000 7f08bdd03700 1 -- 172.21.15.50:0/126655465 shutdown_connections 2023-11-28T11:54:27.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.696+0000 7f08bdd03700 1 -- 172.21.15.50:0/126655465 wait complete. 2023-11-28T11:54:27.714 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:27.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f456c8700 1 Processor -- start 2023-11-28T11:54:27.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f456c8700 1 -- start start 2023-11-28T11:54:27.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f456c8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f400c1ac0 0x7f8f40069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f456c8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8f400ceef0 0x7f8f4006a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f456c8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f400cae70 con 0x7f8f401606b0 2023-11-28T11:54:27.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f456c8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f400cbc10 con 0x7f8f400ceef0 2023-11-28T11:54:27.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f456c8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f400cb130 con 0x7f8f400c1ac0 2023-11-28T11:54:27.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f44ec7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8f400ceef0 0x7f8f4006a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f3f7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f400c1ac0 0x7f8f40069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f3f7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f400c1ac0 0x7f8f40069c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:60540/0 (socket says 172.21.15.50:60540) 2023-11-28T11:54:27.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f3f7fe700 1 -- 172.21.15.50:0/2845406445 learned_addr learned my addr 172.21.15.50:0/2845406445 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:27.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f3f7fe700 1 -- 172.21.15.50:0/2845406445 >> v2:172.21.15.50:3300/0 conn(0x7f8f400ceef0 msgr2=0x7f8f4006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:27.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f3f7fe700 1 --2- 172.21.15.50:0/2845406445 >> v2:172.21.15.50:3300/0 conn(0x7f8f400ceef0 0x7f8f4006a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f3f7fe700 1 -- 172.21.15.50:0/2845406445 >> v1:172.21.15.192:6789/0 conn(0x7f8f401606b0 legacy=0x7f8f400c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f3effd700 1 -- 172.21.15.50:0/2845406445 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019650684 0 0) 0x7f8f400cae70 con 0x7f8f401606b0 2023-11-28T11:54:27.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f3f7fe700 1 -- 172.21.15.50:0/2845406445 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f400cb410 con 0x7f8f400c1ac0 2023-11-28T11:54:27.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f3f7fe700 1 --2- 172.21.15.50:0/2845406445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f400c1ac0 0x7f8f40069c40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009e50 tx=0x7f8f3800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66253e7715bca46b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:27.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f3effd700 1 -- 172.21.15.50:0/2845406445 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3800e070 con 0x7f8f400c1ac0 2023-11-28T11:54:27.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f3effd700 1 -- 172.21.15.50:0/2845406445 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3800b910 con 0x7f8f400c1ac0 2023-11-28T11:54:27.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f3effd700 1 -- 172.21.15.50:0/2845406445 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3800bcc0 con 0x7f8f400c1ac0 2023-11-28T11:54:27.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f456c8700 1 -- 172.21.15.50:0/2845406445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f400c1ac0 msgr2=0x7f8f40069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f456c8700 1 --2- 172.21.15.50:0/2845406445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f400c1ac0 0x7f8f40069c40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009e50 tx=0x7f8f3800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:27.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f456c8700 1 -- 172.21.15.50:0/2845406445 shutdown_connections 2023-11-28T11:54:27.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f456c8700 1 --2- 172.21.15.50:0/2845406445 >> v2:172.21.15.50:3300/0 conn(0x7f8f400ceef0 0x7f8f4006a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f456c8700 1 --2- 172.21.15.50:0/2845406445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f400c1ac0 0x7f8f40069c40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.828+0000 7f8f456c8700 1 -- 172.21.15.50:0/2845406445 >> 172.21.15.50:0/2845406445 conn(0x7f8f400ce3e0 msgr2=0x7f8f400ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:27.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f456c8700 1 -- 172.21.15.50:0/2845406445 shutdown_connections 2023-11-28T11:54:27.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f456c8700 1 -- 172.21.15.50:0/2845406445 wait complete. 2023-11-28T11:54:27.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f456c8700 1 Processor -- start 2023-11-28T11:54:27.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f456c8700 1 -- start start 2023-11-28T11:54:27.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f456c8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f400c1ac0 0x7f8f40097910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f456c8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f400ceef0 0x7f8f40160a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f456c8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f401606b0 0x7f8f400c2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f456c8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f400710b0 con 0x7f8f400c1ac0 2023-11-28T11:54:27.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f456c8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f400c2110 con 0x7f8f401606b0 2023-11-28T11:54:27.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f456c8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f40097e50 con 0x7f8f400ceef0 2023-11-28T11:54:27.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f3ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f400c1ac0 0x7f8f40097910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f3ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f400c1ac0 0x7f8f40097910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60230/0 (socket says 172.21.15.50:60230) 2023-11-28T11:54:27.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f3ffff700 1 -- 172.21.15.50:0/3628729933 learned_addr learned my addr 172.21.15.50:0/3628729933 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:27.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f3f7fe700 1 --2- 172.21.15.50:0/3628729933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f400ceef0 0x7f8f40160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f44ec7700 1 --2- 172.21.15.50:0/3628729933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f401606b0 0x7f8f400c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f3ffff700 1 -- 172.21.15.50:0/3628729933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f400ceef0 msgr2=0x7f8f40160a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f3ffff700 1 --2- 172.21.15.50:0/3628729933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f400ceef0 0x7f8f40160a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f3ffff700 1 -- 172.21.15.50:0/3628729933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f401606b0 msgr2=0x7f8f400c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:27.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f3ffff700 1 --2- 172.21.15.50:0/3628729933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f401606b0 0x7f8f400c2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:27.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f3ffff700 1 -- 172.21.15.50:0/3628729933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f38009b30 con 0x7f8f400c1ac0 2023-11-28T11:54:27.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f44ec7700 1 --2- 172.21.15.50:0/3628729933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f401606b0 0x7f8f400c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:27.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f3ffff700 1 --2- 172.21.15.50:0/3628729933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f400c1ac0 0x7f8f40097910 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000c520 tx=0x7f8f3000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:27.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f3cff9700 1 -- 172.21.15.50:0/3628729933 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f300054e0 con 0x7f8f400c1ac0 2023-11-28T11:54:27.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f3cff9700 1 -- 172.21.15.50:0/3628729933 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f300036a0 con 0x7f8f400c1ac0 2023-11-28T11:54:27.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f456c8700 1 -- 172.21.15.50:0/3628729933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f400b36c0 con 0x7f8f400c1ac0 2023-11-28T11:54:27.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f3cff9700 1 -- 172.21.15.50:0/3628729933 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f30003a50 con 0x7f8f400c1ac0 2023-11-28T11:54:27.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.832+0000 7f8f456c8700 1 -- 172.21.15.50:0/3628729933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f400cb6f0 con 0x7f8f400c1ac0 2023-11-28T11:54:27.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.836+0000 7f8f456c8700 1 -- 172.21.15.50:0/3628729933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f400ad610 con 0x7f8f400c1ac0 2023-11-28T11:54:27.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.836+0000 7f8f3cff9700 1 -- 172.21.15.50:0/3628729933 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8f30019030 con 0x7f8f400c1ac0 2023-11-28T11:54:27.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.836+0000 7f8f3cff9700 1 --2- 172.21.15.50:0/3628729933 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8f20064ee0 0x7f8f20067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:27.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.836+0000 7f8f3cff9700 1 -- 172.21.15.50:0/3628729933 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8f30081580 con 0x7f8f400c1ac0 2023-11-28T11:54:27.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.836+0000 7f8f3f7fe700 1 --2- 172.21.15.50:0/3628729933 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8f20064ee0 0x7f8f20067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:27.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.840+0000 7f8f3f7fe700 1 --2- 172.21.15.50:0/3628729933 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8f20064ee0 0x7f8f20067390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8f400c1eb0 tx=0x7f8f38009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:27.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:27.844+0000 7f8f3cff9700 1 -- 172.21.15.50:0/3628729933 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8f3004f340 con 0x7f8f400c1ac0 2023-11-28T11:54:28.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.012+0000 7f8f456c8700 1 -- 172.21.15.50:0/3628729933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f40072500 con 0x7f8f400c1ac0 2023-11-28T11:54:28.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.016+0000 7f8f3cff9700 1 -- 172.21.15.50:0/3628729933 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f8f30052960 con 0x7f8f400c1ac0 2023-11-28T11:54:28.016 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:28.016 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:53:45.231747+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:28.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.016+0000 7f8f456c8700 1 -- 172.21.15.50:0/3628729933 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8f20064ee0 msgr2=0x7f8f20067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.016+0000 7f8f456c8700 1 --2- 172.21.15.50:0/3628729933 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8f20064ee0 0x7f8f20067390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8f400c1eb0 tx=0x7f8f38009000 comp rx=0 tx=0).stop 2023-11-28T11:54:28.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.016+0000 7f8f456c8700 1 -- 172.21.15.50:0/3628729933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f400c1ac0 msgr2=0x7f8f40097910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.016+0000 7f8f456c8700 1 --2- 172.21.15.50:0/3628729933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f400c1ac0 0x7f8f40097910 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000c520 tx=0x7f8f3000c830 comp rx=0 tx=0).stop 2023-11-28T11:54:28.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.016+0000 7f8f456c8700 1 -- 172.21.15.50:0/3628729933 shutdown_connections 2023-11-28T11:54:28.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.016+0000 7f8f456c8700 1 --2- 172.21.15.50:0/3628729933 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8f20064ee0 0x7f8f20067390 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.016+0000 7f8f456c8700 1 --2- 172.21.15.50:0/3628729933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f401606b0 0x7f8f400c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.016+0000 7f8f456c8700 1 --2- 172.21.15.50:0/3628729933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f400ceef0 0x7f8f40160a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.016+0000 7f8f456c8700 1 --2- 172.21.15.50:0/3628729933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f400c1ac0 0x7f8f40097910 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.016+0000 7f8f456c8700 1 -- 172.21.15.50:0/3628729933 >> 172.21.15.50:0/3628729933 conn(0x7f8f400ce3e0 msgr2=0x7f8f4006b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:28.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.016+0000 7f8f456c8700 1 -- 172.21.15.50:0/3628729933 shutdown_connections 2023-11-28T11:54:28.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.016+0000 7f8f456c8700 1 -- 172.21.15.50:0/3628729933 wait complete. 2023-11-28T11:54:28.032 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:53:38.462826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:53:39.778621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:53:42.870360+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:54:28.032 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:54:28.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.156+0000 7f47a681a700 1 Processor -- start 2023-11-28T11:54:28.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.156+0000 7f47a681a700 1 -- start start 2023-11-28T11:54:28.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a681a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47a00b2740 0x7f47a0166f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:28.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a681a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a00cac70 con 0x7f47a00cc590 2023-11-28T11:54:28.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a681a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a00cfa50 con 0x7f47a00cfdd0 2023-11-28T11:54:28.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a681a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a006c8e0 con 0x7f47a00b2740 2023-11-28T11:54:28.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a5818700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f47a00cc590 0x7f47a00b0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44390/0 (socket says 172.21.15.50:44390) 2023-11-28T11:54:28.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a5818700 1 -- 172.21.15.50:0/77102385 learned_addr learned my addr 172.21.15.50:0/77102385 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:28.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a6019700 1 --2- 172.21.15.50:0/77102385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47a00b2740 0x7f47a0166f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:28.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a4816700 1 -- 172.21.15.50:0/77102385 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263641899 0 0) 0x7f47a00cac70 con 0x7f47a00cc590 2023-11-28T11:54:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a4816700 1 -- 172.21.15.50:0/77102385 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f478c0035d0 con 0x7f47a00cc590 2023-11-28T11:54:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a4816700 1 -- 172.21.15.50:0/77102385 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104047045 0 0) 0x7f47a00cfa50 con 0x7f47a00cfdd0 2023-11-28T11:54:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a4816700 1 -- 172.21.15.50:0/77102385 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47a00cac70 con 0x7f47a00cfdd0 2023-11-28T11:54:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a6019700 1 -- 172.21.15.50:0/77102385 >> v1:172.21.15.192:6789/0 conn(0x7f47a00cfdd0 legacy=0x7f47a00b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a6019700 1 -- 172.21.15.50:0/77102385 >> v1:172.21.15.50:6789/0 conn(0x7f47a00cc590 legacy=0x7f47a00b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a6019700 1 -- 172.21.15.50:0/77102385 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a00d0340 con 0x7f47a00b2740 2023-11-28T11:54:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a6019700 1 --2- 172.21.15.50:0/77102385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47a00b2740 0x7f47a0166f80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4798009df0 tx=0x7f479800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57a4e0f0b4c5b92a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a4816700 1 -- 172.21.15.50:0/77102385 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800e070 con 0x7f47a00b2740 2023-11-28T11:54:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a4816700 1 -- 172.21.15.50:0/77102385 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479800bae0 con 0x7f47a00b2740 2023-11-28T11:54:28.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a4816700 1 -- 172.21.15.50:0/77102385 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800be50 con 0x7f47a00b2740 2023-11-28T11:54:28.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a681a700 1 -- 172.21.15.50:0/77102385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47a00b2740 msgr2=0x7f47a0166f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a681a700 1 --2- 172.21.15.50:0/77102385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47a00b2740 0x7f47a0166f80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4798009df0 tx=0x7f479800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:28.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a681a700 1 -- 172.21.15.50:0/77102385 shutdown_connections 2023-11-28T11:54:28.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a681a700 1 --2- 172.21.15.50:0/77102385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47a00b2740 0x7f47a0166f80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a681a700 1 -- 172.21.15.50:0/77102385 >> 172.21.15.50:0/77102385 conn(0x7f47a00cd0a0 msgr2=0x7f47a00cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:28.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a681a700 1 -- 172.21.15.50:0/77102385 shutdown_connections 2023-11-28T11:54:28.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.160+0000 7f47a681a700 1 -- 172.21.15.50:0/77102385 wait complete. 2023-11-28T11:54:28.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.164+0000 7f47a681a700 1 Processor -- start 2023-11-28T11:54:28.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.164+0000 7f47a681a700 1 -- start start 2023-11-28T11:54:28.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.164+0000 7f47a681a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a00b2740 0x7f47a006ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:28.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.164+0000 7f47a681a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47a00cfdd0 0x7f47a00c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:28.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.164+0000 7f47a681a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47a00c9280 0x7f47a01f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:28.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.164+0000 7f47a681a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a00c97e0 con 0x7f47a00b2740 2023-11-28T11:54:28.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.164+0000 7f47a681a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a00c9ac0 con 0x7f47a00cfdd0 2023-11-28T11:54:28.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.164+0000 7f47a681a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a00c9da0 con 0x7f47a00c9280 2023-11-28T11:54:28.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.168+0000 7f47a5818700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a00b2740 0x7f47a006ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:28.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.168+0000 7f47a5818700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a00b2740 0x7f47a006ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60246/0 (socket says 172.21.15.50:60246) 2023-11-28T11:54:28.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.168+0000 7f47a5818700 1 -- 172.21.15.50:0/982980685 learned_addr learned my addr 172.21.15.50:0/982980685 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:28.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.168+0000 7f47a6019700 1 --2- 172.21.15.50:0/982980685 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47a00c9280 0x7f47a01f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:28.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.168+0000 7f47a5017700 1 --2- 172.21.15.50:0/982980685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47a00cfdd0 0x7f47a00c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:28.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.168+0000 7f47a5818700 1 -- 172.21.15.50:0/982980685 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47a00c9280 msgr2=0x7f47a01f3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.168+0000 7f47a5818700 1 --2- 172.21.15.50:0/982980685 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47a00c9280 0x7f47a01f3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.168+0000 7f47a5818700 1 -- 172.21.15.50:0/982980685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47a00cfdd0 msgr2=0x7f47a00c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.168+0000 7f47a5818700 1 --2- 172.21.15.50:0/982980685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47a00cfdd0 0x7f47a00c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.168+0000 7f47a5818700 1 -- 172.21.15.50:0/982980685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4798009a70 con 0x7f47a00b2740 2023-11-28T11:54:28.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.168+0000 7f47a5818700 1 --2- 172.21.15.50:0/982980685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a00b2740 0x7f47a006ec10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f479c00c4d0 tx=0x7f479c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:28.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.168+0000 7f47967fc700 1 -- 172.21.15.50:0/982980685 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c005d90 con 0x7f47a00b2740 2023-11-28T11:54:28.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.168+0000 7f47967fc700 1 -- 172.21.15.50:0/982980685 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479c0070d0 con 0x7f47a00b2740 2023-11-28T11:54:28.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.168+0000 7f47967fc700 1 -- 172.21.15.50:0/982980685 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c007480 con 0x7f47a00b2740 2023-11-28T11:54:28.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.168+0000 7f47a681a700 1 -- 172.21.15.50:0/982980685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a006d4b0 con 0x7f47a00b2740 2023-11-28T11:54:28.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.168+0000 7f47a681a700 1 -- 172.21.15.50:0/982980685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a006d1d0 con 0x7f47a00b2740 2023-11-28T11:54:28.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.168+0000 7f47a681a700 1 -- 172.21.15.50:0/982980685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a00ce520 con 0x7f47a00b2740 2023-11-28T11:54:28.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.172+0000 7f47967fc700 1 -- 172.21.15.50:0/982980685 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f479c019030 con 0x7f47a00b2740 2023-11-28T11:54:28.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.172+0000 7f47967fc700 1 --2- 172.21.15.50:0/982980685 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4784064ee0 0x7f4784067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:28.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.172+0000 7f47967fc700 1 -- 172.21.15.50:0/982980685 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f479c081460 con 0x7f47a00b2740 2023-11-28T11:54:28.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.172+0000 7f47a5017700 1 --2- 172.21.15.50:0/982980685 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4784064ee0 0x7f4784067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:28.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.172+0000 7f47a5017700 1 --2- 172.21.15.50:0/982980685 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4784064ee0 0x7f4784067390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f47a00b0f30 tx=0x7f4790009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:28.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.176+0000 7f47967fc700 1 -- 172.21.15.50:0/982980685 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f479c04f310 con 0x7f47a00b2740 2023-11-28T11:54:28.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.336+0000 7f47a681a700 1 -- 172.21.15.50:0/982980685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f47a0072c20 con 0x7f47a00b2740 2023-11-28T11:54:28.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.336+0000 7f47967fc700 1 -- 172.21.15.50:0/982980685 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f479c052930 con 0x7f47a00b2740 2023-11-28T11:54:28.338 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:54:28.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.340+0000 7f47a681a700 1 -- 172.21.15.50:0/982980685 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4784064ee0 msgr2=0x7f4784067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.340+0000 7f47a681a700 1 --2- 172.21.15.50:0/982980685 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4784064ee0 0x7f4784067390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f47a00b0f30 tx=0x7f4790009040 comp rx=0 tx=0).stop 2023-11-28T11:54:28.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.340+0000 7f47a681a700 1 -- 172.21.15.50:0/982980685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a00b2740 msgr2=0x7f47a006ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.340+0000 7f47a681a700 1 --2- 172.21.15.50:0/982980685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a00b2740 0x7f47a006ec10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f479c00c4d0 tx=0x7f479c00c7e0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.340+0000 7f47a681a700 1 -- 172.21.15.50:0/982980685 shutdown_connections 2023-11-28T11:54:28.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.340+0000 7f47a681a700 1 --2- 172.21.15.50:0/982980685 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47a00c9280 0x7f47a01f3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.340+0000 7f47a681a700 1 --2- 172.21.15.50:0/982980685 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4784064ee0 0x7f4784067390 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.340+0000 7f47a681a700 1 --2- 172.21.15.50:0/982980685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47a00cfdd0 0x7f47a00c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.340+0000 7f47a681a700 1 --2- 172.21.15.50:0/982980685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47a00b2740 0x7f47a006ec10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.340+0000 7f47a681a700 1 -- 172.21.15.50:0/982980685 >> 172.21.15.50:0/982980685 conn(0x7f47a00cd0a0 msgr2=0x7f47a00cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:28.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.340+0000 7f47a681a700 1 -- 172.21.15.50:0/982980685 shutdown_connections 2023-11-28T11:54:28.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.340+0000 7f47a681a700 1 -- 172.21.15.50:0/982980685 wait complete. 2023-11-28T11:54:28.358 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:54:28.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.476+0000 7f5b2ffff700 1 Processor -- start 2023-11-28T11:54:28.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.476+0000 7f5b2ffff700 1 -- start start 2023-11-28T11:54:28.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.476+0000 7f5b2ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5b300b1ae0 0x7f5b3006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:28.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.476+0000 7f5b2ffff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3006a9c0 con 0x7f5b300cf0e0 2023-11-28T11:54:28.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.476+0000 7f5b2ffff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3006aca0 con 0x7f5b3006a4c0 2023-11-28T11:54:28.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.476+0000 7f5b2ffff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b300d0ab0 con 0x7f5b300b1ae0 2023-11-28T11:54:28.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2f7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5b300cf0e0 0x7f5b300cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44392/0 (socket says 172.21.15.50:44392) 2023-11-28T11:54:28.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2f7fe700 1 -- 172.21.15.50:0/2980956470 learned_addr learned my addr 172.21.15.50:0/2980956470 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:28.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2effd700 1 --2- 172.21.15.50:0/2980956470 >> v2:172.21.15.192:3300/0 conn(0x7f5b300b1ae0 0x7f5b3006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2e7fc700 1 -- 172.21.15.50:0/2980956470 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921149864 0 0) 0x7f5b3006a9c0 con 0x7f5b300cf0e0 2023-11-28T11:54:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2e7fc700 1 -- 172.21.15.50:0/2980956470 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b1c0035d0 con 0x7f5b300cf0e0 2023-11-28T11:54:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2effd700 1 -- 172.21.15.50:0/2980956470 >> v1:172.21.15.192:6789/0 conn(0x7f5b3006a4c0 legacy=0x7f5b300d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2e7fc700 1 -- 172.21.15.50:0/2980956470 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1255648242 0 0) 0x7f5b1c0035d0 con 0x7f5b300cf0e0 2023-11-28T11:54:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2effd700 1 -- 172.21.15.50:0/2980956470 >> v1:172.21.15.50:6789/0 conn(0x7f5b300cf0e0 legacy=0x7f5b300cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2effd700 1 -- 172.21.15.50:0/2980956470 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3006af80 con 0x7f5b300b1ae0 2023-11-28T11:54:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2effd700 1 --2- 172.21.15.50:0/2980956470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b300b1ae0 0x7f5b3006d8e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009850 tx=0x7f5b20009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec52c7522bf0583f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2e7fc700 1 -- 172.21.15.50:0/2980956470 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b280019f0 con 0x7f5b300b1ae0 2023-11-28T11:54:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2e7fc700 1 -- 172.21.15.50:0/2980956470 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b20004030 con 0x7f5b300b1ae0 2023-11-28T11:54:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2e7fc700 1 -- 172.21.15.50:0/2980956470 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b200043a0 con 0x7f5b300b1ae0 2023-11-28T11:54:28.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2ffff700 1 -- 172.21.15.50:0/2980956470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b300b1ae0 msgr2=0x7f5b3006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2ffff700 1 --2- 172.21.15.50:0/2980956470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b300b1ae0 0x7f5b3006d8e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009850 tx=0x7f5b20009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:28.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2ffff700 1 -- 172.21.15.50:0/2980956470 shutdown_connections 2023-11-28T11:54:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2ffff700 1 --2- 172.21.15.50:0/2980956470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b300b1ae0 0x7f5b3006d8e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2ffff700 1 -- 172.21.15.50:0/2980956470 >> 172.21.15.50:0/2980956470 conn(0x7f5b3009bbd0 msgr2=0x7f5b300b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2ffff700 1 -- 172.21.15.50:0/2980956470 shutdown_connections 2023-11-28T11:54:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.480+0000 7f5b2ffff700 1 -- 172.21.15.50:0/2980956470 wait complete. 2023-11-28T11:54:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2ffff700 1 Processor -- start 2023-11-28T11:54:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2ffff700 1 -- start start 2023-11-28T11:54:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b3006a4c0 0x7f5b300c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b300b1ae0 0x7f5b300c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b300cf0e0 0x7f5b3015ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2ffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3015c850 con 0x7f5b3006a4c0 2023-11-28T11:54:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2ffff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3015cb10 con 0x7f5b300cf0e0 2023-11-28T11:54:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2ffff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3015cdf0 con 0x7f5b300b1ae0 2023-11-28T11:54:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b3006a4c0 0x7f5b300c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b3006a4c0 0x7f5b300c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60250/0 (socket says 172.21.15.50:60250) 2023-11-28T11:54:28.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2effd700 1 -- 172.21.15.50:0/1089616645 learned_addr learned my addr 172.21.15.50:0/1089616645 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b27fff700 1 --2- 172.21.15.50:0/1089616645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b300b1ae0 0x7f5b300c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2f7fe700 1 --2- 172.21.15.50:0/1089616645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b300cf0e0 0x7f5b3015ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2effd700 1 -- 172.21.15.50:0/1089616645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b300b1ae0 msgr2=0x7f5b300c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2effd700 1 --2- 172.21.15.50:0/1089616645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b300b1ae0 0x7f5b300c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2effd700 1 -- 172.21.15.50:0/1089616645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b300cf0e0 msgr2=0x7f5b3015ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2effd700 1 --2- 172.21.15.50:0/1089616645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b300cf0e0 0x7f5b3015ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2effd700 1 -- 172.21.15.50:0/1089616645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b200094b0 con 0x7f5b3006a4c0 2023-11-28T11:54:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2f7fe700 1 --2- 172.21.15.50:0/1089616645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b300cf0e0 0x7f5b3015ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b27fff700 1 --2- 172.21.15.50:0/1089616645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b300b1ae0 0x7f5b300c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2effd700 1 --2- 172.21.15.50:0/1089616645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b3006a4c0 0x7f5b300c8430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5b200090b0 tx=0x7f5b20004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b277fe700 1 -- 172.21.15.50:0/1089616645 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b20003cb0 con 0x7f5b3006a4c0 2023-11-28T11:54:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b277fe700 1 -- 172.21.15.50:0/1089616645 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2001f070 con 0x7f5b3006a4c0 2023-11-28T11:54:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b277fe700 1 -- 172.21.15.50:0/1089616645 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b20011870 con 0x7f5b3006a4c0 2023-11-28T11:54:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2ffff700 1 -- 172.21.15.50:0/1089616645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b300b1eb0 con 0x7f5b3006a4c0 2023-11-28T11:54:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.484+0000 7f5b2ffff700 1 -- 172.21.15.50:0/1089616645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b300b4380 con 0x7f5b3006a4c0 2023-11-28T11:54:28.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.488+0000 7f5b2ffff700 1 -- 172.21.15.50:0/1089616645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b300b60e0 con 0x7f5b3006a4c0 2023-11-28T11:54:28.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.488+0000 7f5b277fe700 1 -- 172.21.15.50:0/1089616645 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5b2002a020 con 0x7f5b3006a4c0 2023-11-28T11:54:28.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.488+0000 7f5b277fe700 1 --2- 172.21.15.50:0/1089616645 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b10064ee0 0x7f5b10067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:28.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.488+0000 7f5b277fe700 1 -- 172.21.15.50:0/1089616645 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5b200836d0 con 0x7f5b3006a4c0 2023-11-28T11:54:28.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.488+0000 7f5b27fff700 1 --2- 172.21.15.50:0/1089616645 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b10064ee0 0x7f5b10067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:28.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.492+0000 7f5b27fff700 1 --2- 172.21.15.50:0/1089616645 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b10064ee0 0x7f5b10067390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5b3015ea80 tx=0x7f5b18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:28.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.496+0000 7f5b277fe700 1 -- 172.21.15.50:0/1089616645 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5b20051580 con 0x7f5b3006a4c0 2023-11-28T11:54:28.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.660+0000 7f5b2ffff700 1 -- 172.21.15.50:0/1089616645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b30072500 con 0x7f5b3006a4c0 2023-11-28T11:54:28.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.660+0000 7f5b277fe700 1 -- 172.21.15.50:0/1089616645 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b20054ba0 con 0x7f5b3006a4c0 2023-11-28T11:54:28.661 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:54:28.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.664+0000 7f5b2ffff700 1 -- 172.21.15.50:0/1089616645 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b10064ee0 msgr2=0x7f5b10067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.664+0000 7f5b2ffff700 1 --2- 172.21.15.50:0/1089616645 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b10064ee0 0x7f5b10067390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5b3015ea80 tx=0x7f5b18009040 comp rx=0 tx=0).stop 2023-11-28T11:54:28.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.664+0000 7f5b2ffff700 1 -- 172.21.15.50:0/1089616645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b3006a4c0 msgr2=0x7f5b300c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.664+0000 7f5b2ffff700 1 --2- 172.21.15.50:0/1089616645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b3006a4c0 0x7f5b300c8430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5b200090b0 tx=0x7f5b20004770 comp rx=0 tx=0).stop 2023-11-28T11:54:28.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.664+0000 7f5b2ffff700 1 -- 172.21.15.50:0/1089616645 shutdown_connections 2023-11-28T11:54:28.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.664+0000 7f5b2ffff700 1 --2- 172.21.15.50:0/1089616645 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5b10064ee0 0x7f5b10067390 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.664+0000 7f5b2ffff700 1 --2- 172.21.15.50:0/1089616645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b300cf0e0 0x7f5b3015ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.664+0000 7f5b2ffff700 1 --2- 172.21.15.50:0/1089616645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b300b1ae0 0x7f5b300c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.664+0000 7f5b2ffff700 1 --2- 172.21.15.50:0/1089616645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b3006a4c0 0x7f5b300c8430 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.664+0000 7f5b2ffff700 1 -- 172.21.15.50:0/1089616645 >> 172.21.15.50:0/1089616645 conn(0x7f5b3009bbd0 msgr2=0x7f5b300d1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:28.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.664+0000 7f5b2ffff700 1 -- 172.21.15.50:0/1089616645 shutdown_connections 2023-11-28T11:54:28.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.664+0000 7f5b2ffff700 1 -- 172.21.15.50:0/1089616645 wait complete. 2023-11-28T11:54:28.676 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:54:28.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.796+0000 7f3043047700 1 Processor -- start 2023-11-28T11:54:28.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.796+0000 7f3043047700 1 -- start start 2023-11-28T11:54:28.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3043047700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f303c0cc2f0 0x7f303c0ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:28.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3043047700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f303c15a3e0 0x7f303c0cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:28.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3043047700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f303c0b2d30 0x7f303c069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:28.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3043047700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303c09c0e0 con 0x7f303c0cc2f0 2023-11-28T11:54:28.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3043047700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303c0ccc00 con 0x7f303c0b2d30 2023-11-28T11:54:28.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3043047700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c0b13e0 con 0x7f303c15a3e0 2023-11-28T11:54:28.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3042045700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f303c0cc2f0 0x7f303c0ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:28.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3042045700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f303c0cc2f0 0x7f303c0ac280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60262/0 (socket says 172.21.15.50:60262) 2023-11-28T11:54:28.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3042045700 1 -- 172.21.15.50:0/3350881499 learned_addr learned my addr 172.21.15.50:0/3350881499 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:28.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3041844700 1 --2- 172.21.15.50:0/3350881499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f303c15a3e0 0x7f303c0cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:28.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3042846700 1 --2- 172.21.15.50:0/3350881499 >> v2:172.21.15.192:3300/0 conn(0x7f303c0b2d30 0x7f303c069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:28.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3042045700 1 -- 172.21.15.50:0/3350881499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f303c15a3e0 msgr2=0x7f303c0cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:28.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3042045700 1 --2- 172.21.15.50:0/3350881499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f303c15a3e0 0x7f303c0cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3042045700 1 -- 172.21.15.50:0/3350881499 >> v2:172.21.15.192:3300/0 conn(0x7f303c0b2d30 msgr2=0x7f303c069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:28.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3042045700 1 --2- 172.21.15.50:0/3350881499 >> v2:172.21.15.192:3300/0 conn(0x7f303c0b2d30 0x7f303c069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3042045700 1 -- 172.21.15.50:0/3350881499 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0b16c0 con 0x7f303c0cc2f0 2023-11-28T11:54:28.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3042846700 1 --2- 172.21.15.50:0/3350881499 >> v2:172.21.15.192:3300/0 conn(0x7f303c0b2d30 0x7f303c069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:28.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3042045700 1 --2- 172.21.15.50:0/3350881499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303c0cc2f0 0x7f303c0ac280 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f303c0b0cc0 tx=0x7f302c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b050295dfc5deba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:28.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3041043700 1 -- 172.21.15.50:0/3350881499 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c011830 con 0x7f303c0cc2f0 2023-11-28T11:54:28.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3041043700 1 -- 172.21.15.50:0/3350881499 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c011990 con 0x7f303c0cc2f0 2023-11-28T11:54:28.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3041043700 1 -- 172.21.15.50:0/3350881499 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c011d20 con 0x7f303c0cc2f0 2023-11-28T11:54:28.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3043047700 1 -- 172.21.15.50:0/3350881499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303c0cc2f0 msgr2=0x7f303c0ac280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3043047700 1 --2- 172.21.15.50:0/3350881499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303c0cc2f0 0x7f303c0ac280 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f303c0b0cc0 tx=0x7f302c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3043047700 1 -- 172.21.15.50:0/3350881499 shutdown_connections 2023-11-28T11:54:28.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3043047700 1 --2- 172.21.15.50:0/3350881499 >> v2:172.21.15.192:3300/0 conn(0x7f303c0b2d30 0x7f303c069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3043047700 1 --2- 172.21.15.50:0/3350881499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f303c15a3e0 0x7f303c0cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3043047700 1 --2- 172.21.15.50:0/3350881499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303c0cc2f0 0x7f303c0ac280 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3043047700 1 -- 172.21.15.50:0/3350881499 >> 172.21.15.50:0/3350881499 conn(0x7f303c0cae70 msgr2=0x7f303c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:28.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3043047700 1 -- 172.21.15.50:0/3350881499 shutdown_connections 2023-11-28T11:54:28.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.800+0000 7f3043047700 1 -- 172.21.15.50:0/3350881499 wait complete. 2023-11-28T11:54:28.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3043047700 1 Processor -- start 2023-11-28T11:54:28.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3043047700 1 -- start start 2023-11-28T11:54:28.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3043047700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303c0b2d30 0x7f303c149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:28.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3043047700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f303c15a3e0 0x7f303c0c1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:28.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3043047700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f303c15b0c0 0x7f303c0aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:28.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3043047700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c15d680 con 0x7f303c0b2d30 2023-11-28T11:54:28.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3043047700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c15d0c0 con 0x7f303c15a3e0 2023-11-28T11:54:28.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3043047700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c15d3a0 con 0x7f303c15b0c0 2023-11-28T11:54:28.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3042045700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303c0b2d30 0x7f303c149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:28.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3042045700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303c0b2d30 0x7f303c149720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60276/0 (socket says 172.21.15.50:60276) 2023-11-28T11:54:28.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3042045700 1 -- 172.21.15.50:0/3531382961 learned_addr learned my addr 172.21.15.50:0/3531382961 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:28.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3042846700 1 --2- 172.21.15.50:0/3531382961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f303c15b0c0 0x7f303c0aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:28.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3041844700 1 --2- 172.21.15.50:0/3531382961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f303c15a3e0 0x7f303c0c1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:28.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3042045700 1 -- 172.21.15.50:0/3531382961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f303c15b0c0 msgr2=0x7f303c0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3042045700 1 --2- 172.21.15.50:0/3531382961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f303c15b0c0 0x7f303c0aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3042045700 1 -- 172.21.15.50:0/3531382961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f303c15a3e0 msgr2=0x7f303c0c1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3042045700 1 --2- 172.21.15.50:0/3531382961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f303c15a3e0 0x7f303c0c1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3042045700 1 -- 172.21.15.50:0/3531382961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c009570 con 0x7f303c0b2d30 2023-11-28T11:54:28.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3042045700 1 --2- 172.21.15.50:0/3531382961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303c0b2d30 0x7f303c149720 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f302c013000 tx=0x7f302c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:28.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.804+0000 7f3032ffd700 1 -- 172.21.15.50:0/3531382961 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c004450 con 0x7f303c0b2d30 2023-11-28T11:54:28.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.808+0000 7f3032ffd700 1 -- 172.21.15.50:0/3531382961 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c01f070 con 0x7f303c0b2d30 2023-11-28T11:54:28.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.808+0000 7f3043047700 1 -- 172.21.15.50:0/3531382961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303c0b1c80 con 0x7f303c0b2d30 2023-11-28T11:54:28.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.808+0000 7f3032ffd700 1 -- 172.21.15.50:0/3531382961 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c003900 con 0x7f303c0b2d30 2023-11-28T11:54:28.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.808+0000 7f3043047700 1 -- 172.21.15.50:0/3531382961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303c0b19a0 con 0x7f303c0b2d30 2023-11-28T11:54:28.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.808+0000 7f3043047700 1 -- 172.21.15.50:0/3531382961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303c06a180 con 0x7f303c0b2d30 2023-11-28T11:54:28.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.808+0000 7f3032ffd700 1 -- 172.21.15.50:0/3531382961 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f302c00f050 con 0x7f303c0b2d30 2023-11-28T11:54:28.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.808+0000 7f3032ffd700 1 --2- 172.21.15.50:0/3531382961 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3020064ee0 0x7f3020067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:28.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.808+0000 7f3032ffd700 1 -- 172.21.15.50:0/3531382961 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f302c021070 con 0x7f303c0b2d30 2023-11-28T11:54:28.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.808+0000 7f3041844700 1 --2- 172.21.15.50:0/3531382961 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3020064ee0 0x7f3020067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:28.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.812+0000 7f3041844700 1 --2- 172.21.15.50:0/3531382961 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3020064ee0 0x7f3020067390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f303c14a050 tx=0x7f3038009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:28.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.820+0000 7f3032ffd700 1 -- 172.21.15.50:0/3531382961 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f302c0512e0 con 0x7f303c0b2d30 2023-11-28T11:54:28.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.984+0000 7f3043047700 1 -- 172.21.15.50:0/3531382961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f303c066f20 con 0x7f303c0b2d30 2023-11-28T11:54:28.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.984+0000 7f3032ffd700 1 -- 172.21.15.50:0/3531382961 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f303c066f20 con 0x7f303c0b2d30 2023-11-28T11:54:28.985 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.988+0000 7f3043047700 1 -- 172.21.15.50:0/3531382961 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3020064ee0 msgr2=0x7f3020067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.988+0000 7f3043047700 1 --2- 172.21.15.50:0/3531382961 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3020064ee0 0x7f3020067390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f303c14a050 tx=0x7f3038009240 comp rx=0 tx=0).stop 2023-11-28T11:54:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.988+0000 7f3043047700 1 -- 172.21.15.50:0/3531382961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303c0b2d30 msgr2=0x7f303c149720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.988+0000 7f3043047700 1 --2- 172.21.15.50:0/3531382961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303c0b2d30 0x7f303c149720 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f302c013000 tx=0x7f302c004770 comp rx=0 tx=0).stop 2023-11-28T11:54:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.988+0000 7f3043047700 1 -- 172.21.15.50:0/3531382961 shutdown_connections 2023-11-28T11:54:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.988+0000 7f3043047700 1 --2- 172.21.15.50:0/3531382961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f303c15b0c0 0x7f303c0aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.988+0000 7f3043047700 1 --2- 172.21.15.50:0/3531382961 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3020064ee0 0x7f3020067390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.988+0000 7f3043047700 1 --2- 172.21.15.50:0/3531382961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f303c15a3e0 0x7f303c0c1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.988+0000 7f3043047700 1 --2- 172.21.15.50:0/3531382961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f303c0b2d30 0x7f303c149720 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.988+0000 7f3043047700 1 -- 172.21.15.50:0/3531382961 >> 172.21.15.50:0/3531382961 conn(0x7f303c0cae70 msgr2=0x7f303c06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.988+0000 7f3043047700 1 -- 172.21.15.50:0/3531382961 shutdown_connections 2023-11-28T11:54:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:28.988+0000 7f3043047700 1 -- 172.21.15.50:0/3531382961 wait complete. 2023-11-28T11:54:29.000 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:54:29.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.112+0000 7f74bb59e700 1 Processor -- start 2023-11-28T11:54:29.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.112+0000 7f74bb59e700 1 -- start start 2023-11-28T11:54:29.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74bb59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f74bc0ce230 0x7f74bc0ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74bb59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74bc06d1c0 con 0x7f74bc158ee0 2023-11-28T11:54:29.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74bb59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74bc0ca3a0 con 0x7f74bc0cd5d0 2023-11-28T11:54:29.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74bb59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74bc06e000 con 0x7f74bc0ce230 2023-11-28T11:54:29.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74ba59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f74bc158ee0 0x7f74bc0cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44406/0 (socket says 172.21.15.50:44406) 2023-11-28T11:54:29.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74ba59c700 1 -- 172.21.15.50:0/464848708 learned_addr learned my addr 172.21.15.50:0/464848708 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:29.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b9d9b700 1 --2- 172.21.15.50:0/464848708 >> v2:172.21.15.192:3300/0 conn(0x7f74bc0ce230 0x7f74bc0ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 -- 172.21.15.50:0/464848708 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741040858 0 0) 0x7f74ac001110 con 0x7f74bc158ee0 2023-11-28T11:54:29.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 -- 172.21.15.50:0/464848708 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74a40057e0 con 0x7f74bc158ee0 2023-11-28T11:54:29.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 -- 172.21.15.50:0/464848708 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3740948052 0 0) 0x7f74a40057e0 con 0x7f74bc158ee0 2023-11-28T11:54:29.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 -- 172.21.15.50:0/464848708 >> v2:172.21.15.192:3300/0 conn(0x7f74bc0ce230 msgr2=0x7f74bc0ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:29.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 --2- 172.21.15.50:0/464848708 >> v2:172.21.15.192:3300/0 conn(0x7f74bc0ce230 0x7f74bc0ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 -- 172.21.15.50:0/464848708 >> v1:172.21.15.192:6789/0 conn(0x7f74bc0cd5d0 legacy=0x7f74bc0cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:29.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 -- 172.21.15.50:0/464848708 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc06c920 con 0x7f74bc158ee0 2023-11-28T11:54:29.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 -- 172.21.15.50:0/464848708 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f74ac001800 con 0x7f74bc158ee0 2023-11-28T11:54:29.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 -- 172.21.15.50:0/464848708 >> v1:172.21.15.50:6789/0 conn(0x7f74bc158ee0 legacy=0x7f74bc0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:29.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 --2- 172.21.15.50:0/464848708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4005c30 0x7f74a4006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 --2- 172.21.15.50:0/464848708 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a4006a80 0x7f74a4006ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 --2- 172.21.15.50:0/464848708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74a4007430 0x7f74a400dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 -- 172.21.15.50:0/464848708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a400e280 con 0x7f74a4005c30 2023-11-28T11:54:29.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 -- 172.21.15.50:0/464848708 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a400e3f0 con 0x7f74a4007430 2023-11-28T11:54:29.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 -- 172.21.15.50:0/464848708 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a400e5b0 con 0x7f74a4006a80 2023-11-28T11:54:29.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74ba59c700 1 --2- 172.21.15.50:0/464848708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4005c30 0x7f74a4006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b9d9b700 1 --2- 172.21.15.50:0/464848708 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a4006a80 0x7f74a4006ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74bad9d700 1 --2- 172.21.15.50:0/464848708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74a4007430 0x7f74a400dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74ba59c700 1 -- 172.21.15.50:0/464848708 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a4006a80 msgr2=0x7f74a4006ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74ba59c700 1 --2- 172.21.15.50:0/464848708 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a4006a80 0x7f74a4006ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74ba59c700 1 -- 172.21.15.50:0/464848708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74a4007430 msgr2=0x7f74a400dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74ba59c700 1 --2- 172.21.15.50:0/464848708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74a4007430 0x7f74a400dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74ba59c700 1 -- 172.21.15.50:0/464848708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40057e0 con 0x7f74a4005c30 2023-11-28T11:54:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74bad9d700 1 --2- 172.21.15.50:0/464848708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74a4007430 0x7f74a400dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74bad9d700 1 -- 172.21.15.50:0/464848708 reap_dead start 2023-11-28T11:54:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74ba59c700 1 --2- 172.21.15.50:0/464848708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4005c30 0x7f74a4006040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00c320 tx=0x7f74a4007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a2b68b38749e52 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 -- 172.21.15.50:0/464848708 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac00ce60 con 0x7f74a4005c30 2023-11-28T11:54:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 -- 172.21.15.50:0/464848708 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac005980 con 0x7f74a4005c30 2023-11-28T11:54:29.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74b959a700 1 -- 172.21.15.50:0/464848708 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac005d10 con 0x7f74a4005c30 2023-11-28T11:54:29.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74bb59e700 1 -- 172.21.15.50:0/464848708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4005c30 msgr2=0x7f74a4006040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:29.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74bb59e700 1 --2- 172.21.15.50:0/464848708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4005c30 0x7f74a4006040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00c320 tx=0x7f74a4007ab0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74bb59e700 1 -- 172.21.15.50:0/464848708 shutdown_connections 2023-11-28T11:54:29.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74bb59e700 1 --2- 172.21.15.50:0/464848708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4005c30 0x7f74a4006040 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74bb59e700 1 -- 172.21.15.50:0/464848708 >> 172.21.15.50:0/464848708 conn(0x7f74bc0d0240 msgr2=0x7f74bc0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:29.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74bb59e700 1 -- 172.21.15.50:0/464848708 shutdown_connections 2023-11-28T11:54:29.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.116+0000 7f74bb59e700 1 -- 172.21.15.50:0/464848708 wait complete. 2023-11-28T11:54:29.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74bb59e700 1 Processor -- start 2023-11-28T11:54:29.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74bb59e700 1 -- start start 2023-11-28T11:54:29.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74bb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4005c30 0x7f74bc1519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74bb59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74bc0b3cb0 0x7f74bc15c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74bb59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74bc0b4120 0x7f74bc15cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74bb59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc1f1790 con 0x7f74a4005c30 2023-11-28T11:54:29.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74bb59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc1f0b10 con 0x7f74bc0b3cb0 2023-11-28T11:54:29.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74bb59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc1f0df0 con 0x7f74bc0b4120 2023-11-28T11:54:29.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74ba59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4005c30 0x7f74bc1519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74ba59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4005c30 0x7f74bc1519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60288/0 (socket says 172.21.15.50:60288) 2023-11-28T11:54:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74ba59c700 1 -- 172.21.15.50:0/2629017557 learned_addr learned my addr 172.21.15.50:0/2629017557 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74bad9d700 1 --2- 172.21.15.50:0/2629017557 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74bc0b4120 0x7f74bc15cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74b9d9b700 1 --2- 172.21.15.50:0/2629017557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74bc0b3cb0 0x7f74bc15c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74ba59c700 1 -- 172.21.15.50:0/2629017557 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74bc0b4120 msgr2=0x7f74bc15cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74ba59c700 1 --2- 172.21.15.50:0/2629017557 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74bc0b4120 0x7f74bc15cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74ba59c700 1 -- 172.21.15.50:0/2629017557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74bc0b3cb0 msgr2=0x7f74bc15c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74ba59c700 1 --2- 172.21.15.50:0/2629017557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74bc0b3cb0 0x7f74bc15c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74ba59c700 1 -- 172.21.15.50:0/2629017557 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc06cee0 con 0x7f74a4005c30 2023-11-28T11:54:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74ba59c700 1 --2- 172.21.15.50:0/2629017557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4005c30 0x7f74bc1519e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f74ac001ac0 tx=0x7f74ac001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74aaffd700 1 -- 172.21.15.50:0/2629017557 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac001110 con 0x7f74a4005c30 2023-11-28T11:54:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74aaffd700 1 -- 172.21.15.50:0/2629017557 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac004aa0 con 0x7f74a4005c30 2023-11-28T11:54:29.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74bb59e700 1 -- 172.21.15.50:0/2629017557 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74bc06cc00 con 0x7f74a4005c30 2023-11-28T11:54:29.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74aaffd700 1 -- 172.21.15.50:0/2629017557 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac004e50 con 0x7f74a4005c30 2023-11-28T11:54:29.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.120+0000 7f74bb59e700 1 -- 172.21.15.50:0/2629017557 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74bc0ca640 con 0x7f74a4005c30 2023-11-28T11:54:29.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.124+0000 7f74bb59e700 1 -- 172.21.15.50:0/2629017557 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74bc072c20 con 0x7f74a4005c30 2023-11-28T11:54:29.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.124+0000 7f74aaffd700 1 -- 172.21.15.50:0/2629017557 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f74ac023070 con 0x7f74a4005c30 2023-11-28T11:54:29.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.124+0000 7f74aaffd700 1 --2- 172.21.15.50:0/2629017557 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f749c064ee0 0x7f749c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.124+0000 7f74aaffd700 1 -- 172.21.15.50:0/2629017557 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f74ac082c30 con 0x7f74a4005c30 2023-11-28T11:54:29.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.124+0000 7f74b9d9b700 1 --2- 172.21.15.50:0/2629017557 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f749c064ee0 0x7f749c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.124+0000 7f74b9d9b700 1 --2- 172.21.15.50:0/2629017557 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f749c064ee0 0x7f749c067390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f74bc15c310 tx=0x7f74b00091c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:29.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.132+0000 7f74aaffd700 1 -- 172.21.15.50:0/2629017557 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f74ac050b60 con 0x7f74a4005c30 2023-11-28T11:54:29.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.292+0000 7f74bb59e700 1 -- 172.21.15.50:0/2629017557 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f74bc06d1c0 con 0x7f74a4005c30 2023-11-28T11:54:29.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.292+0000 7f74aaffd700 1 -- 172.21.15.50:0/2629017557 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f74bc06d1c0 con 0x7f74a4005c30 2023-11-28T11:54:29.295 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:54:29.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.300+0000 7f74bb59e700 1 -- 172.21.15.50:0/2629017557 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f749c064ee0 msgr2=0x7f749c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:29.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.300+0000 7f74bb59e700 1 --2- 172.21.15.50:0/2629017557 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f749c064ee0 0x7f749c067390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f74bc15c310 tx=0x7f74b00091c0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.300+0000 7f74bb59e700 1 -- 172.21.15.50:0/2629017557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4005c30 msgr2=0x7f74bc1519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:29.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.300+0000 7f74bb59e700 1 --2- 172.21.15.50:0/2629017557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4005c30 0x7f74bc1519e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f74ac001ac0 tx=0x7f74ac001b90 comp rx=0 tx=0).stop 2023-11-28T11:54:29.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.300+0000 7f74bb59e700 1 -- 172.21.15.50:0/2629017557 shutdown_connections 2023-11-28T11:54:29.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.300+0000 7f74bb59e700 1 --2- 172.21.15.50:0/2629017557 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74bc0b4120 0x7f74bc15cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.300+0000 7f74bb59e700 1 --2- 172.21.15.50:0/2629017557 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f749c064ee0 0x7f749c067390 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.300+0000 7f74bb59e700 1 --2- 172.21.15.50:0/2629017557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74bc0b3cb0 0x7f74bc15c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.300+0000 7f74bb59e700 1 --2- 172.21.15.50:0/2629017557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4005c30 0x7f74bc1519e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.300+0000 7f74bb59e700 1 -- 172.21.15.50:0/2629017557 >> 172.21.15.50:0/2629017557 conn(0x7f74bc0d0240 msgr2=0x7f74bc0cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:29.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.300+0000 7f74bb59e700 1 -- 172.21.15.50:0/2629017557 shutdown_connections 2023-11-28T11:54:29.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.300+0000 7f74bb59e700 1 -- 172.21.15.50:0/2629017557 wait complete. 2023-11-28T11:54:29.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:54:29.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.440+0000 7fc3b7128700 1 Processor -- start 2023-11-28T11:54:29.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.440+0000 7fc3b7128700 1 -- start start 2023-11-28T11:54:29.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.440+0000 7fc3b7128700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3b015c160 0x7fc3b006cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.440+0000 7fc3b7128700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3b006ea10 0x7fc3b00cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.440+0000 7fc3b7128700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b006f990 con 0x7fc3b00c9c00 2023-11-28T11:54:29.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.440+0000 7fc3b7128700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b006a4d0 con 0x7fc3b015c160 2023-11-28T11:54:29.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.440+0000 7fc3b7128700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b006ee90 con 0x7fc3b006ea10 2023-11-28T11:54:29.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.440+0000 7fc3b5925700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3b015c160 0x7fc3b006cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.440+0000 7fc3b6126700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc3b00c9c00 0x7fc3b00c9fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44412/0 (socket says 172.21.15.50:44412) 2023-11-28T11:54:29.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.440+0000 7fc3b6126700 1 -- 172.21.15.50:0/1899081350 learned_addr learned my addr 172.21.15.50:0/1899081350 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:29.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.440+0000 7fc3b6927700 1 --2- 172.21.15.50:0/1899081350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3b006ea10 0x7fc3b00cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.440+0000 7fc3b6927700 1 -- 172.21.15.50:0/1899081350 >> v2:172.21.15.50:3300/0 conn(0x7fc3b015c160 msgr2=0x7fc3b006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:29.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.440+0000 7fc3b6927700 1 --2- 172.21.15.50:0/1899081350 >> v2:172.21.15.50:3300/0 conn(0x7fc3b015c160 0x7fc3b006cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.440+0000 7fc3b6927700 1 -- 172.21.15.50:0/1899081350 >> v1:172.21.15.50:6789/0 conn(0x7fc3b00c9c00 legacy=0x7fc3b00c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:29.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.440+0000 7fc3b6927700 1 -- 172.21.15.50:0/1899081350 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b006f0f0 con 0x7fc3b006ea10 2023-11-28T11:54:29.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.440+0000 7fc3b5925700 1 --2- 172.21.15.50:0/1899081350 >> v2:172.21.15.50:3300/0 conn(0x7fc3b015c160 0x7fc3b006cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:29.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.444+0000 7fc3b6927700 1 --2- 172.21.15.50:0/1899081350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3b006ea10 0x7fc3b00cde30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8009d90 tx=0x7fc3a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5366c8b5346c411d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:29.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.444+0000 7fc3b5124700 1 -- 172.21.15.50:0/1899081350 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a800e070 con 0x7fc3b006ea10 2023-11-28T11:54:29.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.444+0000 7fc3b5124700 1 -- 172.21.15.50:0/1899081350 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a800bb20 con 0x7fc3b006ea10 2023-11-28T11:54:29.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.444+0000 7fc3b5124700 1 -- 172.21.15.50:0/1899081350 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8012430 con 0x7fc3b006ea10 2023-11-28T11:54:29.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.444+0000 7fc3b7128700 1 -- 172.21.15.50:0/1899081350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3b006ea10 msgr2=0x7fc3b00cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:29.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.444+0000 7fc3b7128700 1 --2- 172.21.15.50:0/1899081350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3b006ea10 0x7fc3b00cde30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8009d90 tx=0x7fc3a800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:29.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.444+0000 7fc3b7128700 1 -- 172.21.15.50:0/1899081350 shutdown_connections 2023-11-28T11:54:29.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.444+0000 7fc3b7128700 1 --2- 172.21.15.50:0/1899081350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3b006ea10 0x7fc3b00cde30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.444+0000 7fc3b7128700 1 --2- 172.21.15.50:0/1899081350 >> v2:172.21.15.50:3300/0 conn(0x7fc3b015c160 0x7fc3b006cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.444+0000 7fc3b7128700 1 -- 172.21.15.50:0/1899081350 >> 172.21.15.50:0/1899081350 conn(0x7fc3b00d0240 msgr2=0x7fc3b00cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:29.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.444+0000 7fc3b7128700 1 -- 172.21.15.50:0/1899081350 shutdown_connections 2023-11-28T11:54:29.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.444+0000 7fc3b7128700 1 -- 172.21.15.50:0/1899081350 wait complete. 2023-11-28T11:54:29.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b7128700 1 Processor -- start 2023-11-28T11:54:29.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b7128700 1 -- start start 2023-11-28T11:54:29.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b7128700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3b006ea10 0x7fc3b00b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b7128700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3b00c9c00 0x7fc3b0153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b7128700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3b015c160 0x7fc3b00b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b7128700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b00b37a0 con 0x7fc3b00c9c00 2023-11-28T11:54:29.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b7128700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b0159750 con 0x7fc3b015c160 2023-11-28T11:54:29.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b7128700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b00b46e0 con 0x7fc3b006ea10 2023-11-28T11:54:29.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b5925700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3b00c9c00 0x7fc3b0153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b5925700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3b00c9c00 0x7fc3b0153900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60306/0 (socket says 172.21.15.50:60306) 2023-11-28T11:54:29.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b5925700 1 -- 172.21.15.50:0/63716111 learned_addr learned my addr 172.21.15.50:0/63716111 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:29.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b6126700 1 --2- 172.21.15.50:0/63716111 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3b006ea10 0x7fc3b00b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b6927700 1 --2- 172.21.15.50:0/63716111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3b015c160 0x7fc3b00b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b5925700 1 -- 172.21.15.50:0/63716111 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3b006ea10 msgr2=0x7fc3b00b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:29.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b5925700 1 --2- 172.21.15.50:0/63716111 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3b006ea10 0x7fc3b00b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b5925700 1 -- 172.21.15.50:0/63716111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3b015c160 msgr2=0x7fc3b00b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:29.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b5925700 1 --2- 172.21.15.50:0/63716111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3b015c160 0x7fc3b00b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b5925700 1 -- 172.21.15.50:0/63716111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a4009450 con 0x7fc3b00c9c00 2023-11-28T11:54:29.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b6927700 1 --2- 172.21.15.50:0/63716111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3b015c160 0x7fc3b00b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:29.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b5925700 1 --2- 172.21.15.50:0/63716111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3b00c9c00 0x7fc3b0153900 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400ebe0 tx=0x7fc3a400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:29.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3a2ffd700 1 -- 172.21.15.50:0/63716111 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4009800 con 0x7fc3b00c9c00 2023-11-28T11:54:29.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3a2ffd700 1 -- 172.21.15.50:0/63716111 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a4005a40 con 0x7fc3b00c9c00 2023-11-28T11:54:29.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b7128700 1 -- 172.21.15.50:0/63716111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a8009a70 con 0x7fc3b00c9c00 2023-11-28T11:54:29.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3a2ffd700 1 -- 172.21.15.50:0/63716111 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4005db0 con 0x7fc3b00c9c00 2023-11-28T11:54:29.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.448+0000 7fc3b7128700 1 -- 172.21.15.50:0/63716111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b006f6b0 con 0x7fc3b00c9c00 2023-11-28T11:54:29.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.452+0000 7fc3b7128700 1 -- 172.21.15.50:0/63716111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b006f3d0 con 0x7fc3b00c9c00 2023-11-28T11:54:29.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.452+0000 7fc3a2ffd700 1 -- 172.21.15.50:0/63716111 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc3a4022070 con 0x7fc3b00c9c00 2023-11-28T11:54:29.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.452+0000 7fc3a2ffd700 1 --2- 172.21.15.50:0/63716111 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc394064ee0 0x7fc394067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.452+0000 7fc3a2ffd700 1 -- 172.21.15.50:0/63716111 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc3a40823f0 con 0x7fc3b00c9c00 2023-11-28T11:54:29.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.452+0000 7fc3b6126700 1 --2- 172.21.15.50:0/63716111 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc394064ee0 0x7fc394067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.456+0000 7fc3b6126700 1 --2- 172.21.15.50:0/63716111 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc394064ee0 0x7fc394067390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac005930 tx=0x7fc3ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:29.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.464+0000 7fc3a2ffd700 1 -- 172.21.15.50:0/63716111 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc3a40501e0 con 0x7fc3b00c9c00 2023-11-28T11:54:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.628+0000 7fc3b7128700 1 -- 172.21.15.50:0/63716111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc3b00cd910 con 0x7fc3b00c9c00 2023-11-28T11:54:29.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.628+0000 7fc3a2ffd700 1 -- 172.21.15.50:0/63716111 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc3a4053800 con 0x7fc3b00c9c00 2023-11-28T11:54:29.630 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:29.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.632+0000 7fc3b7128700 1 -- 172.21.15.50:0/63716111 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc394064ee0 msgr2=0x7fc394067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:29.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.632+0000 7fc3b7128700 1 --2- 172.21.15.50:0/63716111 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc394064ee0 0x7fc394067390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac005930 tx=0x7fc3ac009040 comp rx=0 tx=0).stop 2023-11-28T11:54:29.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.632+0000 7fc3b7128700 1 -- 172.21.15.50:0/63716111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3b00c9c00 msgr2=0x7fc3b0153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:29.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.632+0000 7fc3b7128700 1 --2- 172.21.15.50:0/63716111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3b00c9c00 0x7fc3b0153900 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400ebe0 tx=0x7fc3a400eef0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.632+0000 7fc3b7128700 1 -- 172.21.15.50:0/63716111 shutdown_connections 2023-11-28T11:54:29.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.632+0000 7fc3b7128700 1 --2- 172.21.15.50:0/63716111 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc394064ee0 0x7fc394067390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.632+0000 7fc3b7128700 1 --2- 172.21.15.50:0/63716111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3b015c160 0x7fc3b00b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.632+0000 7fc3b7128700 1 --2- 172.21.15.50:0/63716111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3b00c9c00 0x7fc3b0153900 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.632+0000 7fc3b7128700 1 --2- 172.21.15.50:0/63716111 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3b006ea10 0x7fc3b00b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.632+0000 7fc3b7128700 1 -- 172.21.15.50:0/63716111 >> 172.21.15.50:0/63716111 conn(0x7fc3b00d0240 msgr2=0x7fc3b00afa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.632+0000 7fc3b7128700 1 -- 172.21.15.50:0/63716111 shutdown_connections 2023-11-28T11:54:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.632+0000 7fc3b7128700 1 -- 172.21.15.50:0/63716111 wait complete. 2023-11-28T11:54:29.653 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T11:54:29.653 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-11-28T11:54:29.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f730955e700 1 Processor -- start 2023-11-28T11:54:29.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f730955e700 1 -- start start 2023-11-28T11:54:29.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f730955e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f730415c150 0x7f73041607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f730955e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f73040c9e70 0x7f73040cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f730955e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730415c520 con 0x7f73040cc430 2023-11-28T11:54:29.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f730955e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73040ca680 con 0x7f730415c150 2023-11-28T11:54:29.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f730955e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73040ca960 con 0x7f73040c9e70 2023-11-28T11:54:29.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f7308d5d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f73040cc430 0x7f7304070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44418/0 (socket says 172.21.15.50:44418) 2023-11-28T11:54:29.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f7308d5d700 1 -- 172.21.15.50:0/547127963 learned_addr learned my addr 172.21.15.50:0/547127963 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:29.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f7303fff700 1 --2- 172.21.15.50:0/547127963 >> v2:172.21.15.50:3300/0 conn(0x7f730415c150 0x7f73041607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f73037fe700 1 --2- 172.21.15.50:0/547127963 >> v2:172.21.15.192:3300/0 conn(0x7f73040c9e70 0x7f73040cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f7302ffd700 1 -- 172.21.15.50:0/547127963 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246630150 0 0) 0x7f730415c520 con 0x7f73040cc430 2023-11-28T11:54:29.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f7302ffd700 1 -- 172.21.15.50:0/547127963 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72ec0035d0 con 0x7f73040cc430 2023-11-28T11:54:29.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f7303fff700 1 -- 172.21.15.50:0/547127963 >> v2:172.21.15.192:3300/0 conn(0x7f73040c9e70 msgr2=0x7f73040cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:29.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f7303fff700 1 --2- 172.21.15.50:0/547127963 >> v2:172.21.15.192:3300/0 conn(0x7f73040c9e70 0x7f73040cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f7303fff700 1 -- 172.21.15.50:0/547127963 >> v1:172.21.15.50:6789/0 conn(0x7f73040cc430 legacy=0x7f7304070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:29.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f7302ffd700 1 -- 172.21.15.50:0/547127963 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2362983225 0 0) 0x7f72ec0035d0 con 0x7f73040cc430 2023-11-28T11:54:29.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f7303fff700 1 -- 172.21.15.50:0/547127963 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73040cf330 con 0x7f730415c150 2023-11-28T11:54:29.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f7303fff700 1 --2- 172.21.15.50:0/547127963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f730415c150 0x7f73041607b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f73040af140 tx=0x7f72f4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e09cbc792321a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:29.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f7302ffd700 1 -- 172.21.15.50:0/547127963 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc0019f0 con 0x7f730415c150 2023-11-28T11:54:29.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f7302ffd700 1 -- 172.21.15.50:0/547127963 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f4004030 con 0x7f730415c150 2023-11-28T11:54:29.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f7302ffd700 1 -- 172.21.15.50:0/547127963 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40043c0 con 0x7f730415c150 2023-11-28T11:54:29.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f730955e700 1 -- 172.21.15.50:0/547127963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f730415c150 msgr2=0x7f73041607b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:29.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f730955e700 1 --2- 172.21.15.50:0/547127963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f730415c150 0x7f73041607b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f73040af140 tx=0x7f72f4009b30 comp rx=0 tx=0).stop 2023-11-28T11:54:29.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f730955e700 1 -- 172.21.15.50:0/547127963 shutdown_connections 2023-11-28T11:54:29.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f730955e700 1 --2- 172.21.15.50:0/547127963 >> v2:172.21.15.192:3300/0 conn(0x7f73040c9e70 0x7f73040cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f730955e700 1 --2- 172.21.15.50:0/547127963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f730415c150 0x7f73041607b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f730955e700 1 -- 172.21.15.50:0/547127963 >> 172.21.15.50:0/547127963 conn(0x7f730406ec40 msgr2=0x7f73040b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:29.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f730955e700 1 -- 172.21.15.50:0/547127963 shutdown_connections 2023-11-28T11:54:29.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.772+0000 7f730955e700 1 -- 172.21.15.50:0/547127963 wait complete. 2023-11-28T11:54:29.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f730955e700 1 Processor -- start 2023-11-28T11:54:29.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f730955e700 1 -- start start 2023-11-28T11:54:29.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f730955e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73040c9e70 0x7f7304147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f730955e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73040cc430 0x7f73040b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f730955e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f730415c150 0x7f73041e6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f730955e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73040ae290 con 0x7f73040cc430 2023-11-28T11:54:29.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f730955e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73040adc60 con 0x7f730415c150 2023-11-28T11:54:29.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f730955e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73040ae6b0 con 0x7f73040c9e70 2023-11-28T11:54:29.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f73037fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73040cc430 0x7f73040b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f73037fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73040cc430 0x7f73040b1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60322/0 (socket says 172.21.15.50:60322) 2023-11-28T11:54:29.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f73037fe700 1 -- 172.21.15.50:0/2030358470 learned_addr learned my addr 172.21.15.50:0/2030358470 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:29.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f7303fff700 1 --2- 172.21.15.50:0/2030358470 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73040c9e70 0x7f7304147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f7308d5d700 1 --2- 172.21.15.50:0/2030358470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f730415c150 0x7f73041e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f73037fe700 1 -- 172.21.15.50:0/2030358470 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73040c9e70 msgr2=0x7f7304147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:29.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f73037fe700 1 --2- 172.21.15.50:0/2030358470 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73040c9e70 0x7f7304147b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f73037fe700 1 -- 172.21.15.50:0/2030358470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f730415c150 msgr2=0x7f73041e6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:29.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f73037fe700 1 --2- 172.21.15.50:0/2030358470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f730415c150 0x7f73041e6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:29.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f73037fe700 1 -- 172.21.15.50:0/2030358470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f40094b0 con 0x7f73040cc430 2023-11-28T11:54:29.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f73037fe700 1 --2- 172.21.15.50:0/2030358470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73040cc430 0x7f73040b1220 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f72f800ea00 tx=0x7f72f800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:29.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f7300ff9700 1 -- 172.21.15.50:0/2030358470 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8009720 con 0x7f73040cc430 2023-11-28T11:54:29.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f7300ff9700 1 -- 172.21.15.50:0/2030358470 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f800c850 con 0x7f73040cc430 2023-11-28T11:54:29.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f730955e700 1 -- 172.21.15.50:0/2030358470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73040cdb20 con 0x7f73040cc430 2023-11-28T11:54:29.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f7300ff9700 1 -- 172.21.15.50:0/2030358470 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f800cbc0 con 0x7f73040cc430 2023-11-28T11:54:29.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.776+0000 7f730955e700 1 -- 172.21.15.50:0/2030358470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73040cd840 con 0x7f73040cc430 2023-11-28T11:54:29.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.780+0000 7f730955e700 1 -- 172.21.15.50:0/2030358470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73040cde00 con 0x7f73040cc430 2023-11-28T11:54:29.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.780+0000 7f7300ff9700 1 -- 172.21.15.50:0/2030358470 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f72f8019030 con 0x7f73040cc430 2023-11-28T11:54:29.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.780+0000 7f7300ff9700 1 --2- 172.21.15.50:0/2030358470 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72f0064ee0 0x7f72f0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:29.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.780+0000 7f7300ff9700 1 -- 172.21.15.50:0/2030358470 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f72f8082230 con 0x7f73040cc430 2023-11-28T11:54:29.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.780+0000 7f7303fff700 1 --2- 172.21.15.50:0/2030358470 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72f0064ee0 0x7f72f0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:29.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.780+0000 7f7303fff700 1 --2- 172.21.15.50:0/2030358470 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72f0064ee0 0x7f72f0067390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f72f40090b0 tx=0x7f72f4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:29.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:29.784+0000 7f7300ff9700 1 -- 172.21.15.50:0/2030358470 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f72f804ffb0 con 0x7f73040cc430 2023-11-28T11:54:30.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.004+0000 7f730955e700 1 -- 172.21.15.50:0/2030358470 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f73040ae3d0 con 0x7f73040cc430 2023-11-28T11:54:30.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.092+0000 7f7300ff9700 1 -- 172.21.15.50:0/2030358470 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v60) v1 ==== 145+0+0 (secure 0 0 0) 0x7f73040ae3d0 con 0x7f73040cc430 2023-11-28T11:54:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.096+0000 7f730955e700 1 -- 172.21.15.50:0/2030358470 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72f0064ee0 msgr2=0x7f72f0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.096+0000 7f730955e700 1 --2- 172.21.15.50:0/2030358470 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72f0064ee0 0x7f72f0067390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f72f40090b0 tx=0x7f72f4008030 comp rx=0 tx=0).stop 2023-11-28T11:54:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.096+0000 7f730955e700 1 -- 172.21.15.50:0/2030358470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73040cc430 msgr2=0x7f73040b1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.096+0000 7f730955e700 1 --2- 172.21.15.50:0/2030358470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73040cc430 0x7f73040b1220 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f72f800ea00 tx=0x7f72f800ed10 comp rx=0 tx=0).stop 2023-11-28T11:54:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.096+0000 7f730955e700 1 -- 172.21.15.50:0/2030358470 shutdown_connections 2023-11-28T11:54:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.096+0000 7f730955e700 1 --2- 172.21.15.50:0/2030358470 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72f0064ee0 0x7f72f0067390 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.096+0000 7f730955e700 1 --2- 172.21.15.50:0/2030358470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f730415c150 0x7f73041e6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.096+0000 7f730955e700 1 --2- 172.21.15.50:0/2030358470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73040cc430 0x7f73040b1220 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.096+0000 7f730955e700 1 --2- 172.21.15.50:0/2030358470 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73040c9e70 0x7f7304147b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.096+0000 7f730955e700 1 -- 172.21.15.50:0/2030358470 >> 172.21.15.50:0/2030358470 conn(0x7f730406ec40 msgr2=0x7f730415b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.096+0000 7f730955e700 1 -- 172.21.15.50:0/2030358470 shutdown_connections 2023-11-28T11:54:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.096+0000 7f730955e700 1 -- 172.21.15.50:0/2030358470 wait complete. 2023-11-28T11:54:30.116 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T11:54:30.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.236+0000 7faf90917700 1 Processor -- start 2023-11-28T11:54:30.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.236+0000 7faf90917700 1 -- start start 2023-11-28T11:54:30.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.236+0000 7faf90917700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf8c0b1ae0 0x7faf8c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.236+0000 7faf90917700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8c06a4c0 0x7faf8c0d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.236+0000 7faf90917700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faf8c0cf0e0 0x7faf8c0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.236+0000 7faf90917700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf8c0cfa80 con 0x7faf8c0b1ae0 2023-11-28T11:54:30.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.236+0000 7faf90917700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf8c06a9c0 con 0x7faf8c0cf0e0 2023-11-28T11:54:30.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.236+0000 7faf90917700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c06aca0 con 0x7faf8c06a4c0 2023-11-28T11:54:30.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.236+0000 7faf8ad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf8c0b1ae0 0x7faf8c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.236+0000 7faf8ad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf8c0b1ae0 0x7faf8c06d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60330/0 (socket says 172.21.15.50:60330) 2023-11-28T11:54:30.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.236+0000 7faf8b59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faf8c0cf0e0 0x7faf8c0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.236+0000 7faf8ad9d700 1 -- 172.21.15.50:0/1008395051 learned_addr learned my addr 172.21.15.50:0/1008395051 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:30.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.236+0000 7faf8a59c700 1 --2- 172.21.15.50:0/1008395051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8c06a4c0 0x7faf8c0d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf8ad9d700 1 -- 172.21.15.50:0/1008395051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8c06a4c0 msgr2=0x7faf8c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:30.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf8ad9d700 1 --2- 172.21.15.50:0/1008395051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8c06a4c0 0x7faf8c0d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf8ad9d700 1 -- 172.21.15.50:0/1008395051 >> v2:172.21.15.192:3300/0 conn(0x7faf8c0cf0e0 msgr2=0x7faf8c0cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:30.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf8ad9d700 1 --2- 172.21.15.50:0/1008395051 >> v2:172.21.15.192:3300/0 conn(0x7faf8c0cf0e0 0x7faf8c0cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf8ad9d700 1 -- 172.21.15.50:0/1008395051 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c06af80 con 0x7faf8c0b1ae0 2023-11-28T11:54:30.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf8b59e700 1 --2- 172.21.15.50:0/1008395051 >> v2:172.21.15.192:3300/0 conn(0x7faf8c0cf0e0 0x7faf8c0cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:30.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf8a59c700 1 --2- 172.21.15.50:0/1008395051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8c06a4c0 0x7faf8c0d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:30.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf8ad9d700 1 --2- 172.21.15.50:0/1008395051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8c0b1ae0 0x7faf8c06d8e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7faf8c08bbc0 tx=0x7faf74009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da9e7b2e4afef99 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:30.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf89d9b700 1 -- 172.21.15.50:0/1008395051 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74011830 con 0x7faf8c0b1ae0 2023-11-28T11:54:30.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf89d9b700 1 -- 172.21.15.50:0/1008395051 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf74011990 con 0x7faf8c0b1ae0 2023-11-28T11:54:30.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf89d9b700 1 -- 172.21.15.50:0/1008395051 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74011d20 con 0x7faf8c0b1ae0 2023-11-28T11:54:30.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf90917700 1 -- 172.21.15.50:0/1008395051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8c0b1ae0 msgr2=0x7faf8c06d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf90917700 1 --2- 172.21.15.50:0/1008395051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8c0b1ae0 0x7faf8c06d8e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7faf8c08bbc0 tx=0x7faf74009bf0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf90917700 1 -- 172.21.15.50:0/1008395051 shutdown_connections 2023-11-28T11:54:30.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf90917700 1 --2- 172.21.15.50:0/1008395051 >> v2:172.21.15.192:3300/0 conn(0x7faf8c0cf0e0 0x7faf8c0cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf90917700 1 --2- 172.21.15.50:0/1008395051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8c06a4c0 0x7faf8c0d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf90917700 1 --2- 172.21.15.50:0/1008395051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8c0b1ae0 0x7faf8c06d8e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf90917700 1 -- 172.21.15.50:0/1008395051 >> 172.21.15.50:0/1008395051 conn(0x7faf8c09bbd0 msgr2=0x7faf8c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:30.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf90917700 1 -- 172.21.15.50:0/1008395051 shutdown_connections 2023-11-28T11:54:30.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.240+0000 7faf90917700 1 -- 172.21.15.50:0/1008395051 wait complete. 2023-11-28T11:54:30.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.244+0000 7faf90917700 1 Processor -- start 2023-11-28T11:54:30.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.244+0000 7faf90917700 1 -- start start 2023-11-28T11:54:30.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.244+0000 7faf90917700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf8c06a4c0 0x7faf8c14b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.244+0000 7faf90917700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8c0b1ae0 0x7faf8c15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.244+0000 7faf90917700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8c0cf0e0 0x7faf8c09c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.244+0000 7faf90917700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c09e650 con 0x7faf8c0cf0e0 2023-11-28T11:54:30.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.244+0000 7faf90917700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c14bdc0 con 0x7faf8c06a4c0 2023-11-28T11:54:30.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.244+0000 7faf90917700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c09e880 con 0x7faf8c0b1ae0 2023-11-28T11:54:30.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.244+0000 7faf8b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8c0cf0e0 0x7faf8c09c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.244+0000 7faf8b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8c0cf0e0 0x7faf8c09c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60334/0 (socket says 172.21.15.50:60334) 2023-11-28T11:54:30.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.244+0000 7faf8b59e700 1 -- 172.21.15.50:0/1787259275 learned_addr learned my addr 172.21.15.50:0/1787259275 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:30.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.244+0000 7faf8ad9d700 1 --2- 172.21.15.50:0/1787259275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf8c06a4c0 0x7faf8c14b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.244+0000 7faf8a59c700 1 --2- 172.21.15.50:0/1787259275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8c0b1ae0 0x7faf8c15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.244+0000 7faf8b59e700 1 -- 172.21.15.50:0/1787259275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8c0b1ae0 msgr2=0x7faf8c15a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.248+0000 7faf8b59e700 1 --2- 172.21.15.50:0/1787259275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8c0b1ae0 0x7faf8c15a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.248+0000 7faf8b59e700 1 -- 172.21.15.50:0/1787259275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf8c06a4c0 msgr2=0x7faf8c14b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.248+0000 7faf8b59e700 1 --2- 172.21.15.50:0/1787259275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf8c06a4c0 0x7faf8c14b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.248+0000 7faf8b59e700 1 -- 172.21.15.50:0/1787259275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c0094b0 con 0x7faf8c0cf0e0 2023-11-28T11:54:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.248+0000 7faf8b59e700 1 --2- 172.21.15.50:0/1787259275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8c0cf0e0 0x7faf8c09c540 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7faf84009e60 tx=0x7faf8400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.248+0000 7faf837fe700 1 -- 172.21.15.50:0/1787259275 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84009cd0 con 0x7faf8c0cf0e0 2023-11-28T11:54:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.248+0000 7faf837fe700 1 -- 172.21.15.50:0/1787259275 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8400f040 con 0x7faf8c0cf0e0 2023-11-28T11:54:30.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.248+0000 7faf90917700 1 -- 172.21.15.50:0/1787259275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf84009a70 con 0x7faf8c0cf0e0 2023-11-28T11:54:30.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.248+0000 7faf837fe700 1 -- 172.21.15.50:0/1787259275 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8400ccb0 con 0x7faf8c0cf0e0 2023-11-28T11:54:30.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.248+0000 7faf90917700 1 -- 172.21.15.50:0/1787259275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf74009570 con 0x7faf8c0cf0e0 2023-11-28T11:54:30.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.248+0000 7faf90917700 1 -- 172.21.15.50:0/1787259275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8c0b1eb0 con 0x7faf8c0cf0e0 2023-11-28T11:54:30.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.252+0000 7faf837fe700 1 -- 172.21.15.50:0/1787259275 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faf84014480 con 0x7faf8c0cf0e0 2023-11-28T11:54:30.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.252+0000 7faf837fe700 1 --2- 172.21.15.50:0/1787259275 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf6c064ee0 0x7faf6c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.252+0000 7faf837fe700 1 -- 172.21.15.50:0/1787259275 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faf84082860 con 0x7faf8c0cf0e0 2023-11-28T11:54:30.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.252+0000 7faf8ad9d700 1 --2- 172.21.15.50:0/1787259275 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf6c064ee0 0x7faf6c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.252+0000 7faf8ad9d700 1 --2- 172.21.15.50:0/1787259275 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf6c064ee0 0x7faf6c067390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faf74009860 tx=0x7faf74008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.260+0000 7faf837fe700 1 -- 172.21.15.50:0/1787259275 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faf84050670 con 0x7faf8c0cf0e0 2023-11-28T11:54:30.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.428+0000 7faf90917700 1 -- 172.21.15.50:0/1787259275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7faf8c0b60e0 con 0x7faf8c0cf0e0 2023-11-28T11:54:30.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.436+0000 7faf837fe700 1 -- 172.21.15.50:0/1787259275 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7faf84053c90 con 0x7faf8c0cf0e0 2023-11-28T11:54:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.436+0000 7faf90917700 1 -- 172.21.15.50:0/1787259275 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf6c064ee0 msgr2=0x7faf6c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.436+0000 7faf90917700 1 --2- 172.21.15.50:0/1787259275 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf6c064ee0 0x7faf6c067390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faf74009860 tx=0x7faf74008030 comp rx=0 tx=0).stop 2023-11-28T11:54:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.436+0000 7faf90917700 1 -- 172.21.15.50:0/1787259275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8c0cf0e0 msgr2=0x7faf8c09c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.436+0000 7faf90917700 1 --2- 172.21.15.50:0/1787259275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8c0cf0e0 0x7faf8c09c540 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7faf84009e60 tx=0x7faf8400c3a0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.436+0000 7faf90917700 1 -- 172.21.15.50:0/1787259275 shutdown_connections 2023-11-28T11:54:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.436+0000 7faf90917700 1 --2- 172.21.15.50:0/1787259275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8c0cf0e0 0x7faf8c09c540 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.436+0000 7faf90917700 1 --2- 172.21.15.50:0/1787259275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8c0b1ae0 0x7faf8c15a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.436+0000 7faf90917700 1 --2- 172.21.15.50:0/1787259275 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf6c064ee0 0x7faf6c067390 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.436+0000 7faf90917700 1 --2- 172.21.15.50:0/1787259275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf8c06a4c0 0x7faf8c14b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.436+0000 7faf90917700 1 -- 172.21.15.50:0/1787259275 >> 172.21.15.50:0/1787259275 conn(0x7faf8c09bbd0 msgr2=0x7faf8c0b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.436+0000 7faf90917700 1 -- 172.21.15.50:0/1787259275 shutdown_connections 2023-11-28T11:54:30.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.436+0000 7faf90917700 1 -- 172.21.15.50:0/1787259275 wait complete. 2023-11-28T11:54:30.455 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:54:30.455 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:54:30.469 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:54:30.488 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:54:30.488 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:54:30.488 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:54:30.495 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:54:30.495 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:54:30.542 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:30.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.652+0000 7f14b91bf700 1 Processor -- start 2023-11-28T11:54:30.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.652+0000 7f14b91bf700 1 -- start start 2023-11-28T11:54:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.652+0000 7f14b91bf700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f14b40b32e0 0x7f14b40b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.652+0000 7f14b91bf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14b4069cd0 0x7f14b406a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.652+0000 7f14b91bf700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b40cbe00 con 0x7f14b41584c0 2023-11-28T11:54:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.652+0000 7f14b91bf700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b406dbd0 con 0x7f14b40b32e0 2023-11-28T11:54:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.652+0000 7f14b91bf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40b3c60 con 0x7f14b4069cd0 2023-11-28T11:54:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.652+0000 7f14b3fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f14b41584c0 0x7f14b40cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44422/0 (socket says 172.21.15.50:44422) 2023-11-28T11:54:30.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.652+0000 7f14b3fff700 1 -- 172.21.15.50:0/1866010629 learned_addr learned my addr 172.21.15.50:0/1866010629 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b89be700 1 --2- 172.21.15.50:0/1866010629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14b4069cd0 0x7f14b406a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b37fe700 1 --2- 172.21.15.50:0/1866010629 >> v2:172.21.15.192:3300/0 conn(0x7f14b40b32e0 0x7f14b40b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b2ffd700 1 -- 172.21.15.50:0/1866010629 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078807242 0 0) 0x7f14b40cbe00 con 0x7f14b41584c0 2023-11-28T11:54:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b2ffd700 1 -- 172.21.15.50:0/1866010629 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14a00057e0 con 0x7f14b41584c0 2023-11-28T11:54:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b89be700 1 -- 172.21.15.50:0/1866010629 >> v2:172.21.15.192:3300/0 conn(0x7f14b40b32e0 msgr2=0x7f14b40b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b89be700 1 --2- 172.21.15.50:0/1866010629 >> v2:172.21.15.192:3300/0 conn(0x7f14b40b32e0 0x7f14b40b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b89be700 1 -- 172.21.15.50:0/1866010629 >> v1:172.21.15.50:6789/0 conn(0x7f14b41584c0 legacy=0x7f14b40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b89be700 1 -- 172.21.15.50:0/1866010629 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b40cd0f0 con 0x7f14b4069cd0 2023-11-28T11:54:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b37fe700 1 --2- 172.21.15.50:0/1866010629 >> v2:172.21.15.192:3300/0 conn(0x7f14b40b32e0 0x7f14b40b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b89be700 1 --2- 172.21.15.50:0/1866010629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14b4069cd0 0x7f14b406a0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f14ac009d90 tx=0x7f14ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e8af127ad91f104 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b2ffd700 1 -- 172.21.15.50:0/1866010629 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00e070 con 0x7f14b4069cd0 2023-11-28T11:54:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b2ffd700 1 -- 172.21.15.50:0/1866010629 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac00bb20 con 0x7f14b4069cd0 2023-11-28T11:54:30.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b2ffd700 1 -- 172.21.15.50:0/1866010629 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00be90 con 0x7f14b4069cd0 2023-11-28T11:54:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b91bf700 1 -- 172.21.15.50:0/1866010629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14b4069cd0 msgr2=0x7f14b406a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b91bf700 1 --2- 172.21.15.50:0/1866010629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14b4069cd0 0x7f14b406a0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f14ac009d90 tx=0x7f14ac00b330 comp rx=0 tx=0).stop 2023-11-28T11:54:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b91bf700 1 -- 172.21.15.50:0/1866010629 shutdown_connections 2023-11-28T11:54:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b91bf700 1 --2- 172.21.15.50:0/1866010629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14b4069cd0 0x7f14b406a0d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b91bf700 1 --2- 172.21.15.50:0/1866010629 >> v2:172.21.15.192:3300/0 conn(0x7f14b40b32e0 0x7f14b40b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b91bf700 1 -- 172.21.15.50:0/1866010629 >> 172.21.15.50:0/1866010629 conn(0x7f14b40ce3e0 msgr2=0x7f14b40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b91bf700 1 -- 172.21.15.50:0/1866010629 shutdown_connections 2023-11-28T11:54:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b91bf700 1 -- 172.21.15.50:0/1866010629 wait complete. 2023-11-28T11:54:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.656+0000 7f14b91bf700 1 Processor -- start 2023-11-28T11:54:30.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b91bf700 1 -- start start 2023-11-28T11:54:30.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b91bf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b4069cd0 0x7f14b4154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b91bf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14b40b32e0 0x7f14b41e5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b91bf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14b41584c0 0x7f14b40af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b91bf700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b41e6570 con 0x7f14b4069cd0 2023-11-28T11:54:30.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b91bf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40c6b90 con 0x7f14b40b32e0 2023-11-28T11:54:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b91bf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40c6e70 con 0x7f14b41584c0 2023-11-28T11:54:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b4069cd0 0x7f14b4154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b4069cd0 0x7f14b4154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60336/0 (socket says 172.21.15.50:60336) 2023-11-28T11:54:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b3fff700 1 -- 172.21.15.50:0/452736330 learned_addr learned my addr 172.21.15.50:0/452736330 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b89be700 1 --2- 172.21.15.50:0/452736330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14b41584c0 0x7f14b40af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b37fe700 1 --2- 172.21.15.50:0/452736330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14b40b32e0 0x7f14b41e5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b3fff700 1 -- 172.21.15.50:0/452736330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14b41584c0 msgr2=0x7f14b40af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b3fff700 1 --2- 172.21.15.50:0/452736330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14b41584c0 0x7f14b40af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b3fff700 1 -- 172.21.15.50:0/452736330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14b40b32e0 msgr2=0x7f14b41e5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b3fff700 1 --2- 172.21.15.50:0/452736330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14b40b32e0 0x7f14b41e5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b3fff700 1 -- 172.21.15.50:0/452736330 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a40094b0 con 0x7f14b4069cd0 2023-11-28T11:54:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b3fff700 1 --2- 172.21.15.50:0/452736330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b4069cd0 0x7f14b4154ed0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f149c001200 tx=0x7f149c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b0ff9700 1 -- 172.21.15.50:0/452736330 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c005d90 con 0x7f14b4069cd0 2023-11-28T11:54:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b0ff9700 1 -- 172.21.15.50:0/452736330 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c00ce80 con 0x7f14b4069cd0 2023-11-28T11:54:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b91bf700 1 -- 172.21.15.50:0/452736330 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ac009a70 con 0x7f14b4069cd0 2023-11-28T11:54:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b0ff9700 1 -- 172.21.15.50:0/452736330 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c007310 con 0x7f14b4069cd0 2023-11-28T11:54:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b91bf700 1 -- 172.21.15.50:0/452736330 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b40cd6b0 con 0x7f14b4069cd0 2023-11-28T11:54:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.660+0000 7f14b91bf700 1 -- 172.21.15.50:0/452736330 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b40cd3d0 con 0x7f14b4069cd0 2023-11-28T11:54:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.664+0000 7f14b0ff9700 1 -- 172.21.15.50:0/452736330 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f149c019030 con 0x7f14b4069cd0 2023-11-28T11:54:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.664+0000 7f14b0ff9700 1 --2- 172.21.15.50:0/452736330 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1494064ee0 0x7f1494067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.664+0000 7f14b0ff9700 1 -- 172.21.15.50:0/452736330 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f149c081470 con 0x7f14b4069cd0 2023-11-28T11:54:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.664+0000 7f14b37fe700 1 --2- 172.21.15.50:0/452736330 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1494064ee0 0x7f1494067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.664+0000 7f14b37fe700 1 --2- 172.21.15.50:0/452736330 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1494064ee0 0x7f1494067390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f14b40b0470 tx=0x7f14a4009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:30.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.672+0000 7f14b0ff9700 1 -- 172.21.15.50:0/452736330 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f149c04f1f0 con 0x7f14b4069cd0 2023-11-28T11:54:30.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.836+0000 7f14b91bf700 1 -- 172.21.15.50:0/452736330 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14b40cd990 con 0x7f14b4069cd0 2023-11-28T11:54:30.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.840+0000 7f14b0ff9700 1 -- 172.21.15.50:0/452736330 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19689 (secure 0 0 0) 0x7f149c052810 con 0x7f14b4069cd0 2023-11-28T11:54:30.840 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:30.841 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:54:30.086945+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:30.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.844+0000 7f14b91bf700 1 -- 172.21.15.50:0/452736330 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1494064ee0 msgr2=0x7f1494067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.844+0000 7f14b91bf700 1 --2- 172.21.15.50:0/452736330 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1494064ee0 0x7f1494067390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f14b40b0470 tx=0x7f14a4009240 comp rx=0 tx=0).stop 2023-11-28T11:54:30.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.844+0000 7f14b91bf700 1 -- 172.21.15.50:0/452736330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b4069cd0 msgr2=0x7f14b4154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.844+0000 7f14b91bf700 1 --2- 172.21.15.50:0/452736330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b4069cd0 0x7f14b4154ed0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f149c001200 tx=0x7f149c00c7b0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.844+0000 7f14b91bf700 1 -- 172.21.15.50:0/452736330 shutdown_connections 2023-11-28T11:54:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.844+0000 7f14b91bf700 1 --2- 172.21.15.50:0/452736330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14b41584c0 0x7f14b40af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.844+0000 7f14b91bf700 1 --2- 172.21.15.50:0/452736330 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1494064ee0 0x7f1494067390 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.844+0000 7f14b91bf700 1 --2- 172.21.15.50:0/452736330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14b40b32e0 0x7f14b41e5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.844+0000 7f14b91bf700 1 --2- 172.21.15.50:0/452736330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b4069cd0 0x7f14b4154ed0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.844+0000 7f14b91bf700 1 -- 172.21.15.50:0/452736330 >> 172.21.15.50:0/452736330 conn(0x7f14b40ce3e0 msgr2=0x7f14b40ca2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.844+0000 7f14b91bf700 1 -- 172.21.15.50:0/452736330 shutdown_connections 2023-11-28T11:54:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.844+0000 7f14b91bf700 1 -- 172.21.15.50:0/452736330 wait complete. 2023-11-28T11:54:30.862 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:53:38.462826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:53:39.778621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:53:42.870360+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:54:30.863 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:54:30.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.984+0000 7fd81966b700 1 Processor -- start 2023-11-28T11:54:30.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.984+0000 7fd81966b700 1 -- start start 2023-11-28T11:54:30.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.984+0000 7fd81966b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd8140b1ae0 0x7fd81406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.984+0000 7fd81966b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81406a9c0 con 0x7fd8140cf0e0 2023-11-28T11:54:30.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.984+0000 7fd81966b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81406aca0 con 0x7fd81406a4c0 2023-11-28T11:54:30.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.984+0000 7fd81966b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8140d0ab0 con 0x7fd8140b1ae0 2023-11-28T11:54:30.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.984+0000 7fd818e6a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd8140cf0e0 0x7fd8140cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44432/0 (socket says 172.21.15.50:44432) 2023-11-28T11:54:30.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.984+0000 7fd813fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd8140b1ae0 0x7fd81406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.984+0000 7fd818e6a700 1 -- 172.21.15.50:0/530294620 learned_addr learned my addr 172.21.15.50:0/530294620 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:30.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.984+0000 7fd812ffd700 1 -- 172.21.15.50:0/530294620 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897686559 0 0) 0x7fd81406a9c0 con 0x7fd8140cf0e0 2023-11-28T11:54:30.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.988+0000 7fd812ffd700 1 -- 172.21.15.50:0/530294620 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8000035d0 con 0x7fd8140cf0e0 2023-11-28T11:54:30.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.988+0000 7fd812ffd700 1 -- 172.21.15.50:0/530294620 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078213131 0 0) 0x7fd81406aca0 con 0x7fd81406a4c0 2023-11-28T11:54:30.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.988+0000 7fd812ffd700 1 -- 172.21.15.50:0/530294620 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd81406a9c0 con 0x7fd81406a4c0 2023-11-28T11:54:30.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.988+0000 7fd813fff700 1 -- 172.21.15.50:0/530294620 >> v1:172.21.15.192:6789/0 conn(0x7fd81406a4c0 legacy=0x7fd8140d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.988+0000 7fd813fff700 1 -- 172.21.15.50:0/530294620 >> v1:172.21.15.50:6789/0 conn(0x7fd8140cf0e0 legacy=0x7fd8140cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.988+0000 7fd813fff700 1 -- 172.21.15.50:0/530294620 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81406af80 con 0x7fd8140b1ae0 2023-11-28T11:54:30.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.988+0000 7fd813fff700 1 --2- 172.21.15.50:0/530294620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8140b1ae0 0x7fd81406d8e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009850 tx=0x7fd7fc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95c7a6d4763e56b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:30.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.988+0000 7fd812ffd700 1 -- 172.21.15.50:0/530294620 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc011830 con 0x7fd8140b1ae0 2023-11-28T11:54:30.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.988+0000 7fd812ffd700 1 -- 172.21.15.50:0/530294620 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc011990 con 0x7fd8140b1ae0 2023-11-28T11:54:30.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.988+0000 7fd812ffd700 1 -- 172.21.15.50:0/530294620 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc011d00 con 0x7fd8140b1ae0 2023-11-28T11:54:30.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.988+0000 7fd81966b700 1 -- 172.21.15.50:0/530294620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8140b1ae0 msgr2=0x7fd81406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.988+0000 7fd81966b700 1 --2- 172.21.15.50:0/530294620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8140b1ae0 0x7fd81406d8e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009850 tx=0x7fd7fc009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:30.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.988+0000 7fd81966b700 1 -- 172.21.15.50:0/530294620 shutdown_connections 2023-11-28T11:54:30.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.988+0000 7fd81966b700 1 --2- 172.21.15.50:0/530294620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8140b1ae0 0x7fd81406d8e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.988+0000 7fd81966b700 1 -- 172.21.15.50:0/530294620 >> 172.21.15.50:0/530294620 conn(0x7fd81409bbd0 msgr2=0x7fd8140b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:30.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.988+0000 7fd81966b700 1 -- 172.21.15.50:0/530294620 shutdown_connections 2023-11-28T11:54:30.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.988+0000 7fd81966b700 1 -- 172.21.15.50:0/530294620 wait complete. 2023-11-28T11:54:30.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd81966b700 1 Processor -- start 2023-11-28T11:54:30.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd81966b700 1 -- start start 2023-11-28T11:54:30.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd81966b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd81406a4c0 0x7fd8140c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd81966b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8140b1ae0 0x7fd81414db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd81966b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8140cf0e0 0x7fd81415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd81966b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81409c540 con 0x7fd8140b1ae0 2023-11-28T11:54:30.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd81966b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81409c820 con 0x7fd81406a4c0 2023-11-28T11:54:30.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd81966b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140c6a70 con 0x7fd8140cf0e0 2023-11-28T11:54:30.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd8137fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8140b1ae0 0x7fd81414db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd8137fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8140b1ae0 0x7fd81414db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60340/0 (socket says 172.21.15.50:60340) 2023-11-28T11:54:30.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd8137fe700 1 -- 172.21.15.50:0/1687840496 learned_addr learned my addr 172.21.15.50:0/1687840496 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:30.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd813fff700 1 --2- 172.21.15.50:0/1687840496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd81406a4c0 0x7fd8140c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd818e6a700 1 --2- 172.21.15.50:0/1687840496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8140cf0e0 0x7fd81415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd8137fe700 1 -- 172.21.15.50:0/1687840496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8140cf0e0 msgr2=0x7fd81415dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd8137fe700 1 --2- 172.21.15.50:0/1687840496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8140cf0e0 0x7fd81415dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd8137fe700 1 -- 172.21.15.50:0/1687840496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd81406a4c0 msgr2=0x7fd8140c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:30.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd8137fe700 1 --2- 172.21.15.50:0/1687840496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd81406a4c0 0x7fd8140c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:30.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd8137fe700 1 -- 172.21.15.50:0/1687840496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc0094b0 con 0x7fd8140b1ae0 2023-11-28T11:54:30.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.992+0000 7fd8137fe700 1 --2- 172.21.15.50:0/1687840496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8140b1ae0 0x7fd81414db80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd80400c500 tx=0x7fd80400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:30.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.996+0000 7fd810ff9700 1 -- 172.21.15.50:0/1687840496 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040052d0 con 0x7fd8140b1ae0 2023-11-28T11:54:30.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.996+0000 7fd810ff9700 1 -- 172.21.15.50:0/1687840496 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd804005450 con 0x7fd8140b1ae0 2023-11-28T11:54:30.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.996+0000 7fd810ff9700 1 -- 172.21.15.50:0/1687840496 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040038e0 con 0x7fd8140b1ae0 2023-11-28T11:54:30.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.996+0000 7fd81966b700 1 -- 172.21.15.50:0/1687840496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8140b1eb0 con 0x7fd8140b1ae0 2023-11-28T11:54:30.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.996+0000 7fd81966b700 1 -- 172.21.15.50:0/1687840496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8140b4380 con 0x7fd8140b1ae0 2023-11-28T11:54:30.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.996+0000 7fd81966b700 1 -- 172.21.15.50:0/1687840496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8140b60e0 con 0x7fd8140b1ae0 2023-11-28T11:54:30.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.996+0000 7fd810ff9700 1 -- 172.21.15.50:0/1687840496 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd804019030 con 0x7fd8140b1ae0 2023-11-28T11:54:30.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.996+0000 7fd810ff9700 1 --2- 172.21.15.50:0/1687840496 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd7f4064ee0 0x7fd7f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:30.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.996+0000 7fd810ff9700 1 -- 172.21.15.50:0/1687840496 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd804081470 con 0x7fd8140b1ae0 2023-11-28T11:54:30.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:30.996+0000 7fd813fff700 1 --2- 172.21.15.50:0/1687840496 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd7f4064ee0 0x7fd7f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:30.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.000+0000 7fd813fff700 1 --2- 172.21.15.50:0/1687840496 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd7f4064ee0 0x7fd7f4067390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0090b0 tx=0x7fd7fc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:31.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.004+0000 7fd810ff9700 1 -- 172.21.15.50:0/1687840496 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd80404f260 con 0x7fd8140b1ae0 2023-11-28T11:54:31.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.168+0000 7fd81966b700 1 -- 172.21.15.50:0/1687840496 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd81409ca40 con 0x7fd8140b1ae0 2023-11-28T11:54:31.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.168+0000 7fd810ff9700 1 -- 172.21.15.50:0/1687840496 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd804052880 con 0x7fd8140b1ae0 2023-11-28T11:54:31.170 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:54:31.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.172+0000 7fd81966b700 1 -- 172.21.15.50:0/1687840496 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd7f4064ee0 msgr2=0x7fd7f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.172+0000 7fd81966b700 1 --2- 172.21.15.50:0/1687840496 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd7f4064ee0 0x7fd7f4067390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0090b0 tx=0x7fd7fc008030 comp rx=0 tx=0).stop 2023-11-28T11:54:31.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.172+0000 7fd81966b700 1 -- 172.21.15.50:0/1687840496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8140b1ae0 msgr2=0x7fd81414db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.172+0000 7fd81966b700 1 --2- 172.21.15.50:0/1687840496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8140b1ae0 0x7fd81414db80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd80400c500 tx=0x7fd80400c810 comp rx=0 tx=0).stop 2023-11-28T11:54:31.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.172+0000 7fd81966b700 1 -- 172.21.15.50:0/1687840496 shutdown_connections 2023-11-28T11:54:31.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.172+0000 7fd81966b700 1 --2- 172.21.15.50:0/1687840496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8140cf0e0 0x7fd81415dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.172+0000 7fd81966b700 1 --2- 172.21.15.50:0/1687840496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8140b1ae0 0x7fd81414db80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.172+0000 7fd81966b700 1 --2- 172.21.15.50:0/1687840496 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd7f4064ee0 0x7fd7f4067390 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.172+0000 7fd81966b700 1 --2- 172.21.15.50:0/1687840496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd81406a4c0 0x7fd8140c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.172+0000 7fd81966b700 1 -- 172.21.15.50:0/1687840496 >> 172.21.15.50:0/1687840496 conn(0x7fd81409bbd0 msgr2=0x7fd8140d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:31.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.172+0000 7fd81966b700 1 -- 172.21.15.50:0/1687840496 shutdown_connections 2023-11-28T11:54:31.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.172+0000 7fd81966b700 1 -- 172.21.15.50:0/1687840496 wait complete. 2023-11-28T11:54:31.185 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:54:31.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.296+0000 7f3367fff700 1 Processor -- start 2023-11-28T11:54:31.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3367fff700 1 -- start start 2023-11-28T11:54:31.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3367fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f33680b00e0 0x7f336815d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3367fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f336809bdb0 0x7f336815d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3367fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33680b2db0 con 0x7f33680cbb30 2023-11-28T11:54:31.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3367fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33680b3240 con 0x7f33680b00e0 2023-11-28T11:54:31.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3367fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336806d840 con 0x7f336809bdb0 2023-11-28T11:54:31.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3366ffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f33680b00e0 0x7f336815d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f33667fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f336809bdb0 0x7f336815d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f33677fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f33680cbb30 0x7f33680ccf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:59156/0 (socket says 172.21.15.50:59156) 2023-11-28T11:54:31.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f33677fe700 1 -- 172.21.15.50:0/1885678129 learned_addr learned my addr 172.21.15.50:0/1885678129 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:31.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3366ffd700 1 --2- 172.21.15.50:0/1885678129 >> v2:172.21.15.192:3300/0 conn(0x7f33680b00e0 0x7f336815d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:35120/0 (socket says 172.21.15.50:35120) 2023-11-28T11:54:31.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3365ffb700 1 -- 172.21.15.50:0/1885678129 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665969060 0 0) 0x7f33680b2db0 con 0x7f33680cbb30 2023-11-28T11:54:31.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f33667fc700 1 -- 172.21.15.50:0/1885678129 >> v2:172.21.15.192:3300/0 conn(0x7f33680b00e0 msgr2=0x7f336815d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:31.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f33667fc700 1 --2- 172.21.15.50:0/1885678129 >> v2:172.21.15.192:3300/0 conn(0x7f33680b00e0 0x7f336815d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f33667fc700 1 -- 172.21.15.50:0/1885678129 >> v1:172.21.15.192:6789/0 conn(0x7f33680cbb30 legacy=0x7f33680ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f33667fc700 1 -- 172.21.15.50:0/1885678129 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336806d560 con 0x7f336809bdb0 2023-11-28T11:54:31.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f33667fc700 1 --2- 172.21.15.50:0/1885678129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f336809bdb0 0x7f336815d820 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3358009850 tx=0x7f3358009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e20c73c7b6dc482c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:31.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3365ffb700 1 -- 172.21.15.50:0/1885678129 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3358011830 con 0x7f336809bdb0 2023-11-28T11:54:31.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3365ffb700 1 -- 172.21.15.50:0/1885678129 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3358011990 con 0x7f336809bdb0 2023-11-28T11:54:31.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3365ffb700 1 -- 172.21.15.50:0/1885678129 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3358011d40 con 0x7f336809bdb0 2023-11-28T11:54:31.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3367fff700 1 -- 172.21.15.50:0/1885678129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f336809bdb0 msgr2=0x7f336815d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3367fff700 1 --2- 172.21.15.50:0/1885678129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f336809bdb0 0x7f336815d820 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3358009850 tx=0x7f3358009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:31.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3367fff700 1 -- 172.21.15.50:0/1885678129 shutdown_connections 2023-11-28T11:54:31.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3367fff700 1 --2- 172.21.15.50:0/1885678129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f336809bdb0 0x7f336815d820 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3367fff700 1 --2- 172.21.15.50:0/1885678129 >> v2:172.21.15.192:3300/0 conn(0x7f33680b00e0 0x7f336815d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3367fff700 1 -- 172.21.15.50:0/1885678129 >> 172.21.15.50:0/1885678129 conn(0x7f33680cae70 msgr2=0x7f33680cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:31.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.300+0000 7f3367fff700 1 -- 172.21.15.50:0/1885678129 shutdown_connections 2023-11-28T11:54:31.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.304+0000 7f3367fff700 1 -- 172.21.15.50:0/1885678129 wait complete. 2023-11-28T11:54:31.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.304+0000 7f3367fff700 1 Processor -- start 2023-11-28T11:54:31.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.304+0000 7f3367fff700 1 -- start start 2023-11-28T11:54:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.304+0000 7f3367fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336809bdb0 0x7f336809b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.304+0000 7f3367fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33680b00e0 0x7f33680ab1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.304+0000 7f3367fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33680cbb30 0x7f336815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.304+0000 7f3367fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33680c9200 con 0x7f33680cbb30 2023-11-28T11:54:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.304+0000 7f3367fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336809b870 con 0x7f336809bdb0 2023-11-28T11:54:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.304+0000 7f3367fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33680c1290 con 0x7f33680b00e0 2023-11-28T11:54:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.304+0000 7f33677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33680cbb30 0x7f336815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.304+0000 7f33677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33680cbb30 0x7f336815a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60352/0 (socket says 172.21.15.50:60352) 2023-11-28T11:54:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.304+0000 7f33677fe700 1 -- 172.21.15.50:0/3619670655 learned_addr learned my addr 172.21.15.50:0/3619670655 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:31.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.304+0000 7f3366ffd700 1 --2- 172.21.15.50:0/3619670655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336809bdb0 0x7f336809b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.304+0000 7f33667fc700 1 --2- 172.21.15.50:0/3619670655 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33680b00e0 0x7f33680ab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.308+0000 7f33677fe700 1 -- 172.21.15.50:0/3619670655 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33680b00e0 msgr2=0x7f33680ab1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.308+0000 7f33677fe700 1 --2- 172.21.15.50:0/3619670655 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33680b00e0 0x7f33680ab1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.308+0000 7f33677fe700 1 -- 172.21.15.50:0/3619670655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336809bdb0 msgr2=0x7f336809b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.308+0000 7f33677fe700 1 --2- 172.21.15.50:0/3619670655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336809bdb0 0x7f336809b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.308+0000 7f33677fe700 1 -- 172.21.15.50:0/3619670655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33580094b0 con 0x7f33680cbb30 2023-11-28T11:54:31.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.308+0000 7f33677fe700 1 --2- 172.21.15.50:0/3619670655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33680cbb30 0x7f336815a2c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f336000cc10 tx=0x7f336000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:31.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.308+0000 7f334f7fe700 1 -- 172.21.15.50:0/3619670655 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336000aa60 con 0x7f33680cbb30 2023-11-28T11:54:31.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.308+0000 7f334f7fe700 1 -- 172.21.15.50:0/3619670655 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336000abc0 con 0x7f33680cbb30 2023-11-28T11:54:31.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.308+0000 7f3367fff700 1 -- 172.21.15.50:0/3619670655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33680ac3d0 con 0x7f33680cbb30 2023-11-28T11:54:31.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.308+0000 7f334f7fe700 1 -- 172.21.15.50:0/3619670655 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33600070d0 con 0x7f33680cbb30 2023-11-28T11:54:31.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.308+0000 7f3367fff700 1 -- 172.21.15.50:0/3619670655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33680ac0f0 con 0x7f33680cbb30 2023-11-28T11:54:31.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.308+0000 7f3367fff700 1 -- 172.21.15.50:0/3619670655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336806cbe0 con 0x7f33680cbb30 2023-11-28T11:54:31.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.308+0000 7f334f7fe700 1 -- 172.21.15.50:0/3619670655 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3360010070 con 0x7f33680cbb30 2023-11-28T11:54:31.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.312+0000 7f334f7fe700 1 --2- 172.21.15.50:0/3619670655 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3354064ee0 0x7f3354067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.312+0000 7f334f7fe700 1 -- 172.21.15.50:0/3619670655 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3360081c70 con 0x7f33680cbb30 2023-11-28T11:54:31.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.312+0000 7f3366ffd700 1 --2- 172.21.15.50:0/3619670655 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3354064ee0 0x7f3354067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.312+0000 7f3366ffd700 1 --2- 172.21.15.50:0/3619670655 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3354064ee0 0x7f3354067390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f335c009bf0 tx=0x7f335c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:31.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.316+0000 7f334f7fe700 1 -- 172.21.15.50:0/3619670655 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f336004f970 con 0x7f33680cbb30 2023-11-28T11:54:31.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.476+0000 7f3367fff700 1 -- 172.21.15.50:0/3619670655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33680c93b0 con 0x7f33680cbb30 2023-11-28T11:54:31.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.476+0000 7f334f7fe700 1 -- 172.21.15.50:0/3619670655 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33680c93b0 con 0x7f33680cbb30 2023-11-28T11:54:31.477 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:54:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.476+0000 7f3367fff700 1 -- 172.21.15.50:0/3619670655 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3354064ee0 msgr2=0x7f3354067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.476+0000 7f3367fff700 1 --2- 172.21.15.50:0/3619670655 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3354064ee0 0x7f3354067390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f335c009bf0 tx=0x7f335c009240 comp rx=0 tx=0).stop 2023-11-28T11:54:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.476+0000 7f3367fff700 1 -- 172.21.15.50:0/3619670655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33680cbb30 msgr2=0x7f336815a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.476+0000 7f3367fff700 1 --2- 172.21.15.50:0/3619670655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33680cbb30 0x7f336815a2c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f336000cc10 tx=0x7f336000cf20 comp rx=0 tx=0).stop 2023-11-28T11:54:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.480+0000 7f3367fff700 1 -- 172.21.15.50:0/3619670655 shutdown_connections 2023-11-28T11:54:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.480+0000 7f3367fff700 1 --2- 172.21.15.50:0/3619670655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33680cbb30 0x7f336815a2c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.480+0000 7f3367fff700 1 --2- 172.21.15.50:0/3619670655 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33680b00e0 0x7f33680ab1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.480+0000 7f3367fff700 1 --2- 172.21.15.50:0/3619670655 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3354064ee0 0x7f3354067390 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.480+0000 7f3367fff700 1 --2- 172.21.15.50:0/3619670655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336809bdb0 0x7f336809b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.480+0000 7f3367fff700 1 -- 172.21.15.50:0/3619670655 >> 172.21.15.50:0/3619670655 conn(0x7f33680cae70 msgr2=0x7f336806acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:31.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.480+0000 7f3367fff700 1 -- 172.21.15.50:0/3619670655 shutdown_connections 2023-11-28T11:54:31.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.480+0000 7f3367fff700 1 -- 172.21.15.50:0/3619670655 wait complete. 2023-11-28T11:54:31.491 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:54:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.612+0000 7f4570a81700 1 Processor -- start 2023-11-28T11:54:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.612+0000 7f4570a81700 1 -- start start 2023-11-28T11:54:31.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.612+0000 7f4570a81700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f456c162d80 0x7f456c165160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.612+0000 7f4570a81700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456c0cb050 con 0x7f456c0cf740 2023-11-28T11:54:31.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.612+0000 7f4570a81700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456c15da00 con 0x7f456c0b2110 2023-11-28T11:54:31.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.612+0000 7f4570a81700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456c15dc50 con 0x7f456c162d80 2023-11-28T11:54:31.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.612+0000 7f456affd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f456c0cf740 0x7f456c0b24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:44440/0 (socket says 172.21.15.50:44440) 2023-11-28T11:54:31.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.612+0000 7f456bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f456c162d80 0x7f456c165160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.612+0000 7f456affd700 1 -- 172.21.15.50:0/4158233499 learned_addr learned my addr 172.21.15.50:0/4158233499 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:31.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.616+0000 7f456bfff700 1 -- 172.21.15.50:0/4158233499 >> v1:172.21.15.192:6789/0 conn(0x7f456c0b2110 legacy=0x7f456c0cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.616+0000 7f456bfff700 1 -- 172.21.15.50:0/4158233499 >> v1:172.21.15.50:6789/0 conn(0x7f456c0cf740 legacy=0x7f456c0b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.616+0000 7f456bfff700 1 -- 172.21.15.50:0/4158233499 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c15df30 con 0x7f456c162d80 2023-11-28T11:54:31.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.616+0000 7f456a7fc700 1 -- 172.21.15.50:0/4158233499 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783938252 0 0) 0x7f456c0cb050 con 0x7f456c0cf740 2023-11-28T11:54:31.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.616+0000 7f456bfff700 1 --2- 172.21.15.50:0/4158233499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c162d80 0x7f456c165160 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4564009d90 tx=0x7f456400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1f3c9009079b42 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:31.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.616+0000 7f456a7fc700 1 -- 172.21.15.50:0/4158233499 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456400e070 con 0x7f456c162d80 2023-11-28T11:54:31.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.616+0000 7f456a7fc700 1 -- 172.21.15.50:0/4158233499 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456400bbd0 con 0x7f456c162d80 2023-11-28T11:54:31.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.616+0000 7f456a7fc700 1 -- 172.21.15.50:0/4158233499 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564012430 con 0x7f456c162d80 2023-11-28T11:54:31.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.616+0000 7f4570a81700 1 -- 172.21.15.50:0/4158233499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c162d80 msgr2=0x7f456c165160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.616+0000 7f4570a81700 1 --2- 172.21.15.50:0/4158233499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c162d80 0x7f456c165160 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4564009d90 tx=0x7f456400b330 comp rx=0 tx=0).stop 2023-11-28T11:54:31.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.616+0000 7f4570a81700 1 -- 172.21.15.50:0/4158233499 shutdown_connections 2023-11-28T11:54:31.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.616+0000 7f4570a81700 1 --2- 172.21.15.50:0/4158233499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c162d80 0x7f456c165160 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.616+0000 7f4570a81700 1 -- 172.21.15.50:0/4158233499 >> 172.21.15.50:0/4158233499 conn(0x7f456c0cd0a0 msgr2=0x7f456c0cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:31.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.616+0000 7f4570a81700 1 -- 172.21.15.50:0/4158233499 shutdown_connections 2023-11-28T11:54:31.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.616+0000 7f4570a81700 1 -- 172.21.15.50:0/4158233499 wait complete. 2023-11-28T11:54:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f4570a81700 1 Processor -- start 2023-11-28T11:54:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f4570a81700 1 -- start start 2023-11-28T11:54:31.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f4570a81700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f456c0b2110 0x7f456c0b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f4570a81700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c0cf740 0x7f456c14fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f4570a81700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f456c162d80 0x7f456c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f4570a81700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c06fd00 con 0x7f456c0cf740 2023-11-28T11:54:31.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f4570a81700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c0b5620 con 0x7f456c0b2110 2023-11-28T11:54:31.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f4570a81700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c150790 con 0x7f456c162d80 2023-11-28T11:54:31.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f456affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c0cf740 0x7f456c14fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f456bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f456c162d80 0x7f456c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f456affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c0cf740 0x7f456c14fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60380/0 (socket says 172.21.15.50:60380) 2023-11-28T11:54:31.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f456affd700 1 -- 172.21.15.50:0/993032592 learned_addr learned my addr 172.21.15.50:0/993032592 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:31.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f456b7fe700 1 --2- 172.21.15.50:0/993032592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f456c0b2110 0x7f456c0b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f456affd700 1 -- 172.21.15.50:0/993032592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f456c162d80 msgr2=0x7f456c06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f456affd700 1 --2- 172.21.15.50:0/993032592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f456c162d80 0x7f456c06ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f456affd700 1 -- 172.21.15.50:0/993032592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f456c0b2110 msgr2=0x7f456c0b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f456affd700 1 --2- 172.21.15.50:0/993032592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f456c0b2110 0x7f456c0b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f456affd700 1 -- 172.21.15.50:0/993032592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4564009a70 con 0x7f456c0cf740 2023-11-28T11:54:31.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f456affd700 1 --2- 172.21.15.50:0/993032592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c0cf740 0x7f456c14fd40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f456000c450 tx=0x7f456000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f4553fff700 1 -- 172.21.15.50:0/993032592 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4560004ca0 con 0x7f456c0cf740 2023-11-28T11:54:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f4553fff700 1 -- 172.21.15.50:0/993032592 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4560004e00 con 0x7f456c0cf740 2023-11-28T11:54:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f4570a81700 1 -- 172.21.15.50:0/993032592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456c15e4f0 con 0x7f456c0cf740 2023-11-28T11:54:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f4553fff700 1 -- 172.21.15.50:0/993032592 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4560007310 con 0x7f456c0cf740 2023-11-28T11:54:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.620+0000 7f4570a81700 1 -- 172.21.15.50:0/993032592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456c15e210 con 0x7f456c0cf740 2023-11-28T11:54:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.624+0000 7f4570a81700 1 -- 172.21.15.50:0/993032592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456c0b0e60 con 0x7f456c0cf740 2023-11-28T11:54:31.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.624+0000 7f4553fff700 1 -- 172.21.15.50:0/993032592 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f456001a020 con 0x7f456c0cf740 2023-11-28T11:54:31.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.624+0000 7f4553fff700 1 --2- 172.21.15.50:0/993032592 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4558064f10 0x7f45580673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.624+0000 7f4553fff700 1 -- 172.21.15.50:0/993032592 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4560081b70 con 0x7f456c0cf740 2023-11-28T11:54:31.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.624+0000 7f456b7fe700 1 --2- 172.21.15.50:0/993032592 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4558064f10 0x7f45580673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.628+0000 7f456b7fe700 1 --2- 172.21.15.50:0/993032592 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4558064f10 0x7f45580673c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f455c000f60 tx=0x7f455c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:31.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.632+0000 7f4553fff700 1 -- 172.21.15.50:0/993032592 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f456004f9e0 con 0x7f456c0cf740 2023-11-28T11:54:31.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.796+0000 7f4570a81700 1 -- 172.21.15.50:0/993032592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f456c150970 con 0x7f456c0cf740 2023-11-28T11:54:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.800+0000 7f4553fff700 1 -- 172.21.15.50:0/993032592 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f456c150970 con 0x7f456c0cf740 2023-11-28T11:54:31.799 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.800+0000 7f4570a81700 1 -- 172.21.15.50:0/993032592 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4558064f10 msgr2=0x7f45580673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.800+0000 7f4570a81700 1 --2- 172.21.15.50:0/993032592 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4558064f10 0x7f45580673c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f455c000f60 tx=0x7f455c009040 comp rx=0 tx=0).stop 2023-11-28T11:54:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.800+0000 7f4570a81700 1 -- 172.21.15.50:0/993032592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c0cf740 msgr2=0x7f456c14fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.800+0000 7f4570a81700 1 --2- 172.21.15.50:0/993032592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c0cf740 0x7f456c14fd40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f456000c450 tx=0x7f456000c760 comp rx=0 tx=0).stop 2023-11-28T11:54:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.800+0000 7f4570a81700 1 -- 172.21.15.50:0/993032592 shutdown_connections 2023-11-28T11:54:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.800+0000 7f4570a81700 1 --2- 172.21.15.50:0/993032592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f456c162d80 0x7f456c06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.800+0000 7f4570a81700 1 --2- 172.21.15.50:0/993032592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c0cf740 0x7f456c14fd40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.800+0000 7f4570a81700 1 --2- 172.21.15.50:0/993032592 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4558064f10 0x7f45580673c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.800+0000 7f4570a81700 1 --2- 172.21.15.50:0/993032592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f456c0b2110 0x7f456c0b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.800+0000 7f4570a81700 1 -- 172.21.15.50:0/993032592 >> 172.21.15.50:0/993032592 conn(0x7f456c0cd0a0 msgr2=0x7f456c0cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.800+0000 7f4570a81700 1 -- 172.21.15.50:0/993032592 shutdown_connections 2023-11-28T11:54:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.800+0000 7f4570a81700 1 -- 172.21.15.50:0/993032592 wait complete. 2023-11-28T11:54:31.816 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:54:31.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c5d43b700 1 Processor -- start 2023-11-28T11:54:31.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c5d43b700 1 -- start start 2023-11-28T11:54:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c5d43b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9c580cfdd0 0x7f9c580b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c5d43b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c580cac70 con 0x7f9c580b2570 2023-11-28T11:54:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c5d43b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c580d0340 con 0x7f9c580cc590 2023-11-28T11:54:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c5d43b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5806c8e0 con 0x7f9c580cfdd0 2023-11-28T11:54:31.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c5cc3a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9c580b2570 0x7f9c580cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41502/0 (socket says 172.21.15.50:41502) 2023-11-28T11:54:31.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c5cc3a700 1 -- 172.21.15.50:0/2609957846 learned_addr learned my addr 172.21.15.50:0/2609957846 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:31.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c577fe700 1 --2- 172.21.15.50:0/2609957846 >> v2:172.21.15.192:3300/0 conn(0x7f9c580cfdd0 0x7f9c580b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c56ffd700 1 -- 172.21.15.50:0/2609957846 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537005033 0 0) 0x7f9c580cac70 con 0x7f9c580b2570 2023-11-28T11:54:31.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c56ffd700 1 -- 172.21.15.50:0/2609957846 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c380035d0 con 0x7f9c580b2570 2023-11-28T11:54:31.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c56ffd700 1 -- 172.21.15.50:0/2609957846 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 450264938 0 0) 0x7f9c380035d0 con 0x7f9c580b2570 2023-11-28T11:54:31.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c56ffd700 1 -- 172.21.15.50:0/2609957846 >> v2:172.21.15.192:3300/0 conn(0x7f9c580cfdd0 msgr2=0x7f9c580b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:31.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c56ffd700 1 --2- 172.21.15.50:0/2609957846 >> v2:172.21.15.192:3300/0 conn(0x7f9c580cfdd0 0x7f9c580b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c56ffd700 1 -- 172.21.15.50:0/2609957846 >> v1:172.21.15.192:6789/0 conn(0x7f9c580cc590 legacy=0x7f9c580b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c56ffd700 1 -- 172.21.15.50:0/2609957846 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5806d1d0 con 0x7f9c580b2570 2023-11-28T11:54:31.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c56ffd700 1 -- 172.21.15.50:0/2609957846 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f9c500019f0 con 0x7f9c580b2570 2023-11-28T11:54:31.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.932+0000 7f9c56ffd700 1 -- 172.21.15.50:0/2609957846 >> v1:172.21.15.50:6789/0 conn(0x7f9c580b2570 legacy=0x7f9c580cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c56ffd700 1 --2- 172.21.15.50:0/2609957846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c38003a50 0x7f9c38003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c56ffd700 1 --2- 172.21.15.50:0/2609957846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c38004870 0x7f9c38004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c56ffd700 1 --2- 172.21.15.50:0/2609957846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c38005270 0x7f9c3800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c56ffd700 1 -- 172.21.15.50:0/2609957846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5806c8e0 con 0x7f9c38003a50 2023-11-28T11:54:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c56ffd700 1 -- 172.21.15.50:0/2609957846 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3800c180 con 0x7f9c38004870 2023-11-28T11:54:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c56ffd700 1 -- 172.21.15.50:0/2609957846 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3800c340 con 0x7f9c38005270 2023-11-28T11:54:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c577fe700 1 --2- 172.21.15.50:0/2609957846 >> v2:172.21.15.192:3300/0 conn(0x7f9c580cfdd0 0x7f9c580b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c57fff700 1 --2- 172.21.15.50:0/2609957846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c38003a50 0x7f9c38003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c5cc3a700 1 --2- 172.21.15.50:0/2609957846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c38005270 0x7f9c3800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c577fe700 1 --2- 172.21.15.50:0/2609957846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c38004870 0x7f9c38004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c57fff700 1 -- 172.21.15.50:0/2609957846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c38005270 msgr2=0x7f9c3800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c57fff700 1 --2- 172.21.15.50:0/2609957846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c38005270 0x7f9c3800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c57fff700 1 -- 172.21.15.50:0/2609957846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c38004870 msgr2=0x7f9c38004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c57fff700 1 --2- 172.21.15.50:0/2609957846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c38004870 0x7f9c38004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c5cc3a700 1 -- 172.21.15.50:0/2609957846 reap_dead start 2023-11-28T11:54:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c57fff700 1 -- 172.21.15.50:0/2609957846 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c380035d0 con 0x7f9c38003a50 2023-11-28T11:54:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c57fff700 1 --2- 172.21.15.50:0/2609957846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c38003a50 0x7f9c38003e60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9c40007fd0 tx=0x7f9c380058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f259c2e07caf011f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c56ffd700 1 -- 172.21.15.50:0/2609957846 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c400052d0 con 0x7f9c38003a50 2023-11-28T11:54:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c56ffd700 1 -- 172.21.15.50:0/2609957846 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c40005450 con 0x7f9c38003a50 2023-11-28T11:54:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c56ffd700 1 -- 172.21.15.50:0/2609957846 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c400038e0 con 0x7f9c38003a50 2023-11-28T11:54:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c5d43b700 1 -- 172.21.15.50:0/2609957846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c38003a50 msgr2=0x7f9c38003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c5d43b700 1 --2- 172.21.15.50:0/2609957846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c38003a50 0x7f9c38003e60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9c40007fd0 tx=0x7f9c380058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c5d43b700 1 -- 172.21.15.50:0/2609957846 shutdown_connections 2023-11-28T11:54:31.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c5d43b700 1 --2- 172.21.15.50:0/2609957846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c38003a50 0x7f9c38003e60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c5d43b700 1 -- 172.21.15.50:0/2609957846 >> 172.21.15.50:0/2609957846 conn(0x7f9c580cd0a0 msgr2=0x7f9c580cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:31.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c5d43b700 1 -- 172.21.15.50:0/2609957846 shutdown_connections 2023-11-28T11:54:31.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.936+0000 7f9c5d43b700 1 -- 172.21.15.50:0/2609957846 wait complete. 2023-11-28T11:54:31.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.940+0000 7f9c5d43b700 1 Processor -- start 2023-11-28T11:54:31.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.940+0000 7f9c5d43b700 1 -- start start 2023-11-28T11:54:31.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.940+0000 7f9c5d43b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c38003a50 0x7f9c5815b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.940+0000 7f9c5d43b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c580caae0 0x7f9c580caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.940+0000 7f9c5d43b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c580c41c0 0x7f9c580c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.940+0000 7f9c5d43b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580c4f30 con 0x7f9c38003a50 2023-11-28T11:54:31.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.940+0000 7f9c5d43b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580c5210 con 0x7f9c580caae0 2023-11-28T11:54:31.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.940+0000 7f9c5d43b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580c54f0 con 0x7f9c580c41c0 2023-11-28T11:54:31.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.940+0000 7f9c57fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c38003a50 0x7f9c5815b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.940+0000 7f9c57fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c38003a50 0x7f9c5815b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60822/0 (socket says 172.21.15.50:60822) 2023-11-28T11:54:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.940+0000 7f9c57fff700 1 -- 172.21.15.50:0/3358257278 learned_addr learned my addr 172.21.15.50:0/3358257278 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.940+0000 7f9c577fe700 1 --2- 172.21.15.50:0/3358257278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c580caae0 0x7f9c580caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.940+0000 7f9c5cc3a700 1 --2- 172.21.15.50:0/3358257278 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c580c41c0 0x7f9c580c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.940+0000 7f9c57fff700 1 -- 172.21.15.50:0/3358257278 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c580c41c0 msgr2=0x7f9c580c4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.940+0000 7f9c57fff700 1 --2- 172.21.15.50:0/3358257278 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c580c41c0 0x7f9c580c4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.944+0000 7f9c57fff700 1 -- 172.21.15.50:0/3358257278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c580caae0 msgr2=0x7f9c580caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.944+0000 7f9c57fff700 1 --2- 172.21.15.50:0/3358257278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c580caae0 0x7f9c580caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.944+0000 7f9c57fff700 1 -- 172.21.15.50:0/3358257278 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c580ce520 con 0x7f9c38003a50 2023-11-28T11:54:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.944+0000 7f9c57fff700 1 --2- 172.21.15.50:0/3358257278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c38003a50 0x7f9c5815b100 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9c40005040 tx=0x7f9c40001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.944+0000 7f9c54ff9700 1 -- 172.21.15.50:0/3358257278 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c40001290 con 0x7f9c38003a50 2023-11-28T11:54:31.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.944+0000 7f9c54ff9700 1 -- 172.21.15.50:0/3358257278 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c40007040 con 0x7f9c38003a50 2023-11-28T11:54:31.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.944+0000 7f9c5d43b700 1 -- 172.21.15.50:0/3358257278 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5806d4b0 con 0x7f9c38003a50 2023-11-28T11:54:31.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.944+0000 7f9c54ff9700 1 -- 172.21.15.50:0/3358257278 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c400073f0 con 0x7f9c38003a50 2023-11-28T11:54:31.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.944+0000 7f9c5d43b700 1 -- 172.21.15.50:0/3358257278 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5806cdf0 con 0x7f9c38003a50 2023-11-28T11:54:31.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.944+0000 7f9c5d43b700 1 -- 172.21.15.50:0/3358257278 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c58072c20 con 0x7f9c38003a50 2023-11-28T11:54:31.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.944+0000 7f9c54ff9700 1 -- 172.21.15.50:0/3358257278 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9c4002d070 con 0x7f9c38003a50 2023-11-28T11:54:31.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.948+0000 7f9c54ff9700 1 --2- 172.21.15.50:0/3358257278 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9c3c064ee0 0x7f9c3c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:31.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.948+0000 7f9c54ff9700 1 -- 172.21.15.50:0/3358257278 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9c40082cf0 con 0x7f9c38003a50 2023-11-28T11:54:31.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.948+0000 7f9c577fe700 1 --2- 172.21.15.50:0/3358257278 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9c3c064ee0 0x7f9c3c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:31.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.948+0000 7f9c577fe700 1 --2- 172.21.15.50:0/3358257278 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9c3c064ee0 0x7f9c3c067390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9c580cb820 tx=0x7f9c48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:31.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:31.956+0000 7f9c54ff9700 1 -- 172.21.15.50:0/3358257278 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9c40050b60 con 0x7f9c38003a50 2023-11-28T11:54:32.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.120+0000 7f9c5d43b700 1 -- 172.21.15.50:0/3358257278 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c580b1160 con 0x7f9c38003a50 2023-11-28T11:54:32.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.120+0000 7f9c54ff9700 1 -- 172.21.15.50:0/3358257278 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c4002b020 con 0x7f9c38003a50 2023-11-28T11:54:32.121 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:54:32.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.124+0000 7f9c5d43b700 1 -- 172.21.15.50:0/3358257278 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9c3c064ee0 msgr2=0x7f9c3c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.124+0000 7f9c5d43b700 1 --2- 172.21.15.50:0/3358257278 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9c3c064ee0 0x7f9c3c067390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9c580cb820 tx=0x7f9c48008040 comp rx=0 tx=0).stop 2023-11-28T11:54:32.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.124+0000 7f9c5d43b700 1 -- 172.21.15.50:0/3358257278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c38003a50 msgr2=0x7f9c5815b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.124+0000 7f9c5d43b700 1 --2- 172.21.15.50:0/3358257278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c38003a50 0x7f9c5815b100 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9c40005040 tx=0x7f9c40001120 comp rx=0 tx=0).stop 2023-11-28T11:54:32.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.124+0000 7f9c5d43b700 1 -- 172.21.15.50:0/3358257278 shutdown_connections 2023-11-28T11:54:32.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.124+0000 7f9c5d43b700 1 --2- 172.21.15.50:0/3358257278 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c580c41c0 0x7f9c580c4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.124+0000 7f9c5d43b700 1 --2- 172.21.15.50:0/3358257278 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9c3c064ee0 0x7f9c3c067390 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.124+0000 7f9c5d43b700 1 --2- 172.21.15.50:0/3358257278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c580caae0 0x7f9c580caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.124+0000 7f9c5d43b700 1 --2- 172.21.15.50:0/3358257278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c38003a50 0x7f9c5815b100 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.124+0000 7f9c5d43b700 1 -- 172.21.15.50:0/3358257278 >> 172.21.15.50:0/3358257278 conn(0x7f9c580cd0a0 msgr2=0x7f9c5815f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:32.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.124+0000 7f9c5d43b700 1 -- 172.21.15.50:0/3358257278 shutdown_connections 2023-11-28T11:54:32.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.124+0000 7f9c5d43b700 1 -- 172.21.15.50:0/3358257278 wait complete. 2023-11-28T11:54:32.140 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:54:32.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.256+0000 7f8bfedb9700 1 Processor -- start 2023-11-28T11:54:32.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.256+0000 7f8bfedb9700 1 -- start start 2023-11-28T11:54:32.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.256+0000 7f8bfedb9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf809bdb0 0x7f8bf815d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:32.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.256+0000 7f8bfedb9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8bf80cbb30 0x7f8bf806bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:32.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.256+0000 7f8bfedb9700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf80b2db0 con 0x7f8bf80b00e0 2023-11-28T11:54:32.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.256+0000 7f8bfedb9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf80b3240 con 0x7f8bf80cbb30 2023-11-28T11:54:32.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.256+0000 7f8bfedb9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf806d840 con 0x7f8bf809bdb0 2023-11-28T11:54:32.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.256+0000 7f8bfddb7700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8bf80b00e0 0x7f8bf815d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41506/0 (socket says 172.21.15.50:41506) 2023-11-28T11:54:32.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.256+0000 7f8bfddb7700 1 -- 172.21.15.50:0/2506080523 learned_addr learned my addr 172.21.15.50:0/2506080523 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:32.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.256+0000 7f8bfe5b8700 1 --2- 172.21.15.50:0/2506080523 >> v2:172.21.15.192:3300/0 conn(0x7f8bf80cbb30 0x7f8bf806bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:32.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.256+0000 7f8bfd5b6700 1 --2- 172.21.15.50:0/2506080523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf809bdb0 0x7f8bf815d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:32.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.256+0000 7f8bfcdb5700 1 -- 172.21.15.50:0/2506080523 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179840947 0 0) 0x7f8bf80b2db0 con 0x7f8bf80b00e0 2023-11-28T11:54:32.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.256+0000 7f8bfcdb5700 1 -- 172.21.15.50:0/2506080523 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8be40035d0 con 0x7f8bf80b00e0 2023-11-28T11:54:32.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.260+0000 7f8bfe5b8700 1 -- 172.21.15.50:0/2506080523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf809bdb0 msgr2=0x7f8bf815d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:32.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.260+0000 7f8bfe5b8700 1 --2- 172.21.15.50:0/2506080523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf809bdb0 0x7f8bf815d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.260+0000 7f8bfe5b8700 1 -- 172.21.15.50:0/2506080523 >> v1:172.21.15.50:6789/0 conn(0x7f8bf80b00e0 legacy=0x7f8bf815d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.260+0000 7f8bfe5b8700 1 -- 172.21.15.50:0/2506080523 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf806d560 con 0x7f8bf80cbb30 2023-11-28T11:54:32.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.260+0000 7f8bfd5b6700 1 --2- 172.21.15.50:0/2506080523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf809bdb0 0x7f8bf815d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:32.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.260+0000 7f8bfe5b8700 1 --2- 172.21.15.50:0/2506080523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bf80cbb30 0x7f8bf806bbd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009d90 tx=0x7f8bf000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83407574ecbee359 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:32.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.260+0000 7f8bfcdb5700 1 -- 172.21.15.50:0/2506080523 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000e070 con 0x7f8bf80cbb30 2023-11-28T11:54:32.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.260+0000 7f8bfcdb5700 1 -- 172.21.15.50:0/2506080523 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf000bb20 con 0x7f8bf80cbb30 2023-11-28T11:54:32.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.260+0000 7f8bfcdb5700 1 -- 172.21.15.50:0/2506080523 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000be90 con 0x7f8bf80cbb30 2023-11-28T11:54:32.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.260+0000 7f8bfedb9700 1 -- 172.21.15.50:0/2506080523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bf80cbb30 msgr2=0x7f8bf806bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.260+0000 7f8bfedb9700 1 --2- 172.21.15.50:0/2506080523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bf80cbb30 0x7f8bf806bbd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009d90 tx=0x7f8bf000b330 comp rx=0 tx=0).stop 2023-11-28T11:54:32.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.260+0000 7f8bfedb9700 1 -- 172.21.15.50:0/2506080523 shutdown_connections 2023-11-28T11:54:32.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.260+0000 7f8bfedb9700 1 --2- 172.21.15.50:0/2506080523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bf80cbb30 0x7f8bf806bbd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.260+0000 7f8bfedb9700 1 --2- 172.21.15.50:0/2506080523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf809bdb0 0x7f8bf815d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.260+0000 7f8bfedb9700 1 -- 172.21.15.50:0/2506080523 >> 172.21.15.50:0/2506080523 conn(0x7f8bf80cae70 msgr2=0x7f8bf80cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:32.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.260+0000 7f8bfedb9700 1 -- 172.21.15.50:0/2506080523 shutdown_connections 2023-11-28T11:54:32.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.260+0000 7f8bfedb9700 1 -- 172.21.15.50:0/2506080523 wait complete. 2023-11-28T11:54:32.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfedb9700 1 Processor -- start 2023-11-28T11:54:32.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfedb9700 1 -- start start 2023-11-28T11:54:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfedb9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf809bdb0 0x7f8bf80ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfedb9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bf80b00e0 0x7f8bf80c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfedb9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf80cbb30 0x7f8bf80c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfedb9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf80c8190 con 0x7f8bf809bdb0 2023-11-28T11:54:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfedb9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf80c8bc0 con 0x7f8bf80b00e0 2023-11-28T11:54:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfedb9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf80c8ea0 con 0x7f8bf80cbb30 2023-11-28T11:54:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfddb7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf809bdb0 0x7f8bf80ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:32.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfe5b8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf80cbb30 0x7f8bf80c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:32.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfddb7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf809bdb0 0x7f8bf80ab120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60826/0 (socket says 172.21.15.50:60826) 2023-11-28T11:54:32.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfd5b6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bf80b00e0 0x7f8bf80c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:32.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfddb7700 1 -- 172.21.15.50:0/3782355249 learned_addr learned my addr 172.21.15.50:0/3782355249 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfddb7700 1 -- 172.21.15.50:0/3782355249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf80cbb30 msgr2=0x7f8bf80c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfddb7700 1 --2- 172.21.15.50:0/3782355249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf80cbb30 0x7f8bf80c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfddb7700 1 -- 172.21.15.50:0/3782355249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bf80b00e0 msgr2=0x7f8bf80c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfddb7700 1 --2- 172.21.15.50:0/3782355249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bf80b00e0 0x7f8bf80c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfddb7700 1 -- 172.21.15.50:0/3782355249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf40094b0 con 0x7f8bf809bdb0 2023-11-28T11:54:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfddb7700 1 --2- 172.21.15.50:0/3782355249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf809bdb0 0x7f8bf80ab120 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8be80010e0 tx=0x7f8be800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bee7fc700 1 -- 172.21.15.50:0/3782355249 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be8005d90 con 0x7f8bf809bdb0 2023-11-28T11:54:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bee7fc700 1 -- 172.21.15.50:0/3782355249 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be800ce80 con 0x7f8bf809bdb0 2023-11-28T11:54:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfedb9700 1 -- 172.21.15.50:0/3782355249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf0009a70 con 0x7f8bf809bdb0 2023-11-28T11:54:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bee7fc700 1 -- 172.21.15.50:0/3782355249 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be8007310 con 0x7f8bf809bdb0 2023-11-28T11:54:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.264+0000 7f8bfedb9700 1 -- 172.21.15.50:0/3782355249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf80ac3d0 con 0x7f8bf809bdb0 2023-11-28T11:54:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.268+0000 7f8bfedb9700 1 -- 172.21.15.50:0/3782355249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf80ac0f0 con 0x7f8bf809bdb0 2023-11-28T11:54:32.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.268+0000 7f8bee7fc700 1 -- 172.21.15.50:0/3782355249 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8be8019030 con 0x7f8bf809bdb0 2023-11-28T11:54:32.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.268+0000 7f8bee7fc700 1 --2- 172.21.15.50:0/3782355249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8bdc064ee0 0x7f8bdc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:32.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.268+0000 7f8bee7fc700 1 -- 172.21.15.50:0/3782355249 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8be8081570 con 0x7f8bf809bdb0 2023-11-28T11:54:32.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.268+0000 7f8bfd5b6700 1 --2- 172.21.15.50:0/3782355249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8bdc064ee0 0x7f8bdc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:32.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.272+0000 7f8bfd5b6700 1 --2- 172.21.15.50:0/3782355249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8bdc064ee0 0x7f8bdc067390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80c1a90 tx=0x7f8bf4009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:32.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.276+0000 7f8bee7fc700 1 -- 172.21.15.50:0/3782355249 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8be804f270 con 0x7f8bf809bdb0 2023-11-28T11:54:32.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.440+0000 7f8bfedb9700 1 -- 172.21.15.50:0/3782355249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8bf80cc9f0 con 0x7f8bf809bdb0 2023-11-28T11:54:32.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.440+0000 7f8bee7fc700 1 -- 172.21.15.50:0/3782355249 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8be8052890 con 0x7f8bf809bdb0 2023-11-28T11:54:32.443 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:32.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.444+0000 7f8bfedb9700 1 -- 172.21.15.50:0/3782355249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8bdc064ee0 msgr2=0x7f8bdc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.444+0000 7f8bfedb9700 1 --2- 172.21.15.50:0/3782355249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8bdc064ee0 0x7f8bdc067390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80c1a90 tx=0x7f8bf4009240 comp rx=0 tx=0).stop 2023-11-28T11:54:32.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.444+0000 7f8bfedb9700 1 -- 172.21.15.50:0/3782355249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf809bdb0 msgr2=0x7f8bf80ab120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.444+0000 7f8bfedb9700 1 --2- 172.21.15.50:0/3782355249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf809bdb0 0x7f8bf80ab120 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8be80010e0 tx=0x7f8be800c7b0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.444+0000 7f8bfedb9700 1 -- 172.21.15.50:0/3782355249 shutdown_connections 2023-11-28T11:54:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.444+0000 7f8bfedb9700 1 --2- 172.21.15.50:0/3782355249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf80cbb30 0x7f8bf80c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.444+0000 7f8bfedb9700 1 --2- 172.21.15.50:0/3782355249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8bdc064ee0 0x7f8bdc067390 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.444+0000 7f8bfedb9700 1 --2- 172.21.15.50:0/3782355249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bf80b00e0 0x7f8bf80c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.444+0000 7f8bfedb9700 1 --2- 172.21.15.50:0/3782355249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf809bdb0 0x7f8bf80ab120 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.444+0000 7f8bfedb9700 1 -- 172.21.15.50:0/3782355249 >> 172.21.15.50:0/3782355249 conn(0x7f8bf80cae70 msgr2=0x7f8bf80aec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.444+0000 7f8bfedb9700 1 -- 172.21.15.50:0/3782355249 shutdown_connections 2023-11-28T11:54:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.444+0000 7f8bfedb9700 1 -- 172.21.15.50:0/3782355249 wait complete. 2023-11-28T11:54:32.463 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:54:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f334bfff700 1 Processor -- start 2023-11-28T11:54:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f334bfff700 1 -- start start 2023-11-28T11:54:32.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f334bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f334c0ceef0 0x7f334c06a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:32.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f334bfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f334c0cae70 con 0x7f334c1606b0 2023-11-28T11:54:32.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f334bfff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f334c0cbc10 con 0x7f334c0c1ac0 2023-11-28T11:54:32.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f334bfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f334c0cb130 con 0x7f334c0ceef0 2023-11-28T11:54:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f334affd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f334c1606b0 0x7f334c0c13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41510/0 (socket says 172.21.15.50:41510) 2023-11-28T11:54:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f334affd700 1 -- 172.21.15.50:0/3741825161 learned_addr learned my addr 172.21.15.50:0/3741825161 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f334b7fe700 1 --2- 172.21.15.50:0/3741825161 >> v2:172.21.15.50:3300/0 conn(0x7f334c0ceef0 0x7f334c06a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f3349ffb700 1 -- 172.21.15.50:0/3741825161 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022231568 0 0) 0x7f334c0cae70 con 0x7f334c1606b0 2023-11-28T11:54:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f3349ffb700 1 -- 172.21.15.50:0/3741825161 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33380035d0 con 0x7f334c1606b0 2023-11-28T11:54:32.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f3349ffb700 1 -- 172.21.15.50:0/3741825161 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162460200 0 0) 0x7f334c0cbc10 con 0x7f334c0c1ac0 2023-11-28T11:54:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f3349ffb700 1 -- 172.21.15.50:0/3741825161 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f334c0cae70 con 0x7f334c0c1ac0 2023-11-28T11:54:32.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f334b7fe700 1 -- 172.21.15.50:0/3741825161 >> v1:172.21.15.192:6789/0 conn(0x7f334c0c1ac0 legacy=0x7f334c069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f3349ffb700 1 -- 172.21.15.50:0/3741825161 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2323238486 0 0) 0x7f33380035d0 con 0x7f334c1606b0 2023-11-28T11:54:32.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f334b7fe700 1 -- 172.21.15.50:0/3741825161 >> v1:172.21.15.50:6789/0 conn(0x7f334c1606b0 legacy=0x7f334c0c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f334b7fe700 1 -- 172.21.15.50:0/3741825161 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334c0cb410 con 0x7f334c0ceef0 2023-11-28T11:54:32.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f334b7fe700 1 --2- 172.21.15.50:0/3741825161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f334c0ceef0 0x7f334c06a350 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3344009d90 tx=0x7f334400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d766b6cdd3496da server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:32.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f3349ffb700 1 -- 172.21.15.50:0/3741825161 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334400e070 con 0x7f334c0ceef0 2023-11-28T11:54:32.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f3349ffb700 1 -- 172.21.15.50:0/3741825161 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3344003a40 con 0x7f334c0ceef0 2023-11-28T11:54:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f3349ffb700 1 -- 172.21.15.50:0/3741825161 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c001670 con 0x7f334c0ceef0 2023-11-28T11:54:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f334bfff700 1 -- 172.21.15.50:0/3741825161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f334c0ceef0 msgr2=0x7f334c06a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.576+0000 7f334bfff700 1 --2- 172.21.15.50:0/3741825161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f334c0ceef0 0x7f334c06a350 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3344009d90 tx=0x7f334400b330 comp rx=0 tx=0).stop 2023-11-28T11:54:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.580+0000 7f334bfff700 1 -- 172.21.15.50:0/3741825161 shutdown_connections 2023-11-28T11:54:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.580+0000 7f334bfff700 1 --2- 172.21.15.50:0/3741825161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f334c0ceef0 0x7f334c06a350 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.580+0000 7f334bfff700 1 -- 172.21.15.50:0/3741825161 >> 172.21.15.50:0/3741825161 conn(0x7f334c0ce3e0 msgr2=0x7f334c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.580+0000 7f334bfff700 1 -- 172.21.15.50:0/3741825161 shutdown_connections 2023-11-28T11:54:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.580+0000 7f334bfff700 1 -- 172.21.15.50:0/3741825161 wait complete. 2023-11-28T11:54:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.580+0000 7f334bfff700 1 Processor -- start 2023-11-28T11:54:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.580+0000 7f334bfff700 1 -- start start 2023-11-28T11:54:32.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f334c0c1ac0 0x7f334c15e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:32.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f334c0ceef0 0x7f334c1f5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:32.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f334c1606b0 0x7f334c15f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:32.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334c152890 con 0x7f334c0c1ac0 2023-11-28T11:54:32.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334bfff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334c15fee0 con 0x7f334c1606b0 2023-11-28T11:54:32.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334bfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334c15f4a0 con 0x7f334c0ceef0 2023-11-28T11:54:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f334c0c1ac0 0x7f334c15e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f334c0c1ac0 0x7f334c15e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60842/0 (socket says 172.21.15.50:60842) 2023-11-28T11:54:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334affd700 1 -- 172.21.15.50:0/2379564600 learned_addr learned my addr 172.21.15.50:0/2379564600 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334b7fe700 1 --2- 172.21.15.50:0/2379564600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f334c1606b0 0x7f334c15f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:32.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334a7fc700 1 --2- 172.21.15.50:0/2379564600 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f334c0ceef0 0x7f334c1f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:32.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334affd700 1 -- 172.21.15.50:0/2379564600 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f334c0ceef0 msgr2=0x7f334c1f5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334affd700 1 --2- 172.21.15.50:0/2379564600 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f334c0ceef0 0x7f334c1f5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334affd700 1 -- 172.21.15.50:0/2379564600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f334c1606b0 msgr2=0x7f334c15f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334affd700 1 --2- 172.21.15.50:0/2379564600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f334c1606b0 0x7f334c15f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334affd700 1 -- 172.21.15.50:0/2379564600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3344009a70 con 0x7f334c0c1ac0 2023-11-28T11:54:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334affd700 1 --2- 172.21.15.50:0/2379564600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f334c0c1ac0 0x7f334c15e900 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f333c00c6b0 tx=0x7f333c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f33437fe700 1 -- 172.21.15.50:0/2379564600 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c004ca0 con 0x7f334c0c1ac0 2023-11-28T11:54:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f33437fe700 1 -- 172.21.15.50:0/2379564600 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333c004e00 con 0x7f334c0c1ac0 2023-11-28T11:54:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334bfff700 1 -- 172.21.15.50:0/2379564600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f334c0b36c0 con 0x7f334c0c1ac0 2023-11-28T11:54:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f33437fe700 1 -- 172.21.15.50:0/2379564600 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c0072f0 con 0x7f334c0c1ac0 2023-11-28T11:54:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334bfff700 1 -- 172.21.15.50:0/2379564600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f334c0cb6f0 con 0x7f334c0c1ac0 2023-11-28T11:54:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.584+0000 7f334bfff700 1 -- 172.21.15.50:0/2379564600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f334c0ad610 con 0x7f334c0c1ac0 2023-11-28T11:54:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.588+0000 7f33437fe700 1 -- 172.21.15.50:0/2379564600 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f333c01a020 con 0x7f334c0c1ac0 2023-11-28T11:54:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.588+0000 7f33437fe700 1 --2- 172.21.15.50:0/2379564600 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f332c064f10 0x7f332c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.588+0000 7f33437fe700 1 -- 172.21.15.50:0/2379564600 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f333c0822f0 con 0x7f334c0c1ac0 2023-11-28T11:54:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.588+0000 7f334a7fc700 1 --2- 172.21.15.50:0/2379564600 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f332c064f10 0x7f332c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.588+0000 7f334a7fc700 1 --2- 172.21.15.50:0/2379564600 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f332c064f10 0x7f332c0673c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f334c1f9190 tx=0x7f3334009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.592+0000 7f33437fe700 1 -- 172.21.15.50:0/2379564600 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f333c050210 con 0x7f334c0c1ac0 2023-11-28T11:54:32.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.768+0000 7f334bfff700 1 -- 172.21.15.50:0/2379564600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f334c15dc80 con 0x7f334c0c1ac0 2023-11-28T11:54:32.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.768+0000 7f33437fe700 1 -- 172.21.15.50:0/2379564600 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f334c15dc80 con 0x7f334c0c1ac0 2023-11-28T11:54:32.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.768+0000 7f334bfff700 1 -- 172.21.15.50:0/2379564600 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f332c064f10 msgr2=0x7f332c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.768+0000 7f334bfff700 1 --2- 172.21.15.50:0/2379564600 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f332c064f10 0x7f332c0673c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f334c1f9190 tx=0x7f3334009040 comp rx=0 tx=0).stop 2023-11-28T11:54:32.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.768+0000 7f334bfff700 1 -- 172.21.15.50:0/2379564600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f334c0c1ac0 msgr2=0x7f334c15e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.768+0000 7f334bfff700 1 --2- 172.21.15.50:0/2379564600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f334c0c1ac0 0x7f334c15e900 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f333c00c6b0 tx=0x7f333c00c9c0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.768+0000 7f334bfff700 1 -- 172.21.15.50:0/2379564600 shutdown_connections 2023-11-28T11:54:32.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.768+0000 7f334bfff700 1 --2- 172.21.15.50:0/2379564600 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f332c064f10 0x7f332c0673c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.768+0000 7f334bfff700 1 --2- 172.21.15.50:0/2379564600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f334c1606b0 0x7f334c15f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.768+0000 7f334bfff700 1 --2- 172.21.15.50:0/2379564600 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f334c0ceef0 0x7f334c1f5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.768+0000 7f334bfff700 1 --2- 172.21.15.50:0/2379564600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f334c0c1ac0 0x7f334c15e900 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.768+0000 7f334bfff700 1 -- 172.21.15.50:0/2379564600 >> 172.21.15.50:0/2379564600 conn(0x7f334c0ce3e0 msgr2=0x7f334c0aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:32.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.772+0000 7f334bfff700 1 -- 172.21.15.50:0/2379564600 shutdown_connections 2023-11-28T11:54:32.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.772+0000 7f334bfff700 1 -- 172.21.15.50:0/2379564600 wait complete. 2023-11-28T11:54:32.773 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-11-28T11:54:32.783 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:54:32.783 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:54:32.789 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:32.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.896+0000 7f571900f700 1 Processor -- start 2023-11-28T11:54:32.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.896+0000 7f571900f700 1 -- start start 2023-11-28T11:54:32.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f571900f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57140cf050 0x7f571406d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:32.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f571900f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f571406a530 0x7f57140cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:32.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f571900f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571415c6d0 con 0x7f57140b4c10 2023-11-28T11:54:32.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f571900f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571406a9a0 con 0x7f571406a530 2023-11-28T11:54:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f571900f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57140cf960 con 0x7f57140cf050 2023-11-28T11:54:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f5713fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57140cf050 0x7f571406d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f57137fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f571406a530 0x7f57140cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f5713fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57140cf050 0x7f571406d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:43310/0 (socket says 172.21.15.50:43310) 2023-11-28T11:54:32.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f5713fff700 1 -- 172.21.15.50:0/4135640365 learned_addr learned my addr 172.21.15.50:0/4135640365 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f5712ffd700 1 -- 172.21.15.50:0/4135640365 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716718215 0 0) 0x7f571415c6d0 con 0x7f57140b4c10 2023-11-28T11:54:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f5712ffd700 1 -- 172.21.15.50:0/4135640365 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57000035d0 con 0x7f57140b4c10 2023-11-28T11:54:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f5713fff700 1 -- 172.21.15.50:0/4135640365 >> v2:172.21.15.192:3300/0 conn(0x7f571406a530 msgr2=0x7f57140cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f5713fff700 1 --2- 172.21.15.50:0/4135640365 >> v2:172.21.15.192:3300/0 conn(0x7f571406a530 0x7f57140cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f5713fff700 1 -- 172.21.15.50:0/4135640365 >> v1:172.21.15.192:6789/0 conn(0x7f57140b4c10 legacy=0x7f57140cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f5713fff700 1 -- 172.21.15.50:0/4135640365 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571406ac60 con 0x7f57140cf050 2023-11-28T11:54:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f5713fff700 1 --2- 172.21.15.50:0/4135640365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57140cf050 0x7f571406d7d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5704009e50 tx=0x7f570400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf7174c7e590eb60 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f5712ffd700 1 -- 172.21.15.50:0/4135640365 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570400e070 con 0x7f57140cf050 2023-11-28T11:54:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f5712ffd700 1 -- 172.21.15.50:0/4135640365 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570400b910 con 0x7f57140cf050 2023-11-28T11:54:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f5712ffd700 1 -- 172.21.15.50:0/4135640365 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570400bc80 con 0x7f57140cf050 2023-11-28T11:54:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f571900f700 1 -- 172.21.15.50:0/4135640365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57140cf050 msgr2=0x7f571406d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f571900f700 1 --2- 172.21.15.50:0/4135640365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57140cf050 0x7f571406d7d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5704009e50 tx=0x7f570400b330 comp rx=0 tx=0).stop 2023-11-28T11:54:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f571900f700 1 -- 172.21.15.50:0/4135640365 shutdown_connections 2023-11-28T11:54:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f571900f700 1 --2- 172.21.15.50:0/4135640365 >> v2:172.21.15.192:3300/0 conn(0x7f571406a530 0x7f57140cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f571900f700 1 --2- 172.21.15.50:0/4135640365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57140cf050 0x7f571406d7d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f571900f700 1 -- 172.21.15.50:0/4135640365 >> 172.21.15.50:0/4135640365 conn(0x7f571409bb30 msgr2=0x7f57140b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f571900f700 1 -- 172.21.15.50:0/4135640365 shutdown_connections 2023-11-28T11:54:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.900+0000 7f571900f700 1 -- 172.21.15.50:0/4135640365 wait complete. 2023-11-28T11:54:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f571900f700 1 Processor -- start 2023-11-28T11:54:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f571900f700 1 -- start start 2023-11-28T11:54:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f571900f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f571406a530 0x7f5714158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f571900f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57140b4c10 0x7f571415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f571900f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57140cf050 0x7f57140c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f571900f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571415e280 con 0x7f57140cf050 2023-11-28T11:54:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f571900f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571415cca0 con 0x7f571406a530 2023-11-28T11:54:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f571900f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571415cf80 con 0x7f57140b4c10 2023-11-28T11:54:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f571880e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57140cf050 0x7f57140c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:32.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f5713fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f571406a530 0x7f5714158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:32.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f57137fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57140b4c10 0x7f571415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:32.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f5713fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f571406a530 0x7f5714158910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:48390/0 (socket says 172.21.15.50:48390) 2023-11-28T11:54:32.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f571880e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57140cf050 0x7f57140c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60844/0 (socket says 172.21.15.50:60844) 2023-11-28T11:54:32.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f5713fff700 1 -- 172.21.15.50:0/3127141055 learned_addr learned my addr 172.21.15.50:0/3127141055 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:32.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f5713fff700 1 -- 172.21.15.50:0/3127141055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57140b4c10 msgr2=0x7f571415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f5713fff700 1 --2- 172.21.15.50:0/3127141055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57140b4c10 0x7f571415dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f5713fff700 1 -- 172.21.15.50:0/3127141055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57140cf050 msgr2=0x7f57140c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:32.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f5713fff700 1 --2- 172.21.15.50:0/3127141055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57140cf050 0x7f57140c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:32.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f5713fff700 1 -- 172.21.15.50:0/3127141055 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5704009b30 con 0x7f571406a530 2023-11-28T11:54:32.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f571880e700 1 --2- 172.21.15.50:0/3127141055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57140cf050 0x7f57140c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:32.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f5713fff700 1 --2- 172.21.15.50:0/3127141055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f571406a530 0x7f5714158910 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f570400b370 tx=0x7f5704004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:32.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f5710ff9700 1 -- 172.21.15.50:0/3127141055 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704004900 con 0x7f571406a530 2023-11-28T11:54:32.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f5710ff9700 1 -- 172.21.15.50:0/3127141055 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57040099b0 con 0x7f571406a530 2023-11-28T11:54:32.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f571900f700 1 -- 172.21.15.50:0/3127141055 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57140b4410 con 0x7f571406a530 2023-11-28T11:54:32.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f5710ff9700 1 -- 172.21.15.50:0/3127141055 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570401c650 con 0x7f571406a530 2023-11-28T11:54:32.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.904+0000 7f571900f700 1 -- 172.21.15.50:0/3127141055 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571406af40 con 0x7f571406a530 2023-11-28T11:54:32.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.908+0000 7f571900f700 1 -- 172.21.15.50:0/3127141055 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57140b46f0 con 0x7f571406a530 2023-11-28T11:54:32.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.908+0000 7f5710ff9700 1 -- 172.21.15.50:0/3127141055 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f570401c7b0 con 0x7f571406a530 2023-11-28T11:54:32.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.908+0000 7f5710ff9700 1 --2- 172.21.15.50:0/3127141055 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f56f4064ee0 0x7f56f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.908+0000 7f5710ff9700 1 -- 172.21.15.50:0/3127141055 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f57040843f0 con 0x7f571406a530 2023-11-28T11:54:32.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.908+0000 7f57137fe700 1 --2- 172.21.15.50:0/3127141055 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f56f4064ee0 0x7f56f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:32.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.908+0000 7f57137fe700 1 --2- 172.21.15.50:0/3127141055 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f56f4064ee0 0x7f56f4067390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f571415a9b0 tx=0x7f56fc009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:32.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:32.916+0000 7f5710ff9700 1 -- 172.21.15.50:0/3127141055 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f57040521f0 con 0x7f571406a530 2023-11-28T11:54:33.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.084+0000 7f571900f700 1 -- 172.21.15.50:0/3127141055 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5714072500 con 0x7f571406a530 2023-11-28T11:54:33.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.088+0000 7f5710ff9700 1 -- 172.21.15.50:0/3127141055 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19689 (secure 0 0 0) 0x7f5704055810 con 0x7f571406a530 2023-11-28T11:54:33.088 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:33.089 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:54:30.086945+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:33.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.092+0000 7f571900f700 1 -- 172.21.15.50:0/3127141055 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f56f4064ee0 msgr2=0x7f56f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.092+0000 7f571900f700 1 --2- 172.21.15.50:0/3127141055 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f56f4064ee0 0x7f56f4067390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f571415a9b0 tx=0x7f56fc009240 comp rx=0 tx=0).stop 2023-11-28T11:54:33.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.092+0000 7f571900f700 1 -- 172.21.15.50:0/3127141055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f571406a530 msgr2=0x7f5714158910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.092+0000 7f571900f700 1 --2- 172.21.15.50:0/3127141055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f571406a530 0x7f5714158910 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f570400b370 tx=0x7f5704004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.092+0000 7f571900f700 1 -- 172.21.15.50:0/3127141055 shutdown_connections 2023-11-28T11:54:33.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.092+0000 7f571900f700 1 --2- 172.21.15.50:0/3127141055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57140cf050 0x7f57140c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.092+0000 7f571900f700 1 --2- 172.21.15.50:0/3127141055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57140b4c10 0x7f571415dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.092+0000 7f571900f700 1 --2- 172.21.15.50:0/3127141055 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f56f4064ee0 0x7f56f4067390 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.092+0000 7f571900f700 1 --2- 172.21.15.50:0/3127141055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f571406a530 0x7f5714158910 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.092+0000 7f571900f700 1 -- 172.21.15.50:0/3127141055 >> 172.21.15.50:0/3127141055 conn(0x7f571409bb30 msgr2=0x7f57140b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:33.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.092+0000 7f571900f700 1 -- 172.21.15.50:0/3127141055 shutdown_connections 2023-11-28T11:54:33.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.092+0000 7f571900f700 1 -- 172.21.15.50:0/3127141055 wait complete. 2023-11-28T11:54:33.107 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:53:38.462826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:53:39.778621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:53:42.870360+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:54:33.108 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:54:33.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.224+0000 7fa6fb078700 1 Processor -- start 2023-11-28T11:54:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.224+0000 7fa6fb078700 1 -- start start 2023-11-28T11:54:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.224+0000 7fa6fb078700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6f406ce60 0x7fa6f40d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.224+0000 7fa6fb078700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6f40cce60 0x7fa6f406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.224+0000 7fa6fb078700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f40cd2d0 con 0x7fa6f40cf470 2023-11-28T11:54:33.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.224+0000 7fa6fb078700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f415c8b0 con 0x7fa6f40cce60 2023-11-28T11:54:33.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.224+0000 7fa6fb078700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f406d770 con 0x7fa6f406ce60 2023-11-28T11:54:33.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.224+0000 7fa6f9875700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6f40cce60 0x7fa6f406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.224+0000 7fa6f9875700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6f40cce60 0x7fa6f406d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60848/0 (socket says 172.21.15.50:60848) 2023-11-28T11:54:33.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.224+0000 7fa6f9875700 1 -- 172.21.15.50:0/2528795514 learned_addr learned my addr 172.21.15.50:0/2528795514 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:33.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.228+0000 7fa6fa076700 1 --2- 172.21.15.50:0/2528795514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6f406ce60 0x7fa6f40d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.228+0000 7fa6f9875700 1 -- 172.21.15.50:0/2528795514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6f406ce60 msgr2=0x7fa6f40d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:33.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.228+0000 7fa6f9875700 1 --2- 172.21.15.50:0/2528795514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6f406ce60 0x7fa6f40d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.228+0000 7fa6f9875700 1 -- 172.21.15.50:0/2528795514 >> v1:172.21.15.192:6789/0 conn(0x7fa6f40cf470 legacy=0x7fa6f40cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.228+0000 7fa6f9875700 1 -- 172.21.15.50:0/2528795514 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f406a7f0 con 0x7fa6f40cce60 2023-11-28T11:54:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.228+0000 7fa6f9875700 1 --2- 172.21.15.50:0/2528795514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f40cce60 0x7fa6f406d230 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0009910 tx=0x7fa6f0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d135feeb9b1199a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.228+0000 7fa6f9074700 1 -- 172.21.15.50:0/2528795514 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f000ba60 con 0x7fa6f40cce60 2023-11-28T11:54:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.228+0000 7fa6f9074700 1 -- 172.21.15.50:0/2528795514 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f000bbc0 con 0x7fa6f40cce60 2023-11-28T11:54:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.228+0000 7fa6f9074700 1 -- 172.21.15.50:0/2528795514 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0009e60 con 0x7fa6f40cce60 2023-11-28T11:54:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.228+0000 7fa6fb078700 1 -- 172.21.15.50:0/2528795514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f40cce60 msgr2=0x7fa6f406d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.228+0000 7fa6fb078700 1 --2- 172.21.15.50:0/2528795514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f40cce60 0x7fa6f406d230 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0009910 tx=0x7fa6f0009c20 comp rx=0 tx=0).stop 2023-11-28T11:54:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.228+0000 7fa6fb078700 1 -- 172.21.15.50:0/2528795514 shutdown_connections 2023-11-28T11:54:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.228+0000 7fa6fb078700 1 --2- 172.21.15.50:0/2528795514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f40cce60 0x7fa6f406d230 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.228+0000 7fa6fb078700 1 --2- 172.21.15.50:0/2528795514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6f406ce60 0x7fa6f40d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.228+0000 7fa6fb078700 1 -- 172.21.15.50:0/2528795514 >> 172.21.15.50:0/2528795514 conn(0x7fa6f40b5760 msgr2=0x7fa6f40b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.228+0000 7fa6fb078700 1 -- 172.21.15.50:0/2528795514 shutdown_connections 2023-11-28T11:54:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.228+0000 7fa6fb078700 1 -- 172.21.15.50:0/2528795514 wait complete. 2023-11-28T11:54:33.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fb078700 1 Processor -- start 2023-11-28T11:54:33.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fb078700 1 -- start start 2023-11-28T11:54:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fb078700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f406ce60 0x7fa6f4157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fb078700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6f40cce60 0x7fa6f40caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fb078700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6f40cf470 0x7fa6f4158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fb078700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40cc0e0 con 0x7fa6f406ce60 2023-11-28T11:54:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fb078700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40cc570 con 0x7fa6f40cf470 2023-11-28T11:54:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fb078700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4157650 con 0x7fa6f40cce60 2023-11-28T11:54:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fa076700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f406ce60 0x7fa6f4157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fa076700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f406ce60 0x7fa6f4157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60854/0 (socket says 172.21.15.50:60854) 2023-11-28T11:54:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fa877700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6f40cf470 0x7fa6f4158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fa076700 1 -- 172.21.15.50:0/1738744754 learned_addr learned my addr 172.21.15.50:0/1738744754 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6f9875700 1 --2- 172.21.15.50:0/1738744754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6f40cce60 0x7fa6f40caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fa076700 1 -- 172.21.15.50:0/1738744754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6f40cce60 msgr2=0x7fa6f40caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fa076700 1 --2- 172.21.15.50:0/1738744754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6f40cce60 0x7fa6f40caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fa076700 1 -- 172.21.15.50:0/1738744754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6f40cf470 msgr2=0x7fa6f4158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fa076700 1 --2- 172.21.15.50:0/1738744754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6f40cf470 0x7fa6f4158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fa076700 1 -- 172.21.15.50:0/1738744754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f0009570 con 0x7fa6f406ce60 2023-11-28T11:54:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fa076700 1 --2- 172.21.15.50:0/1738744754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f406ce60 0x7fa6f4157110 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800d800 tx=0x7fa6e800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6e6ffd700 1 -- 172.21.15.50:0/1738744754 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80125f0 con 0x7fa6f406ce60 2023-11-28T11:54:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6e6ffd700 1 -- 172.21.15.50:0/1738744754 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e8012750 con 0x7fa6f406ce60 2023-11-28T11:54:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fb078700 1 -- 172.21.15.50:0/1738744754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f406adb0 con 0x7fa6f406ce60 2023-11-28T11:54:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6e6ffd700 1 -- 172.21.15.50:0/1738744754 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8012ac0 con 0x7fa6f406ce60 2023-11-28T11:54:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.232+0000 7fa6fb078700 1 -- 172.21.15.50:0/1738744754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f406aad0 con 0x7fa6f406ce60 2023-11-28T11:54:33.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.236+0000 7fa6fb078700 1 -- 172.21.15.50:0/1738744754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f406b090 con 0x7fa6f406ce60 2023-11-28T11:54:33.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.236+0000 7fa6e6ffd700 1 -- 172.21.15.50:0/1738744754 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa6e8012c20 con 0x7fa6f406ce60 2023-11-28T11:54:33.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.236+0000 7fa6e6ffd700 1 --2- 172.21.15.50:0/1738744754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa6d8064ee0 0x7fa6d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.236+0000 7fa6e6ffd700 1 -- 172.21.15.50:0/1738744754 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa6e80823c0 con 0x7fa6f406ce60 2023-11-28T11:54:33.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.236+0000 7fa6f9875700 1 --2- 172.21.15.50:0/1738744754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa6d8064ee0 0x7fa6d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.240+0000 7fa6f9875700 1 --2- 172.21.15.50:0/1738744754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa6d8064ee0 0x7fa6d8067390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0000c00 tx=0x7fa6f0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:33.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.244+0000 7fa6e6ffd700 1 -- 172.21.15.50:0/1738744754 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa6e8050230 con 0x7fa6f406ce60 2023-11-28T11:54:33.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.408+0000 7fa6fb078700 1 -- 172.21.15.50:0/1738744754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa6f4072c20 con 0x7fa6f406ce60 2023-11-28T11:54:33.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.412+0000 7fa6e6ffd700 1 -- 172.21.15.50:0/1738744754 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa6e8053850 con 0x7fa6f406ce60 2023-11-28T11:54:33.411 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:54:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.412+0000 7fa6fb078700 1 -- 172.21.15.50:0/1738744754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa6d8064ee0 msgr2=0x7fa6d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.412+0000 7fa6fb078700 1 --2- 172.21.15.50:0/1738744754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa6d8064ee0 0x7fa6d8067390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0000c00 tx=0x7fa6f0008030 comp rx=0 tx=0).stop 2023-11-28T11:54:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.412+0000 7fa6fb078700 1 -- 172.21.15.50:0/1738744754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f406ce60 msgr2=0x7fa6f4157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.412+0000 7fa6fb078700 1 --2- 172.21.15.50:0/1738744754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f406ce60 0x7fa6f4157110 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800d800 tx=0x7fa6e800db10 comp rx=0 tx=0).stop 2023-11-28T11:54:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.412+0000 7fa6fb078700 1 -- 172.21.15.50:0/1738744754 shutdown_connections 2023-11-28T11:54:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.412+0000 7fa6fb078700 1 --2- 172.21.15.50:0/1738744754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa6d8064ee0 0x7fa6d8067390 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.412+0000 7fa6fb078700 1 --2- 172.21.15.50:0/1738744754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6f40cf470 0x7fa6f4158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.412+0000 7fa6fb078700 1 --2- 172.21.15.50:0/1738744754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6f40cce60 0x7fa6f40caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.412+0000 7fa6fb078700 1 --2- 172.21.15.50:0/1738744754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6f406ce60 0x7fa6f4157110 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.412+0000 7fa6fb078700 1 -- 172.21.15.50:0/1738744754 >> 172.21.15.50:0/1738744754 conn(0x7fa6f40b5760 msgr2=0x7fa6f40b77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.412+0000 7fa6fb078700 1 -- 172.21.15.50:0/1738744754 shutdown_connections 2023-11-28T11:54:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.412+0000 7fa6fb078700 1 -- 172.21.15.50:0/1738744754 wait complete. 2023-11-28T11:54:33.432 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:54:33.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ed2110700 1 Processor -- start 2023-11-28T11:54:33.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ed2110700 1 -- start start 2023-11-28T11:54:33.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ed2110700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0cc2f0 0x7f5ecc0ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ed2110700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ecc09c0e0 con 0x7f5ecc15a3e0 2023-11-28T11:54:33.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ed2110700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ecc0b13e0 con 0x7f5ecc0b2d30 2023-11-28T11:54:33.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ed2110700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc0b16c0 con 0x7f5ecc0cc2f0 2023-11-28T11:54:33.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ed090d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5ecc15a3e0 0x7f5ecc0cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41526/0 (socket says 172.21.15.50:41526) 2023-11-28T11:54:33.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ed090d700 1 -- 172.21.15.50:0/1639484281 learned_addr learned my addr 172.21.15.50:0/1639484281 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:33.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ec3fff700 1 -- 172.21.15.50:0/1639484281 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409166755 0 0) 0x7f5ecc09c0e0 con 0x7f5ecc15a3e0 2023-11-28T11:54:33.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ed110e700 1 --2- 172.21.15.50:0/1639484281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0cc2f0 0x7f5ecc0ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ec3fff700 1 -- 172.21.15.50:0/1639484281 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eb80035d0 con 0x7f5ecc15a3e0 2023-11-28T11:54:33.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ec3fff700 1 -- 172.21.15.50:0/1639484281 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3682510776 0 0) 0x7f5eb80035d0 con 0x7f5ecc15a3e0 2023-11-28T11:54:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ec3fff700 1 -- 172.21.15.50:0/1639484281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0cc2f0 msgr2=0x7f5ecc0ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ec3fff700 1 --2- 172.21.15.50:0/1639484281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0cc2f0 0x7f5ecc0ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ec3fff700 1 -- 172.21.15.50:0/1639484281 >> v1:172.21.15.192:6789/0 conn(0x7f5ecc0b2d30 legacy=0x7f5ecc069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ec3fff700 1 -- 172.21.15.50:0/1639484281 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc0b19a0 con 0x7f5ecc15a3e0 2023-11-28T11:54:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ec3fff700 1 -- 172.21.15.50:0/1639484281 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f5ec80019f0 con 0x7f5ecc15a3e0 2023-11-28T11:54:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ec3fff700 1 -- 172.21.15.50:0/1639484281 >> v1:172.21.15.50:6789/0 conn(0x7f5ecc15a3e0 legacy=0x7f5ecc0cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ec3fff700 1 --2- 172.21.15.50:0/1639484281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0cc2f0 0x7f5eb8003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ec3fff700 1 --2- 172.21.15.50:0/1639484281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eb8004080 0x7f5eb8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ec3fff700 1 --2- 172.21.15.50:0/1639484281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb8004db0 0x7f5eb8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ec3fff700 1 -- 172.21.15.50:0/1639484281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc0b16c0 con 0x7f5eb8004db0 2023-11-28T11:54:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ec3fff700 1 -- 172.21.15.50:0/1639484281 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb800bbc0 con 0x7f5eb8004080 2023-11-28T11:54:33.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ec3fff700 1 -- 172.21.15.50:0/1639484281 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb800bd80 con 0x7f5ecc0cc2f0 2023-11-28T11:54:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.552+0000 7f5ed190f700 1 --2- 172.21.15.50:0/1639484281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb8004db0 0x7f5eb8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed110e700 1 --2- 172.21.15.50:0/1639484281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0cc2f0 0x7f5eb8003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed090d700 1 --2- 172.21.15.50:0/1639484281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eb8004080 0x7f5eb8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed190f700 1 -- 172.21.15.50:0/1639484281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0cc2f0 msgr2=0x7f5eb8003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed190f700 1 --2- 172.21.15.50:0/1639484281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0cc2f0 0x7f5eb8003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed190f700 1 -- 172.21.15.50:0/1639484281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eb8004080 msgr2=0x7f5eb8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed190f700 1 --2- 172.21.15.50:0/1639484281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eb8004080 0x7f5eb8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed190f700 1 -- 172.21.15.50:0/1639484281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb80035d0 con 0x7f5eb8004db0 2023-11-28T11:54:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed110e700 1 --2- 172.21.15.50:0/1639484281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0cc2f0 0x7f5eb8003a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed090d700 1 --2- 172.21.15.50:0/1639484281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eb8004080 0x7f5eb8004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:33.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed190f700 1 --2- 172.21.15.50:0/1639484281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb8004db0 0x7f5eb8005220 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40017e0 tx=0x7f5eb80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47421b6bed2580e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:33.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ec3fff700 1 -- 172.21.15.50:0/1639484281 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40052d0 con 0x7f5eb8004db0 2023-11-28T11:54:33.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ec3fff700 1 -- 172.21.15.50:0/1639484281 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec4005430 con 0x7f5eb8004db0 2023-11-28T11:54:33.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ec3fff700 1 -- 172.21.15.50:0/1639484281 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40055a0 con 0x7f5eb8004db0 2023-11-28T11:54:33.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed2110700 1 -- 172.21.15.50:0/1639484281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb8004db0 msgr2=0x7f5eb8005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed2110700 1 --2- 172.21.15.50:0/1639484281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb8004db0 0x7f5eb8005220 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40017e0 tx=0x7f5eb80058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed190f700 1 -- 172.21.15.50:0/1639484281 reap_dead start 2023-11-28T11:54:33.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed2110700 1 -- 172.21.15.50:0/1639484281 shutdown_connections 2023-11-28T11:54:33.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed2110700 1 -- 172.21.15.50:0/1639484281 >> 172.21.15.50:0/1639484281 conn(0x7f5ecc0cae70 msgr2=0x7f5ecc0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:33.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed2110700 1 -- 172.21.15.50:0/1639484281 shutdown_connections 2023-11-28T11:54:33.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed2110700 1 -- 172.21.15.50:0/1639484281 wait complete. 2023-11-28T11:54:33.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed2110700 1 Processor -- start 2023-11-28T11:54:33.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.556+0000 7f5ed2110700 1 -- start start 2023-11-28T11:54:33.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed2110700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb8004db0 0x7f5ecc06d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed2110700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0aeab0 0x7f5ecc1e3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed2110700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ecc1e4430 0x7f5ecc1577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed2110700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc1e2e50 con 0x7f5eb8004db0 2023-11-28T11:54:33.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed2110700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc1e3130 con 0x7f5ecc1e4430 2023-11-28T11:54:33.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed2110700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc1e3410 con 0x7f5ecc0aeab0 2023-11-28T11:54:33.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed110e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb8004db0 0x7f5ecc06d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed110e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb8004db0 0x7f5ecc06d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60862/0 (socket says 172.21.15.50:60862) 2023-11-28T11:54:33.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed110e700 1 -- 172.21.15.50:0/1718465559 learned_addr learned my addr 172.21.15.50:0/1718465559 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:33.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed190f700 1 --2- 172.21.15.50:0/1718465559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ecc1e4430 0x7f5ecc1577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed090d700 1 --2- 172.21.15.50:0/1718465559 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0aeab0 0x7f5ecc1e3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed110e700 1 -- 172.21.15.50:0/1718465559 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0aeab0 msgr2=0x7f5ecc1e3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed110e700 1 --2- 172.21.15.50:0/1718465559 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0aeab0 0x7f5ecc1e3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed110e700 1 -- 172.21.15.50:0/1718465559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ecc1e4430 msgr2=0x7f5ecc1577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed110e700 1 --2- 172.21.15.50:0/1718465559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ecc1e4430 0x7f5ecc1577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed110e700 1 -- 172.21.15.50:0/1718465559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc06a350 con 0x7f5eb8004db0 2023-11-28T11:54:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed110e700 1 --2- 172.21.15.50:0/1718465559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb8004db0 0x7f5ecc06d080 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc010820 tx=0x7f5ebc010be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ec1ffb700 1 -- 172.21.15.50:0/1718465559 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc015880 con 0x7f5eb8004db0 2023-11-28T11:54:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ec1ffb700 1 -- 172.21.15.50:0/1718465559 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc00c050 con 0x7f5eb8004db0 2023-11-28T11:54:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ec1ffb700 1 -- 172.21.15.50:0/1718465559 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc015c20 con 0x7f5eb8004db0 2023-11-28T11:54:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed2110700 1 -- 172.21.15.50:0/1718465559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ecc0b1c80 con 0x7f5eb8004db0 2023-11-28T11:54:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.560+0000 7f5ed2110700 1 -- 172.21.15.50:0/1718465559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ecc0ac280 con 0x7f5eb8004db0 2023-11-28T11:54:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.564+0000 7f5ed2110700 1 -- 172.21.15.50:0/1718465559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ecc0722c0 con 0x7f5eb8004db0 2023-11-28T11:54:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.564+0000 7f5ec1ffb700 1 -- 172.21.15.50:0/1718465559 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5ebc026070 con 0x7f5eb8004db0 2023-11-28T11:54:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.564+0000 7f5ec1ffb700 1 --2- 172.21.15.50:0/1718465559 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5eb0064ee0 0x7f5eb0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.564+0000 7f5ec1ffb700 1 -- 172.21.15.50:0/1718465559 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5ebc082a80 con 0x7f5eb8004db0 2023-11-28T11:54:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.564+0000 7f5ed090d700 1 --2- 172.21.15.50:0/1718465559 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5eb0064ee0 0x7f5eb0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.564+0000 7f5ed090d700 1 --2- 172.21.15.50:0/1718465559 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5eb0064ee0 0x7f5eb0067390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0aee80 tx=0x7f5ec8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:33.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.572+0000 7f5ec1ffb700 1 -- 172.21.15.50:0/1718465559 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5ebc0508f0 con 0x7f5eb8004db0 2023-11-28T11:54:33.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.736+0000 7f5ed2110700 1 -- 172.21.15.50:0/1718465559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ecc072500 con 0x7f5eb8004db0 2023-11-28T11:54:33.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.736+0000 7f5ec1ffb700 1 -- 172.21.15.50:0/1718465559 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ebc053f10 con 0x7f5eb8004db0 2023-11-28T11:54:33.736 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:54:33.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.736+0000 7f5ed2110700 1 -- 172.21.15.50:0/1718465559 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5eb0064ee0 msgr2=0x7f5eb0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.736+0000 7f5ed2110700 1 --2- 172.21.15.50:0/1718465559 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5eb0064ee0 0x7f5eb0067390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0aee80 tx=0x7f5ec8009040 comp rx=0 tx=0).stop 2023-11-28T11:54:33.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.736+0000 7f5ed2110700 1 -- 172.21.15.50:0/1718465559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb8004db0 msgr2=0x7f5ecc06d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.736+0000 7f5ed2110700 1 --2- 172.21.15.50:0/1718465559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb8004db0 0x7f5ecc06d080 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc010820 tx=0x7f5ebc010be0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.736+0000 7f5ed2110700 1 -- 172.21.15.50:0/1718465559 shutdown_connections 2023-11-28T11:54:33.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.736+0000 7f5ed2110700 1 --2- 172.21.15.50:0/1718465559 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5eb0064ee0 0x7f5eb0067390 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.736+0000 7f5ed2110700 1 --2- 172.21.15.50:0/1718465559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ecc1e4430 0x7f5ecc1577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.736+0000 7f5ed2110700 1 --2- 172.21.15.50:0/1718465559 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0aeab0 0x7f5ecc1e3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.736+0000 7f5ed2110700 1 --2- 172.21.15.50:0/1718465559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb8004db0 0x7f5ecc06d080 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.736+0000 7f5ed2110700 1 -- 172.21.15.50:0/1718465559 >> 172.21.15.50:0/1718465559 conn(0x7f5ecc0cae70 msgr2=0x7f5ecc0cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:33.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.736+0000 7f5ed2110700 1 -- 172.21.15.50:0/1718465559 shutdown_connections 2023-11-28T11:54:33.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.736+0000 7f5ed2110700 1 -- 172.21.15.50:0/1718465559 wait complete. 2023-11-28T11:54:33.751 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:54:33.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.872+0000 7fbb41858700 1 Processor -- start 2023-11-28T11:54:33.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.872+0000 7fbb41858700 1 -- start start 2023-11-28T11:54:33.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.872+0000 7fbb41858700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb3c158ee0 0x7fbb3c0ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.872+0000 7fbb41858700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb3c0cd5d0 0x7fbb3c0cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.872+0000 7fbb41858700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3c06d1c0 con 0x7fbb3c0ce060 2023-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.872+0000 7fbb41858700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3c06e000 con 0x7fbb3c158ee0 2023-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.872+0000 7fbb41858700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0ce480 con 0x7fbb3c0cd5d0 2023-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.872+0000 7fbb40856700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb3c158ee0 0x7fbb3c0ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.872+0000 7fbb40856700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb3c158ee0 0x7fbb3c0ae760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60870/0 (socket says 172.21.15.50:60870) 2023-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.872+0000 7fbb40856700 1 -- 172.21.15.50:0/2329988884 learned_addr learned my addr 172.21.15.50:0/2329988884 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.872+0000 7fbb3bfff700 1 --2- 172.21.15.50:0/2329988884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb3c0cd5d0 0x7fbb3c0cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.872+0000 7fbb40856700 1 -- 172.21.15.50:0/2329988884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb3c0cd5d0 msgr2=0x7fbb3c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.872+0000 7fbb40856700 1 --2- 172.21.15.50:0/2329988884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb3c0cd5d0 0x7fbb3c0cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.872+0000 7fbb40856700 1 -- 172.21.15.50:0/2329988884 >> v1:172.21.15.192:6789/0 conn(0x7fbb3c0ce060 legacy=0x7fbb3c15c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.872+0000 7fbb40856700 1 -- 172.21.15.50:0/2329988884 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c0ca3a0 con 0x7fbb3c158ee0 2023-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.872+0000 7fbb3bfff700 1 --2- 172.21.15.50:0/2329988884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb3c0cd5d0 0x7fbb3c0cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.876+0000 7fbb40856700 1 --2- 172.21.15.50:0/2329988884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb3c158ee0 0x7fbb3c0ae760 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009910 tx=0x7fbb30009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9be545a1632426 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.876+0000 7fbb3b7fe700 1 -- 172.21.15.50:0/2329988884 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3000ba60 con 0x7fbb3c158ee0 2023-11-28T11:54:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.876+0000 7fbb3b7fe700 1 -- 172.21.15.50:0/2329988884 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3000bbc0 con 0x7fbb3c158ee0 2023-11-28T11:54:33.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.876+0000 7fbb3b7fe700 1 -- 172.21.15.50:0/2329988884 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb30009e60 con 0x7fbb3c158ee0 2023-11-28T11:54:33.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.876+0000 7fbb41858700 1 -- 172.21.15.50:0/2329988884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb3c158ee0 msgr2=0x7fbb3c0ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.876+0000 7fbb41858700 1 --2- 172.21.15.50:0/2329988884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb3c158ee0 0x7fbb3c0ae760 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009910 tx=0x7fbb30009c20 comp rx=0 tx=0).stop 2023-11-28T11:54:33.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.876+0000 7fbb41858700 1 -- 172.21.15.50:0/2329988884 shutdown_connections 2023-11-28T11:54:33.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.876+0000 7fbb41858700 1 --2- 172.21.15.50:0/2329988884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb3c0cd5d0 0x7fbb3c0cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.876+0000 7fbb41858700 1 --2- 172.21.15.50:0/2329988884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb3c158ee0 0x7fbb3c0ae760 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.876+0000 7fbb41858700 1 -- 172.21.15.50:0/2329988884 >> 172.21.15.50:0/2329988884 conn(0x7fbb3c0d0240 msgr2=0x7fbb3c0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:33.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.876+0000 7fbb41858700 1 -- 172.21.15.50:0/2329988884 shutdown_connections 2023-11-28T11:54:33.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.876+0000 7fbb41858700 1 -- 172.21.15.50:0/2329988884 wait complete. 2023-11-28T11:54:33.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb41858700 1 Processor -- start 2023-11-28T11:54:33.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb41858700 1 -- start start 2023-11-28T11:54:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb41858700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb3c0cd5d0 0x7fbb3c0c2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb41858700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb3c0ce060 0x7fbb3c144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb41858700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb3c158ee0 0x7fbb3c1454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb41858700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0c5d80 con 0x7fbb3c0ce060 2023-11-28T11:54:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb41858700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0b4940 con 0x7fbb3c0cd5d0 2023-11-28T11:54:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb41858700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0b4c20 con 0x7fbb3c158ee0 2023-11-28T11:54:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb3bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb3c0ce060 0x7fbb3c144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb3bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb3c0ce060 0x7fbb3c144f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60872/0 (socket says 172.21.15.50:60872) 2023-11-28T11:54:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb3bfff700 1 -- 172.21.15.50:0/1920828039 learned_addr learned my addr 172.21.15.50:0/1920828039 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb41057700 1 --2- 172.21.15.50:0/1920828039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb3c158ee0 0x7fbb3c1454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb40856700 1 --2- 172.21.15.50:0/1920828039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb3c0cd5d0 0x7fbb3c0c2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb3bfff700 1 -- 172.21.15.50:0/1920828039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb3c158ee0 msgr2=0x7fbb3c1454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb3bfff700 1 --2- 172.21.15.50:0/1920828039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb3c158ee0 0x7fbb3c1454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb3bfff700 1 -- 172.21.15.50:0/1920828039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb3c0cd5d0 msgr2=0x7fbb3c0c2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:33.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb3bfff700 1 --2- 172.21.15.50:0/1920828039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb3c0cd5d0 0x7fbb3c0c2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:33.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb3bfff700 1 -- 172.21.15.50:0/1920828039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb30009570 con 0x7fbb3c0ce060 2023-11-28T11:54:33.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb40856700 1 --2- 172.21.15.50:0/1920828039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb3c0cd5d0 0x7fbb3c0c2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:33.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb3bfff700 1 --2- 172.21.15.50:0/1920828039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb3c0ce060 0x7fbb3c144f80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800e810 tx=0x7fbb2800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb397fa700 1 -- 172.21.15.50:0/1920828039 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb28005c40 con 0x7fbb3c0ce060 2023-11-28T11:54:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb397fa700 1 -- 172.21.15.50:0/1920828039 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb28005da0 con 0x7fbb3c0ce060 2023-11-28T11:54:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb397fa700 1 -- 172.21.15.50:0/1920828039 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb28004250 con 0x7fbb3c0ce060 2023-11-28T11:54:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.880+0000 7fbb41858700 1 -- 172.21.15.50:0/1920828039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3c06cc00 con 0x7fbb3c0ce060 2023-11-28T11:54:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.884+0000 7fbb41858700 1 -- 172.21.15.50:0/1920828039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3c06c920 con 0x7fbb3c0ce060 2023-11-28T11:54:33.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.884+0000 7fbb41858700 1 -- 172.21.15.50:0/1920828039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3c06cee0 con 0x7fbb3c0ce060 2023-11-28T11:54:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.884+0000 7fbb397fa700 1 -- 172.21.15.50:0/1920828039 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbb28022070 con 0x7fbb3c0ce060 2023-11-28T11:54:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.884+0000 7fbb397fa700 1 --2- 172.21.15.50:0/1920828039 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbb20064ee0 0x7fbb20067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:33.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.884+0000 7fbb397fa700 1 -- 172.21.15.50:0/1920828039 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbb28082060 con 0x7fbb3c0ce060 2023-11-28T11:54:33.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.884+0000 7fbb40856700 1 --2- 172.21.15.50:0/1920828039 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbb20064ee0 0x7fbb20067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:33.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.888+0000 7fbb40856700 1 --2- 172.21.15.50:0/1920828039 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbb20064ee0 0x7fbb20067390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbb30000c00 tx=0x7fbb30008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:33.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:33.888+0000 7fbb397fa700 1 -- 172.21.15.50:0/1920828039 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbb2804fde0 con 0x7fbb3c0ce060 2023-11-28T11:54:34.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.056+0000 7fbb41858700 1 -- 172.21.15.50:0/1920828039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbb3c072c20 con 0x7fbb3c0ce060 2023-11-28T11:54:34.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.056+0000 7fbb397fa700 1 -- 172.21.15.50:0/1920828039 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbb2800f040 con 0x7fbb3c0ce060 2023-11-28T11:54:34.056 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.056+0000 7fbb41858700 1 -- 172.21.15.50:0/1920828039 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbb20064ee0 msgr2=0x7fbb20067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.056+0000 7fbb41858700 1 --2- 172.21.15.50:0/1920828039 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbb20064ee0 0x7fbb20067390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbb30000c00 tx=0x7fbb30008030 comp rx=0 tx=0).stop 2023-11-28T11:54:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.056+0000 7fbb41858700 1 -- 172.21.15.50:0/1920828039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb3c0ce060 msgr2=0x7fbb3c144f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.056+0000 7fbb41858700 1 --2- 172.21.15.50:0/1920828039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb3c0ce060 0x7fbb3c144f80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800e810 tx=0x7fbb2800eb20 comp rx=0 tx=0).stop 2023-11-28T11:54:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.056+0000 7fbb41858700 1 -- 172.21.15.50:0/1920828039 shutdown_connections 2023-11-28T11:54:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.056+0000 7fbb41858700 1 --2- 172.21.15.50:0/1920828039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb3c158ee0 0x7fbb3c1454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.056+0000 7fbb41858700 1 --2- 172.21.15.50:0/1920828039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb3c0ce060 0x7fbb3c144f80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.056+0000 7fbb41858700 1 --2- 172.21.15.50:0/1920828039 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbb20064ee0 0x7fbb20067390 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.056+0000 7fbb41858700 1 --2- 172.21.15.50:0/1920828039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb3c0cd5d0 0x7fbb3c0c2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.056+0000 7fbb41858700 1 -- 172.21.15.50:0/1920828039 >> 172.21.15.50:0/1920828039 conn(0x7fbb3c0d0240 msgr2=0x7fbb3c14b450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:34.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.056+0000 7fbb41858700 1 -- 172.21.15.50:0/1920828039 shutdown_connections 2023-11-28T11:54:34.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.056+0000 7fbb41858700 1 -- 172.21.15.50:0/1920828039 wait complete. 2023-11-28T11:54:34.071 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:54:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f344bfff700 1 Processor -- start 2023-11-28T11:54:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f344bfff700 1 -- start start 2023-11-28T11:54:34.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f344bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f344c0adfd0 0x7f344c069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f344bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f344c0cd5d0 0x7f344c0cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f344bfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344c0ce730 con 0x7f344c0cf100 2023-11-28T11:54:34.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f344bfff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344c0c9b00 con 0x7f344c0cd5d0 2023-11-28T11:54:34.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f344bfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344c0c9540 con 0x7f344c0adfd0 2023-11-28T11:54:34.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f344b7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f344c0cf100 0x7f344c15ba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41536/0 (socket says 172.21.15.50:41536) 2023-11-28T11:54:34.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f344b7fe700 1 -- 172.21.15.50:0/2720507293 learned_addr learned my addr 172.21.15.50:0/2720507293 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:34.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f344affd700 1 --2- 172.21.15.50:0/2720507293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f344c0adfd0 0x7f344c069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f3449ffb700 1 -- 172.21.15.50:0/2720507293 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381392869 0 0) 0x7f344c0ce730 con 0x7f344c0cf100 2023-11-28T11:54:34.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f344a7fc700 1 --2- 172.21.15.50:0/2720507293 >> v2:172.21.15.192:3300/0 conn(0x7f344c0cd5d0 0x7f344c0cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f3449ffb700 1 -- 172.21.15.50:0/2720507293 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34380035d0 con 0x7f344c0cf100 2023-11-28T11:54:34.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f3449ffb700 1 -- 172.21.15.50:0/2720507293 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1251666730 0 0) 0x7f34380035d0 con 0x7f344c0cf100 2023-11-28T11:54:34.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f3449ffb700 1 -- 172.21.15.50:0/2720507293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f344c0adfd0 msgr2=0x7f344c069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f3449ffb700 1 --2- 172.21.15.50:0/2720507293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f344c0adfd0 0x7f344c069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f3449ffb700 1 -- 172.21.15.50:0/2720507293 >> v2:172.21.15.192:3300/0 conn(0x7f344c0cd5d0 msgr2=0x7f344c0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f3449ffb700 1 --2- 172.21.15.50:0/2720507293 >> v2:172.21.15.192:3300/0 conn(0x7f344c0cd5d0 0x7f344c0cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f3449ffb700 1 -- 172.21.15.50:0/2720507293 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c0c9820 con 0x7f344c0cf100 2023-11-28T11:54:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f3449ffb700 1 -- 172.21.15.50:0/2720507293 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f34440019f0 con 0x7f344c0cf100 2023-11-28T11:54:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f344a7fc700 1 --2- 172.21.15.50:0/2720507293 >> v2:172.21.15.192:3300/0 conn(0x7f344c0cd5d0 0x7f344c0cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f3449ffb700 1 -- 172.21.15.50:0/2720507293 >> v1:172.21.15.50:6789/0 conn(0x7f344c0cf100 legacy=0x7f344c15ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f3449ffb700 1 --2- 172.21.15.50:0/2720507293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3438003a20 0x7f3438003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f3449ffb700 1 --2- 172.21.15.50:0/2720507293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3438004450 0x7f3438004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f3449ffb700 1 --2- 172.21.15.50:0/2720507293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f344c0adfd0 0x7f3438005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f3449ffb700 1 -- 172.21.15.50:0/2720507293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c0c9b00 con 0x7f3438003a20 2023-11-28T11:54:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f3449ffb700 1 -- 172.21.15.50:0/2720507293 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c0c9540 con 0x7f3438004450 2023-11-28T11:54:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f3449ffb700 1 -- 172.21.15.50:0/2720507293 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343800bab0 con 0x7f344c0adfd0 2023-11-28T11:54:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.196+0000 7f344affd700 1 --2- 172.21.15.50:0/2720507293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3438003a20 0x7f3438003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344b7fe700 1 --2- 172.21.15.50:0/2720507293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f344c0adfd0 0x7f3438005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344a7fc700 1 --2- 172.21.15.50:0/2720507293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3438004450 0x7f3438004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344affd700 1 -- 172.21.15.50:0/2720507293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f344c0adfd0 msgr2=0x7f3438005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344affd700 1 --2- 172.21.15.50:0/2720507293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f344c0adfd0 0x7f3438005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344affd700 1 -- 172.21.15.50:0/2720507293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3438004450 msgr2=0x7f3438004910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344affd700 1 --2- 172.21.15.50:0/2720507293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3438004450 0x7f3438004910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344affd700 1 -- 172.21.15.50:0/2720507293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34380035d0 con 0x7f3438003a20 2023-11-28T11:54:34.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344b7fe700 1 --2- 172.21.15.50:0/2720507293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f344c0adfd0 0x7f3438005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:54:34.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344a7fc700 1 --2- 172.21.15.50:0/2720507293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3438004450 0x7f3438004910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:54:34.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344affd700 1 --2- 172.21.15.50:0/2720507293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3438003a20 0x7f3438003e30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3434009b60 tx=0x7f34380058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1790f9bcffb44175 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:34.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f3449ffb700 1 -- 172.21.15.50:0/2720507293 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434005a40 con 0x7f3438003a20 2023-11-28T11:54:34.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f3449ffb700 1 -- 172.21.15.50:0/2720507293 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3434005ba0 con 0x7f3438003a20 2023-11-28T11:54:34.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f3449ffb700 1 -- 172.21.15.50:0/2720507293 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343400e6c0 con 0x7f3438003a20 2023-11-28T11:54:34.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344bfff700 1 -- 172.21.15.50:0/2720507293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3438003a20 msgr2=0x7f3438003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344bfff700 1 --2- 172.21.15.50:0/2720507293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3438003a20 0x7f3438003e30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3434009b60 tx=0x7f34380058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344b7fe700 1 -- 172.21.15.50:0/2720507293 reap_dead start 2023-11-28T11:54:34.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344bfff700 1 -- 172.21.15.50:0/2720507293 shutdown_connections 2023-11-28T11:54:34.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344bfff700 1 -- 172.21.15.50:0/2720507293 >> 172.21.15.50:0/2720507293 conn(0x7f344c06c660 msgr2=0x7f344c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:34.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344bfff700 1 -- 172.21.15.50:0/2720507293 shutdown_connections 2023-11-28T11:54:34.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344bfff700 1 -- 172.21.15.50:0/2720507293 wait complete. 2023-11-28T11:54:34.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344bfff700 1 Processor -- start 2023-11-28T11:54:34.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.200+0000 7f344bfff700 1 -- start start 2023-11-28T11:54:34.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3438003a20 0x7f344c1f4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f344c0b2ce0 0x7f344c0c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f344c0b3150 0x7f344c0c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c0b3710 con 0x7f344c0b3150 2023-11-28T11:54:34.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344bfff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c0b39f0 con 0x7f344c0b2ce0 2023-11-28T11:54:34.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344bfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344c0b3cd0 con 0x7f3438003a20 2023-11-28T11:54:34.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f344c0b3150 0x7f344c0c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f344c0b3150 0x7f344c0c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60880/0 (socket says 172.21.15.50:60880) 2023-11-28T11:54:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344b7fe700 1 -- 172.21.15.50:0/702212158 learned_addr learned my addr 172.21.15.50:0/702212158 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344a7fc700 1 --2- 172.21.15.50:0/702212158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f344c0b2ce0 0x7f344c0c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344affd700 1 --2- 172.21.15.50:0/702212158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3438003a20 0x7f344c1f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344b7fe700 1 -- 172.21.15.50:0/702212158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3438003a20 msgr2=0x7f344c1f4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344b7fe700 1 --2- 172.21.15.50:0/702212158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3438003a20 0x7f344c1f4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344b7fe700 1 -- 172.21.15.50:0/702212158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f344c0b2ce0 msgr2=0x7f344c0c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344b7fe700 1 --2- 172.21.15.50:0/702212158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f344c0b2ce0 0x7f344c0c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344b7fe700 1 -- 172.21.15.50:0/702212158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c0cf580 con 0x7f344c0b3150 2023-11-28T11:54:34.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344b7fe700 1 --2- 172.21.15.50:0/702212158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f344c0b3150 0x7f344c0c63d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f344c070210 tx=0x7f3444002160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:34.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f3443fff700 1 -- 172.21.15.50:0/702212158 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3444007560 con 0x7f344c0b3150 2023-11-28T11:54:34.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f3443fff700 1 -- 172.21.15.50:0/702212158 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34440076c0 con 0x7f344c0b3150 2023-11-28T11:54:34.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344bfff700 1 -- 172.21.15.50:0/702212158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f344c0ce3c0 con 0x7f344c0b3150 2023-11-28T11:54:34.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f3443fff700 1 -- 172.21.15.50:0/702212158 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3444007a70 con 0x7f344c0b3150 2023-11-28T11:54:34.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.204+0000 7f344bfff700 1 -- 172.21.15.50:0/702212158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f344c0cf710 con 0x7f344c0b3150 2023-11-28T11:54:34.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.208+0000 7f344bfff700 1 -- 172.21.15.50:0/702212158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344c072c20 con 0x7f344c0b3150 2023-11-28T11:54:34.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.208+0000 7f3443fff700 1 -- 172.21.15.50:0/702212158 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f344401b030 con 0x7f344c0b3150 2023-11-28T11:54:34.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.208+0000 7f3443fff700 1 --2- 172.21.15.50:0/702212158 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f342c064ee0 0x7f342c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.208+0000 7f3443fff700 1 -- 172.21.15.50:0/702212158 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3444081c10 con 0x7f344c0b3150 2023-11-28T11:54:34.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.208+0000 7f344affd700 1 --2- 172.21.15.50:0/702212158 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f342c064ee0 0x7f342c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.212+0000 7f344affd700 1 --2- 172.21.15.50:0/702212158 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f342c064ee0 0x7f342c067390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3434000c00 tx=0x7f3434008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:34.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.216+0000 7f3443fff700 1 -- 172.21.15.50:0/702212158 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f344404fa20 con 0x7f344c0b3150 2023-11-28T11:54:34.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.380+0000 7f344bfff700 1 -- 172.21.15.50:0/702212158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f344c071390 con 0x7f344c0b3150 2023-11-28T11:54:34.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.380+0000 7f3443fff700 1 -- 172.21.15.50:0/702212158 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3444053040 con 0x7f344c0b3150 2023-11-28T11:54:34.381 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:54:34.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.380+0000 7f344bfff700 1 -- 172.21.15.50:0/702212158 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f342c064ee0 msgr2=0x7f342c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.380+0000 7f344bfff700 1 --2- 172.21.15.50:0/702212158 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f342c064ee0 0x7f342c067390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3434000c00 tx=0x7f3434008030 comp rx=0 tx=0).stop 2023-11-28T11:54:34.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.380+0000 7f344bfff700 1 -- 172.21.15.50:0/702212158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f344c0b3150 msgr2=0x7f344c0c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.380+0000 7f344bfff700 1 --2- 172.21.15.50:0/702212158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f344c0b3150 0x7f344c0c63d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f344c070210 tx=0x7f3444002160 comp rx=0 tx=0).stop 2023-11-28T11:54:34.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.380+0000 7f344bfff700 1 -- 172.21.15.50:0/702212158 shutdown_connections 2023-11-28T11:54:34.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.380+0000 7f344bfff700 1 --2- 172.21.15.50:0/702212158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f344c0b3150 0x7f344c0c63d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.380+0000 7f344bfff700 1 --2- 172.21.15.50:0/702212158 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f342c064ee0 0x7f342c067390 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.380+0000 7f344bfff700 1 --2- 172.21.15.50:0/702212158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f344c0b2ce0 0x7f344c0c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.380+0000 7f344bfff700 1 --2- 172.21.15.50:0/702212158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3438003a20 0x7f344c1f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.380+0000 7f344bfff700 1 -- 172.21.15.50:0/702212158 >> 172.21.15.50:0/702212158 conn(0x7f344c06c660 msgr2=0x7f344c0acc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:34.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.384+0000 7f344bfff700 1 -- 172.21.15.50:0/702212158 shutdown_connections 2023-11-28T11:54:34.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.384+0000 7f344bfff700 1 -- 172.21.15.50:0/702212158 wait complete. 2023-11-28T11:54:34.396 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:54:34.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22f028700 1 Processor -- start 2023-11-28T11:54:34.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22f028700 1 -- start start 2023-11-28T11:54:34.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22f028700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc228158850 0x7fc2280c9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22f028700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2280cd3a0 0x7fc2280ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22f028700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22806a4d0 con 0x7fc228158480 2023-11-28T11:54:34.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22f028700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2280cc490 con 0x7fc228158850 2023-11-28T11:54:34.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22f028700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22806a720 con 0x7fc2280cd3a0 2023-11-28T11:54:34.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22d825700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc228158850 0x7fc2280c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22e827700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2280cd3a0 0x7fc2280ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22e026700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fc228158480 0x7fc2280cbcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:55252/0 (socket says 172.21.15.50:55252) 2023-11-28T11:54:34.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22e026700 1 -- 172.21.15.50:0/4036365528 learned_addr learned my addr 172.21.15.50:0/4036365528 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:34.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22d024700 1 -- 172.21.15.50:0/4036365528 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026924620 0 0) 0x7fc22806a4d0 con 0x7fc228158480 2023-11-28T11:54:34.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22d024700 1 -- 172.21.15.50:0/4036365528 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2140035d0 con 0x7fc228158480 2023-11-28T11:54:34.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22e827700 1 -- 172.21.15.50:0/4036365528 >> v2:172.21.15.192:3300/0 conn(0x7fc228158850 msgr2=0x7fc2280c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:34.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22e827700 1 --2- 172.21.15.50:0/4036365528 >> v2:172.21.15.192:3300/0 conn(0x7fc228158850 0x7fc2280c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22e827700 1 -- 172.21.15.50:0/4036365528 >> v1:172.21.15.192:6789/0 conn(0x7fc228158480 legacy=0x7fc2280cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22e827700 1 -- 172.21.15.50:0/4036365528 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22806aa00 con 0x7fc2280cd3a0 2023-11-28T11:54:34.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.520+0000 7fc22d825700 1 --2- 172.21.15.50:0/4036365528 >> v2:172.21.15.192:3300/0 conn(0x7fc228158850 0x7fc2280c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:34.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.524+0000 7fc22e827700 1 --2- 172.21.15.50:0/4036365528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2280cd3a0 0x7fc2280ceca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc220009850 tx=0x7fc220009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8e0bd2631c4cf95 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:34.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.524+0000 7fc22d024700 1 -- 172.21.15.50:0/4036365528 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220011830 con 0x7fc2280cd3a0 2023-11-28T11:54:34.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.524+0000 7fc22d024700 1 -- 172.21.15.50:0/4036365528 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc220011990 con 0x7fc2280cd3a0 2023-11-28T11:54:34.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.524+0000 7fc22d024700 1 -- 172.21.15.50:0/4036365528 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220011d40 con 0x7fc2280cd3a0 2023-11-28T11:54:34.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.524+0000 7fc22f028700 1 -- 172.21.15.50:0/4036365528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2280cd3a0 msgr2=0x7fc2280ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.524+0000 7fc22f028700 1 --2- 172.21.15.50:0/4036365528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2280cd3a0 0x7fc2280ceca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc220009850 tx=0x7fc220009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:34.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.524+0000 7fc22f028700 1 -- 172.21.15.50:0/4036365528 shutdown_connections 2023-11-28T11:54:34.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.524+0000 7fc22f028700 1 --2- 172.21.15.50:0/4036365528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2280cd3a0 0x7fc2280ceca0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.524+0000 7fc22f028700 1 --2- 172.21.15.50:0/4036365528 >> v2:172.21.15.192:3300/0 conn(0x7fc228158850 0x7fc2280c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.524+0000 7fc22f028700 1 -- 172.21.15.50:0/4036365528 >> 172.21.15.50:0/4036365528 conn(0x7fc22806c660 msgr2=0x7fc22806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:34.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.524+0000 7fc22f028700 1 -- 172.21.15.50:0/4036365528 shutdown_connections 2023-11-28T11:54:34.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.524+0000 7fc22f028700 1 -- 172.21.15.50:0/4036365528 wait complete. 2023-11-28T11:54:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22f028700 1 Processor -- start 2023-11-28T11:54:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22f028700 1 -- start start 2023-11-28T11:54:34.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22f028700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2280cd3a0 0x7fc2281540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22f028700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc228158480 0x7fc2280c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22f028700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc228158850 0x7fc2280c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22f028700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc228158d40 con 0x7fc2280cd3a0 2023-11-28T11:54:34.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22f028700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280c4850 con 0x7fc228158480 2023-11-28T11:54:34.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22f028700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280c4b30 con 0x7fc228158850 2023-11-28T11:54:34.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22e026700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2280cd3a0 0x7fc2281540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22e026700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2280cd3a0 0x7fc2281540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60890/0 (socket says 172.21.15.50:60890) 2023-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22e026700 1 -- 172.21.15.50:0/2082429642 learned_addr learned my addr 172.21.15.50:0/2082429642 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22e827700 1 --2- 172.21.15.50:0/2082429642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc228158850 0x7fc2280c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22d825700 1 --2- 172.21.15.50:0/2082429642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc228158480 0x7fc2280c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22e026700 1 -- 172.21.15.50:0/2082429642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc228158850 msgr2=0x7fc2280c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22e026700 1 --2- 172.21.15.50:0/2082429642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc228158850 0x7fc2280c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22e026700 1 -- 172.21.15.50:0/2082429642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc228158480 msgr2=0x7fc2280c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22e026700 1 --2- 172.21.15.50:0/2082429642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc228158480 0x7fc2280c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22e026700 1 -- 172.21.15.50:0/2082429642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2180094b0 con 0x7fc2280cd3a0 2023-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22e827700 1 --2- 172.21.15.50:0/2082429642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc228158850 0x7fc2280c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22e026700 1 --2- 172.21.15.50:0/2082429642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2280cd3a0 0x7fc2281540d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc2240014b0 tx=0x7fc22400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc21effd700 1 -- 172.21.15.50:0/2082429642 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22400ab50 con 0x7fc2280cd3a0 2023-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc21effd700 1 -- 172.21.15.50:0/2082429642 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22400acb0 con 0x7fc2280cd3a0 2023-11-28T11:54:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22f028700 1 -- 172.21.15.50:0/2082429642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2200094b0 con 0x7fc2280cd3a0 2023-11-28T11:54:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc21effd700 1 -- 172.21.15.50:0/2082429642 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224012620 con 0x7fc2280cd3a0 2023-11-28T11:54:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.528+0000 7fc22f028700 1 -- 172.21.15.50:0/2082429642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2280c9950 con 0x7fc2280cd3a0 2023-11-28T11:54:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.532+0000 7fc22f028700 1 -- 172.21.15.50:0/2082429642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22806ace0 con 0x7fc2280cd3a0 2023-11-28T11:54:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.532+0000 7fc21effd700 1 -- 172.21.15.50:0/2082429642 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc224019030 con 0x7fc2280cd3a0 2023-11-28T11:54:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.532+0000 7fc21effd700 1 --2- 172.21.15.50:0/2082429642 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc20c064ee0 0x7fc20c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.532+0000 7fc21effd700 1 -- 172.21.15.50:0/2082429642 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc224081ea0 con 0x7fc2280cd3a0 2023-11-28T11:54:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.532+0000 7fc22d825700 1 --2- 172.21.15.50:0/2082429642 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc20c064ee0 0x7fc20c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.532+0000 7fc22d825700 1 --2- 172.21.15.50:0/2082429642 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc20c064ee0 0x7fc20c067390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc2280c5960 tx=0x7fc218008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.540+0000 7fc21effd700 1 -- 172.21.15.50:0/2082429642 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc22404fc90 con 0x7fc2280cd3a0 2023-11-28T11:54:34.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.700+0000 7fc22f028700 1 -- 172.21.15.50:0/2082429642 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc2280cf1e0 con 0x7fc2280cd3a0 2023-11-28T11:54:34.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.704+0000 7fc21effd700 1 -- 172.21.15.50:0/2082429642 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc2240170a0 con 0x7fc2280cd3a0 2023-11-28T11:54:34.704 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:34.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.704+0000 7fc22f028700 1 -- 172.21.15.50:0/2082429642 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc20c064ee0 msgr2=0x7fc20c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.704+0000 7fc22f028700 1 --2- 172.21.15.50:0/2082429642 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc20c064ee0 0x7fc20c067390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc2280c5960 tx=0x7fc218008040 comp rx=0 tx=0).stop 2023-11-28T11:54:34.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.704+0000 7fc22f028700 1 -- 172.21.15.50:0/2082429642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2280cd3a0 msgr2=0x7fc2281540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.704+0000 7fc22f028700 1 --2- 172.21.15.50:0/2082429642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2280cd3a0 0x7fc2281540d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc2240014b0 tx=0x7fc22400cf20 comp rx=0 tx=0).stop 2023-11-28T11:54:34.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.704+0000 7fc22f028700 1 -- 172.21.15.50:0/2082429642 shutdown_connections 2023-11-28T11:54:34.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.704+0000 7fc22f028700 1 --2- 172.21.15.50:0/2082429642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc228158850 0x7fc2280c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.704+0000 7fc22f028700 1 --2- 172.21.15.50:0/2082429642 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc20c064ee0 0x7fc20c067390 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.704+0000 7fc22f028700 1 --2- 172.21.15.50:0/2082429642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc228158480 0x7fc2280c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.704+0000 7fc22f028700 1 --2- 172.21.15.50:0/2082429642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2280cd3a0 0x7fc2281540d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.704+0000 7fc22f028700 1 -- 172.21.15.50:0/2082429642 >> 172.21.15.50:0/2082429642 conn(0x7fc22806c660 msgr2=0x7fc2280b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:34.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.704+0000 7fc22f028700 1 -- 172.21.15.50:0/2082429642 shutdown_connections 2023-11-28T11:54:34.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.704+0000 7fc22f028700 1 -- 172.21.15.50:0/2082429642 wait complete. 2023-11-28T11:54:34.719 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:54:34.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.832+0000 7f25c591d700 1 Processor -- start 2023-11-28T11:54:34.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.832+0000 7f25c591d700 1 -- start start 2023-11-28T11:54:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.832+0000 7f25c591d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25b80dd280 0x7f25b8050760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.832+0000 7f25c591d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b8036e80 0x7f25b8053080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.832+0000 7f25c591d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b8052bf0 con 0x7f25b80dfb70 2023-11-28T11:54:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.832+0000 7f25c591d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b80dd650 con 0x7f25b80dd280 2023-11-28T11:54:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.832+0000 7f25c591d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80528c0 con 0x7f25b8036e80 2023-11-28T11:54:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25c491b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25b80dd280 0x7f25b8050760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25bffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f25b80dfb70 0x7f25b8036770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41552/0 (socket says 172.21.15.50:41552) 2023-11-28T11:54:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25bffff700 1 -- 172.21.15.50:0/1592977810 learned_addr learned my addr 172.21.15.50:0/1592977810 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25c511c700 1 --2- 172.21.15.50:0/1592977810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b8036e80 0x7f25b8053080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25c491b700 1 -- 172.21.15.50:0/1592977810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b8036e80 msgr2=0x7f25b8053080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:34.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25c491b700 1 --2- 172.21.15.50:0/1592977810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b8036e80 0x7f25b8053080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25c491b700 1 -- 172.21.15.50:0/1592977810 >> v1:172.21.15.50:6789/0 conn(0x7f25b80dfb70 legacy=0x7f25b8036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25bf7fe700 1 -- 172.21.15.50:0/1592977810 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2713963095 0 0) 0x7f25b8052bf0 con 0x7f25b80dfb70 2023-11-28T11:54:34.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25c491b700 1 -- 172.21.15.50:0/1592977810 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b80e0430 con 0x7f25b80dd280 2023-11-28T11:54:34.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25c491b700 1 --2- 172.21.15.50:0/1592977810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25b80dd280 0x7f25b8050760 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009850 tx=0x7f25b0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b58afac49b6108 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:34.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25bf7fe700 1 -- 172.21.15.50:0/1592977810 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0011830 con 0x7f25b80dd280 2023-11-28T11:54:34.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25bf7fe700 1 -- 172.21.15.50:0/1592977810 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b0011990 con 0x7f25b80dd280 2023-11-28T11:54:34.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25bf7fe700 1 -- 172.21.15.50:0/1592977810 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0011d40 con 0x7f25b80dd280 2023-11-28T11:54:34.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25c591d700 1 -- 172.21.15.50:0/1592977810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25b80dd280 msgr2=0x7f25b8050760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25c591d700 1 --2- 172.21.15.50:0/1592977810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25b80dd280 0x7f25b8050760 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009850 tx=0x7f25b0009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:34.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25c591d700 1 -- 172.21.15.50:0/1592977810 shutdown_connections 2023-11-28T11:54:34.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25c591d700 1 --2- 172.21.15.50:0/1592977810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b8036e80 0x7f25b8053080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25c591d700 1 --2- 172.21.15.50:0/1592977810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25b80dd280 0x7f25b8050760 secure :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009850 tx=0x7f25b0009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:34.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25c591d700 1 -- 172.21.15.50:0/1592977810 >> 172.21.15.50:0/1592977810 conn(0x7f25b8051770 msgr2=0x7f25b8051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25c591d700 1 -- 172.21.15.50:0/1592977810 shutdown_connections 2023-11-28T11:54:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.836+0000 7f25c591d700 1 -- 172.21.15.50:0/1592977810 wait complete. 2023-11-28T11:54:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.840+0000 7f25c591d700 1 Processor -- start 2023-11-28T11:54:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.840+0000 7f25c591d700 1 -- start start 2023-11-28T11:54:34.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.840+0000 7f25c591d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25b8036e80 0x7f25b804a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.840+0000 7f25c591d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25b80dfb70 0x7f25b804ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.840+0000 7f25c591d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b804d350 0x7f25b80ddc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.840+0000 7f25c591d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b804d7f0 con 0x7f25b80dfb70 2023-11-28T11:54:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.840+0000 7f25c591d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b804dad0 con 0x7f25b8036e80 2023-11-28T11:54:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.840+0000 7f25c591d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b804ddb0 con 0x7f25b804d350 2023-11-28T11:54:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.840+0000 7f25bffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25b80dfb70 0x7f25b804ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.840+0000 7f25bffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25b80dfb70 0x7f25b804ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60904/0 (socket says 172.21.15.50:60904) 2023-11-28T11:54:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.840+0000 7f25bffff700 1 -- 172.21.15.50:0/3857125267 learned_addr learned my addr 172.21.15.50:0/3857125267 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.844+0000 7f25c491b700 1 --2- 172.21.15.50:0/3857125267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25b8036e80 0x7f25b804a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.844+0000 7f25c511c700 1 --2- 172.21.15.50:0/3857125267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b804d350 0x7f25b80ddc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.844+0000 7f25bffff700 1 -- 172.21.15.50:0/3857125267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b804d350 msgr2=0x7f25b80ddc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.844+0000 7f25bffff700 1 --2- 172.21.15.50:0/3857125267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b804d350 0x7f25b80ddc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.844+0000 7f25bffff700 1 -- 172.21.15.50:0/3857125267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25b8036e80 msgr2=0x7f25b804a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.844+0000 7f25bffff700 1 --2- 172.21.15.50:0/3857125267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25b8036e80 0x7f25b804a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.844+0000 7f25bffff700 1 -- 172.21.15.50:0/3857125267 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b00094b0 con 0x7f25b80dfb70 2023-11-28T11:54:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.844+0000 7f25c511c700 1 --2- 172.21.15.50:0/3857125267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b804d350 0x7f25b80ddc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.844+0000 7f25bffff700 1 --2- 172.21.15.50:0/3857125267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25b80dfb70 0x7f25b804ce10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f25b400c580 tx=0x7f25b400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.844+0000 7f25bd7fa700 1 -- 172.21.15.50:0/3857125267 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4004ca0 con 0x7f25b80dfb70 2023-11-28T11:54:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.844+0000 7f25bd7fa700 1 -- 172.21.15.50:0/3857125267 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4004e20 con 0x7f25b80dfb70 2023-11-28T11:54:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.844+0000 7f25c591d700 1 -- 172.21.15.50:0/3857125267 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b80e09f0 con 0x7f25b80dfb70 2023-11-28T11:54:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.844+0000 7f25bd7fa700 1 -- 172.21.15.50:0/3857125267 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4007310 con 0x7f25b80dfb70 2023-11-28T11:54:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.844+0000 7f25c591d700 1 -- 172.21.15.50:0/3857125267 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b80e0710 con 0x7f25b80dfb70 2023-11-28T11:54:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.844+0000 7f25c591d700 1 -- 172.21.15.50:0/3857125267 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b80dffe0 con 0x7f25b80dfb70 2023-11-28T11:54:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.844+0000 7f25bd7fa700 1 -- 172.21.15.50:0/3857125267 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f25b401a020 con 0x7f25b80dfb70 2023-11-28T11:54:34.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.848+0000 7f25bd7fa700 1 --2- 172.21.15.50:0/3857125267 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f25ac064ee0 0x7f25ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:34.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.848+0000 7f25bd7fa700 1 -- 172.21.15.50:0/3857125267 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f25b4081dc0 con 0x7f25b80dfb70 2023-11-28T11:54:34.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.848+0000 7f25c491b700 1 --2- 172.21.15.50:0/3857125267 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f25ac064ee0 0x7f25ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:34.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.848+0000 7f25c491b700 1 --2- 172.21.15.50:0/3857125267 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f25ac064ee0 0x7f25ac067390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f25b8052570 tx=0x7f25b0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:34.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:34.852+0000 7f25bd7fa700 1 -- 172.21.15.50:0/3857125267 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f25b404fc30 con 0x7f25b80dfb70 2023-11-28T11:54:35.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.032+0000 7f25c591d700 1 -- 172.21.15.50:0/3857125267 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f25b8174bb0 con 0x7f25b80dfb70 2023-11-28T11:54:35.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.032+0000 7f25bd7fa700 1 -- 172.21.15.50:0/3857125267 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f25b4053250 con 0x7f25b80dfb70 2023-11-28T11:54:35.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.036+0000 7f25c591d700 1 -- 172.21.15.50:0/3857125267 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f25ac064ee0 msgr2=0x7f25ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.036+0000 7f25c591d700 1 --2- 172.21.15.50:0/3857125267 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f25ac064ee0 0x7f25ac067390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f25b8052570 tx=0x7f25b0008030 comp rx=0 tx=0).stop 2023-11-28T11:54:35.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.036+0000 7f25c591d700 1 -- 172.21.15.50:0/3857125267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25b80dfb70 msgr2=0x7f25b804ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.036+0000 7f25c591d700 1 --2- 172.21.15.50:0/3857125267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25b80dfb70 0x7f25b804ce10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f25b400c580 tx=0x7f25b400c890 comp rx=0 tx=0).stop 2023-11-28T11:54:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.036+0000 7f25c591d700 1 -- 172.21.15.50:0/3857125267 shutdown_connections 2023-11-28T11:54:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.036+0000 7f25c591d700 1 --2- 172.21.15.50:0/3857125267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b804d350 0x7f25b80ddc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.036+0000 7f25c591d700 1 --2- 172.21.15.50:0/3857125267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25b80dfb70 0x7f25b804ce10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.036+0000 7f25c591d700 1 --2- 172.21.15.50:0/3857125267 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f25ac064ee0 0x7f25ac067390 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.036+0000 7f25c591d700 1 --2- 172.21.15.50:0/3857125267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25b8036e80 0x7f25b804a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.036+0000 7f25c591d700 1 -- 172.21.15.50:0/3857125267 >> 172.21.15.50:0/3857125267 conn(0x7f25b8051770 msgr2=0x7f25b8051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.036+0000 7f25c591d700 1 -- 172.21.15.50:0/3857125267 shutdown_connections 2023-11-28T11:54:35.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.036+0000 7f25c591d700 1 -- 172.21.15.50:0/3857125267 wait complete. 2023-11-28T11:54:35.040 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-11-28T11:54:35.054 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-11-28T11:54:35.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:35.055 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T11:54:35.071 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:54:35.072 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T11:54:35.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:35.072 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T11:54:35.078 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:54:35.078 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:54:35.087 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:54:35.087 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:54:35.095 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:35.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafe4cc7700 1 Processor -- start 2023-11-28T11:54:35.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafe4cc7700 1 -- start start 2023-11-28T11:54:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafe4cc7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafe0159e70 0x7fafe006c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafe4cc7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fafe0069c40 0x7fafe00cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafe4cc7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe006ace0 con 0x7fafe006cee0 2023-11-28T11:54:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafe4cc7700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe006a0d0 con 0x7fafe0069c40 2023-11-28T11:54:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafe4cc7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe006a3b0 con 0x7fafe0159e70 2023-11-28T11:54:35.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafd6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fafe0069c40 0x7fafe00cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:35.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafd6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fafe0069c40 0x7fafe00cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60912/0 (socket says 172.21.15.50:60912) 2023-11-28T11:54:35.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafd6ffd700 1 -- 172.21.15.50:0/3292060182 learned_addr learned my addr 172.21.15.50:0/3292060182 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:35.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafdf7fe700 1 --2- 172.21.15.50:0/3292060182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafe0159e70 0x7fafe006c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:35.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafd6ffd700 1 -- 172.21.15.50:0/3292060182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafe0159e70 msgr2=0x7fafe006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:35.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafd6ffd700 1 --2- 172.21.15.50:0/3292060182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafe0159e70 0x7fafe006c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafd6ffd700 1 -- 172.21.15.50:0/3292060182 >> v1:172.21.15.192:6789/0 conn(0x7fafe006cee0 legacy=0x7fafe00b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafd6ffd700 1 -- 172.21.15.50:0/3292060182 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe006a690 con 0x7fafe0069c40 2023-11-28T11:54:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafd6ffd700 1 --2- 172.21.15.50:0/3292060182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafe0069c40 0x7fafe00cad60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009910 tx=0x7fafc8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a271c6912d9546c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafdeffd700 1 -- 172.21.15.50:0/3292060182 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8004230 con 0x7fafe0069c40 2023-11-28T11:54:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafdeffd700 1 -- 172.21.15.50:0/3292060182 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc8004390 con 0x7fafe0069c40 2023-11-28T11:54:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafdeffd700 1 -- 172.21.15.50:0/3292060182 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8009e60 con 0x7fafe0069c40 2023-11-28T11:54:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafe4cc7700 1 -- 172.21.15.50:0/3292060182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafe0069c40 msgr2=0x7fafe00cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafe4cc7700 1 --2- 172.21.15.50:0/3292060182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafe0069c40 0x7fafe00cad60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009910 tx=0x7fafc8009c20 comp rx=0 tx=0).stop 2023-11-28T11:54:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafe4cc7700 1 -- 172.21.15.50:0/3292060182 shutdown_connections 2023-11-28T11:54:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafe4cc7700 1 --2- 172.21.15.50:0/3292060182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafe0069c40 0x7fafe00cad60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafe4cc7700 1 --2- 172.21.15.50:0/3292060182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafe0159e70 0x7fafe006c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafe4cc7700 1 -- 172.21.15.50:0/3292060182 >> 172.21.15.50:0/3292060182 conn(0x7fafe00ce3e0 msgr2=0x7fafe00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafe4cc7700 1 -- 172.21.15.50:0/3292060182 shutdown_connections 2023-11-28T11:54:35.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.240+0000 7fafe4cc7700 1 -- 172.21.15.50:0/3292060182 wait complete. 2023-11-28T11:54:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.244+0000 7fafe4cc7700 1 Processor -- start 2023-11-28T11:54:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.244+0000 7fafe4cc7700 1 -- start start 2023-11-28T11:54:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafe4cc7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafe0069c40 0x7fafe01eeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafe4cc7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafe006cee0 0x7fafe00718a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafe4cc7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafe0159e70 0x7fafe015c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafe4cc7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe0158c90 con 0x7fafe0069c40 2023-11-28T11:54:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafe4cc7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe00c37f0 con 0x7fafe0159e70 2023-11-28T11:54:35.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafe4cc7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe00c2900 con 0x7fafe006cee0 2023-11-28T11:54:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafdf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafe0069c40 0x7fafe01eeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafdf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafe0069c40 0x7fafe01eeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60918/0 (socket says 172.21.15.50:60918) 2023-11-28T11:54:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafdf7fe700 1 -- 172.21.15.50:0/368228796 learned_addr learned my addr 172.21.15.50:0/368228796 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafd6ffd700 1 --2- 172.21.15.50:0/368228796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafe006cee0 0x7fafe00718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafdffff700 1 --2- 172.21.15.50:0/368228796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafe0159e70 0x7fafe015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafdf7fe700 1 -- 172.21.15.50:0/368228796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafe006cee0 msgr2=0x7fafe00718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafdf7fe700 1 --2- 172.21.15.50:0/368228796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafe006cee0 0x7fafe00718a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafdf7fe700 1 -- 172.21.15.50:0/368228796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafe0159e70 msgr2=0x7fafe015c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafdf7fe700 1 --2- 172.21.15.50:0/368228796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafe0159e70 0x7fafe015c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafdf7fe700 1 -- 172.21.15.50:0/368228796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc8009570 con 0x7fafe0069c40 2023-11-28T11:54:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafdffff700 1 --2- 172.21.15.50:0/368228796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafe0159e70 0x7fafe015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafdf7fe700 1 --2- 172.21.15.50:0/368228796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafe0069c40 0x7fafe01eeb40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fafd000d800 tx=0x7fafd000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafdcff9700 1 -- 172.21.15.50:0/368228796 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd00125f0 con 0x7fafe0069c40 2023-11-28T11:54:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafdcff9700 1 -- 172.21.15.50:0/368228796 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd0012750 con 0x7fafe0069c40 2023-11-28T11:54:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafe4cc7700 1 -- 172.21.15.50:0/368228796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe015a240 con 0x7fafe0069c40 2023-11-28T11:54:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafdcff9700 1 -- 172.21.15.50:0/368228796 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0012b00 con 0x7fafe0069c40 2023-11-28T11:54:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafe4cc7700 1 -- 172.21.15.50:0/368228796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe006a970 con 0x7fafe0069c40 2023-11-28T11:54:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.248+0000 7fafe4cc7700 1 -- 172.21.15.50:0/368228796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe00ca1e0 con 0x7fafe0069c40 2023-11-28T11:54:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.252+0000 7fafdcff9700 1 -- 172.21.15.50:0/368228796 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fafd0012c60 con 0x7fafe0069c40 2023-11-28T11:54:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.252+0000 7fafdcff9700 1 --2- 172.21.15.50:0/368228796 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fafc0064f10 0x7fafc00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.252+0000 7fafdcff9700 1 -- 172.21.15.50:0/368228796 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fafd00826f0 con 0x7fafe0069c40 2023-11-28T11:54:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.252+0000 7fafd6ffd700 1 --2- 172.21.15.50:0/368228796 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fafc0064f10 0x7fafc00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:35.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.252+0000 7fafd6ffd700 1 --2- 172.21.15.50:0/368228796 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fafc0064f10 0x7fafc00673c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009910 tx=0x7fafc8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:35.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.260+0000 7fafdcff9700 1 -- 172.21.15.50:0/368228796 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fafd00504d0 con 0x7fafe0069c40 2023-11-28T11:54:35.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.420+0000 7fafe4cc7700 1 -- 172.21.15.50:0/368228796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafe006b6d0 con 0x7fafe0069c40 2023-11-28T11:54:35.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.424+0000 7fafdcff9700 1 -- 172.21.15.50:0/368228796 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19689 (secure 0 0 0) 0x7fafd0053af0 con 0x7fafe0069c40 2023-11-28T11:54:35.425 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:35.425 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:54:30.086945+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:35.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.424+0000 7fafe4cc7700 1 -- 172.21.15.50:0/368228796 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fafc0064f10 msgr2=0x7fafc00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.424+0000 7fafe4cc7700 1 --2- 172.21.15.50:0/368228796 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fafc0064f10 0x7fafc00673c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009910 tx=0x7fafc8008030 comp rx=0 tx=0).stop 2023-11-28T11:54:35.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.424+0000 7fafe4cc7700 1 -- 172.21.15.50:0/368228796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafe0069c40 msgr2=0x7fafe01eeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.424+0000 7fafe4cc7700 1 --2- 172.21.15.50:0/368228796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafe0069c40 0x7fafe01eeb40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fafd000d800 tx=0x7fafd000db10 comp rx=0 tx=0).stop 2023-11-28T11:54:35.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.424+0000 7fafe4cc7700 1 -- 172.21.15.50:0/368228796 shutdown_connections 2023-11-28T11:54:35.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.424+0000 7fafe4cc7700 1 --2- 172.21.15.50:0/368228796 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fafc0064f10 0x7fafc00673c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.424+0000 7fafe4cc7700 1 --2- 172.21.15.50:0/368228796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafe0159e70 0x7fafe015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.424+0000 7fafe4cc7700 1 --2- 172.21.15.50:0/368228796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafe006cee0 0x7fafe00718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.424+0000 7fafe4cc7700 1 --2- 172.21.15.50:0/368228796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafe0069c40 0x7fafe01eeb40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.428+0000 7fafe4cc7700 1 -- 172.21.15.50:0/368228796 >> 172.21.15.50:0/368228796 conn(0x7fafe00ce3e0 msgr2=0x7fafe00ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:35.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.428+0000 7fafe4cc7700 1 -- 172.21.15.50:0/368228796 shutdown_connections 2023-11-28T11:54:35.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.428+0000 7fafe4cc7700 1 -- 172.21.15.50:0/368228796 wait complete. 2023-11-28T11:54:35.441 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:53:38.462826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:53:39.778621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:53:42.870360+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:54:35.442 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:54:35.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.560+0000 7fb7ca5fc700 1 Processor -- start 2023-11-28T11:54:35.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.560+0000 7fb7ca5fc700 1 -- start start 2023-11-28T11:54:35.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7ca5fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb7c406cd30 0x7fb7c406ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:35.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7ca5fc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c406f990 con 0x7fb7c415c160 2023-11-28T11:54:35.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7ca5fc700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c406d1b0 con 0x7fb7c40c9c00 2023-11-28T11:54:35.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7ca5fc700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c406a4d0 con 0x7fb7c406cd30 2023-11-28T11:54:35.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7c8df9700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb7c415c160 0x7fb7c40cde30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41564/0 (socket says 172.21.15.50:41564) 2023-11-28T11:54:35.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7c8df9700 1 -- 172.21.15.50:0/1645002945 learned_addr learned my addr 172.21.15.50:0/1645002945 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:35.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7c9dfb700 1 --2- 172.21.15.50:0/1645002945 >> v2:172.21.15.192:3300/0 conn(0x7fb7c406cd30 0x7fb7c406ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:35.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7bbfff700 1 -- 172.21.15.50:0/1645002945 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780182775 0 0) 0x7fb7c406f990 con 0x7fb7c415c160 2023-11-28T11:54:35.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7bbfff700 1 -- 172.21.15.50:0/1645002945 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7b00035d0 con 0x7fb7c415c160 2023-11-28T11:54:35.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7c9dfb700 1 -- 172.21.15.50:0/1645002945 >> v1:172.21.15.192:6789/0 conn(0x7fb7c40c9c00 legacy=0x7fb7c40c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7c9dfb700 1 -- 172.21.15.50:0/1645002945 >> v1:172.21.15.50:6789/0 conn(0x7fb7c415c160 legacy=0x7fb7c40cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7c9dfb700 1 -- 172.21.15.50:0/1645002945 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c406f0f0 con 0x7fb7c406cd30 2023-11-28T11:54:35.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7c9dfb700 1 --2- 172.21.15.50:0/1645002945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7c406cd30 0x7fb7c406ea10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc009d90 tx=0x7fb7bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83a3babdd5e545d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7bbfff700 1 -- 172.21.15.50:0/1645002945 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc00e070 con 0x7fb7c406cd30 2023-11-28T11:54:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7bbfff700 1 -- 172.21.15.50:0/1645002945 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc00bb20 con 0x7fb7c406cd30 2023-11-28T11:54:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7bbfff700 1 -- 172.21.15.50:0/1645002945 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc012430 con 0x7fb7c406cd30 2023-11-28T11:54:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7ca5fc700 1 -- 172.21.15.50:0/1645002945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7c406cd30 msgr2=0x7fb7c406ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7ca5fc700 1 --2- 172.21.15.50:0/1645002945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7c406cd30 0x7fb7c406ea10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc009d90 tx=0x7fb7bc00b330 comp rx=0 tx=0).stop 2023-11-28T11:54:35.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7ca5fc700 1 -- 172.21.15.50:0/1645002945 shutdown_connections 2023-11-28T11:54:35.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7ca5fc700 1 --2- 172.21.15.50:0/1645002945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7c406cd30 0x7fb7c406ea10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7ca5fc700 1 -- 172.21.15.50:0/1645002945 >> 172.21.15.50:0/1645002945 conn(0x7fb7c40d0240 msgr2=0x7fb7c40cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:35.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7ca5fc700 1 -- 172.21.15.50:0/1645002945 shutdown_connections 2023-11-28T11:54:35.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.564+0000 7fb7ca5fc700 1 -- 172.21.15.50:0/1645002945 wait complete. 2023-11-28T11:54:35.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.568+0000 7fb7ca5fc700 1 Processor -- start 2023-11-28T11:54:35.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.568+0000 7fb7ca5fc700 1 -- start start 2023-11-28T11:54:35.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.568+0000 7fb7ca5fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7c406cd30 0x7fb7c4156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:35.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.568+0000 7fb7ca5fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7c40c9c00 0x7fb7c40c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:35.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.568+0000 7fb7ca5fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7c415c160 0x7fb7c415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:35.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.568+0000 7fb7ca5fc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c4157190 con 0x7fb7c40c9c00 2023-11-28T11:54:35.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.568+0000 7fb7ca5fc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c40c85f0 con 0x7fb7c415c160 2023-11-28T11:54:35.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.568+0000 7fb7ca5fc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c40c79e0 con 0x7fb7c406cd30 2023-11-28T11:54:35.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.568+0000 7fb7c8df9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7c40c9c00 0x7fb7c40c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:35.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.568+0000 7fb7c8df9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7c40c9c00 0x7fb7c40c7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60928/0 (socket says 172.21.15.50:60928) 2023-11-28T11:54:35.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.568+0000 7fb7c9dfb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7c415c160 0x7fb7c415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:35.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.568+0000 7fb7c95fa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7c406cd30 0x7fb7c4156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:35.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.568+0000 7fb7c8df9700 1 -- 172.21.15.50:0/4202292604 learned_addr learned my addr 172.21.15.50:0/4202292604 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.572+0000 7fb7c9dfb700 1 -- 172.21.15.50:0/4202292604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7c406cd30 msgr2=0x7fb7c4156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.572+0000 7fb7c9dfb700 1 --2- 172.21.15.50:0/4202292604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7c406cd30 0x7fb7c4156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.572+0000 7fb7c9dfb700 1 -- 172.21.15.50:0/4202292604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7c40c9c00 msgr2=0x7fb7c40c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.572+0000 7fb7c9dfb700 1 --2- 172.21.15.50:0/4202292604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7c40c9c00 0x7fb7c40c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.572+0000 7fb7c9dfb700 1 -- 172.21.15.50:0/4202292604 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc009a70 con 0x7fb7c415c160 2023-11-28T11:54:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.572+0000 7fb7c8df9700 1 --2- 172.21.15.50:0/4202292604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7c40c9c00 0x7fb7c40c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.572+0000 7fb7c9dfb700 1 --2- 172.21.15.50:0/4202292604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7c415c160 0x7fb7c415c9b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc016000 tx=0x7fb7bc004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.572+0000 7fb7b9ffb700 1 -- 172.21.15.50:0/4202292604 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc012430 con 0x7fb7c415c160 2023-11-28T11:54:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.572+0000 7fb7b9ffb700 1 -- 172.21.15.50:0/4202292604 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc020070 con 0x7fb7c415c160 2023-11-28T11:54:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.572+0000 7fb7b9ffb700 1 -- 172.21.15.50:0/4202292604 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc004280 con 0x7fb7c415c160 2023-11-28T11:54:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.572+0000 7fb7ca5fc700 1 -- 172.21.15.50:0/4202292604 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c406f6b0 con 0x7fb7c415c160 2023-11-28T11:54:35.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.572+0000 7fb7ca5fc700 1 -- 172.21.15.50:0/4202292604 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c406f3d0 con 0x7fb7c415c160 2023-11-28T11:54:35.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.572+0000 7fb7ca5fc700 1 -- 172.21.15.50:0/4202292604 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c40cd910 con 0x7fb7c415c160 2023-11-28T11:54:35.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.572+0000 7fb7b9ffb700 1 -- 172.21.15.50:0/4202292604 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb7bc02e070 con 0x7fb7c415c160 2023-11-28T11:54:35.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.576+0000 7fb7b9ffb700 1 --2- 172.21.15.50:0/4202292604 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb7a8064ee0 0x7fb7a8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:35.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.576+0000 7fb7b9ffb700 1 -- 172.21.15.50:0/4202292604 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb7bc022070 con 0x7fb7c415c160 2023-11-28T11:54:35.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.576+0000 7fb7c95fa700 1 --2- 172.21.15.50:0/4202292604 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb7a8064ee0 0x7fb7a8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:35.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.576+0000 7fb7c95fa700 1 --2- 172.21.15.50:0/4202292604 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb7a8064ee0 0x7fb7a8067390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb7c415b620 tx=0x7fb7c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:35.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.584+0000 7fb7b9ffb700 1 -- 172.21.15.50:0/4202292604 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb7bc051bd0 con 0x7fb7c415c160 2023-11-28T11:54:35.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.744+0000 7fb7ca5fc700 1 -- 172.21.15.50:0/4202292604 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb7c4072c20 con 0x7fb7c415c160 2023-11-28T11:54:35.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.748+0000 7fb7b9ffb700 1 -- 172.21.15.50:0/4202292604 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb7bc0551f0 con 0x7fb7c415c160 2023-11-28T11:54:35.748 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:54:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.748+0000 7fb7ca5fc700 1 -- 172.21.15.50:0/4202292604 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb7a8064ee0 msgr2=0x7fb7a8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.748+0000 7fb7ca5fc700 1 --2- 172.21.15.50:0/4202292604 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb7a8064ee0 0x7fb7a8067390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb7c415b620 tx=0x7fb7c0009040 comp rx=0 tx=0).stop 2023-11-28T11:54:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.748+0000 7fb7ca5fc700 1 -- 172.21.15.50:0/4202292604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7c415c160 msgr2=0x7fb7c415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.748+0000 7fb7ca5fc700 1 --2- 172.21.15.50:0/4202292604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7c415c160 0x7fb7c415c9b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc016000 tx=0x7fb7bc004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.748+0000 7fb7ca5fc700 1 -- 172.21.15.50:0/4202292604 shutdown_connections 2023-11-28T11:54:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.748+0000 7fb7ca5fc700 1 --2- 172.21.15.50:0/4202292604 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb7a8064ee0 0x7fb7a8067390 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.748+0000 7fb7ca5fc700 1 --2- 172.21.15.50:0/4202292604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7c415c160 0x7fb7c415c9b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.748+0000 7fb7ca5fc700 1 --2- 172.21.15.50:0/4202292604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7c40c9c00 0x7fb7c40c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.748+0000 7fb7ca5fc700 1 --2- 172.21.15.50:0/4202292604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7c406cd30 0x7fb7c4156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.748+0000 7fb7ca5fc700 1 -- 172.21.15.50:0/4202292604 >> 172.21.15.50:0/4202292604 conn(0x7fb7c40d0240 msgr2=0x7fb7c406b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:35.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.748+0000 7fb7ca5fc700 1 -- 172.21.15.50:0/4202292604 shutdown_connections 2023-11-28T11:54:35.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.748+0000 7fb7ca5fc700 1 -- 172.21.15.50:0/4202292604 wait complete. 2023-11-28T11:54:35.764 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:54:35.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.880+0000 7f0b8da11700 1 Processor -- start 2023-11-28T11:54:35.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.880+0000 7f0b8da11700 1 -- start start 2023-11-28T11:54:35.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.880+0000 7f0b8da11700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b880b2110 0x7f0b880cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:35.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.880+0000 7f0b8da11700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0b880c4170 0x7f0b880c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:35.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.880+0000 7f0b8da11700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b880cb050 con 0x7f0b880cf740 2023-11-28T11:54:35.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.880+0000 7f0b8da11700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8815da00 con 0x7f0b880c4170 2023-11-28T11:54:35.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.880+0000 7f0b8da11700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880d0310 con 0x7f0b880b2110 2023-11-28T11:54:35.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b87fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0b880cf740 0x7f0b880b24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41580/0 (socket says 172.21.15.50:41580) 2023-11-28T11:54:35.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b87fff700 1 -- 172.21.15.50:0/1856066975 learned_addr learned my addr 172.21.15.50:0/1856066975 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:35.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b8ca0f700 1 --2- 172.21.15.50:0/1856066975 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b880b2110 0x7f0b880cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:35.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b8d210700 1 --2- 172.21.15.50:0/1856066975 >> v2:172.21.15.192:3300/0 conn(0x7f0b880c4170 0x7f0b880c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:35.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b877fe700 1 -- 172.21.15.50:0/1856066975 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821558517 0 0) 0x7f0b880cb050 con 0x7f0b880cf740 2023-11-28T11:54:35.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b877fe700 1 -- 172.21.15.50:0/1856066975 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b700035d0 con 0x7f0b880cf740 2023-11-28T11:54:35.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b8d210700 1 -- 172.21.15.50:0/1856066975 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b880b2110 msgr2=0x7f0b880cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:35.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b8d210700 1 --2- 172.21.15.50:0/1856066975 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b880b2110 0x7f0b880cfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b8d210700 1 -- 172.21.15.50:0/1856066975 >> v1:172.21.15.50:6789/0 conn(0x7f0b880cf740 legacy=0x7f0b880b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b8d210700 1 -- 172.21.15.50:0/1856066975 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8815dc50 con 0x7f0b880c4170 2023-11-28T11:54:35.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b8d210700 1 --2- 172.21.15.50:0/1856066975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b880c4170 0x7f0b880c45c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009850 tx=0x7f0b80009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e81f4a3b1c1b8e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:35.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b877fe700 1 -- 172.21.15.50:0/1856066975 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80011830 con 0x7f0b880c4170 2023-11-28T11:54:35.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b877fe700 1 -- 172.21.15.50:0/1856066975 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b80011990 con 0x7f0b880c4170 2023-11-28T11:54:35.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b877fe700 1 -- 172.21.15.50:0/1856066975 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80011d40 con 0x7f0b880c4170 2023-11-28T11:54:35.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b8da11700 1 -- 172.21.15.50:0/1856066975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b880c4170 msgr2=0x7f0b880c45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b8da11700 1 --2- 172.21.15.50:0/1856066975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b880c4170 0x7f0b880c45c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009850 tx=0x7f0b80009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b8da11700 1 -- 172.21.15.50:0/1856066975 shutdown_connections 2023-11-28T11:54:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b8da11700 1 --2- 172.21.15.50:0/1856066975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b880c4170 0x7f0b880c45c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b8da11700 1 --2- 172.21.15.50:0/1856066975 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b880b2110 0x7f0b880cfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b8da11700 1 -- 172.21.15.50:0/1856066975 >> 172.21.15.50:0/1856066975 conn(0x7f0b880cd0a0 msgr2=0x7f0b880cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b8da11700 1 -- 172.21.15.50:0/1856066975 shutdown_connections 2023-11-28T11:54:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.884+0000 7f0b8da11700 1 -- 172.21.15.50:0/1856066975 wait complete. 2023-11-28T11:54:35.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b8da11700 1 Processor -- start 2023-11-28T11:54:35.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b8da11700 1 -- start start 2023-11-28T11:54:35.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b8da11700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b880b2110 0x7f0b88147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:35.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b8da11700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880c4170 0x7f0b88147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:35.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b8da11700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b880cf740 0x7f0b880b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:35.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b8da11700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8815c0b0 con 0x7f0b880c4170 2023-11-28T11:54:35.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b8da11700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b88147680 con 0x7f0b880b2110 2023-11-28T11:54:35.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b8da11700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8815b450 con 0x7f0b880cf740 2023-11-28T11:54:35.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b87fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880c4170 0x7f0b88147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:35.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b87fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880c4170 0x7f0b88147950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60934/0 (socket says 172.21.15.50:60934) 2023-11-28T11:54:35.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b87fff700 1 -- 172.21.15.50:0/3946144002 learned_addr learned my addr 172.21.15.50:0/3946144002 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:35.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b8ca0f700 1 --2- 172.21.15.50:0/3946144002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b880b2110 0x7f0b88147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:35.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b8d210700 1 --2- 172.21.15.50:0/3946144002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b880cf740 0x7f0b880b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:35.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b87fff700 1 -- 172.21.15.50:0/3946144002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b880cf740 msgr2=0x7f0b880b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b87fff700 1 --2- 172.21.15.50:0/3946144002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b880cf740 0x7f0b880b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b87fff700 1 -- 172.21.15.50:0/3946144002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b880b2110 msgr2=0x7f0b88147140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:35.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b87fff700 1 --2- 172.21.15.50:0/3946144002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b880b2110 0x7f0b88147140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:35.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b87fff700 1 -- 172.21.15.50:0/3946144002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b800094b0 con 0x7f0b880c4170 2023-11-28T11:54:35.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.888+0000 7f0b87fff700 1 --2- 172.21.15.50:0/3946144002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880c4170 0x7f0b88147950 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800cbf0 tx=0x7f0b7800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:35.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.892+0000 7f0b857fa700 1 -- 172.21.15.50:0/3946144002 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78007480 con 0x7f0b880c4170 2023-11-28T11:54:35.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.892+0000 7f0b857fa700 1 -- 172.21.15.50:0/3946144002 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b780075e0 con 0x7f0b880c4170 2023-11-28T11:54:35.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.892+0000 7f0b8da11700 1 -- 172.21.15.50:0/3946144002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8815e210 con 0x7f0b880c4170 2023-11-28T11:54:35.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.892+0000 7f0b857fa700 1 -- 172.21.15.50:0/3946144002 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78007970 con 0x7f0b880c4170 2023-11-28T11:54:35.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.892+0000 7f0b8da11700 1 -- 172.21.15.50:0/3946144002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8815df30 con 0x7f0b880c4170 2023-11-28T11:54:35.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.892+0000 7f0b8da11700 1 -- 172.21.15.50:0/3946144002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b8815e4f0 con 0x7f0b880c4170 2023-11-28T11:54:35.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.892+0000 7f0b857fa700 1 -- 172.21.15.50:0/3946144002 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0b78019030 con 0x7f0b880c4170 2023-11-28T11:54:35.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.892+0000 7f0b857fa700 1 --2- 172.21.15.50:0/3946144002 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0b74064ee0 0x7f0b74067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:35.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.892+0000 7f0b857fa700 1 -- 172.21.15.50:0/3946144002 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0b78081980 con 0x7f0b880c4170 2023-11-28T11:54:35.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.892+0000 7f0b8ca0f700 1 --2- 172.21.15.50:0/3946144002 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0b74064ee0 0x7f0b74067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:35.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.896+0000 7f0b8ca0f700 1 --2- 172.21.15.50:0/3946144002 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0b74064ee0 0x7f0b74067390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009b50 tx=0x7f0b7c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:35.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:35.900+0000 7f0b857fa700 1 -- 172.21.15.50:0/3946144002 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0b7804f7f0 con 0x7f0b880c4170 2023-11-28T11:54:36.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.068+0000 7f0b8da11700 1 -- 172.21.15.50:0/3946144002 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b8815c1f0 con 0x7f0b880c4170 2023-11-28T11:54:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.068+0000 7f0b857fa700 1 -- 172.21.15.50:0/3946144002 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b78017020 con 0x7f0b880c4170 2023-11-28T11:54:36.069 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:54:36.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.068+0000 7f0b8da11700 1 -- 172.21.15.50:0/3946144002 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0b74064ee0 msgr2=0x7f0b74067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.068+0000 7f0b8da11700 1 --2- 172.21.15.50:0/3946144002 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0b74064ee0 0x7f0b74067390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009b50 tx=0x7f0b7c009240 comp rx=0 tx=0).stop 2023-11-28T11:54:36.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.068+0000 7f0b8da11700 1 -- 172.21.15.50:0/3946144002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880c4170 msgr2=0x7f0b88147950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.068+0000 7f0b8da11700 1 --2- 172.21.15.50:0/3946144002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880c4170 0x7f0b88147950 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800cbf0 tx=0x7f0b7800cc20 comp rx=0 tx=0).stop 2023-11-28T11:54:36.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.068+0000 7f0b8da11700 1 -- 172.21.15.50:0/3946144002 shutdown_connections 2023-11-28T11:54:36.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.068+0000 7f0b8da11700 1 --2- 172.21.15.50:0/3946144002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b880cf740 0x7f0b880b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.068+0000 7f0b8da11700 1 --2- 172.21.15.50:0/3946144002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b880c4170 0x7f0b88147950 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.068+0000 7f0b8da11700 1 --2- 172.21.15.50:0/3946144002 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0b74064ee0 0x7f0b74067390 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.068+0000 7f0b8da11700 1 --2- 172.21.15.50:0/3946144002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b880b2110 0x7f0b88147140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.068+0000 7f0b8da11700 1 -- 172.21.15.50:0/3946144002 >> 172.21.15.50:0/3946144002 conn(0x7f0b880cd0a0 msgr2=0x7f0b880b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:36.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.068+0000 7f0b8da11700 1 -- 172.21.15.50:0/3946144002 shutdown_connections 2023-11-28T11:54:36.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.072+0000 7f0b8da11700 1 -- 172.21.15.50:0/3946144002 wait complete. 2023-11-28T11:54:36.072 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:54:36.074 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:54:36.084 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:54:36.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2f759e700 1 Processor -- start 2023-11-28T11:54:36.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2f759e700 1 -- start start 2023-11-28T11:54:36.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2f759e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe2f806b370 0x7fe2f8163590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:36.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2f759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f80ccd00 con 0x7fe2f80aaf40 2023-11-28T11:54:36.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2f759e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f80b3270 con 0x7fe2f815bb80 2023-11-28T11:54:36.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2f759e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f80b19b0 con 0x7fe2f806b370 2023-11-28T11:54:36.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2effff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe2f80aaf40 0x7fe2f80b2b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41594/0 (socket says 172.21.15.50:41594) 2023-11-28T11:54:36.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2effff700 1 -- 172.21.15.50:0/338617520 learned_addr learned my addr 172.21.15.50:0/338617520 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:36.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2f6d9d700 1 --2- 172.21.15.50:0/338617520 >> v2:172.21.15.192:3300/0 conn(0x7fe2f806b370 0x7fe2f8163590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:36.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2f5d9b700 1 -- 172.21.15.50:0/338617520 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3352610230 0 0) 0x7fe2f80ccd00 con 0x7fe2f80aaf40 2023-11-28T11:54:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2f5d9b700 1 -- 172.21.15.50:0/338617520 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2e40046e0 con 0x7fe2f80aaf40 2023-11-28T11:54:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2f6d9d700 1 -- 172.21.15.50:0/338617520 >> v1:172.21.15.192:6789/0 conn(0x7fe2f815bb80 legacy=0x7fe2f80b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2f6d9d700 1 -- 172.21.15.50:0/338617520 >> v1:172.21.15.50:6789/0 conn(0x7fe2f80aaf40 legacy=0x7fe2f80b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2f6d9d700 1 -- 172.21.15.50:0/338617520 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f80cd510 con 0x7fe2f806b370 2023-11-28T11:54:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2f6d9d700 1 --2- 172.21.15.50:0/338617520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2f806b370 0x7fe2f8163590 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009d90 tx=0x7fe2f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc29138028ddd6f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2f5d9b700 1 -- 172.21.15.50:0/338617520 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f000e070 con 0x7fe2f806b370 2023-11-28T11:54:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2f5d9b700 1 -- 172.21.15.50:0/338617520 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f000bb20 con 0x7fe2f806b370 2023-11-28T11:54:36.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.292+0000 7fe2f5d9b700 1 -- 172.21.15.50:0/338617520 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0012430 con 0x7fe2f806b370 2023-11-28T11:54:36.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.296+0000 7fe2f759e700 1 -- 172.21.15.50:0/338617520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2f806b370 msgr2=0x7fe2f8163590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.296+0000 7fe2f759e700 1 --2- 172.21.15.50:0/338617520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2f806b370 0x7fe2f8163590 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009d90 tx=0x7fe2f000b330 comp rx=0 tx=0).stop 2023-11-28T11:54:36.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.296+0000 7fe2f759e700 1 -- 172.21.15.50:0/338617520 shutdown_connections 2023-11-28T11:54:36.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.296+0000 7fe2f759e700 1 --2- 172.21.15.50:0/338617520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2f806b370 0x7fe2f8163590 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.296+0000 7fe2f759e700 1 -- 172.21.15.50:0/338617520 >> 172.21.15.50:0/338617520 conn(0x7fe2f80cae70 msgr2=0x7fe2f80cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:36.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.296+0000 7fe2f759e700 1 -- 172.21.15.50:0/338617520 shutdown_connections 2023-11-28T11:54:36.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.296+0000 7fe2f759e700 1 -- 172.21.15.50:0/338617520 wait complete. 2023-11-28T11:54:36.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.296+0000 7fe2f759e700 1 Processor -- start 2023-11-28T11:54:36.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.296+0000 7fe2f759e700 1 -- start start 2023-11-28T11:54:36.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.296+0000 7fe2f759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe2f806b370 0x7fe2f8146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:36.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.296+0000 7fe2f759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f80aaf40 0x7fe2f809b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:36.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.296+0000 7fe2f759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2f815bb80 0x7fe2f8148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:36.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.296+0000 7fe2f759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f80ae7f0 con 0x7fe2f80aaf40 2023-11-28T11:54:36.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2f759e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f80c8280 con 0x7fe2f815bb80 2023-11-28T11:54:36.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2f759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f80adec0 con 0x7fe2f806b370 2023-11-28T11:54:36.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2effff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f80aaf40 0x7fe2f809b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:36.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2effff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f80aaf40 0x7fe2f809b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60944/0 (socket says 172.21.15.50:60944) 2023-11-28T11:54:36.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2effff700 1 -- 172.21.15.50:0/1598651011 learned_addr learned my addr 172.21.15.50:0/1598651011 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:36.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2f6d9d700 1 --2- 172.21.15.50:0/1598651011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2f815bb80 0x7fe2f8148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:36.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2f659c700 1 --2- 172.21.15.50:0/1598651011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe2f806b370 0x7fe2f8146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:36.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2effff700 1 -- 172.21.15.50:0/1598651011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe2f806b370 msgr2=0x7fe2f8146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2effff700 1 --2- 172.21.15.50:0/1598651011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe2f806b370 0x7fe2f8146f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2effff700 1 -- 172.21.15.50:0/1598651011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2f815bb80 msgr2=0x7fe2f8148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2effff700 1 --2- 172.21.15.50:0/1598651011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2f815bb80 0x7fe2f8148f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2effff700 1 -- 172.21.15.50:0/1598651011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f0009a70 con 0x7fe2f80aaf40 2023-11-28T11:54:36.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2effff700 1 --2- 172.21.15.50:0/1598651011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f80aaf40 0x7fe2f809b270 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000c700 tx=0x7fe2e000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:36.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2eeffd700 1 -- 172.21.15.50:0/1598651011 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0005d90 con 0x7fe2f80aaf40 2023-11-28T11:54:36.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2eeffd700 1 -- 172.21.15.50:0/1598651011 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e00070d0 con 0x7fe2f80aaf40 2023-11-28T11:54:36.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2f759e700 1 -- 172.21.15.50:0/1598651011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f80cd230 con 0x7fe2f80aaf40 2023-11-28T11:54:36.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2eeffd700 1 -- 172.21.15.50:0/1598651011 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0007480 con 0x7fe2f80aaf40 2023-11-28T11:54:36.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2f759e700 1 -- 172.21.15.50:0/1598651011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f80ccf50 con 0x7fe2f80aaf40 2023-11-28T11:54:36.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.300+0000 7fe2f759e700 1 -- 172.21.15.50:0/1598651011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f80b1c50 con 0x7fe2f80aaf40 2023-11-28T11:54:36.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.304+0000 7fe2eeffd700 1 -- 172.21.15.50:0/1598651011 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe2e0019030 con 0x7fe2f80aaf40 2023-11-28T11:54:36.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.304+0000 7fe2eeffd700 1 --2- 172.21.15.50:0/1598651011 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe2d8064f10 0x7fe2d80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:36.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.304+0000 7fe2eeffd700 1 -- 172.21.15.50:0/1598651011 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe2e0081600 con 0x7fe2f80aaf40 2023-11-28T11:54:36.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.304+0000 7fe2f659c700 1 --2- 172.21.15.50:0/1598651011 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe2d8064f10 0x7fe2d80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:36.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.304+0000 7fe2f659c700 1 --2- 172.21.15.50:0/1598651011 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe2d8064f10 0x7fe2d80673c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8000f60 tx=0x7fe2e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:36.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.308+0000 7fe2eeffd700 1 -- 172.21.15.50:0/1598651011 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe2e004f2a0 con 0x7fe2f80aaf40 2023-11-28T11:54:36.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.468+0000 7fe2f759e700 1 -- 172.21.15.50:0/1598651011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe2f8072500 con 0x7fe2f80aaf40 2023-11-28T11:54:36.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.468+0000 7fe2eeffd700 1 -- 172.21.15.50:0/1598651011 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe2e00528c0 con 0x7fe2f80aaf40 2023-11-28T11:54:36.471 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:36.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.472+0000 7fe2f759e700 1 -- 172.21.15.50:0/1598651011 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe2d8064f10 msgr2=0x7fe2d80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.472+0000 7fe2f759e700 1 --2- 172.21.15.50:0/1598651011 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe2d8064f10 0x7fe2d80673c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8000f60 tx=0x7fe2e8009040 comp rx=0 tx=0).stop 2023-11-28T11:54:36.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.472+0000 7fe2f759e700 1 -- 172.21.15.50:0/1598651011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f80aaf40 msgr2=0x7fe2f809b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.472+0000 7fe2f759e700 1 --2- 172.21.15.50:0/1598651011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f80aaf40 0x7fe2f809b270 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000c700 tx=0x7fe2e000ca10 comp rx=0 tx=0).stop 2023-11-28T11:54:36.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.472+0000 7fe2f759e700 1 -- 172.21.15.50:0/1598651011 shutdown_connections 2023-11-28T11:54:36.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.472+0000 7fe2f759e700 1 --2- 172.21.15.50:0/1598651011 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe2d8064f10 0x7fe2d80673c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.472+0000 7fe2f759e700 1 --2- 172.21.15.50:0/1598651011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2f815bb80 0x7fe2f8148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.472+0000 7fe2f759e700 1 --2- 172.21.15.50:0/1598651011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2f80aaf40 0x7fe2f809b270 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.472+0000 7fe2f759e700 1 --2- 172.21.15.50:0/1598651011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe2f806b370 0x7fe2f8146f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.472+0000 7fe2f759e700 1 -- 172.21.15.50:0/1598651011 >> 172.21.15.50:0/1598651011 conn(0x7fe2f80cae70 msgr2=0x7fe2f80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:36.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.472+0000 7fe2f759e700 1 -- 172.21.15.50:0/1598651011 shutdown_connections 2023-11-28T11:54:36.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.472+0000 7fe2f759e700 1 -- 172.21.15.50:0/1598651011 wait complete. 2023-11-28T11:54:36.486 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:54:36.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.600+0000 7f92f4962700 1 Processor -- start 2023-11-28T11:54:36.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.600+0000 7f92f4962700 1 -- start start 2023-11-28T11:54:36.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92f4962700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f92f00cf7f0 0x7f92f006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:36.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92f4962700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f006a9c0 con 0x7f92f006a4c0 2023-11-28T11:54:36.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92f4962700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f006aca0 con 0x7f92f00b1ae0 2023-11-28T11:54:36.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92f4962700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f00d0ab0 con 0x7f92f00cf7f0 2023-11-28T11:54:36.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92ee59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f92f006a4c0 0x7f92f00cf0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41596/0 (socket says 172.21.15.50:41596) 2023-11-28T11:54:36.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92ee59c700 1 -- 172.21.15.50:0/3026670448 learned_addr learned my addr 172.21.15.50:0/3026670448 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:36.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92ef59e700 1 --2- 172.21.15.50:0/3026670448 >> v2:172.21.15.192:3300/0 conn(0x7f92f00cf7f0 0x7f92f006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:36.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92edd9b700 1 -- 172.21.15.50:0/3026670448 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164151822 0 0) 0x7f92f006a9c0 con 0x7f92f006a4c0 2023-11-28T11:54:36.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92edd9b700 1 -- 172.21.15.50:0/3026670448 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92dc0035d0 con 0x7f92f006a4c0 2023-11-28T11:54:36.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92ef59e700 1 -- 172.21.15.50:0/3026670448 >> v1:172.21.15.192:6789/0 conn(0x7f92f00b1ae0 legacy=0x7f92f00d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92ef59e700 1 -- 172.21.15.50:0/3026670448 >> v1:172.21.15.50:6789/0 conn(0x7f92f006a4c0 legacy=0x7f92f00cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92edd9b700 1 -- 172.21.15.50:0/3026670448 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 282124582 0 0) 0x7f92dc0035d0 con 0x7f92f006a4c0 2023-11-28T11:54:36.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92ef59e700 1 -- 172.21.15.50:0/3026670448 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f006af80 con 0x7f92f00cf7f0 2023-11-28T11:54:36.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92ef59e700 1 --2- 172.21.15.50:0/3026670448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92f00cf7f0 0x7f92f006d8e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f92e8009d90 tx=0x7f92e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeb5864e6435be97 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:36.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92edd9b700 1 -- 172.21.15.50:0/3026670448 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e800e070 con 0x7f92f00cf7f0 2023-11-28T11:54:36.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92edd9b700 1 -- 172.21.15.50:0/3026670448 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e8003a40 con 0x7f92f00cf7f0 2023-11-28T11:54:36.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92edd9b700 1 -- 172.21.15.50:0/3026670448 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d8001670 con 0x7f92f00cf7f0 2023-11-28T11:54:36.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92f4962700 1 -- 172.21.15.50:0/3026670448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92f00cf7f0 msgr2=0x7f92f006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92f4962700 1 --2- 172.21.15.50:0/3026670448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92f00cf7f0 0x7f92f006d8e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f92e8009d90 tx=0x7f92e800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:36.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92f4962700 1 -- 172.21.15.50:0/3026670448 shutdown_connections 2023-11-28T11:54:36.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92f4962700 1 --2- 172.21.15.50:0/3026670448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92f00cf7f0 0x7f92f006d8e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92f4962700 1 -- 172.21.15.50:0/3026670448 >> 172.21.15.50:0/3026670448 conn(0x7f92f009bbd0 msgr2=0x7f92f00b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:36.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92f4962700 1 -- 172.21.15.50:0/3026670448 shutdown_connections 2023-11-28T11:54:36.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.604+0000 7f92f4962700 1 -- 172.21.15.50:0/3026670448 wait complete. 2023-11-28T11:54:36.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.608+0000 7f92f4962700 1 Processor -- start 2023-11-28T11:54:36.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.608+0000 7f92f4962700 1 -- start start 2023-11-28T11:54:36.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92f4962700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92f006a4c0 0x7f92f00c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:36.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92f4962700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92f00b1ae0 0x7f92f0150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:36.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92f4962700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f00cf7f0 0x7f92f00c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:36.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92f4962700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f00c70a0 con 0x7f92f00cf7f0 2023-11-28T11:54:36.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92f4962700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f00c7f80 con 0x7f92f00b1ae0 2023-11-28T11:54:36.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92f4962700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f00c8260 con 0x7f92f006a4c0 2023-11-28T11:54:36.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92ef59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f00cf7f0 0x7f92f00c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:36.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92ef59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f00cf7f0 0x7f92f00c6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60958/0 (socket says 172.21.15.50:60958) 2023-11-28T11:54:36.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92ef59e700 1 -- 172.21.15.50:0/3758071277 learned_addr learned my addr 172.21.15.50:0/3758071277 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:36.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92eed9d700 1 --2- 172.21.15.50:0/3758071277 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92f006a4c0 0x7f92f00c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:36.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92ee59c700 1 --2- 172.21.15.50:0/3758071277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92f00b1ae0 0x7f92f0150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:36.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92ef59e700 1 -- 172.21.15.50:0/3758071277 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92f006a4c0 msgr2=0x7f92f00c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92ef59e700 1 --2- 172.21.15.50:0/3758071277 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92f006a4c0 0x7f92f00c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92ef59e700 1 -- 172.21.15.50:0/3758071277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92f00b1ae0 msgr2=0x7f92f0150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92ef59e700 1 --2- 172.21.15.50:0/3758071277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92f00b1ae0 0x7f92f0150080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92ef59e700 1 -- 172.21.15.50:0/3758071277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e8009a70 con 0x7f92f00cf7f0 2023-11-28T11:54:36.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92ef59e700 1 --2- 172.21.15.50:0/3758071277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f00cf7f0 0x7f92f00c6b60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f92f0066b70 tx=0x7f92e8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:36.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92e77fe700 1 -- 172.21.15.50:0/3758071277 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e8004540 con 0x7f92f00cf7f0 2023-11-28T11:54:36.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92e77fe700 1 -- 172.21.15.50:0/3758071277 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e80046a0 con 0x7f92f00cf7f0 2023-11-28T11:54:36.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92f4962700 1 -- 172.21.15.50:0/3758071277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f00b1eb0 con 0x7f92f00cf7f0 2023-11-28T11:54:36.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92e77fe700 1 -- 172.21.15.50:0/3758071277 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e801d470 con 0x7f92f00cf7f0 2023-11-28T11:54:36.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92f4962700 1 -- 172.21.15.50:0/3758071277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f00b4380 con 0x7f92f00cf7f0 2023-11-28T11:54:36.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.612+0000 7f92f4962700 1 -- 172.21.15.50:0/3758071277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f00b60e0 con 0x7f92f00cf7f0 2023-11-28T11:54:36.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.616+0000 7f92e77fe700 1 -- 172.21.15.50:0/3758071277 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f92e8018070 con 0x7f92f00cf7f0 2023-11-28T11:54:36.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.616+0000 7f92e77fe700 1 --2- 172.21.15.50:0/3758071277 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f92d0064f10 0x7f92d00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:36.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.616+0000 7f92e77fe700 1 -- 172.21.15.50:0/3758071277 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f92e8083900 con 0x7f92f00cf7f0 2023-11-28T11:54:36.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.616+0000 7f92eed9d700 1 --2- 172.21.15.50:0/3758071277 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f92d0064f10 0x7f92d00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:36.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.616+0000 7f92eed9d700 1 --2- 172.21.15.50:0/3758071277 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f92d0064f10 0x7f92d00673c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92e0001800 tx=0x7f92e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:36.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.624+0000 7f92e77fe700 1 -- 172.21.15.50:0/3758071277 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f92e8051680 con 0x7f92f00cf7f0 2023-11-28T11:54:36.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.788+0000 7f92f4962700 1 -- 172.21.15.50:0/3758071277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f92f0072500 con 0x7f92f00cf7f0 2023-11-28T11:54:36.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.788+0000 7f92e77fe700 1 -- 172.21.15.50:0/3758071277 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f92e8054ca0 con 0x7f92f00cf7f0 2023-11-28T11:54:36.789 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:54:36.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.788+0000 7f92f4962700 1 -- 172.21.15.50:0/3758071277 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f92d0064f10 msgr2=0x7f92d00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.788+0000 7f92f4962700 1 --2- 172.21.15.50:0/3758071277 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f92d0064f10 0x7f92d00673c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92e0001800 tx=0x7f92e0009040 comp rx=0 tx=0).stop 2023-11-28T11:54:36.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.788+0000 7f92f4962700 1 -- 172.21.15.50:0/3758071277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f00cf7f0 msgr2=0x7f92f00c6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.788+0000 7f92f4962700 1 --2- 172.21.15.50:0/3758071277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f00cf7f0 0x7f92f00c6b60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f92f0066b70 tx=0x7f92e8004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.788+0000 7f92f4962700 1 -- 172.21.15.50:0/3758071277 shutdown_connections 2023-11-28T11:54:36.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.788+0000 7f92f4962700 1 --2- 172.21.15.50:0/3758071277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92f00cf7f0 0x7f92f00c6b60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.788+0000 7f92f4962700 1 --2- 172.21.15.50:0/3758071277 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f92d0064f10 0x7f92d00673c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.788+0000 7f92f4962700 1 --2- 172.21.15.50:0/3758071277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92f00b1ae0 0x7f92f0150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.788+0000 7f92f4962700 1 --2- 172.21.15.50:0/3758071277 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92f006a4c0 0x7f92f00c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.788+0000 7f92f4962700 1 -- 172.21.15.50:0/3758071277 >> 172.21.15.50:0/3758071277 conn(0x7f92f009bbd0 msgr2=0x7f92f00b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:36.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.788+0000 7f92f4962700 1 -- 172.21.15.50:0/3758071277 shutdown_connections 2023-11-28T11:54:36.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.792+0000 7f92f4962700 1 -- 172.21.15.50:0/3758071277 wait complete. 2023-11-28T11:54:36.804 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:54:36.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.928+0000 7f52fb59e700 1 Processor -- start 2023-11-28T11:54:36.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.928+0000 7f52fb59e700 1 -- start start 2023-11-28T11:54:36.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.928+0000 7f52fb59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f52fc0b1ae0 0x7f52fc06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:36.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.928+0000 7f52fb59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52fc06a4c0 0x7f52fc0d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:36.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.928+0000 7f52fb59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52fc06a9c0 con 0x7f52fc0cf0e0 2023-11-28T11:54:36.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.928+0000 7f52fb59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52fc06aca0 con 0x7f52fc06a4c0 2023-11-28T11:54:36.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.928+0000 7f52fb59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52fc06af80 con 0x7f52fc0b1ae0 2023-11-28T11:54:36.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.928+0000 7f52f9d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52fc06a4c0 0x7f52fc0d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:36.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.928+0000 7f52f9d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52fc06a4c0 0x7f52fc0d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60964/0 (socket says 172.21.15.50:60964) 2023-11-28T11:54:36.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.928+0000 7f52f9d9b700 1 -- 172.21.15.50:0/2083198020 learned_addr learned my addr 172.21.15.50:0/2083198020 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:36.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.932+0000 7f52fa59c700 1 --2- 172.21.15.50:0/2083198020 >> v2:172.21.15.192:3300/0 conn(0x7f52fc0b1ae0 0x7f52fc06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:36.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.932+0000 7f52f9d9b700 1 -- 172.21.15.50:0/2083198020 >> v2:172.21.15.192:3300/0 conn(0x7f52fc0b1ae0 msgr2=0x7f52fc06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:36.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.932+0000 7f52f9d9b700 1 --2- 172.21.15.50:0/2083198020 >> v2:172.21.15.192:3300/0 conn(0x7f52fc0b1ae0 0x7f52fc06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.932+0000 7f52f9d9b700 1 -- 172.21.15.50:0/2083198020 >> v1:172.21.15.192:6789/0 conn(0x7f52fc0cf0e0 legacy=0x7f52fc0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.932+0000 7f52f9d9b700 1 -- 172.21.15.50:0/2083198020 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc0b4380 con 0x7f52fc06a4c0 2023-11-28T11:54:36.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.932+0000 7f52f9d9b700 1 --2- 172.21.15.50:0/2083198020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52fc06a4c0 0x7f52fc0d03a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0b8870 tx=0x7f52ec009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd13d9c7d053fc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:36.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.932+0000 7f52f959a700 1 -- 172.21.15.50:0/2083198020 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00b8a0 con 0x7f52fc06a4c0 2023-11-28T11:54:36.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.932+0000 7f52f959a700 1 -- 172.21.15.50:0/2083198020 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec00ba00 con 0x7f52fc06a4c0 2023-11-28T11:54:36.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.932+0000 7f52f959a700 1 -- 172.21.15.50:0/2083198020 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00bd90 con 0x7f52fc06a4c0 2023-11-28T11:54:36.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.932+0000 7f52fb59e700 1 -- 172.21.15.50:0/2083198020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52fc06a4c0 msgr2=0x7f52fc0d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.932+0000 7f52fb59e700 1 --2- 172.21.15.50:0/2083198020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52fc06a4c0 0x7f52fc0d03a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0b8870 tx=0x7f52ec009bf0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.932+0000 7f52fb59e700 1 -- 172.21.15.50:0/2083198020 shutdown_connections 2023-11-28T11:54:36.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.932+0000 7f52fb59e700 1 --2- 172.21.15.50:0/2083198020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52fc06a4c0 0x7f52fc0d03a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.932+0000 7f52fb59e700 1 --2- 172.21.15.50:0/2083198020 >> v2:172.21.15.192:3300/0 conn(0x7f52fc0b1ae0 0x7f52fc06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.932+0000 7f52fb59e700 1 -- 172.21.15.50:0/2083198020 >> 172.21.15.50:0/2083198020 conn(0x7f52fc09bbd0 msgr2=0x7f52fc0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:36.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.932+0000 7f52fb59e700 1 -- 172.21.15.50:0/2083198020 shutdown_connections 2023-11-28T11:54:36.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.932+0000 7f52fb59e700 1 -- 172.21.15.50:0/2083198020 wait complete. 2023-11-28T11:54:36.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52fb59e700 1 Processor -- start 2023-11-28T11:54:36.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52fb59e700 1 -- start start 2023-11-28T11:54:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52fb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52fc06a4c0 0x7f52fc1e4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52fb59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52fc0b1ae0 0x7f52fc148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52fb59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52fc0cf0e0 0x7f52fc0c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:36.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52fb59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc1e5030 con 0x7f52fc06a4c0 2023-11-28T11:54:36.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52fb59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc15ba70 con 0x7f52fc0cf0e0 2023-11-28T11:54:36.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52fb59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc149180 con 0x7f52fc0b1ae0 2023-11-28T11:54:36.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52fa59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52fc06a4c0 0x7f52fc1e4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:36.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52fa59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52fc06a4c0 0x7f52fc1e4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60968/0 (socket says 172.21.15.50:60968) 2023-11-28T11:54:36.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52fa59c700 1 -- 172.21.15.50:0/1737138223 learned_addr learned my addr 172.21.15.50:0/1737138223 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:36.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52f9d9b700 1 --2- 172.21.15.50:0/1737138223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52fc0b1ae0 0x7f52fc148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:36.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52fad9d700 1 --2- 172.21.15.50:0/1737138223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52fc0cf0e0 0x7f52fc0c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:36.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52f9d9b700 1 -- 172.21.15.50:0/1737138223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52fc0cf0e0 msgr2=0x7f52fc0c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52f9d9b700 1 --2- 172.21.15.50:0/1737138223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52fc0cf0e0 0x7f52fc0c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52f9d9b700 1 -- 172.21.15.50:0/1737138223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52fc06a4c0 msgr2=0x7f52fc1e4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:36.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52f9d9b700 1 --2- 172.21.15.50:0/1737138223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52fc06a4c0 0x7f52fc1e4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:36.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52f9d9b700 1 -- 172.21.15.50:0/1737138223 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec009570 con 0x7f52fc0b1ae0 2023-11-28T11:54:36.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52f9d9b700 1 --2- 172.21.15.50:0/1737138223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52fc0b1ae0 0x7f52fc148c40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52ec016000 tx=0x7f52ec004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:36.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52f2ffd700 1 -- 172.21.15.50:0/1737138223 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0038c0 con 0x7f52fc0b1ae0 2023-11-28T11:54:36.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52f2ffd700 1 -- 172.21.15.50:0/1737138223 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec01e070 con 0x7f52fc0b1ae0 2023-11-28T11:54:36.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52fb59e700 1 -- 172.21.15.50:0/1737138223 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52fc0b60e0 con 0x7f52fc0b1ae0 2023-11-28T11:54:36.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52f2ffd700 1 -- 172.21.15.50:0/1737138223 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec003c80 con 0x7f52fc0b1ae0 2023-11-28T11:54:36.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.936+0000 7f52fb59e700 1 -- 172.21.15.50:0/1737138223 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52fc0b1eb0 con 0x7f52fc0b1ae0 2023-11-28T11:54:36.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.940+0000 7f52fb59e700 1 -- 172.21.15.50:0/1737138223 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52fc1e52f0 con 0x7f52fc0b1ae0 2023-11-28T11:54:36.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.940+0000 7f52f2ffd700 1 -- 172.21.15.50:0/1737138223 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f52ec00f050 con 0x7f52fc0b1ae0 2023-11-28T11:54:36.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.940+0000 7f52f2ffd700 1 --2- 172.21.15.50:0/1737138223 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f52dc064ee0 0x7f52dc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:36.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.940+0000 7f52f2ffd700 1 -- 172.21.15.50:0/1737138223 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f52ec020070 con 0x7f52fc0b1ae0 2023-11-28T11:54:36.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.940+0000 7f52fa59c700 1 --2- 172.21.15.50:0/1737138223 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f52dc064ee0 0x7f52dc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:36.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.944+0000 7f52fa59c700 1 --2- 172.21.15.50:0/1737138223 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f52dc064ee0 0x7f52dc067390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f52e4007b10 tx=0x7f52e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:36.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:36.948+0000 7f52f2ffd700 1 -- 172.21.15.50:0/1737138223 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f52ec0516e0 con 0x7f52fc0b1ae0 2023-11-28T11:54:37.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.116+0000 7f52fb59e700 1 -- 172.21.15.50:0/1737138223 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f52fc0d2e10 con 0x7f52fc0b1ae0 2023-11-28T11:54:37.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.124+0000 7f52f2ffd700 1 -- 172.21.15.50:0/1737138223 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f52ec054d00 con 0x7f52fc0b1ae0 2023-11-28T11:54:37.126 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:37.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.128+0000 7f52fb59e700 1 -- 172.21.15.50:0/1737138223 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f52dc064ee0 msgr2=0x7f52dc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.128+0000 7f52fb59e700 1 --2- 172.21.15.50:0/1737138223 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f52dc064ee0 0x7f52dc067390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f52e4007b10 tx=0x7f52e4008040 comp rx=0 tx=0).stop 2023-11-28T11:54:37.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.128+0000 7f52fb59e700 1 -- 172.21.15.50:0/1737138223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52fc0b1ae0 msgr2=0x7f52fc148c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.128+0000 7f52fb59e700 1 --2- 172.21.15.50:0/1737138223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52fc0b1ae0 0x7f52fc148c40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52ec016000 tx=0x7f52ec004770 comp rx=0 tx=0).stop 2023-11-28T11:54:37.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.128+0000 7f52fb59e700 1 -- 172.21.15.50:0/1737138223 shutdown_connections 2023-11-28T11:54:37.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.128+0000 7f52fb59e700 1 --2- 172.21.15.50:0/1737138223 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f52dc064ee0 0x7f52dc067390 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.128+0000 7f52fb59e700 1 --2- 172.21.15.50:0/1737138223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52fc0cf0e0 0x7f52fc0c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.128+0000 7f52fb59e700 1 --2- 172.21.15.50:0/1737138223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52fc0b1ae0 0x7f52fc148c40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.128+0000 7f52fb59e700 1 --2- 172.21.15.50:0/1737138223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52fc06a4c0 0x7f52fc1e4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.128+0000 7f52fb59e700 1 -- 172.21.15.50:0/1737138223 >> 172.21.15.50:0/1737138223 conn(0x7f52fc09bbd0 msgr2=0x7f52fc15bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:37.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.128+0000 7f52fb59e700 1 -- 172.21.15.50:0/1737138223 shutdown_connections 2023-11-28T11:54:37.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.128+0000 7f52fb59e700 1 -- 172.21.15.50:0/1737138223 wait complete. 2023-11-28T11:54:37.147 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:54:37.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.260+0000 7fb1e07b6700 1 Processor -- start 2023-11-28T11:54:37.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.260+0000 7fb1e07b6700 1 -- start start 2023-11-28T11:54:37.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.264+0000 7fb1e07b6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb1d806aee0 0x7fb1d80b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:37.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.264+0000 7fb1e07b6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d80b1be0 con 0x7fb1d815a140 2023-11-28T11:54:37.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.264+0000 7fb1e07b6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d806b330 con 0x7fb1d80b17a0 2023-11-28T11:54:37.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.264+0000 7fb1e07b6700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d815a510 con 0x7fb1d806aee0 2023-11-28T11:54:37.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.264+0000 7fb1ddd51700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb1d806aee0 0x7fb1d80b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:37.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.264+0000 7fb1de552700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb1d815a140 0x7fb1d815e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41612/0 (socket says 172.21.15.50:41612) 2023-11-28T11:54:37.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.264+0000 7fb1ddd51700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb1d806aee0 0x7fb1d80b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60984/0 (socket says 172.21.15.50:60984) 2023-11-28T11:54:37.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.264+0000 7fb1de552700 1 -- 172.21.15.50:0/3835720139 learned_addr learned my addr 172.21.15.50:0/3835720139 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:37.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.264+0000 7fb1ddd51700 1 -- 172.21.15.50:0/3835720139 >> v1:172.21.15.192:6789/0 conn(0x7fb1d80b17a0 legacy=0x7fb1d80caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.264+0000 7fb1ddd51700 1 -- 172.21.15.50:0/3835720139 >> v1:172.21.15.50:6789/0 conn(0x7fb1d815a140 legacy=0x7fb1d815e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.264+0000 7fb1ddd51700 1 -- 172.21.15.50:0/3835720139 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d806cce0 con 0x7fb1d806aee0 2023-11-28T11:54:37.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.264+0000 7fb1ddd51700 1 --2- 172.21.15.50:0/3835720139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1d806aee0 0x7fb1d80b1260 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8009850 tx=0x7fb1c8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb447fa70f231ebc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:37.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.264+0000 7fb1dd550700 1 -- 172.21.15.50:0/3835720139 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8011830 con 0x7fb1d806aee0 2023-11-28T11:54:37.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.264+0000 7fb1dd550700 1 -- 172.21.15.50:0/3835720139 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c8011990 con 0x7fb1d806aee0 2023-11-28T11:54:37.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.264+0000 7fb1dd550700 1 -- 172.21.15.50:0/3835720139 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8011d20 con 0x7fb1d806aee0 2023-11-28T11:54:37.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.268+0000 7fb1e07b6700 1 -- 172.21.15.50:0/3835720139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1d806aee0 msgr2=0x7fb1d80b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.268+0000 7fb1e07b6700 1 --2- 172.21.15.50:0/3835720139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1d806aee0 0x7fb1d80b1260 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8009850 tx=0x7fb1c8009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:37.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.268+0000 7fb1e07b6700 1 -- 172.21.15.50:0/3835720139 shutdown_connections 2023-11-28T11:54:37.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.268+0000 7fb1e07b6700 1 --2- 172.21.15.50:0/3835720139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1d806aee0 0x7fb1d80b1260 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.268+0000 7fb1e07b6700 1 -- 172.21.15.50:0/3835720139 >> 172.21.15.50:0/3835720139 conn(0x7fb1d80cc260 msgr2=0x7fb1d80cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:37.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.268+0000 7fb1e07b6700 1 -- 172.21.15.50:0/3835720139 shutdown_connections 2023-11-28T11:54:37.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.268+0000 7fb1e07b6700 1 -- 172.21.15.50:0/3835720139 wait complete. 2023-11-28T11:54:37.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.268+0000 7fb1e07b6700 1 Processor -- start 2023-11-28T11:54:37.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.268+0000 7fb1e07b6700 1 -- start start 2023-11-28T11:54:37.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.268+0000 7fb1e07b6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1d806aee0 0x7fb1d814a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:37.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.268+0000 7fb1e07b6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1d80b17a0 0x7fb1d81e31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:37.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.268+0000 7fb1e07b6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1d815a140 0x7fb1d80c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:37.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.268+0000 7fb1e07b6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80c3cc0 con 0x7fb1d815a140 2023-11-28T11:54:37.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.268+0000 7fb1e07b6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80c3390 con 0x7fb1d806aee0 2023-11-28T11:54:37.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.268+0000 7fb1e07b6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80c3670 con 0x7fb1d80b17a0 2023-11-28T11:54:37.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1ded53700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1d815a140 0x7fb1d80c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:37.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1ded53700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1d815a140 0x7fb1d80c4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60996/0 (socket says 172.21.15.50:60996) 2023-11-28T11:54:37.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1de552700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1d806aee0 0x7fb1d814a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:37.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1ded53700 1 -- 172.21.15.50:0/407668383 learned_addr learned my addr 172.21.15.50:0/407668383 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:37.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1ddd51700 1 --2- 172.21.15.50:0/407668383 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1d80b17a0 0x7fb1d81e31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:37.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1ded53700 1 -- 172.21.15.50:0/407668383 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1d80b17a0 msgr2=0x7fb1d81e31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1ded53700 1 --2- 172.21.15.50:0/407668383 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1d80b17a0 0x7fb1d81e31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1ded53700 1 -- 172.21.15.50:0/407668383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1d806aee0 msgr2=0x7fb1d814a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1ded53700 1 --2- 172.21.15.50:0/407668383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1d806aee0 0x7fb1d814a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1ded53700 1 -- 172.21.15.50:0/407668383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c80094b0 con 0x7fb1d815a140 2023-11-28T11:54:37.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1ded53700 1 --2- 172.21.15.50:0/407668383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1d815a140 0x7fb1d80c4150 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000cc50 tx=0x7fb1d000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:37.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1ceffd700 1 -- 172.21.15.50:0/407668383 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0003c20 con 0x7fb1d815a140 2023-11-28T11:54:37.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1ceffd700 1 -- 172.21.15.50:0/407668383 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d0003d80 con 0x7fb1d815a140 2023-11-28T11:54:37.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1e07b6700 1 -- 172.21.15.50:0/407668383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d80ca560 con 0x7fb1d815a140 2023-11-28T11:54:37.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1ceffd700 1 -- 172.21.15.50:0/407668383 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d000aab0 con 0x7fb1d815a140 2023-11-28T11:54:37.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1e07b6700 1 -- 172.21.15.50:0/407668383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d806cfc0 con 0x7fb1d815a140 2023-11-28T11:54:37.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1e07b6700 1 -- 172.21.15.50:0/407668383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d806c990 con 0x7fb1d815a140 2023-11-28T11:54:37.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1ceffd700 1 -- 172.21.15.50:0/407668383 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb1d0010050 con 0x7fb1d815a140 2023-11-28T11:54:37.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.272+0000 7fb1ceffd700 1 --2- 172.21.15.50:0/407668383 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb1bc064f10 0x7fb1bc0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:37.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.276+0000 7fb1ceffd700 1 -- 172.21.15.50:0/407668383 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb1d0082080 con 0x7fb1d815a140 2023-11-28T11:54:37.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.276+0000 7fb1de552700 1 --2- 172.21.15.50:0/407668383 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb1bc064f10 0x7fb1bc0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:37.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.276+0000 7fb1de552700 1 --2- 172.21.15.50:0/407668383 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb1bc064f10 0x7fb1bc0673c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4005930 tx=0x7fb1d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:37.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.280+0000 7fb1ceffd700 1 -- 172.21.15.50:0/407668383 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb1d004fe70 con 0x7fb1d815a140 2023-11-28T11:54:37.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.456+0000 7fb1e07b6700 1 -- 172.21.15.50:0/407668383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb1d8072810 con 0x7fb1d815a140 2023-11-28T11:54:37.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.456+0000 7fb1ceffd700 1 -- 172.21.15.50:0/407668383 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb1d0053490 con 0x7fb1d815a140 2023-11-28T11:54:37.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.460+0000 7fb1e07b6700 1 -- 172.21.15.50:0/407668383 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb1bc064f10 msgr2=0x7fb1bc0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.460+0000 7fb1e07b6700 1 --2- 172.21.15.50:0/407668383 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb1bc064f10 0x7fb1bc0673c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4005930 tx=0x7fb1d4009040 comp rx=0 tx=0).stop 2023-11-28T11:54:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.460+0000 7fb1e07b6700 1 -- 172.21.15.50:0/407668383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1d815a140 msgr2=0x7fb1d80c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.460+0000 7fb1e07b6700 1 --2- 172.21.15.50:0/407668383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1d815a140 0x7fb1d80c4150 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000cc50 tx=0x7fb1d000cf60 comp rx=0 tx=0).stop 2023-11-28T11:54:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.460+0000 7fb1e07b6700 1 -- 172.21.15.50:0/407668383 shutdown_connections 2023-11-28T11:54:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.460+0000 7fb1e07b6700 1 --2- 172.21.15.50:0/407668383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1d815a140 0x7fb1d80c4150 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.460+0000 7fb1e07b6700 1 --2- 172.21.15.50:0/407668383 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1d80b17a0 0x7fb1d81e31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.460+0000 7fb1e07b6700 1 --2- 172.21.15.50:0/407668383 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb1bc064f10 0x7fb1bc0673c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.460+0000 7fb1e07b6700 1 --2- 172.21.15.50:0/407668383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1d806aee0 0x7fb1d814a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.460+0000 7fb1e07b6700 1 -- 172.21.15.50:0/407668383 >> 172.21.15.50:0/407668383 conn(0x7fb1d80cc260 msgr2=0x7fb1d80cb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.460+0000 7fb1e07b6700 1 -- 172.21.15.50:0/407668383 shutdown_connections 2023-11-28T11:54:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.460+0000 7fb1e07b6700 1 -- 172.21.15.50:0/407668383 wait complete. 2023-11-28T11:54:37.463 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-11-28T11:54:37.475 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:54:37.475 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:54:37.483 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc80d783700 1 Processor -- start 2023-11-28T11:54:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc80d783700 1 -- start start 2023-11-28T11:54:37.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc80d783700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8081510d0 0x7fc80815b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:37.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc80d783700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc8080c98a0 0x7fc8080c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:37.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc80d783700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8080ca200 con 0x7fc808069c40 2023-11-28T11:54:37.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc80d783700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8080c95d0 con 0x7fc8081510d0 2023-11-28T11:54:37.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc80d783700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8080c8e00 con 0x7fc8080c98a0 2023-11-28T11:54:37.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc806ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8081510d0 0x7fc80815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:37.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc806ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8081510d0 0x7fc80815b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32780/0 (socket says 172.21.15.50:32780) 2023-11-28T11:54:37.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc806ffd700 1 -- 172.21.15.50:0/2106936910 learned_addr learned my addr 172.21.15.50:0/2106936910 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:37.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc8077fe700 1 --2- 172.21.15.50:0/2106936910 >> v2:172.21.15.192:3300/0 conn(0x7fc8080c98a0 0x7fc8080c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:37.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc806ffd700 1 -- 172.21.15.50:0/2106936910 >> v2:172.21.15.192:3300/0 conn(0x7fc8080c98a0 msgr2=0x7fc8080c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:37.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc806ffd700 1 --2- 172.21.15.50:0/2106936910 >> v2:172.21.15.192:3300/0 conn(0x7fc8080c98a0 0x7fc8080c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc806ffd700 1 -- 172.21.15.50:0/2106936910 >> v1:172.21.15.192:6789/0 conn(0x7fc808069c40 legacy=0x7fc8080b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:37.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc806ffd700 1 -- 172.21.15.50:0/2106936910 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8080c9010 con 0x7fc8081510d0 2023-11-28T11:54:37.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc8077fe700 1 --2- 172.21.15.50:0/2106936910 >> v2:172.21.15.192:3300/0 conn(0x7fc8080c98a0 0x7fc8080c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:54:37.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc806ffd700 1 --2- 172.21.15.50:0/2106936910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8081510d0 0x7fc80815b260 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc80815dbc0 tx=0x7fc7f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445ba71d29037219 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc805ffb700 1 -- 172.21.15.50:0/2106936910 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f800e070 con 0x7fc8081510d0 2023-11-28T11:54:37.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc805ffb700 1 -- 172.21.15.50:0/2106936910 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f8003a40 con 0x7fc8081510d0 2023-11-28T11:54:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc805ffb700 1 -- 172.21.15.50:0/2106936910 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8003df0 con 0x7fc8081510d0 2023-11-28T11:54:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc80d783700 1 -- 172.21.15.50:0/2106936910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8081510d0 msgr2=0x7fc80815b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc80d783700 1 --2- 172.21.15.50:0/2106936910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8081510d0 0x7fc80815b260 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc80815dbc0 tx=0x7fc7f800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc80d783700 1 -- 172.21.15.50:0/2106936910 shutdown_connections 2023-11-28T11:54:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc80d783700 1 --2- 172.21.15.50:0/2106936910 >> v2:172.21.15.192:3300/0 conn(0x7fc8080c98a0 0x7fc8080c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc80d783700 1 --2- 172.21.15.50:0/2106936910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8081510d0 0x7fc80815b260 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc80d783700 1 -- 172.21.15.50:0/2106936910 >> 172.21.15.50:0/2106936910 conn(0x7fc80806caf0 msgr2=0x7fc8080ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc80d783700 1 -- 172.21.15.50:0/2106936910 shutdown_connections 2023-11-28T11:54:37.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.596+0000 7fc80d783700 1 -- 172.21.15.50:0/2106936910 wait complete. 2023-11-28T11:54:37.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc80d783700 1 Processor -- start 2023-11-28T11:54:37.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc80d783700 1 -- start start 2023-11-28T11:54:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc80d783700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc808069c40 0x7fc80814f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc80d783700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8080c98a0 0x7fc808152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc80d783700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8081510d0 0x7fc8080b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc80d783700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080c5880 con 0x7fc808069c40 2023-11-28T11:54:37.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc80d783700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080cddb0 con 0x7fc8080c98a0 2023-11-28T11:54:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc80d783700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080c5ad0 con 0x7fc8081510d0 2023-11-28T11:54:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc806ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc808069c40 0x7fc80814f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc806ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc808069c40 0x7fc80814f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32782/0 (socket says 172.21.15.50:32782) 2023-11-28T11:54:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc806ffd700 1 -- 172.21.15.50:0/2987317027 learned_addr learned my addr 172.21.15.50:0/2987317027 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc8067fc700 1 --2- 172.21.15.50:0/2987317027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8080c98a0 0x7fc808152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc806ffd700 1 -- 172.21.15.50:0/2987317027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8081510d0 msgr2=0x7fc8080b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc806ffd700 1 --2- 172.21.15.50:0/2987317027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8081510d0 0x7fc8080b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc806ffd700 1 -- 172.21.15.50:0/2987317027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8080c98a0 msgr2=0x7fc808152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc806ffd700 1 --2- 172.21.15.50:0/2987317027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8080c98a0 0x7fc808152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc806ffd700 1 -- 172.21.15.50:0/2987317027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f8009b30 con 0x7fc808069c40 2023-11-28T11:54:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc806ffd700 1 --2- 172.21.15.50:0/2987317027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc808069c40 0x7fc80814f590 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8000f80 tx=0x7fc7f8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc7ef7fe700 1 -- 172.21.15.50:0/2987317027 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8004440 con 0x7fc808069c40 2023-11-28T11:54:37.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc7ef7fe700 1 -- 172.21.15.50:0/2987317027 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f80045c0 con 0x7fc808069c40 2023-11-28T11:54:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc80d783700 1 -- 172.21.15.50:0/2987317027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc808070170 con 0x7fc808069c40 2023-11-28T11:54:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc7ef7fe700 1 -- 172.21.15.50:0/2987317027 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8004970 con 0x7fc808069c40 2023-11-28T11:54:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.600+0000 7fc80d783700 1 -- 172.21.15.50:0/2987317027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8080c92f0 con 0x7fc808069c40 2023-11-28T11:54:37.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.604+0000 7fc80d783700 1 -- 172.21.15.50:0/2987317027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8081514a0 con 0x7fc808069c40 2023-11-28T11:54:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.604+0000 7fc7ef7fe700 1 -- 172.21.15.50:0/2987317027 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc7f8022030 con 0x7fc808069c40 2023-11-28T11:54:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.604+0000 7fc7ef7fe700 1 --2- 172.21.15.50:0/2987317027 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc7f4064ee0 0x7fc7f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.604+0000 7fc7ef7fe700 1 -- 172.21.15.50:0/2987317027 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc7f80836a0 con 0x7fc808069c40 2023-11-28T11:54:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.604+0000 7fc8067fc700 1 --2- 172.21.15.50:0/2987317027 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc7f4064ee0 0x7fc7f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:37.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.604+0000 7fc8067fc700 1 --2- 172.21.15.50:0/2987317027 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc7f4064ee0 0x7fc7f4067390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc8081507e0 tx=0x7fc7fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:37.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.608+0000 7fc7ef7fe700 1 -- 172.21.15.50:0/2987317027 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc7f8051490 con 0x7fc808069c40 2023-11-28T11:54:37.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.768+0000 7fc80d783700 1 -- 172.21.15.50:0/2987317027 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc808072500 con 0x7fc808069c40 2023-11-28T11:54:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.772+0000 7fc7ef7fe700 1 -- 172.21.15.50:0/2987317027 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19689 (secure 0 0 0) 0x7fc7f8054ab0 con 0x7fc808069c40 2023-11-28T11:54:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:37.774 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:54:30.086945+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:37.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.776+0000 7fc80d783700 1 -- 172.21.15.50:0/2987317027 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc7f4064ee0 msgr2=0x7fc7f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.776+0000 7fc80d783700 1 --2- 172.21.15.50:0/2987317027 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc7f4064ee0 0x7fc7f4067390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc8081507e0 tx=0x7fc7fc008040 comp rx=0 tx=0).stop 2023-11-28T11:54:37.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.776+0000 7fc80d783700 1 -- 172.21.15.50:0/2987317027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc808069c40 msgr2=0x7fc80814f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.776+0000 7fc80d783700 1 --2- 172.21.15.50:0/2987317027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc808069c40 0x7fc80814f590 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8000f80 tx=0x7fc7f8004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.776+0000 7fc80d783700 1 -- 172.21.15.50:0/2987317027 shutdown_connections 2023-11-28T11:54:37.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.776+0000 7fc80d783700 1 --2- 172.21.15.50:0/2987317027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8081510d0 0x7fc8080b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.776+0000 7fc80d783700 1 --2- 172.21.15.50:0/2987317027 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc7f4064ee0 0x7fc7f4067390 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.776+0000 7fc80d783700 1 --2- 172.21.15.50:0/2987317027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8080c98a0 0x7fc808152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.776+0000 7fc80d783700 1 --2- 172.21.15.50:0/2987317027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc808069c40 0x7fc80814f590 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.776+0000 7fc80d783700 1 -- 172.21.15.50:0/2987317027 >> 172.21.15.50:0/2987317027 conn(0x7fc80806caf0 msgr2=0x7fc80806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:37.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.776+0000 7fc80d783700 1 -- 172.21.15.50:0/2987317027 shutdown_connections 2023-11-28T11:54:37.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.776+0000 7fc80d783700 1 -- 172.21.15.50:0/2987317027 wait complete. 2023-11-28T11:54:37.790 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:53:38.462826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:53:39.778621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:53:42.870360+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:54:37.791 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:54:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74baf35700 1 Processor -- start 2023-11-28T11:54:37.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74baf35700 1 -- start start 2023-11-28T11:54:37.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74baf35700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f74b406a4c0 0x7f74b406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:37.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74baf35700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b40cf0e0 0x7f74b40cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:37.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74baf35700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b40cfa80 con 0x7f74b40b1ae0 2023-11-28T11:54:37.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74baf35700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b40d0ab0 con 0x7f74b406a4c0 2023-11-28T11:54:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74baf35700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b406a9c0 con 0x7f74b40cf0e0 2023-11-28T11:54:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74b9f33700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f74b40b1ae0 0x7f74b40d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41616/0 (socket says 172.21.15.50:41616) 2023-11-28T11:54:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74b9f33700 1 -- 172.21.15.50:0/1124895268 learned_addr learned my addr 172.21.15.50:0/1124895268 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74b9732700 1 --2- 172.21.15.50:0/1124895268 >> v2:172.21.15.50:3300/0 conn(0x7f74b406a4c0 0x7f74b406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74ba734700 1 --2- 172.21.15.50:0/1124895268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b40cf0e0 0x7f74b40cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74b8f31700 1 -- 172.21.15.50:0/1124895268 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031387867 0 0) 0x7f74b40cfa80 con 0x7f74b40b1ae0 2023-11-28T11:54:37.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74b8f31700 1 -- 172.21.15.50:0/1124895268 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74a00035d0 con 0x7f74b40b1ae0 2023-11-28T11:54:37.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74b9732700 1 -- 172.21.15.50:0/1124895268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b40cf0e0 msgr2=0x7f74b40cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:37.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74b9732700 1 --2- 172.21.15.50:0/1124895268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b40cf0e0 0x7f74b40cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74b9732700 1 -- 172.21.15.50:0/1124895268 >> v1:172.21.15.50:6789/0 conn(0x7f74b40b1ae0 legacy=0x7f74b40d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74b9732700 1 -- 172.21.15.50:0/1124895268 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b406aca0 con 0x7f74b406a4c0 2023-11-28T11:54:37.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74b9732700 1 --2- 172.21.15.50:0/1124895268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74b406a4c0 0x7f74b406d8e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009850 tx=0x7f74a4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e127cb7472a6474 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:37.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74b8f31700 1 -- 172.21.15.50:0/1124895268 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4011830 con 0x7f74b406a4c0 2023-11-28T11:54:37.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74b8f31700 1 -- 172.21.15.50:0/1124895268 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a4011990 con 0x7f74b406a4c0 2023-11-28T11:54:37.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.908+0000 7f74b8f31700 1 -- 172.21.15.50:0/1124895268 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4011d40 con 0x7f74b406a4c0 2023-11-28T11:54:37.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.912+0000 7f74baf35700 1 -- 172.21.15.50:0/1124895268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74b406a4c0 msgr2=0x7f74b406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.912+0000 7f74baf35700 1 --2- 172.21.15.50:0/1124895268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74b406a4c0 0x7f74b406d8e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009850 tx=0x7f74a4009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:37.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.912+0000 7f74baf35700 1 -- 172.21.15.50:0/1124895268 shutdown_connections 2023-11-28T11:54:37.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.912+0000 7f74baf35700 1 --2- 172.21.15.50:0/1124895268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b40cf0e0 0x7f74b40cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.912+0000 7f74baf35700 1 --2- 172.21.15.50:0/1124895268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74b406a4c0 0x7f74b406d8e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.912+0000 7f74baf35700 1 -- 172.21.15.50:0/1124895268 >> 172.21.15.50:0/1124895268 conn(0x7f74b409bbd0 msgr2=0x7f74b40b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:37.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.912+0000 7f74baf35700 1 -- 172.21.15.50:0/1124895268 shutdown_connections 2023-11-28T11:54:37.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.912+0000 7f74baf35700 1 -- 172.21.15.50:0/1124895268 wait complete. 2023-11-28T11:54:37.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.912+0000 7f74baf35700 1 Processor -- start 2023-11-28T11:54:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.912+0000 7f74baf35700 1 -- start start 2023-11-28T11:54:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.912+0000 7f74baf35700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b406a4c0 0x7f74b409ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.912+0000 7f74baf35700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b40b1ae0 0x7f74b41f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.912+0000 7f74baf35700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74b40cf0e0 0x7f74b4159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.912+0000 7f74baf35700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b41f6260 con 0x7f74b40cf0e0 2023-11-28T11:54:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.912+0000 7f74baf35700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b4159890 con 0x7f74b406a4c0 2023-11-28T11:54:37.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.912+0000 7f74baf35700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b409d490 con 0x7f74b40b1ae0 2023-11-28T11:54:37.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.912+0000 7f74ba734700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74b40cf0e0 0x7f74b4159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:37.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.916+0000 7f74ba734700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74b40cf0e0 0x7f74b4159d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32800/0 (socket says 172.21.15.50:32800) 2023-11-28T11:54:37.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.916+0000 7f74ba734700 1 -- 172.21.15.50:0/1936166125 learned_addr learned my addr 172.21.15.50:0/1936166125 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:37.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.916+0000 7f74b9732700 1 --2- 172.21.15.50:0/1936166125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b40b1ae0 0x7f74b41f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.916+0000 7f74b9f33700 1 --2- 172.21.15.50:0/1936166125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b406a4c0 0x7f74b409ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.916+0000 7f74ba734700 1 -- 172.21.15.50:0/1936166125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b40b1ae0 msgr2=0x7f74b41f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.916+0000 7f74ba734700 1 --2- 172.21.15.50:0/1936166125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b40b1ae0 0x7f74b41f5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.916+0000 7f74ba734700 1 -- 172.21.15.50:0/1936166125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b406a4c0 msgr2=0x7f74b409ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.916+0000 7f74ba734700 1 --2- 172.21.15.50:0/1936166125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b406a4c0 0x7f74b409ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.916+0000 7f74ba734700 1 -- 172.21.15.50:0/1936166125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40094b0 con 0x7f74b40cf0e0 2023-11-28T11:54:37.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.916+0000 7f74b9f33700 1 --2- 172.21.15.50:0/1936166125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b406a4c0 0x7f74b409ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:37.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.916+0000 7f74ba734700 1 --2- 172.21.15.50:0/1936166125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74b40cf0e0 0x7f74b4159d20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f74ac007e40 tx=0x7f74ac00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:37.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.916+0000 7f74aa7fc700 1 -- 172.21.15.50:0/1936166125 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac00ede0 con 0x7f74b40cf0e0 2023-11-28T11:54:37.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.916+0000 7f74baf35700 1 -- 172.21.15.50:0/1936166125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b40b4380 con 0x7f74b40cf0e0 2023-11-28T11:54:37.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.916+0000 7f74aa7fc700 1 -- 172.21.15.50:0/1936166125 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac014420 con 0x7f74b40cf0e0 2023-11-28T11:54:37.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.916+0000 7f74baf35700 1 -- 172.21.15.50:0/1936166125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b406af80 con 0x7f74b40cf0e0 2023-11-28T11:54:37.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.916+0000 7f74aa7fc700 1 -- 172.21.15.50:0/1936166125 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0147d0 con 0x7f74b40cf0e0 2023-11-28T11:54:37.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.916+0000 7f74baf35700 1 -- 172.21.15.50:0/1936166125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b40b1eb0 con 0x7f74b40cf0e0 2023-11-28T11:54:37.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.920+0000 7f74aa7fc700 1 -- 172.21.15.50:0/1936166125 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f74ac012050 con 0x7f74b40cf0e0 2023-11-28T11:54:37.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.920+0000 7f74aa7fc700 1 --2- 172.21.15.50:0/1936166125 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7498064ee0 0x7f7498067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:37.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.920+0000 7f74aa7fc700 1 -- 172.21.15.50:0/1936166125 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f74ac0836d0 con 0x7f74b40cf0e0 2023-11-28T11:54:37.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.920+0000 7f74b9f33700 1 --2- 172.21.15.50:0/1936166125 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7498064ee0 0x7f7498067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:37.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.920+0000 7f74b9f33700 1 --2- 172.21.15.50:0/1936166125 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7498064ee0 0x7f7498067390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f74b00011e0 tx=0x7f74b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:37.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:37.924+0000 7f74aa7fc700 1 -- 172.21.15.50:0/1936166125 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f74ac051540 con 0x7f74b40cf0e0 2023-11-28T11:54:38.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.088+0000 7f74baf35700 1 -- 172.21.15.50:0/1936166125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f74b41590a0 con 0x7f74b40cf0e0 2023-11-28T11:54:38.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.088+0000 7f74aa7fc700 1 -- 172.21.15.50:0/1936166125 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f74b41590a0 con 0x7f74b40cf0e0 2023-11-28T11:54:38.089 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:54:38.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.088+0000 7f74baf35700 1 -- 172.21.15.50:0/1936166125 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7498064ee0 msgr2=0x7f7498067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.088+0000 7f74baf35700 1 --2- 172.21.15.50:0/1936166125 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7498064ee0 0x7f7498067390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f74b00011e0 tx=0x7f74b0009040 comp rx=0 tx=0).stop 2023-11-28T11:54:38.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.088+0000 7f74baf35700 1 -- 172.21.15.50:0/1936166125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74b40cf0e0 msgr2=0x7f74b4159d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.088+0000 7f74baf35700 1 --2- 172.21.15.50:0/1936166125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74b40cf0e0 0x7f74b4159d20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f74ac007e40 tx=0x7f74ac00e3c0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.088+0000 7f74baf35700 1 -- 172.21.15.50:0/1936166125 shutdown_connections 2023-11-28T11:54:38.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.088+0000 7f74baf35700 1 --2- 172.21.15.50:0/1936166125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74b40cf0e0 0x7f74b4159d20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.088+0000 7f74baf35700 1 --2- 172.21.15.50:0/1936166125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b40b1ae0 0x7f74b41f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.088+0000 7f74baf35700 1 --2- 172.21.15.50:0/1936166125 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7498064ee0 0x7f7498067390 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.088+0000 7f74baf35700 1 --2- 172.21.15.50:0/1936166125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b406a4c0 0x7f74b409ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.088+0000 7f74baf35700 1 -- 172.21.15.50:0/1936166125 >> 172.21.15.50:0/1936166125 conn(0x7f74b409bbd0 msgr2=0x7f74b415bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:38.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.088+0000 7f74baf35700 1 -- 172.21.15.50:0/1936166125 shutdown_connections 2023-11-28T11:54:38.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.088+0000 7f74baf35700 1 -- 172.21.15.50:0/1936166125 wait complete. 2023-11-28T11:54:38.104 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:54:38.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.224+0000 7effdce48700 1 Processor -- start 2023-11-28T11:54:38.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.224+0000 7effdce48700 1 -- start start 2023-11-28T11:54:38.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.224+0000 7effdce48700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7effd80b1ae0 0x7effd806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:38.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.224+0000 7effdce48700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd80cf0e0 0x7effd80cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:38.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.224+0000 7effdce48700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd80cfa80 con 0x7effd806a4c0 2023-11-28T11:54:38.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.224+0000 7effdce48700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd80d0ab0 con 0x7effd80b1ae0 2023-11-28T11:54:38.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.224+0000 7effdce48700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd806a9c0 con 0x7effd80cf0e0 2023-11-28T11:54:38.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.224+0000 7effd7fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd80cf0e0 0x7effd80cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:38.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.224+0000 7effd77fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7effd80b1ae0 0x7effd806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:38.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.224+0000 7effceffd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7effd806a4c0 0x7effd80d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:55322/0 (socket says 172.21.15.50:55322) 2023-11-28T11:54:38.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effceffd700 1 -- 172.21.15.50:0/552680092 learned_addr learned my addr 172.21.15.50:0/552680092 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:38.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effd6ffd700 1 -- 172.21.15.50:0/552680092 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238048971 0 0) 0x7effd80cfa80 con 0x7effd806a4c0 2023-11-28T11:54:38.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effd7fff700 1 -- 172.21.15.50:0/552680092 >> v2:172.21.15.192:3300/0 conn(0x7effd80b1ae0 msgr2=0x7effd806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:38.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effd7fff700 1 --2- 172.21.15.50:0/552680092 >> v2:172.21.15.192:3300/0 conn(0x7effd80b1ae0 0x7effd806d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effd7fff700 1 -- 172.21.15.50:0/552680092 >> v1:172.21.15.192:6789/0 conn(0x7effd806a4c0 legacy=0x7effd80d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effd7fff700 1 -- 172.21.15.50:0/552680092 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd806aca0 con 0x7effd80cf0e0 2023-11-28T11:54:38.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effd7fff700 1 --2- 172.21.15.50:0/552680092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd80cf0e0 0x7effd80cf540 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7effd0009d90 tx=0x7effd000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42ff350ef5ed4ea8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:38.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effd6ffd700 1 -- 172.21.15.50:0/552680092 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd000e070 con 0x7effd80cf0e0 2023-11-28T11:54:38.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effd6ffd700 1 -- 172.21.15.50:0/552680092 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd000bb20 con 0x7effd80cf0e0 2023-11-28T11:54:38.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effd6ffd700 1 -- 172.21.15.50:0/552680092 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd0012430 con 0x7effd80cf0e0 2023-11-28T11:54:38.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effdce48700 1 -- 172.21.15.50:0/552680092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd80cf0e0 msgr2=0x7effd80cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effdce48700 1 --2- 172.21.15.50:0/552680092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd80cf0e0 0x7effd80cf540 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7effd0009d90 tx=0x7effd000b330 comp rx=0 tx=0).stop 2023-11-28T11:54:38.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effdce48700 1 -- 172.21.15.50:0/552680092 shutdown_connections 2023-11-28T11:54:38.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effdce48700 1 --2- 172.21.15.50:0/552680092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd80cf0e0 0x7effd80cf540 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effdce48700 1 --2- 172.21.15.50:0/552680092 >> v2:172.21.15.192:3300/0 conn(0x7effd80b1ae0 0x7effd806d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effdce48700 1 -- 172.21.15.50:0/552680092 >> 172.21.15.50:0/552680092 conn(0x7effd809bbd0 msgr2=0x7effd80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:38.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effdce48700 1 -- 172.21.15.50:0/552680092 shutdown_connections 2023-11-28T11:54:38.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.228+0000 7effdce48700 1 -- 172.21.15.50:0/552680092 wait complete. 2023-11-28T11:54:38.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effdce48700 1 Processor -- start 2023-11-28T11:54:38.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effdce48700 1 -- start start 2023-11-28T11:54:38.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effdce48700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effd806a4c0 0x7effd80b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:38.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effdce48700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd80b1ae0 0x7effd80b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:38.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effdce48700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd80cf0e0 0x7effd80b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:38.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effdce48700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd809e1b0 con 0x7effd80b1ae0 2023-11-28T11:54:38.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effdce48700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd809ccb0 con 0x7effd806a4c0 2023-11-28T11:54:38.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effdce48700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd809c9d0 con 0x7effd80cf0e0 2023-11-28T11:54:38.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effceffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd80b1ae0 0x7effd80b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:38.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effceffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd80b1ae0 0x7effd80b47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32804/0 (socket says 172.21.15.50:32804) 2023-11-28T11:54:38.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effceffd700 1 -- 172.21.15.50:0/924249879 learned_addr learned my addr 172.21.15.50:0/924249879 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:38.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effd7fff700 1 --2- 172.21.15.50:0/924249879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd80cf0e0 0x7effd80b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:38.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effd77fe700 1 --2- 172.21.15.50:0/924249879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effd806a4c0 0x7effd80b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:38.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effceffd700 1 -- 172.21.15.50:0/924249879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd80cf0e0 msgr2=0x7effd80b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effceffd700 1 --2- 172.21.15.50:0/924249879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd80cf0e0 0x7effd80b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effceffd700 1 -- 172.21.15.50:0/924249879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effd806a4c0 msgr2=0x7effd80b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effceffd700 1 --2- 172.21.15.50:0/924249879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effd806a4c0 0x7effd80b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effceffd700 1 -- 172.21.15.50:0/924249879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd0009a70 con 0x7effd80b1ae0 2023-11-28T11:54:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effceffd700 1 --2- 172.21.15.50:0/924249879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd80b1ae0 0x7effd80b47a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7effc000c4e0 tx=0x7effc000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effd4ff9700 1 -- 172.21.15.50:0/924249879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0004ca0 con 0x7effd80b1ae0 2023-11-28T11:54:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effd4ff9700 1 -- 172.21.15.50:0/924249879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc0004e20 con 0x7effd80b1ae0 2023-11-28T11:54:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effd4ff9700 1 -- 172.21.15.50:0/924249879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0007310 con 0x7effd80b1ae0 2023-11-28T11:54:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effdce48700 1 -- 172.21.15.50:0/924249879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd80b4380 con 0x7effd80b1ae0 2023-11-28T11:54:38.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.232+0000 7effdce48700 1 -- 172.21.15.50:0/924249879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd806af80 con 0x7effd80b1ae0 2023-11-28T11:54:38.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.236+0000 7effdce48700 1 -- 172.21.15.50:0/924249879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd80b1eb0 con 0x7effd80b1ae0 2023-11-28T11:54:38.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.236+0000 7effd4ff9700 1 -- 172.21.15.50:0/924249879 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7effc001a020 con 0x7effd80b1ae0 2023-11-28T11:54:38.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.236+0000 7effd4ff9700 1 --2- 172.21.15.50:0/924249879 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7effbc064ee0 0x7effbc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:38.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.236+0000 7effd4ff9700 1 -- 172.21.15.50:0/924249879 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7effc0081c20 con 0x7effd80b1ae0 2023-11-28T11:54:38.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.236+0000 7effd77fe700 1 --2- 172.21.15.50:0/924249879 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7effbc064ee0 0x7effbc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:38.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.236+0000 7effd77fe700 1 --2- 172.21.15.50:0/924249879 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7effbc064ee0 0x7effbc067390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7effd80b0930 tx=0x7effc8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:38.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.240+0000 7effd4ff9700 1 -- 172.21.15.50:0/924249879 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7effc004fa90 con 0x7effd80b1ae0 2023-11-28T11:54:38.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.404+0000 7effdce48700 1 -- 172.21.15.50:0/924249879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7effd8072500 con 0x7effd80b1ae0 2023-11-28T11:54:38.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.404+0000 7effd4ff9700 1 -- 172.21.15.50:0/924249879 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7effc00530b0 con 0x7effd80b1ae0 2023-11-28T11:54:38.407 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:54:38.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.408+0000 7effdce48700 1 -- 172.21.15.50:0/924249879 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7effbc064ee0 msgr2=0x7effbc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.408+0000 7effdce48700 1 --2- 172.21.15.50:0/924249879 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7effbc064ee0 0x7effbc067390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7effd80b0930 tx=0x7effc8009240 comp rx=0 tx=0).stop 2023-11-28T11:54:38.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.408+0000 7effdce48700 1 -- 172.21.15.50:0/924249879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd80b1ae0 msgr2=0x7effd80b47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.408+0000 7effdce48700 1 --2- 172.21.15.50:0/924249879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd80b1ae0 0x7effd80b47a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7effc000c4e0 tx=0x7effc000c7f0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.408+0000 7effdce48700 1 -- 172.21.15.50:0/924249879 shutdown_connections 2023-11-28T11:54:38.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.408+0000 7effdce48700 1 --2- 172.21.15.50:0/924249879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd80cf0e0 0x7effd80b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.408+0000 7effdce48700 1 --2- 172.21.15.50:0/924249879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effd80b1ae0 0x7effd80b47a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.408+0000 7effdce48700 1 --2- 172.21.15.50:0/924249879 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7effbc064ee0 0x7effbc067390 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.408+0000 7effdce48700 1 --2- 172.21.15.50:0/924249879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effd806a4c0 0x7effd80b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.408+0000 7effdce48700 1 -- 172.21.15.50:0/924249879 >> 172.21.15.50:0/924249879 conn(0x7effd809bbd0 msgr2=0x7effd806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:38.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.408+0000 7effdce48700 1 -- 172.21.15.50:0/924249879 shutdown_connections 2023-11-28T11:54:38.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.408+0000 7effdce48700 1 -- 172.21.15.50:0/924249879 wait complete. 2023-11-28T11:54:38.423 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:54:38.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.540+0000 7f485d233700 1 Processor -- start 2023-11-28T11:54:38.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.540+0000 7f485d233700 1 -- start start 2023-11-28T11:54:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.540+0000 7f485d233700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f485815bb80 0x7f48580b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.540+0000 7f485d233700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48580ccd00 con 0x7f485806b370 2023-11-28T11:54:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.540+0000 7f485d233700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48580b19b0 con 0x7f48580aaf40 2023-11-28T11:54:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.540+0000 7f485d233700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48580cd510 con 0x7f485815bb80 2023-11-28T11:54:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.540+0000 7f4857fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f485815bb80 0x7f48580b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.540+0000 7f4857fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f485815bb80 0x7f48580b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32810/0 (socket says 172.21.15.50:32810) 2023-11-28T11:54:38.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.540+0000 7f4857fff700 1 -- 172.21.15.50:0/323680882 learned_addr learned my addr 172.21.15.50:0/323680882 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.540+0000 7f4857fff700 1 -- 172.21.15.50:0/323680882 >> v1:172.21.15.192:6789/0 conn(0x7f48580aaf40 legacy=0x7f48580b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.540+0000 7f4857fff700 1 -- 172.21.15.50:0/323680882 >> v1:172.21.15.50:6789/0 conn(0x7f485806b370 legacy=0x7f485815c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.540+0000 7f4857fff700 1 -- 172.21.15.50:0/323680882 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48580ccf50 con 0x7f485815bb80 2023-11-28T11:54:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.540+0000 7f4857fff700 1 --2- 172.21.15.50:0/323680882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f485815bb80 0x7f48580b2450 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4848009910 tx=0x7f4848009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1891839d9069fee1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.540+0000 7f4856ffd700 1 -- 172.21.15.50:0/323680882 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484800ba60 con 0x7f485815bb80 2023-11-28T11:54:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.540+0000 7f4856ffd700 1 -- 172.21.15.50:0/323680882 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484800bbc0 con 0x7f485815bb80 2023-11-28T11:54:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.540+0000 7f4856ffd700 1 -- 172.21.15.50:0/323680882 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848009e60 con 0x7f485815bb80 2023-11-28T11:54:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.544+0000 7f485d233700 1 -- 172.21.15.50:0/323680882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f485815bb80 msgr2=0x7f48580b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.544+0000 7f485d233700 1 --2- 172.21.15.50:0/323680882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f485815bb80 0x7f48580b2450 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4848009910 tx=0x7f4848009c20 comp rx=0 tx=0).stop 2023-11-28T11:54:38.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.544+0000 7f485d233700 1 -- 172.21.15.50:0/323680882 shutdown_connections 2023-11-28T11:54:38.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.544+0000 7f485d233700 1 --2- 172.21.15.50:0/323680882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f485815bb80 0x7f48580b2450 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.544+0000 7f485d233700 1 -- 172.21.15.50:0/323680882 >> 172.21.15.50:0/323680882 conn(0x7f48580cae70 msgr2=0x7f48580cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:38.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.544+0000 7f485d233700 1 -- 172.21.15.50:0/323680882 shutdown_connections 2023-11-28T11:54:38.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.544+0000 7f485d233700 1 -- 172.21.15.50:0/323680882 wait complete. 2023-11-28T11:54:38.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.544+0000 7f485d233700 1 Processor -- start 2023-11-28T11:54:38.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.544+0000 7f485d233700 1 -- start start 2023-11-28T11:54:38.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f485d233700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485806b370 0x7f48581498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:38.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f485d233700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48580aaf40 0x7f48580c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:38.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f485d233700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f485815bb80 0x7f48580c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:38.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f485d233700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4858149e10 con 0x7f485815bb80 2023-11-28T11:54:38.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f485d233700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485806ffb0 con 0x7f48580aaf40 2023-11-28T11:54:38.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f485d233700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4858158fe0 con 0x7f485806b370 2023-11-28T11:54:38.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f485ca32700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f485815bb80 0x7f48580c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:38.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f485ca32700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f485815bb80 0x7f48580c97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32818/0 (socket says 172.21.15.50:32818) 2023-11-28T11:54:38.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f485ca32700 1 -- 172.21.15.50:0/1379625415 learned_addr learned my addr 172.21.15.50:0/1379625415 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:38.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f4857fff700 1 --2- 172.21.15.50:0/1379625415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485806b370 0x7f48581498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:38.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f48577fe700 1 --2- 172.21.15.50:0/1379625415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48580aaf40 0x7f48580c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f485ca32700 1 -- 172.21.15.50:0/1379625415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485806b370 msgr2=0x7f48581498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f485ca32700 1 --2- 172.21.15.50:0/1379625415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485806b370 0x7f48581498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f485ca32700 1 -- 172.21.15.50:0/1379625415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48580aaf40 msgr2=0x7f48580c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f485ca32700 1 --2- 172.21.15.50:0/1379625415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48580aaf40 0x7f48580c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f485ca32700 1 -- 172.21.15.50:0/1379625415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4848009570 con 0x7f485815bb80 2023-11-28T11:54:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f485ca32700 1 --2- 172.21.15.50:0/1379625415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f485815bb80 0x7f48580c97f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f485000cb50 tx=0x7f485000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f4854ff9700 1 -- 172.21.15.50:0/1379625415 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850003c20 con 0x7f485815bb80 2023-11-28T11:54:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f4854ff9700 1 -- 172.21.15.50:0/1379625415 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4850003d80 con 0x7f485815bb80 2023-11-28T11:54:38.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f485d233700 1 -- 172.21.15.50:0/1379625415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48580b1c50 con 0x7f485815bb80 2023-11-28T11:54:38.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f4854ff9700 1 -- 172.21.15.50:0/1379625415 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000aa20 con 0x7f485815bb80 2023-11-28T11:54:38.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.548+0000 7f485d233700 1 -- 172.21.15.50:0/1379625415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48580cd230 con 0x7f485815bb80 2023-11-28T11:54:38.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.552+0000 7f485d233700 1 -- 172.21.15.50:0/1379625415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48580b1f30 con 0x7f485815bb80 2023-11-28T11:54:38.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.552+0000 7f4854ff9700 1 -- 172.21.15.50:0/1379625415 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4850010050 con 0x7f485815bb80 2023-11-28T11:54:38.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.552+0000 7f4854ff9700 1 --2- 172.21.15.50:0/1379625415 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4844064ee0 0x7f4844067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:38.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.552+0000 7f4854ff9700 1 -- 172.21.15.50:0/1379625415 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4850082140 con 0x7f485815bb80 2023-11-28T11:54:38.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.552+0000 7f4857fff700 1 --2- 172.21.15.50:0/1379625415 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4844064ee0 0x7f4844067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:38.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.552+0000 7f4857fff700 1 --2- 172.21.15.50:0/1379625415 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4844064ee0 0x7f4844067390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4848009c60 tx=0x7f4848008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:38.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.560+0000 7f4854ff9700 1 -- 172.21.15.50:0/1379625415 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f485004fea0 con 0x7f485815bb80 2023-11-28T11:54:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.724+0000 7f485d233700 1 -- 172.21.15.50:0/1379625415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4858072500 con 0x7f485815bb80 2023-11-28T11:54:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.724+0000 7f4854ff9700 1 -- 172.21.15.50:0/1379625415 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f48500534c0 con 0x7f485815bb80 2023-11-28T11:54:38.725 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.724+0000 7f485d233700 1 -- 172.21.15.50:0/1379625415 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4844064ee0 msgr2=0x7f4844067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.724+0000 7f485d233700 1 --2- 172.21.15.50:0/1379625415 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4844064ee0 0x7f4844067390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4848009c60 tx=0x7f4848008030 comp rx=0 tx=0).stop 2023-11-28T11:54:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.724+0000 7f485d233700 1 -- 172.21.15.50:0/1379625415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f485815bb80 msgr2=0x7f48580c97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.724+0000 7f485d233700 1 --2- 172.21.15.50:0/1379625415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f485815bb80 0x7f48580c97f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f485000cb50 tx=0x7f485000ce60 comp rx=0 tx=0).stop 2023-11-28T11:54:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.724+0000 7f485d233700 1 -- 172.21.15.50:0/1379625415 shutdown_connections 2023-11-28T11:54:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.724+0000 7f485d233700 1 --2- 172.21.15.50:0/1379625415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f485815bb80 0x7f48580c97f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.724+0000 7f485d233700 1 --2- 172.21.15.50:0/1379625415 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4844064ee0 0x7f4844067390 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.724+0000 7f485d233700 1 --2- 172.21.15.50:0/1379625415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48580aaf40 0x7f48580c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.724+0000 7f485d233700 1 --2- 172.21.15.50:0/1379625415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485806b370 0x7f48581498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.724+0000 7f485d233700 1 -- 172.21.15.50:0/1379625415 >> 172.21.15.50:0/1379625415 conn(0x7f48580cae70 msgr2=0x7f48580ac180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.724+0000 7f485d233700 1 -- 172.21.15.50:0/1379625415 shutdown_connections 2023-11-28T11:54:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.724+0000 7f485d233700 1 -- 172.21.15.50:0/1379625415 wait complete. 2023-11-28T11:54:38.739 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:54:38.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.860+0000 7f86b9ec3700 1 Processor -- start 2023-11-28T11:54:38.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.860+0000 7f86b9ec3700 1 -- start start 2023-11-28T11:54:38.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.860+0000 7f86b9ec3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f86b40cc2f0 0x7f86b40ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:38.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.860+0000 7f86b9ec3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b415a3e0 0x7f86b40cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:38.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.860+0000 7f86b9ec3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b409c0e0 con 0x7f86b40b2d30 2023-11-28T11:54:38.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.860+0000 7f86b9ec3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b40ccc00 con 0x7f86b40cc2f0 2023-11-28T11:54:38.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.860+0000 7f86b9ec3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40b13e0 con 0x7f86b415a3e0 2023-11-28T11:54:38.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.860+0000 7f86b96c2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f86b40b2d30 0x7f86b4069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41628/0 (socket says 172.21.15.50:41628) 2023-11-28T11:54:38.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.860+0000 7f86b96c2700 1 -- 172.21.15.50:0/981968128 learned_addr learned my addr 172.21.15.50:0/981968128 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:38.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.860+0000 7f86b8ec1700 1 --2- 172.21.15.50:0/981968128 >> v2:172.21.15.50:3300/0 conn(0x7f86b40cc2f0 0x7f86b40ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:38.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.860+0000 7f86b3fff700 1 --2- 172.21.15.50:0/981968128 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b415a3e0 0x7f86b40cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:38.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.860+0000 7f86b37fe700 1 -- 172.21.15.50:0/981968128 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331722090 0 0) 0x7f86b409c0e0 con 0x7f86b40b2d30 2023-11-28T11:54:38.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.860+0000 7f86b37fe700 1 -- 172.21.15.50:0/981968128 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f869c0035d0 con 0x7f86b40b2d30 2023-11-28T11:54:38.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.860+0000 7f86b3fff700 1 -- 172.21.15.50:0/981968128 >> v2:172.21.15.50:3300/0 conn(0x7f86b40cc2f0 msgr2=0x7f86b40ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:38.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.860+0000 7f86b3fff700 1 --2- 172.21.15.50:0/981968128 >> v2:172.21.15.50:3300/0 conn(0x7f86b40cc2f0 0x7f86b40ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.860+0000 7f86b3fff700 1 -- 172.21.15.50:0/981968128 >> v1:172.21.15.50:6789/0 conn(0x7f86b40b2d30 legacy=0x7f86b4069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.860+0000 7f86b37fe700 1 -- 172.21.15.50:0/981968128 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1703633947 0 0) 0x7f869c0035d0 con 0x7f86b40b2d30 2023-11-28T11:54:38.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.864+0000 7f86b3fff700 1 -- 172.21.15.50:0/981968128 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b40b16c0 con 0x7f86b415a3e0 2023-11-28T11:54:38.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.864+0000 7f86b3fff700 1 --2- 172.21.15.50:0/981968128 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b415a3e0 0x7f86b40cc6c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009850 tx=0x7f86a4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efca3d2fcdc907fa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:38.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.864+0000 7f86b37fe700 1 -- 172.21.15.50:0/981968128 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0019f0 con 0x7f86b415a3e0 2023-11-28T11:54:38.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.864+0000 7f86b37fe700 1 -- 172.21.15.50:0/981968128 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a4004030 con 0x7f86b415a3e0 2023-11-28T11:54:38.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.864+0000 7f86b37fe700 1 -- 172.21.15.50:0/981968128 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a40043a0 con 0x7f86b415a3e0 2023-11-28T11:54:38.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.864+0000 7f86b9ec3700 1 -- 172.21.15.50:0/981968128 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b415a3e0 msgr2=0x7f86b40cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.864+0000 7f86b9ec3700 1 --2- 172.21.15.50:0/981968128 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b415a3e0 0x7f86b40cc6c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009850 tx=0x7f86a4009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:38.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.864+0000 7f86b9ec3700 1 -- 172.21.15.50:0/981968128 shutdown_connections 2023-11-28T11:54:38.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.864+0000 7f86b9ec3700 1 --2- 172.21.15.50:0/981968128 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b415a3e0 0x7f86b40cc6c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.864+0000 7f86b9ec3700 1 --2- 172.21.15.50:0/981968128 >> v2:172.21.15.50:3300/0 conn(0x7f86b40cc2f0 0x7f86b40ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.864+0000 7f86b9ec3700 1 -- 172.21.15.50:0/981968128 >> 172.21.15.50:0/981968128 conn(0x7f86b40cae70 msgr2=0x7f86b40cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.864+0000 7f86b9ec3700 1 -- 172.21.15.50:0/981968128 shutdown_connections 2023-11-28T11:54:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.864+0000 7f86b9ec3700 1 -- 172.21.15.50:0/981968128 wait complete. 2023-11-28T11:54:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.868+0000 7f86b9ec3700 1 Processor -- start 2023-11-28T11:54:38.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.868+0000 7f86b9ec3700 1 -- start start 2023-11-28T11:54:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.868+0000 7f86b9ec3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b40b2d30 0x7f86b414c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.868+0000 7f86b9ec3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b40cc2f0 0x7f86b414ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.868+0000 7f86b9ec3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86b415a3e0 0x7f86b40add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.868+0000 7f86b9ec3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40aedb0 con 0x7f86b415a3e0 2023-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.868+0000 7f86b9ec3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b41ef870 con 0x7f86b40b2d30 2023-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.868+0000 7f86b9ec3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40ae7f0 con 0x7f86b40cc2f0 2023-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.868+0000 7f86b96c2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86b415a3e0 0x7f86b40add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.868+0000 7f86b96c2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86b415a3e0 0x7f86b40add50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32828/0 (socket says 172.21.15.50:32828) 2023-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.868+0000 7f86b3fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b40cc2f0 0x7f86b414ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.868+0000 7f86b96c2700 1 -- 172.21.15.50:0/3684705916 learned_addr learned my addr 172.21.15.50:0/3684705916 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.868+0000 7f86b8ec1700 1 --2- 172.21.15.50:0/3684705916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b40b2d30 0x7f86b414c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.872+0000 7f86b96c2700 1 -- 172.21.15.50:0/3684705916 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b40cc2f0 msgr2=0x7f86b414ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.872+0000 7f86b96c2700 1 --2- 172.21.15.50:0/3684705916 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b40cc2f0 0x7f86b414ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.872+0000 7f86b96c2700 1 -- 172.21.15.50:0/3684705916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b40b2d30 msgr2=0x7f86b414c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.872+0000 7f86b96c2700 1 --2- 172.21.15.50:0/3684705916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b40b2d30 0x7f86b414c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.872+0000 7f86b96c2700 1 -- 172.21.15.50:0/3684705916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a40094b0 con 0x7f86b415a3e0 2023-11-28T11:54:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.872+0000 7f86b8ec1700 1 --2- 172.21.15.50:0/3684705916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b40b2d30 0x7f86b414c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:38.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.872+0000 7f86b96c2700 1 --2- 172.21.15.50:0/3684705916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86b415a3e0 0x7f86b40add50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f86ac001560 tx=0x7f86ac00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.872+0000 7f86b17fa700 1 -- 172.21.15.50:0/3684705916 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac00aaa0 con 0x7f86b415a3e0 2023-11-28T11:54:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.872+0000 7f86b17fa700 1 -- 172.21.15.50:0/3684705916 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac00ac00 con 0x7f86b415a3e0 2023-11-28T11:54:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.872+0000 7f86b9ec3700 1 -- 172.21.15.50:0/3684705916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b40b1c80 con 0x7f86b415a3e0 2023-11-28T11:54:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.872+0000 7f86b17fa700 1 -- 172.21.15.50:0/3684705916 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0070d0 con 0x7f86b415a3e0 2023-11-28T11:54:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.872+0000 7f86b9ec3700 1 -- 172.21.15.50:0/3684705916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b40b19a0 con 0x7f86b415a3e0 2023-11-28T11:54:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.872+0000 7f86b9ec3700 1 -- 172.21.15.50:0/3684705916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b406a350 con 0x7f86b415a3e0 2023-11-28T11:54:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.872+0000 7f86b17fa700 1 -- 172.21.15.50:0/3684705916 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f86ac01a030 con 0x7f86b415a3e0 2023-11-28T11:54:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.872+0000 7f86b17fa700 1 --2- 172.21.15.50:0/3684705916 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f86a0064ee0 0x7f86a0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.876+0000 7f86b17fa700 1 -- 172.21.15.50:0/3684705916 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f86ac081e20 con 0x7f86b415a3e0 2023-11-28T11:54:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.876+0000 7f86b8ec1700 1 --2- 172.21.15.50:0/3684705916 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f86a0064ee0 0x7f86a0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:38.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.876+0000 7f86b8ec1700 1 --2- 172.21.15.50:0/3684705916 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f86a0064ee0 0x7f86a0067390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009f40 tx=0x7f86a8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:38.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:38.880+0000 7f86b17fa700 1 -- 172.21.15.50:0/3684705916 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f86ac04fc90 con 0x7f86b415a3e0 2023-11-28T11:54:39.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.040+0000 7f86b9ec3700 1 -- 172.21.15.50:0/3684705916 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f86b4072500 con 0x7f86b415a3e0 2023-11-28T11:54:39.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.040+0000 7f86b17fa700 1 -- 172.21.15.50:0/3684705916 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f86ac0180a0 con 0x7f86b415a3e0 2023-11-28T11:54:39.043 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:54:39.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.044+0000 7f86b9ec3700 1 -- 172.21.15.50:0/3684705916 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f86a0064ee0 msgr2=0x7f86a0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:39.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.044+0000 7f86b9ec3700 1 --2- 172.21.15.50:0/3684705916 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f86a0064ee0 0x7f86a0067390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009f40 tx=0x7f86a8009240 comp rx=0 tx=0).stop 2023-11-28T11:54:39.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.044+0000 7f86b9ec3700 1 -- 172.21.15.50:0/3684705916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86b415a3e0 msgr2=0x7f86b40add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:39.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.044+0000 7f86b9ec3700 1 --2- 172.21.15.50:0/3684705916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86b415a3e0 0x7f86b40add50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f86ac001560 tx=0x7f86ac00cf00 comp rx=0 tx=0).stop 2023-11-28T11:54:39.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.044+0000 7f86b9ec3700 1 -- 172.21.15.50:0/3684705916 shutdown_connections 2023-11-28T11:54:39.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.044+0000 7f86b9ec3700 1 --2- 172.21.15.50:0/3684705916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86b415a3e0 0x7f86b40add50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.044+0000 7f86b9ec3700 1 --2- 172.21.15.50:0/3684705916 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b40cc2f0 0x7f86b414ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.044+0000 7f86b9ec3700 1 --2- 172.21.15.50:0/3684705916 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f86a0064ee0 0x7f86a0067390 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.044+0000 7f86b9ec3700 1 --2- 172.21.15.50:0/3684705916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b40b2d30 0x7f86b414c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.044+0000 7f86b9ec3700 1 -- 172.21.15.50:0/3684705916 >> 172.21.15.50:0/3684705916 conn(0x7f86b40cae70 msgr2=0x7f86b406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:39.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.044+0000 7f86b9ec3700 1 -- 172.21.15.50:0/3684705916 shutdown_connections 2023-11-28T11:54:39.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.044+0000 7f86b9ec3700 1 -- 172.21.15.50:0/3684705916 wait complete. 2023-11-28T11:54:39.058 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:54:39.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff15089e700 1 Processor -- start 2023-11-28T11:54:39.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff15089e700 1 -- start start 2023-11-28T11:54:39.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff15089e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff14c160880 0x7ff14c06aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff15089e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff14c06b000 0x7ff14c0c13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff15089e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff14c0c1900 0x7ff14c0afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff15089e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c06b450 con 0x7ff14c0c1900 2023-11-28T11:54:39.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff15089e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c160c50 con 0x7ff14c160880 2023-11-28T11:54:39.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff15089e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0c1d60 con 0x7ff14c06b000 2023-11-28T11:54:39.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff14bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff14c0c1900 0x7ff14c0afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff14affd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff14c06b000 0x7ff14c0c13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff14b7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff14c160880 0x7ff14c06aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff14bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff14c0c1900 0x7ff14c0afe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32834/0 (socket says 172.21.15.50:32834) 2023-11-28T11:54:39.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff14bfff700 1 -- 172.21.15.50:0/3656126789 learned_addr learned my addr 172.21.15.50:0/3656126789 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:39.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff14bfff700 1 -- 172.21.15.50:0/3656126789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff14c06b000 msgr2=0x7ff14c0c13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff14bfff700 1 --2- 172.21.15.50:0/3656126789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff14c06b000 0x7ff14c0c13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff14bfff700 1 -- 172.21.15.50:0/3656126789 >> v2:172.21.15.192:3300/0 conn(0x7ff14c160880 msgr2=0x7ff14c06aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff14bfff700 1 --2- 172.21.15.50:0/3656126789 >> v2:172.21.15.192:3300/0 conn(0x7ff14c160880 0x7ff14c06aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff14bfff700 1 -- 172.21.15.50:0/3656126789 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0b3050 con 0x7ff14c0c1900 2023-11-28T11:54:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff14bfff700 1 --2- 172.21.15.50:0/3656126789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14c0c1900 0x7ff14c0afe70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff14c06fae0 tx=0x7ff134009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873d256ee1d6b3b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff14a7fc700 1 -- 172.21.15.50:0/3656126789 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134011830 con 0x7ff14c0c1900 2023-11-28T11:54:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff14a7fc700 1 -- 172.21.15.50:0/3656126789 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff134011990 con 0x7ff14c0c1900 2023-11-28T11:54:39.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.176+0000 7ff14a7fc700 1 -- 172.21.15.50:0/3656126789 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134011d20 con 0x7ff14c0c1900 2023-11-28T11:54:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff15089e700 1 -- 172.21.15.50:0/3656126789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14c0c1900 msgr2=0x7ff14c0afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:39.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff15089e700 1 --2- 172.21.15.50:0/3656126789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14c0c1900 0x7ff14c0afe70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff14c06fae0 tx=0x7ff134009bf0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff15089e700 1 -- 172.21.15.50:0/3656126789 shutdown_connections 2023-11-28T11:54:39.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff15089e700 1 --2- 172.21.15.50:0/3656126789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14c0c1900 0x7ff14c0afe70 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff15089e700 1 --2- 172.21.15.50:0/3656126789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff14c06b000 0x7ff14c0c13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff15089e700 1 --2- 172.21.15.50:0/3656126789 >> v2:172.21.15.192:3300/0 conn(0x7ff14c160880 0x7ff14c06aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff15089e700 1 -- 172.21.15.50:0/3656126789 >> 172.21.15.50:0/3656126789 conn(0x7ff14c0cae70 msgr2=0x7ff14c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:39.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff15089e700 1 -- 172.21.15.50:0/3656126789 shutdown_connections 2023-11-28T11:54:39.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff15089e700 1 -- 172.21.15.50:0/3656126789 wait complete. 2023-11-28T11:54:39.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff15089e700 1 Processor -- start 2023-11-28T11:54:39.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff15089e700 1 -- start start 2023-11-28T11:54:39.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff15089e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14c06b000 0x7ff14c0b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff15089e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff14c0c1900 0x7ff14c0b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff15089e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff14c160880 0x7ff14c148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff15089e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0c48d0 con 0x7ff14c06b000 2023-11-28T11:54:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff15089e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c1467a0 con 0x7ff14c0c1900 2023-11-28T11:54:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff15089e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0c3d50 con 0x7ff14c160880 2023-11-28T11:54:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff14b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14c06b000 0x7ff14c0b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff14b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14c06b000 0x7ff14c0b0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32842/0 (socket says 172.21.15.50:32842) 2023-11-28T11:54:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff14b7fe700 1 -- 172.21.15.50:0/164451563 learned_addr learned my addr 172.21.15.50:0/164451563 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff14bfff700 1 --2- 172.21.15.50:0/164451563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff14c160880 0x7ff14c148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.180+0000 7ff14affd700 1 --2- 172.21.15.50:0/164451563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff14c0c1900 0x7ff14c0b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.184+0000 7ff14b7fe700 1 -- 172.21.15.50:0/164451563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff14c160880 msgr2=0x7ff14c148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.184+0000 7ff14b7fe700 1 --2- 172.21.15.50:0/164451563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff14c160880 0x7ff14c148b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.184+0000 7ff14b7fe700 1 -- 172.21.15.50:0/164451563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff14c0c1900 msgr2=0x7ff14c0b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.184+0000 7ff14b7fe700 1 --2- 172.21.15.50:0/164451563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff14c0c1900 0x7ff14c0b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.184+0000 7ff14b7fe700 1 -- 172.21.15.50:0/164451563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff134009570 con 0x7ff14c06b000 2023-11-28T11:54:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.184+0000 7ff14affd700 1 --2- 172.21.15.50:0/164451563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff14c0c1900 0x7ff14c0b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.184+0000 7ff14bfff700 1 --2- 172.21.15.50:0/164451563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff14c160880 0x7ff14c148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.184+0000 7ff14b7fe700 1 --2- 172.21.15.50:0/164451563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14c06b000 0x7ff14c0b0420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00ea00 tx=0x7ff13c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.184+0000 7ff143fff700 1 -- 172.21.15.50:0/164451563 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c009720 con 0x7ff14c06b000 2023-11-28T11:54:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.184+0000 7ff143fff700 1 -- 172.21.15.50:0/164451563 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c00eea0 con 0x7ff14c06b000 2023-11-28T11:54:39.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.184+0000 7ff15089e700 1 -- 172.21.15.50:0/164451563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c069ce0 con 0x7ff14c06b000 2023-11-28T11:54:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.184+0000 7ff143fff700 1 -- 172.21.15.50:0/164451563 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c00ca50 con 0x7ff14c06b000 2023-11-28T11:54:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.184+0000 7ff15089e700 1 -- 172.21.15.50:0/164451563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14c06b630 con 0x7ff14c06b000 2023-11-28T11:54:39.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.184+0000 7ff15089e700 1 -- 172.21.15.50:0/164451563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14c069fc0 con 0x7ff14c06b000 2023-11-28T11:54:39.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.188+0000 7ff143fff700 1 -- 172.21.15.50:0/164451563 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff13c019030 con 0x7ff14c06b000 2023-11-28T11:54:39.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.188+0000 7ff143fff700 1 --2- 172.21.15.50:0/164451563 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff12c064ee0 0x7ff12c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.188+0000 7ff143fff700 1 -- 172.21.15.50:0/164451563 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff13c082930 con 0x7ff14c06b000 2023-11-28T11:54:39.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.188+0000 7ff14affd700 1 --2- 172.21.15.50:0/164451563 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff12c064ee0 0x7ff12c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.188+0000 7ff14affd700 1 --2- 172.21.15.50:0/164451563 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff12c064ee0 0x7ff12c067390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff144009fd0 tx=0x7ff14400d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:39.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.192+0000 7ff143fff700 1 -- 172.21.15.50:0/164451563 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff13c0506d0 con 0x7ff14c06b000 2023-11-28T11:54:39.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.356+0000 7ff15089e700 1 -- 172.21.15.50:0/164451563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff14c072500 con 0x7ff14c06b000 2023-11-28T11:54:39.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.356+0000 7ff143fff700 1 -- 172.21.15.50:0/164451563 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff13c017020 con 0x7ff14c06b000 2023-11-28T11:54:39.357 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:39.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.356+0000 7ff15089e700 1 -- 172.21.15.50:0/164451563 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff12c064ee0 msgr2=0x7ff12c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:39.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.356+0000 7ff15089e700 1 --2- 172.21.15.50:0/164451563 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff12c064ee0 0x7ff12c067390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff144009fd0 tx=0x7ff14400d040 comp rx=0 tx=0).stop 2023-11-28T11:54:39.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.356+0000 7ff15089e700 1 -- 172.21.15.50:0/164451563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14c06b000 msgr2=0x7ff14c0b0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:39.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.356+0000 7ff15089e700 1 --2- 172.21.15.50:0/164451563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14c06b000 0x7ff14c0b0420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00ea00 tx=0x7ff13c00ed10 comp rx=0 tx=0).stop 2023-11-28T11:54:39.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.356+0000 7ff15089e700 1 -- 172.21.15.50:0/164451563 shutdown_connections 2023-11-28T11:54:39.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.356+0000 7ff15089e700 1 --2- 172.21.15.50:0/164451563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff14c160880 0x7ff14c148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.356+0000 7ff15089e700 1 --2- 172.21.15.50:0/164451563 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff12c064ee0 0x7ff12c067390 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.356+0000 7ff15089e700 1 --2- 172.21.15.50:0/164451563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff14c0c1900 0x7ff14c0b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.356+0000 7ff15089e700 1 --2- 172.21.15.50:0/164451563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff14c06b000 0x7ff14c0b0420 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.356+0000 7ff15089e700 1 -- 172.21.15.50:0/164451563 >> 172.21.15.50:0/164451563 conn(0x7ff14c0cae70 msgr2=0x7ff14c06c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:39.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.356+0000 7ff15089e700 1 -- 172.21.15.50:0/164451563 shutdown_connections 2023-11-28T11:54:39.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.356+0000 7ff15089e700 1 -- 172.21.15.50:0/164451563 wait complete. 2023-11-28T11:54:39.372 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:54:39.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3e01804700 1 Processor -- start 2023-11-28T11:54:39.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3e01804700 1 -- start start 2023-11-28T11:54:39.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3e01804700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3dfc0b8250 0x7f3dfc06a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3e01804700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dfc0cf8c0 0x7f3dfc069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3e01804700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dfc06a5e0 con 0x7f3dfc06a180 2023-11-28T11:54:39.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3e01804700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dfc0d0760 con 0x7f3dfc0b8250 2023-11-28T11:54:39.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3e01804700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc0cd270 con 0x7f3dfc0cf8c0 2023-11-28T11:54:39.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3dfaffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3dfc0b8250 0x7f3dfc06a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3dfa7fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dfc0cf8c0 0x7f3dfc069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3dfaffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3dfc0b8250 0x7f3dfc06a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:48668/0 (socket says 172.21.15.50:48668) 2023-11-28T11:54:39.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3dfaffd700 1 -- 172.21.15.50:0/1906061412 learned_addr learned my addr 172.21.15.50:0/1906061412 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:39.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3dfaffd700 1 -- 172.21.15.50:0/1906061412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dfc0cf8c0 msgr2=0x7f3dfc069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3dfaffd700 1 --2- 172.21.15.50:0/1906061412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dfc0cf8c0 0x7f3dfc069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3dfaffd700 1 -- 172.21.15.50:0/1906061412 >> v1:172.21.15.192:6789/0 conn(0x7f3dfc06a180 legacy=0x7f3dfc15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3dfaffd700 1 -- 172.21.15.50:0/1906061412 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc0cd550 con 0x7f3dfc0b8250 2023-11-28T11:54:39.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3dfaffd700 1 --2- 172.21.15.50:0/1906061412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dfc0b8250 0x7f3dfc06a800 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009910 tx=0x7f3dec009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dfe836848d1cc4f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3df9ffb700 1 -- 172.21.15.50:0/1906061412 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec011830 con 0x7f3dfc0b8250 2023-11-28T11:54:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3df9ffb700 1 -- 172.21.15.50:0/1906061412 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dec011990 con 0x7f3dfc0b8250 2023-11-28T11:54:39.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.492+0000 7f3df9ffb700 1 -- 172.21.15.50:0/1906061412 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec011d40 con 0x7f3dfc0b8250 2023-11-28T11:54:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.496+0000 7f3e01804700 1 -- 172.21.15.50:0/1906061412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dfc0b8250 msgr2=0x7f3dfc06a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.496+0000 7f3e01804700 1 --2- 172.21.15.50:0/1906061412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dfc0b8250 0x7f3dfc06a800 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009910 tx=0x7f3dec009c20 comp rx=0 tx=0).stop 2023-11-28T11:54:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.496+0000 7f3e01804700 1 -- 172.21.15.50:0/1906061412 shutdown_connections 2023-11-28T11:54:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.496+0000 7f3e01804700 1 --2- 172.21.15.50:0/1906061412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dfc0cf8c0 0x7f3dfc069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.496+0000 7f3e01804700 1 --2- 172.21.15.50:0/1906061412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dfc0b8250 0x7f3dfc06a800 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.496+0000 7f3e01804700 1 -- 172.21.15.50:0/1906061412 >> 172.21.15.50:0/1906061412 conn(0x7f3dfc06beb0 msgr2=0x7f3dfc06c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.496+0000 7f3e01804700 1 -- 172.21.15.50:0/1906061412 shutdown_connections 2023-11-28T11:54:39.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.496+0000 7f3e01804700 1 -- 172.21.15.50:0/1906061412 wait complete. 2023-11-28T11:54:39.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.496+0000 7f3e01804700 1 Processor -- start 2023-11-28T11:54:39.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.496+0000 7f3e01804700 1 -- start start 2023-11-28T11:54:39.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3e01804700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dfc06a180 0x7f3dfc0b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3e01804700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dfc0b8250 0x7f3dfc1f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3e01804700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dfc0cf8c0 0x7f3dfc1f1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3e01804700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc0b6c60 con 0x7f3dfc0b8250 2023-11-28T11:54:39.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3e01804700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc1f1890 con 0x7f3dfc06a180 2023-11-28T11:54:39.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3e01804700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc14f060 con 0x7f3dfc0cf8c0 2023-11-28T11:54:39.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3dfa7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dfc0b8250 0x7f3dfc1f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3dfa7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dfc0b8250 0x7f3dfc1f0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32846/0 (socket says 172.21.15.50:32846) 2023-11-28T11:54:39.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3dfa7fc700 1 -- 172.21.15.50:0/1726894774 learned_addr learned my addr 172.21.15.50:0/1726894774 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:39.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3dfaffd700 1 --2- 172.21.15.50:0/1726894774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dfc06a180 0x7f3dfc0b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3dfb7fe700 1 --2- 172.21.15.50:0/1726894774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dfc0cf8c0 0x7f3dfc1f1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3dfa7fc700 1 -- 172.21.15.50:0/1726894774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dfc0cf8c0 msgr2=0x7f3dfc1f1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:39.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3dfa7fc700 1 --2- 172.21.15.50:0/1726894774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dfc0cf8c0 0x7f3dfc1f1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3dfa7fc700 1 -- 172.21.15.50:0/1726894774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dfc06a180 msgr2=0x7f3dfc0b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:39.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3dfa7fc700 1 --2- 172.21.15.50:0/1726894774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dfc06a180 0x7f3dfc0b5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3dfa7fc700 1 -- 172.21.15.50:0/1726894774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec009570 con 0x7f3dfc0b8250 2023-11-28T11:54:39.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3dfa7fc700 1 --2- 172.21.15.50:0/1726894774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dfc0b8250 0x7f3dfc1f0e10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3df000e9d0 tx=0x7f3df000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:39.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3de3fff700 1 -- 172.21.15.50:0/1726894774 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0009720 con 0x7f3dfc0b8250 2023-11-28T11:54:39.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3de3fff700 1 -- 172.21.15.50:0/1726894774 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df000ee70 con 0x7f3dfc0b8250 2023-11-28T11:54:39.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3e01804700 1 -- 172.21.15.50:0/1726894774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dfc0b8620 con 0x7f3dfc0b8250 2023-11-28T11:54:39.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3de3fff700 1 -- 172.21.15.50:0/1726894774 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df000c9f0 con 0x7f3dfc0b8250 2023-11-28T11:54:39.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3e01804700 1 -- 172.21.15.50:0/1726894774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dfc0d0a00 con 0x7f3dfc0b8250 2023-11-28T11:54:39.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3de3fff700 1 -- 172.21.15.50:0/1726894774 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3df0019030 con 0x7f3dfc0b8250 2023-11-28T11:54:39.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.500+0000 7f3e01804700 1 -- 172.21.15.50:0/1726894774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dfc0cd830 con 0x7f3dfc0b8250 2023-11-28T11:54:39.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.504+0000 7f3de3fff700 1 --2- 172.21.15.50:0/1726894774 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3de8064ee0 0x7f3de8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.504+0000 7f3de3fff700 1 -- 172.21.15.50:0/1726894774 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3df0082130 con 0x7f3dfc0b8250 2023-11-28T11:54:39.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.504+0000 7f3dfaffd700 1 --2- 172.21.15.50:0/1726894774 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3de8064ee0 0x7f3de8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.504+0000 7f3dfaffd700 1 --2- 172.21.15.50:0/1726894774 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3de8064ee0 0x7f3de8067390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3dec000c00 tx=0x7f3dec008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:39.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.512+0000 7f3de3fff700 1 -- 172.21.15.50:0/1726894774 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3df004fe50 con 0x7f3dfc0b8250 2023-11-28T11:54:39.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.680+0000 7f3e01804700 1 -- 172.21.15.50:0/1726894774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3dfc072500 con 0x7f3dfc0b8250 2023-11-28T11:54:39.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.680+0000 7f3de3fff700 1 -- 172.21.15.50:0/1726894774 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3df0053470 con 0x7f3dfc0b8250 2023-11-28T11:54:39.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.684+0000 7f3e01804700 1 -- 172.21.15.50:0/1726894774 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3de8064ee0 msgr2=0x7f3de8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:39.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.684+0000 7f3e01804700 1 --2- 172.21.15.50:0/1726894774 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3de8064ee0 0x7f3de8067390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3dec000c00 tx=0x7f3dec008030 comp rx=0 tx=0).stop 2023-11-28T11:54:39.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.684+0000 7f3e01804700 1 -- 172.21.15.50:0/1726894774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dfc0b8250 msgr2=0x7f3dfc1f0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:39.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.684+0000 7f3e01804700 1 --2- 172.21.15.50:0/1726894774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dfc0b8250 0x7f3dfc1f0e10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3df000e9d0 tx=0x7f3df000ece0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.684+0000 7f3e01804700 1 -- 172.21.15.50:0/1726894774 shutdown_connections 2023-11-28T11:54:39.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.684+0000 7f3e01804700 1 --2- 172.21.15.50:0/1726894774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dfc0cf8c0 0x7f3dfc1f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.684+0000 7f3e01804700 1 --2- 172.21.15.50:0/1726894774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3dfc0b8250 0x7f3dfc1f0e10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.684+0000 7f3e01804700 1 --2- 172.21.15.50:0/1726894774 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3de8064ee0 0x7f3de8067390 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.684+0000 7f3e01804700 1 --2- 172.21.15.50:0/1726894774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dfc06a180 0x7f3dfc0b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.684+0000 7f3e01804700 1 -- 172.21.15.50:0/1726894774 >> 172.21.15.50:0/1726894774 conn(0x7f3dfc06beb0 msgr2=0x7f3dfc15bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:39.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.684+0000 7f3e01804700 1 -- 172.21.15.50:0/1726894774 shutdown_connections 2023-11-28T11:54:39.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.684+0000 7f3e01804700 1 -- 172.21.15.50:0/1726894774 wait complete. 2023-11-28T11:54:39.685 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-11-28T11:54:39.696 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi192.front.sepia.ceph.com... 2023-11-28T11:54:39.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:39.697 DEBUG:teuthology.orchestra.run.smithi192:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-28T11:54:39.725 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:54:39.725 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T11:54:39.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:39.726 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T11:54:39.762 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:54:39.762 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:54:39.770 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:54:39.770 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:54:39.777 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:39.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.928+0000 7fc18564e700 1 Processor -- start 2023-11-28T11:54:39.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.928+0000 7fc18564e700 1 -- start start 2023-11-28T11:54:39.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc18564e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc18013efb0 0x7fc18015e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc18564e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc18006caa0 0x7fc180070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc18564e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc18013f6c0 con 0x7fc18006c640 2023-11-28T11:54:39.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc18564e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18013f9a0 con 0x7fc18006caa0 2023-11-28T11:54:39.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc18564e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18013fc80 con 0x7fc18013efb0 2023-11-28T11:54:39.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc184e4d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc18006caa0 0x7fc180070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc17f7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc18006c640 0x7fc1800706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41642/0 (socket says 172.21.15.50:41642) 2023-11-28T11:54:39.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc17f7fe700 1 -- 172.21.15.50:0/442439691 learned_addr learned my addr 172.21.15.50:0/442439691 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:39.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc17ffff700 1 --2- 172.21.15.50:0/442439691 >> v2:172.21.15.192:3300/0 conn(0x7fc18013efb0 0x7fc18015e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc184e4d700 1 -- 172.21.15.50:0/442439691 >> v2:172.21.15.192:3300/0 conn(0x7fc18013efb0 msgr2=0x7fc18015e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc184e4d700 1 --2- 172.21.15.50:0/442439691 >> v2:172.21.15.192:3300/0 conn(0x7fc18013efb0 0x7fc18015e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc184e4d700 1 -- 172.21.15.50:0/442439691 >> v1:172.21.15.50:6789/0 conn(0x7fc18006c640 legacy=0x7fc1800706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc184e4d700 1 -- 172.21.15.50:0/442439691 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18013ff60 con 0x7fc18006caa0 2023-11-28T11:54:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc184e4d700 1 --2- 172.21.15.50:0/442439691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18006caa0 0x7fc180070e00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc18006e770 tx=0x7fc17800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45322d12ad92cc6c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc17effd700 1 -- 172.21.15.50:0/442439691 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17800e070 con 0x7fc18006caa0 2023-11-28T11:54:39.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc17effd700 1 -- 172.21.15.50:0/442439691 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17800bb20 con 0x7fc18006caa0 2023-11-28T11:54:39.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc17effd700 1 -- 172.21.15.50:0/442439691 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178012430 con 0x7fc18006caa0 2023-11-28T11:54:39.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc18564e700 1 -- 172.21.15.50:0/442439691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18006caa0 msgr2=0x7fc180070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:39.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc18564e700 1 --2- 172.21.15.50:0/442439691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18006caa0 0x7fc180070e00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc18006e770 tx=0x7fc17800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:39.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc18564e700 1 -- 172.21.15.50:0/442439691 shutdown_connections 2023-11-28T11:54:39.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc18564e700 1 --2- 172.21.15.50:0/442439691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18006caa0 0x7fc180070e00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc18564e700 1 --2- 172.21.15.50:0/442439691 >> v2:172.21.15.192:3300/0 conn(0x7fc18013efb0 0x7fc18015e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc18564e700 1 -- 172.21.15.50:0/442439691 >> 172.21.15.50:0/442439691 conn(0x7fc18006e000 msgr2=0x7fc1800b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:39.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc18564e700 1 -- 172.21.15.50:0/442439691 shutdown_connections 2023-11-28T11:54:39.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.932+0000 7fc18564e700 1 -- 172.21.15.50:0/442439691 wait complete. 2023-11-28T11:54:39.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc18564e700 1 Processor -- start 2023-11-28T11:54:39.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc18564e700 1 -- start start 2023-11-28T11:54:39.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc18564e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc18006c640 0x7fc180152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc18564e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18006caa0 0x7fc18013c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc18564e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc18013efb0 0x7fc180158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc18564e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc180152d30 con 0x7fc18006caa0 2023-11-28T11:54:39.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc18564e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc180153010 con 0x7fc18013efb0 2023-11-28T11:54:39.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc18564e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1801532f0 con 0x7fc18006c640 2023-11-28T11:54:39.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc17f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18006caa0 0x7fc18013c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc17f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18006caa0 0x7fc18013c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32864/0 (socket says 172.21.15.50:32864) 2023-11-28T11:54:39.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc17f7fe700 1 -- 172.21.15.50:0/1219537530 learned_addr learned my addr 172.21.15.50:0/1219537530 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:39.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc17ffff700 1 --2- 172.21.15.50:0/1219537530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc18006c640 0x7fc180152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc184e4d700 1 --2- 172.21.15.50:0/1219537530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc18013efb0 0x7fc180158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc17f7fe700 1 -- 172.21.15.50:0/1219537530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc18006c640 msgr2=0x7fc180152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:39.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc17f7fe700 1 --2- 172.21.15.50:0/1219537530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc18006c640 0x7fc180152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc17f7fe700 1 -- 172.21.15.50:0/1219537530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc18013efb0 msgr2=0x7fc180158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:39.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc17f7fe700 1 --2- 172.21.15.50:0/1219537530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc18013efb0 0x7fc180158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:39.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc17f7fe700 1 -- 172.21.15.50:0/1219537530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc178009a70 con 0x7fc18006caa0 2023-11-28T11:54:39.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc17f7fe700 1 --2- 172.21.15.50:0/1219537530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18006caa0 0x7fc18013c6f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc17400c700 tx=0x7fc17400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:39.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc17cff9700 1 -- 172.21.15.50:0/1219537530 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174005d90 con 0x7fc18006caa0 2023-11-28T11:54:39.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc17cff9700 1 -- 172.21.15.50:0/1219537530 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1740070d0 con 0x7fc18006caa0 2023-11-28T11:54:39.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc18564e700 1 -- 172.21.15.50:0/1219537530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc18013f380 con 0x7fc18006caa0 2023-11-28T11:54:39.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc17cff9700 1 -- 172.21.15.50:0/1219537530 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174007440 con 0x7fc18006caa0 2023-11-28T11:54:39.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.936+0000 7fc18564e700 1 -- 172.21.15.50:0/1219537530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc180140240 con 0x7fc18006caa0 2023-11-28T11:54:39.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.940+0000 7fc18564e700 1 -- 172.21.15.50:0/1219537530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc18006cea0 con 0x7fc18006caa0 2023-11-28T11:54:39.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.940+0000 7fc17cff9700 1 -- 172.21.15.50:0/1219537530 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc174019030 con 0x7fc18006caa0 2023-11-28T11:54:39.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.940+0000 7fc17cff9700 1 --2- 172.21.15.50:0/1219537530 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc16c064ee0 0x7fc16c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:39.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.940+0000 7fc17cff9700 1 -- 172.21.15.50:0/1219537530 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc174081450 con 0x7fc18006caa0 2023-11-28T11:54:39.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.940+0000 7fc17ffff700 1 --2- 172.21.15.50:0/1219537530 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc16c064ee0 0x7fc16c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:39.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.940+0000 7fc17ffff700 1 --2- 172.21.15.50:0/1219537530 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc16c064ee0 0x7fc16c067390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc170009b50 tx=0x7fc170009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:39.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:39.948+0000 7fc17cff9700 1 -- 172.21.15.50:0/1219537530 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc17404a400 con 0x7fc18006caa0 2023-11-28T11:54:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.112+0000 7fc18564e700 1 -- 172.21.15.50:0/1219537530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc180072c20 con 0x7fc18006caa0 2023-11-28T11:54:40.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.112+0000 7fc17cff9700 1 -- 172.21.15.50:0/1219537530 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19689 (secure 0 0 0) 0x7fc174060d00 con 0x7fc18006caa0 2023-11-28T11:54:40.113 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:40.114 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:54:30.086945+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:40.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.112+0000 7fc18564e700 1 -- 172.21.15.50:0/1219537530 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc16c064ee0 msgr2=0x7fc16c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.112+0000 7fc18564e700 1 --2- 172.21.15.50:0/1219537530 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc16c064ee0 0x7fc16c067390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc170009b50 tx=0x7fc170009240 comp rx=0 tx=0).stop 2023-11-28T11:54:40.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.112+0000 7fc18564e700 1 -- 172.21.15.50:0/1219537530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18006caa0 msgr2=0x7fc18013c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.112+0000 7fc18564e700 1 --2- 172.21.15.50:0/1219537530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18006caa0 0x7fc18013c6f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc17400c700 tx=0x7fc17400ca10 comp rx=0 tx=0).stop 2023-11-28T11:54:40.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.116+0000 7fc18564e700 1 -- 172.21.15.50:0/1219537530 shutdown_connections 2023-11-28T11:54:40.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.116+0000 7fc18564e700 1 --2- 172.21.15.50:0/1219537530 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc16c064ee0 0x7fc16c067390 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.116+0000 7fc18564e700 1 --2- 172.21.15.50:0/1219537530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc18013efb0 0x7fc180158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.116+0000 7fc18564e700 1 --2- 172.21.15.50:0/1219537530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc18006caa0 0x7fc18013c6f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.116+0000 7fc18564e700 1 --2- 172.21.15.50:0/1219537530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc18006c640 0x7fc180152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.116+0000 7fc18564e700 1 -- 172.21.15.50:0/1219537530 >> 172.21.15.50:0/1219537530 conn(0x7fc18006e000 msgr2=0x7fc18015cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:40.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.116+0000 7fc18564e700 1 -- 172.21.15.50:0/1219537530 shutdown_connections 2023-11-28T11:54:40.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.116+0000 7fc18564e700 1 -- 172.21.15.50:0/1219537530 wait complete. 2023-11-28T11:54:40.129 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:53:38.462826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:53:39.778621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:53:42.870360+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:54:40.130 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:54:40.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.252+0000 7fd0ec8a2700 1 Processor -- start 2023-11-28T11:54:40.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.252+0000 7fd0ec8a2700 1 -- start start 2023-11-28T11:54:40.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.252+0000 7fd0ec8a2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd0e806a4c0 0x7fd0e806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.252+0000 7fd0ec8a2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0e80cf0e0 0x7fd0e80cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.252+0000 7fd0ec8a2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e80cfa80 con 0x7fd0e80b1ae0 2023-11-28T11:54:40.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.252+0000 7fd0ec8a2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e80d0ab0 con 0x7fd0e806a4c0 2023-11-28T11:54:40.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.252+0000 7fd0ec8a2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e806a9c0 con 0x7fd0e80cf0e0 2023-11-28T11:54:40.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0e6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd0e806a4c0 0x7fd0e806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0e6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd0e806a4c0 0x7fd0e806d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32880/0 (socket says 172.21.15.50:32880) 2023-11-28T11:54:40.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0e6ffd700 1 -- 172.21.15.50:0/2966327885 learned_addr learned my addr 172.21.15.50:0/2966327885 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:40.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0e7fff700 1 --2- 172.21.15.50:0/2966327885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0e80cf0e0 0x7fd0e80cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0e6ffd700 1 -- 172.21.15.50:0/2966327885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0e80cf0e0 msgr2=0x7fd0e80cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:40.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0e6ffd700 1 --2- 172.21.15.50:0/2966327885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0e80cf0e0 0x7fd0e80cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0e6ffd700 1 -- 172.21.15.50:0/2966327885 >> v1:172.21.15.192:6789/0 conn(0x7fd0e80b1ae0 legacy=0x7fd0e80d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0e6ffd700 1 -- 172.21.15.50:0/2966327885 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e806aca0 con 0x7fd0e806a4c0 2023-11-28T11:54:40.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0e6ffd700 1 --2- 172.21.15.50:0/2966327885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e806a4c0 0x7fd0e806d8e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009910 tx=0x7fd0d8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686ef6f57874b6d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:40.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0e67fc700 1 -- 172.21.15.50:0/2966327885 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8011830 con 0x7fd0e806a4c0 2023-11-28T11:54:40.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0e67fc700 1 -- 172.21.15.50:0/2966327885 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d8011990 con 0x7fd0e806a4c0 2023-11-28T11:54:40.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0e67fc700 1 -- 172.21.15.50:0/2966327885 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8011d40 con 0x7fd0e806a4c0 2023-11-28T11:54:40.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0ec8a2700 1 -- 172.21.15.50:0/2966327885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e806a4c0 msgr2=0x7fd0e806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0ec8a2700 1 --2- 172.21.15.50:0/2966327885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e806a4c0 0x7fd0e806d8e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009910 tx=0x7fd0d8009c20 comp rx=0 tx=0).stop 2023-11-28T11:54:40.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0ec8a2700 1 -- 172.21.15.50:0/2966327885 shutdown_connections 2023-11-28T11:54:40.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0ec8a2700 1 --2- 172.21.15.50:0/2966327885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0e80cf0e0 0x7fd0e80cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0ec8a2700 1 --2- 172.21.15.50:0/2966327885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e806a4c0 0x7fd0e806d8e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0ec8a2700 1 -- 172.21.15.50:0/2966327885 >> 172.21.15.50:0/2966327885 conn(0x7fd0e809bbd0 msgr2=0x7fd0e80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:40.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0ec8a2700 1 -- 172.21.15.50:0/2966327885 shutdown_connections 2023-11-28T11:54:40.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.256+0000 7fd0ec8a2700 1 -- 172.21.15.50:0/2966327885 wait complete. 2023-11-28T11:54:40.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.260+0000 7fd0ec8a2700 1 Processor -- start 2023-11-28T11:54:40.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.260+0000 7fd0ec8a2700 1 -- start start 2023-11-28T11:54:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.260+0000 7fd0ec8a2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0e806a4c0 0x7fd0e80a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.260+0000 7fd0ec8a2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0e80b1ae0 0x7fd0e80c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0ec8a2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e80cf0e0 0x7fd0e81f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0ec8a2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e80c8270 con 0x7fd0e80cf0e0 2023-11-28T11:54:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0ec8a2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e80c7660 con 0x7fd0e806a4c0 2023-11-28T11:54:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0ec8a2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e80c7940 con 0x7fd0e80b1ae0 2023-11-28T11:54:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0e7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e80cf0e0 0x7fd0e81f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0e7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e80cf0e0 0x7fd0e81f1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32882/0 (socket says 172.21.15.50:32882) 2023-11-28T11:54:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0e7fff700 1 -- 172.21.15.50:0/4182131289 learned_addr learned my addr 172.21.15.50:0/4182131289 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0e77fe700 1 --2- 172.21.15.50:0/4182131289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0e806a4c0 0x7fd0e80a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0e6ffd700 1 --2- 172.21.15.50:0/4182131289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0e80b1ae0 0x7fd0e80c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0e7fff700 1 -- 172.21.15.50:0/4182131289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0e80b1ae0 msgr2=0x7fd0e80c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0e7fff700 1 --2- 172.21.15.50:0/4182131289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0e80b1ae0 0x7fd0e80c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0e7fff700 1 -- 172.21.15.50:0/4182131289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0e806a4c0 msgr2=0x7fd0e80a00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0e7fff700 1 --2- 172.21.15.50:0/4182131289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0e806a4c0 0x7fd0e80a00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0e7fff700 1 -- 172.21.15.50:0/4182131289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d8009570 con 0x7fd0e80cf0e0 2023-11-28T11:54:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0e7fff700 1 --2- 172.21.15.50:0/4182131289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e80cf0e0 0x7fd0e81f1ab0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000efc0 tx=0x7fd0e000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0cffff700 1 -- 172.21.15.50:0/4182131289 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0009ea0 con 0x7fd0e80cf0e0 2023-11-28T11:54:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0cffff700 1 -- 172.21.15.50:0/4182131289 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e000f040 con 0x7fd0e80cf0e0 2023-11-28T11:54:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0ec8a2700 1 -- 172.21.15.50:0/4182131289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e80b4380 con 0x7fd0e80cf0e0 2023-11-28T11:54:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0cffff700 1 -- 172.21.15.50:0/4182131289 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e000ced0 con 0x7fd0e80cf0e0 2023-11-28T11:54:40.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0ec8a2700 1 -- 172.21.15.50:0/4182131289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e806af80 con 0x7fd0e80cf0e0 2023-11-28T11:54:40.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.264+0000 7fd0ec8a2700 1 -- 172.21.15.50:0/4182131289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e80b1eb0 con 0x7fd0e80cf0e0 2023-11-28T11:54:40.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.268+0000 7fd0cffff700 1 -- 172.21.15.50:0/4182131289 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd0e0014480 con 0x7fd0e80cf0e0 2023-11-28T11:54:40.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.268+0000 7fd0cffff700 1 --2- 172.21.15.50:0/4182131289 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd0d4064ee0 0x7fd0d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.268+0000 7fd0cffff700 1 -- 172.21.15.50:0/4182131289 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd0e0082fe0 con 0x7fd0e80cf0e0 2023-11-28T11:54:40.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.268+0000 7fd0e77fe700 1 --2- 172.21.15.50:0/4182131289 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd0d4064ee0 0x7fd0d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.268+0000 7fd0e77fe700 1 --2- 172.21.15.50:0/4182131289 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd0d4064ee0 0x7fd0d4067390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc000f60 tx=0x7fd0dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.276+0000 7fd0cffff700 1 -- 172.21.15.50:0/4182131289 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd0e0050c70 con 0x7fd0e80cf0e0 2023-11-28T11:54:40.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.436+0000 7fd0ec8a2700 1 -- 172.21.15.50:0/4182131289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd0e8072500 con 0x7fd0e80cf0e0 2023-11-28T11:54:40.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.440+0000 7fd0cffff700 1 -- 172.21.15.50:0/4182131289 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd0e0018070 con 0x7fd0e80cf0e0 2023-11-28T11:54:40.440 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:54:40.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.440+0000 7fd0ec8a2700 1 -- 172.21.15.50:0/4182131289 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd0d4064ee0 msgr2=0x7fd0d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.440+0000 7fd0ec8a2700 1 --2- 172.21.15.50:0/4182131289 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd0d4064ee0 0x7fd0d4067390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc000f60 tx=0x7fd0dc009040 comp rx=0 tx=0).stop 2023-11-28T11:54:40.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.440+0000 7fd0ec8a2700 1 -- 172.21.15.50:0/4182131289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e80cf0e0 msgr2=0x7fd0e81f1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.440+0000 7fd0ec8a2700 1 --2- 172.21.15.50:0/4182131289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e80cf0e0 0x7fd0e81f1ab0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000efc0 tx=0x7fd0e000c3a0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.440+0000 7fd0ec8a2700 1 -- 172.21.15.50:0/4182131289 shutdown_connections 2023-11-28T11:54:40.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.440+0000 7fd0ec8a2700 1 --2- 172.21.15.50:0/4182131289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e80cf0e0 0x7fd0e81f1ab0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.440+0000 7fd0ec8a2700 1 --2- 172.21.15.50:0/4182131289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0e80b1ae0 0x7fd0e80c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.440+0000 7fd0ec8a2700 1 --2- 172.21.15.50:0/4182131289 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd0d4064ee0 0x7fd0d4067390 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.440+0000 7fd0ec8a2700 1 --2- 172.21.15.50:0/4182131289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0e806a4c0 0x7fd0e80a00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.440+0000 7fd0ec8a2700 1 -- 172.21.15.50:0/4182131289 >> 172.21.15.50:0/4182131289 conn(0x7fd0e809bbd0 msgr2=0x7fd0e80b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:40.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.440+0000 7fd0ec8a2700 1 -- 172.21.15.50:0/4182131289 shutdown_connections 2023-11-28T11:54:40.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.440+0000 7fd0ec8a2700 1 -- 172.21.15.50:0/4182131289 wait complete. 2023-11-28T11:54:40.455 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:54:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.572+0000 7f3d39e51700 1 Processor -- start 2023-11-28T11:54:40.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.572+0000 7f3d39e51700 1 -- start start 2023-11-28T11:54:40.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.572+0000 7f3d39e51700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d2c0dc7f0 0x7f3d2c051740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.572+0000 7f3d39e51700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3d2c006ce0 0x7f3d2c0e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.572+0000 7f3d39e51700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2c008020 con 0x7f3d2c006450 2023-11-28T11:54:40.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.572+0000 7f3d39e51700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2c0e3820 con 0x7f3d2c006ce0 2023-11-28T11:54:40.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.572+0000 7f3d39e51700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c0502a0 con 0x7f3d2c0dc7f0 2023-11-28T11:54:40.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d39650700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3d2c006450 0x7f3d2c037000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41652/0 (socket says 172.21.15.50:41652) 2023-11-28T11:54:40.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d39650700 1 -- 172.21.15.50:0/2461781381 learned_addr learned my addr 172.21.15.50:0/2461781381 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:40.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d38e4f700 1 --2- 172.21.15.50:0/2461781381 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d2c0dc7f0 0x7f3d2c051740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d33fff700 1 --2- 172.21.15.50:0/2461781381 >> v2:172.21.15.192:3300/0 conn(0x7f3d2c006ce0 0x7f3d2c0e32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d337fe700 1 -- 172.21.15.50:0/2461781381 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695453054 0 0) 0x7f3d2c008020 con 0x7f3d2c006450 2023-11-28T11:54:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d337fe700 1 -- 172.21.15.50:0/2461781381 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d240035d0 con 0x7f3d2c006450 2023-11-28T11:54:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d38e4f700 1 -- 172.21.15.50:0/2461781381 >> v2:172.21.15.192:3300/0 conn(0x7f3d2c006ce0 msgr2=0x7f3d2c0e32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d38e4f700 1 --2- 172.21.15.50:0/2461781381 >> v2:172.21.15.192:3300/0 conn(0x7f3d2c006ce0 0x7f3d2c0e32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d38e4f700 1 -- 172.21.15.50:0/2461781381 >> v1:172.21.15.50:6789/0 conn(0x7f3d2c006450 legacy=0x7f3d2c037000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d38e4f700 1 -- 172.21.15.50:0/2461781381 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c04fce0 con 0x7f3d2c0dc7f0 2023-11-28T11:54:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d38e4f700 1 --2- 172.21.15.50:0/2461781381 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d2c0dc7f0 0x7f3d2c051740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3d28009850 tx=0x7f3d28009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6c3c63f630c4375 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d337fe700 1 -- 172.21.15.50:0/2461781381 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2800f8a0 con 0x7f3d2c0dc7f0 2023-11-28T11:54:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d337fe700 1 -- 172.21.15.50:0/2461781381 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2800fa00 con 0x7f3d2c0dc7f0 2023-11-28T11:54:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d337fe700 1 -- 172.21.15.50:0/2461781381 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2800fdb0 con 0x7f3d2c0dc7f0 2023-11-28T11:54:40.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d39e51700 1 -- 172.21.15.50:0/2461781381 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d2c0dc7f0 msgr2=0x7f3d2c051740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d39e51700 1 --2- 172.21.15.50:0/2461781381 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d2c0dc7f0 0x7f3d2c051740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3d28009850 tx=0x7f3d28009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d39e51700 1 -- 172.21.15.50:0/2461781381 shutdown_connections 2023-11-28T11:54:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d39e51700 1 --2- 172.21.15.50:0/2461781381 >> v2:172.21.15.192:3300/0 conn(0x7f3d2c006ce0 0x7f3d2c0e32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d39e51700 1 --2- 172.21.15.50:0/2461781381 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d2c0dc7f0 0x7f3d2c051740 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d39e51700 1 -- 172.21.15.50:0/2461781381 >> 172.21.15.50:0/2461781381 conn(0x7f3d2c052000 msgr2=0x7f3d2c052400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d39e51700 1 -- 172.21.15.50:0/2461781381 shutdown_connections 2023-11-28T11:54:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d39e51700 1 -- 172.21.15.50:0/2461781381 wait complete. 2023-11-28T11:54:40.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d39e51700 1 Processor -- start 2023-11-28T11:54:40.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.576+0000 7f3d39e51700 1 -- start start 2023-11-28T11:54:40.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d39e51700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d2c006450 0x7f3d2c177d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d39e51700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d2c006ce0 0x7f3d2c0dd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d39e51700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d2c0dc7f0 0x7f3d2c04e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d39e51700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c1782a0 con 0x7f3d2c006450 2023-11-28T11:54:40.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d39e51700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c04d480 con 0x7f3d2c0dc7f0 2023-11-28T11:54:40.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d39e51700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c04d760 con 0x7f3d2c006ce0 2023-11-28T11:54:40.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d33fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d2c006ce0 0x7f3d2c0dd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d33fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d2c006ce0 0x7f3d2c0dd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:43722/0 (socket says 172.21.15.50:43722) 2023-11-28T11:54:40.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d38e4f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d2c006450 0x7f3d2c177d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d33fff700 1 -- 172.21.15.50:0/590561427 learned_addr learned my addr 172.21.15.50:0/590561427 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:40.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d39650700 1 --2- 172.21.15.50:0/590561427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d2c0dc7f0 0x7f3d2c04e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d33fff700 1 -- 172.21.15.50:0/590561427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d2c0dc7f0 msgr2=0x7f3d2c04e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d33fff700 1 --2- 172.21.15.50:0/590561427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d2c0dc7f0 0x7f3d2c04e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d33fff700 1 -- 172.21.15.50:0/590561427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d2c006450 msgr2=0x7f3d2c177d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d33fff700 1 --2- 172.21.15.50:0/590561427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d2c006450 0x7f3d2c177d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d33fff700 1 -- 172.21.15.50:0/590561427 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d280094b0 con 0x7f3d2c006ce0 2023-11-28T11:54:40.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d33fff700 1 --2- 172.21.15.50:0/590561427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d2c006ce0 0x7f3d2c0dd1f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000e9d0 tx=0x7f3d2000ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:40.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d317fa700 1 -- 172.21.15.50:0/590561427 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d20009720 con 0x7f3d2c006ce0 2023-11-28T11:54:40.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d317fa700 1 -- 172.21.15.50:0/590561427 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2000ee70 con 0x7f3d2c006ce0 2023-11-28T11:54:40.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d39e51700 1 -- 172.21.15.50:0/590561427 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2c0082c0 con 0x7f3d2c006ce0 2023-11-28T11:54:40.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d317fa700 1 -- 172.21.15.50:0/590561427 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2000ca50 con 0x7f3d2c006ce0 2023-11-28T11:54:40.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.580+0000 7f3d39e51700 1 -- 172.21.15.50:0/590561427 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2c04ffc0 con 0x7f3d2c006ce0 2023-11-28T11:54:40.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.584+0000 7f3d39e51700 1 -- 172.21.15.50:0/590561427 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2c0dcbc0 con 0x7f3d2c006ce0 2023-11-28T11:54:40.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.584+0000 7f3d317fa700 1 -- 172.21.15.50:0/590561427 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3d20019030 con 0x7f3d2c006ce0 2023-11-28T11:54:40.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.584+0000 7f3d317fa700 1 --2- 172.21.15.50:0/590561427 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d18064ee0 0x7f3d18067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.584+0000 7f3d317fa700 1 -- 172.21.15.50:0/590561427 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3d20082130 con 0x7f3d2c006ce0 2023-11-28T11:54:40.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.584+0000 7f3d38e4f700 1 --2- 172.21.15.50:0/590561427 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d18064ee0 0x7f3d18067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.584+0000 7f3d38e4f700 1 --2- 172.21.15.50:0/590561427 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d18064ee0 0x7f3d18067390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3d280090b0 tx=0x7f3d2801b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:40.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.596+0000 7f3d317fa700 1 -- 172.21.15.50:0/590561427 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3d2004ff20 con 0x7f3d2c006ce0 2023-11-28T11:54:40.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.760+0000 7f3d39e51700 1 -- 172.21.15.50:0/590561427 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d2c0059c0 con 0x7f3d2c006ce0 2023-11-28T11:54:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.760+0000 7f3d317fa700 1 -- 172.21.15.50:0/590561427 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d20053540 con 0x7f3d2c006ce0 2023-11-28T11:54:40.763 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:54:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.764+0000 7f3d39e51700 1 -- 172.21.15.50:0/590561427 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d18064ee0 msgr2=0x7f3d18067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.764+0000 7f3d39e51700 1 --2- 172.21.15.50:0/590561427 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d18064ee0 0x7f3d18067390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3d280090b0 tx=0x7f3d2801b040 comp rx=0 tx=0).stop 2023-11-28T11:54:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.764+0000 7f3d39e51700 1 -- 172.21.15.50:0/590561427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d2c006ce0 msgr2=0x7f3d2c0dd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.764+0000 7f3d39e51700 1 --2- 172.21.15.50:0/590561427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d2c006ce0 0x7f3d2c0dd1f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000e9d0 tx=0x7f3d2000ece0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.764+0000 7f3d39e51700 1 -- 172.21.15.50:0/590561427 shutdown_connections 2023-11-28T11:54:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.764+0000 7f3d39e51700 1 --2- 172.21.15.50:0/590561427 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d18064ee0 0x7f3d18067390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.764+0000 7f3d39e51700 1 --2- 172.21.15.50:0/590561427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d2c0dc7f0 0x7f3d2c04e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.764+0000 7f3d39e51700 1 --2- 172.21.15.50:0/590561427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d2c006ce0 0x7f3d2c0dd1f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.764+0000 7f3d39e51700 1 --2- 172.21.15.50:0/590561427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d2c006450 0x7f3d2c177d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.764+0000 7f3d39e51700 1 -- 172.21.15.50:0/590561427 >> 172.21.15.50:0/590561427 conn(0x7f3d2c052000 msgr2=0x7f3d2c053590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.764+0000 7f3d39e51700 1 -- 172.21.15.50:0/590561427 shutdown_connections 2023-11-28T11:54:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.764+0000 7f3d39e51700 1 -- 172.21.15.50:0/590561427 wait complete. 2023-11-28T11:54:40.778 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:54:40.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.888+0000 7f023f705700 1 Processor -- start 2023-11-28T11:54:40.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023f705700 1 -- start start 2023-11-28T11:54:40.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023f705700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02380cbfa0 0x7f02380cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023f705700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f02380c9590 0x7f023806b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023f705700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023806c3b0 con 0x7f0238158890 2023-11-28T11:54:40.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023f705700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023806c690 con 0x7f02380c9590 2023-11-28T11:54:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023f705700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023806c970 con 0x7f02380cbfa0 2023-11-28T11:54:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023d4a1700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0238158890 0x7f02380cb890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41666/0 (socket says 172.21.15.50:41666) 2023-11-28T11:54:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023d4a1700 1 -- 172.21.15.50:0/2546890480 learned_addr learned my addr 172.21.15.50:0/2546890480 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023cca0700 1 --2- 172.21.15.50:0/2546890480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02380cbfa0 0x7f02380cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023dca2700 1 --2- 172.21.15.50:0/2546890480 >> v2:172.21.15.192:3300/0 conn(0x7f02380c9590 0x7f023806b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f022ffff700 1 -- 172.21.15.50:0/2546890480 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836755749 0 0) 0x7f023806c3b0 con 0x7f0238158890 2023-11-28T11:54:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f022ffff700 1 -- 172.21.15.50:0/2546890480 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02240035d0 con 0x7f0238158890 2023-11-28T11:54:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023cca0700 1 -- 172.21.15.50:0/2546890480 >> v2:172.21.15.192:3300/0 conn(0x7f02380c9590 msgr2=0x7f023806b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023cca0700 1 --2- 172.21.15.50:0/2546890480 >> v2:172.21.15.192:3300/0 conn(0x7f02380c9590 0x7f023806b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023cca0700 1 -- 172.21.15.50:0/2546890480 >> v1:172.21.15.50:6789/0 conn(0x7f0238158890 legacy=0x7f02380cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023cca0700 1 -- 172.21.15.50:0/2546890480 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023806cc50 con 0x7f02380cbfa0 2023-11-28T11:54:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023dca2700 1 --2- 172.21.15.50:0/2546890480 >> v2:172.21.15.192:3300/0 conn(0x7f02380c9590 0x7f023806b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:40.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023cca0700 1 --2- 172.21.15.50:0/2546890480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02380cbfa0 0x7f02380cd520 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0228009850 tx=0x7f0228009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53c08dfcbe52dea4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:40.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f022ffff700 1 -- 172.21.15.50:0/2546890480 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228010800 con 0x7f02380cbfa0 2023-11-28T11:54:40.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f022ffff700 1 -- 172.21.15.50:0/2546890480 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0228010960 con 0x7f02380cbfa0 2023-11-28T11:54:40.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f022ffff700 1 -- 172.21.15.50:0/2546890480 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228010d10 con 0x7f02380cbfa0 2023-11-28T11:54:40.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023f705700 1 -- 172.21.15.50:0/2546890480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02380cbfa0 msgr2=0x7f02380cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023f705700 1 --2- 172.21.15.50:0/2546890480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02380cbfa0 0x7f02380cd520 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0228009850 tx=0x7f0228009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:40.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023f705700 1 -- 172.21.15.50:0/2546890480 shutdown_connections 2023-11-28T11:54:40.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023f705700 1 --2- 172.21.15.50:0/2546890480 >> v2:172.21.15.192:3300/0 conn(0x7f02380c9590 0x7f023806b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023f705700 1 --2- 172.21.15.50:0/2546890480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02380cbfa0 0x7f02380cd520 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023f705700 1 -- 172.21.15.50:0/2546890480 >> 172.21.15.50:0/2546890480 conn(0x7f02380b0a90 msgr2=0x7f02380b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:40.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023f705700 1 -- 172.21.15.50:0/2546890480 shutdown_connections 2023-11-28T11:54:40.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.892+0000 7f023f705700 1 -- 172.21.15.50:0/2546890480 wait complete. 2023-11-28T11:54:40.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023f705700 1 Processor -- start 2023-11-28T11:54:40.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023f705700 1 -- start start 2023-11-28T11:54:40.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023f705700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02380c9590 0x7f02380c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023f705700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02380cbfa0 0x7f02380b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023f705700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0238158890 0x7f02380b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023f705700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02380b3bc0 con 0x7f02380c9590 2023-11-28T11:54:40.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023f705700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02380b25e0 con 0x7f0238158890 2023-11-28T11:54:40.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023f705700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02380b28c0 con 0x7f02380cbfa0 2023-11-28T11:54:40.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023d4a1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02380c9590 0x7f02380c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023d4a1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02380c9590 0x7f02380c4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32910/0 (socket says 172.21.15.50:32910) 2023-11-28T11:54:40.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023d4a1700 1 -- 172.21.15.50:0/3010306068 learned_addr learned my addr 172.21.15.50:0/3010306068 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:40.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023cca0700 1 --2- 172.21.15.50:0/3010306068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02380cbfa0 0x7f02380b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023dca2700 1 --2- 172.21.15.50:0/3010306068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0238158890 0x7f02380b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023d4a1700 1 -- 172.21.15.50:0/3010306068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02380cbfa0 msgr2=0x7f02380b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023d4a1700 1 --2- 172.21.15.50:0/3010306068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02380cbfa0 0x7f02380b3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023d4a1700 1 -- 172.21.15.50:0/3010306068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0238158890 msgr2=0x7f02380b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:40.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023d4a1700 1 --2- 172.21.15.50:0/3010306068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0238158890 0x7f02380b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:40.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023d4a1700 1 -- 172.21.15.50:0/3010306068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0230009a70 con 0x7f02380c9590 2023-11-28T11:54:40.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023d4a1700 1 --2- 172.21.15.50:0/3010306068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02380c9590 0x7f02380c4820 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f023400c4d0 tx=0x7f023400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:40.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f022dffb700 1 -- 172.21.15.50:0/3010306068 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0234005d90 con 0x7f02380c9590 2023-11-28T11:54:40.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023f705700 1 -- 172.21.15.50:0/3010306068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02280094b0 con 0x7f02380c9590 2023-11-28T11:54:40.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f022dffb700 1 -- 172.21.15.50:0/3010306068 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02340070d0 con 0x7f02380c9590 2023-11-28T11:54:40.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f022dffb700 1 -- 172.21.15.50:0/3010306068 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0234007480 con 0x7f02380c9590 2023-11-28T11:54:40.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.896+0000 7f023f705700 1 -- 172.21.15.50:0/3010306068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0238069c40 con 0x7f02380c9590 2023-11-28T11:54:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.900+0000 7f022dffb700 1 -- 172.21.15.50:0/3010306068 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0234019030 con 0x7f02380c9590 2023-11-28T11:54:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.900+0000 7f023f705700 1 -- 172.21.15.50:0/3010306068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023806cf30 con 0x7f02380c9590 2023-11-28T11:54:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.900+0000 7f022dffb700 1 --2- 172.21.15.50:0/3010306068 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f021c064ee0 0x7f021c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.900+0000 7f022dffb700 1 -- 172.21.15.50:0/3010306068 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0234081610 con 0x7f02380c9590 2023-11-28T11:54:40.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.900+0000 7f023cca0700 1 --2- 172.21.15.50:0/3010306068 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f021c064ee0 0x7f021c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:40.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.900+0000 7f023cca0700 1 --2- 172.21.15.50:0/3010306068 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f021c064ee0 0x7f021c067390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f02380cc390 tx=0x7f022801b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:40.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:40.904+0000 7f022dffb700 1 -- 172.21.15.50:0/3010306068 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f023404f310 con 0x7f02380c9590 2023-11-28T11:54:41.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.064+0000 7f023f705700 1 -- 172.21.15.50:0/3010306068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0238069dd0 con 0x7f02380c9590 2023-11-28T11:54:41.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.064+0000 7f022dffb700 1 -- 172.21.15.50:0/3010306068 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0234052930 con 0x7f02380c9590 2023-11-28T11:54:41.066 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.068+0000 7f023f705700 1 -- 172.21.15.50:0/3010306068 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f021c064ee0 msgr2=0x7f021c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.068+0000 7f023f705700 1 --2- 172.21.15.50:0/3010306068 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f021c064ee0 0x7f021c067390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f02380cc390 tx=0x7f022801b040 comp rx=0 tx=0).stop 2023-11-28T11:54:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.068+0000 7f023f705700 1 -- 172.21.15.50:0/3010306068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02380c9590 msgr2=0x7f02380c4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.068+0000 7f023f705700 1 --2- 172.21.15.50:0/3010306068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02380c9590 0x7f02380c4820 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f023400c4d0 tx=0x7f023400c7e0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.068+0000 7f023f705700 1 -- 172.21.15.50:0/3010306068 shutdown_connections 2023-11-28T11:54:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.068+0000 7f023f705700 1 --2- 172.21.15.50:0/3010306068 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f021c064ee0 0x7f021c067390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.068+0000 7f023f705700 1 --2- 172.21.15.50:0/3010306068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0238158890 0x7f02380b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.068+0000 7f023f705700 1 --2- 172.21.15.50:0/3010306068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02380cbfa0 0x7f02380b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.068+0000 7f023f705700 1 --2- 172.21.15.50:0/3010306068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02380c9590 0x7f02380c4820 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.068+0000 7f023f705700 1 -- 172.21.15.50:0/3010306068 >> 172.21.15.50:0/3010306068 conn(0x7f02380b0a90 msgr2=0x7f0238154410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:41.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.068+0000 7f023f705700 1 -- 172.21.15.50:0/3010306068 shutdown_connections 2023-11-28T11:54:41.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.068+0000 7f023f705700 1 -- 172.21.15.50:0/3010306068 wait complete. 2023-11-28T11:54:41.086 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:54:41.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.208+0000 7fdaaf59e700 1 Processor -- start 2023-11-28T11:54:41.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.208+0000 7fdaaf59e700 1 -- start start 2023-11-28T11:54:41.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaf59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdab00cf740 0x7fdab00b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaf59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdab00c4170 0x7fdab00c4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaf59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab00cb050 con 0x7fdab00b2110 2023-11-28T11:54:41.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaf59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab015da00 con 0x7fdab00c4170 2023-11-28T11:54:41.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaf59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab00b2a20 con 0x7fdab00cf740 2023-11-28T11:54:41.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdab00c4170 0x7fdab00c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdab00c4170 0x7fdab00c4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32914/0 (socket says 172.21.15.50:32914) 2023-11-28T11:54:41.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaed9d700 1 -- 172.21.15.50:0/3745751256 learned_addr learned my addr 172.21.15.50:0/3745751256 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:41.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaa5d9b700 1 --2- 172.21.15.50:0/3745751256 >> v2:172.21.15.192:3300/0 conn(0x7fdab00cf740 0x7fdab00b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaed9d700 1 -- 172.21.15.50:0/3745751256 >> v2:172.21.15.192:3300/0 conn(0x7fdab00cf740 msgr2=0x7fdab00b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:41.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaed9d700 1 --2- 172.21.15.50:0/3745751256 >> v2:172.21.15.192:3300/0 conn(0x7fdab00cf740 0x7fdab00b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaed9d700 1 -- 172.21.15.50:0/3745751256 >> v1:172.21.15.192:6789/0 conn(0x7fdab00b2110 legacy=0x7fdab00cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:41.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaed9d700 1 -- 172.21.15.50:0/3745751256 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab015dc50 con 0x7fdab00c4170 2023-11-28T11:54:41.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaa5d9b700 1 --2- 172.21.15.50:0/3745751256 >> v2:172.21.15.192:3300/0 conn(0x7fdab00cf740 0x7fdab00b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:41.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaed9d700 1 --2- 172.21.15.50:0/3745751256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdab00c4170 0x7fdab00c4610 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdab00d1720 tx=0x7fdaa800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe50760cafb16ff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:41.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaadd9b700 1 -- 172.21.15.50:0/3745751256 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa800e070 con 0x7fdab00c4170 2023-11-28T11:54:41.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaadd9b700 1 -- 172.21.15.50:0/3745751256 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa800b9c0 con 0x7fdab00c4170 2023-11-28T11:54:41.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaadd9b700 1 -- 172.21.15.50:0/3745751256 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa800bd70 con 0x7fdab00c4170 2023-11-28T11:54:41.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaf59e700 1 -- 172.21.15.50:0/3745751256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdab00c4170 msgr2=0x7fdab00c4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaf59e700 1 --2- 172.21.15.50:0/3745751256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdab00c4170 0x7fdab00c4610 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdab00d1720 tx=0x7fdaa800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:41.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaf59e700 1 -- 172.21.15.50:0/3745751256 shutdown_connections 2023-11-28T11:54:41.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaf59e700 1 --2- 172.21.15.50:0/3745751256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdab00c4170 0x7fdab00c4610 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaf59e700 1 --2- 172.21.15.50:0/3745751256 >> v2:172.21.15.192:3300/0 conn(0x7fdab00cf740 0x7fdab00b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaf59e700 1 -- 172.21.15.50:0/3745751256 >> 172.21.15.50:0/3745751256 conn(0x7fdab00cd0a0 msgr2=0x7fdab00cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:41.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaf59e700 1 -- 172.21.15.50:0/3745751256 shutdown_connections 2023-11-28T11:54:41.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.212+0000 7fdaaf59e700 1 -- 172.21.15.50:0/3745751256 wait complete. 2023-11-28T11:54:41.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaaf59e700 1 Processor -- start 2023-11-28T11:54:41.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaaf59e700 1 -- start start 2023-11-28T11:54:41.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaaf59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdab00b2110 0x7fdab014fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaaf59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdab00c4170 0x7fdab01537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaaf59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdab00cf740 0x7fdab00c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaaf59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab01500f0 con 0x7fdab00c4170 2023-11-28T11:54:41.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaaf59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab015c0c0 con 0x7fdab00cf740 2023-11-28T11:54:41.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaaf59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab0153d20 con 0x7fdab00b2110 2023-11-28T11:54:41.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaa5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdab00c4170 0x7fdab01537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaa5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdab00c4170 0x7fdab01537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32922/0 (socket says 172.21.15.50:32922) 2023-11-28T11:54:41.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaa5d9b700 1 -- 172.21.15.50:0/4215322256 learned_addr learned my addr 172.21.15.50:0/4215322256 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:41.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaaed9d700 1 --2- 172.21.15.50:0/4215322256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdab00cf740 0x7fdab00c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaae59c700 1 --2- 172.21.15.50:0/4215322256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdab00b2110 0x7fdab014fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaa5d9b700 1 -- 172.21.15.50:0/4215322256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdab00b2110 msgr2=0x7fdab014fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaa5d9b700 1 --2- 172.21.15.50:0/4215322256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdab00b2110 0x7fdab014fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaa5d9b700 1 -- 172.21.15.50:0/4215322256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdab00cf740 msgr2=0x7fdab00c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaa5d9b700 1 --2- 172.21.15.50:0/4215322256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdab00cf740 0x7fdab00c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaa5d9b700 1 -- 172.21.15.50:0/4215322256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa8009b30 con 0x7fdab00c4170 2023-11-28T11:54:41.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.216+0000 7fdaa5d9b700 1 --2- 172.21.15.50:0/4215322256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdab00c4170 0x7fdab01537e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fda9800e760 tx=0x7fda9800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:41.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.220+0000 7fdaa77fe700 1 -- 172.21.15.50:0/4215322256 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9800c070 con 0x7fdab00c4170 2023-11-28T11:54:41.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.220+0000 7fdaa77fe700 1 -- 172.21.15.50:0/4215322256 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda98013610 con 0x7fdab00c4170 2023-11-28T11:54:41.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.220+0000 7fdaaf59e700 1 -- 172.21.15.50:0/4215322256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab015e210 con 0x7fdab00c4170 2023-11-28T11:54:41.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.220+0000 7fdaa77fe700 1 -- 172.21.15.50:0/4215322256 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda980139c0 con 0x7fdab00c4170 2023-11-28T11:54:41.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.220+0000 7fdaaf59e700 1 -- 172.21.15.50:0/4215322256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab015df30 con 0x7fdab00c4170 2023-11-28T11:54:41.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.220+0000 7fdaaf59e700 1 -- 172.21.15.50:0/4215322256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab015e4f0 con 0x7fdab00c4170 2023-11-28T11:54:41.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.220+0000 7fdaa77fe700 1 -- 172.21.15.50:0/4215322256 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fda98023070 con 0x7fdab00c4170 2023-11-28T11:54:41.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.220+0000 7fdaa77fe700 1 --2- 172.21.15.50:0/4215322256 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fda90064ee0 0x7fda90067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.220+0000 7fdaa77fe700 1 -- 172.21.15.50:0/4215322256 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fda98081f40 con 0x7fdab00c4170 2023-11-28T11:54:41.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.224+0000 7fdaae59c700 1 --2- 172.21.15.50:0/4215322256 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fda90064ee0 0x7fda90067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.224+0000 7fdaae59c700 1 --2- 172.21.15.50:0/4215322256 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fda90064ee0 0x7fda90067390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdab00cbd90 tx=0x7fdaa0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:41.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.228+0000 7fdaa77fe700 1 -- 172.21.15.50:0/4215322256 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fda9804fcc0 con 0x7fdab00c4170 2023-11-28T11:54:41.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.392+0000 7fdaaf59e700 1 -- 172.21.15.50:0/4215322256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdab0072c20 con 0x7fdab00c4170 2023-11-28T11:54:41.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.392+0000 7fdaa77fe700 1 -- 172.21.15.50:0/4215322256 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fda980094e0 con 0x7fdab00c4170 2023-11-28T11:54:41.395 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:54:41.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.396+0000 7fdaaf59e700 1 -- 172.21.15.50:0/4215322256 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fda90064ee0 msgr2=0x7fda90067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.396+0000 7fdaaf59e700 1 --2- 172.21.15.50:0/4215322256 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fda90064ee0 0x7fda90067390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdab00cbd90 tx=0x7fdaa0009040 comp rx=0 tx=0).stop 2023-11-28T11:54:41.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.396+0000 7fdaaf59e700 1 -- 172.21.15.50:0/4215322256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdab00c4170 msgr2=0x7fdab01537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.396+0000 7fdaaf59e700 1 --2- 172.21.15.50:0/4215322256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdab00c4170 0x7fdab01537e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fda9800e760 tx=0x7fda9800ea70 comp rx=0 tx=0).stop 2023-11-28T11:54:41.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.396+0000 7fdaaf59e700 1 -- 172.21.15.50:0/4215322256 shutdown_connections 2023-11-28T11:54:41.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.396+0000 7fdaaf59e700 1 --2- 172.21.15.50:0/4215322256 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fda90064ee0 0x7fda90067390 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.396+0000 7fdaaf59e700 1 --2- 172.21.15.50:0/4215322256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdab00cf740 0x7fdab00c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.396+0000 7fdaaf59e700 1 --2- 172.21.15.50:0/4215322256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdab00c4170 0x7fdab01537e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.396+0000 7fdaaf59e700 1 --2- 172.21.15.50:0/4215322256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdab00b2110 0x7fdab014fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.396+0000 7fdaaf59e700 1 -- 172.21.15.50:0/4215322256 >> 172.21.15.50:0/4215322256 conn(0x7fdab00cd0a0 msgr2=0x7fdab00cfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:41.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.396+0000 7fdaaf59e700 1 -- 172.21.15.50:0/4215322256 shutdown_connections 2023-11-28T11:54:41.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.396+0000 7fdaaf59e700 1 -- 172.21.15.50:0/4215322256 wait complete. 2023-11-28T11:54:41.410 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:54:41.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81dca22700 1 Processor -- start 2023-11-28T11:54:41.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81dca22700 1 -- start start 2023-11-28T11:54:41.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81dca22700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d80cc2f0 0x7f81d80ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81dca22700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d809c0e0 con 0x7f81d815a3e0 2023-11-28T11:54:41.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81dca22700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d80b13e0 con 0x7f81d80b2d30 2023-11-28T11:54:41.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81dca22700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80b16c0 con 0x7f81d80cc2f0 2023-11-28T11:54:41.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d659c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f81d815a3e0 0x7f81d80cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41674/0 (socket says 172.21.15.50:41674) 2023-11-28T11:54:41.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d659c700 1 -- 172.21.15.50:0/2093232390 learned_addr learned my addr 172.21.15.50:0/2093232390 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:41.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d6d9d700 1 --2- 172.21.15.50:0/2093232390 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d80cc2f0 0x7f81d80ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d5d9b700 1 -- 172.21.15.50:0/2093232390 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694280746 0 0) 0x7f81d809c0e0 con 0x7f81d815a3e0 2023-11-28T11:54:41.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d5d9b700 1 -- 172.21.15.50:0/2093232390 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c00035d0 con 0x7f81d815a3e0 2023-11-28T11:54:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d5d9b700 1 -- 172.21.15.50:0/2093232390 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3907190522 0 0) 0x7f81c00035d0 con 0x7f81d815a3e0 2023-11-28T11:54:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d5d9b700 1 -- 172.21.15.50:0/2093232390 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d80cc2f0 msgr2=0x7f81d80ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d5d9b700 1 --2- 172.21.15.50:0/2093232390 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d80cc2f0 0x7f81d80ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d5d9b700 1 -- 172.21.15.50:0/2093232390 >> v1:172.21.15.192:6789/0 conn(0x7f81d80b2d30 legacy=0x7f81d8069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d5d9b700 1 -- 172.21.15.50:0/2093232390 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d80b19a0 con 0x7f81d815a3e0 2023-11-28T11:54:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d5d9b700 1 -- 172.21.15.50:0/2093232390 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f81cc001670 con 0x7f81d815a3e0 2023-11-28T11:54:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d5d9b700 1 -- 172.21.15.50:0/2093232390 >> v1:172.21.15.50:6789/0 conn(0x7f81d815a3e0 legacy=0x7f81d80cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d5d9b700 1 --2- 172.21.15.50:0/2093232390 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d80cc2f0 0x7f81c0003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d5d9b700 1 --2- 172.21.15.50:0/2093232390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c0003f90 0x7f81c0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d5d9b700 1 --2- 172.21.15.50:0/2093232390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c0004db0 0x7f81c0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d5d9b700 1 -- 172.21.15.50:0/2093232390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80b16c0 con 0x7f81c0004db0 2023-11-28T11:54:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d5d9b700 1 -- 172.21.15.50:0/2093232390 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c000ba60 con 0x7f81c0003f90 2023-11-28T11:54:41.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d5d9b700 1 -- 172.21.15.50:0/2093232390 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c000bc20 con 0x7f81d80cc2f0 2023-11-28T11:54:41.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d759e700 1 --2- 172.21.15.50:0/2093232390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c0004db0 0x7f81c0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d6d9d700 1 --2- 172.21.15.50:0/2093232390 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d80cc2f0 0x7f81c0003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.532+0000 7f81d659c700 1 --2- 172.21.15.50:0/2093232390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c0003f90 0x7f81c0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81d759e700 1 -- 172.21.15.50:0/2093232390 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d80cc2f0 msgr2=0x7f81c0003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:41.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81d759e700 1 --2- 172.21.15.50:0/2093232390 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d80cc2f0 0x7f81c0003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81d759e700 1 -- 172.21.15.50:0/2093232390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c0003f90 msgr2=0x7f81c0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:41.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81d759e700 1 --2- 172.21.15.50:0/2093232390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c0003f90 0x7f81c0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81d759e700 1 -- 172.21.15.50:0/2093232390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c00035d0 con 0x7f81c0004db0 2023-11-28T11:54:41.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81d759e700 1 --2- 172.21.15.50:0/2093232390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c0004db0 0x7f81c0005220 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f81d000c290 tx=0x7f81c00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196eeec09e3e2288 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:41.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81d5d9b700 1 -- 172.21.15.50:0/2093232390 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0001e70 con 0x7f81c0004db0 2023-11-28T11:54:41.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81d5d9b700 1 -- 172.21.15.50:0/2093232390 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d000ce50 con 0x7f81c0004db0 2023-11-28T11:54:41.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81d5d9b700 1 -- 172.21.15.50:0/2093232390 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0012660 con 0x7f81c0004db0 2023-11-28T11:54:41.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81dca22700 1 -- 172.21.15.50:0/2093232390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c0004db0 msgr2=0x7f81c0005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81dca22700 1 --2- 172.21.15.50:0/2093232390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c0004db0 0x7f81c0005220 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f81d000c290 tx=0x7f81c00058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81d759e700 1 -- 172.21.15.50:0/2093232390 reap_dead start 2023-11-28T11:54:41.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81dca22700 1 -- 172.21.15.50:0/2093232390 shutdown_connections 2023-11-28T11:54:41.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81dca22700 1 -- 172.21.15.50:0/2093232390 >> 172.21.15.50:0/2093232390 conn(0x7f81d80cae70 msgr2=0x7f81d80cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:41.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81dca22700 1 -- 172.21.15.50:0/2093232390 shutdown_connections 2023-11-28T11:54:41.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81dca22700 1 -- 172.21.15.50:0/2093232390 wait complete. 2023-11-28T11:54:41.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81dca22700 1 Processor -- start 2023-11-28T11:54:41.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.536+0000 7f81dca22700 1 -- start start 2023-11-28T11:54:41.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81dca22700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c0004db0 0x7f81d8158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81dca22700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d815c300 0x7f81d80c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81dca22700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d815c770 0x7f81d80c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81dca22700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d815bee0 con 0x7f81d815c300 2023-11-28T11:54:41.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81dca22700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80c63b0 con 0x7f81c0004db0 2023-11-28T11:54:41.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81dca22700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d815b260 con 0x7f81d815c770 2023-11-28T11:54:41.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81d659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d815c300 0x7f81d80c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81d759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d815c770 0x7f81d80c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81d659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d815c300 0x7f81d80c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:32942/0 (socket says 172.21.15.50:32942) 2023-11-28T11:54:41.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81d6d9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c0004db0 0x7f81d8158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81d659c700 1 -- 172.21.15.50:0/350836354 learned_addr learned my addr 172.21.15.50:0/350836354 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:41.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81d759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d815c770 0x7f81d80c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:43760/0 (socket says 172.21.15.50:43760) 2023-11-28T11:54:41.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81d759e700 1 -- 172.21.15.50:0/350836354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c0004db0 msgr2=0x7f81d8158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81d759e700 1 --2- 172.21.15.50:0/350836354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c0004db0 0x7f81d8158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81d759e700 1 -- 172.21.15.50:0/350836354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d815c300 msgr2=0x7f81d80c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81d759e700 1 --2- 172.21.15.50:0/350836354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d815c300 0x7f81d80c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81d759e700 1 -- 172.21.15.50:0/350836354 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d806a350 con 0x7f81d815c770 2023-11-28T11:54:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81d659c700 1 --2- 172.21.15.50:0/350836354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d815c300 0x7f81d80c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81d759e700 1 --2- 172.21.15.50:0/350836354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d815c770 0x7f81d80c9f60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f81d0016000 tx=0x7f81d00015b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81bf7fe700 1 -- 172.21.15.50:0/350836354 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0003e30 con 0x7f81d815c770 2023-11-28T11:54:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81bf7fe700 1 -- 172.21.15.50:0/350836354 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d0005070 con 0x7f81d815c770 2023-11-28T11:54:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81dca22700 1 -- 172.21.15.50:0/350836354 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d80b1c80 con 0x7f81d815c770 2023-11-28T11:54:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81bf7fe700 1 -- 172.21.15.50:0/350836354 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0005400 con 0x7f81d815c770 2023-11-28T11:54:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.540+0000 7f81dca22700 1 -- 172.21.15.50:0/350836354 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d80ac280 con 0x7f81d815c770 2023-11-28T11:54:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.544+0000 7f81dca22700 1 -- 172.21.15.50:0/350836354 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d8072500 con 0x7f81d815c770 2023-11-28T11:54:41.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.544+0000 7f81bf7fe700 1 -- 172.21.15.50:0/350836354 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f81d002d070 con 0x7f81d815c770 2023-11-28T11:54:41.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.544+0000 7f81bf7fe700 1 --2- 172.21.15.50:0/350836354 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f81c4064ee0 0x7f81c4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.544+0000 7f81bf7fe700 1 -- 172.21.15.50:0/350836354 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f81d0083680 con 0x7f81d815c770 2023-11-28T11:54:41.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.544+0000 7f81d6d9d700 1 --2- 172.21.15.50:0/350836354 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f81c4064ee0 0x7f81c4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.548+0000 7f81d6d9d700 1 --2- 172.21.15.50:0/350836354 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f81c4064ee0 0x7f81c4067390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009c70 tx=0x7f81c8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:41.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.556+0000 7f81bf7fe700 1 -- 172.21.15.50:0/350836354 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f81d00514f0 con 0x7f81d815c770 2023-11-28T11:54:41.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.720+0000 7f81dca22700 1 -- 172.21.15.50:0/350836354 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f81d806f980 con 0x7f81d815c770 2023-11-28T11:54:41.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.720+0000 7f81bf7fe700 1 -- 172.21.15.50:0/350836354 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f81d002b020 con 0x7f81d815c770 2023-11-28T11:54:41.722 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.724+0000 7f81dca22700 1 -- 172.21.15.50:0/350836354 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f81c4064ee0 msgr2=0x7f81c4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.724+0000 7f81dca22700 1 --2- 172.21.15.50:0/350836354 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f81c4064ee0 0x7f81c4067390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009c70 tx=0x7f81c8009240 comp rx=0 tx=0).stop 2023-11-28T11:54:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.724+0000 7f81dca22700 1 -- 172.21.15.50:0/350836354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d815c770 msgr2=0x7f81d80c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.724+0000 7f81dca22700 1 --2- 172.21.15.50:0/350836354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d815c770 0x7f81d80c9f60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f81d0016000 tx=0x7f81d00015b0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.724+0000 7f81dca22700 1 -- 172.21.15.50:0/350836354 shutdown_connections 2023-11-28T11:54:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.724+0000 7f81dca22700 1 --2- 172.21.15.50:0/350836354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d815c770 0x7f81d80c9f60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.724+0000 7f81dca22700 1 --2- 172.21.15.50:0/350836354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d815c300 0x7f81d80c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.724+0000 7f81dca22700 1 --2- 172.21.15.50:0/350836354 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f81c4064ee0 0x7f81c4067390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.724+0000 7f81dca22700 1 --2- 172.21.15.50:0/350836354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c0004db0 0x7f81d8158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.724+0000 7f81dca22700 1 -- 172.21.15.50:0/350836354 >> 172.21.15.50:0/350836354 conn(0x7f81d80cae70 msgr2=0x7f81d80ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:41.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.724+0000 7f81dca22700 1 -- 172.21.15.50:0/350836354 shutdown_connections 2023-11-28T11:54:41.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.724+0000 7f81dca22700 1 -- 172.21.15.50:0/350836354 wait complete. 2023-11-28T11:54:41.738 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:54:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.860+0000 7f379b516700 1 Processor -- start 2023-11-28T11:54:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.860+0000 7f379b516700 1 -- start start 2023-11-28T11:54:41.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.860+0000 7f379b516700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f379406c640 0x7f379406cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.860+0000 7f379b516700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3794152f80 con 0x7f3794152bb0 2023-11-28T11:54:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.860+0000 7f379b516700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3794159a30 con 0x7f37940b2020 2023-11-28T11:54:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.860+0000 7f379a514700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3794152bb0 0x7f379415caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59774/0 (socket says 172.21.15.50:59774) 2023-11-28T11:54:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.860+0000 7f379b516700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379406d020 con 0x7f379406c640 2023-11-28T11:54:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.860+0000 7f379a514700 1 -- 172.21.15.50:0/2545252955 learned_addr learned my addr 172.21.15.50:0/2545252955 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.860+0000 7f3799d13700 1 --2- 172.21.15.50:0/2545252955 >> v2:172.21.15.50:3300/0 conn(0x7f379406c640 0x7f379406cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.860+0000 7f3799512700 1 -- 172.21.15.50:0/2545252955 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 858002261 0 0) 0x7f3794152f80 con 0x7f3794152bb0 2023-11-28T11:54:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.860+0000 7f3799512700 1 -- 172.21.15.50:0/2545252955 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37800057e0 con 0x7f3794152bb0 2023-11-28T11:54:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.860+0000 7f3799d13700 1 -- 172.21.15.50:0/2545252955 >> v1:172.21.15.192:6789/0 conn(0x7f37940b2020 legacy=0x7f37940b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.864+0000 7f3799d13700 1 -- 172.21.15.50:0/2545252955 >> v1:172.21.15.50:6789/0 conn(0x7f3794152bb0 legacy=0x7f379415caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.864+0000 7f3799d13700 1 -- 172.21.15.50:0/2545252955 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3794158eb0 con 0x7f379406c640 2023-11-28T11:54:41.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.864+0000 7f3799d13700 1 --2- 172.21.15.50:0/2545252955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f379406c640 0x7f379406cae0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3784009850 tx=0x7f3784009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30fb803edb85415 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:41.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.864+0000 7f3799512700 1 -- 172.21.15.50:0/2545252955 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784004230 con 0x7f379406c640 2023-11-28T11:54:41.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.864+0000 7f3799512700 1 -- 172.21.15.50:0/2545252955 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3784004390 con 0x7f379406c640 2023-11-28T11:54:41.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.864+0000 7f3799512700 1 -- 172.21.15.50:0/2545252955 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37840036c0 con 0x7f379406c640 2023-11-28T11:54:41.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.864+0000 7f379b516700 1 -- 172.21.15.50:0/2545252955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f379406c640 msgr2=0x7f379406cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.864+0000 7f379b516700 1 --2- 172.21.15.50:0/2545252955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f379406c640 0x7f379406cae0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3784009850 tx=0x7f3784009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:41.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.864+0000 7f379b516700 1 -- 172.21.15.50:0/2545252955 shutdown_connections 2023-11-28T11:54:41.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.864+0000 7f379b516700 1 --2- 172.21.15.50:0/2545252955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f379406c640 0x7f379406cae0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.864+0000 7f379b516700 1 -- 172.21.15.50:0/2545252955 >> 172.21.15.50:0/2545252955 conn(0x7f379406e000 msgr2=0x7f37940b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:41.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.864+0000 7f379b516700 1 -- 172.21.15.50:0/2545252955 shutdown_connections 2023-11-28T11:54:41.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.864+0000 7f379b516700 1 -- 172.21.15.50:0/2545252955 wait complete. 2023-11-28T11:54:41.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379b516700 1 Processor -- start 2023-11-28T11:54:41.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379b516700 1 -- start start 2023-11-28T11:54:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379b516700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379406c640 0x7f3794155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379b516700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37940b2020 0x7f379414e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379b516700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3794152bb0 0x7f379414eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379b516700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37941579b0 con 0x7f3794152bb0 2023-11-28T11:54:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379b516700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379413f070 con 0x7f37940b2020 2023-11-28T11:54:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379b516700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3794156da0 con 0x7f379406c640 2023-11-28T11:54:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379ad15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3794152bb0 0x7f379414eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379ad15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3794152bb0 0x7f379414eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51778/0 (socket says 172.21.15.50:51778) 2023-11-28T11:54:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379ad15700 1 -- 172.21.15.50:0/1758739427 learned_addr learned my addr 172.21.15.50:0/1758739427 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f3799d13700 1 --2- 172.21.15.50:0/1758739427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37940b2020 0x7f379414e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379a514700 1 --2- 172.21.15.50:0/1758739427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379406c640 0x7f3794155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379ad15700 1 -- 172.21.15.50:0/1758739427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379406c640 msgr2=0x7f3794155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379ad15700 1 --2- 172.21.15.50:0/1758739427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379406c640 0x7f3794155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379ad15700 1 -- 172.21.15.50:0/1758739427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37940b2020 msgr2=0x7f379414e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379ad15700 1 --2- 172.21.15.50:0/1758739427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37940b2020 0x7f379414e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379ad15700 1 -- 172.21.15.50:0/1758739427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37840094b0 con 0x7f3794152bb0 2023-11-28T11:54:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f3799d13700 1 --2- 172.21.15.50:0/1758739427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37940b2020 0x7f379414e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379ad15700 1 --2- 172.21.15.50:0/1758739427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3794152bb0 0x7f379414eca0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f378c00c4d0 tx=0x7f378c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f378affd700 1 -- 172.21.15.50:0/1758739427 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c0052d0 con 0x7f3794152bb0 2023-11-28T11:54:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f378affd700 1 -- 172.21.15.50:0/1758739427 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378c005430 con 0x7f3794152bb0 2023-11-28T11:54:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379b516700 1 -- 172.21.15.50:0/1758739427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3794159470 con 0x7f3794152bb0 2023-11-28T11:54:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f378affd700 1 -- 172.21.15.50:0/1758739427 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c0055a0 con 0x7f3794152bb0 2023-11-28T11:54:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.868+0000 7f379b516700 1 -- 172.21.15.50:0/1758739427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3794159190 con 0x7f3794152bb0 2023-11-28T11:54:41.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.872+0000 7f379b516700 1 -- 172.21.15.50:0/1758739427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3794159750 con 0x7f3794152bb0 2023-11-28T11:54:41.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.872+0000 7f378affd700 1 -- 172.21.15.50:0/1758739427 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f378c010050 con 0x7f3794152bb0 2023-11-28T11:54:41.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.872+0000 7f378affd700 1 --2- 172.21.15.50:0/1758739427 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3778064f10 0x7f37780673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:41.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.872+0000 7f378affd700 1 -- 172.21.15.50:0/1758739427 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f378c081350 con 0x7f3794152bb0 2023-11-28T11:54:41.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.872+0000 7f379a514700 1 --2- 172.21.15.50:0/1758739427 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3778064f10 0x7f37780673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:41.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.872+0000 7f379a514700 1 --2- 172.21.15.50:0/1758739427 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3778064f10 0x7f37780673c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f37900012e0 tx=0x7f3790001970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:41.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:41.880+0000 7f378affd700 1 -- 172.21.15.50:0/1758739427 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f378c049400 con 0x7f3794152bb0 2023-11-28T11:54:42.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.052+0000 7f379b516700 1 -- 172.21.15.50:0/1758739427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3794072c20 con 0x7f3794152bb0 2023-11-28T11:54:42.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.052+0000 7f378affd700 1 -- 172.21.15.50:0/1758739427 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f378c04f160 con 0x7f3794152bb0 2023-11-28T11:54:42.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.056+0000 7f379b516700 1 -- 172.21.15.50:0/1758739427 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3778064f10 msgr2=0x7f37780673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.056+0000 7f379b516700 1 --2- 172.21.15.50:0/1758739427 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3778064f10 0x7f37780673c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f37900012e0 tx=0x7f3790001970 comp rx=0 tx=0).stop 2023-11-28T11:54:42.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.056+0000 7f379b516700 1 -- 172.21.15.50:0/1758739427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3794152bb0 msgr2=0x7f379414eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.056+0000 7f379b516700 1 --2- 172.21.15.50:0/1758739427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3794152bb0 0x7f379414eca0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f378c00c4d0 tx=0x7f378c00c890 comp rx=0 tx=0).stop 2023-11-28T11:54:42.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.056+0000 7f379b516700 1 -- 172.21.15.50:0/1758739427 shutdown_connections 2023-11-28T11:54:42.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.056+0000 7f379b516700 1 --2- 172.21.15.50:0/1758739427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3794152bb0 0x7f379414eca0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.056+0000 7f379b516700 1 --2- 172.21.15.50:0/1758739427 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3778064f10 0x7f37780673c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.056+0000 7f379b516700 1 --2- 172.21.15.50:0/1758739427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37940b2020 0x7f379414e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.056+0000 7f379b516700 1 --2- 172.21.15.50:0/1758739427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379406c640 0x7f3794155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.056+0000 7f379b516700 1 -- 172.21.15.50:0/1758739427 >> 172.21.15.50:0/1758739427 conn(0x7f379406e000 msgr2=0x7f379415b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:42.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.056+0000 7f379b516700 1 -- 172.21.15.50:0/1758739427 shutdown_connections 2023-11-28T11:54:42.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.056+0000 7f379b516700 1 -- 172.21.15.50:0/1758739427 wait complete. 2023-11-28T11:54:42.058 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-11-28T11:54:42.069 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:54:42.069 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:54:42.077 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:42.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.188+0000 7fc6bb59e700 1 Processor -- start 2023-11-28T11:54:42.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.188+0000 7fc6bb59e700 1 -- start start 2023-11-28T11:54:42.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.188+0000 7fc6bb59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6bc15c3b0 0x7fc6bc0c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.188+0000 7fc6bb59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6bc15c780 0x7fc6bc0cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.188+0000 7fc6bb59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6bc0cdad0 con 0x7fc6bc0ce4a0 2023-11-28T11:54:42.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.188+0000 7fc6bb59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6bc0cd4c0 con 0x7fc6bc15c780 2023-11-28T11:54:42.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.188+0000 7fc6bb59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc0ca6d0 con 0x7fc6bc15c3b0 2023-11-28T11:54:42.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6b9d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6bc15c780 0x7fc6bc0cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6bad9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc6bc0ce4a0 0x7fc6bc071030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59780/0 (socket says 172.21.15.50:59780) 2023-11-28T11:54:42.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6bad9d700 1 -- 172.21.15.50:0/3843663023 learned_addr learned my addr 172.21.15.50:0/3843663023 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:42.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6ba59c700 1 --2- 172.21.15.50:0/3843663023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6bc15c3b0 0x7fc6bc0c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6b959a700 1 -- 172.21.15.50:0/3843663023 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334316037 0 0) 0x7fc6bc0cdad0 con 0x7fc6bc0ce4a0 2023-11-28T11:54:42.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6b959a700 1 -- 172.21.15.50:0/3843663023 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a40035d0 con 0x7fc6bc0ce4a0 2023-11-28T11:54:42.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6b9d9b700 1 -- 172.21.15.50:0/3843663023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6bc15c3b0 msgr2=0x7fc6bc0c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:42.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6b9d9b700 1 --2- 172.21.15.50:0/3843663023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6bc15c3b0 0x7fc6bc0c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6b9d9b700 1 -- 172.21.15.50:0/3843663023 >> v1:172.21.15.50:6789/0 conn(0x7fc6bc0ce4a0 legacy=0x7fc6bc071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6b959a700 1 -- 172.21.15.50:0/3843663023 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1312831797 0 0) 0x7fc6a40035d0 con 0x7fc6bc0ce4a0 2023-11-28T11:54:42.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6b9d9b700 1 -- 172.21.15.50:0/3843663023 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc0cd760 con 0x7fc6bc15c780 2023-11-28T11:54:42.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6b9d9b700 1 --2- 172.21.15.50:0/3843663023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc15c780 0x7fc6bc0cdf60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac009850 tx=0x7fc6ac009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c607ccfb3c2f34c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:42.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6b959a700 1 -- 172.21.15.50:0/3843663023 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b40019f0 con 0x7fc6bc15c780 2023-11-28T11:54:42.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6b959a700 1 -- 172.21.15.50:0/3843663023 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ac004030 con 0x7fc6bc15c780 2023-11-28T11:54:42.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6b959a700 1 -- 172.21.15.50:0/3843663023 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac0043a0 con 0x7fc6bc15c780 2023-11-28T11:54:42.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6bb59e700 1 -- 172.21.15.50:0/3843663023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc15c780 msgr2=0x7fc6bc0cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6bb59e700 1 --2- 172.21.15.50:0/3843663023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc15c780 0x7fc6bc0cdf60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac009850 tx=0x7fc6ac009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:42.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6bb59e700 1 -- 172.21.15.50:0/3843663023 shutdown_connections 2023-11-28T11:54:42.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6bb59e700 1 --2- 172.21.15.50:0/3843663023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc15c780 0x7fc6bc0cdf60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6bb59e700 1 --2- 172.21.15.50:0/3843663023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6bc15c3b0 0x7fc6bc0c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6bb59e700 1 -- 172.21.15.50:0/3843663023 >> 172.21.15.50:0/3843663023 conn(0x7fc6bc0b1d40 msgr2=0x7fc6bc0cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:42.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6bb59e700 1 -- 172.21.15.50:0/3843663023 shutdown_connections 2023-11-28T11:54:42.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.192+0000 7fc6bb59e700 1 -- 172.21.15.50:0/3843663023 wait complete. 2023-11-28T11:54:42.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6bb59e700 1 Processor -- start 2023-11-28T11:54:42.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6bb59e700 1 -- start start 2023-11-28T11:54:42.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6bb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0ce4a0 0x7fc6bc159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6bb59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6bc15c3b0 0x7fc6bc0acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6bb59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6bc15c780 0x7fc6bc0ad510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6bb59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc0ade90 con 0x7fc6bc0ce4a0 2023-11-28T11:54:42.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6bb59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc15a580 con 0x7fc6bc15c3b0 2023-11-28T11:54:42.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6bb59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc15a010 con 0x7fc6bc15c780 2023-11-28T11:54:42.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6ba59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0ce4a0 0x7fc6bc159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6ba59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0ce4a0 0x7fc6bc159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51800/0 (socket says 172.21.15.50:51800) 2023-11-28T11:54:42.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6ba59c700 1 -- 172.21.15.50:0/2384595090 learned_addr learned my addr 172.21.15.50:0/2384595090 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:42.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6b9d9b700 1 --2- 172.21.15.50:0/2384595090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6bc15c3b0 0x7fc6bc0acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6bad9d700 1 --2- 172.21.15.50:0/2384595090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6bc15c780 0x7fc6bc0ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6ba59c700 1 -- 172.21.15.50:0/2384595090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6bc15c780 msgr2=0x7fc6bc0ad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6ba59c700 1 --2- 172.21.15.50:0/2384595090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6bc15c780 0x7fc6bc0ad510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6ba59c700 1 -- 172.21.15.50:0/2384595090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6bc15c3b0 msgr2=0x7fc6bc0acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6ba59c700 1 --2- 172.21.15.50:0/2384595090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6bc15c3b0 0x7fc6bc0acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6ba59c700 1 -- 172.21.15.50:0/2384595090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac0094b0 con 0x7fc6bc0ce4a0 2023-11-28T11:54:42.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6ba59c700 1 --2- 172.21.15.50:0/2384595090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0ce4a0 0x7fc6bc159ad0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000e760 tx=0x7fc6b000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:42.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6aaffd700 1 -- 172.21.15.50:0/2384595090 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000c070 con 0x7fc6bc0ce4a0 2023-11-28T11:54:42.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6aaffd700 1 -- 172.21.15.50:0/2384595090 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b0013610 con 0x7fc6bc0ce4a0 2023-11-28T11:54:42.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6bb59e700 1 -- 172.21.15.50:0/2384595090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6bc0cab40 con 0x7fc6bc0ce4a0 2023-11-28T11:54:42.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6aaffd700 1 -- 172.21.15.50:0/2384595090 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0013980 con 0x7fc6bc0ce4a0 2023-11-28T11:54:42.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.196+0000 7fc6bb59e700 1 -- 172.21.15.50:0/2384595090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6bc0ca9b0 con 0x7fc6bc0ce4a0 2023-11-28T11:54:42.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.200+0000 7fc6bb59e700 1 -- 172.21.15.50:0/2384595090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6bc0ca2c0 con 0x7fc6bc0ce4a0 2023-11-28T11:54:42.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.200+0000 7fc6aaffd700 1 -- 172.21.15.50:0/2384595090 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc6b0023070 con 0x7fc6bc0ce4a0 2023-11-28T11:54:42.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.200+0000 7fc6aaffd700 1 --2- 172.21.15.50:0/2384595090 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc69c064ee0 0x7fc69c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.200+0000 7fc6aaffd700 1 -- 172.21.15.50:0/2384595090 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc6b0081fb0 con 0x7fc6bc0ce4a0 2023-11-28T11:54:42.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.204+0000 7fc6b9d9b700 1 --2- 172.21.15.50:0/2384595090 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc69c064ee0 0x7fc69c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.204+0000 7fc6b9d9b700 1 --2- 172.21.15.50:0/2384595090 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc69c064ee0 0x7fc69c067390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0090b0 tx=0x7fc6ac008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:42.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.208+0000 7fc6aaffd700 1 -- 172.21.15.50:0/2384595090 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc6b004fd30 con 0x7fc6bc0ce4a0 2023-11-28T11:54:42.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.376+0000 7fc6bb59e700 1 -- 172.21.15.50:0/2384595090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6bc072500 con 0x7fc6bc0ce4a0 2023-11-28T11:54:42.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.376+0000 7fc6aaffd700 1 -- 172.21.15.50:0/2384595090 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19689 (secure 0 0 0) 0x7fc6b000f040 con 0x7fc6bc0ce4a0 2023-11-28T11:54:42.379 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:42.379 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:54:30.086945+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:42.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.380+0000 7fc6bb59e700 1 -- 172.21.15.50:0/2384595090 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc69c064ee0 msgr2=0x7fc69c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.380+0000 7fc6bb59e700 1 --2- 172.21.15.50:0/2384595090 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc69c064ee0 0x7fc69c067390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0090b0 tx=0x7fc6ac008030 comp rx=0 tx=0).stop 2023-11-28T11:54:42.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.380+0000 7fc6bb59e700 1 -- 172.21.15.50:0/2384595090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0ce4a0 msgr2=0x7fc6bc159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.380+0000 7fc6bb59e700 1 --2- 172.21.15.50:0/2384595090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0ce4a0 0x7fc6bc159ad0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000e760 tx=0x7fc6b000ea70 comp rx=0 tx=0).stop 2023-11-28T11:54:42.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.380+0000 7fc6bb59e700 1 -- 172.21.15.50:0/2384595090 shutdown_connections 2023-11-28T11:54:42.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.380+0000 7fc6bb59e700 1 --2- 172.21.15.50:0/2384595090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6bc15c780 0x7fc6bc0ad510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.380+0000 7fc6bb59e700 1 --2- 172.21.15.50:0/2384595090 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc69c064ee0 0x7fc69c067390 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.380+0000 7fc6bb59e700 1 --2- 172.21.15.50:0/2384595090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6bc15c3b0 0x7fc6bc0acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.380+0000 7fc6bb59e700 1 --2- 172.21.15.50:0/2384595090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6bc0ce4a0 0x7fc6bc159ad0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.380+0000 7fc6bb59e700 1 -- 172.21.15.50:0/2384595090 >> 172.21.15.50:0/2384595090 conn(0x7fc6bc0b1d40 msgr2=0x7fc6bc0af570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:42.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.380+0000 7fc6bb59e700 1 -- 172.21.15.50:0/2384595090 shutdown_connections 2023-11-28T11:54:42.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.380+0000 7fc6bb59e700 1 -- 172.21.15.50:0/2384595090 wait complete. 2023-11-28T11:54:42.394 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:53:38.462826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:53:39.778621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:53:42.870360+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:54:42.395 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:54:42.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.512+0000 7f7b457c7700 1 Processor -- start 2023-11-28T11:54:42.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.512+0000 7f7b457c7700 1 -- start start 2023-11-28T11:54:42.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.512+0000 7f7b457c7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b400cd370 0x7f7b400cc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.512+0000 7f7b457c7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7b400ce220 0x7f7b400cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.512+0000 7f7b457c7700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b400d0130 con 0x7f7b4015c1d0 2023-11-28T11:54:42.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.512+0000 7f7b457c7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b400ce660 con 0x7f7b400ce220 2023-11-28T11:54:42.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.512+0000 7f7b457c7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400cb750 con 0x7f7b400cd370 2023-11-28T11:54:42.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.512+0000 7f7b3ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7b4015c1d0 0x7f7b400ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59782/0 (socket says 172.21.15.50:59782) 2023-11-28T11:54:42.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.512+0000 7f7b3ffff700 1 -- 172.21.15.50:0/511251009 learned_addr learned my addr 172.21.15.50:0/511251009 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:42.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.512+0000 7f7b3f7fe700 1 --2- 172.21.15.50:0/511251009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b400cd370 0x7f7b400cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.512+0000 7f7b44fc6700 1 --2- 172.21.15.50:0/511251009 >> v2:172.21.15.192:3300/0 conn(0x7f7b400ce220 0x7f7b400cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.512+0000 7f7b3effd700 1 -- 172.21.15.50:0/511251009 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273967589 0 0) 0x7f7b400d0130 con 0x7f7b4015c1d0 2023-11-28T11:54:42.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.512+0000 7f7b3effd700 1 -- 172.21.15.50:0/511251009 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b280035d0 con 0x7f7b4015c1d0 2023-11-28T11:54:42.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.516+0000 7f7b3f7fe700 1 -- 172.21.15.50:0/511251009 >> v2:172.21.15.192:3300/0 conn(0x7f7b400ce220 msgr2=0x7f7b400cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:42.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.516+0000 7f7b3f7fe700 1 --2- 172.21.15.50:0/511251009 >> v2:172.21.15.192:3300/0 conn(0x7f7b400ce220 0x7f7b400cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.516+0000 7f7b3f7fe700 1 -- 172.21.15.50:0/511251009 >> v1:172.21.15.50:6789/0 conn(0x7f7b4015c1d0 legacy=0x7f7b400ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.516+0000 7f7b3f7fe700 1 -- 172.21.15.50:0/511251009 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b400cba30 con 0x7f7b400cd370 2023-11-28T11:54:42.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.516+0000 7f7b3f7fe700 1 --2- 172.21.15.50:0/511251009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b400cd370 0x7f7b400cc510 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009850 tx=0x7f7b30009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81bba887077e1ca4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:42.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.516+0000 7f7b3effd700 1 -- 172.21.15.50:0/511251009 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b30011830 con 0x7f7b400cd370 2023-11-28T11:54:42.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.516+0000 7f7b3effd700 1 -- 172.21.15.50:0/511251009 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b30011990 con 0x7f7b400cd370 2023-11-28T11:54:42.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.516+0000 7f7b3effd700 1 -- 172.21.15.50:0/511251009 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b30011d00 con 0x7f7b400cd370 2023-11-28T11:54:42.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.516+0000 7f7b457c7700 1 -- 172.21.15.50:0/511251009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b400cd370 msgr2=0x7f7b400cc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.516+0000 7f7b457c7700 1 --2- 172.21.15.50:0/511251009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b400cd370 0x7f7b400cc510 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009850 tx=0x7f7b30009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:42.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.516+0000 7f7b457c7700 1 -- 172.21.15.50:0/511251009 shutdown_connections 2023-11-28T11:54:42.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.516+0000 7f7b457c7700 1 --2- 172.21.15.50:0/511251009 >> v2:172.21.15.192:3300/0 conn(0x7f7b400ce220 0x7f7b400cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.516+0000 7f7b457c7700 1 --2- 172.21.15.50:0/511251009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b400cd370 0x7f7b400cc510 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.516+0000 7f7b457c7700 1 -- 172.21.15.50:0/511251009 >> 172.21.15.50:0/511251009 conn(0x7f7b400b2180 msgr2=0x7f7b400b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:42.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.516+0000 7f7b457c7700 1 -- 172.21.15.50:0/511251009 shutdown_connections 2023-11-28T11:54:42.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.516+0000 7f7b457c7700 1 -- 172.21.15.50:0/511251009 wait complete. 2023-11-28T11:54:42.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.516+0000 7f7b457c7700 1 Processor -- start 2023-11-28T11:54:42.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b457c7700 1 -- start start 2023-11-28T11:54:42.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b457c7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b400cd370 0x7f7b400c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b457c7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b400ce220 0x7f7b401f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b457c7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b4015c1d0 0x7f7b400c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b457c7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400c7720 con 0x7f7b400cd370 2023-11-28T11:54:42.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b457c7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400c79c0 con 0x7f7b400ce220 2023-11-28T11:54:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b457c7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400c7ca0 con 0x7f7b4015c1d0 2023-11-28T11:54:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b3ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b400cd370 0x7f7b400c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b3ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b400cd370 0x7f7b400c99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51814/0 (socket says 172.21.15.50:51814) 2023-11-28T11:54:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b3ffff700 1 -- 172.21.15.50:0/3339576827 learned_addr learned my addr 172.21.15.50:0/3339576827 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b3f7fe700 1 --2- 172.21.15.50:0/3339576827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b400ce220 0x7f7b401f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b44fc6700 1 --2- 172.21.15.50:0/3339576827 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b4015c1d0 0x7f7b400c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b3ffff700 1 -- 172.21.15.50:0/3339576827 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b4015c1d0 msgr2=0x7f7b400c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b3ffff700 1 --2- 172.21.15.50:0/3339576827 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b4015c1d0 0x7f7b400c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b3ffff700 1 -- 172.21.15.50:0/3339576827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b400ce220 msgr2=0x7f7b401f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b3ffff700 1 --2- 172.21.15.50:0/3339576827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b400ce220 0x7f7b401f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b3ffff700 1 -- 172.21.15.50:0/3339576827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b300094b0 con 0x7f7b400cd370 2023-11-28T11:54:42.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b3ffff700 1 --2- 172.21.15.50:0/3339576827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b400cd370 0x7f7b400c99c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400c4d0 tx=0x7f7b3400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:42.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b3cff9700 1 -- 172.21.15.50:0/3339576827 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34005d90 con 0x7f7b400cd370 2023-11-28T11:54:42.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b3cff9700 1 -- 172.21.15.50:0/3339576827 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3400ce80 con 0x7f7b400cd370 2023-11-28T11:54:42.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b457c7700 1 -- 172.21.15.50:0/3339576827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b400cbff0 con 0x7f7b400cd370 2023-11-28T11:54:42.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b3cff9700 1 -- 172.21.15.50:0/3339576827 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340072d0 con 0x7f7b400cd370 2023-11-28T11:54:42.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.520+0000 7f7b457c7700 1 -- 172.21.15.50:0/3339576827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b400cbd10 con 0x7f7b400cd370 2023-11-28T11:54:42.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.524+0000 7f7b457c7700 1 -- 172.21.15.50:0/3339576827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b400d0360 con 0x7f7b400cd370 2023-11-28T11:54:42.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.524+0000 7f7b3cff9700 1 -- 172.21.15.50:0/3339576827 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7b34019030 con 0x7f7b400cd370 2023-11-28T11:54:42.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.524+0000 7f7b3cff9700 1 --2- 172.21.15.50:0/3339576827 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7b2c064f10 0x7f7b2c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.524+0000 7f7b3cff9700 1 -- 172.21.15.50:0/3339576827 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7b34081280 con 0x7f7b400cd370 2023-11-28T11:54:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.524+0000 7f7b3f7fe700 1 --2- 172.21.15.50:0/3339576827 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7b2c064f10 0x7f7b2c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.524+0000 7f7b3f7fe700 1 --2- 172.21.15.50:0/3339576827 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7b2c064f10 0x7f7b2c0673c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7b300090b0 tx=0x7f7b30008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:42.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.536+0000 7f7b3cff9700 1 -- 172.21.15.50:0/3339576827 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7b3404a400 con 0x7f7b400cd370 2023-11-28T11:54:42.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.700+0000 7f7b457c7700 1 -- 172.21.15.50:0/3339576827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7b40072500 con 0x7f7b400cd370 2023-11-28T11:54:42.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.704+0000 7f7b3cff9700 1 -- 172.21.15.50:0/3339576827 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7b34017020 con 0x7f7b400cd370 2023-11-28T11:54:42.703 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:54:42.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.704+0000 7f7b457c7700 1 -- 172.21.15.50:0/3339576827 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7b2c064f10 msgr2=0x7f7b2c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.704+0000 7f7b457c7700 1 --2- 172.21.15.50:0/3339576827 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7b2c064f10 0x7f7b2c0673c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7b300090b0 tx=0x7f7b30008030 comp rx=0 tx=0).stop 2023-11-28T11:54:42.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.704+0000 7f7b457c7700 1 -- 172.21.15.50:0/3339576827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b400cd370 msgr2=0x7f7b400c99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.704+0000 7f7b457c7700 1 --2- 172.21.15.50:0/3339576827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b400cd370 0x7f7b400c99c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400c4d0 tx=0x7f7b3400c7e0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.704+0000 7f7b457c7700 1 -- 172.21.15.50:0/3339576827 shutdown_connections 2023-11-28T11:54:42.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.704+0000 7f7b457c7700 1 --2- 172.21.15.50:0/3339576827 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b4015c1d0 0x7f7b400c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.704+0000 7f7b457c7700 1 --2- 172.21.15.50:0/3339576827 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7b2c064f10 0x7f7b2c0673c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.704+0000 7f7b457c7700 1 --2- 172.21.15.50:0/3339576827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b400ce220 0x7f7b401f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.704+0000 7f7b457c7700 1 --2- 172.21.15.50:0/3339576827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7b400cd370 0x7f7b400c99c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.704+0000 7f7b457c7700 1 -- 172.21.15.50:0/3339576827 >> 172.21.15.50:0/3339576827 conn(0x7f7b400b2180 msgr2=0x7f7b4015a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:42.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.704+0000 7f7b457c7700 1 -- 172.21.15.50:0/3339576827 shutdown_connections 2023-11-28T11:54:42.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.704+0000 7f7b457c7700 1 -- 172.21.15.50:0/3339576827 wait complete. 2023-11-28T11:54:42.719 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:54:42.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.844+0000 7f4e0e3dd700 1 Processor -- start 2023-11-28T11:54:42.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.844+0000 7f4e0e3dd700 1 -- start start 2023-11-28T11:54:42.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.844+0000 7f4e0e3dd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4e0806aee0 0x7f4e080b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.844+0000 7f4e0e3dd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e080b1be0 con 0x7f4e0815a140 2023-11-28T11:54:42.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.844+0000 7f4e0e3dd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0806b330 con 0x7f4e080b17a0 2023-11-28T11:54:42.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.844+0000 7f4e0e3dd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0815a510 con 0x7f4e0806aee0 2023-11-28T11:54:42.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.844+0000 7f4e07fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4e0815a140 0x7f4e0815e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59792/0 (socket says 172.21.15.50:59792) 2023-11-28T11:54:42.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.844+0000 7f4e07fff700 1 -- 172.21.15.50:0/3290832003 learned_addr learned my addr 172.21.15.50:0/3290832003 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:42.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.844+0000 7f4e077fe700 1 --2- 172.21.15.50:0/3290832003 >> v2:172.21.15.192:3300/0 conn(0x7f4e0806aee0 0x7f4e080b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.844+0000 7f4e06ffd700 1 -- 172.21.15.50:0/3290832003 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998537595 0 0) 0x7f4e080b1be0 con 0x7f4e0815a140 2023-11-28T11:54:42.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.844+0000 7f4e06ffd700 1 -- 172.21.15.50:0/3290832003 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4df00035d0 con 0x7f4e0815a140 2023-11-28T11:54:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e06ffd700 1 -- 172.21.15.50:0/3290832003 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1702705047 0 0) 0x7f4df00035d0 con 0x7f4e0815a140 2023-11-28T11:54:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e06ffd700 1 -- 172.21.15.50:0/3290832003 >> v2:172.21.15.192:3300/0 conn(0x7f4e0806aee0 msgr2=0x7f4e080b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e06ffd700 1 --2- 172.21.15.50:0/3290832003 >> v2:172.21.15.192:3300/0 conn(0x7f4e0806aee0 0x7f4e080b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e06ffd700 1 -- 172.21.15.50:0/3290832003 >> v1:172.21.15.192:6789/0 conn(0x7f4e080b17a0 legacy=0x7f4e080caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e06ffd700 1 -- 172.21.15.50:0/3290832003 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0806cce0 con 0x7f4e0815a140 2023-11-28T11:54:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e06ffd700 1 -- 172.21.15.50:0/3290832003 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f4df8001670 con 0x7f4e0815a140 2023-11-28T11:54:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e06ffd700 1 -- 172.21.15.50:0/3290832003 >> v1:172.21.15.50:6789/0 conn(0x7f4e0815a140 legacy=0x7f4e0815e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e06ffd700 1 --2- 172.21.15.50:0/3290832003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4df0003a20 0x7f4df0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e06ffd700 1 --2- 172.21.15.50:0/3290832003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4df0004410 0x7f4df00048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e06ffd700 1 --2- 172.21.15.50:0/3290832003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df00050d0 0x7f4df000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e06ffd700 1 -- 172.21.15.50:0/3290832003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0815a510 con 0x7f4df0004410 2023-11-28T11:54:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e06ffd700 1 -- 172.21.15.50:0/3290832003 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df000c020 con 0x7f4df0003a20 2023-11-28T11:54:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e06ffd700 1 -- 172.21.15.50:0/3290832003 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df000c1e0 con 0x7f4df00050d0 2023-11-28T11:54:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e077fe700 1 --2- 172.21.15.50:0/3290832003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4df0004410 0x7f4df00048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e07fff700 1 --2- 172.21.15.50:0/3290832003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4df0003a20 0x7f4df0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e0c97a700 1 --2- 172.21.15.50:0/3290832003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df00050d0 0x7f4df000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e077fe700 1 -- 172.21.15.50:0/3290832003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df00050d0 msgr2=0x7f4df000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e077fe700 1 --2- 172.21.15.50:0/3290832003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df00050d0 0x7f4df000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e077fe700 1 -- 172.21.15.50:0/3290832003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4df0003a20 msgr2=0x7f4df0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:42.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e077fe700 1 --2- 172.21.15.50:0/3290832003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4df0003a20 0x7f4df0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e0c97a700 1 -- 172.21.15.50:0/3290832003 reap_dead start 2023-11-28T11:54:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e077fe700 1 -- 172.21.15.50:0/3290832003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df00035d0 con 0x7f4df0004410 2023-11-28T11:54:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e07fff700 1 --2- 172.21.15.50:0/3290832003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4df0003a20 0x7f4df0003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e077fe700 1 --2- 172.21.15.50:0/3290832003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4df0004410 0x7f4df00048d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009b70 tx=0x7f4df00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71537bf47ae756 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e06ffd700 1 -- 172.21.15.50:0/3290832003 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc00e6c0 con 0x7f4df0004410 2023-11-28T11:54:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e06ffd700 1 -- 172.21.15.50:0/3290832003 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc00e820 con 0x7f4df0004410 2023-11-28T11:54:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e06ffd700 1 -- 172.21.15.50:0/3290832003 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc00eb90 con 0x7f4df0004410 2023-11-28T11:54:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e0e3dd700 1 -- 172.21.15.50:0/3290832003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4df0004410 msgr2=0x7f4df00048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e0e3dd700 1 --2- 172.21.15.50:0/3290832003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4df0004410 0x7f4df00048d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009b70 tx=0x7f4df00058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e0e3dd700 1 -- 172.21.15.50:0/3290832003 shutdown_connections 2023-11-28T11:54:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e0e3dd700 1 --2- 172.21.15.50:0/3290832003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4df0004410 0x7f4df00048d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e0e3dd700 1 -- 172.21.15.50:0/3290832003 >> 172.21.15.50:0/3290832003 conn(0x7f4e080cc260 msgr2=0x7f4e080cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e0e3dd700 1 -- 172.21.15.50:0/3290832003 shutdown_connections 2023-11-28T11:54:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.848+0000 7f4e0e3dd700 1 -- 172.21.15.50:0/3290832003 wait complete. 2023-11-28T11:54:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e0e3dd700 1 Processor -- start 2023-11-28T11:54:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e0e3dd700 1 -- start start 2023-11-28T11:54:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e0e3dd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e0814dbd0 0x7f4e081f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e0e3dd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e0814dfa0 0x7f4e0815c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e0e3dd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e080c5830 0x7f4e08157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e0e3dd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e081f59b0 con 0x7f4e0814dfa0 2023-11-28T11:54:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e0e3dd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0815c8e0 con 0x7f4e0814dbd0 2023-11-28T11:54:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e0e3dd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0815cb60 con 0x7f4e080c5830 2023-11-28T11:54:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e077fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e0814dfa0 0x7f4e0815c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e0c97a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e080c5830 0x7f4e08157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e077fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e0814dfa0 0x7f4e0815c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51828/0 (socket says 172.21.15.50:51828) 2023-11-28T11:54:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e07fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e0814dbd0 0x7f4e081f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e077fe700 1 -- 172.21.15.50:0/73780692 learned_addr learned my addr 172.21.15.50:0/73780692 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:42.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e077fe700 1 -- 172.21.15.50:0/73780692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e080c5830 msgr2=0x7f4e08157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e077fe700 1 --2- 172.21.15.50:0/73780692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e080c5830 0x7f4e08157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e077fe700 1 -- 172.21.15.50:0/73780692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e0814dbd0 msgr2=0x7f4e081f5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e077fe700 1 --2- 172.21.15.50:0/73780692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e0814dbd0 0x7f4e081f5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e077fe700 1 -- 172.21.15.50:0/73780692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e080ca560 con 0x7f4e0814dfa0 2023-11-28T11:54:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e077fe700 1 --2- 172.21.15.50:0/73780692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e0814dfa0 0x7f4e0815c3a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4df0005830 tx=0x7f4dfc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e04ff9700 1 -- 172.21.15.50:0/73780692 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc00e6c0 con 0x7f4e0814dfa0 2023-11-28T11:54:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e04ff9700 1 -- 172.21.15.50:0/73780692 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc0038e0 con 0x7f4e0814dfa0 2023-11-28T11:54:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e0e3dd700 1 -- 172.21.15.50:0/73780692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0806cfc0 con 0x7f4e0814dfa0 2023-11-28T11:54:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e04ff9700 1 -- 172.21.15.50:0/73780692 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc003c90 con 0x7f4e0814dfa0 2023-11-28T11:54:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.852+0000 7f4e0e3dd700 1 -- 172.21.15.50:0/73780692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0806c990 con 0x7f4e0814dfa0 2023-11-28T11:54:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.856+0000 7f4e0e3dd700 1 -- 172.21.15.50:0/73780692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e08072c20 con 0x7f4e0814dfa0 2023-11-28T11:54:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.856+0000 7f4e04ff9700 1 -- 172.21.15.50:0/73780692 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4dfc02c030 con 0x7f4e0814dfa0 2023-11-28T11:54:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.856+0000 7f4e04ff9700 1 --2- 172.21.15.50:0/73780692 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4df4064ee0 0x7f4df4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.856+0000 7f4e04ff9700 1 -- 172.21.15.50:0/73780692 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4dfc0833b0 con 0x7f4e0814dfa0 2023-11-28T11:54:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.856+0000 7f4e07fff700 1 --2- 172.21.15.50:0/73780692 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4df4064ee0 0x7f4df4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:42.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.856+0000 7f4e07fff700 1 --2- 172.21.15.50:0/73780692 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4df4064ee0 0x7f4df4067390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4df8001030 tx=0x7f4df80011c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:42.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:42.860+0000 7f4e04ff9700 1 -- 172.21.15.50:0/73780692 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4dfc051220 con 0x7f4e0814dfa0 2023-11-28T11:54:43.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.020+0000 7f4e0e3dd700 1 -- 172.21.15.50:0/73780692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e080c9f70 con 0x7f4e0814dfa0 2023-11-28T11:54:43.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.024+0000 7f4e04ff9700 1 -- 172.21.15.50:0/73780692 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4dfc054840 con 0x7f4e0814dfa0 2023-11-28T11:54:43.024 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:54:43.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.024+0000 7f4e0e3dd700 1 -- 172.21.15.50:0/73780692 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4df4064ee0 msgr2=0x7f4df4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.024+0000 7f4e0e3dd700 1 --2- 172.21.15.50:0/73780692 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4df4064ee0 0x7f4df4067390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4df8001030 tx=0x7f4df80011c0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.024+0000 7f4e0e3dd700 1 -- 172.21.15.50:0/73780692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e0814dfa0 msgr2=0x7f4e0815c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.024+0000 7f4e0e3dd700 1 --2- 172.21.15.50:0/73780692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e0814dfa0 0x7f4e0815c3a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4df0005830 tx=0x7f4dfc0047e0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.024+0000 7f4e0e3dd700 1 -- 172.21.15.50:0/73780692 shutdown_connections 2023-11-28T11:54:43.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.024+0000 7f4e0e3dd700 1 --2- 172.21.15.50:0/73780692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e080c5830 0x7f4e08157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.024+0000 7f4e0e3dd700 1 --2- 172.21.15.50:0/73780692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e0814dfa0 0x7f4e0815c3a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.024+0000 7f4e0e3dd700 1 --2- 172.21.15.50:0/73780692 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4df4064ee0 0x7f4df4067390 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.024+0000 7f4e0e3dd700 1 --2- 172.21.15.50:0/73780692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e0814dbd0 0x7f4e081f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.024+0000 7f4e0e3dd700 1 -- 172.21.15.50:0/73780692 >> 172.21.15.50:0/73780692 conn(0x7f4e080cc260 msgr2=0x7f4e080af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.024+0000 7f4e0e3dd700 1 -- 172.21.15.50:0/73780692 shutdown_connections 2023-11-28T11:54:43.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.024+0000 7f4e0e3dd700 1 -- 172.21.15.50:0/73780692 wait complete. 2023-11-28T11:54:43.039 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:54:43.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.156+0000 7f0524ca6700 1 Processor -- start 2023-11-28T11:54:43.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.156+0000 7f0524ca6700 1 -- start start 2023-11-28T11:54:43.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f0524ca6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f05200cce60 0x7f05200cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:43.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f0524ca6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05200cd2e0 con 0x7f05200d31b0 2023-11-28T11:54:43.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f0524ca6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05200d00c0 con 0x7f052006ce60 2023-11-28T11:54:43.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f0524ca6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05200d3650 con 0x7f05200cce60 2023-11-28T11:54:43.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f0516ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f05200d31b0 0x7f05200cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59806/0 (socket says 172.21.15.50:59806) 2023-11-28T11:54:43.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f0516ffd700 1 -- 172.21.15.50:0/864697059 learned_addr learned my addr 172.21.15.50:0/864697059 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:43.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f051ffff700 1 --2- 172.21.15.50:0/864697059 >> v2:172.21.15.192:3300/0 conn(0x7f05200cce60 0x7f05200cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:43.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f051effd700 1 -- 172.21.15.50:0/864697059 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723214697 0 0) 0x7f05200cd2e0 con 0x7f05200d31b0 2023-11-28T11:54:43.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f051effd700 1 -- 172.21.15.50:0/864697059 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f050c0035d0 con 0x7f05200d31b0 2023-11-28T11:54:43.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f051ffff700 1 -- 172.21.15.50:0/864697059 >> v1:172.21.15.192:6789/0 conn(0x7f052006ce60 legacy=0x7f052006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f051ffff700 1 -- 172.21.15.50:0/864697059 >> v1:172.21.15.50:6789/0 conn(0x7f05200d31b0 legacy=0x7f05200cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f051ffff700 1 -- 172.21.15.50:0/864697059 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052006a7f0 con 0x7f05200cce60 2023-11-28T11:54:43.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f051ffff700 1 --2- 172.21.15.50:0/864697059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05200cce60 0x7f05200cfb80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0518009dc0 tx=0x7f051800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89c478fa5cb580c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:43.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f051effd700 1 -- 172.21.15.50:0/864697059 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051800e070 con 0x7f05200cce60 2023-11-28T11:54:43.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f051effd700 1 -- 172.21.15.50:0/864697059 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051800bae0 con 0x7f05200cce60 2023-11-28T11:54:43.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f051effd700 1 -- 172.21.15.50:0/864697059 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051800be50 con 0x7f05200cce60 2023-11-28T11:54:43.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f0524ca6700 1 -- 172.21.15.50:0/864697059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05200cce60 msgr2=0x7f05200cfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f0524ca6700 1 --2- 172.21.15.50:0/864697059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05200cce60 0x7f05200cfb80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0518009dc0 tx=0x7f051800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:43.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f0524ca6700 1 -- 172.21.15.50:0/864697059 shutdown_connections 2023-11-28T11:54:43.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f0524ca6700 1 --2- 172.21.15.50:0/864697059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05200cce60 0x7f05200cfb80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f0524ca6700 1 -- 172.21.15.50:0/864697059 >> 172.21.15.50:0/864697059 conn(0x7f05200b5760 msgr2=0x7f05200b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:43.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f0524ca6700 1 -- 172.21.15.50:0/864697059 shutdown_connections 2023-11-28T11:54:43.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.160+0000 7f0524ca6700 1 -- 172.21.15.50:0/864697059 wait complete. 2023-11-28T11:54:43.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.164+0000 7f0524ca6700 1 Processor -- start 2023-11-28T11:54:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.164+0000 7f0524ca6700 1 -- start start 2023-11-28T11:54:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.164+0000 7f0524ca6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052006ce60 0x7f05201f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.164+0000 7f0524ca6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05200cce60 0x7f05200cf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.164+0000 7f0524ca6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05200d31b0 0x7f052009fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.164+0000 7f0524ca6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05201f2590 con 0x7f052006ce60 2023-11-28T11:54:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.164+0000 7f0524ca6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05201f2ca0 con 0x7f05200cce60 2023-11-28T11:54:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.164+0000 7f0524ca6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05201f22b0 con 0x7f05200d31b0 2023-11-28T11:54:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.164+0000 7f051f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052006ce60 0x7f05201f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.164+0000 7f051ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05200d31b0 0x7f052009fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:43.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.164+0000 7f0516ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05200cce60 0x7f05200cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:43.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.164+0000 7f051f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052006ce60 0x7f05201f2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51834/0 (socket says 172.21.15.50:51834) 2023-11-28T11:54:43.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.164+0000 7f051f7fe700 1 -- 172.21.15.50:0/2814791515 learned_addr learned my addr 172.21.15.50:0/2814791515 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:43.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.164+0000 7f051f7fe700 1 -- 172.21.15.50:0/2814791515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05200d31b0 msgr2=0x7f052009fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.164+0000 7f051f7fe700 1 --2- 172.21.15.50:0/2814791515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05200d31b0 0x7f052009fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.164+0000 7f051f7fe700 1 -- 172.21.15.50:0/2814791515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05200cce60 msgr2=0x7f05200cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.164+0000 7f051f7fe700 1 --2- 172.21.15.50:0/2814791515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05200cce60 0x7f05200cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.168+0000 7f051f7fe700 1 -- 172.21.15.50:0/2814791515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0518009a70 con 0x7f052006ce60 2023-11-28T11:54:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.168+0000 7f051f7fe700 1 --2- 172.21.15.50:0/2814791515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052006ce60 0x7f05201f2760 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f051000c530 tx=0x7f051000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.168+0000 7f051cff9700 1 -- 172.21.15.50:0/2814791515 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051000cea0 con 0x7f052006ce60 2023-11-28T11:54:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.168+0000 7f051cff9700 1 -- 172.21.15.50:0/2814791515 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05100052d0 con 0x7f052006ce60 2023-11-28T11:54:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.168+0000 7f0524ca6700 1 -- 172.21.15.50:0/2814791515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052006adb0 con 0x7f052006ce60 2023-11-28T11:54:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.168+0000 7f051cff9700 1 -- 172.21.15.50:0/2814791515 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05100036a0 con 0x7f052006ce60 2023-11-28T11:54:43.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.168+0000 7f0524ca6700 1 -- 172.21.15.50:0/2814791515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052006aad0 con 0x7f052006ce60 2023-11-28T11:54:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.168+0000 7f0524ca6700 1 -- 172.21.15.50:0/2814791515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052006b090 con 0x7f052006ce60 2023-11-28T11:54:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.172+0000 7f051cff9700 1 -- 172.21.15.50:0/2814791515 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0510019030 con 0x7f052006ce60 2023-11-28T11:54:43.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.172+0000 7f051cff9700 1 --2- 172.21.15.50:0/2814791515 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0500064ee0 0x7f0500067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.172+0000 7f051cff9700 1 -- 172.21.15.50:0/2814791515 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0510081330 con 0x7f052006ce60 2023-11-28T11:54:43.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.172+0000 7f0516ffd700 1 --2- 172.21.15.50:0/2814791515 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0500064ee0 0x7f0500067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:43.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.172+0000 7f0516ffd700 1 --2- 172.21.15.50:0/2814791515 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0500064ee0 0x7f0500067390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f05201f4af0 tx=0x7f0508007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:43.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.176+0000 7f051cff9700 1 -- 172.21.15.50:0/2814791515 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f051004f1a0 con 0x7f052006ce60 2023-11-28T11:54:43.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.340+0000 7f0524ca6700 1 -- 172.21.15.50:0/2814791515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0520072c20 con 0x7f052006ce60 2023-11-28T11:54:43.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.340+0000 7f051cff9700 1 -- 172.21.15.50:0/2814791515 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f05100527c0 con 0x7f052006ce60 2023-11-28T11:54:43.343 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:43.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.344+0000 7f0524ca6700 1 -- 172.21.15.50:0/2814791515 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0500064ee0 msgr2=0x7f0500067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.344+0000 7f0524ca6700 1 --2- 172.21.15.50:0/2814791515 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0500064ee0 0x7f0500067390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f05201f4af0 tx=0x7f0508007de0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.344+0000 7f0524ca6700 1 -- 172.21.15.50:0/2814791515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052006ce60 msgr2=0x7f05201f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.344+0000 7f0524ca6700 1 --2- 172.21.15.50:0/2814791515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052006ce60 0x7f05201f2760 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f051000c530 tx=0x7f051000c840 comp rx=0 tx=0).stop 2023-11-28T11:54:43.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.344+0000 7f0524ca6700 1 -- 172.21.15.50:0/2814791515 shutdown_connections 2023-11-28T11:54:43.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.344+0000 7f0524ca6700 1 --2- 172.21.15.50:0/2814791515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05200d31b0 0x7f052009fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.344+0000 7f0524ca6700 1 --2- 172.21.15.50:0/2814791515 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0500064ee0 0x7f0500067390 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.344+0000 7f0524ca6700 1 --2- 172.21.15.50:0/2814791515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05200cce60 0x7f05200cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.344+0000 7f0524ca6700 1 --2- 172.21.15.50:0/2814791515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f052006ce60 0x7f05201f2760 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.344+0000 7f0524ca6700 1 -- 172.21.15.50:0/2814791515 >> 172.21.15.50:0/2814791515 conn(0x7f05200b5760 msgr2=0x7f0520069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:43.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.344+0000 7f0524ca6700 1 -- 172.21.15.50:0/2814791515 shutdown_connections 2023-11-28T11:54:43.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.344+0000 7f0524ca6700 1 -- 172.21.15.50:0/2814791515 wait complete. 2023-11-28T11:54:43.358 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:54:43.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.480+0000 7f5355e60700 1 Processor -- start 2023-11-28T11:54:43.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.480+0000 7f5355e60700 1 -- start start 2023-11-28T11:54:43.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.480+0000 7f5355e60700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53500cc510 0x7f53500ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:43.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.480+0000 7f5355e60700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53500cb750 con 0x7f53500cd370 2023-11-28T11:54:43.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.480+0000 7f5355e60700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53500cba30 con 0x7f535015c1d0 2023-11-28T11:54:43.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.480+0000 7f5355e60700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53500cc8e0 con 0x7f53500cc510 2023-11-28T11:54:43.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.480+0000 7f535565f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53500cc510 0x7f53500ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:43.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.480+0000 7f534ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f53500cd370 0x7f535006b5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59816/0 (socket says 172.21.15.50:59816) 2023-11-28T11:54:43.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.480+0000 7f534ffff700 1 -- 172.21.15.50:0/1312648326 learned_addr learned my addr 172.21.15.50:0/1312648326 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:43.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.480+0000 7f534f7fe700 1 -- 172.21.15.50:0/1312648326 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325190472 0 0) 0x7f53500cb750 con 0x7f53500cd370 2023-11-28T11:54:43.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.480+0000 7f534f7fe700 1 -- 172.21.15.50:0/1312648326 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53380035d0 con 0x7f53500cd370 2023-11-28T11:54:43.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.480+0000 7f535565f700 1 -- 172.21.15.50:0/1312648326 >> v1:172.21.15.192:6789/0 conn(0x7f535015c1d0 legacy=0x7f53500ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.480+0000 7f535565f700 1 -- 172.21.15.50:0/1312648326 >> v1:172.21.15.50:6789/0 conn(0x7f53500cd370 legacy=0x7f535006b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.480+0000 7f535565f700 1 -- 172.21.15.50:0/1312648326 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53500cbd10 con 0x7f53500cc510 2023-11-28T11:54:43.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.484+0000 7f535565f700 1 --2- 172.21.15.50:0/1312648326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53500cc510 0x7f53500ce220 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f53500cca20 tx=0x7f534800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6b2487c8ac85f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:43.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.484+0000 7f534f7fe700 1 -- 172.21.15.50:0/1312648326 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5348016070 con 0x7f53500cc510 2023-11-28T11:54:43.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.484+0000 7f534f7fe700 1 -- 172.21.15.50:0/1312648326 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534800bb20 con 0x7f53500cc510 2023-11-28T11:54:43.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.484+0000 7f534f7fe700 1 -- 172.21.15.50:0/1312648326 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534800e070 con 0x7f53500cc510 2023-11-28T11:54:43.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.484+0000 7f5355e60700 1 -- 172.21.15.50:0/1312648326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53500cc510 msgr2=0x7f53500ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.484+0000 7f5355e60700 1 --2- 172.21.15.50:0/1312648326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53500cc510 0x7f53500ce220 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f53500cca20 tx=0x7f534800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:43.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.484+0000 7f5355e60700 1 -- 172.21.15.50:0/1312648326 shutdown_connections 2023-11-28T11:54:43.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.484+0000 7f5355e60700 1 --2- 172.21.15.50:0/1312648326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53500cc510 0x7f53500ce220 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.484+0000 7f5355e60700 1 -- 172.21.15.50:0/1312648326 >> 172.21.15.50:0/1312648326 conn(0x7f53500b2180 msgr2=0x7f53500b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:43.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.484+0000 7f5355e60700 1 -- 172.21.15.50:0/1312648326 shutdown_connections 2023-11-28T11:54:43.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.484+0000 7f5355e60700 1 -- 172.21.15.50:0/1312648326 wait complete. 2023-11-28T11:54:43.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.484+0000 7f5355e60700 1 Processor -- start 2023-11-28T11:54:43.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.484+0000 7f5355e60700 1 -- start start 2023-11-28T11:54:43.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f5355e60700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53500cc510 0x7f53501f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:43.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f5355e60700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53500cd370 0x7f53500c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:43.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f5355e60700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f535015c1d0 0x7f53500c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:43.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f5355e60700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5350147530 con 0x7f53500cc510 2023-11-28T11:54:43.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f5355e60700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53501f2200 con 0x7f535015c1d0 2023-11-28T11:54:43.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f5355e60700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53501f5cc0 con 0x7f53500cd370 2023-11-28T11:54:43.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f5354e5e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53500cc510 0x7f53501f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:43.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f5354e5e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53500cc510 0x7f53501f1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51854/0 (socket says 172.21.15.50:51854) 2023-11-28T11:54:43.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f5354e5e700 1 -- 172.21.15.50:0/3259825207 learned_addr learned my addr 172.21.15.50:0/3259825207 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:43.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f534ffff700 1 --2- 172.21.15.50:0/3259825207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53500cd370 0x7f53500c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:43.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f535565f700 1 --2- 172.21.15.50:0/3259825207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f535015c1d0 0x7f53500c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:43.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f5354e5e700 1 -- 172.21.15.50:0/3259825207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53500cd370 msgr2=0x7f53500c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f5354e5e700 1 --2- 172.21.15.50:0/3259825207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53500cd370 0x7f53500c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f5354e5e700 1 -- 172.21.15.50:0/3259825207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f535015c1d0 msgr2=0x7f53500c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f5354e5e700 1 --2- 172.21.15.50:0/3259825207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f535015c1d0 0x7f53500c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f5354e5e700 1 -- 172.21.15.50:0/3259825207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5348009a70 con 0x7f53500cc510 2023-11-28T11:54:43.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f535565f700 1 --2- 172.21.15.50:0/3259825207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f535015c1d0 0x7f53500c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:43.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f534ffff700 1 --2- 172.21.15.50:0/3259825207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53500cd370 0x7f53500c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:43.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f5354e5e700 1 --2- 172.21.15.50:0/3259825207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53500cc510 0x7f53501f1280 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f534400c500 tx=0x7f534400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:43.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f534d7fa700 1 -- 172.21.15.50:0/3259825207 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53440052d0 con 0x7f53500cc510 2023-11-28T11:54:43.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f534d7fa700 1 -- 172.21.15.50:0/3259825207 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5344005430 con 0x7f53500cc510 2023-11-28T11:54:43.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f5355e60700 1 -- 172.21.15.50:0/3259825207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53500d0360 con 0x7f53500cc510 2023-11-28T11:54:43.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f534d7fa700 1 -- 172.21.15.50:0/3259825207 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53440055a0 con 0x7f53500cc510 2023-11-28T11:54:43.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.488+0000 7f5355e60700 1 -- 172.21.15.50:0/3259825207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53500cbff0 con 0x7f53500cc510 2023-11-28T11:54:43.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.492+0000 7f5355e60700 1 -- 172.21.15.50:0/3259825207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53500cfbf0 con 0x7f53500cc510 2023-11-28T11:54:43.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.492+0000 7f534d7fa700 1 -- 172.21.15.50:0/3259825207 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5344019030 con 0x7f53500cc510 2023-11-28T11:54:43.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.492+0000 7f534d7fa700 1 --2- 172.21.15.50:0/3259825207 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f533c064ee0 0x7f533c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:43.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.492+0000 7f534d7fa700 1 -- 172.21.15.50:0/3259825207 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5344081560 con 0x7f53500cc510 2023-11-28T11:54:43.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.492+0000 7f534ffff700 1 --2- 172.21.15.50:0/3259825207 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f533c064ee0 0x7f533c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:43.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.492+0000 7f534ffff700 1 --2- 172.21.15.50:0/3259825207 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f533c064ee0 0x7f533c067390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f53500d15b0 tx=0x7f5340009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:43.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.500+0000 7f534d7fa700 1 -- 172.21.15.50:0/3259825207 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f534404f350 con 0x7f53500cc510 2023-11-28T11:54:43.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.660+0000 7f5355e60700 1 -- 172.21.15.50:0/3259825207 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5350072500 con 0x7f53500cc510 2023-11-28T11:54:43.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.660+0000 7f534d7fa700 1 -- 172.21.15.50:0/3259825207 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5344052970 con 0x7f53500cc510 2023-11-28T11:54:43.662 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:54:43.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.664+0000 7f5355e60700 1 -- 172.21.15.50:0/3259825207 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f533c064ee0 msgr2=0x7f533c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.664+0000 7f5355e60700 1 --2- 172.21.15.50:0/3259825207 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f533c064ee0 0x7f533c067390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f53500d15b0 tx=0x7f5340009040 comp rx=0 tx=0).stop 2023-11-28T11:54:43.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.664+0000 7f5355e60700 1 -- 172.21.15.50:0/3259825207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53500cc510 msgr2=0x7f53501f1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.664+0000 7f5355e60700 1 --2- 172.21.15.50:0/3259825207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53500cc510 0x7f53501f1280 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f534400c500 tx=0x7f534400c8c0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.664+0000 7f5355e60700 1 -- 172.21.15.50:0/3259825207 shutdown_connections 2023-11-28T11:54:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.664+0000 7f5355e60700 1 --2- 172.21.15.50:0/3259825207 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f533c064ee0 0x7f533c067390 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.664+0000 7f5355e60700 1 --2- 172.21.15.50:0/3259825207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f535015c1d0 0x7f53500c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.664+0000 7f5355e60700 1 --2- 172.21.15.50:0/3259825207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53500cd370 0x7f53500c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.664+0000 7f5355e60700 1 --2- 172.21.15.50:0/3259825207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53500cc510 0x7f53501f1280 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.664+0000 7f5355e60700 1 -- 172.21.15.50:0/3259825207 >> 172.21.15.50:0/3259825207 conn(0x7f53500b2180 msgr2=0x7f535015b420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.664+0000 7f5355e60700 1 -- 172.21.15.50:0/3259825207 shutdown_connections 2023-11-28T11:54:43.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.664+0000 7f5355e60700 1 -- 172.21.15.50:0/3259825207 wait complete. 2023-11-28T11:54:43.676 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:54:43.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.792+0000 7f73169eb700 1 Processor -- start 2023-11-28T11:54:43.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.792+0000 7f73169eb700 1 -- start start 2023-11-28T11:54:43.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73169eb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f731015bb80 0x7f73100b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:43.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73169eb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f73100aaf40 0x7f73100b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:43.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73169eb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f731006b370 0x7f73100b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:43.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73169eb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73100ccd00 con 0x7f731006b370 2023-11-28T11:54:43.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73169eb700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73100b19b0 con 0x7f73100aaf40 2023-11-28T11:54:43.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73169eb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73100cd510 con 0x7f731015bb80 2023-11-28T11:54:43.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73161ea700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f731006b370 0x7f73100b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:43.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73161ea700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f731006b370 0x7f73100b2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51866/0 (socket says 172.21.15.50:51866) 2023-11-28T11:54:43.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73161ea700 1 -- 172.21.15.50:0/243202581 learned_addr learned my addr 172.21.15.50:0/243202581 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:43.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73151e8700 1 --2- 172.21.15.50:0/243202581 >> v2:172.21.15.192:3300/0 conn(0x7f73100aaf40 0x7f73100b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:43.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73159e9700 1 --2- 172.21.15.50:0/243202581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f731015bb80 0x7f73100b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:43.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73161ea700 1 -- 172.21.15.50:0/243202581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f731015bb80 msgr2=0x7f73100b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:43.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73161ea700 1 --2- 172.21.15.50:0/243202581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f731015bb80 0x7f73100b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73161ea700 1 -- 172.21.15.50:0/243202581 >> v2:172.21.15.192:3300/0 conn(0x7f73100aaf40 msgr2=0x7f73100b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:43.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73161ea700 1 --2- 172.21.15.50:0/243202581 >> v2:172.21.15.192:3300/0 conn(0x7f73100aaf40 0x7f73100b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73161ea700 1 -- 172.21.15.50:0/243202581 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73100ccf50 con 0x7f731006b370 2023-11-28T11:54:43.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73161ea700 1 --2- 172.21.15.50:0/243202581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f731006b370 0x7f73100b2ed0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f731006fae0 tx=0x7f7300009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4583e1a49497b4f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:43.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73149e7700 1 -- 172.21.15.50:0/243202581 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300011830 con 0x7f731006b370 2023-11-28T11:54:43.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73149e7700 1 -- 172.21.15.50:0/243202581 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7300011990 con 0x7f731006b370 2023-11-28T11:54:43.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73149e7700 1 -- 172.21.15.50:0/243202581 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300011d20 con 0x7f731006b370 2023-11-28T11:54:43.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73169eb700 1 -- 172.21.15.50:0/243202581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f731006b370 msgr2=0x7f73100b2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73169eb700 1 --2- 172.21.15.50:0/243202581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f731006b370 0x7f73100b2ed0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f731006fae0 tx=0x7f7300009bf0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73169eb700 1 -- 172.21.15.50:0/243202581 shutdown_connections 2023-11-28T11:54:43.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73169eb700 1 --2- 172.21.15.50:0/243202581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f731006b370 0x7f73100b2ed0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73169eb700 1 --2- 172.21.15.50:0/243202581 >> v2:172.21.15.192:3300/0 conn(0x7f73100aaf40 0x7f73100b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73169eb700 1 --2- 172.21.15.50:0/243202581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f731015bb80 0x7f73100b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73169eb700 1 -- 172.21.15.50:0/243202581 >> 172.21.15.50:0/243202581 conn(0x7f73100cae70 msgr2=0x7f73100cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:43.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73169eb700 1 -- 172.21.15.50:0/243202581 shutdown_connections 2023-11-28T11:54:43.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.796+0000 7f73169eb700 1 -- 172.21.15.50:0/243202581 wait complete. 2023-11-28T11:54:43.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73169eb700 1 Processor -- start 2023-11-28T11:54:43.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73169eb700 1 -- start start 2023-11-28T11:54:43.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73169eb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f731006b370 0x7f7310159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:43.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73169eb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73100aaf40 0x7f73101f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:43.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73169eb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f731015bb80 0x7f73101f3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:43.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73169eb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731009b490 con 0x7f73100aaf40 2023-11-28T11:54:43.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73169eb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7310155de0 con 0x7f731006b370 2023-11-28T11:54:43.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73169eb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7310158750 con 0x7f731015bb80 2023-11-28T11:54:43.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73151e8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73100aaf40 0x7f73101f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:43.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73151e8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73100aaf40 0x7f73101f36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51878/0 (socket says 172.21.15.50:51878) 2023-11-28T11:54:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73151e8700 1 -- 172.21.15.50:0/611829323 learned_addr learned my addr 172.21.15.50:0/611829323 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73161ea700 1 --2- 172.21.15.50:0/611829323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f731015bb80 0x7f73101f3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73159e9700 1 --2- 172.21.15.50:0/611829323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f731006b370 0x7f7310159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73151e8700 1 -- 172.21.15.50:0/611829323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f731015bb80 msgr2=0x7f73101f3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73151e8700 1 --2- 172.21.15.50:0/611829323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f731015bb80 0x7f73101f3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73151e8700 1 -- 172.21.15.50:0/611829323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f731006b370 msgr2=0x7f7310159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73151e8700 1 --2- 172.21.15.50:0/611829323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f731006b370 0x7f7310159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73151e8700 1 -- 172.21.15.50:0/611829323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7300009570 con 0x7f73100aaf40 2023-11-28T11:54:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73151e8700 1 --2- 172.21.15.50:0/611829323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73100aaf40 0x7f73101f36b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f730c00e9d0 tx=0x7f730c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73067fc700 1 -- 172.21.15.50:0/611829323 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c009720 con 0x7f73100aaf40 2023-11-28T11:54:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73067fc700 1 -- 172.21.15.50:0/611829323 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c00ee70 con 0x7f73100aaf40 2023-11-28T11:54:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73067fc700 1 -- 172.21.15.50:0/611829323 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c00ca50 con 0x7f73100aaf40 2023-11-28T11:54:43.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73169eb700 1 -- 172.21.15.50:0/611829323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73100b1c50 con 0x7f73100aaf40 2023-11-28T11:54:43.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.800+0000 7f73169eb700 1 -- 172.21.15.50:0/611829323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73100cd230 con 0x7f73100aaf40 2023-11-28T11:54:43.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.804+0000 7f73169eb700 1 -- 172.21.15.50:0/611829323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73100b1f30 con 0x7f73100aaf40 2023-11-28T11:54:43.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.804+0000 7f73067fc700 1 -- 172.21.15.50:0/611829323 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f730c019030 con 0x7f73100aaf40 2023-11-28T11:54:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.804+0000 7f73067fc700 1 --2- 172.21.15.50:0/611829323 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72fc064ee0 0x7f72fc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.804+0000 7f73067fc700 1 -- 172.21.15.50:0/611829323 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f730c082940 con 0x7f73100aaf40 2023-11-28T11:54:43.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.804+0000 7f73159e9700 1 --2- 172.21.15.50:0/611829323 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72fc064ee0 0x7f72fc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:43.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.808+0000 7f73159e9700 1 --2- 172.21.15.50:0/611829323 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72fc064ee0 0x7f72fc067390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f73100abc90 tx=0x7f730800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:43.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.808+0000 7f73067fc700 1 -- 172.21.15.50:0/611829323 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f730c050740 con 0x7f73100aaf40 2023-11-28T11:54:43.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.968+0000 7f73169eb700 1 -- 172.21.15.50:0/611829323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7310072500 con 0x7f73100aaf40 2023-11-28T11:54:43.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.972+0000 7f73067fc700 1 -- 172.21.15.50:0/611829323 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f730c017020 con 0x7f73100aaf40 2023-11-28T11:54:43.972 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:43.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.972+0000 7f73169eb700 1 -- 172.21.15.50:0/611829323 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72fc064ee0 msgr2=0x7f72fc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.972+0000 7f73169eb700 1 --2- 172.21.15.50:0/611829323 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72fc064ee0 0x7f72fc067390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f73100abc90 tx=0x7f730800b040 comp rx=0 tx=0).stop 2023-11-28T11:54:43.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.972+0000 7f73169eb700 1 -- 172.21.15.50:0/611829323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73100aaf40 msgr2=0x7f73101f36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:43.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.972+0000 7f73169eb700 1 --2- 172.21.15.50:0/611829323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73100aaf40 0x7f73101f36b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f730c00e9d0 tx=0x7f730c00ece0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.972+0000 7f73169eb700 1 -- 172.21.15.50:0/611829323 shutdown_connections 2023-11-28T11:54:43.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.972+0000 7f73169eb700 1 --2- 172.21.15.50:0/611829323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f731015bb80 0x7f73101f3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.972+0000 7f73169eb700 1 --2- 172.21.15.50:0/611829323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73100aaf40 0x7f73101f36b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.972+0000 7f73169eb700 1 --2- 172.21.15.50:0/611829323 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72fc064ee0 0x7f72fc067390 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.972+0000 7f73169eb700 1 --2- 172.21.15.50:0/611829323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f731006b370 0x7f7310159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:43.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.972+0000 7f73169eb700 1 -- 172.21.15.50:0/611829323 >> 172.21.15.50:0/611829323 conn(0x7f73100cae70 msgr2=0x7f73100abf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:43.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.972+0000 7f73169eb700 1 -- 172.21.15.50:0/611829323 shutdown_connections 2023-11-28T11:54:43.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:43.972+0000 7f73169eb700 1 -- 172.21.15.50:0/611829323 wait complete. 2023-11-28T11:54:43.987 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:54:44.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.104+0000 7f31be931700 1 Processor -- start 2023-11-28T11:54:44.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.104+0000 7f31be931700 1 -- start start 2023-11-28T11:54:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.104+0000 7f31be931700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31b80cf050 0x7f31b806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.104+0000 7f31be931700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f31b806a530 0x7f31b80cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.104+0000 7f31be931700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b815c6d0 con 0x7f31b80b4c10 2023-11-28T11:54:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.104+0000 7f31be931700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b806a9a0 con 0x7f31b806a530 2023-11-28T11:54:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.104+0000 7f31be931700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b80cf960 con 0x7f31b80cf050 2023-11-28T11:54:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.104+0000 7f31be130700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f31b80b4c10 0x7f31b80cce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59818/0 (socket says 172.21.15.50:59818) 2023-11-28T11:54:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.104+0000 7f31be130700 1 -- 172.21.15.50:0/3530457819 learned_addr learned my addr 172.21.15.50:0/3530457819 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.104+0000 7f31bd12e700 1 --2- 172.21.15.50:0/3530457819 >> v2:172.21.15.192:3300/0 conn(0x7f31b806a530 0x7f31b80cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.104+0000 7f31bd92f700 1 --2- 172.21.15.50:0/3530457819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31b80cf050 0x7f31b806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31bc92d700 1 -- 172.21.15.50:0/3530457819 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354807907 0 0) 0x7f31b815c6d0 con 0x7f31b80b4c10 2023-11-28T11:54:44.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31bc92d700 1 -- 172.21.15.50:0/3530457819 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31a40035d0 con 0x7f31b80b4c10 2023-11-28T11:54:44.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31bd12e700 1 -- 172.21.15.50:0/3530457819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31b80cf050 msgr2=0x7f31b806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:44.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31bd12e700 1 --2- 172.21.15.50:0/3530457819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31b80cf050 0x7f31b806d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31bd12e700 1 -- 172.21.15.50:0/3530457819 >> v1:172.21.15.50:6789/0 conn(0x7f31b80b4c10 legacy=0x7f31b80cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31bd12e700 1 -- 172.21.15.50:0/3530457819 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b806ac60 con 0x7f31b806a530 2023-11-28T11:54:44.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31bd12e700 1 --2- 172.21.15.50:0/3530457819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31b806a530 0x7f31b80cf420 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f31a8009850 tx=0x7f31a8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88a9ef59769c5419 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:44.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31bc92d700 1 -- 172.21.15.50:0/3530457819 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8011830 con 0x7f31b806a530 2023-11-28T11:54:44.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31bc92d700 1 -- 172.21.15.50:0/3530457819 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a8011990 con 0x7f31b806a530 2023-11-28T11:54:44.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31bc92d700 1 -- 172.21.15.50:0/3530457819 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8011d40 con 0x7f31b806a530 2023-11-28T11:54:44.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31be931700 1 -- 172.21.15.50:0/3530457819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31b806a530 msgr2=0x7f31b80cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:44.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31be931700 1 --2- 172.21.15.50:0/3530457819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31b806a530 0x7f31b80cf420 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f31a8009850 tx=0x7f31a8009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:44.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31be931700 1 -- 172.21.15.50:0/3530457819 shutdown_connections 2023-11-28T11:54:44.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31be931700 1 --2- 172.21.15.50:0/3530457819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31b806a530 0x7f31b80cf420 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31be931700 1 --2- 172.21.15.50:0/3530457819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31b80cf050 0x7f31b806d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31be931700 1 -- 172.21.15.50:0/3530457819 >> 172.21.15.50:0/3530457819 conn(0x7f31b809bb30 msgr2=0x7f31b80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:44.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31be931700 1 -- 172.21.15.50:0/3530457819 shutdown_connections 2023-11-28T11:54:44.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.108+0000 7f31be931700 1 -- 172.21.15.50:0/3530457819 wait complete. 2023-11-28T11:54:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.112+0000 7f31be931700 1 Processor -- start 2023-11-28T11:54:44.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.112+0000 7f31be931700 1 -- start start 2023-11-28T11:54:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.112+0000 7f31be931700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b806a530 0x7f31b80d20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.112+0000 7f31be931700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31b80b4c10 0x7f31b815af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.112+0000 7f31be931700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31b80cf050 0x7f31b815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.112+0000 7f31be931700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b80d2630 con 0x7f31b806a530 2023-11-28T11:54:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.112+0000 7f31be931700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b8148f60 con 0x7f31b80b4c10 2023-11-28T11:54:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.112+0000 7f31be931700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b80c8030 con 0x7f31b80cf050 2023-11-28T11:54:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.112+0000 7f31bd92f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b806a530 0x7f31b80d20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.112+0000 7f31bd92f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b806a530 0x7f31b80d20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51888/0 (socket says 172.21.15.50:51888) 2023-11-28T11:54:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.112+0000 7f31bd92f700 1 -- 172.21.15.50:0/1571494487 learned_addr learned my addr 172.21.15.50:0/1571494487 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:44.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.112+0000 7f31bd12e700 1 --2- 172.21.15.50:0/1571494487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31b80b4c10 0x7f31b815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.112+0000 7f31be130700 1 --2- 172.21.15.50:0/1571494487 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31b80cf050 0x7f31b815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.112+0000 7f31bd92f700 1 -- 172.21.15.50:0/1571494487 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31b80cf050 msgr2=0x7f31b815b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.112+0000 7f31bd92f700 1 --2- 172.21.15.50:0/1571494487 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31b80cf050 0x7f31b815b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.112+0000 7f31bd92f700 1 -- 172.21.15.50:0/1571494487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31b80b4c10 msgr2=0x7f31b815af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.112+0000 7f31bd92f700 1 --2- 172.21.15.50:0/1571494487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31b80b4c10 0x7f31b815af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.116+0000 7f31bd92f700 1 -- 172.21.15.50:0/1571494487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a80094b0 con 0x7f31b806a530 2023-11-28T11:54:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.116+0000 7f31bd12e700 1 --2- 172.21.15.50:0/1571494487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31b80b4c10 0x7f31b815af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.116+0000 7f31bd92f700 1 --2- 172.21.15.50:0/1571494487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b806a530 0x7f31b80d20f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f31b400e870 tx=0x7f31b400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.116+0000 7f31ae7fc700 1 -- 172.21.15.50:0/1571494487 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b40095a0 con 0x7f31b806a530 2023-11-28T11:54:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.116+0000 7f31be931700 1 -- 172.21.15.50:0/1571494487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b80b4410 con 0x7f31b806a530 2023-11-28T11:54:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.116+0000 7f31ae7fc700 1 -- 172.21.15.50:0/1571494487 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b400ee70 con 0x7f31b806a530 2023-11-28T11:54:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.116+0000 7f31be931700 1 -- 172.21.15.50:0/1571494487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b806af40 con 0x7f31b806a530 2023-11-28T11:54:44.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.116+0000 7f31ae7fc700 1 -- 172.21.15.50:0/1571494487 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b400c9f0 con 0x7f31b806a530 2023-11-28T11:54:44.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.116+0000 7f31be931700 1 -- 172.21.15.50:0/1571494487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b80b46f0 con 0x7f31b806a530 2023-11-28T11:54:44.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.116+0000 7f31ae7fc700 1 -- 172.21.15.50:0/1571494487 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f31b4019030 con 0x7f31b806a530 2023-11-28T11:54:44.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.120+0000 7f31ae7fc700 1 --2- 172.21.15.50:0/1571494487 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f319c064ee0 0x7f319c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.120+0000 7f31ae7fc700 1 -- 172.21.15.50:0/1571494487 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f31b4082060 con 0x7f31b806a530 2023-11-28T11:54:44.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.120+0000 7f31bd12e700 1 --2- 172.21.15.50:0/1571494487 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f319c064ee0 0x7f319c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.120+0000 7f31bd12e700 1 --2- 172.21.15.50:0/1571494487 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f319c064ee0 0x7f319c067390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f31a80090b0 tx=0x7f31a8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:44.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.124+0000 7f31ae7fc700 1 -- 172.21.15.50:0/1571494487 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f31b404fe50 con 0x7f31b806a530 2023-11-28T11:54:44.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.300+0000 7f31be931700 1 -- 172.21.15.50:0/1571494487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f31b8072500 con 0x7f31b806a530 2023-11-28T11:54:44.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.304+0000 7f31ae7fc700 1 -- 172.21.15.50:0/1571494487 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f31b4053470 con 0x7f31b806a530 2023-11-28T11:54:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.304+0000 7f31be931700 1 -- 172.21.15.50:0/1571494487 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f319c064ee0 msgr2=0x7f319c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.304+0000 7f31be931700 1 --2- 172.21.15.50:0/1571494487 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f319c064ee0 0x7f319c067390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f31a80090b0 tx=0x7f31a8008030 comp rx=0 tx=0).stop 2023-11-28T11:54:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.304+0000 7f31be931700 1 -- 172.21.15.50:0/1571494487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b806a530 msgr2=0x7f31b80d20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.304+0000 7f31be931700 1 --2- 172.21.15.50:0/1571494487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b806a530 0x7f31b80d20f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f31b400e870 tx=0x7f31b400ec30 comp rx=0 tx=0).stop 2023-11-28T11:54:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.304+0000 7f31be931700 1 -- 172.21.15.50:0/1571494487 shutdown_connections 2023-11-28T11:54:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.304+0000 7f31be931700 1 --2- 172.21.15.50:0/1571494487 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31b80cf050 0x7f31b815b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.304+0000 7f31be931700 1 --2- 172.21.15.50:0/1571494487 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f319c064ee0 0x7f319c067390 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.304+0000 7f31be931700 1 --2- 172.21.15.50:0/1571494487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31b80b4c10 0x7f31b815af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.304+0000 7f31be931700 1 --2- 172.21.15.50:0/1571494487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31b806a530 0x7f31b80d20f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.304+0000 7f31be931700 1 -- 172.21.15.50:0/1571494487 >> 172.21.15.50:0/1571494487 conn(0x7f31b809bb30 msgr2=0x7f31b80d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.304+0000 7f31be931700 1 -- 172.21.15.50:0/1571494487 shutdown_connections 2023-11-28T11:54:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.304+0000 7f31be931700 1 -- 172.21.15.50:0/1571494487 wait complete. 2023-11-28T11:54:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-11-28T11:54:44.319 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-11-28T11:54:44.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:44.319 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-28T11:54:44.335 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:54:44.335 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T11:54:44.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:44.335 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T11:54:44.340 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:54:44.341 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:54:44.348 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:54:44.349 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:54:44.397 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:44.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.520+0000 7fded6bc3700 1 Processor -- start 2023-11-28T11:54:44.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.520+0000 7fded6bc3700 1 -- start start 2023-11-28T11:54:44.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.520+0000 7fded6bc3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fded015d650 0x7fded00ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.520+0000 7fded6bc3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded00cd720 con 0x7fded0159c00 2023-11-28T11:54:44.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.520+0000 7fded6bc3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded00cd990 con 0x7fded00cc020 2023-11-28T11:54:44.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.520+0000 7fded6bc3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded00cdc70 con 0x7fded015d650 2023-11-28T11:54:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.520+0000 7fded63c2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fded0159c00 0x7fded006bb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59826/0 (socket says 172.21.15.50:59826) 2023-11-28T11:54:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.520+0000 7fded63c2700 1 -- 172.21.15.50:0/1758641139 learned_addr learned my addr 172.21.15.50:0/1758641139 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:44.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.520+0000 7fded5bc1700 1 --2- 172.21.15.50:0/1758641139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fded015d650 0x7fded00ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.520+0000 7fded4bbf700 1 -- 172.21.15.50:0/1758641139 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243136577 0 0) 0x7fded00cd720 con 0x7fded0159c00 2023-11-28T11:54:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.520+0000 7fded4bbf700 1 -- 172.21.15.50:0/1758641139 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdebc0035d0 con 0x7fded0159c00 2023-11-28T11:54:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.520+0000 7fded4bbf700 1 -- 172.21.15.50:0/1758641139 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2081650924 0 0) 0x7fdebc0035d0 con 0x7fded0159c00 2023-11-28T11:54:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.520+0000 7fded4bbf700 1 -- 172.21.15.50:0/1758641139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fded015d650 msgr2=0x7fded00ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.520+0000 7fded4bbf700 1 --2- 172.21.15.50:0/1758641139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fded015d650 0x7fded00ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.520+0000 7fded4bbf700 1 -- 172.21.15.50:0/1758641139 >> v1:172.21.15.192:6789/0 conn(0x7fded00cc020 legacy=0x7fded01594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:44.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded4bbf700 1 -- 172.21.15.50:0/1758641139 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded00cdf50 con 0x7fded0159c00 2023-11-28T11:54:44.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded4bbf700 1 -- 172.21.15.50:0/1758641139 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7fdec80019f0 con 0x7fded0159c00 2023-11-28T11:54:44.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded5bc1700 1 --2- 172.21.15.50:0/1758641139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fded015d650 0x7fded00ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:44.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded4bbf700 1 -- 172.21.15.50:0/1758641139 >> v1:172.21.15.50:6789/0 conn(0x7fded0159c00 legacy=0x7fded006bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:44.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded4bbf700 1 --2- 172.21.15.50:0/1758641139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdebc003a50 0x7fdebc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded4bbf700 1 --2- 172.21.15.50:0/1758641139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdebc0043f0 0x7fdebc0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded4bbf700 1 --2- 172.21.15.50:0/1758641139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fded015d650 0x7fdebc0050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded4bbf700 1 -- 172.21.15.50:0/1758641139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded00cdc70 con 0x7fdebc003a50 2023-11-28T11:54:44.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded5bc1700 1 --2- 172.21.15.50:0/1758641139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdebc003a50 0x7fdebc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded4bbf700 1 -- 172.21.15.50:0/1758641139 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc00ba30 con 0x7fdebc0043f0 2023-11-28T11:54:44.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded4bbf700 1 -- 172.21.15.50:0/1758641139 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc00bba0 con 0x7fded015d650 2023-11-28T11:54:44.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded53c0700 1 --2- 172.21.15.50:0/1758641139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdebc0043f0 0x7fdebc0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded63c2700 1 --2- 172.21.15.50:0/1758641139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fded015d650 0x7fdebc0050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded5bc1700 1 -- 172.21.15.50:0/1758641139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fded015d650 msgr2=0x7fdebc0050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:44.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded5bc1700 1 --2- 172.21.15.50:0/1758641139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fded015d650 0x7fdebc0050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded5bc1700 1 -- 172.21.15.50:0/1758641139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdebc0043f0 msgr2=0x7fdebc0048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:44.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded5bc1700 1 --2- 172.21.15.50:0/1758641139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdebc0043f0 0x7fdebc0048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded5bc1700 1 -- 172.21.15.50:0/1758641139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc0094b0 con 0x7fdebc003a50 2023-11-28T11:54:44.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded63c2700 1 --2- 172.21.15.50:0/1758641139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fded015d650 0x7fdebc0050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:44.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded5bc1700 1 --2- 172.21.15.50:0/1758641139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdebc003a50 0x7fdebc003e20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009d40 tx=0x7fdebc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37468a2b1318ad6d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:44.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded4bbf700 1 -- 172.21.15.50:0/1758641139 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc009e90 con 0x7fdebc003a50 2023-11-28T11:54:44.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded4bbf700 1 -- 172.21.15.50:0/1758641139 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdecc00e9a0 con 0x7fdebc003a50 2023-11-28T11:54:44.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded4bbf700 1 -- 172.21.15.50:0/1758641139 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc00ed10 con 0x7fdebc003a50 2023-11-28T11:54:44.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded6bc3700 1 -- 172.21.15.50:0/1758641139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdebc003a50 msgr2=0x7fdebc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:44.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded6bc3700 1 --2- 172.21.15.50:0/1758641139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdebc003a50 0x7fdebc003e20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009d40 tx=0x7fdebc0058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded63c2700 1 -- 172.21.15.50:0/1758641139 reap_dead start 2023-11-28T11:54:44.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded6bc3700 1 -- 172.21.15.50:0/1758641139 shutdown_connections 2023-11-28T11:54:44.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded6bc3700 1 -- 172.21.15.50:0/1758641139 >> 172.21.15.50:0/1758641139 conn(0x7fded006ec40 msgr2=0x7fded00b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:44.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded6bc3700 1 -- 172.21.15.50:0/1758641139 shutdown_connections 2023-11-28T11:54:44.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.524+0000 7fded6bc3700 1 -- 172.21.15.50:0/1758641139 wait complete. 2023-11-28T11:54:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded6bc3700 1 Processor -- start 2023-11-28T11:54:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded6bc3700 1 -- start start 2023-11-28T11:54:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded6bc3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded0157d30 0x7fded00c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded6bc3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fded0158100 0x7fded00cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded6bc3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fded00cb330 0x7fded00c4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded6bc3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded00cb7a0 con 0x7fded0157d30 2023-11-28T11:54:44.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded6bc3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded00c5ff0 con 0x7fded0158100 2023-11-28T11:54:44.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded6bc3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded00b2b50 con 0x7fded00cb330 2023-11-28T11:54:44.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded5bc1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded0157d30 0x7fded00c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded5bc1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded0157d30 0x7fded00c7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51904/0 (socket says 172.21.15.50:51904) 2023-11-28T11:54:44.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded5bc1700 1 -- 172.21.15.50:0/2929127065 learned_addr learned my addr 172.21.15.50:0/2929127065 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:44.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded63c2700 1 --2- 172.21.15.50:0/2929127065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fded00cb330 0x7fded00c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded53c0700 1 --2- 172.21.15.50:0/2929127065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fded0158100 0x7fded00cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded5bc1700 1 -- 172.21.15.50:0/2929127065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fded00cb330 msgr2=0x7fded00c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:44.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded5bc1700 1 --2- 172.21.15.50:0/2929127065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fded00cb330 0x7fded00c4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded5bc1700 1 -- 172.21.15.50:0/2929127065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fded0158100 msgr2=0x7fded00cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded5bc1700 1 --2- 172.21.15.50:0/2929127065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fded0158100 0x7fded00cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded5bc1700 1 -- 172.21.15.50:0/2929127065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded00ce470 con 0x7fded0157d30 2023-11-28T11:54:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded53c0700 1 --2- 172.21.15.50:0/2929127065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fded0158100 0x7fded00cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded63c2700 1 --2- 172.21.15.50:0/2929127065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fded00cb330 0x7fded00c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded5bc1700 1 --2- 172.21.15.50:0/2929127065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded0157d30 0x7fded00c7b70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00e790 tx=0x7fdecc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fdec67fc700 1 -- 172.21.15.50:0/2929127065 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc003ad0 con 0x7fded0157d30 2023-11-28T11:54:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fdec67fc700 1 -- 172.21.15.50:0/2929127065 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdecc003c50 con 0x7fded0157d30 2023-11-28T11:54:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fdec67fc700 1 -- 172.21.15.50:0/2929127065 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc009e90 con 0x7fded0157d30 2023-11-28T11:54:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded6bc3700 1 -- 172.21.15.50:0/2929127065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded015a250 con 0x7fded0157d30 2023-11-28T11:54:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.528+0000 7fded6bc3700 1 -- 172.21.15.50:0/2929127065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded00ce600 con 0x7fded0157d30 2023-11-28T11:54:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.532+0000 7fded6bc3700 1 -- 172.21.15.50:0/2929127065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded0072c20 con 0x7fded0157d30 2023-11-28T11:54:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.532+0000 7fdec67fc700 1 -- 172.21.15.50:0/2929127065 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdecc02c030 con 0x7fded0157d30 2023-11-28T11:54:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.532+0000 7fdec67fc700 1 --2- 172.21.15.50:0/2929127065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdeb4064ee0 0x7fdeb4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.532+0000 7fdec67fc700 1 -- 172.21.15.50:0/2929127065 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdecc0838d0 con 0x7fded0157d30 2023-11-28T11:54:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.532+0000 7fded53c0700 1 --2- 172.21.15.50:0/2929127065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdeb4064ee0 0x7fdeb4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.532+0000 7fded53c0700 1 --2- 172.21.15.50:0/2929127065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdeb4064ee0 0x7fdeb4067390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fded015d3b0 tx=0x7fdec0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:44.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.536+0000 7fdec67fc700 1 -- 172.21.15.50:0/2929127065 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdecc0515d0 con 0x7fded0157d30 2023-11-28T11:54:44.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.708+0000 7fded6bc3700 1 -- 172.21.15.50:0/2929127065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fded006ca60 con 0x7fded0157d30 2023-11-28T11:54:44.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.712+0000 7fdec67fc700 1 -- 172.21.15.50:0/2929127065 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19689 (secure 0 0 0) 0x7fdecc054bf0 con 0x7fded0157d30 2023-11-28T11:54:44.712 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:44.712 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:54:30.086945+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:44.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.716+0000 7fded6bc3700 1 -- 172.21.15.50:0/2929127065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdeb4064ee0 msgr2=0x7fdeb4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:44.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.716+0000 7fded6bc3700 1 --2- 172.21.15.50:0/2929127065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdeb4064ee0 0x7fdeb4067390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fded015d3b0 tx=0x7fdec0009040 comp rx=0 tx=0).stop 2023-11-28T11:54:44.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.716+0000 7fded6bc3700 1 -- 172.21.15.50:0/2929127065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded0157d30 msgr2=0x7fded00c7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:44.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.716+0000 7fded6bc3700 1 --2- 172.21.15.50:0/2929127065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded0157d30 0x7fded00c7b70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00e790 tx=0x7fdecc0047e0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.716+0000 7fded6bc3700 1 -- 172.21.15.50:0/2929127065 shutdown_connections 2023-11-28T11:54:44.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.716+0000 7fded6bc3700 1 --2- 172.21.15.50:0/2929127065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fded00cb330 0x7fded00c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.716+0000 7fded6bc3700 1 --2- 172.21.15.50:0/2929127065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdeb4064ee0 0x7fdeb4067390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.716+0000 7fded6bc3700 1 --2- 172.21.15.50:0/2929127065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fded0158100 0x7fded00cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.716+0000 7fded6bc3700 1 --2- 172.21.15.50:0/2929127065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded0157d30 0x7fded00c7b70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.716+0000 7fded6bc3700 1 -- 172.21.15.50:0/2929127065 >> 172.21.15.50:0/2929127065 conn(0x7fded006ec40 msgr2=0x7fded00b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:44.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.716+0000 7fded6bc3700 1 -- 172.21.15.50:0/2929127065 shutdown_connections 2023-11-28T11:54:44.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.716+0000 7fded6bc3700 1 -- 172.21.15.50:0/2929127065 wait complete. 2023-11-28T11:54:44.729 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:53:38.462826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:53:39.778621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:53:42.870360+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:54:44.730 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:54:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.844+0000 7f23b887b700 1 Processor -- start 2023-11-28T11:54:44.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.844+0000 7f23b887b700 1 -- start start 2023-11-28T11:54:44.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b887b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f23b415c020 0x7f23b40cae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b887b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23b415c3f0 0x7f23b40cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b887b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b406c3c0 con 0x7f23b40c9430 2023-11-28T11:54:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b887b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b406cfb0 con 0x7f23b415c3f0 2023-11-28T11:54:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b887b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b406c610 con 0x7f23b415c020 2023-11-28T11:54:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b2ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23b415c3f0 0x7f23b40cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b3fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f23b40c9430 0x7f23b40ad880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59830/0 (socket says 172.21.15.50:59830) 2023-11-28T11:54:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b3fff700 1 -- 172.21.15.50:0/1616436406 learned_addr learned my addr 172.21.15.50:0/1616436406 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b2ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23b415c3f0 0x7f23b40cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51918/0 (socket says 172.21.15.50:51918) 2023-11-28T11:54:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b37fe700 1 --2- 172.21.15.50:0/1616436406 >> v2:172.21.15.192:3300/0 conn(0x7f23b415c020 0x7f23b40cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b2ffd700 1 -- 172.21.15.50:0/1616436406 >> v2:172.21.15.192:3300/0 conn(0x7f23b415c020 msgr2=0x7f23b40cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b2ffd700 1 --2- 172.21.15.50:0/1616436406 >> v2:172.21.15.192:3300/0 conn(0x7f23b415c020 0x7f23b40cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b2ffd700 1 -- 172.21.15.50:0/1616436406 >> v1:172.21.15.50:6789/0 conn(0x7f23b40c9430 legacy=0x7f23b40ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:44.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b2ffd700 1 -- 172.21.15.50:0/1616436406 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b406c8f0 con 0x7f23b415c3f0 2023-11-28T11:54:44.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b27fc700 1 -- 172.21.15.50:0/1616436406 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257297661 0 0) 0x7f23b406c3c0 con 0x7f23b40c9430 2023-11-28T11:54:44.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b2ffd700 1 --2- 172.21.15.50:0/1616436406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b415c3f0 0x7f23b40cb7f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f23b40704f0 tx=0x7f23a8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87862c01554f91d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:44.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b27fc700 1 -- 172.21.15.50:0/1616436406 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8011830 con 0x7f23b415c3f0 2023-11-28T11:54:44.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b27fc700 1 -- 172.21.15.50:0/1616436406 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a8011990 con 0x7f23b415c3f0 2023-11-28T11:54:44.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b27fc700 1 -- 172.21.15.50:0/1616436406 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8011d40 con 0x7f23b415c3f0 2023-11-28T11:54:44.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b887b700 1 -- 172.21.15.50:0/1616436406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b415c3f0 msgr2=0x7f23b40cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:44.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b887b700 1 --2- 172.21.15.50:0/1616436406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b415c3f0 0x7f23b40cb7f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f23b40704f0 tx=0x7f23a8009b30 comp rx=0 tx=0).stop 2023-11-28T11:54:44.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b887b700 1 -- 172.21.15.50:0/1616436406 shutdown_connections 2023-11-28T11:54:44.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b887b700 1 --2- 172.21.15.50:0/1616436406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b415c3f0 0x7f23b40cb7f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b887b700 1 --2- 172.21.15.50:0/1616436406 >> v2:172.21.15.192:3300/0 conn(0x7f23b415c020 0x7f23b40cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b887b700 1 -- 172.21.15.50:0/1616436406 >> 172.21.15.50:0/1616436406 conn(0x7f23b40b0990 msgr2=0x7f23b40b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:44.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b887b700 1 -- 172.21.15.50:0/1616436406 shutdown_connections 2023-11-28T11:54:44.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.848+0000 7f23b887b700 1 -- 172.21.15.50:0/1616436406 wait complete. 2023-11-28T11:54:44.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b887b700 1 Processor -- start 2023-11-28T11:54:44.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b887b700 1 -- start start 2023-11-28T11:54:44.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b887b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23b40c9430 0x7f23b40b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b887b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23b415c020 0x7f23b40ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b887b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b415c3f0 0x7f23b41f12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b887b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b414f6d0 con 0x7f23b415c3f0 2023-11-28T11:54:44.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b887b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b40ac950 con 0x7f23b40c9430 2023-11-28T11:54:44.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b887b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b40b2b60 con 0x7f23b415c020 2023-11-28T11:54:44.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b415c3f0 0x7f23b41f12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b415c3f0 0x7f23b41f12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51928/0 (socket says 172.21.15.50:51928) 2023-11-28T11:54:44.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b3fff700 1 -- 172.21.15.50:0/111138715 learned_addr learned my addr 172.21.15.50:0/111138715 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:44.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b2ffd700 1 --2- 172.21.15.50:0/111138715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23b415c020 0x7f23b40ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b37fe700 1 --2- 172.21.15.50:0/111138715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23b40c9430 0x7f23b40b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b2ffd700 1 -- 172.21.15.50:0/111138715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23b40c9430 msgr2=0x7f23b40b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:44.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b2ffd700 1 --2- 172.21.15.50:0/111138715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23b40c9430 0x7f23b40b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b2ffd700 1 -- 172.21.15.50:0/111138715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b415c3f0 msgr2=0x7f23b41f12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:44.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b2ffd700 1 --2- 172.21.15.50:0/111138715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b415c3f0 0x7f23b41f12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:44.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b2ffd700 1 -- 172.21.15.50:0/111138715 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a80094b0 con 0x7f23b415c020 2023-11-28T11:54:44.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b3fff700 1 --2- 172.21.15.50:0/111138715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b415c3f0 0x7f23b41f12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:44.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b2ffd700 1 --2- 172.21.15.50:0/111138715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23b415c020 0x7f23b40ac250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f23a8016000 tx=0x7f23a8004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f239bfff700 1 -- 172.21.15.50:0/111138715 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a801a990 con 0x7f23b415c020 2023-11-28T11:54:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f239bfff700 1 -- 172.21.15.50:0/111138715 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a801f070 con 0x7f23b415c020 2023-11-28T11:54:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b887b700 1 -- 172.21.15.50:0/111138715 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b40cb3b0 con 0x7f23b415c020 2023-11-28T11:54:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f239bfff700 1 -- 172.21.15.50:0/111138715 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a801ad30 con 0x7f23b415c020 2023-11-28T11:54:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.852+0000 7f23b887b700 1 -- 172.21.15.50:0/111138715 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b406cbd0 con 0x7f23b415c020 2023-11-28T11:54:44.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.856+0000 7f23b887b700 1 -- 172.21.15.50:0/111138715 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b4069c40 con 0x7f23b415c020 2023-11-28T11:54:44.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.856+0000 7f239bfff700 1 -- 172.21.15.50:0/111138715 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f23a800f050 con 0x7f23b415c020 2023-11-28T11:54:44.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.856+0000 7f239bfff700 1 --2- 172.21.15.50:0/111138715 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f23a0064ee0 0x7f23a0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:44.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.856+0000 7f239bfff700 1 -- 172.21.15.50:0/111138715 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f23a8021070 con 0x7f23b415c020 2023-11-28T11:54:44.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.856+0000 7f23b37fe700 1 --2- 172.21.15.50:0/111138715 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f23a0064ee0 0x7f23a0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:44.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.856+0000 7f23b37fe700 1 --2- 172.21.15.50:0/111138715 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f23a0064ee0 0x7f23a0067390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f23b40ca300 tx=0x7f23a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:44.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:44.864+0000 7f239bfff700 1 -- 172.21.15.50:0/111138715 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f23a8051940 con 0x7f23b415c020 2023-11-28T11:54:45.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.028+0000 7f23b887b700 1 -- 172.21.15.50:0/111138715 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f23b4072500 con 0x7f23b415c020 2023-11-28T11:54:45.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.028+0000 7f239bfff700 1 -- 172.21.15.50:0/111138715 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f23a8015020 con 0x7f23b415c020 2023-11-28T11:54:45.030 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:54:45.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.032+0000 7f23b887b700 1 -- 172.21.15.50:0/111138715 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f23a0064ee0 msgr2=0x7f23a0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.032+0000 7f23b887b700 1 --2- 172.21.15.50:0/111138715 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f23a0064ee0 0x7f23a0067390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f23b40ca300 tx=0x7f23a4008040 comp rx=0 tx=0).stop 2023-11-28T11:54:45.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.032+0000 7f23b887b700 1 -- 172.21.15.50:0/111138715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23b415c020 msgr2=0x7f23b40ac250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.032+0000 7f23b887b700 1 --2- 172.21.15.50:0/111138715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23b415c020 0x7f23b40ac250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f23a8016000 tx=0x7f23a8004770 comp rx=0 tx=0).stop 2023-11-28T11:54:45.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.032+0000 7f23b887b700 1 -- 172.21.15.50:0/111138715 shutdown_connections 2023-11-28T11:54:45.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.032+0000 7f23b887b700 1 --2- 172.21.15.50:0/111138715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23b415c3f0 0x7f23b41f12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.032+0000 7f23b887b700 1 --2- 172.21.15.50:0/111138715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23b415c020 0x7f23b40ac250 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.032+0000 7f23b887b700 1 --2- 172.21.15.50:0/111138715 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f23a0064ee0 0x7f23a0067390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.032+0000 7f23b887b700 1 --2- 172.21.15.50:0/111138715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23b40c9430 0x7f23b40b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.032+0000 7f23b887b700 1 -- 172.21.15.50:0/111138715 >> 172.21.15.50:0/111138715 conn(0x7f23b40b0990 msgr2=0x7f23b415b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:45.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.032+0000 7f23b887b700 1 -- 172.21.15.50:0/111138715 shutdown_connections 2023-11-28T11:54:45.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.032+0000 7f23b887b700 1 -- 172.21.15.50:0/111138715 wait complete. 2023-11-28T11:54:45.045 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:54:45.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.164+0000 7fad1f59e700 1 Processor -- start 2023-11-28T11:54:45.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.164+0000 7fad1f59e700 1 -- start start 2023-11-28T11:54:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.164+0000 7fad1f59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fad200b1ae0 0x7fad2006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.164+0000 7fad1f59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad200cf0e0 0x7fad200cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.164+0000 7fad1f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad200cfa40 con 0x7fad2006a4c0 2023-11-28T11:54:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.164+0000 7fad1f59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad200d0ab0 con 0x7fad200cf0e0 2023-11-28T11:54:45.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.164+0000 7fad1f59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2006a9c0 con 0x7fad200b1ae0 2023-11-28T11:54:45.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.164+0000 7fad1dd9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fad2006a4c0 0x7fad200d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59844/0 (socket says 172.21.15.50:59844) 2023-11-28T11:54:45.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.164+0000 7fad1ed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad200cf0e0 0x7fad200cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:45.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.164+0000 7fad1dd9b700 1 -- 172.21.15.50:0/1848280710 learned_addr learned my addr 172.21.15.50:0/1848280710 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:45.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.164+0000 7fad1e59c700 1 --2- 172.21.15.50:0/1848280710 >> v2:172.21.15.192:3300/0 conn(0x7fad200b1ae0 0x7fad2006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.164+0000 7fad1ed9d700 1 -- 172.21.15.50:0/1848280710 >> v2:172.21.15.192:3300/0 conn(0x7fad200b1ae0 msgr2=0x7fad2006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.164+0000 7fad1ed9d700 1 --2- 172.21.15.50:0/1848280710 >> v2:172.21.15.192:3300/0 conn(0x7fad200b1ae0 0x7fad2006d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.164+0000 7fad1ed9d700 1 -- 172.21.15.50:0/1848280710 >> v1:172.21.15.50:6789/0 conn(0x7fad2006a4c0 legacy=0x7fad200d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.164+0000 7fad1ed9d700 1 -- 172.21.15.50:0/1848280710 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2006aca0 con 0x7fad200cf0e0 2023-11-28T11:54:45.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.164+0000 7fad1ed9d700 1 --2- 172.21.15.50:0/1848280710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad200cf0e0 0x7fad200cf500 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fad200b8870 tx=0x7fad1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f3c7b18baaeb66 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:45.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.168+0000 7fad1d59a700 1 -- 172.21.15.50:0/1848280710 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1800e070 con 0x7fad200cf0e0 2023-11-28T11:54:45.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.168+0000 7fad1d59a700 1 -- 172.21.15.50:0/1848280710 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1800bb20 con 0x7fad200cf0e0 2023-11-28T11:54:45.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.168+0000 7fad1d59a700 1 -- 172.21.15.50:0/1848280710 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad18012430 con 0x7fad200cf0e0 2023-11-28T11:54:45.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.168+0000 7fad1f59e700 1 -- 172.21.15.50:0/1848280710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad200cf0e0 msgr2=0x7fad200cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.168+0000 7fad1f59e700 1 --2- 172.21.15.50:0/1848280710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad200cf0e0 0x7fad200cf500 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fad200b8870 tx=0x7fad1800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:45.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.168+0000 7fad1f59e700 1 -- 172.21.15.50:0/1848280710 shutdown_connections 2023-11-28T11:54:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.168+0000 7fad1f59e700 1 --2- 172.21.15.50:0/1848280710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad200cf0e0 0x7fad200cf500 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.168+0000 7fad1f59e700 1 --2- 172.21.15.50:0/1848280710 >> v2:172.21.15.192:3300/0 conn(0x7fad200b1ae0 0x7fad2006d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.168+0000 7fad1f59e700 1 -- 172.21.15.50:0/1848280710 >> 172.21.15.50:0/1848280710 conn(0x7fad2009bbd0 msgr2=0x7fad200b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.168+0000 7fad1f59e700 1 -- 172.21.15.50:0/1848280710 shutdown_connections 2023-11-28T11:54:45.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.168+0000 7fad1f59e700 1 -- 172.21.15.50:0/1848280710 wait complete. 2023-11-28T11:54:45.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1f59e700 1 Processor -- start 2023-11-28T11:54:45.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1f59e700 1 -- start start 2023-11-28T11:54:45.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad2006a4c0 0x7fad2015ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:45.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad200b1ae0 0x7fad2014dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:45.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad200cf0e0 0x7fad2014fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:45.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad200b3200 con 0x7fad200cf0e0 2023-11-28T11:54:45.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1f59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad200b2680 con 0x7fad2006a4c0 2023-11-28T11:54:45.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad200b2960 con 0x7fad200b1ae0 2023-11-28T11:54:45.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad200cf0e0 0x7fad2014fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:45.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad200cf0e0 0x7fad2014fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51936/0 (socket says 172.21.15.50:51936) 2023-11-28T11:54:45.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1ed9d700 1 -- 172.21.15.50:0/160537782 learned_addr learned my addr 172.21.15.50:0/160537782 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:45.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1e59c700 1 --2- 172.21.15.50:0/160537782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad2006a4c0 0x7fad2015ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:45.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1dd9b700 1 --2- 172.21.15.50:0/160537782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad200b1ae0 0x7fad2014dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:45.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1ed9d700 1 -- 172.21.15.50:0/160537782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad200b1ae0 msgr2=0x7fad2014dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1ed9d700 1 --2- 172.21.15.50:0/160537782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad200b1ae0 0x7fad2014dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1ed9d700 1 -- 172.21.15.50:0/160537782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad2006a4c0 msgr2=0x7fad2015ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1ed9d700 1 --2- 172.21.15.50:0/160537782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad2006a4c0 0x7fad2015ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1ed9d700 1 -- 172.21.15.50:0/160537782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad18009a70 con 0x7fad200cf0e0 2023-11-28T11:54:45.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1dd9b700 1 --2- 172.21.15.50:0/160537782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad200b1ae0 0x7fad2014dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1ed9d700 1 --2- 172.21.15.50:0/160537782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad200cf0e0 0x7fad2014fad0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fad18014040 tx=0x7fad18004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad0effd700 1 -- 172.21.15.50:0/160537782 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad18012430 con 0x7fad200cf0e0 2023-11-28T11:54:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad0effd700 1 -- 172.21.15.50:0/160537782 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad18020070 con 0x7fad200cf0e0 2023-11-28T11:54:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1f59e700 1 -- 172.21.15.50:0/160537782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad200b4380 con 0x7fad200cf0e0 2023-11-28T11:54:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad0effd700 1 -- 172.21.15.50:0/160537782 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad18004280 con 0x7fad200cf0e0 2023-11-28T11:54:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.172+0000 7fad1f59e700 1 -- 172.21.15.50:0/160537782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2006af80 con 0x7fad200cf0e0 2023-11-28T11:54:45.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.176+0000 7fad1f59e700 1 -- 172.21.15.50:0/160537782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad200b1eb0 con 0x7fad200cf0e0 2023-11-28T11:54:45.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.176+0000 7fad0effd700 1 -- 172.21.15.50:0/160537782 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fad180043e0 con 0x7fad200cf0e0 2023-11-28T11:54:45.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.176+0000 7fad0effd700 1 --2- 172.21.15.50:0/160537782 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fad00064ee0 0x7fad00067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:45.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.176+0000 7fad0effd700 1 -- 172.21.15.50:0/160537782 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fad18022070 con 0x7fad200cf0e0 2023-11-28T11:54:45.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.176+0000 7fad1e59c700 1 --2- 172.21.15.50:0/160537782 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fad00064ee0 0x7fad00067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:45.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.176+0000 7fad1e59c700 1 --2- 172.21.15.50:0/160537782 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fad00064ee0 0x7fad00067390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fad10009bf0 tx=0x7fad10009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:45.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.184+0000 7fad0effd700 1 -- 172.21.15.50:0/160537782 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fad18052380 con 0x7fad200cf0e0 2023-11-28T11:54:45.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.344+0000 7fad1f59e700 1 -- 172.21.15.50:0/160537782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad20072500 con 0x7fad200cf0e0 2023-11-28T11:54:45.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.348+0000 7fad0effd700 1 -- 172.21.15.50:0/160537782 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad180559a0 con 0x7fad200cf0e0 2023-11-28T11:54:45.347 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:54:45.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.348+0000 7fad1f59e700 1 -- 172.21.15.50:0/160537782 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fad00064ee0 msgr2=0x7fad00067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.348+0000 7fad1f59e700 1 --2- 172.21.15.50:0/160537782 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fad00064ee0 0x7fad00067390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fad10009bf0 tx=0x7fad10009240 comp rx=0 tx=0).stop 2023-11-28T11:54:45.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.348+0000 7fad1f59e700 1 -- 172.21.15.50:0/160537782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad200cf0e0 msgr2=0x7fad2014fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.348+0000 7fad1f59e700 1 --2- 172.21.15.50:0/160537782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad200cf0e0 0x7fad2014fad0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fad18014040 tx=0x7fad18004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.348+0000 7fad1f59e700 1 -- 172.21.15.50:0/160537782 shutdown_connections 2023-11-28T11:54:45.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.348+0000 7fad1f59e700 1 --2- 172.21.15.50:0/160537782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad200cf0e0 0x7fad2014fad0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.348+0000 7fad1f59e700 1 --2- 172.21.15.50:0/160537782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad200b1ae0 0x7fad2014dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.348+0000 7fad1f59e700 1 --2- 172.21.15.50:0/160537782 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fad00064ee0 0x7fad00067390 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.348+0000 7fad1f59e700 1 --2- 172.21.15.50:0/160537782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad2006a4c0 0x7fad2015ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.348+0000 7fad1f59e700 1 -- 172.21.15.50:0/160537782 >> 172.21.15.50:0/160537782 conn(0x7fad2009bbd0 msgr2=0x7fad200d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:45.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.348+0000 7fad1f59e700 1 -- 172.21.15.50:0/160537782 shutdown_connections 2023-11-28T11:54:45.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.348+0000 7fad1f59e700 1 -- 172.21.15.50:0/160537782 wait complete. 2023-11-28T11:54:45.363 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:54:45.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.484+0000 7f2c2168f700 1 Processor -- start 2023-11-28T11:54:45.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.484+0000 7f2c2168f700 1 -- start start 2023-11-28T11:54:45.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.484+0000 7f2c2168f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c1c06a4c0 0x7f2c1c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:45.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.484+0000 7f2c2168f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2c1c0cf0e0 0x7f2c1c0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:45.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.484+0000 7f2c2168f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1c0cfa80 con 0x7f2c1c0b1ae0 2023-11-28T11:54:45.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.484+0000 7f2c2168f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1c0d0ab0 con 0x7f2c1c0cf0e0 2023-11-28T11:54:45.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.484+0000 7f2c2168f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c06a9c0 con 0x7f2c1c06a4c0 2023-11-28T11:54:45.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c20e8e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2c1c0cf0e0 0x7f2c1c0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:45.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c20e8e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2c1c0cf0e0 0x7f2c1c0cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51942/0 (socket says 172.21.15.50:51942) 2023-11-28T11:54:45.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c20e8e700 1 -- 172.21.15.50:0/4044078173 learned_addr learned my addr 172.21.15.50:0/4044078173 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:45.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c1b7fe700 1 --2- 172.21.15.50:0/4044078173 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c1c06a4c0 0x7f2c1c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:45.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c20e8e700 1 -- 172.21.15.50:0/4044078173 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c1c06a4c0 msgr2=0x7f2c1c06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:45.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c20e8e700 1 --2- 172.21.15.50:0/4044078173 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c1c06a4c0 0x7f2c1c06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c20e8e700 1 -- 172.21.15.50:0/4044078173 >> v1:172.21.15.192:6789/0 conn(0x7f2c1c0b1ae0 legacy=0x7f2c1c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c20e8e700 1 -- 172.21.15.50:0/4044078173 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c06aca0 con 0x7f2c1c0cf0e0 2023-11-28T11:54:45.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c20e8e700 1 --2- 172.21.15.50:0/4044078173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c1c0cf0e0 0x7f2c1c0cf540 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2c14009e50 tx=0x7f2c1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c393a52b166235 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:45.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c1affd700 1 -- 172.21.15.50:0/4044078173 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1400e070 con 0x7f2c1c0cf0e0 2023-11-28T11:54:45.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c1affd700 1 -- 172.21.15.50:0/4044078173 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1400b910 con 0x7f2c1c0cf0e0 2023-11-28T11:54:45.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c1affd700 1 -- 172.21.15.50:0/4044078173 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1400bcc0 con 0x7f2c1c0cf0e0 2023-11-28T11:54:45.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c2168f700 1 -- 172.21.15.50:0/4044078173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c1c0cf0e0 msgr2=0x7f2c1c0cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c2168f700 1 --2- 172.21.15.50:0/4044078173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c1c0cf0e0 0x7f2c1c0cf540 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2c14009e50 tx=0x7f2c1400b330 comp rx=0 tx=0).stop 2023-11-28T11:54:45.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c2168f700 1 -- 172.21.15.50:0/4044078173 shutdown_connections 2023-11-28T11:54:45.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c2168f700 1 --2- 172.21.15.50:0/4044078173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c1c0cf0e0 0x7f2c1c0cf540 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c2168f700 1 --2- 172.21.15.50:0/4044078173 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c1c06a4c0 0x7f2c1c06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c2168f700 1 -- 172.21.15.50:0/4044078173 >> 172.21.15.50:0/4044078173 conn(0x7f2c1c09bbd0 msgr2=0x7f2c1c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:45.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c2168f700 1 -- 172.21.15.50:0/4044078173 shutdown_connections 2023-11-28T11:54:45.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.488+0000 7f2c2168f700 1 -- 172.21.15.50:0/4044078173 wait complete. 2023-11-28T11:54:45.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c2168f700 1 Processor -- start 2023-11-28T11:54:45.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c2168f700 1 -- start start 2023-11-28T11:54:45.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c2168f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c1c06a4c0 0x7f2c1c0c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:45.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c2168f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c1c0b1ae0 0x7f2c1c159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:45.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c2168f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c1c0cf0e0 0x7f2c1c0c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:45.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c2168f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c15f660 con 0x7f2c1c0cf0e0 2023-11-28T11:54:45.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c2168f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c1f25e0 con 0x7f2c1c06a4c0 2023-11-28T11:54:45.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c2168f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c0c7170 con 0x7f2c1c0b1ae0 2023-11-28T11:54:45.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c1bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c1c06a4c0 0x7f2c1c0c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:45.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c1b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c1c0b1ae0 0x7f2c1c159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:45.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c1bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c1c06a4c0 0x7f2c1c0c6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:57684/0 (socket says 172.21.15.50:57684) 2023-11-28T11:54:45.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c20e8e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c1c0cf0e0 0x7f2c1c0c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:45.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c1bfff700 1 -- 172.21.15.50:0/3964093012 learned_addr learned my addr 172.21.15.50:0/3964093012 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:45.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c1b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c1c0b1ae0 0x7f2c1c159de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:54794/0 (socket says 172.21.15.50:54794) 2023-11-28T11:54:45.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c1b7fe700 1 -- 172.21.15.50:0/3964093012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c1c06a4c0 msgr2=0x7f2c1c0c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c1b7fe700 1 --2- 172.21.15.50:0/3964093012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c1c06a4c0 0x7f2c1c0c6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c1b7fe700 1 -- 172.21.15.50:0/3964093012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c1c0cf0e0 msgr2=0x7f2c1c0c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c1b7fe700 1 --2- 172.21.15.50:0/3964093012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c1c0cf0e0 0x7f2c1c0c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c1b7fe700 1 -- 172.21.15.50:0/3964093012 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c14009b30 con 0x7f2c1c0b1ae0 2023-11-28T11:54:45.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c20e8e700 1 --2- 172.21.15.50:0/3964093012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c1c0cf0e0 0x7f2c1c0c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:45.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c1bfff700 1 --2- 172.21.15.50:0/3964093012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c1c06a4c0 0x7f2c1c0c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:45.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.492+0000 7f2c1b7fe700 1 --2- 172.21.15.50:0/3964093012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c1c0b1ae0 0x7f2c1c159de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400e870 tx=0x7f2c0400eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:45.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.496+0000 7f2c18ff9700 1 -- 172.21.15.50:0/3964093012 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04013680 con 0x7f2c1c0b1ae0 2023-11-28T11:54:45.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.496+0000 7f2c18ff9700 1 -- 172.21.15.50:0/3964093012 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c040137e0 con 0x7f2c1c0b1ae0 2023-11-28T11:54:45.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.496+0000 7f2c2168f700 1 -- 172.21.15.50:0/3964093012 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1c0b4380 con 0x7f2c1c0b1ae0 2023-11-28T11:54:45.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.496+0000 7f2c18ff9700 1 -- 172.21.15.50:0/3964093012 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04013b70 con 0x7f2c1c0b1ae0 2023-11-28T11:54:45.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.496+0000 7f2c2168f700 1 -- 172.21.15.50:0/3964093012 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1c06af80 con 0x7f2c1c0b1ae0 2023-11-28T11:54:45.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.496+0000 7f2c2168f700 1 -- 172.21.15.50:0/3964093012 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1c0b1eb0 con 0x7f2c1c0b1ae0 2023-11-28T11:54:45.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.496+0000 7f2c18ff9700 1 -- 172.21.15.50:0/3964093012 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2c04019030 con 0x7f2c1c0b1ae0 2023-11-28T11:54:45.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.496+0000 7f2c18ff9700 1 --2- 172.21.15.50:0/3964093012 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2c00064ee0 0x7f2c00067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:45.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.496+0000 7f2c18ff9700 1 -- 172.21.15.50:0/3964093012 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2c04081da0 con 0x7f2c1c0b1ae0 2023-11-28T11:54:45.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.500+0000 7f2c1bfff700 1 --2- 172.21.15.50:0/3964093012 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2c00064ee0 0x7f2c00067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:45.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.500+0000 7f2c1bfff700 1 --2- 172.21.15.50:0/3964093012 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2c00064ee0 0x7f2c00067390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c001d30 tx=0x7f2c0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:45.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.508+0000 7f2c18ff9700 1 -- 172.21.15.50:0/3964093012 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2c040536e0 con 0x7f2c1c0b1ae0 2023-11-28T11:54:45.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.668+0000 7f2c2168f700 1 -- 172.21.15.50:0/3964093012 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2c1c072500 con 0x7f2c1c0b1ae0 2023-11-28T11:54:45.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.668+0000 7f2c18ff9700 1 -- 172.21.15.50:0/3964093012 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2c04017020 con 0x7f2c1c0b1ae0 2023-11-28T11:54:45.670 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.672+0000 7f2c2168f700 1 -- 172.21.15.50:0/3964093012 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2c00064ee0 msgr2=0x7f2c00067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.672+0000 7f2c2168f700 1 --2- 172.21.15.50:0/3964093012 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2c00064ee0 0x7f2c00067390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c001d30 tx=0x7f2c0c009040 comp rx=0 tx=0).stop 2023-11-28T11:54:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.672+0000 7f2c2168f700 1 -- 172.21.15.50:0/3964093012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c1c0b1ae0 msgr2=0x7f2c1c159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.672+0000 7f2c2168f700 1 --2- 172.21.15.50:0/3964093012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c1c0b1ae0 0x7f2c1c159de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400e870 tx=0x7f2c0400eb80 comp rx=0 tx=0).stop 2023-11-28T11:54:45.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.672+0000 7f2c2168f700 1 -- 172.21.15.50:0/3964093012 shutdown_connections 2023-11-28T11:54:45.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.672+0000 7f2c2168f700 1 --2- 172.21.15.50:0/3964093012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c1c0cf0e0 0x7f2c1c0c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.672+0000 7f2c2168f700 1 --2- 172.21.15.50:0/3964093012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c1c0b1ae0 0x7f2c1c159de0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.672+0000 7f2c2168f700 1 --2- 172.21.15.50:0/3964093012 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2c00064ee0 0x7f2c00067390 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.672+0000 7f2c2168f700 1 --2- 172.21.15.50:0/3964093012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c1c06a4c0 0x7f2c1c0c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.676+0000 7f2c2168f700 1 -- 172.21.15.50:0/3964093012 >> 172.21.15.50:0/3964093012 conn(0x7f2c1c09bbd0 msgr2=0x7f2c1c0d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:45.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.676+0000 7f2c2168f700 1 -- 172.21.15.50:0/3964093012 shutdown_connections 2023-11-28T11:54:45.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.676+0000 7f2c2168f700 1 -- 172.21.15.50:0/3964093012 wait complete. 2023-11-28T11:54:45.692 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:54:45.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.812+0000 7fe767fff700 1 Processor -- start 2023-11-28T11:54:45.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.812+0000 7fe767fff700 1 -- start start 2023-11-28T11:54:45.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.816+0000 7fe767fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe7681569f0 0x7fe76815a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:45.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.816+0000 7fe767fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7680c9b60 con 0x7fe7680cb7a0 2023-11-28T11:54:45.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.816+0000 7fe767fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76815d6e0 con 0x7fe768156dc0 2023-11-28T11:54:45.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.816+0000 7fe767fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76815d9c0 con 0x7fe7681569f0 2023-11-28T11:54:45.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.816+0000 7fe7677fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe7680cb7a0 0x7fe7680cbbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59854/0 (socket says 172.21.15.50:59854) 2023-11-28T11:54:45.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.816+0000 7fe7677fe700 1 -- 172.21.15.50:0/1335905308 learned_addr learned my addr 172.21.15.50:0/1335905308 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:45.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.816+0000 7fe766ffd700 1 --2- 172.21.15.50:0/1335905308 >> v2:172.21.15.192:3300/0 conn(0x7fe7681569f0 0x7fe76815a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.816+0000 7fe7667fc700 1 -- 172.21.15.50:0/1335905308 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816757224 0 0) 0x7fe7680c9b60 con 0x7fe7680cb7a0 2023-11-28T11:54:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.816+0000 7fe7667fc700 1 -- 172.21.15.50:0/1335905308 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7540035d0 con 0x7fe7680cb7a0 2023-11-28T11:54:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.816+0000 7fe766ffd700 1 -- 172.21.15.50:0/1335905308 >> v1:172.21.15.192:6789/0 conn(0x7fe768156dc0 legacy=0x7fe76815cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.816+0000 7fe766ffd700 1 -- 172.21.15.50:0/1335905308 >> v1:172.21.15.50:6789/0 conn(0x7fe7680cb7a0 legacy=0x7fe7680cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.816+0000 7fe766ffd700 1 -- 172.21.15.50:0/1335905308 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7681598d0 con 0x7fe7681569f0 2023-11-28T11:54:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.816+0000 7fe766ffd700 1 --2- 172.21.15.50:0/1335905308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7681569f0 0x7fe76815a0d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe758009840 tx=0x7fe758009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aec0c6ef29abf21 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.816+0000 7fe7667fc700 1 -- 172.21.15.50:0/1335905308 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758005e50 con 0x7fe7681569f0 2023-11-28T11:54:45.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.816+0000 7fe7667fc700 1 -- 172.21.15.50:0/1335905308 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe758006030 con 0x7fe7681569f0 2023-11-28T11:54:45.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.816+0000 7fe7667fc700 1 -- 172.21.15.50:0/1335905308 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7580063c0 con 0x7fe7681569f0 2023-11-28T11:54:45.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.820+0000 7fe767fff700 1 -- 172.21.15.50:0/1335905308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7681569f0 msgr2=0x7fe76815a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.820+0000 7fe767fff700 1 --2- 172.21.15.50:0/1335905308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7681569f0 0x7fe76815a0d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe758009840 tx=0x7fe758009b50 comp rx=0 tx=0).stop 2023-11-28T11:54:45.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.820+0000 7fe767fff700 1 -- 172.21.15.50:0/1335905308 shutdown_connections 2023-11-28T11:54:45.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.820+0000 7fe767fff700 1 --2- 172.21.15.50:0/1335905308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7681569f0 0x7fe76815a0d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.820+0000 7fe767fff700 1 -- 172.21.15.50:0/1335905308 >> 172.21.15.50:0/1335905308 conn(0x7fe76806c660 msgr2=0x7fe76806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:45.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.820+0000 7fe767fff700 1 -- 172.21.15.50:0/1335905308 shutdown_connections 2023-11-28T11:54:45.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.820+0000 7fe767fff700 1 -- 172.21.15.50:0/1335905308 wait complete. 2023-11-28T11:54:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.820+0000 7fe767fff700 1 Processor -- start 2023-11-28T11:54:45.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe767fff700 1 -- start start 2023-11-28T11:54:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe767fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7680cb7a0 0x7fe768154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe767fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7681569f0 0x7fe7680afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe767fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7680b0650 0x7fe768158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:45.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe767fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7680b1740 con 0x7fe7680cb7a0 2023-11-28T11:54:45.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe767fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7680b0b30 con 0x7fe7680b0650 2023-11-28T11:54:45.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe767fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7680b0e10 con 0x7fe7681569f0 2023-11-28T11:54:45.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe766ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7680cb7a0 0x7fe768154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:45.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe766ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7680cb7a0 0x7fe768154790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51956/0 (socket says 172.21.15.50:51956) 2023-11-28T11:54:45.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe766ffd700 1 -- 172.21.15.50:0/2495772122 learned_addr learned my addr 172.21.15.50:0/2495772122 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe7677fe700 1 --2- 172.21.15.50:0/2495772122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7680b0650 0x7fe768158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe75ffff700 1 --2- 172.21.15.50:0/2495772122 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7681569f0 0x7fe7680afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe766ffd700 1 -- 172.21.15.50:0/2495772122 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7681569f0 msgr2=0x7fe7680afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe766ffd700 1 --2- 172.21.15.50:0/2495772122 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7681569f0 0x7fe7680afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe766ffd700 1 -- 172.21.15.50:0/2495772122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7680b0650 msgr2=0x7fe768158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:45.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe766ffd700 1 --2- 172.21.15.50:0/2495772122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7680b0650 0x7fe768158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe766ffd700 1 -- 172.21.15.50:0/2495772122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe758009450 con 0x7fe7680cb7a0 2023-11-28T11:54:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe766ffd700 1 --2- 172.21.15.50:0/2495772122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7680cb7a0 0x7fe768154790 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe758013040 tx=0x7fe758004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe764ff9700 1 -- 172.21.15.50:0/2495772122 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758003ad0 con 0x7fe7680cb7a0 2023-11-28T11:54:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe764ff9700 1 -- 172.21.15.50:0/2495772122 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe758003c50 con 0x7fe7680cb7a0 2023-11-28T11:54:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe767fff700 1 -- 172.21.15.50:0/2495772122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe768159520 con 0x7fe7680cb7a0 2023-11-28T11:54:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe764ff9700 1 -- 172.21.15.50:0/2495772122 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7580061a0 con 0x7fe7680cb7a0 2023-11-28T11:54:45.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.824+0000 7fe767fff700 1 -- 172.21.15.50:0/2495772122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe768159bb0 con 0x7fe7680cb7a0 2023-11-28T11:54:45.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.828+0000 7fe767fff700 1 -- 172.21.15.50:0/2495772122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe76815d280 con 0x7fe7680cb7a0 2023-11-28T11:54:45.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.828+0000 7fe764ff9700 1 -- 172.21.15.50:0/2495772122 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe75800f050 con 0x7fe7680cb7a0 2023-11-28T11:54:45.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.828+0000 7fe764ff9700 1 --2- 172.21.15.50:0/2495772122 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe748064ee0 0x7fe748067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:45.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.828+0000 7fe764ff9700 1 -- 172.21.15.50:0/2495772122 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe758083c90 con 0x7fe7680cb7a0 2023-11-28T11:54:45.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.828+0000 7fe75ffff700 1 --2- 172.21.15.50:0/2495772122 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe748064ee0 0x7fe748067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:45.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.828+0000 7fe75ffff700 1 --2- 172.21.15.50:0/2495772122 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe748064ee0 0x7fe748067390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe768157ca0 tx=0x7fe750009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:45.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:45.836+0000 7fe764ff9700 1 -- 172.21.15.50:0/2495772122 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe758051b00 con 0x7fe7680cb7a0 2023-11-28T11:54:46.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.000+0000 7fe767fff700 1 -- 172.21.15.50:0/2495772122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe768072c20 con 0x7fe7680cb7a0 2023-11-28T11:54:46.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.000+0000 7fe764ff9700 1 -- 172.21.15.50:0/2495772122 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe75802a020 con 0x7fe7680cb7a0 2023-11-28T11:54:46.002 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:54:46.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.004+0000 7fe767fff700 1 -- 172.21.15.50:0/2495772122 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe748064ee0 msgr2=0x7fe748067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.004+0000 7fe767fff700 1 --2- 172.21.15.50:0/2495772122 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe748064ee0 0x7fe748067390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe768157ca0 tx=0x7fe750009040 comp rx=0 tx=0).stop 2023-11-28T11:54:46.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.004+0000 7fe767fff700 1 -- 172.21.15.50:0/2495772122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7680cb7a0 msgr2=0x7fe768154790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.004+0000 7fe767fff700 1 --2- 172.21.15.50:0/2495772122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7680cb7a0 0x7fe768154790 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe758013040 tx=0x7fe758004770 comp rx=0 tx=0).stop 2023-11-28T11:54:46.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.004+0000 7fe767fff700 1 -- 172.21.15.50:0/2495772122 shutdown_connections 2023-11-28T11:54:46.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.004+0000 7fe767fff700 1 --2- 172.21.15.50:0/2495772122 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe748064ee0 0x7fe748067390 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.004+0000 7fe767fff700 1 --2- 172.21.15.50:0/2495772122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7680b0650 0x7fe768158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.004+0000 7fe767fff700 1 --2- 172.21.15.50:0/2495772122 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7681569f0 0x7fe7680afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.004+0000 7fe767fff700 1 --2- 172.21.15.50:0/2495772122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7680cb7a0 0x7fe768154790 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.004+0000 7fe767fff700 1 -- 172.21.15.50:0/2495772122 >> 172.21.15.50:0/2495772122 conn(0x7fe76806c660 msgr2=0x7fe7680cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:46.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.004+0000 7fe767fff700 1 -- 172.21.15.50:0/2495772122 shutdown_connections 2023-11-28T11:54:46.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.004+0000 7fe767fff700 1 -- 172.21.15.50:0/2495772122 wait complete. 2023-11-28T11:54:46.024 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:54:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.144+0000 7f3539e95700 1 Processor -- start 2023-11-28T11:54:46.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.144+0000 7f3539e95700 1 -- start start 2023-11-28T11:54:46.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.144+0000 7f3539e95700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35340cfdd0 0x7f35340b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.144+0000 7f3539e95700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f35340b2570 0x7f35340cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.144+0000 7f3539e95700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35340cac70 con 0x7f35340cc590 2023-11-28T11:54:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.144+0000 7f3539e95700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353406c8e0 con 0x7f35340cfdd0 2023-11-28T11:54:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.144+0000 7f3539e95700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35340b29f0 con 0x7f35340b2570 2023-11-28T11:54:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.144+0000 7f3533fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35340cfdd0 0x7f35340b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.144+0000 7f3533fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f35340cfdd0 0x7f35340b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51964/0 (socket says 172.21.15.50:51964) 2023-11-28T11:54:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.144+0000 7f3538e93700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f35340cc590 0x7f35340b0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59860/0 (socket says 172.21.15.50:59860) 2023-11-28T11:54:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.144+0000 7f3533fff700 1 -- 172.21.15.50:0/3844891244 learned_addr learned my addr 172.21.15.50:0/3844891244 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f3539694700 1 --2- 172.21.15.50:0/3844891244 >> v2:172.21.15.192:3300/0 conn(0x7f35340b2570 0x7f35340cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f3533fff700 1 -- 172.21.15.50:0/3844891244 >> v2:172.21.15.192:3300/0 conn(0x7f35340b2570 msgr2=0x7f35340cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f3533fff700 1 --2- 172.21.15.50:0/3844891244 >> v2:172.21.15.192:3300/0 conn(0x7f35340b2570 0x7f35340cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f3533fff700 1 -- 172.21.15.50:0/3844891244 >> v1:172.21.15.50:6789/0 conn(0x7f35340cc590 legacy=0x7f35340b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f3533fff700 1 -- 172.21.15.50:0/3844891244 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35340d0340 con 0x7f35340cfdd0 2023-11-28T11:54:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f3539694700 1 --2- 172.21.15.50:0/3844891244 >> v2:172.21.15.192:3300/0 conn(0x7f35340b2570 0x7f35340cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:54:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f3533fff700 1 --2- 172.21.15.50:0/3844891244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35340cfdd0 0x7f35340b2030 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3524009910 tx=0x7f3524009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ed7230d0158d66 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f35337fe700 1 -- 172.21.15.50:0/3844891244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352400ba20 con 0x7f35340cfdd0 2023-11-28T11:54:46.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f35337fe700 1 -- 172.21.15.50:0/3844891244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352400bb80 con 0x7f35340cfdd0 2023-11-28T11:54:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f35337fe700 1 -- 172.21.15.50:0/3844891244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524009e60 con 0x7f35340cfdd0 2023-11-28T11:54:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f3539e95700 1 -- 172.21.15.50:0/3844891244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35340cfdd0 msgr2=0x7f35340b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f3539e95700 1 --2- 172.21.15.50:0/3844891244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35340cfdd0 0x7f35340b2030 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3524009910 tx=0x7f3524009c20 comp rx=0 tx=0).stop 2023-11-28T11:54:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f3539e95700 1 -- 172.21.15.50:0/3844891244 shutdown_connections 2023-11-28T11:54:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f3539e95700 1 --2- 172.21.15.50:0/3844891244 >> v2:172.21.15.192:3300/0 conn(0x7f35340b2570 0x7f35340cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f3539e95700 1 --2- 172.21.15.50:0/3844891244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35340cfdd0 0x7f35340b2030 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f3539e95700 1 -- 172.21.15.50:0/3844891244 >> 172.21.15.50:0/3844891244 conn(0x7f35340cd0a0 msgr2=0x7f35340cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f3539e95700 1 -- 172.21.15.50:0/3844891244 shutdown_connections 2023-11-28T11:54:46.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f3539e95700 1 -- 172.21.15.50:0/3844891244 wait complete. 2023-11-28T11:54:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f3539e95700 1 Processor -- start 2023-11-28T11:54:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.148+0000 7f3539e95700 1 -- start start 2023-11-28T11:54:46.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3539e95700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35340b2570 0x7f3534158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3539e95700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35340cfdd0 0x7f35340b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3539e95700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35340b4fe0 0x7f35340ce740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3539e95700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35340b4460 con 0x7f35340b2570 2023-11-28T11:54:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3539e95700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35340c4490 con 0x7f35340b4fe0 2023-11-28T11:54:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3539e95700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35340c4770 con 0x7f35340cfdd0 2023-11-28T11:54:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3538e93700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35340b2570 0x7f3534158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3538e93700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35340b2570 0x7f3534158c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51968/0 (socket says 172.21.15.50:51968) 2023-11-28T11:54:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3538e93700 1 -- 172.21.15.50:0/2587848422 learned_addr learned my addr 172.21.15.50:0/2587848422 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3533fff700 1 --2- 172.21.15.50:0/2587848422 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35340cfdd0 0x7f35340b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3539694700 1 --2- 172.21.15.50:0/2587848422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35340b4fe0 0x7f35340ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3538e93700 1 -- 172.21.15.50:0/2587848422 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35340cfdd0 msgr2=0x7f35340b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3538e93700 1 --2- 172.21.15.50:0/2587848422 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35340cfdd0 0x7f35340b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3538e93700 1 -- 172.21.15.50:0/2587848422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35340b4fe0 msgr2=0x7f35340ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3538e93700 1 --2- 172.21.15.50:0/2587848422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35340b4fe0 0x7f35340ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3538e93700 1 -- 172.21.15.50:0/2587848422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3524009570 con 0x7f35340b2570 2023-11-28T11:54:46.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3538e93700 1 --2- 172.21.15.50:0/2587848422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35340b2570 0x7f3534158c20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f351c00c410 tx=0x7f351c00c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:46.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f35317fa700 1 -- 172.21.15.50:0/2587848422 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c005cd0 con 0x7f35340b2570 2023-11-28T11:54:46.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f35317fa700 1 -- 172.21.15.50:0/2587848422 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351c005e30 con 0x7f35340b2570 2023-11-28T11:54:46.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3539e95700 1 -- 172.21.15.50:0/2587848422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353406d4b0 con 0x7f35340b2570 2023-11-28T11:54:46.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f35317fa700 1 -- 172.21.15.50:0/2587848422 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c0072f0 con 0x7f35340b2570 2023-11-28T11:54:46.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.152+0000 7f3539e95700 1 -- 172.21.15.50:0/2587848422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353406d1d0 con 0x7f35340b2570 2023-11-28T11:54:46.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.156+0000 7f3539e95700 1 -- 172.21.15.50:0/2587848422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35340ce520 con 0x7f35340b2570 2023-11-28T11:54:46.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.156+0000 7f35317fa700 1 -- 172.21.15.50:0/2587848422 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f351c019030 con 0x7f35340b2570 2023-11-28T11:54:46.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.156+0000 7f35317fa700 1 --2- 172.21.15.50:0/2587848422 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3514064ee0 0x7f3514067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.156+0000 7f35317fa700 1 -- 172.21.15.50:0/2587848422 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f351c081430 con 0x7f35340b2570 2023-11-28T11:54:46.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.156+0000 7f3533fff700 1 --2- 172.21.15.50:0/2587848422 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3514064ee0 0x7f3514067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.156+0000 7f3533fff700 1 --2- 172.21.15.50:0/2587848422 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3514064ee0 0x7f3514067390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3524000c00 tx=0x7f3524008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:46.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.164+0000 7f35317fa700 1 -- 172.21.15.50:0/2587848422 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f351c04f2a0 con 0x7f35340b2570 2023-11-28T11:54:46.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.332+0000 7f3539e95700 1 -- 172.21.15.50:0/2587848422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3534072c20 con 0x7f35340b2570 2023-11-28T11:54:46.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.332+0000 7f35317fa700 1 -- 172.21.15.50:0/2587848422 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f351c017020 con 0x7f35340b2570 2023-11-28T11:54:46.333 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:46.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.332+0000 7f3539e95700 1 -- 172.21.15.50:0/2587848422 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3514064ee0 msgr2=0x7f3514067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.332+0000 7f3539e95700 1 --2- 172.21.15.50:0/2587848422 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3514064ee0 0x7f3514067390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3524000c00 tx=0x7f3524008030 comp rx=0 tx=0).stop 2023-11-28T11:54:46.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.332+0000 7f3539e95700 1 -- 172.21.15.50:0/2587848422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35340b2570 msgr2=0x7f3534158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.332+0000 7f3539e95700 1 --2- 172.21.15.50:0/2587848422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35340b2570 0x7f3534158c20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f351c00c410 tx=0x7f351c00c720 comp rx=0 tx=0).stop 2023-11-28T11:54:46.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.332+0000 7f3539e95700 1 -- 172.21.15.50:0/2587848422 shutdown_connections 2023-11-28T11:54:46.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.332+0000 7f3539e95700 1 --2- 172.21.15.50:0/2587848422 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3514064ee0 0x7f3514067390 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.332+0000 7f3539e95700 1 --2- 172.21.15.50:0/2587848422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35340b4fe0 0x7f35340ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.332+0000 7f3539e95700 1 --2- 172.21.15.50:0/2587848422 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35340cfdd0 0x7f35340b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.332+0000 7f3539e95700 1 --2- 172.21.15.50:0/2587848422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35340b2570 0x7f3534158c20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.332+0000 7f3539e95700 1 -- 172.21.15.50:0/2587848422 >> 172.21.15.50:0/2587848422 conn(0x7f35340cd0a0 msgr2=0x7f35340cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:46.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.332+0000 7f3539e95700 1 -- 172.21.15.50:0/2587848422 shutdown_connections 2023-11-28T11:54:46.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.336+0000 7f3539e95700 1 -- 172.21.15.50:0/2587848422 wait complete. 2023-11-28T11:54:46.348 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:54:46.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8b8d49700 1 Processor -- start 2023-11-28T11:54:46.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8b8d49700 1 -- start start 2023-11-28T11:54:46.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8b8d49700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd8b406d7d0 0x7fd8b406a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8b8d49700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8b40b4c10 0x7fd8b40cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8b8d49700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b406dc70 con 0x7fd8b40cf050 2023-11-28T11:54:46.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8b8d49700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b406aa70 con 0x7fd8b406d7d0 2023-11-28T11:54:46.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8b8d49700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b415c6d0 con 0x7fd8b40b4c10 2023-11-28T11:54:46.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8b37fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd8b40cf050 0x7fd8b40cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59874/0 (socket says 172.21.15.50:59874) 2023-11-28T11:54:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8b37fe700 1 -- 172.21.15.50:0/1712747396 learned_addr learned my addr 172.21.15.50:0/1712747396 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8aaffd700 1 --2- 172.21.15.50:0/1712747396 >> v2:172.21.15.50:3300/0 conn(0x7fd8b406d7d0 0x7fd8b406a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8b3fff700 1 --2- 172.21.15.50:0/1712747396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8b40b4c10 0x7fd8b40cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8b2ffd700 1 -- 172.21.15.50:0/1712747396 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972020539 0 0) 0x7fd8a4001110 con 0x7fd8b40cf050 2023-11-28T11:54:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8b2ffd700 1 -- 172.21.15.50:0/1712747396 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8a00035d0 con 0x7fd8b40cf050 2023-11-28T11:54:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8aaffd700 1 -- 172.21.15.50:0/1712747396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8b40b4c10 msgr2=0x7fd8b40cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8aaffd700 1 --2- 172.21.15.50:0/1712747396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8b40b4c10 0x7fd8b40cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8aaffd700 1 -- 172.21.15.50:0/1712747396 >> v1:172.21.15.50:6789/0 conn(0x7fd8b40cf050 legacy=0x7fd8b40cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8b2ffd700 1 -- 172.21.15.50:0/1712747396 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 723310070 0 0) 0x7fd8a00035d0 con 0x7fd8b40cf050 2023-11-28T11:54:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8aaffd700 1 -- 172.21.15.50:0/1712747396 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b406ac60 con 0x7fd8b406d7d0 2023-11-28T11:54:46.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8aaffd700 1 --2- 172.21.15.50:0/1712747396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b406d7d0 0x7fd8b406a530 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009850 tx=0x7fd89c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c239f6d9ce220c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:46.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8b2ffd700 1 -- 172.21.15.50:0/1712747396 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4001800 con 0x7fd8b406d7d0 2023-11-28T11:54:46.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8b2ffd700 1 -- 172.21.15.50:0/1712747396 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c004030 con 0x7fd8b406d7d0 2023-11-28T11:54:46.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.464+0000 7fd8b2ffd700 1 -- 172.21.15.50:0/1712747396 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0043e0 con 0x7fd8b406d7d0 2023-11-28T11:54:46.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.468+0000 7fd8b8d49700 1 -- 172.21.15.50:0/1712747396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b406d7d0 msgr2=0x7fd8b406a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.468+0000 7fd8b8d49700 1 --2- 172.21.15.50:0/1712747396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b406d7d0 0x7fd8b406a530 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009850 tx=0x7fd89c009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:46.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.468+0000 7fd8b8d49700 1 -- 172.21.15.50:0/1712747396 shutdown_connections 2023-11-28T11:54:46.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.468+0000 7fd8b8d49700 1 --2- 172.21.15.50:0/1712747396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8b40b4c10 0x7fd8b40cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.468+0000 7fd8b8d49700 1 --2- 172.21.15.50:0/1712747396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b406d7d0 0x7fd8b406a530 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.468+0000 7fd8b8d49700 1 -- 172.21.15.50:0/1712747396 >> 172.21.15.50:0/1712747396 conn(0x7fd8b409bb30 msgr2=0x7fd8b40b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:46.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.468+0000 7fd8b8d49700 1 -- 172.21.15.50:0/1712747396 shutdown_connections 2023-11-28T11:54:46.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.468+0000 7fd8b8d49700 1 -- 172.21.15.50:0/1712747396 wait complete. 2023-11-28T11:54:46.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b8d49700 1 Processor -- start 2023-11-28T11:54:46.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b8d49700 1 -- start start 2023-11-28T11:54:46.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b8d49700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8b406d7d0 0x7fd8b41f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b8d49700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8b40b4c10 0x7fd8b415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b8d49700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b40cf050 0x7fd8b4157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b8d49700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40c60f0 con 0x7fd8b40cf050 2023-11-28T11:54:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b8d49700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b415d790 con 0x7fd8b406d7d0 2023-11-28T11:54:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b8d49700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b415c8a0 con 0x7fd8b40b4c10 2023-11-28T11:54:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b40cf050 0x7fd8b4157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b40cf050 0x7fd8b4157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51990/0 (socket says 172.21.15.50:51990) 2023-11-28T11:54:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b3fff700 1 -- 172.21.15.50:0/3038280609 learned_addr learned my addr 172.21.15.50:0/3038280609 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8aaffd700 1 --2- 172.21.15.50:0/3038280609 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8b40b4c10 0x7fd8b415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b37fe700 1 --2- 172.21.15.50:0/3038280609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8b406d7d0 0x7fd8b41f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b3fff700 1 -- 172.21.15.50:0/3038280609 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8b40b4c10 msgr2=0x7fd8b415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b3fff700 1 --2- 172.21.15.50:0/3038280609 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8b40b4c10 0x7fd8b415dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b3fff700 1 -- 172.21.15.50:0/3038280609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8b406d7d0 msgr2=0x7fd8b41f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b3fff700 1 --2- 172.21.15.50:0/3038280609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8b406d7d0 0x7fd8b41f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b3fff700 1 -- 172.21.15.50:0/3038280609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c0094b0 con 0x7fd8b40cf050 2023-11-28T11:54:46.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b3fff700 1 --2- 172.21.15.50:0/3038280609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b40cf050 0x7fd8b4157820 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00efc0 tx=0x7fd8ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:46.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b0ff9700 1 -- 172.21.15.50:0/3038280609 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac009ea0 con 0x7fd8b40cf050 2023-11-28T11:54:46.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b0ff9700 1 -- 172.21.15.50:0/3038280609 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac00f040 con 0x7fd8b40cf050 2023-11-28T11:54:46.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.472+0000 7fd8b8d49700 1 -- 172.21.15.50:0/3038280609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b40b4410 con 0x7fd8b40cf050 2023-11-28T11:54:46.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.476+0000 7fd8b0ff9700 1 -- 172.21.15.50:0/3038280609 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac00ced0 con 0x7fd8b40cf050 2023-11-28T11:54:46.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.476+0000 7fd8b8d49700 1 -- 172.21.15.50:0/3038280609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b406af40 con 0x7fd8b40cf050 2023-11-28T11:54:46.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.476+0000 7fd8b8d49700 1 -- 172.21.15.50:0/3038280609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b40b46f0 con 0x7fd8b40cf050 2023-11-28T11:54:46.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.476+0000 7fd8b0ff9700 1 -- 172.21.15.50:0/3038280609 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd8ac014480 con 0x7fd8b40cf050 2023-11-28T11:54:46.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.476+0000 7fd8b0ff9700 1 --2- 172.21.15.50:0/3038280609 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd894064ee0 0x7fd894067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.476+0000 7fd8b0ff9700 1 -- 172.21.15.50:0/3038280609 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd8ac082f20 con 0x7fd8b40cf050 2023-11-28T11:54:46.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.476+0000 7fd8b37fe700 1 --2- 172.21.15.50:0/3038280609 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd894064ee0 0x7fd894067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.476+0000 7fd8b37fe700 1 --2- 172.21.15.50:0/3038280609 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd894064ee0 0x7fd894067390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4000f60 tx=0x7fd8a4001df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:46.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.484+0000 7fd8b0ff9700 1 -- 172.21.15.50:0/3038280609 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd8ac050c40 con 0x7fd8b40cf050 2023-11-28T11:54:46.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.656+0000 7fd8b8d49700 1 -- 172.21.15.50:0/3038280609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd8b4072500 con 0x7fd8b40cf050 2023-11-28T11:54:46.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.660+0000 7fd8b0ff9700 1 -- 172.21.15.50:0/3038280609 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd8ac018080 con 0x7fd8b40cf050 2023-11-28T11:54:46.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.660+0000 7fd8b8d49700 1 -- 172.21.15.50:0/3038280609 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd894064ee0 msgr2=0x7fd894067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.660+0000 7fd8b8d49700 1 --2- 172.21.15.50:0/3038280609 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd894064ee0 0x7fd894067390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4000f60 tx=0x7fd8a4001df0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.660+0000 7fd8b8d49700 1 -- 172.21.15.50:0/3038280609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b40cf050 msgr2=0x7fd8b4157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.660+0000 7fd8b8d49700 1 --2- 172.21.15.50:0/3038280609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b40cf050 0x7fd8b4157820 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00efc0 tx=0x7fd8ac00c3a0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.660+0000 7fd8b8d49700 1 -- 172.21.15.50:0/3038280609 shutdown_connections 2023-11-28T11:54:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.660+0000 7fd8b8d49700 1 --2- 172.21.15.50:0/3038280609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8b40cf050 0x7fd8b4157820 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.660+0000 7fd8b8d49700 1 --2- 172.21.15.50:0/3038280609 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8b40b4c10 0x7fd8b415dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.660+0000 7fd8b8d49700 1 --2- 172.21.15.50:0/3038280609 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd894064ee0 0x7fd894067390 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.660+0000 7fd8b8d49700 1 --2- 172.21.15.50:0/3038280609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8b406d7d0 0x7fd8b41f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.660+0000 7fd8b8d49700 1 -- 172.21.15.50:0/3038280609 >> 172.21.15.50:0/3038280609 conn(0x7fd8b409bb30 msgr2=0x7fd8b40b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:46.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.660+0000 7fd8b8d49700 1 -- 172.21.15.50:0/3038280609 shutdown_connections 2023-11-28T11:54:46.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.660+0000 7fd8b8d49700 1 -- 172.21.15.50:0/3038280609 wait complete. 2023-11-28T11:54:46.666 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-11-28T11:54:46.675 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:54:46.675 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:54:46.685 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:46.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7fc902700 1 Processor -- start 2023-11-28T11:54:46.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7fc902700 1 -- start start 2023-11-28T11:54:46.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7fc902700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb7f8159e70 0x7fb7f806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7fc902700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb7f80cb470 0x7fb7f80c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7fc902700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f806ace0 con 0x7fb7f8069c40 2023-11-28T11:54:46.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7fc902700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f806a0d0 con 0x7fb7f8159e70 2023-11-28T11:54:46.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7fc902700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f806a3b0 con 0x7fb7f80cb470 2023-11-28T11:54:46.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7f6d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb7f8159e70 0x7fb7f806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7f659c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb7f8069c40 0x7fb7f80cad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59886/0 (socket says 172.21.15.50:59886) 2023-11-28T11:54:46.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7f659c700 1 -- 172.21.15.50:0/3663260423 learned_addr learned my addr 172.21.15.50:0/3663260423 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:46.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7f759e700 1 --2- 172.21.15.50:0/3663260423 >> v2:172.21.15.192:3300/0 conn(0x7fb7f80cb470 0x7fb7f80c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7f5d9b700 1 -- 172.21.15.50:0/3663260423 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079206296 0 0) 0x7fb7f806ace0 con 0x7fb7f8069c40 2023-11-28T11:54:46.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7f5d9b700 1 -- 172.21.15.50:0/3663260423 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e40035d0 con 0x7fb7f8069c40 2023-11-28T11:54:46.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7f6d9d700 1 -- 172.21.15.50:0/3663260423 >> v2:172.21.15.192:3300/0 conn(0x7fb7f80cb470 msgr2=0x7fb7f80c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:46.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7f6d9d700 1 --2- 172.21.15.50:0/3663260423 >> v2:172.21.15.192:3300/0 conn(0x7fb7f80cb470 0x7fb7f80c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7f6d9d700 1 -- 172.21.15.50:0/3663260423 >> v1:172.21.15.50:6789/0 conn(0x7fb7f8069c40 legacy=0x7fb7f80cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7f6d9d700 1 -- 172.21.15.50:0/3663260423 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f806a690 con 0x7fb7f8159e70 2023-11-28T11:54:46.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7f6d9d700 1 --2- 172.21.15.50:0/3663260423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f8159e70 0x7fb7f806c9a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80afe60 tx=0x7fb7e8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4b486a71d491d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:46.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.800+0000 7fb7f5d9b700 1 -- 172.21.15.50:0/3663260423 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8011830 con 0x7fb7f8159e70 2023-11-28T11:54:46.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.804+0000 7fb7f5d9b700 1 -- 172.21.15.50:0/3663260423 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e8011990 con 0x7fb7f8159e70 2023-11-28T11:54:46.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.804+0000 7fb7f5d9b700 1 -- 172.21.15.50:0/3663260423 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8011d00 con 0x7fb7f8159e70 2023-11-28T11:54:46.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.804+0000 7fb7fc902700 1 -- 172.21.15.50:0/3663260423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f8159e70 msgr2=0x7fb7f806c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.804+0000 7fb7fc902700 1 --2- 172.21.15.50:0/3663260423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f8159e70 0x7fb7f806c9a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80afe60 tx=0x7fb7e8009b30 comp rx=0 tx=0).stop 2023-11-28T11:54:46.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.804+0000 7fb7fc902700 1 -- 172.21.15.50:0/3663260423 shutdown_connections 2023-11-28T11:54:46.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.804+0000 7fb7fc902700 1 --2- 172.21.15.50:0/3663260423 >> v2:172.21.15.192:3300/0 conn(0x7fb7f80cb470 0x7fb7f80c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.804+0000 7fb7fc902700 1 --2- 172.21.15.50:0/3663260423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f8159e70 0x7fb7f806c9a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.804+0000 7fb7fc902700 1 -- 172.21.15.50:0/3663260423 >> 172.21.15.50:0/3663260423 conn(0x7fb7f80ce3e0 msgr2=0x7fb7f80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:46.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.804+0000 7fb7fc902700 1 -- 172.21.15.50:0/3663260423 shutdown_connections 2023-11-28T11:54:46.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.804+0000 7fb7fc902700 1 -- 172.21.15.50:0/3663260423 wait complete. 2023-11-28T11:54:46.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.804+0000 7fb7fc902700 1 Processor -- start 2023-11-28T11:54:46.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.804+0000 7fb7fc902700 1 -- start start 2023-11-28T11:54:46.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7fc902700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f8069c40 0x7fb7f8150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7fc902700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cb470 0x7fb7f81f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7fc902700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7f8159e70 0x7fb7f81f4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7fc902700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f80adb20 con 0x7fb7f8069c40 2023-11-28T11:54:46.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7fc902700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f815d2c0 con 0x7fb7f80cb470 2023-11-28T11:54:46.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7fc902700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f815cd20 con 0x7fb7f8159e70 2023-11-28T11:54:46.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7f6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f8069c40 0x7fb7f8150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7f6d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f8069c40 0x7fb7f8150560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52014/0 (socket says 172.21.15.50:52014) 2023-11-28T11:54:46.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7f659c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cb470 0x7fb7f81f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7f6d9d700 1 -- 172.21.15.50:0/2443760903 learned_addr learned my addr 172.21.15.50:0/2443760903 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:46.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7f759e700 1 --2- 172.21.15.50:0/2443760903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7f8159e70 0x7fb7f81f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7f6d9d700 1 -- 172.21.15.50:0/2443760903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7f8159e70 msgr2=0x7fb7f81f4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7f6d9d700 1 --2- 172.21.15.50:0/2443760903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7f8159e70 0x7fb7f81f4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7f6d9d700 1 -- 172.21.15.50:0/2443760903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cb470 msgr2=0x7fb7f81f0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7f6d9d700 1 --2- 172.21.15.50:0/2443760903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cb470 0x7fb7f81f0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7f6d9d700 1 -- 172.21.15.50:0/2443760903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e80094b0 con 0x7fb7f8069c40 2023-11-28T11:54:46.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7f6d9d700 1 --2- 172.21.15.50:0/2443760903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f8069c40 0x7fb7f8150560 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009b70 tx=0x7fb7e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:46.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7ef7fe700 1 -- 172.21.15.50:0/2443760903 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e80044d0 con 0x7fb7f8069c40 2023-11-28T11:54:46.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7ef7fe700 1 -- 172.21.15.50:0/2443760903 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e801e070 con 0x7fb7f8069c40 2023-11-28T11:54:46.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7fc902700 1 -- 172.21.15.50:0/2443760903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f815a240 con 0x7fb7f8069c40 2023-11-28T11:54:46.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7ef7fe700 1 -- 172.21.15.50:0/2443760903 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8003900 con 0x7fb7f8069c40 2023-11-28T11:54:46.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7fc902700 1 -- 172.21.15.50:0/2443760903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f806a970 con 0x7fb7f8069c40 2023-11-28T11:54:46.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.808+0000 7fb7fc902700 1 -- 172.21.15.50:0/2443760903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f806cee0 con 0x7fb7f8069c40 2023-11-28T11:54:46.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.812+0000 7fb7ef7fe700 1 -- 172.21.15.50:0/2443760903 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb7e800f050 con 0x7fb7f8069c40 2023-11-28T11:54:46.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.812+0000 7fb7ef7fe700 1 --2- 172.21.15.50:0/2443760903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb7d8064ee0 0x7fb7d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:46.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.812+0000 7fb7ef7fe700 1 -- 172.21.15.50:0/2443760903 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb7e8082ff0 con 0x7fb7f8069c40 2023-11-28T11:54:46.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.812+0000 7fb7f659c700 1 --2- 172.21.15.50:0/2443760903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb7d8064ee0 0x7fb7d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:46.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.812+0000 7fb7f659c700 1 --2- 172.21.15.50:0/2443760903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb7d8064ee0 0x7fb7d8067390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80b09a0 tx=0x7fb7e0007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:46.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.820+0000 7fb7ef7fe700 1 -- 172.21.15.50:0/2443760903 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb7e8050d50 con 0x7fb7f8069c40 2023-11-28T11:54:46.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.984+0000 7fb7fc902700 1 -- 172.21.15.50:0/2443760903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7f8072500 con 0x7fb7f8069c40 2023-11-28T11:54:46.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.988+0000 7fb7ef7fe700 1 -- 172.21.15.50:0/2443760903 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19689 (secure 0 0 0) 0x7fb7e8054370 con 0x7fb7f8069c40 2023-11-28T11:54:46.988 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:46.988 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:54:30.086945+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:46.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.988+0000 7fb7fc902700 1 -- 172.21.15.50:0/2443760903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb7d8064ee0 msgr2=0x7fb7d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.988+0000 7fb7fc902700 1 --2- 172.21.15.50:0/2443760903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb7d8064ee0 0x7fb7d8067390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80b09a0 tx=0x7fb7e0007de0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.988+0000 7fb7fc902700 1 -- 172.21.15.50:0/2443760903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f8069c40 msgr2=0x7fb7f8150560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:46.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.988+0000 7fb7fc902700 1 --2- 172.21.15.50:0/2443760903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f8069c40 0x7fb7f8150560 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009b70 tx=0x7fb7e8004770 comp rx=0 tx=0).stop 2023-11-28T11:54:46.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.988+0000 7fb7fc902700 1 -- 172.21.15.50:0/2443760903 shutdown_connections 2023-11-28T11:54:46.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.988+0000 7fb7fc902700 1 --2- 172.21.15.50:0/2443760903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7f8159e70 0x7fb7f81f4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.988+0000 7fb7fc902700 1 --2- 172.21.15.50:0/2443760903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb7d8064ee0 0x7fb7d8067390 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.988+0000 7fb7fc902700 1 --2- 172.21.15.50:0/2443760903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cb470 0x7fb7f81f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.988+0000 7fb7fc902700 1 --2- 172.21.15.50:0/2443760903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f8069c40 0x7fb7f8150560 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:46.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.988+0000 7fb7fc902700 1 -- 172.21.15.50:0/2443760903 >> 172.21.15.50:0/2443760903 conn(0x7fb7f80ce3e0 msgr2=0x7fb7f806be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:46.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.988+0000 7fb7fc902700 1 -- 172.21.15.50:0/2443760903 shutdown_connections 2023-11-28T11:54:46.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:46.988+0000 7fb7fc902700 1 -- 172.21.15.50:0/2443760903 wait complete. 2023-11-28T11:54:47.004 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:53:38.462826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:53:39.778621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:53:42.870360+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:54:47.005 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:54:47.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.128+0000 7f37c865f700 1 Processor -- start 2023-11-28T11:54:47.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.128+0000 7f37c865f700 1 -- start start 2023-11-28T11:54:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.128+0000 7f37c865f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37c0160ac0 0x7f37c00b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.128+0000 7f37c865f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c00d0740 con 0x7f37c00b45f0 2023-11-28T11:54:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.128+0000 7f37c865f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c00b4f00 con 0x7f37c00cd1c0 2023-11-28T11:54:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.128+0000 7f37c865f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c00d0990 con 0x7f37c0160ac0 2023-11-28T11:54:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.128+0000 7f37c5bfa700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37c0160ac0 0x7f37c00b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.128+0000 7f37c63fb700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f37c00b45f0 0x7f37c00d1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59902/0 (socket says 172.21.15.50:59902) 2023-11-28T11:54:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.128+0000 7f37c63fb700 1 -- 172.21.15.50:0/1977736062 learned_addr learned my addr 172.21.15.50:0/1977736062 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.128+0000 7f37c5bfa700 1 -- 172.21.15.50:0/1977736062 >> v1:172.21.15.192:6789/0 conn(0x7f37c00cd1c0 legacy=0x7f37c00b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.128+0000 7f37c5bfa700 1 -- 172.21.15.50:0/1977736062 >> v1:172.21.15.50:6789/0 conn(0x7f37c00b45f0 legacy=0x7f37c00d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.128+0000 7f37c5bfa700 1 -- 172.21.15.50:0/1977736062 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c00d0c70 con 0x7f37c0160ac0 2023-11-28T11:54:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.128+0000 7f37c5bfa700 1 --2- 172.21.15.50:0/1977736062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c0160ac0 0x7f37c00b49c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009850 tx=0x7f37b4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4750c6d6f3ed9a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.128+0000 7f37c53f9700 1 -- 172.21.15.50:0/1977736062 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4011830 con 0x7f37c0160ac0 2023-11-28T11:54:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.128+0000 7f37c53f9700 1 -- 172.21.15.50:0/1977736062 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b4011990 con 0x7f37c0160ac0 2023-11-28T11:54:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.128+0000 7f37c53f9700 1 -- 172.21.15.50:0/1977736062 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4011d20 con 0x7f37c0160ac0 2023-11-28T11:54:47.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.132+0000 7f37c865f700 1 -- 172.21.15.50:0/1977736062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c0160ac0 msgr2=0x7f37c00b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.132+0000 7f37c865f700 1 --2- 172.21.15.50:0/1977736062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c0160ac0 0x7f37c00b49c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009850 tx=0x7f37b4009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.132+0000 7f37c865f700 1 -- 172.21.15.50:0/1977736062 shutdown_connections 2023-11-28T11:54:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.132+0000 7f37c865f700 1 --2- 172.21.15.50:0/1977736062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c0160ac0 0x7f37c00b49c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.132+0000 7f37c865f700 1 -- 172.21.15.50:0/1977736062 >> 172.21.15.50:0/1977736062 conn(0x7f37c006cb40 msgr2=0x7f37c00cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.132+0000 7f37c865f700 1 -- 172.21.15.50:0/1977736062 shutdown_connections 2023-11-28T11:54:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.132+0000 7f37c865f700 1 -- 172.21.15.50:0/1977736062 wait complete. 2023-11-28T11:54:47.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.132+0000 7f37c865f700 1 Processor -- start 2023-11-28T11:54:47.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.132+0000 7f37c865f700 1 -- start start 2023-11-28T11:54:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c865f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37c00b45f0 0x7f37c014d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c865f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c00cd1c0 0x7f37c00b81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c865f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37c0160ac0 0x7f37c00d2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c865f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00b7d30 con 0x7f37c00cd1c0 2023-11-28T11:54:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c865f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00b7400 con 0x7f37c00b45f0 2023-11-28T11:54:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c865f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00b76e0 con 0x7f37c0160ac0 2023-11-28T11:54:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c5bfa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c00cd1c0 0x7f37c00b81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:47.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c5bfa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c00cd1c0 0x7f37c00b81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52042/0 (socket says 172.21.15.50:52042) 2023-11-28T11:54:47.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c5bfa700 1 -- 172.21.15.50:0/69981486 learned_addr learned my addr 172.21.15.50:0/69981486 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:47.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c6bfc700 1 --2- 172.21.15.50:0/69981486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37c0160ac0 0x7f37c00d2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:47.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c63fb700 1 --2- 172.21.15.50:0/69981486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37c00b45f0 0x7f37c014d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:47.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c5bfa700 1 -- 172.21.15.50:0/69981486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37c0160ac0 msgr2=0x7f37c00d2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c5bfa700 1 --2- 172.21.15.50:0/69981486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37c0160ac0 0x7f37c00d2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c5bfa700 1 -- 172.21.15.50:0/69981486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37c00b45f0 msgr2=0x7f37c014d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c5bfa700 1 --2- 172.21.15.50:0/69981486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37c00b45f0 0x7f37c014d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c5bfa700 1 -- 172.21.15.50:0/69981486 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b40094b0 con 0x7f37c00cd1c0 2023-11-28T11:54:47.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c5bfa700 1 --2- 172.21.15.50:0/69981486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c00cd1c0 0x7f37c00b81c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009fd0 tx=0x7f37b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:47.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37beffd700 1 -- 172.21.15.50:0/69981486 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b40036c0 con 0x7f37c00cd1c0 2023-11-28T11:54:47.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37beffd700 1 -- 172.21.15.50:0/69981486 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b401e070 con 0x7f37c00cd1c0 2023-11-28T11:54:47.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c865f700 1 -- 172.21.15.50:0/69981486 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c00d1230 con 0x7f37c00cd1c0 2023-11-28T11:54:47.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37beffd700 1 -- 172.21.15.50:0/69981486 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4003a60 con 0x7f37c00cd1c0 2023-11-28T11:54:47.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.136+0000 7f37c865f700 1 -- 172.21.15.50:0/69981486 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c00d0f50 con 0x7f37c00cd1c0 2023-11-28T11:54:47.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.140+0000 7f37c865f700 1 -- 172.21.15.50:0/69981486 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c015c660 con 0x7f37c00cd1c0 2023-11-28T11:54:47.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.140+0000 7f37beffd700 1 -- 172.21.15.50:0/69981486 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f37b400f050 con 0x7f37c00cd1c0 2023-11-28T11:54:47.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.140+0000 7f37beffd700 1 --2- 172.21.15.50:0/69981486 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f37ac064ee0 0x7f37ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:47.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.140+0000 7f37beffd700 1 -- 172.21.15.50:0/69981486 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f37b4020070 con 0x7f37c00cd1c0 2023-11-28T11:54:47.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.140+0000 7f37c63fb700 1 --2- 172.21.15.50:0/69981486 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f37ac064ee0 0x7f37ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:47.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.140+0000 7f37c63fb700 1 --2- 172.21.15.50:0/69981486 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f37ac064ee0 0x7f37ac067390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f37b0005930 tx=0x7f37b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:47.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.148+0000 7f37beffd700 1 -- 172.21.15.50:0/69981486 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f37b4051920 con 0x7f37c00cd1c0 2023-11-28T11:54:47.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.312+0000 7f37c865f700 1 -- 172.21.15.50:0/69981486 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f37c0072c20 con 0x7f37c00cd1c0 2023-11-28T11:54:47.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.312+0000 7f37beffd700 1 -- 172.21.15.50:0/69981486 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f37b4054f40 con 0x7f37c00cd1c0 2023-11-28T11:54:47.312 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:54:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.312+0000 7f37c865f700 1 -- 172.21.15.50:0/69981486 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f37ac064ee0 msgr2=0x7f37ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.312+0000 7f37c865f700 1 --2- 172.21.15.50:0/69981486 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f37ac064ee0 0x7f37ac067390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f37b0005930 tx=0x7f37b0009040 comp rx=0 tx=0).stop 2023-11-28T11:54:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.312+0000 7f37c865f700 1 -- 172.21.15.50:0/69981486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c00cd1c0 msgr2=0x7f37c00b81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.312+0000 7f37c865f700 1 --2- 172.21.15.50:0/69981486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c00cd1c0 0x7f37c00b81c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009fd0 tx=0x7f37b4004770 comp rx=0 tx=0).stop 2023-11-28T11:54:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.312+0000 7f37c865f700 1 -- 172.21.15.50:0/69981486 shutdown_connections 2023-11-28T11:54:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.312+0000 7f37c865f700 1 --2- 172.21.15.50:0/69981486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37c0160ac0 0x7f37c00d2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.312+0000 7f37c865f700 1 --2- 172.21.15.50:0/69981486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37c00cd1c0 0x7f37c00b81c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.312+0000 7f37c865f700 1 --2- 172.21.15.50:0/69981486 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f37ac064ee0 0x7f37ac067390 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.312+0000 7f37c865f700 1 --2- 172.21.15.50:0/69981486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37c00b45f0 0x7f37c014d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.312+0000 7f37c865f700 1 -- 172.21.15.50:0/69981486 >> 172.21.15.50:0/69981486 conn(0x7f37c006cb40 msgr2=0x7f37c0157050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.312+0000 7f37c865f700 1 -- 172.21.15.50:0/69981486 shutdown_connections 2023-11-28T11:54:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.312+0000 7f37c865f700 1 -- 172.21.15.50:0/69981486 wait complete. 2023-11-28T11:54:47.328 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:54:47.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.447+0000 7faaf88b8700 1 Processor -- start 2023-11-28T11:54:47.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.447+0000 7faaf88b8700 1 -- start start 2023-11-28T11:54:47.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.447+0000 7faaf88b8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faaf40b1ae0 0x7faaf406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:47.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.447+0000 7faaf88b8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faaf406a4c0 0x7faaf40d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:47.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.447+0000 7faaf88b8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf406a9c0 con 0x7faaf40cf0e0 2023-11-28T11:54:47.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.447+0000 7faaf88b8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf406aca0 con 0x7faaf40b1ae0 2023-11-28T11:54:47.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.447+0000 7faaf88b8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf406af80 con 0x7faaf406a4c0 2023-11-28T11:54:47.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.447+0000 7faaf2ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faaf406a4c0 0x7faaf40d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:47.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.447+0000 7faaf2ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faaf406a4c0 0x7faaf40d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:54856/0 (socket says 172.21.15.50:54856) 2023-11-28T11:54:47.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.447+0000 7faaf2ffd700 1 -- 172.21.15.50:0/3994804223 learned_addr learned my addr 172.21.15.50:0/3994804223 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:47.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.447+0000 7faaf37fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faaf40b1ae0 0x7faaf406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:47.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.447+0000 7faaf3fff700 1 --1- 172.21.15.50:0/3994804223 >> v1:172.21.15.192:6789/0 conn(0x7faaf40cf0e0 0x7faaf40b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:46266/0 (socket says 172.21.15.50:46266) 2023-11-28T11:54:47.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf27fc700 1 -- 172.21.15.50:0/3994804223 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4159480587 0 0) 0x7faaf406a9c0 con 0x7faaf40cf0e0 2023-11-28T11:54:47.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf27fc700 1 -- 172.21.15.50:0/3994804223 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faae00035d0 con 0x7faaf40cf0e0 2023-11-28T11:54:47.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf2ffd700 1 -- 172.21.15.50:0/3994804223 >> v2:172.21.15.192:3300/0 conn(0x7faaf40b1ae0 msgr2=0x7faaf406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:47.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf2ffd700 1 --2- 172.21.15.50:0/3994804223 >> v2:172.21.15.192:3300/0 conn(0x7faaf40b1ae0 0x7faaf406d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf2ffd700 1 -- 172.21.15.50:0/3994804223 >> v1:172.21.15.192:6789/0 conn(0x7faaf40cf0e0 legacy=0x7faaf40b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf2ffd700 1 -- 172.21.15.50:0/3994804223 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf40b4380 con 0x7faaf406a4c0 2023-11-28T11:54:47.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf2ffd700 1 --2- 172.21.15.50:0/3994804223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faaf406a4c0 0x7faaf40d03a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faae4009910 tx=0x7faae4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3e6a5a8e773d184 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:47.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf27fc700 1 -- 172.21.15.50:0/3994804223 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae4011830 con 0x7faaf406a4c0 2023-11-28T11:54:47.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf27fc700 1 -- 172.21.15.50:0/3994804223 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae4011990 con 0x7faaf406a4c0 2023-11-28T11:54:47.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf27fc700 1 -- 172.21.15.50:0/3994804223 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae4011d40 con 0x7faaf406a4c0 2023-11-28T11:54:47.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf88b8700 1 -- 172.21.15.50:0/3994804223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faaf406a4c0 msgr2=0x7faaf40d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf88b8700 1 --2- 172.21.15.50:0/3994804223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faaf406a4c0 0x7faaf40d03a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faae4009910 tx=0x7faae4009c20 comp rx=0 tx=0).stop 2023-11-28T11:54:47.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf88b8700 1 -- 172.21.15.50:0/3994804223 shutdown_connections 2023-11-28T11:54:47.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf88b8700 1 --2- 172.21.15.50:0/3994804223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faaf406a4c0 0x7faaf40d03a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf88b8700 1 --2- 172.21.15.50:0/3994804223 >> v2:172.21.15.192:3300/0 conn(0x7faaf40b1ae0 0x7faaf406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf88b8700 1 -- 172.21.15.50:0/3994804223 >> 172.21.15.50:0/3994804223 conn(0x7faaf409bbd0 msgr2=0x7faaf40b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:47.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf88b8700 1 -- 172.21.15.50:0/3994804223 shutdown_connections 2023-11-28T11:54:47.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.451+0000 7faaf88b8700 1 -- 172.21.15.50:0/3994804223 wait complete. 2023-11-28T11:54:47.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf88b8700 1 Processor -- start 2023-11-28T11:54:47.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf88b8700 1 -- start start 2023-11-28T11:54:47.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf88b8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faaf406a4c0 0x7faaf41f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:47.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf88b8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40b1ae0 0x7faaf40c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:47.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf88b8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faaf40cf0e0 0x7faaf415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:47.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf88b8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40c96c0 con 0x7faaf40b1ae0 2023-11-28T11:54:47.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf88b8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf41f29e0 con 0x7faaf40cf0e0 2023-11-28T11:54:47.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf88b8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf41f1dd0 con 0x7faaf406a4c0 2023-11-28T11:54:47.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40b1ae0 0x7faaf40c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:47.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40b1ae0 0x7faaf40c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52056/0 (socket says 172.21.15.50:52056) 2023-11-28T11:54:47.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf2ffd700 1 -- 172.21.15.50:0/3681508154 learned_addr learned my addr 172.21.15.50:0/3681508154 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:47.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf3fff700 1 --2- 172.21.15.50:0/3681508154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faaf40cf0e0 0x7faaf415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:47.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf37fe700 1 --2- 172.21.15.50:0/3681508154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faaf406a4c0 0x7faaf41f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:47.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf2ffd700 1 -- 172.21.15.50:0/3681508154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faaf406a4c0 msgr2=0x7faaf41f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf2ffd700 1 --2- 172.21.15.50:0/3681508154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faaf406a4c0 0x7faaf41f1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf2ffd700 1 -- 172.21.15.50:0/3681508154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faaf40cf0e0 msgr2=0x7faaf415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf2ffd700 1 --2- 172.21.15.50:0/3681508154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faaf40cf0e0 0x7faaf415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf2ffd700 1 -- 172.21.15.50:0/3681508154 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae4009570 con 0x7faaf40b1ae0 2023-11-28T11:54:47.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf2ffd700 1 --2- 172.21.15.50:0/3681508154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40b1ae0 0x7faaf40c9180 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7faae4013000 tx=0x7faae4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:47.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaebfff700 1 -- 172.21.15.50:0/3681508154 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae4004450 con 0x7faaf40b1ae0 2023-11-28T11:54:47.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaebfff700 1 -- 172.21.15.50:0/3681508154 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae401e070 con 0x7faaf40b1ae0 2023-11-28T11:54:47.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf88b8700 1 -- 172.21.15.50:0/3681508154 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf40b60e0 con 0x7faaf40b1ae0 2023-11-28T11:54:47.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaebfff700 1 -- 172.21.15.50:0/3681508154 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae4003900 con 0x7faaf40b1ae0 2023-11-28T11:54:47.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.455+0000 7faaf88b8700 1 -- 172.21.15.50:0/3681508154 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf40b1eb0 con 0x7faaf40b1ae0 2023-11-28T11:54:47.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.459+0000 7faaf88b8700 1 -- 172.21.15.50:0/3681508154 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf40d08e0 con 0x7faaf40b1ae0 2023-11-28T11:54:47.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.459+0000 7faaebfff700 1 -- 172.21.15.50:0/3681508154 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faae400f050 con 0x7faaf40b1ae0 2023-11-28T11:54:47.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.459+0000 7faaebfff700 1 --2- 172.21.15.50:0/3681508154 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faad4064ee0 0x7faad4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:47.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.459+0000 7faaebfff700 1 -- 172.21.15.50:0/3681508154 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faae4083020 con 0x7faaf40b1ae0 2023-11-28T11:54:47.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.459+0000 7faaf37fe700 1 --2- 172.21.15.50:0/3681508154 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faad4064ee0 0x7faad4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:47.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.459+0000 7faaf37fe700 1 --2- 172.21.15.50:0/3681508154 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faad4064ee0 0x7faad4067390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faaf415a700 tx=0x7faadc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:47.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.467+0000 7faaebfff700 1 -- 172.21.15.50:0/3681508154 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faae4050e90 con 0x7faaf40b1ae0 2023-11-28T11:54:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.635+0000 7faaf88b8700 1 -- 172.21.15.50:0/3681508154 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faaf41f2bb0 con 0x7faaf40b1ae0 2023-11-28T11:54:47.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.635+0000 7faaebfff700 1 -- 172.21.15.50:0/3681508154 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7faaf41f2bb0 con 0x7faaf40b1ae0 2023-11-28T11:54:47.638 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:54:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.639+0000 7faaf88b8700 1 -- 172.21.15.50:0/3681508154 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faad4064ee0 msgr2=0x7faad4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.639+0000 7faaf88b8700 1 --2- 172.21.15.50:0/3681508154 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faad4064ee0 0x7faad4067390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faaf415a700 tx=0x7faadc008040 comp rx=0 tx=0).stop 2023-11-28T11:54:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.639+0000 7faaf88b8700 1 -- 172.21.15.50:0/3681508154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40b1ae0 msgr2=0x7faaf40c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.639+0000 7faaf88b8700 1 --2- 172.21.15.50:0/3681508154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40b1ae0 0x7faaf40c9180 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7faae4013000 tx=0x7faae4004770 comp rx=0 tx=0).stop 2023-11-28T11:54:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.639+0000 7faaf88b8700 1 -- 172.21.15.50:0/3681508154 shutdown_connections 2023-11-28T11:54:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.639+0000 7faaf88b8700 1 --2- 172.21.15.50:0/3681508154 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faad4064ee0 0x7faad4067390 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.639+0000 7faaf88b8700 1 --2- 172.21.15.50:0/3681508154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faaf40cf0e0 0x7faaf415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.639+0000 7faaf88b8700 1 --2- 172.21.15.50:0/3681508154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf40b1ae0 0x7faaf40c9180 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.639+0000 7faaf88b8700 1 --2- 172.21.15.50:0/3681508154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faaf406a4c0 0x7faaf41f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.639+0000 7faaf88b8700 1 -- 172.21.15.50:0/3681508154 >> 172.21.15.50:0/3681508154 conn(0x7faaf409bbd0 msgr2=0x7faaf415bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:47.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.639+0000 7faaf88b8700 1 -- 172.21.15.50:0/3681508154 shutdown_connections 2023-11-28T11:54:47.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.639+0000 7faaf88b8700 1 -- 172.21.15.50:0/3681508154 wait complete. 2023-11-28T11:54:47.653 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:54:47.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.771+0000 7faa6232e700 1 Processor -- start 2023-11-28T11:54:47.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.771+0000 7faa6232e700 1 -- start start 2023-11-28T11:54:47.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.771+0000 7faa6232e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faa5c0cf7f0 0x7faa5c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:47.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.771+0000 7faa6232e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5c06a9c0 con 0x7faa5c0b1ae0 2023-11-28T11:54:47.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.771+0000 7faa6232e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5c06aca0 con 0x7faa5c06a4c0 2023-11-28T11:54:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.771+0000 7faa6232e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5c0d0ab0 con 0x7faa5c0cf7f0 2023-11-28T11:54:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa6132c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faa5c0b1ae0 0x7faa5c0d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59906/0 (socket says 172.21.15.50:59906) 2023-11-28T11:54:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa6132c700 1 -- 172.21.15.50:0/1248175027 learned_addr learned my addr 172.21.15.50:0/1248175027 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:47.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa61b2d700 1 --2- 172.21.15.50:0/1248175027 >> v2:172.21.15.192:3300/0 conn(0x7faa5c0cf7f0 0x7faa5c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:47.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa4ffff700 1 -- 172.21.15.50:0/1248175027 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1813770639 0 0) 0x7faa5c06a9c0 con 0x7faa5c0b1ae0 2023-11-28T11:54:47.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa4ffff700 1 -- 172.21.15.50:0/1248175027 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa480035d0 con 0x7faa5c0b1ae0 2023-11-28T11:54:47.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa61b2d700 1 -- 172.21.15.50:0/1248175027 >> v1:172.21.15.192:6789/0 conn(0x7faa5c06a4c0 legacy=0x7faa5c0cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa61b2d700 1 -- 172.21.15.50:0/1248175027 >> v1:172.21.15.50:6789/0 conn(0x7faa5c0b1ae0 legacy=0x7faa5c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa61b2d700 1 -- 172.21.15.50:0/1248175027 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5c06af80 con 0x7faa5c0cf7f0 2023-11-28T11:54:47.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa61b2d700 1 --2- 172.21.15.50:0/1248175027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa5c0cf7f0 0x7faa5c06d8e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faa54009d90 tx=0x7faa5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c852905e27c4ca4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:47.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa4ffff700 1 -- 172.21.15.50:0/1248175027 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5400e070 con 0x7faa5c0cf7f0 2023-11-28T11:54:47.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa4ffff700 1 -- 172.21.15.50:0/1248175027 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5400bb20 con 0x7faa5c0cf7f0 2023-11-28T11:54:47.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa4ffff700 1 -- 172.21.15.50:0/1248175027 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54012430 con 0x7faa5c0cf7f0 2023-11-28T11:54:47.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa6232e700 1 -- 172.21.15.50:0/1248175027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa5c0cf7f0 msgr2=0x7faa5c06d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa6232e700 1 --2- 172.21.15.50:0/1248175027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa5c0cf7f0 0x7faa5c06d8e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faa54009d90 tx=0x7faa5400b330 comp rx=0 tx=0).stop 2023-11-28T11:54:47.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa6232e700 1 -- 172.21.15.50:0/1248175027 shutdown_connections 2023-11-28T11:54:47.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa6232e700 1 --2- 172.21.15.50:0/1248175027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa5c0cf7f0 0x7faa5c06d8e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa6232e700 1 -- 172.21.15.50:0/1248175027 >> 172.21.15.50:0/1248175027 conn(0x7faa5c09bbd0 msgr2=0x7faa5c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:47.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa6232e700 1 -- 172.21.15.50:0/1248175027 shutdown_connections 2023-11-28T11:54:47.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.775+0000 7faa6232e700 1 -- 172.21.15.50:0/1248175027 wait complete. 2023-11-28T11:54:47.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.779+0000 7faa6232e700 1 Processor -- start 2023-11-28T11:54:47.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.779+0000 7faa6232e700 1 -- start start 2023-11-28T11:54:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa6232e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa5c06a4c0 0x7faa5c0c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa6232e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa5c0b1ae0 0x7faa5c0c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa6232e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa5c0cf7f0 0x7faa5c159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa6232e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c0c67d0 con 0x7faa5c0b1ae0 2023-11-28T11:54:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa6232e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c0c6a70 con 0x7faa5c06a4c0 2023-11-28T11:54:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa6232e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c0c6d50 con 0x7faa5c0cf7f0 2023-11-28T11:54:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa60b2b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa5c0b1ae0 0x7faa5c0c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa60b2b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa5c0b1ae0 0x7faa5c0c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52064/0 (socket says 172.21.15.50:52064) 2023-11-28T11:54:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa60b2b700 1 -- 172.21.15.50:0/3455859772 learned_addr learned my addr 172.21.15.50:0/3455859772 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa6132c700 1 --2- 172.21.15.50:0/3455859772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa5c06a4c0 0x7faa5c0c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:47.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa61b2d700 1 --2- 172.21.15.50:0/3455859772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa5c0cf7f0 0x7faa5c159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa60b2b700 1 -- 172.21.15.50:0/3455859772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa5c0cf7f0 msgr2=0x7faa5c159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa60b2b700 1 --2- 172.21.15.50:0/3455859772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa5c0cf7f0 0x7faa5c159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa60b2b700 1 -- 172.21.15.50:0/3455859772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa5c06a4c0 msgr2=0x7faa5c0c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa60b2b700 1 --2- 172.21.15.50:0/3455859772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa5c06a4c0 0x7faa5c0c6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa60b2b700 1 -- 172.21.15.50:0/3455859772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa54009a70 con 0x7faa5c0b1ae0 2023-11-28T11:54:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa61b2d700 1 --2- 172.21.15.50:0/3455859772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa5c0cf7f0 0x7faa5c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:47.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa60b2b700 1 --2- 172.21.15.50:0/3455859772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa5c0b1ae0 0x7faa5c0c8b20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7faa5800c500 tx=0x7faa5800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:47.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa4dffb700 1 -- 172.21.15.50:0/3455859772 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa580052d0 con 0x7faa5c0b1ae0 2023-11-28T11:54:47.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa4dffb700 1 -- 172.21.15.50:0/3455859772 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa58005430 con 0x7faa5c0b1ae0 2023-11-28T11:54:47.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa6232e700 1 -- 172.21.15.50:0/3455859772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5c0b1eb0 con 0x7faa5c0b1ae0 2023-11-28T11:54:47.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa4dffb700 1 -- 172.21.15.50:0/3455859772 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa580055a0 con 0x7faa5c0b1ae0 2023-11-28T11:54:47.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.783+0000 7faa6232e700 1 -- 172.21.15.50:0/3455859772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5c0b4380 con 0x7faa5c0b1ae0 2023-11-28T11:54:47.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.787+0000 7faa6232e700 1 -- 172.21.15.50:0/3455859772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5c0b60e0 con 0x7faa5c0b1ae0 2023-11-28T11:54:47.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.787+0000 7faa4dffb700 1 -- 172.21.15.50:0/3455859772 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faa58019030 con 0x7faa5c0b1ae0 2023-11-28T11:54:47.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.787+0000 7faa4dffb700 1 --2- 172.21.15.50:0/3455859772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa40064ee0 0x7faa40067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:47.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.787+0000 7faa4dffb700 1 -- 172.21.15.50:0/3455859772 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faa58081430 con 0x7faa5c0b1ae0 2023-11-28T11:54:47.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.787+0000 7faa6132c700 1 --2- 172.21.15.50:0/3455859772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa40064ee0 0x7faa40067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:47.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.787+0000 7faa6132c700 1 --2- 172.21.15.50:0/3455859772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa40064ee0 0x7faa40067390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faa50007fd0 tx=0x7faa50007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:47.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.795+0000 7faa4dffb700 1 -- 172.21.15.50:0/3455859772 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faa5804f2a0 con 0x7faa5c0b1ae0 2023-11-28T11:54:47.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.959+0000 7faa6232e700 1 -- 172.21.15.50:0/3455859772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa5c072500 con 0x7faa5c0b1ae0 2023-11-28T11:54:47.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.959+0000 7faa4dffb700 1 -- 172.21.15.50:0/3455859772 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa580528c0 con 0x7faa5c0b1ae0 2023-11-28T11:54:47.961 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.963+0000 7faa6232e700 1 -- 172.21.15.50:0/3455859772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa40064ee0 msgr2=0x7faa40067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.963+0000 7faa6232e700 1 --2- 172.21.15.50:0/3455859772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa40064ee0 0x7faa40067390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faa50007fd0 tx=0x7faa50007de0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.963+0000 7faa6232e700 1 -- 172.21.15.50:0/3455859772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa5c0b1ae0 msgr2=0x7faa5c0c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.963+0000 7faa6232e700 1 --2- 172.21.15.50:0/3455859772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa5c0b1ae0 0x7faa5c0c8b20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7faa5800c500 tx=0x7faa5800c810 comp rx=0 tx=0).stop 2023-11-28T11:54:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.963+0000 7faa6232e700 1 -- 172.21.15.50:0/3455859772 shutdown_connections 2023-11-28T11:54:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.963+0000 7faa6232e700 1 --2- 172.21.15.50:0/3455859772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa5c0cf7f0 0x7faa5c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.963+0000 7faa6232e700 1 --2- 172.21.15.50:0/3455859772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa5c0b1ae0 0x7faa5c0c8b20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.963+0000 7faa6232e700 1 --2- 172.21.15.50:0/3455859772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa40064ee0 0x7faa40067390 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.963+0000 7faa6232e700 1 --2- 172.21.15.50:0/3455859772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa5c06a4c0 0x7faa5c0c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:47.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.963+0000 7faa6232e700 1 -- 172.21.15.50:0/3455859772 >> 172.21.15.50:0/3455859772 conn(0x7faa5c09bbd0 msgr2=0x7faa5c0cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:47.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.963+0000 7faa6232e700 1 -- 172.21.15.50:0/3455859772 shutdown_connections 2023-11-28T11:54:47.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:47.963+0000 7faa6232e700 1 -- 172.21.15.50:0/3455859772 wait complete. 2023-11-28T11:54:47.977 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:54:48.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0fbfff700 1 Processor -- start 2023-11-28T11:54:48.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0fbfff700 1 -- start start 2023-11-28T11:54:48.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0fbfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb0fc0cca00 0x7fb0fc166ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:48.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0fbfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0fc0b0910 con 0x7fb0fc15c520 2023-11-28T11:54:48.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0fbfff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0fc06a470 con 0x7fb0fc0ac1f0 2023-11-28T11:54:48.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0fbfff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0fc0b2250 con 0x7fb0fc0cca00 2023-11-28T11:54:48.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0faffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb0fc15c520 0x7fb0fc069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59918/0 (socket says 172.21.15.50:59918) 2023-11-28T11:54:48.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0faffd700 1 -- 172.21.15.50:0/2227200191 learned_addr learned my addr 172.21.15.50:0/2227200191 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:48.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0fb7fe700 1 --2- 172.21.15.50:0/2227200191 >> v2:172.21.15.192:3300/0 conn(0x7fb0fc0cca00 0x7fb0fc166ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:48.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0f9ffb700 1 -- 172.21.15.50:0/2227200191 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437558534 0 0) 0x7fb0fc0b0910 con 0x7fb0fc15c520 2023-11-28T11:54:48.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0f9ffb700 1 -- 172.21.15.50:0/2227200191 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0e40035d0 con 0x7fb0fc15c520 2023-11-28T11:54:48.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0fb7fe700 1 -- 172.21.15.50:0/2227200191 >> v1:172.21.15.192:6789/0 conn(0x7fb0fc0ac1f0 legacy=0x7fb0fc0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0fb7fe700 1 -- 172.21.15.50:0/2227200191 >> v1:172.21.15.50:6789/0 conn(0x7fb0fc15c520 legacy=0x7fb0fc069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0fb7fe700 1 -- 172.21.15.50:0/2227200191 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc06a750 con 0x7fb0fc0cca00 2023-11-28T11:54:48.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0fb7fe700 1 --2- 172.21.15.50:0/2227200191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0fc0cca00 0x7fb0fc166ef0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009dc0 tx=0x7fb0f400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29438b12fdb19a1e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0f9ffb700 1 -- 172.21.15.50:0/2227200191 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f400e070 con 0x7fb0fc0cca00 2023-11-28T11:54:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0f9ffb700 1 -- 172.21.15.50:0/2227200191 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f400bae0 con 0x7fb0fc0cca00 2023-11-28T11:54:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.095+0000 7fb0f9ffb700 1 -- 172.21.15.50:0/2227200191 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f400be50 con 0x7fb0fc0cca00 2023-11-28T11:54:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.099+0000 7fb0fbfff700 1 -- 172.21.15.50:0/2227200191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0fc0cca00 msgr2=0x7fb0fc166ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.099+0000 7fb0fbfff700 1 --2- 172.21.15.50:0/2227200191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0fc0cca00 0x7fb0fc166ef0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009dc0 tx=0x7fb0f400b330 comp rx=0 tx=0).stop 2023-11-28T11:54:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.099+0000 7fb0fbfff700 1 -- 172.21.15.50:0/2227200191 shutdown_connections 2023-11-28T11:54:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.099+0000 7fb0fbfff700 1 --2- 172.21.15.50:0/2227200191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0fc0cca00 0x7fb0fc166ef0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.099+0000 7fb0fbfff700 1 -- 172.21.15.50:0/2227200191 >> 172.21.15.50:0/2227200191 conn(0x7fb0fc0cae70 msgr2=0x7fb0fc0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.099+0000 7fb0fbfff700 1 -- 172.21.15.50:0/2227200191 shutdown_connections 2023-11-28T11:54:48.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.099+0000 7fb0fbfff700 1 -- 172.21.15.50:0/2227200191 wait complete. 2023-11-28T11:54:48.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.099+0000 7fb0fbfff700 1 Processor -- start 2023-11-28T11:54:48.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.099+0000 7fb0fbfff700 1 -- start start 2023-11-28T11:54:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fbfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0fc0ac1f0 0x7fb0fc159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0fc0cca00 0x7fb0fc15a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fbfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0fc15c520 0x7fb0fc15a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fbfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0ae870 con 0x7fb0fc0cca00 2023-11-28T11:54:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fbfff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc09a310 con 0x7fb0fc0ac1f0 2023-11-28T11:54:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fbfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc09b410 con 0x7fb0fc15c520 2023-11-28T11:54:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fa7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0fc0cca00 0x7fb0fc15a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fa7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0fc0cca00 0x7fb0fc15a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52076/0 (socket says 172.21.15.50:52076) 2023-11-28T11:54:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fb7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0fc15c520 0x7fb0fc15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0faffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0fc0ac1f0 0x7fb0fc159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:48.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fa7fc700 1 -- 172.21.15.50:0/3011167008 learned_addr learned my addr 172.21.15.50:0/3011167008 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:48.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fb7fe700 1 -- 172.21.15.50:0/3011167008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0fc0ac1f0 msgr2=0x7fb0fc159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fb7fe700 1 --2- 172.21.15.50:0/3011167008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0fc0ac1f0 0x7fb0fc159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fb7fe700 1 -- 172.21.15.50:0/3011167008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0fc0cca00 msgr2=0x7fb0fc15a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fb7fe700 1 --2- 172.21.15.50:0/3011167008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0fc0cca00 0x7fb0fc15a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fb7fe700 1 -- 172.21.15.50:0/3011167008 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4009a70 con 0x7fb0fc15c520 2023-11-28T11:54:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fb7fe700 1 --2- 172.21.15.50:0/3011167008 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0fc15c520 0x7fb0fc15a750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc066160 tx=0x7fb0f4004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0e37fe700 1 -- 172.21.15.50:0/3011167008 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f40098f0 con 0x7fb0fc15c520 2023-11-28T11:54:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0e37fe700 1 -- 172.21.15.50:0/3011167008 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f401f070 con 0x7fb0fc15c520 2023-11-28T11:54:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fbfff700 1 -- 172.21.15.50:0/3011167008 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0fc06ad10 con 0x7fb0fc15c520 2023-11-28T11:54:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0e37fe700 1 -- 172.21.15.50:0/3011167008 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4025600 con 0x7fb0fc15c520 2023-11-28T11:54:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fbfff700 1 -- 172.21.15.50:0/3011167008 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0fc06aa30 con 0x7fb0fc15c520 2023-11-28T11:54:48.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.103+0000 7fb0fbfff700 1 -- 172.21.15.50:0/3011167008 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0fc06aff0 con 0x7fb0fc15c520 2023-11-28T11:54:48.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.107+0000 7fb0e37fe700 1 -- 172.21.15.50:0/3011167008 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb0f402b060 con 0x7fb0fc15c520 2023-11-28T11:54:48.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.107+0000 7fb0e37fe700 1 --2- 172.21.15.50:0/3011167008 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb0e8064ee0 0x7fb0e8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:48.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.107+0000 7fb0e37fe700 1 -- 172.21.15.50:0/3011167008 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb0f40835d0 con 0x7fb0fc15c520 2023-11-28T11:54:48.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.107+0000 7fb0faffd700 1 --2- 172.21.15.50:0/3011167008 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb0e8064ee0 0x7fb0e8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.107+0000 7fb0faffd700 1 --2- 172.21.15.50:0/3011167008 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb0e8064ee0 0x7fb0e8067390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec007fd0 tx=0x7fb0ec007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:48.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.119+0000 7fb0e37fe700 1 -- 172.21.15.50:0/3011167008 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb0f40512d0 con 0x7fb0fc15c520 2023-11-28T11:54:48.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.283+0000 7fb0fbfff700 1 -- 172.21.15.50:0/3011167008 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0fc06d7d0 con 0x7fb0fc15c520 2023-11-28T11:54:48.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.283+0000 7fb0e37fe700 1 -- 172.21.15.50:0/3011167008 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb0f40548f0 con 0x7fb0fc15c520 2023-11-28T11:54:48.286 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:54:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.287+0000 7fb0fbfff700 1 -- 172.21.15.50:0/3011167008 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb0e8064ee0 msgr2=0x7fb0e8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.287+0000 7fb0fbfff700 1 --2- 172.21.15.50:0/3011167008 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb0e8064ee0 0x7fb0e8067390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec007fd0 tx=0x7fb0ec007de0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.287+0000 7fb0fbfff700 1 -- 172.21.15.50:0/3011167008 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0fc15c520 msgr2=0x7fb0fc15a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.287+0000 7fb0fbfff700 1 --2- 172.21.15.50:0/3011167008 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0fc15c520 0x7fb0fc15a750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc066160 tx=0x7fb0f4004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.287+0000 7fb0fbfff700 1 -- 172.21.15.50:0/3011167008 shutdown_connections 2023-11-28T11:54:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.287+0000 7fb0fbfff700 1 --2- 172.21.15.50:0/3011167008 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0fc15c520 0x7fb0fc15a750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.287+0000 7fb0fbfff700 1 --2- 172.21.15.50:0/3011167008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0fc0cca00 0x7fb0fc15a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.287+0000 7fb0fbfff700 1 --2- 172.21.15.50:0/3011167008 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb0e8064ee0 0x7fb0e8067390 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.287+0000 7fb0fbfff700 1 --2- 172.21.15.50:0/3011167008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0fc0ac1f0 0x7fb0fc159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.287+0000 7fb0fbfff700 1 -- 172.21.15.50:0/3011167008 >> 172.21.15.50:0/3011167008 conn(0x7fb0fc0cae70 msgr2=0x7fb0fc069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:48.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.287+0000 7fb0fbfff700 1 -- 172.21.15.50:0/3011167008 shutdown_connections 2023-11-28T11:54:48.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.287+0000 7fb0fbfff700 1 -- 172.21.15.50:0/3011167008 wait complete. 2023-11-28T11:54:48.300 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:54:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.415+0000 7fb2bffff700 1 Processor -- start 2023-11-28T11:54:48.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.415+0000 7fb2bffff700 1 -- start start 2023-11-28T11:54:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2c00cfdd0 0x7fb2c00b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb2c00b2570 0x7fb2c00cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bffff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c00cac70 con 0x7fb2c00cc590 2023-11-28T11:54:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bffff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c006c8e0 con 0x7fb2c00b2570 2023-11-28T11:54:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bffff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00b29f0 con 0x7fb2c00cfdd0 2023-11-28T11:54:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bf7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb2c00b2570 0x7fb2c00cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2beffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb2c00cc590 0x7fb2c00b0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59924/0 (socket says 172.21.15.50:59924) 2023-11-28T11:54:48.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bf7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb2c00b2570 0x7fb2c00cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52090/0 (socket says 172.21.15.50:52090) 2023-11-28T11:54:48.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2beffd700 1 -- 172.21.15.50:0/2020390636 learned_addr learned my addr 172.21.15.50:0/2020390636 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:48.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2be7fc700 1 --2- 172.21.15.50:0/2020390636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2c00cfdd0 0x7fb2c00b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:48.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bf7fe700 1 -- 172.21.15.50:0/2020390636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2c00cfdd0 msgr2=0x7fb2c00b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:48.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bdffb700 1 -- 172.21.15.50:0/2020390636 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777461726 0 0) 0x7fb2c00cac70 con 0x7fb2c00cc590 2023-11-28T11:54:48.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bf7fe700 1 --2- 172.21.15.50:0/2020390636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2c00cfdd0 0x7fb2c00b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bf7fe700 1 -- 172.21.15.50:0/2020390636 >> v1:172.21.15.50:6789/0 conn(0x7fb2c00cc590 legacy=0x7fb2c00b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bf7fe700 1 -- 172.21.15.50:0/2020390636 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c00d0340 con 0x7fb2c00b2570 2023-11-28T11:54:48.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bf7fe700 1 --2- 172.21.15.50:0/2020390636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c00b2570 0x7fb2c00cea40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009d90 tx=0x7fb2b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989655f6897464d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:48.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bdffb700 1 -- 172.21.15.50:0/2020390636 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b800e070 con 0x7fb2c00b2570 2023-11-28T11:54:48.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bdffb700 1 -- 172.21.15.50:0/2020390636 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b800bb20 con 0x7fb2c00b2570 2023-11-28T11:54:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bdffb700 1 -- 172.21.15.50:0/2020390636 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8012430 con 0x7fb2c00b2570 2023-11-28T11:54:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bffff700 1 -- 172.21.15.50:0/2020390636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c00b2570 msgr2=0x7fb2c00cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bffff700 1 --2- 172.21.15.50:0/2020390636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c00b2570 0x7fb2c00cea40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009d90 tx=0x7fb2b800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bffff700 1 -- 172.21.15.50:0/2020390636 shutdown_connections 2023-11-28T11:54:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bffff700 1 --2- 172.21.15.50:0/2020390636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c00b2570 0x7fb2c00cea40 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bffff700 1 --2- 172.21.15.50:0/2020390636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2c00cfdd0 0x7fb2c00b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bffff700 1 -- 172.21.15.50:0/2020390636 >> 172.21.15.50:0/2020390636 conn(0x7fb2c00cd0a0 msgr2=0x7fb2c00cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bffff700 1 -- 172.21.15.50:0/2020390636 shutdown_connections 2023-11-28T11:54:48.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.419+0000 7fb2bffff700 1 -- 172.21.15.50:0/2020390636 wait complete. 2023-11-28T11:54:48.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2bffff700 1 Processor -- start 2023-11-28T11:54:48.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2bffff700 1 -- start start 2023-11-28T11:54:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2bffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c00b2570 0x7fb2c015e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2bffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2c00cfdd0 0x7fb2c01f2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2bffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2c00b3450 0x7fb2c00b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2bffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c01573d0 con 0x7fb2c00b2570 2023-11-28T11:54:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2bffff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00b6310 con 0x7fb2c00b3450 2023-11-28T11:54:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2bffff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c01f25d0 con 0x7fb2c00cfdd0 2023-11-28T11:54:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2beffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c00b2570 0x7fb2c015e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2beffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c00b2570 0x7fb2c015e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52098/0 (socket says 172.21.15.50:52098) 2023-11-28T11:54:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2be7fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2c00cfdd0 0x7fb2c01f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2beffd700 1 -- 172.21.15.50:0/1924432227 learned_addr learned my addr 172.21.15.50:0/1924432227 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:48.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2bf7fe700 1 --2- 172.21.15.50:0/1924432227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2c00b3450 0x7fb2c00b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:48.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2be7fc700 1 -- 172.21.15.50:0/1924432227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2c00b3450 msgr2=0x7fb2c00b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2be7fc700 1 --2- 172.21.15.50:0/1924432227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2c00b3450 0x7fb2c00b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2be7fc700 1 -- 172.21.15.50:0/1924432227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c00b2570 msgr2=0x7fb2c015e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2be7fc700 1 --2- 172.21.15.50:0/1924432227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c00b2570 0x7fb2c015e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2be7fc700 1 -- 172.21.15.50:0/1924432227 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b8009a70 con 0x7fb2c00cfdd0 2023-11-28T11:54:48.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2beffd700 1 --2- 172.21.15.50:0/1924432227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c00b2570 0x7fb2c015e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:48.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2be7fc700 1 --2- 172.21.15.50:0/1924432227 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2c00cfdd0 0x7fb2c01f2090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000e870 tx=0x7fb2b000eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:48.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2a77fe700 1 -- 172.21.15.50:0/1924432227 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0013680 con 0x7fb2c00cfdd0 2023-11-28T11:54:48.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2a77fe700 1 -- 172.21.15.50:0/1924432227 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b00137e0 con 0x7fb2c00cfdd0 2023-11-28T11:54:48.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2bffff700 1 -- 172.21.15.50:0/1924432227 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c006d4b0 con 0x7fb2c00cfdd0 2023-11-28T11:54:48.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2a77fe700 1 -- 172.21.15.50:0/1924432227 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0013b70 con 0x7fb2c00cfdd0 2023-11-28T11:54:48.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.423+0000 7fb2bffff700 1 -- 172.21.15.50:0/1924432227 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c006d1d0 con 0x7fb2c00cfdd0 2023-11-28T11:54:48.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.427+0000 7fb2bffff700 1 -- 172.21.15.50:0/1924432227 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c00ce520 con 0x7fb2c00cfdd0 2023-11-28T11:54:48.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.427+0000 7fb2a77fe700 1 -- 172.21.15.50:0/1924432227 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb2b0019030 con 0x7fb2c00cfdd0 2023-11-28T11:54:48.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.427+0000 7fb2a77fe700 1 --2- 172.21.15.50:0/1924432227 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb2ac064ee0 0x7fb2ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:48.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.427+0000 7fb2a77fe700 1 -- 172.21.15.50:0/1924432227 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb2b0081f10 con 0x7fb2c00cfdd0 2023-11-28T11:54:48.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.427+0000 7fb2beffd700 1 --2- 172.21.15.50:0/1924432227 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb2ac064ee0 0x7fb2ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:48.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.427+0000 7fb2beffd700 1 --2- 172.21.15.50:0/1924432227 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb2ac064ee0 0x7fb2ac067390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40012d0 tx=0x7fb2b4004b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:48.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.439+0000 7fb2a77fe700 1 -- 172.21.15.50:0/1924432227 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb2b004fd00 con 0x7fb2c00cfdd0 2023-11-28T11:54:48.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.603+0000 7fb2bffff700 1 -- 172.21.15.50:0/1924432227 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb2c0072c20 con 0x7fb2c00cfdd0 2023-11-28T11:54:48.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.603+0000 7fb2a77fe700 1 -- 172.21.15.50:0/1924432227 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb2b0021020 con 0x7fb2c00cfdd0 2023-11-28T11:54:48.607 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.607+0000 7fb2bffff700 1 -- 172.21.15.50:0/1924432227 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb2ac064ee0 msgr2=0x7fb2ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.607+0000 7fb2bffff700 1 --2- 172.21.15.50:0/1924432227 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb2ac064ee0 0x7fb2ac067390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40012d0 tx=0x7fb2b4004b50 comp rx=0 tx=0).stop 2023-11-28T11:54:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.607+0000 7fb2bffff700 1 -- 172.21.15.50:0/1924432227 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2c00cfdd0 msgr2=0x7fb2c01f2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.607+0000 7fb2bffff700 1 --2- 172.21.15.50:0/1924432227 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2c00cfdd0 0x7fb2c01f2090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000e870 tx=0x7fb2b000eb80 comp rx=0 tx=0).stop 2023-11-28T11:54:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.607+0000 7fb2bffff700 1 -- 172.21.15.50:0/1924432227 shutdown_connections 2023-11-28T11:54:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.607+0000 7fb2bffff700 1 --2- 172.21.15.50:0/1924432227 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb2ac064ee0 0x7fb2ac067390 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.607+0000 7fb2bffff700 1 --2- 172.21.15.50:0/1924432227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2c00b3450 0x7fb2c00b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.607+0000 7fb2bffff700 1 --2- 172.21.15.50:0/1924432227 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2c00cfdd0 0x7fb2c01f2090 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.607+0000 7fb2bffff700 1 --2- 172.21.15.50:0/1924432227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c00b2570 0x7fb2c015e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.607+0000 7fb2bffff700 1 -- 172.21.15.50:0/1924432227 >> 172.21.15.50:0/1924432227 conn(0x7fb2c00cd0a0 msgr2=0x7fb2c00cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.607+0000 7fb2bffff700 1 -- 172.21.15.50:0/1924432227 shutdown_connections 2023-11-28T11:54:48.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.607+0000 7fb2bffff700 1 -- 172.21.15.50:0/1924432227 wait complete. 2023-11-28T11:54:48.629 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:54:48.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.739+0000 7fa932a95700 1 Processor -- start 2023-11-28T11:54:48.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.739+0000 7fa932a95700 1 -- start start 2023-11-28T11:54:48.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.739+0000 7fa932a95700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa92c0cf050 0x7fa92c06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:48.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.739+0000 7fa932a95700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa92c0b4c10 0x7fa92c0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:48.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.739+0000 7fa932a95700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92c15c6d0 con 0x7fa92c06a530 2023-11-28T11:54:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.739+0000 7fa932a95700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92c06a9d0 con 0x7fa92c0cf050 2023-11-28T11:54:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.739+0000 7fa932a95700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92c06ac60 con 0x7fa92c0b4c10 2023-11-28T11:54:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa931a93700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa92c0cf050 0x7fa92c06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa931a93700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa92c0cf050 0x7fa92c06d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52114/0 (socket says 172.21.15.50:52114) 2023-11-28T11:54:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa931a93700 1 -- 172.21.15.50:0/1459341900 learned_addr learned my addr 172.21.15.50:0/1459341900 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:48.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa932294700 1 --2- 172.21.15.50:0/1459341900 >> v2:172.21.15.192:3300/0 conn(0x7fa92c0b4c10 0x7fa92c0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa931a93700 1 -- 172.21.15.50:0/1459341900 >> v2:172.21.15.192:3300/0 conn(0x7fa92c0b4c10 msgr2=0x7fa92c0cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa931a93700 1 --2- 172.21.15.50:0/1459341900 >> v2:172.21.15.192:3300/0 conn(0x7fa92c0b4c10 0x7fa92c0cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa931a93700 1 -- 172.21.15.50:0/1459341900 >> v1:172.21.15.192:6789/0 conn(0x7fa92c06a530 legacy=0x7fa92c0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa931a93700 1 -- 172.21.15.50:0/1459341900 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c06af40 con 0x7fa92c0cf050 2023-11-28T11:54:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa931a93700 1 --2- 172.21.15.50:0/1459341900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92c0cf050 0x7fa92c06d7d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa92c08c660 tx=0x7fa91c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e6850c78b83e83 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa930a91700 1 -- 172.21.15.50:0/1459341900 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c011830 con 0x7fa92c0cf050 2023-11-28T11:54:48.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa930a91700 1 -- 172.21.15.50:0/1459341900 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c011990 con 0x7fa92c0cf050 2023-11-28T11:54:48.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa930a91700 1 -- 172.21.15.50:0/1459341900 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c011d20 con 0x7fa92c0cf050 2023-11-28T11:54:48.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa932a95700 1 -- 172.21.15.50:0/1459341900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92c0cf050 msgr2=0x7fa92c06d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa932a95700 1 --2- 172.21.15.50:0/1459341900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92c0cf050 0x7fa92c06d7d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa92c08c660 tx=0x7fa91c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa932a95700 1 -- 172.21.15.50:0/1459341900 shutdown_connections 2023-11-28T11:54:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa932a95700 1 --2- 172.21.15.50:0/1459341900 >> v2:172.21.15.192:3300/0 conn(0x7fa92c0b4c10 0x7fa92c0cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa932a95700 1 --2- 172.21.15.50:0/1459341900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92c0cf050 0x7fa92c06d7d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa932a95700 1 -- 172.21.15.50:0/1459341900 >> 172.21.15.50:0/1459341900 conn(0x7fa92c09bb30 msgr2=0x7fa92c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa932a95700 1 -- 172.21.15.50:0/1459341900 shutdown_connections 2023-11-28T11:54:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.743+0000 7fa932a95700 1 -- 172.21.15.50:0/1459341900 wait complete. 2023-11-28T11:54:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa932a95700 1 Processor -- start 2023-11-28T11:54:48.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa932a95700 1 -- start start 2023-11-28T11:54:48.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa932a95700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa92c06a530 0x7fa92c0d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:48.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa932a95700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92c0b4c10 0x7fa92c0d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:48.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa932a95700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa92c0cf050 0x7fa92c1f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:48.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa932a95700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c0d1ef0 con 0x7fa92c0b4c10 2023-11-28T11:54:48.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa932a95700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c0d1370 con 0x7fa92c06a530 2023-11-28T11:54:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa932a95700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c0d1650 con 0x7fa92c0cf050 2023-11-28T11:54:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa931292700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92c0b4c10 0x7fa92c0d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa932294700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa92c0cf050 0x7fa92c1f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa931292700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92c0b4c10 0x7fa92c0d0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52120/0 (socket says 172.21.15.50:52120) 2023-11-28T11:54:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa931a93700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa92c06a530 0x7fa92c0d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa931292700 1 -- 172.21.15.50:0/2642593348 learned_addr learned my addr 172.21.15.50:0/2642593348 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa931292700 1 -- 172.21.15.50:0/2642593348 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa92c0cf050 msgr2=0x7fa92c1f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa931292700 1 --2- 172.21.15.50:0/2642593348 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa92c0cf050 0x7fa92c1f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa931292700 1 -- 172.21.15.50:0/2642593348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa92c06a530 msgr2=0x7fa92c0d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa931292700 1 --2- 172.21.15.50:0/2642593348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa92c06a530 0x7fa92c0d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa931292700 1 -- 172.21.15.50:0/2642593348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c009570 con 0x7fa92c0b4c10 2023-11-28T11:54:48.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa931292700 1 --2- 172.21.15.50:0/2642593348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92c0b4c10 0x7fa92c0d0b30 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa92800c410 tx=0x7fa92800c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:48.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa9227fc700 1 -- 172.21.15.50:0/2642593348 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9280052d0 con 0x7fa92c0b4c10 2023-11-28T11:54:48.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa9227fc700 1 -- 172.21.15.50:0/2642593348 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa928005430 con 0x7fa92c0b4c10 2023-11-28T11:54:48.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa932a95700 1 -- 172.21.15.50:0/2642593348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92c0b46f0 con 0x7fa92c0b4c10 2023-11-28T11:54:48.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa9227fc700 1 -- 172.21.15.50:0/2642593348 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9280055a0 con 0x7fa92c0b4c10 2023-11-28T11:54:48.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa932a95700 1 -- 172.21.15.50:0/2642593348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92c0b4410 con 0x7fa92c0b4c10 2023-11-28T11:54:48.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.747+0000 7fa932a95700 1 -- 172.21.15.50:0/2642593348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92c06b220 con 0x7fa92c0b4c10 2023-11-28T11:54:48.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.751+0000 7fa9227fc700 1 -- 172.21.15.50:0/2642593348 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa928010050 con 0x7fa92c0b4c10 2023-11-28T11:54:48.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.751+0000 7fa9227fc700 1 --2- 172.21.15.50:0/2642593348 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa910064ee0 0x7fa910067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:48.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.751+0000 7fa9227fc700 1 -- 172.21.15.50:0/2642593348 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa928081740 con 0x7fa92c0b4c10 2023-11-28T11:54:48.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.751+0000 7fa931a93700 1 --2- 172.21.15.50:0/2642593348 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa910064ee0 0x7fa910067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:48.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.755+0000 7fa931a93700 1 --2- 172.21.15.50:0/2642593348 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa910064ee0 0x7fa910067390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa91c000c00 tx=0x7fa91c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:48.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.755+0000 7fa9227fc700 1 -- 172.21.15.50:0/2642593348 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa92804f4e0 con 0x7fa92c0b4c10 2023-11-28T11:54:48.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.931+0000 7fa932a95700 1 -- 172.21.15.50:0/2642593348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa92c072500 con 0x7fa92c0b4c10 2023-11-28T11:54:48.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.931+0000 7fa9227fc700 1 -- 172.21.15.50:0/2642593348 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa928052b00 con 0x7fa92c0b4c10 2023-11-28T11:54:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.935+0000 7fa932a95700 1 -- 172.21.15.50:0/2642593348 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa910064ee0 msgr2=0x7fa910067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.935+0000 7fa932a95700 1 --2- 172.21.15.50:0/2642593348 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa910064ee0 0x7fa910067390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa91c000c00 tx=0x7fa91c008030 comp rx=0 tx=0).stop 2023-11-28T11:54:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.935+0000 7fa932a95700 1 -- 172.21.15.50:0/2642593348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92c0b4c10 msgr2=0x7fa92c0d0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.935+0000 7fa932a95700 1 --2- 172.21.15.50:0/2642593348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92c0b4c10 0x7fa92c0d0b30 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa92800c410 tx=0x7fa92800c720 comp rx=0 tx=0).stop 2023-11-28T11:54:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.935+0000 7fa932a95700 1 -- 172.21.15.50:0/2642593348 shutdown_connections 2023-11-28T11:54:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.935+0000 7fa932a95700 1 --2- 172.21.15.50:0/2642593348 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa92c0cf050 0x7fa92c1f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.935+0000 7fa932a95700 1 --2- 172.21.15.50:0/2642593348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa92c0b4c10 0x7fa92c0d0b30 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.935+0000 7fa932a95700 1 --2- 172.21.15.50:0/2642593348 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa910064ee0 0x7fa910067390 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.935+0000 7fa932a95700 1 --2- 172.21.15.50:0/2642593348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa92c06a530 0x7fa92c0d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.935+0000 7fa932a95700 1 -- 172.21.15.50:0/2642593348 >> 172.21.15.50:0/2642593348 conn(0x7fa92c09bb30 msgr2=0x7fa92c0b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.935+0000 7fa932a95700 1 -- 172.21.15.50:0/2642593348 shutdown_connections 2023-11-28T11:54:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:48.935+0000 7fa932a95700 1 -- 172.21.15.50:0/2642593348 wait complete. 2023-11-28T11:54:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-11-28T11:54:48.950 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi192.front.sepia.ceph.com... 2023-11-28T11:54:48.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:48.950 DEBUG:teuthology.orchestra.run.smithi192:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-28T11:54:48.968 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:54:48.968 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T11:54:48.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:54:48.969 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T11:54:48.975 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T11:54:48.975 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:54:49.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.091+0000 7fd713fff700 1 Processor -- start 2023-11-28T11:54:49.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.091+0000 7fd713fff700 1 -- start start 2023-11-28T11:54:49.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.091+0000 7fd713fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd71406b540 0x7fd7140cb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:49.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.091+0000 7fd713fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7140c1330 0x7fd7140c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:49.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.091+0000 7fd713fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7140b38c0 con 0x7fd71406d420 2023-11-28T11:54:49.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.091+0000 7fd713fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7140cbca0 con 0x7fd71406b540 2023-11-28T11:54:49.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.091+0000 7fd713fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140c1cf0 con 0x7fd7140c1330 2023-11-28T11:54:49.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.091+0000 7fd7137fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7140c1330 0x7fd7140c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:49.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.091+0000 7fd712ffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd71406b540 0x7fd7140cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:49.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.091+0000 7fd7127fc700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd71406d420 0x7fd7140ad660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:46302/0 (socket says 172.21.15.50:46302) 2023-11-28T11:54:49.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.091+0000 7fd7127fc700 1 -- 172.21.15.50:0/3337988384 learned_addr learned my addr 172.21.15.50:0/3337988384 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:49.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd711ffb700 1 -- 172.21.15.50:0/3337988384 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275530363 0 0) 0x7fd7140b38c0 con 0x7fd71406d420 2023-11-28T11:54:49.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd711ffb700 1 -- 172.21.15.50:0/3337988384 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7000035d0 con 0x7fd71406d420 2023-11-28T11:54:49.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd712ffd700 1 -- 172.21.15.50:0/3337988384 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7140c1330 msgr2=0x7fd7140c17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:49.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd712ffd700 1 --2- 172.21.15.50:0/3337988384 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7140c1330 0x7fd7140c17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd712ffd700 1 -- 172.21.15.50:0/3337988384 >> v1:172.21.15.192:6789/0 conn(0x7fd71406d420 legacy=0x7fd7140ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd712ffd700 1 -- 172.21.15.50:0/3337988384 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7140cb2d0 con 0x7fd71406b540 2023-11-28T11:54:49.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd7137fe700 1 --2- 172.21.15.50:0/3337988384 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7140c1330 0x7fd7140c17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:49.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd712ffd700 1 --2- 172.21.15.50:0/3337988384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd71406b540 0x7fd7140cb760 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd704009840 tx=0x7fd704009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79e488572dd5f512 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:49.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd711ffb700 1 -- 172.21.15.50:0/3337988384 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704005e50 con 0x7fd71406b540 2023-11-28T11:54:49.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd711ffb700 1 -- 172.21.15.50:0/3337988384 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd704006030 con 0x7fd71406b540 2023-11-28T11:54:49.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd711ffb700 1 -- 172.21.15.50:0/3337988384 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7040063c0 con 0x7fd71406b540 2023-11-28T11:54:49.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd713fff700 1 -- 172.21.15.50:0/3337988384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd71406b540 msgr2=0x7fd7140cb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd713fff700 1 --2- 172.21.15.50:0/3337988384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd71406b540 0x7fd7140cb760 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd704009840 tx=0x7fd704009b50 comp rx=0 tx=0).stop 2023-11-28T11:54:49.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd713fff700 1 -- 172.21.15.50:0/3337988384 shutdown_connections 2023-11-28T11:54:49.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd713fff700 1 --2- 172.21.15.50:0/3337988384 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7140c1330 0x7fd7140c17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd713fff700 1 --2- 172.21.15.50:0/3337988384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd71406b540 0x7fd7140cb760 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd713fff700 1 -- 172.21.15.50:0/3337988384 >> 172.21.15.50:0/3337988384 conn(0x7fd7140ce360 msgr2=0x7fd7140ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:49.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd713fff700 1 -- 172.21.15.50:0/3337988384 shutdown_connections 2023-11-28T11:54:49.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd713fff700 1 -- 172.21.15.50:0/3337988384 wait complete. 2023-11-28T11:54:49.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd713fff700 1 Processor -- start 2023-11-28T11:54:49.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.095+0000 7fd713fff700 1 -- start start 2023-11-28T11:54:49.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd713fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd71406b540 0x7fd7141f8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:49.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd713fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd71406d420 0x7fd714160d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:49.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd713fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7140c1330 0x7fd714163240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:49.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd713fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140c3d00 con 0x7fd71406b540 2023-11-28T11:54:49.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd713fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140c3fe0 con 0x7fd7140c1330 2023-11-28T11:54:49.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd713fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140c42c0 con 0x7fd71406d420 2023-11-28T11:54:49.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd712ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd71406b540 0x7fd7141f8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:49.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd7127fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd71406d420 0x7fd714160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:49.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd712ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd71406b540 0x7fd7141f8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52126/0 (socket says 172.21.15.50:52126) 2023-11-28T11:54:49.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd712ffd700 1 -- 172.21.15.50:0/2236643871 learned_addr learned my addr 172.21.15.50:0/2236643871 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:49.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd7137fe700 1 --2- 172.21.15.50:0/2236643871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7140c1330 0x7fd714163240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:49.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd712ffd700 1 -- 172.21.15.50:0/2236643871 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd71406d420 msgr2=0x7fd714160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd712ffd700 1 --2- 172.21.15.50:0/2236643871 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd71406d420 0x7fd714160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd712ffd700 1 -- 172.21.15.50:0/2236643871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7140c1330 msgr2=0x7fd714163240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd712ffd700 1 --2- 172.21.15.50:0/2236643871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7140c1330 0x7fd714163240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd712ffd700 1 -- 172.21.15.50:0/2236643871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c009a70 con 0x7fd71406b540 2023-11-28T11:54:49.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd7137fe700 1 --2- 172.21.15.50:0/2236643871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7140c1330 0x7fd714163240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:49.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd712ffd700 1 --2- 172.21.15.50:0/2236643871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd71406b540 0x7fd7141f8ba0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd704000c00 tx=0x7fd704004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:49.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd70b7fe700 1 -- 172.21.15.50:0/2236643871 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7040038c0 con 0x7fd71406b540 2023-11-28T11:54:49.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd70b7fe700 1 -- 172.21.15.50:0/2236643871 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd704003a20 con 0x7fd71406b540 2023-11-28T11:54:49.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd713fff700 1 -- 172.21.15.50:0/2236643871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd704009450 con 0x7fd71406b540 2023-11-28T11:54:49.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd70b7fe700 1 -- 172.21.15.50:0/2236643871 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704003dd0 con 0x7fd71406b540 2023-11-28T11:54:49.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.099+0000 7fd713fff700 1 -- 172.21.15.50:0/2236643871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7140b3b10 con 0x7fd71406b540 2023-11-28T11:54:49.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.103+0000 7fd713fff700 1 -- 172.21.15.50:0/2236643871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7140b3df0 con 0x7fd71406b540 2023-11-28T11:54:49.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.103+0000 7fd70b7fe700 1 -- 172.21.15.50:0/2236643871 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd70400f050 con 0x7fd71406b540 2023-11-28T11:54:49.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.103+0000 7fd70b7fe700 1 --2- 172.21.15.50:0/2236643871 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd6f4064ee0 0x7fd6f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:49.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.103+0000 7fd70b7fe700 1 -- 172.21.15.50:0/2236643871 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd704083b40 con 0x7fd71406b540 2023-11-28T11:54:49.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.103+0000 7fd7127fc700 1 --2- 172.21.15.50:0/2236643871 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd6f4064ee0 0x7fd6f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:49.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.103+0000 7fd7127fc700 1 --2- 172.21.15.50:0/2236643871 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd6f4064ee0 0x7fd6f4067390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd71406aeb0 tx=0x7fd6fc007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.111+0000 7fd70b7fe700 1 -- 172.21.15.50:0/2236643871 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd7040519b0 con 0x7fd71406b540 2023-11-28T11:54:49.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.307+0000 7fd713fff700 1 -- 172.21.15.50:0/2236643871 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd714160b30 con 0x7fd71406b540 2023-11-28T11:54:49.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.307+0000 7fd70b7fe700 1 -- 172.21.15.50:0/2236643871 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7fd704054fd0 con 0x7fd71406b540 2023-11-28T11:54:49.309 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:49.309 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2457318670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2457318670},{"type":"v1","addr":"172.21.15.192:6836","nonce":2457318670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3448258722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3448258722},{"type":"v1","addr":"172.21.15.192:6837","nonce":3448258722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/490368853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":490368853},{"type":"v1","addr":"172.21.15.50:6833","nonce":490368853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:53:40.797417+0000","modified":"2023-11-28T11:54:02.939902+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3764199418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3764199418},{"type":"v1","addr":"172.21.15.50:6835","nonce":3764199418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:54:49.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.307+0000 7fd713fff700 1 -- 172.21.15.50:0/2236643871 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd6f4064ee0 msgr2=0x7fd6f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.307+0000 7fd713fff700 1 --2- 172.21.15.50:0/2236643871 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd6f4064ee0 0x7fd6f4067390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd71406aeb0 tx=0x7fd6fc007de0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.307+0000 7fd713fff700 1 -- 172.21.15.50:0/2236643871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd71406b540 msgr2=0x7fd7141f8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.307+0000 7fd713fff700 1 --2- 172.21.15.50:0/2236643871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd71406b540 0x7fd7141f8ba0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd704000c00 tx=0x7fd704004770 comp rx=0 tx=0).stop 2023-11-28T11:54:49.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.307+0000 7fd713fff700 1 -- 172.21.15.50:0/2236643871 shutdown_connections 2023-11-28T11:54:49.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.307+0000 7fd713fff700 1 --2- 172.21.15.50:0/2236643871 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd6f4064ee0 0x7fd6f4067390 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.307+0000 7fd713fff700 1 --2- 172.21.15.50:0/2236643871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7140c1330 0x7fd714163240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.307+0000 7fd713fff700 1 --2- 172.21.15.50:0/2236643871 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd71406d420 0x7fd714160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.307+0000 7fd713fff700 1 --2- 172.21.15.50:0/2236643871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd71406b540 0x7fd7141f8ba0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.307+0000 7fd713fff700 1 -- 172.21.15.50:0/2236643871 >> 172.21.15.50:0/2236643871 conn(0x7fd7140ce360 msgr2=0x7fd714071930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:49.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.307+0000 7fd713fff700 1 -- 172.21.15.50:0/2236643871 shutdown_connections 2023-11-28T11:54:49.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.307+0000 7fd713fff700 1 -- 172.21.15.50:0/2236643871 wait complete. 2023-11-28T11:54:49.312 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-11-28T11:54:49.324 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:49.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.435+0000 7fd85cb3a700 1 Processor -- start 2023-11-28T11:54:49.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.435+0000 7fd85cb3a700 1 -- start start 2023-11-28T11:54:49.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85cb3a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd858153420 0x7fd8580c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:49.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85cb3a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd85815cb50 0x7fd85815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:49.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85cb3a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8580cad30 con 0x7fd8581537f0 2023-11-28T11:54:49.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85cb3a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8580cdda0 con 0x7fd85815cb50 2023-11-28T11:54:49.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85cb3a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85815d4b0 con 0x7fd858153420 2023-11-28T11:54:49.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd856d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd85815cb50 0x7fd85815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:49.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd856d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd85815cb50 0x7fd85815cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52142/0 (socket says 172.21.15.50:52142) 2023-11-28T11:54:49.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd856d9d700 1 -- 172.21.15.50:0/2418321237 learned_addr learned my addr 172.21.15.50:0/2418321237 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:49.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd856d9d700 1 -- 172.21.15.50:0/2418321237 >> v2:172.21.15.192:3300/0 conn(0x7fd858153420 msgr2=0x7fd8580c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:49.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85659c700 1 --2- 172.21.15.50:0/2418321237 >> v2:172.21.15.192:3300/0 conn(0x7fd858153420 0x7fd8580c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:49.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd856d9d700 1 --2- 172.21.15.50:0/2418321237 >> v2:172.21.15.192:3300/0 conn(0x7fd858153420 0x7fd8580c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd856d9d700 1 -- 172.21.15.50:0/2418321237 >> v1:172.21.15.192:6789/0 conn(0x7fd8581537f0 legacy=0x7fd8580ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd856d9d700 1 -- 172.21.15.50:0/2418321237 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8580b0cd0 con 0x7fd85815cb50 2023-11-28T11:54:49.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85659c700 1 --2- 172.21.15.50:0/2418321237 >> v2:172.21.15.192:3300/0 conn(0x7fd858153420 0x7fd8580c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:54:49.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd856d9d700 1 --2- 172.21.15.50:0/2418321237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815cb50 0x7fd85815cf70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd85806f8e0 tx=0x7fd85000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e0d8bb23e6fe21 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:49.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85559a700 1 -- 172.21.15.50:0/2418321237 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850010070 con 0x7fd85815cb50 2023-11-28T11:54:49.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85559a700 1 -- 172.21.15.50:0/2418321237 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85000dd90 con 0x7fd85815cb50 2023-11-28T11:54:49.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85559a700 1 -- 172.21.15.50:0/2418321237 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85000b310 con 0x7fd85815cb50 2023-11-28T11:54:49.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85cb3a700 1 -- 172.21.15.50:0/2418321237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815cb50 msgr2=0x7fd85815cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85cb3a700 1 --2- 172.21.15.50:0/2418321237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815cb50 0x7fd85815cf70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd85806f8e0 tx=0x7fd85000d430 comp rx=0 tx=0).stop 2023-11-28T11:54:49.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85cb3a700 1 -- 172.21.15.50:0/2418321237 shutdown_connections 2023-11-28T11:54:49.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85cb3a700 1 --2- 172.21.15.50:0/2418321237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815cb50 0x7fd85815cf70 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85cb3a700 1 --2- 172.21.15.50:0/2418321237 >> v2:172.21.15.192:3300/0 conn(0x7fd858153420 0x7fd8580c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85cb3a700 1 -- 172.21.15.50:0/2418321237 >> 172.21.15.50:0/2418321237 conn(0x7fd85806caf0 msgr2=0x7fd8580ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:49.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85cb3a700 1 -- 172.21.15.50:0/2418321237 shutdown_connections 2023-11-28T11:54:49.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.439+0000 7fd85cb3a700 1 -- 172.21.15.50:0/2418321237 wait complete. 2023-11-28T11:54:49.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd85cb3a700 1 Processor -- start 2023-11-28T11:54:49.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd85cb3a700 1 -- start start 2023-11-28T11:54:49.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd85cb3a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd858153420 0x7fd85813bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:49.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd85cb3a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8581537f0 0x7fd8580c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:49.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd85cb3a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815cb50 0x7fd85813c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:49.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd85cb3a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85813c070 con 0x7fd85815cb50 2023-11-28T11:54:49.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd85cb3a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85814fef0 con 0x7fd8581537f0 2023-11-28T11:54:49.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd85cb3a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd858150190 con 0x7fd858153420 2023-11-28T11:54:49.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd856d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815cb50 0x7fd85813c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:49.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd856d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815cb50 0x7fd85813c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52154/0 (socket says 172.21.15.50:52154) 2023-11-28T11:54:49.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd856d9d700 1 -- 172.21.15.50:0/2502331819 learned_addr learned my addr 172.21.15.50:0/2502331819 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:49.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd85659c700 1 --2- 172.21.15.50:0/2502331819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd858153420 0x7fd85813bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:49.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd855d9b700 1 --2- 172.21.15.50:0/2502331819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8581537f0 0x7fd8580c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:49.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd856d9d700 1 -- 172.21.15.50:0/2502331819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd858153420 msgr2=0x7fd85813bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd856d9d700 1 --2- 172.21.15.50:0/2502331819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd858153420 0x7fd85813bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd856d9d700 1 -- 172.21.15.50:0/2502331819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8581537f0 msgr2=0x7fd8580c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd856d9d700 1 --2- 172.21.15.50:0/2502331819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8581537f0 0x7fd8580c5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.443+0000 7fd856d9d700 1 -- 172.21.15.50:0/2502331819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85000bd40 con 0x7fd85815cb50 2023-11-28T11:54:49.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.447+0000 7fd856d9d700 1 --2- 172.21.15.50:0/2502331819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815cb50 0x7fd85813c2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd85806fa00 tx=0x7fd850004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:49.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.447+0000 7fd84effd700 1 -- 172.21.15.50:0/2502331819 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850009a10 con 0x7fd85815cb50 2023-11-28T11:54:49.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.447+0000 7fd84effd700 1 -- 172.21.15.50:0/2502331819 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd850009b90 con 0x7fd85815cb50 2023-11-28T11:54:49.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.447+0000 7fd84effd700 1 -- 172.21.15.50:0/2502331819 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85000b4c0 con 0x7fd85815cb50 2023-11-28T11:54:49.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.447+0000 7fd85cb3a700 1 -- 172.21.15.50:0/2502331819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8580b0f70 con 0x7fd85815cb50 2023-11-28T11:54:49.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.447+0000 7fd85cb3a700 1 -- 172.21.15.50:0/2502331819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8580caa00 con 0x7fd85815cb50 2023-11-28T11:54:49.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.447+0000 7fd85cb3a700 1 -- 172.21.15.50:0/2502331819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8580b1250 con 0x7fd85815cb50 2023-11-28T11:54:49.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.447+0000 7fd84effd700 1 -- 172.21.15.50:0/2502331819 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd85002d070 con 0x7fd85815cb50 2023-11-28T11:54:49.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.447+0000 7fd84effd700 1 --2- 172.21.15.50:0/2502331819 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd838064ee0 0x7fd838067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:49.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.447+0000 7fd84effd700 1 -- 172.21.15.50:0/2502331819 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd850083f00 con 0x7fd85815cb50 2023-11-28T11:54:49.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.447+0000 7fd85659c700 1 --2- 172.21.15.50:0/2502331819 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd838064ee0 0x7fd838067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:49.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.451+0000 7fd85659c700 1 --2- 172.21.15.50:0/2502331819 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd838064ee0 0x7fd838067390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd84800ab60 tx=0x7fd848008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:49.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.455+0000 7fd84effd700 1 -- 172.21.15.50:0/2502331819 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd850051cf0 con 0x7fd85815cb50 2023-11-28T11:54:49.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.619+0000 7fd85cb3a700 1 -- 172.21.15.50:0/2502331819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8580cf630 con 0x7fd85815cb50 2023-11-28T11:54:49.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.623+0000 7fd84effd700 1 -- 172.21.15.50:0/2502331819 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19689 (secure 0 0 0) 0x7fd850055310 con 0x7fd85815cb50 2023-11-28T11:54:49.625 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:49.625 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:54:30.086945+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.623+0000 7fd85cb3a700 1 -- 172.21.15.50:0/2502331819 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd838064ee0 msgr2=0x7fd838067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.623+0000 7fd85cb3a700 1 --2- 172.21.15.50:0/2502331819 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd838064ee0 0x7fd838067390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd84800ab60 tx=0x7fd848008040 comp rx=0 tx=0).stop 2023-11-28T11:54:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.623+0000 7fd85cb3a700 1 -- 172.21.15.50:0/2502331819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815cb50 msgr2=0x7fd85813c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.623+0000 7fd85cb3a700 1 --2- 172.21.15.50:0/2502331819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815cb50 0x7fd85813c2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd85806fa00 tx=0x7fd850004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.623+0000 7fd85cb3a700 1 -- 172.21.15.50:0/2502331819 shutdown_connections 2023-11-28T11:54:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.623+0000 7fd85cb3a700 1 --2- 172.21.15.50:0/2502331819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd85815cb50 0x7fd85813c2f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.623+0000 7fd85cb3a700 1 --2- 172.21.15.50:0/2502331819 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd838064ee0 0x7fd838067390 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.623+0000 7fd85cb3a700 1 --2- 172.21.15.50:0/2502331819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8581537f0 0x7fd8580c5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.623+0000 7fd85cb3a700 1 --2- 172.21.15.50:0/2502331819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd858153420 0x7fd85813bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.623+0000 7fd85cb3a700 1 -- 172.21.15.50:0/2502331819 >> 172.21.15.50:0/2502331819 conn(0x7fd85806caf0 msgr2=0x7fd8580c4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:49.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.623+0000 7fd85cb3a700 1 -- 172.21.15.50:0/2502331819 shutdown_connections 2023-11-28T11:54:49.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.623+0000 7fd85cb3a700 1 -- 172.21.15.50:0/2502331819 wait complete. 2023-11-28T11:54:49.641 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:53:38.462826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:53:39.778621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T11:53:42.870360+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T11:54:49.642 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:54:49.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.767+0000 7f87f9459700 1 Processor -- start 2023-11-28T11:54:49.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.767+0000 7f87f9459700 1 -- start start 2023-11-28T11:54:49.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.767+0000 7f87f9459700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f87f415c1d0 0x7f87f40cc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:49.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.767+0000 7f87f9459700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f40ce6a0 con 0x7f87f40cd370 2023-11-28T11:54:49.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.767+0000 7f87f9459700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f40cb750 con 0x7f87f40ce220 2023-11-28T11:54:49.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.767+0000 7f87f9459700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f40cba30 con 0x7f87f415c1d0 2023-11-28T11:54:49.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.767+0000 7f87f3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f87f415c1d0 0x7f87f40cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:49.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.767+0000 7f87f8c58700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f87f40cd370 0x7f87f406b5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59932/0 (socket says 172.21.15.50:59932) 2023-11-28T11:54:49.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.767+0000 7f87f8c58700 1 -- 172.21.15.50:0/2080207286 learned_addr learned my addr 172.21.15.50:0/2080207286 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:49.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.767+0000 7f87f2ffd700 1 -- 172.21.15.50:0/2080207286 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 533343484 0 0) 0x7f87f40ce6a0 con 0x7f87f40cd370 2023-11-28T11:54:49.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.767+0000 7f87f2ffd700 1 -- 172.21.15.50:0/2080207286 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87dc0035d0 con 0x7f87f40cd370 2023-11-28T11:54:49.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.767+0000 7f87f3fff700 1 -- 172.21.15.50:0/2080207286 >> v1:172.21.15.192:6789/0 conn(0x7f87f40ce220 legacy=0x7f87f40ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.767+0000 7f87f2ffd700 1 -- 172.21.15.50:0/2080207286 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876311585 0 0) 0x7f87f40cb750 con 0x7f87f40ce220 2023-11-28T11:54:49.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.767+0000 7f87f3fff700 1 -- 172.21.15.50:0/2080207286 >> v1:172.21.15.50:6789/0 conn(0x7f87f40cd370 legacy=0x7f87f406b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.767+0000 7f87f3fff700 1 -- 172.21.15.50:0/2080207286 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f40cbd10 con 0x7f87f415c1d0 2023-11-28T11:54:49.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.771+0000 7f87f3fff700 1 --2- 172.21.15.50:0/2080207286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f415c1d0 0x7f87f40cc510 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009850 tx=0x7f87e8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4089e513384e20b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:49.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.771+0000 7f87f2ffd700 1 -- 172.21.15.50:0/2080207286 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8011830 con 0x7f87f415c1d0 2023-11-28T11:54:49.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.771+0000 7f87f2ffd700 1 -- 172.21.15.50:0/2080207286 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e8011990 con 0x7f87f415c1d0 2023-11-28T11:54:49.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.771+0000 7f87f2ffd700 1 -- 172.21.15.50:0/2080207286 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8011d40 con 0x7f87f415c1d0 2023-11-28T11:54:49.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.771+0000 7f87f9459700 1 -- 172.21.15.50:0/2080207286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f415c1d0 msgr2=0x7f87f40cc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.771+0000 7f87f9459700 1 --2- 172.21.15.50:0/2080207286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f415c1d0 0x7f87f40cc510 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009850 tx=0x7f87e8009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:49.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.771+0000 7f87f9459700 1 -- 172.21.15.50:0/2080207286 shutdown_connections 2023-11-28T11:54:49.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.771+0000 7f87f9459700 1 --2- 172.21.15.50:0/2080207286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f415c1d0 0x7f87f40cc510 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.771+0000 7f87f9459700 1 -- 172.21.15.50:0/2080207286 >> 172.21.15.50:0/2080207286 conn(0x7f87f40b2180 msgr2=0x7f87f40b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:49.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.771+0000 7f87f9459700 1 -- 172.21.15.50:0/2080207286 shutdown_connections 2023-11-28T11:54:49.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.771+0000 7f87f9459700 1 -- 172.21.15.50:0/2080207286 wait complete. 2023-11-28T11:54:49.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.771+0000 7f87f9459700 1 Processor -- start 2023-11-28T11:54:49.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.771+0000 7f87f9459700 1 -- start start 2023-11-28T11:54:49.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f9459700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87f40cd370 0x7f87f4157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:49.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f9459700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f40ce220 0x7f87f415cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:49.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f9459700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f415c5a0 0x7f87f40c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:49.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f9459700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f41f2550 con 0x7f87f415c5a0 2023-11-28T11:54:49.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f9459700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f41577b0 con 0x7f87f40ce220 2023-11-28T11:54:49.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f9459700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f41f1bb0 con 0x7f87f40cd370 2023-11-28T11:54:49.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f8c58700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f415c5a0 0x7f87f40c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:49.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f8c58700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f415c5a0 0x7f87f40c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52170/0 (socket says 172.21.15.50:52170) 2023-11-28T11:54:49.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f8c58700 1 -- 172.21.15.50:0/2839743354 learned_addr learned my addr 172.21.15.50:0/2839743354 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:49.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f37fe700 1 --2- 172.21.15.50:0/2839743354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f40ce220 0x7f87f415cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:49.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f3fff700 1 --2- 172.21.15.50:0/2839743354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87f40cd370 0x7f87f4157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:49.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f8c58700 1 -- 172.21.15.50:0/2839743354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87f40cd370 msgr2=0x7f87f4157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f8c58700 1 --2- 172.21.15.50:0/2839743354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87f40cd370 0x7f87f4157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f8c58700 1 -- 172.21.15.50:0/2839743354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f40ce220 msgr2=0x7f87f415cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f8c58700 1 --2- 172.21.15.50:0/2839743354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f40ce220 0x7f87f415cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f8c58700 1 -- 172.21.15.50:0/2839743354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e80094b0 con 0x7f87f415c5a0 2023-11-28T11:54:49.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f3fff700 1 --2- 172.21.15.50:0/2839743354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87f40cd370 0x7f87f4157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:49.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f8c58700 1 --2- 172.21.15.50:0/2839743354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f415c5a0 0x7f87f40c8d10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00cb10 tx=0x7f87ec00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:49.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f0ff9700 1 -- 172.21.15.50:0/2839743354 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec00a770 con 0x7f87f415c5a0 2023-11-28T11:54:49.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f0ff9700 1 -- 172.21.15.50:0/2839743354 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec00a8d0 con 0x7f87f415c5a0 2023-11-28T11:54:49.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f9459700 1 -- 172.21.15.50:0/2839743354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f40d0360 con 0x7f87f415c5a0 2023-11-28T11:54:49.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f0ff9700 1 -- 172.21.15.50:0/2839743354 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec00ac60 con 0x7f87f415c5a0 2023-11-28T11:54:49.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f9459700 1 -- 172.21.15.50:0/2839743354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f40cbff0 con 0x7f87f415c5a0 2023-11-28T11:54:49.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f9459700 1 -- 172.21.15.50:0/2839743354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f40cfbf0 con 0x7f87f415c5a0 2023-11-28T11:54:49.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.775+0000 7f87f0ff9700 1 -- 172.21.15.50:0/2839743354 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f87ec019030 con 0x7f87f415c5a0 2023-11-28T11:54:49.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.779+0000 7f87f0ff9700 1 --2- 172.21.15.50:0/2839743354 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f87e0064ee0 0x7f87e0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:49.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.779+0000 7f87f0ff9700 1 -- 172.21.15.50:0/2839743354 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f87ec081a90 con 0x7f87f415c5a0 2023-11-28T11:54:49.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.779+0000 7f87f3fff700 1 --2- 172.21.15.50:0/2839743354 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f87e0064ee0 0x7f87e0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:49.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.779+0000 7f87f3fff700 1 --2- 172.21.15.50:0/2839743354 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f87e0064ee0 0x7f87e0067390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f87f4071b60 tx=0x7f87e8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:49.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.787+0000 7f87f0ff9700 1 -- 172.21.15.50:0/2839743354 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f87ec04f900 con 0x7f87f415c5a0 2023-11-28T11:54:49.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.943+0000 7f87f9459700 1 -- 172.21.15.50:0/2839743354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f87f41f2690 con 0x7f87f415c5a0 2023-11-28T11:54:49.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.943+0000 7f87f0ff9700 1 -- 172.21.15.50:0/2839743354 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f87ec017020 con 0x7f87f415c5a0 2023-11-28T11:54:49.947 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:54:49.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.947+0000 7f87f9459700 1 -- 172.21.15.50:0/2839743354 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f87e0064ee0 msgr2=0x7f87e0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.947+0000 7f87f9459700 1 --2- 172.21.15.50:0/2839743354 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f87e0064ee0 0x7f87e0067390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f87f4071b60 tx=0x7f87e8008030 comp rx=0 tx=0).stop 2023-11-28T11:54:49.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.947+0000 7f87f9459700 1 -- 172.21.15.50:0/2839743354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f415c5a0 msgr2=0x7f87f40c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:49.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.947+0000 7f87f9459700 1 --2- 172.21.15.50:0/2839743354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f415c5a0 0x7f87f40c8d10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00cb10 tx=0x7f87ec00cb40 comp rx=0 tx=0).stop 2023-11-28T11:54:49.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.947+0000 7f87f9459700 1 -- 172.21.15.50:0/2839743354 shutdown_connections 2023-11-28T11:54:49.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.947+0000 7f87f9459700 1 --2- 172.21.15.50:0/2839743354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87f415c5a0 0x7f87f40c8d10 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.947+0000 7f87f9459700 1 --2- 172.21.15.50:0/2839743354 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f87e0064ee0 0x7f87e0067390 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.947+0000 7f87f9459700 1 --2- 172.21.15.50:0/2839743354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f40ce220 0x7f87f415cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.947+0000 7f87f9459700 1 --2- 172.21.15.50:0/2839743354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87f40cd370 0x7f87f4157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:49.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.947+0000 7f87f9459700 1 -- 172.21.15.50:0/2839743354 >> 172.21.15.50:0/2839743354 conn(0x7f87f40b2180 msgr2=0x7f87f406ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:49.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.947+0000 7f87f9459700 1 -- 172.21.15.50:0/2839743354 shutdown_connections 2023-11-28T11:54:49.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:49.947+0000 7f87f9459700 1 -- 172.21.15.50:0/2839743354 wait complete. 2023-11-28T11:54:49.962 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:54:50.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.079+0000 7fbaf7fff700 1 Processor -- start 2023-11-28T11:54:50.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.079+0000 7fbaf7fff700 1 -- start start 2023-11-28T11:54:50.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.079+0000 7fbaf7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbaf00df6c0 0x7fbaf0050450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.079+0000 7fbaf7fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbaf0037880 0x7fbaf0037cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.079+0000 7fbaf7fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf0052400 con 0x7fbaf0051fb0 2023-11-28T11:54:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.079+0000 7fbaf7fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf0039360 con 0x7fbaf00df6c0 2023-11-28T11:54:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.079+0000 7fbaf7fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf0054480 con 0x7fbaf0037880 2023-11-28T11:54:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.079+0000 7fbaf6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbaf00df6c0 0x7fbaf0050450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.079+0000 7fbaf67fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbaf0051fb0 0x7fbaf0038c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59938/0 (socket says 172.21.15.50:59938) 2023-11-28T11:54:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.079+0000 7fbaf67fc700 1 -- 172.21.15.50:0/3720266590 learned_addr learned my addr 172.21.15.50:0/3720266590 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.079+0000 7fbaf77fe700 1 --2- 172.21.15.50:0/3720266590 >> v2:172.21.15.192:3300/0 conn(0x7fbaf0037880 0x7fbaf0037cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.079+0000 7fbaf5ffb700 1 -- 172.21.15.50:0/3720266590 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461187499 0 0) 0x7fbaf0052400 con 0x7fbaf0051fb0 2023-11-28T11:54:50.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.079+0000 7fbaf5ffb700 1 -- 172.21.15.50:0/3720266590 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbae00035d0 con 0x7fbaf0051fb0 2023-11-28T11:54:50.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.079+0000 7fbaf6ffd700 1 -- 172.21.15.50:0/3720266590 >> v2:172.21.15.192:3300/0 conn(0x7fbaf0037880 msgr2=0x7fbaf0037cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:50.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.079+0000 7fbaf6ffd700 1 --2- 172.21.15.50:0/3720266590 >> v2:172.21.15.192:3300/0 conn(0x7fbaf0037880 0x7fbaf0037cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.079+0000 7fbaf6ffd700 1 -- 172.21.15.50:0/3720266590 >> v1:172.21.15.50:6789/0 conn(0x7fbaf0051fb0 legacy=0x7fbaf0038c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.079+0000 7fbaf6ffd700 1 -- 172.21.15.50:0/3720266590 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf0038200 con 0x7fbaf00df6c0 2023-11-28T11:54:50.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf6ffd700 1 --2- 172.21.15.50:0/3720266590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaf00df6c0 0x7fbaf0050450 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00e30e0 tx=0x7fbae8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8690b0f970652a32 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:50.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf5ffb700 1 -- 172.21.15.50:0/3720266590 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae8011830 con 0x7fbaf00df6c0 2023-11-28T11:54:50.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf5ffb700 1 -- 172.21.15.50:0/3720266590 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae8011990 con 0x7fbaf00df6c0 2023-11-28T11:54:50.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf5ffb700 1 -- 172.21.15.50:0/3720266590 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae8011d20 con 0x7fbaf00df6c0 2023-11-28T11:54:50.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf7fff700 1 -- 172.21.15.50:0/3720266590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaf00df6c0 msgr2=0x7fbaf0050450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf7fff700 1 --2- 172.21.15.50:0/3720266590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaf00df6c0 0x7fbaf0050450 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00e30e0 tx=0x7fbae8009b30 comp rx=0 tx=0).stop 2023-11-28T11:54:50.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf7fff700 1 -- 172.21.15.50:0/3720266590 shutdown_connections 2023-11-28T11:54:50.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf7fff700 1 --2- 172.21.15.50:0/3720266590 >> v2:172.21.15.192:3300/0 conn(0x7fbaf0037880 0x7fbaf0037cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf7fff700 1 --2- 172.21.15.50:0/3720266590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaf00df6c0 0x7fbaf0050450 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf7fff700 1 -- 172.21.15.50:0/3720266590 >> 172.21.15.50:0/3720266590 conn(0x7fbaf0052880 msgr2=0x7fbaf0052c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:50.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf7fff700 1 -- 172.21.15.50:0/3720266590 shutdown_connections 2023-11-28T11:54:50.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf7fff700 1 -- 172.21.15.50:0/3720266590 wait complete. 2023-11-28T11:54:50.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf7fff700 1 Processor -- start 2023-11-28T11:54:50.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf7fff700 1 -- start start 2023-11-28T11:54:50.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf7fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbaf0037880 0x7fbaf00cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf7fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaf0051fb0 0x7fbaf004efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaf00df6c0 0x7fbaf00e1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf7fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf004dbe0 con 0x7fbaf00df6c0 2023-11-28T11:54:50.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf7fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf0050500 con 0x7fbaf0051fb0 2023-11-28T11:54:50.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.083+0000 7fbaf7fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf004f8f0 con 0x7fbaf0037880 2023-11-28T11:54:50.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbaf77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaf00df6c0 0x7fbaf00e1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbaf77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaf00df6c0 0x7fbaf00e1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52192/0 (socket says 172.21.15.50:52192) 2023-11-28T11:54:50.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbaf77fe700 1 -- 172.21.15.50:0/785863683 learned_addr learned my addr 172.21.15.50:0/785863683 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:50.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbaf6ffd700 1 --2- 172.21.15.50:0/785863683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbaf0037880 0x7fbaf00cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbaf67fc700 1 --2- 172.21.15.50:0/785863683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaf0051fb0 0x7fbaf004efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbaf77fe700 1 -- 172.21.15.50:0/785863683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbaf0037880 msgr2=0x7fbaf00cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbaf77fe700 1 --2- 172.21.15.50:0/785863683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbaf0037880 0x7fbaf00cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbaf77fe700 1 -- 172.21.15.50:0/785863683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaf0051fb0 msgr2=0x7fbaf004efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbaf77fe700 1 --2- 172.21.15.50:0/785863683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaf0051fb0 0x7fbaf004efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbaf77fe700 1 -- 172.21.15.50:0/785863683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae80094b0 con 0x7fbaf00df6c0 2023-11-28T11:54:50.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbaf77fe700 1 --2- 172.21.15.50:0/785863683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaf00df6c0 0x7fbaf00e1c90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbaf804ed50 tx=0x7fbaf8000b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:50.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbadf7fe700 1 -- 172.21.15.50:0/785863683 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf808e070 con 0x7fbaf00df6c0 2023-11-28T11:54:50.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbadf7fe700 1 -- 172.21.15.50:0/785863683 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf8072c20 con 0x7fbaf00df6c0 2023-11-28T11:54:50.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbadf7fe700 1 -- 172.21.15.50:0/785863683 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8066d40 con 0x7fbaf00df6c0 2023-11-28T11:54:50.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbaf7fff700 1 -- 172.21.15.50:0/785863683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf0054720 con 0x7fbaf00df6c0 2023-11-28T11:54:50.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbaf7fff700 1 -- 172.21.15.50:0/785863683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf00dfa90 con 0x7fbaf00df6c0 2023-11-28T11:54:50.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbaf7fff700 1 -- 172.21.15.50:0/785863683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf0054a00 con 0x7fbaf00df6c0 2023-11-28T11:54:50.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbadf7fe700 1 -- 172.21.15.50:0/785863683 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbaf8099020 con 0x7fbaf00df6c0 2023-11-28T11:54:50.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.087+0000 7fbadf7fe700 1 --2- 172.21.15.50:0/785863683 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbae4064f10 0x7fbae40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.091+0000 7fbadf7fe700 1 -- 172.21.15.50:0/785863683 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbaf80fb1f0 con 0x7fbaf00df6c0 2023-11-28T11:54:50.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.091+0000 7fbaf6ffd700 1 --2- 172.21.15.50:0/785863683 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbae4064f10 0x7fbae40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.091+0000 7fbaf6ffd700 1 --2- 172.21.15.50:0/785863683 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbae4064f10 0x7fbae40673c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbae8000c00 tx=0x7fbae8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:50.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.095+0000 7fbadf7fe700 1 -- 172.21.15.50:0/785863683 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbaf80c9060 con 0x7fbaf00df6c0 2023-11-28T11:54:50.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.259+0000 7fbaf7fff700 1 -- 172.21.15.50:0/785863683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbaf0050640 con 0x7fbaf00df6c0 2023-11-28T11:54:50.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.259+0000 7fbadf7fe700 1 -- 172.21.15.50:0/785863683 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbaf0050640 con 0x7fbaf00df6c0 2023-11-28T11:54:50.260 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:54:50.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.259+0000 7fbaf7fff700 1 -- 172.21.15.50:0/785863683 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbae4064f10 msgr2=0x7fbae40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.259+0000 7fbaf7fff700 1 --2- 172.21.15.50:0/785863683 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbae4064f10 0x7fbae40673c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbae8000c00 tx=0x7fbae8008030 comp rx=0 tx=0).stop 2023-11-28T11:54:50.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.259+0000 7fbaf7fff700 1 -- 172.21.15.50:0/785863683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaf00df6c0 msgr2=0x7fbaf00e1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.259+0000 7fbaf7fff700 1 --2- 172.21.15.50:0/785863683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaf00df6c0 0x7fbaf00e1c90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbaf804ed50 tx=0x7fbaf8000b00 comp rx=0 tx=0).stop 2023-11-28T11:54:50.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.259+0000 7fbaf7fff700 1 -- 172.21.15.50:0/785863683 shutdown_connections 2023-11-28T11:54:50.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.259+0000 7fbaf7fff700 1 --2- 172.21.15.50:0/785863683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbaf00df6c0 0x7fbaf00e1c90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.259+0000 7fbaf7fff700 1 --2- 172.21.15.50:0/785863683 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbae4064f10 0x7fbae40673c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.259+0000 7fbaf7fff700 1 --2- 172.21.15.50:0/785863683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaf0051fb0 0x7fbaf004efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.259+0000 7fbaf7fff700 1 --2- 172.21.15.50:0/785863683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbaf0037880 0x7fbaf00cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.259+0000 7fbaf7fff700 1 -- 172.21.15.50:0/785863683 >> 172.21.15.50:0/785863683 conn(0x7fbaf0052880 msgr2=0x7fbaf0005130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:50.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.259+0000 7fbaf7fff700 1 -- 172.21.15.50:0/785863683 shutdown_connections 2023-11-28T11:54:50.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.259+0000 7fbaf7fff700 1 -- 172.21.15.50:0/785863683 wait complete. 2023-11-28T11:54:50.275 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:54:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f781d846700 1 Processor -- start 2023-11-28T11:54:50.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f781d846700 1 -- start start 2023-11-28T11:54:50.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f781d846700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78180b1ae0 0x7f781806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f781d846700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f78180cf0e0 0x7f78180cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f781d846700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78180cfa80 con 0x7f781806a4c0 2023-11-28T11:54:50.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f781d846700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78180d0ab0 con 0x7f78180cf0e0 2023-11-28T11:54:50.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f781d846700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781806a9c0 con 0x7f78180b1ae0 2023-11-28T11:54:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f7817fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f781806a4c0 0x7f78180d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59944/0 (socket says 172.21.15.50:59944) 2023-11-28T11:54:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f7817fff700 1 -- 172.21.15.50:0/4024520558 learned_addr learned my addr 172.21.15.50:0/4024520558 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f781c844700 1 --2- 172.21.15.50:0/4024520558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78180b1ae0 0x7f781806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f781d045700 1 --2- 172.21.15.50:0/4024520558 >> v2:172.21.15.192:3300/0 conn(0x7f78180cf0e0 0x7f78180cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f78177fe700 1 -- 172.21.15.50:0/4024520558 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418181888 0 0) 0x7f78180cfa80 con 0x7f781806a4c0 2023-11-28T11:54:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f78177fe700 1 -- 172.21.15.50:0/4024520558 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78080035d0 con 0x7f781806a4c0 2023-11-28T11:54:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f78177fe700 1 -- 172.21.15.50:0/4024520558 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 417029438 0 0) 0x7f78080035d0 con 0x7f781806a4c0 2023-11-28T11:54:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f78177fe700 1 -- 172.21.15.50:0/4024520558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78180b1ae0 msgr2=0x7f781806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f78177fe700 1 --2- 172.21.15.50:0/4024520558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78180b1ae0 0x7f781806d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f78177fe700 1 -- 172.21.15.50:0/4024520558 >> v2:172.21.15.192:3300/0 conn(0x7f78180cf0e0 msgr2=0x7f78180cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f78177fe700 1 --2- 172.21.15.50:0/4024520558 >> v2:172.21.15.192:3300/0 conn(0x7f78180cf0e0 0x7f78180cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f78177fe700 1 -- 172.21.15.50:0/4024520558 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781806aca0 con 0x7f781806a4c0 2023-11-28T11:54:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f78177fe700 1 -- 172.21.15.50:0/4024520558 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f780c001670 con 0x7f781806a4c0 2023-11-28T11:54:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f781d045700 1 --2- 172.21.15.50:0/4024520558 >> v2:172.21.15.192:3300/0 conn(0x7f78180cf0e0 0x7f78180cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f78177fe700 1 -- 172.21.15.50:0/4024520558 >> v1:172.21.15.50:6789/0 conn(0x7f781806a4c0 legacy=0x7f78180d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f78177fe700 1 --2- 172.21.15.50:0/4024520558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78180b1ae0 0x7f7808003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f78177fe700 1 --2- 172.21.15.50:0/4024520558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7808003fa0 0x7f7808004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f78177fe700 1 --2- 172.21.15.50:0/4024520558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7808004db0 0x7f7808005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f78177fe700 1 -- 172.21.15.50:0/4024520558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78180d0ab0 con 0x7f7808004db0 2023-11-28T11:54:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f78177fe700 1 -- 172.21.15.50:0/4024520558 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781806a9c0 con 0x7f7808003fa0 2023-11-28T11:54:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f78177fe700 1 -- 172.21.15.50:0/4024520558 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780800ba30 con 0x7f78180b1ae0 2023-11-28T11:54:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.383+0000 7f781d045700 1 --2- 172.21.15.50:0/4024520558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7808004db0 0x7f7808005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f781c844700 1 --2- 172.21.15.50:0/4024520558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78180b1ae0 0x7f7808003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f7817fff700 1 --2- 172.21.15.50:0/4024520558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7808003fa0 0x7f7808004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f781d045700 1 -- 172.21.15.50:0/4024520558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78180b1ae0 msgr2=0x7f7808003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f781d045700 1 --2- 172.21.15.50:0/4024520558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78180b1ae0 0x7f7808003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f781d045700 1 -- 172.21.15.50:0/4024520558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7808003fa0 msgr2=0x7f7808004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f781d045700 1 --2- 172.21.15.50:0/4024520558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7808003fa0 0x7f7808004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f781d045700 1 -- 172.21.15.50:0/4024520558 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78080035d0 con 0x7f7808004db0 2023-11-28T11:54:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f781d045700 1 --2- 172.21.15.50:0/4024520558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7808004db0 0x7f7808005220 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f781000e350 tx=0x7f78080058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74af668f7c33e7c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f78177fe700 1 -- 172.21.15.50:0/4024520558 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781000edf0 con 0x7f7808004db0 2023-11-28T11:54:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f78177fe700 1 -- 172.21.15.50:0/4024520558 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781000f040 con 0x7f7808004db0 2023-11-28T11:54:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f78177fe700 1 -- 172.21.15.50:0/4024520558 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78100146a0 con 0x7f7808004db0 2023-11-28T11:54:50.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f781d846700 1 -- 172.21.15.50:0/4024520558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7808004db0 msgr2=0x7f7808005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f781d846700 1 --2- 172.21.15.50:0/4024520558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7808004db0 0x7f7808005220 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f781000e350 tx=0x7f78080058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f781d045700 1 -- 172.21.15.50:0/4024520558 reap_dead start 2023-11-28T11:54:50.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f781d846700 1 -- 172.21.15.50:0/4024520558 shutdown_connections 2023-11-28T11:54:50.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f781d846700 1 -- 172.21.15.50:0/4024520558 >> 172.21.15.50:0/4024520558 conn(0x7f781809bbd0 msgr2=0x7f78180b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:50.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f781d846700 1 -- 172.21.15.50:0/4024520558 shutdown_connections 2023-11-28T11:54:50.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f781d846700 1 -- 172.21.15.50:0/4024520558 wait complete. 2023-11-28T11:54:50.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f781d846700 1 Processor -- start 2023-11-28T11:54:50.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.387+0000 7f781d846700 1 -- start start 2023-11-28T11:54:50.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d846700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f781814fb80 0x7f78180b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d846700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78180b3f70 0x7f78180b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d846700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7818150080 0x7f78180b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d846700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781815f4e0 con 0x7f7818150080 2023-11-28T11:54:50.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d846700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781815e440 con 0x7f78180b3f70 2023-11-28T11:54:50.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d846700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781815e720 con 0x7f781814fb80 2023-11-28T11:54:50.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d045700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7818150080 0x7f78180b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d045700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7818150080 0x7f78180b0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52208/0 (socket says 172.21.15.50:52208) 2023-11-28T11:54:50.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d045700 1 -- 172.21.15.50:0/1280901772 learned_addr learned my addr 172.21.15.50:0/1280901772 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:50.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781c844700 1 --2- 172.21.15.50:0/1280901772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f781814fb80 0x7f78180b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f7817fff700 1 --2- 172.21.15.50:0/1280901772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78180b3f70 0x7f78180b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d045700 1 -- 172.21.15.50:0/1280901772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f781814fb80 msgr2=0x7f78180b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d045700 1 --2- 172.21.15.50:0/1280901772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f781814fb80 0x7f78180b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d045700 1 -- 172.21.15.50:0/1280901772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78180b3f70 msgr2=0x7f78180b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d045700 1 --2- 172.21.15.50:0/1280901772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78180b3f70 0x7f78180b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d045700 1 -- 172.21.15.50:0/1280901772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78180b4380 con 0x7f7818150080 2023-11-28T11:54:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d045700 1 --2- 172.21.15.50:0/1280901772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7818150080 0x7f78180b0ce0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7810016000 tx=0x7f7810009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f78157fa700 1 -- 172.21.15.50:0/1280901772 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810007000 con 0x7f7818150080 2023-11-28T11:54:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f78157fa700 1 -- 172.21.15.50:0/1280901772 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7810009410 con 0x7f7818150080 2023-11-28T11:54:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d846700 1 -- 172.21.15.50:0/1280901772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781806af80 con 0x7f7818150080 2023-11-28T11:54:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f78157fa700 1 -- 172.21.15.50:0/1280901772 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810003a40 con 0x7f7818150080 2023-11-28T11:54:50.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d846700 1 -- 172.21.15.50:0/1280901772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78180b1eb0 con 0x7f7818150080 2023-11-28T11:54:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.391+0000 7f781d846700 1 -- 172.21.15.50:0/1280901772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7818072500 con 0x7f7818150080 2023-11-28T11:54:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.395+0000 7f78157fa700 1 -- 172.21.15.50:0/1280901772 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7810003ba0 con 0x7f7818150080 2023-11-28T11:54:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.395+0000 7f78157fa700 1 --2- 172.21.15.50:0/1280901772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f77fc064f10 0x7f77fc0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.395+0000 7f78157fa700 1 -- 172.21.15.50:0/1280901772 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f78100834c0 con 0x7f7818150080 2023-11-28T11:54:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.395+0000 7f781c844700 1 --2- 172.21.15.50:0/1280901772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f77fc064f10 0x7f77fc0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.395+0000 7f781c844700 1 --2- 172.21.15.50:0/1280901772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f77fc064f10 0x7f77fc0673c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7804009c70 tx=0x7f7804009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:50.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.399+0000 7f78157fa700 1 -- 172.21.15.50:0/1280901772 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f78100513f0 con 0x7f7818150080 2023-11-28T11:54:50.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.555+0000 7f781d846700 1 -- 172.21.15.50:0/1280901772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78181504d0 con 0x7f7818150080 2023-11-28T11:54:50.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.559+0000 7f78157fa700 1 -- 172.21.15.50:0/1280901772 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7810054a10 con 0x7f7818150080 2023-11-28T11:54:50.560 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:50.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.559+0000 7f781d846700 1 -- 172.21.15.50:0/1280901772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f77fc064f10 msgr2=0x7f77fc0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.559+0000 7f781d846700 1 --2- 172.21.15.50:0/1280901772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f77fc064f10 0x7f77fc0673c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7804009c70 tx=0x7f7804009240 comp rx=0 tx=0).stop 2023-11-28T11:54:50.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.559+0000 7f781d846700 1 -- 172.21.15.50:0/1280901772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7818150080 msgr2=0x7f78180b0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.559+0000 7f781d846700 1 --2- 172.21.15.50:0/1280901772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7818150080 0x7f78180b0ce0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7810016000 tx=0x7f7810009750 comp rx=0 tx=0).stop 2023-11-28T11:54:50.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.559+0000 7f781d846700 1 -- 172.21.15.50:0/1280901772 shutdown_connections 2023-11-28T11:54:50.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.559+0000 7f781d846700 1 --2- 172.21.15.50:0/1280901772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7818150080 0x7f78180b0ce0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.559+0000 7f781d846700 1 --2- 172.21.15.50:0/1280901772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f77fc064f10 0x7f77fc0673c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.559+0000 7f781d846700 1 --2- 172.21.15.50:0/1280901772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78180b3f70 0x7f78180b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.559+0000 7f781d846700 1 --2- 172.21.15.50:0/1280901772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f781814fb80 0x7f78180b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.559+0000 7f781d846700 1 -- 172.21.15.50:0/1280901772 >> 172.21.15.50:0/1280901772 conn(0x7f781809bbd0 msgr2=0x7f78180b7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:50.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.559+0000 7f781d846700 1 -- 172.21.15.50:0/1280901772 shutdown_connections 2023-11-28T11:54:50.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.559+0000 7f781d846700 1 -- 172.21.15.50:0/1280901772 wait complete. 2023-11-28T11:54:50.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:54:50.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.687+0000 7fe6a759e700 1 Processor -- start 2023-11-28T11:54:50.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.687+0000 7fe6a759e700 1 -- start start 2023-11-28T11:54:50.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.687+0000 7fe6a759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6a8159e00 0x7fe6a80caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.687+0000 7fe6a759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a815fcf0 con 0x7fe6a80cd960 2023-11-28T11:54:50.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.687+0000 7fe6a759e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a815ffd0 con 0x7fe6a8071b00 2023-11-28T11:54:50.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.687+0000 7fe6a759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a815a1d0 con 0x7fe6a8159e00 2023-11-28T11:54:50.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.687+0000 7fe6a6d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe6a80cd960 0x7fe6a815ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59956/0 (socket says 172.21.15.50:59956) 2023-11-28T11:54:50.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.687+0000 7fe6a6d9d700 1 -- 172.21.15.50:0/1133043150 learned_addr learned my addr 172.21.15.50:0/1133043150 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:50.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.687+0000 7fe6a659c700 1 --2- 172.21.15.50:0/1133043150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6a8159e00 0x7fe6a80caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.687+0000 7fe6a559a700 1 -- 172.21.15.50:0/1133043150 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562717435 0 0) 0x7fe6a815fcf0 con 0x7fe6a80cd960 2023-11-28T11:54:50.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.687+0000 7fe6a559a700 1 -- 172.21.15.50:0/1133043150 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6900035d0 con 0x7fe6a80cd960 2023-11-28T11:54:50.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a559a700 1 -- 172.21.15.50:0/1133043150 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2458308760 0 0) 0x7fe6900035d0 con 0x7fe6a80cd960 2023-11-28T11:54:50.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a559a700 1 -- 172.21.15.50:0/1133043150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6a8159e00 msgr2=0x7fe6a80caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:50.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a559a700 1 --2- 172.21.15.50:0/1133043150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6a8159e00 0x7fe6a80caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a559a700 1 -- 172.21.15.50:0/1133043150 >> v1:172.21.15.192:6789/0 conn(0x7fe6a8071b00 legacy=0x7fe6a80cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a559a700 1 -- 172.21.15.50:0/1133043150 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a81602b0 con 0x7fe6a80cd960 2023-11-28T11:54:50.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a559a700 1 -- 172.21.15.50:0/1133043150 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7fe6a00019f0 con 0x7fe6a80cd960 2023-11-28T11:54:50.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a559a700 1 -- 172.21.15.50:0/1133043150 >> v1:172.21.15.50:6789/0 conn(0x7fe6a80cd960 legacy=0x7fe6a815ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a559a700 1 --2- 172.21.15.50:0/1133043150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe690003a50 0x7fe690003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a559a700 1 --2- 172.21.15.50:0/1133043150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6a8159e00 0x7fe690004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a559a700 1 --2- 172.21.15.50:0/1133043150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe690004db0 0x7fe690005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a559a700 1 -- 172.21.15.50:0/1133043150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69000ba30 con 0x7fe690003a50 2023-11-28T11:54:50.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a559a700 1 -- 172.21.15.50:0/1133043150 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69000bb70 con 0x7fe690004db0 2023-11-28T11:54:50.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a559a700 1 -- 172.21.15.50:0/1133043150 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69000bd00 con 0x7fe6a8159e00 2023-11-28T11:54:50.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a659c700 1 --2- 172.21.15.50:0/1133043150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe690003a50 0x7fe690003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a6d9d700 1 --2- 172.21.15.50:0/1133043150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe690004db0 0x7fe690005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a5d9b700 1 --2- 172.21.15.50:0/1133043150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6a8159e00 0x7fe690004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a659c700 1 -- 172.21.15.50:0/1133043150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6a8159e00 msgr2=0x7fe690004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:50.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a659c700 1 --2- 172.21.15.50:0/1133043150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6a8159e00 0x7fe690004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a659c700 1 -- 172.21.15.50:0/1133043150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe690004db0 msgr2=0x7fe690005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:50.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a659c700 1 --2- 172.21.15.50:0/1133043150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe690004db0 0x7fe690005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a659c700 1 -- 172.21.15.50:0/1133043150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6900035d0 con 0x7fe690003a50 2023-11-28T11:54:50.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a659c700 1 --2- 172.21.15.50:0/1133043150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe690003a50 0x7fe690003e20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009b70 tx=0x7fe6900058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe168e16fd407a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:50.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a559a700 1 -- 172.21.15.50:0/1133043150 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c00e6c0 con 0x7fe690003a50 2023-11-28T11:54:50.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a559a700 1 -- 172.21.15.50:0/1133043150 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69c00e820 con 0x7fe690003a50 2023-11-28T11:54:50.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a559a700 1 -- 172.21.15.50:0/1133043150 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c00eb90 con 0x7fe690003a50 2023-11-28T11:54:50.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a759e700 1 -- 172.21.15.50:0/1133043150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe690003a50 msgr2=0x7fe690003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a759e700 1 --2- 172.21.15.50:0/1133043150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe690003a50 0x7fe690003e20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009b70 tx=0x7fe6900058a0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a6d9d700 1 -- 172.21.15.50:0/1133043150 reap_dead start 2023-11-28T11:54:50.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a759e700 1 -- 172.21.15.50:0/1133043150 shutdown_connections 2023-11-28T11:54:50.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a759e700 1 -- 172.21.15.50:0/1133043150 >> 172.21.15.50:0/1133043150 conn(0x7fe6a80b26e0 msgr2=0x7fe6a80b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:50.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a759e700 1 -- 172.21.15.50:0/1133043150 shutdown_connections 2023-11-28T11:54:50.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.691+0000 7fe6a759e700 1 -- 172.21.15.50:0/1133043150 wait complete. 2023-11-28T11:54:50.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a759e700 1 Processor -- start 2023-11-28T11:54:50.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a759e700 1 -- start start 2023-11-28T11:54:50.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe690003a50 0x7fe6a814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6a80a9100 0x7fe6a806b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6a80b48a0 0x7fe6a80b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a80a7e50 con 0x7fe6a80a9100 2023-11-28T11:54:50.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a759e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a80b5250 con 0x7fe690003a50 2023-11-28T11:54:50.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a80a8c70 con 0x7fe6a80b48a0 2023-11-28T11:54:50.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6a80a9100 0x7fe6a806b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6a80a9100 0x7fe6a806b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52218/0 (socket says 172.21.15.50:52218) 2023-11-28T11:54:50.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a5d9b700 1 -- 172.21.15.50:0/3995548253 learned_addr learned my addr 172.21.15.50:0/3995548253 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:50.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a659c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe690003a50 0x7fe6a814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a6d9d700 1 --2- 172.21.15.50:0/3995548253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6a80b48a0 0x7fe6a80b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a5d9b700 1 -- 172.21.15.50:0/3995548253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6a80b48a0 msgr2=0x7fe6a80b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a5d9b700 1 --2- 172.21.15.50:0/3995548253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6a80b48a0 0x7fe6a80b4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a5d9b700 1 -- 172.21.15.50:0/3995548253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe690003a50 msgr2=0x7fe6a814d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a5d9b700 1 --2- 172.21.15.50:0/3995548253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe690003a50 0x7fe6a814d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a5d9b700 1 -- 172.21.15.50:0/3995548253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a8160870 con 0x7fe6a80a9100 2023-11-28T11:54:50.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a5d9b700 1 --2- 172.21.15.50:0/3995548253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6a80a9100 0x7fe6a806b520 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe69800f910 tx=0x7fe69800fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:50.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe696ffd700 1 -- 172.21.15.50:0/3995548253 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6980052e0 con 0x7fe6a80a9100 2023-11-28T11:54:50.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe696ffd700 1 -- 172.21.15.50:0/3995548253 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe698005440 con 0x7fe6a80a9100 2023-11-28T11:54:50.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a759e700 1 -- 172.21.15.50:0/3995548253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a8160590 con 0x7fe6a80a9100 2023-11-28T11:54:50.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe696ffd700 1 -- 172.21.15.50:0/3995548253 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6980038e0 con 0x7fe6a80a9100 2023-11-28T11:54:50.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.695+0000 7fe6a759e700 1 -- 172.21.15.50:0/3995548253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a8160b50 con 0x7fe6a80a9100 2023-11-28T11:54:50.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.699+0000 7fe6a759e700 1 -- 172.21.15.50:0/3995548253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a8072500 con 0x7fe6a80a9100 2023-11-28T11:54:50.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.699+0000 7fe696ffd700 1 -- 172.21.15.50:0/3995548253 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe698003a40 con 0x7fe6a80a9100 2023-11-28T11:54:50.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.699+0000 7fe696ffd700 1 --2- 172.21.15.50:0/3995548253 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe688064f10 0x7fe6880673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:50.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.699+0000 7fe696ffd700 1 -- 172.21.15.50:0/3995548253 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe6980821b0 con 0x7fe6a80a9100 2023-11-28T11:54:50.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.699+0000 7fe6a659c700 1 --2- 172.21.15.50:0/3995548253 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe688064f10 0x7fe6880673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:50.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.699+0000 7fe6a659c700 1 --2- 172.21.15.50:0/3995548253 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe688064f10 0x7fe6880673c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe69c0090b0 tx=0x7fe69c01e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:50.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.707+0000 7fe696ffd700 1 -- 172.21.15.50:0/3995548253 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe69804ff30 con 0x7fe6a80a9100 2023-11-28T11:54:50.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.867+0000 7fe6a759e700 1 -- 172.21.15.50:0/3995548253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6a80ce680 con 0x7fe6a80a9100 2023-11-28T11:54:50.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.871+0000 7fe696ffd700 1 -- 172.21.15.50:0/3995548253 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe698053550 con 0x7fe6a80a9100 2023-11-28T11:54:50.872 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:54:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.875+0000 7fe6a759e700 1 -- 172.21.15.50:0/3995548253 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe688064f10 msgr2=0x7fe6880673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.875+0000 7fe6a759e700 1 --2- 172.21.15.50:0/3995548253 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe688064f10 0x7fe6880673c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe69c0090b0 tx=0x7fe69c01e040 comp rx=0 tx=0).stop 2023-11-28T11:54:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.875+0000 7fe6a759e700 1 -- 172.21.15.50:0/3995548253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6a80a9100 msgr2=0x7fe6a806b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.875+0000 7fe6a759e700 1 --2- 172.21.15.50:0/3995548253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6a80a9100 0x7fe6a806b520 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe69800f910 tx=0x7fe69800fc20 comp rx=0 tx=0).stop 2023-11-28T11:54:50.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.875+0000 7fe6a759e700 1 -- 172.21.15.50:0/3995548253 shutdown_connections 2023-11-28T11:54:50.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.875+0000 7fe6a759e700 1 --2- 172.21.15.50:0/3995548253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6a80b48a0 0x7fe6a80b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.875+0000 7fe6a759e700 1 --2- 172.21.15.50:0/3995548253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6a80a9100 0x7fe6a806b520 secure :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe69800f910 tx=0x7fe69800fc20 comp rx=0 tx=0).stop 2023-11-28T11:54:50.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.875+0000 7fe6a759e700 1 --2- 172.21.15.50:0/3995548253 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe688064f10 0x7fe6880673c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.875+0000 7fe6a759e700 1 --2- 172.21.15.50:0/3995548253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe690003a50 0x7fe6a814d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:50.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.875+0000 7fe6a759e700 1 -- 172.21.15.50:0/3995548253 >> 172.21.15.50:0/3995548253 conn(0x7fe6a80b26e0 msgr2=0x7fe6a80b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:50.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.875+0000 7fe6a759e700 1 -- 172.21.15.50:0/3995548253 shutdown_connections 2023-11-28T11:54:50.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:50.875+0000 7fe6a759e700 1 -- 172.21.15.50:0/3995548253 wait complete. 2023-11-28T11:54:50.894 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T11:54:51.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.011+0000 7f9fbc8cb700 1 Processor -- start 2023-11-28T11:54:51.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.011+0000 7f9fbc8cb700 1 -- start start 2023-11-28T11:54:51.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.011+0000 7f9fbc8cb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fb809bdb0 0x7f9fb815d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:51.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.011+0000 7f9fbc8cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9fb80cbb30 0x7f9fb806bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:51.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.011+0000 7f9fbc8cb700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb80b2db0 con 0x7f9fb80b00e0 2023-11-28T11:54:51.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.011+0000 7f9fbc8cb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb80b3240 con 0x7f9fb80cbb30 2023-11-28T11:54:51.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.011+0000 7f9fbc8cb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb806d840 con 0x7f9fb809bdb0 2023-11-28T11:54:51.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.011+0000 7f9fb7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9fb80cbb30 0x7f9fb806bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:51.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.011+0000 7f9fb7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9fb80cbb30 0x7f9fb806bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52224/0 (socket says 172.21.15.50:52224) 2023-11-28T11:54:51.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.011+0000 7f9fb7fff700 1 -- 172.21.15.50:0/1595349923 learned_addr learned my addr 172.21.15.50:0/1595349923 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:51.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.011+0000 7f9faeffd700 1 --2- 172.21.15.50:0/1595349923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fb809bdb0 0x7f9fb815d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:51.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.015+0000 7f9fb7fff700 1 -- 172.21.15.50:0/1595349923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fb809bdb0 msgr2=0x7f9fb815d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:51.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.015+0000 7f9fb7fff700 1 --2- 172.21.15.50:0/1595349923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fb809bdb0 0x7f9fb815d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.015+0000 7f9fb7fff700 1 -- 172.21.15.50:0/1595349923 >> v1:172.21.15.192:6789/0 conn(0x7f9fb80b00e0 legacy=0x7f9fb815d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.015+0000 7f9fb7fff700 1 -- 172.21.15.50:0/1595349923 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb806d560 con 0x7f9fb80cbb30 2023-11-28T11:54:51.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.015+0000 7f9fb7fff700 1 --2- 172.21.15.50:0/1595349923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb80cbb30 0x7f9fb806bbd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009e50 tx=0x7f9fb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e62a780243d4898 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:51.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.015+0000 7f9fb6ffd700 1 -- 172.21.15.50:0/1595349923 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000e070 con 0x7f9fb80cbb30 2023-11-28T11:54:51.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.015+0000 7f9fb6ffd700 1 -- 172.21.15.50:0/1595349923 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb000b9c0 con 0x7f9fb80cbb30 2023-11-28T11:54:51.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.015+0000 7f9fb6ffd700 1 -- 172.21.15.50:0/1595349923 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000bd70 con 0x7f9fb80cbb30 2023-11-28T11:54:51.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.015+0000 7f9fbc8cb700 1 -- 172.21.15.50:0/1595349923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb80cbb30 msgr2=0x7f9fb806bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.015+0000 7f9fbc8cb700 1 --2- 172.21.15.50:0/1595349923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb80cbb30 0x7f9fb806bbd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009e50 tx=0x7f9fb000b330 comp rx=0 tx=0).stop 2023-11-28T11:54:51.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.015+0000 7f9fbc8cb700 1 -- 172.21.15.50:0/1595349923 shutdown_connections 2023-11-28T11:54:51.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.015+0000 7f9fbc8cb700 1 --2- 172.21.15.50:0/1595349923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb80cbb30 0x7f9fb806bbd0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.015+0000 7f9fbc8cb700 1 --2- 172.21.15.50:0/1595349923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fb809bdb0 0x7f9fb815d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.015+0000 7f9fbc8cb700 1 -- 172.21.15.50:0/1595349923 >> 172.21.15.50:0/1595349923 conn(0x7f9fb80cae70 msgr2=0x7f9fb80cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:51.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.015+0000 7f9fbc8cb700 1 -- 172.21.15.50:0/1595349923 shutdown_connections 2023-11-28T11:54:51.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.015+0000 7f9fbc8cb700 1 -- 172.21.15.50:0/1595349923 wait complete. 2023-11-28T11:54:51.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.015+0000 7f9fbc8cb700 1 Processor -- start 2023-11-28T11:54:51.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fbc8cb700 1 -- start start 2023-11-28T11:54:51.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fbc8cb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fb809bdb0 0x7f9fb8153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:51.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fbc8cb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fb80b00e0 0x7f9fb81597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:51.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fbc8cb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb80cbb30 0x7f9fb815c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fbc8cb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb815ad90 con 0x7f9fb80cbb30 2023-11-28T11:54:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fbc8cb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb8153a60 con 0x7f9fb809bdb0 2023-11-28T11:54:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fbc8cb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb815a110 con 0x7f9fb80b00e0 2023-11-28T11:54:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fb7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb80cbb30 0x7f9fb815c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fb7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb80cbb30 0x7f9fb815c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52232/0 (socket says 172.21.15.50:52232) 2023-11-28T11:54:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fb7fff700 1 -- 172.21.15.50:0/409993982 learned_addr learned my addr 172.21.15.50:0/409993982 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:51.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9faeffd700 1 --2- 172.21.15.50:0/409993982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fb80b00e0 0x7f9fb81597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fb77fe700 1 --2- 172.21.15.50:0/409993982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fb809bdb0 0x7f9fb8153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fb7fff700 1 -- 172.21.15.50:0/409993982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fb80b00e0 msgr2=0x7f9fb81597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fb7fff700 1 --2- 172.21.15.50:0/409993982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fb80b00e0 0x7f9fb81597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fb7fff700 1 -- 172.21.15.50:0/409993982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fb809bdb0 msgr2=0x7f9fb8153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fb7fff700 1 --2- 172.21.15.50:0/409993982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fb809bdb0 0x7f9fb8153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fb7fff700 1 -- 172.21.15.50:0/409993982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb0009b30 con 0x7f9fb80cbb30 2023-11-28T11:54:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9faeffd700 1 --2- 172.21.15.50:0/409993982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fb80b00e0 0x7f9fb81597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fb77fe700 1 --2- 172.21.15.50:0/409993982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fb809bdb0 0x7f9fb8153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:51.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fb7fff700 1 --2- 172.21.15.50:0/409993982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb80cbb30 0x7f9fb815c090 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0012000 tx=0x7f9fb0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:51.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fb4ff9700 1 -- 172.21.15.50:0/409993982 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb00099b0 con 0x7f9fb80cbb30 2023-11-28T11:54:51.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fb4ff9700 1 -- 172.21.15.50:0/409993982 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb00092e0 con 0x7f9fb80cbb30 2023-11-28T11:54:51.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fbc8cb700 1 -- 172.21.15.50:0/409993982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb80ac3d0 con 0x7f9fb80cbb30 2023-11-28T11:54:51.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fbc8cb700 1 -- 172.21.15.50:0/409993982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb80ac0f0 con 0x7f9fb80cbb30 2023-11-28T11:54:51.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fb4ff9700 1 -- 172.21.15.50:0/409993982 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb001c640 con 0x7f9fb80cbb30 2023-11-28T11:54:51.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.019+0000 7f9fbc8cb700 1 -- 172.21.15.50:0/409993982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f90005310 con 0x7f9fb80cbb30 2023-11-28T11:54:51.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.023+0000 7f9fb4ff9700 1 -- 172.21.15.50:0/409993982 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9fb0022030 con 0x7f9fb80cbb30 2023-11-28T11:54:51.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.023+0000 7f9fb4ff9700 1 --2- 172.21.15.50:0/409993982 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9f9c064ee0 0x7f9f9c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:51.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.023+0000 7f9fb4ff9700 1 -- 172.21.15.50:0/409993982 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9fb0083b60 con 0x7f9fb80cbb30 2023-11-28T11:54:51.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.023+0000 7f9fb77fe700 1 --2- 172.21.15.50:0/409993982 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9f9c064ee0 0x7f9f9c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:51.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.023+0000 7f9fb77fe700 1 --2- 172.21.15.50:0/409993982 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9f9c064ee0 0x7f9f9c067390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9fb81f2ce0 tx=0x7f9fa8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:51.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.031+0000 7f9fb4ff9700 1 -- 172.21.15.50:0/409993982 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9fb0051860 con 0x7f9fb80cbb30 2023-11-28T11:54:51.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.195+0000 7f9fbc8cb700 1 -- 172.21.15.50:0/409993982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9f90005b40 con 0x7f9fb80cbb30 2023-11-28T11:54:51.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.199+0000 7f9fb4ff9700 1 -- 172.21.15.50:0/409993982 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9fb0054e80 con 0x7f9fb80cbb30 2023-11-28T11:54:51.203 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:54:51.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.203+0000 7f9fbc8cb700 1 -- 172.21.15.50:0/409993982 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9f9c064ee0 msgr2=0x7f9f9c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.203+0000 7f9fbc8cb700 1 --2- 172.21.15.50:0/409993982 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9f9c064ee0 0x7f9f9c067390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9fb81f2ce0 tx=0x7f9fa8009040 comp rx=0 tx=0).stop 2023-11-28T11:54:51.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.203+0000 7f9fbc8cb700 1 -- 172.21.15.50:0/409993982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb80cbb30 msgr2=0x7f9fb815c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.203+0000 7f9fbc8cb700 1 --2- 172.21.15.50:0/409993982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb80cbb30 0x7f9fb815c090 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0012000 tx=0x7f9fb0004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.203+0000 7f9fbc8cb700 1 -- 172.21.15.50:0/409993982 shutdown_connections 2023-11-28T11:54:51.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.203+0000 7f9fbc8cb700 1 --2- 172.21.15.50:0/409993982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fb80cbb30 0x7f9fb815c090 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.203+0000 7f9fbc8cb700 1 --2- 172.21.15.50:0/409993982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fb80b00e0 0x7f9fb81597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.203+0000 7f9fbc8cb700 1 --2- 172.21.15.50:0/409993982 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9f9c064ee0 0x7f9f9c067390 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.203+0000 7f9fbc8cb700 1 --2- 172.21.15.50:0/409993982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fb809bdb0 0x7f9fb8153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.203+0000 7f9fbc8cb700 1 -- 172.21.15.50:0/409993982 >> 172.21.15.50:0/409993982 conn(0x7f9fb80cae70 msgr2=0x7f9fb806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:51.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.203+0000 7f9fbc8cb700 1 -- 172.21.15.50:0/409993982 shutdown_connections 2023-11-28T11:54:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.203+0000 7f9fbc8cb700 1 -- 172.21.15.50:0/409993982 wait complete. 2023-11-28T11:54:51.219 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:54:51.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.327+0000 7f0833fff700 1 Processor -- start 2023-11-28T11:54:51.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.327+0000 7f0833fff700 1 -- start start 2023-11-28T11:54:51.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.327+0000 7f0833fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0834158f30 0x7f08340ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:51.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.327+0000 7f0833fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f08340cdb40 0x7f08340cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:51.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.327+0000 7f0833fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f083406e6f0 con 0x7f083406b940 2023-11-28T11:54:51.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.327+0000 7f0833fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08340ce4f0 con 0x7f0834158f30 2023-11-28T11:54:51.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.327+0000 7f0833fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083406c600 con 0x7f08340cdb40 2023-11-28T11:54:51.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.327+0000 7f0832ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0834158f30 0x7f08340ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.327+0000 7f0832ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0834158f30 0x7f08340ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52242/0 (socket says 172.21.15.50:52242) 2023-11-28T11:54:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.327+0000 7f0832ffd700 1 -- 172.21.15.50:0/4147826870 learned_addr learned my addr 172.21.15.50:0/4147826870 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.331+0000 7f08327fc700 1 --2- 172.21.15.50:0/4147826870 >> v2:172.21.15.192:3300/0 conn(0x7f08340cdb40 0x7f08340cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.331+0000 7f0832ffd700 1 -- 172.21.15.50:0/4147826870 >> v2:172.21.15.192:3300/0 conn(0x7f08340cdb40 msgr2=0x7f08340cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:51.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.331+0000 7f0832ffd700 1 --2- 172.21.15.50:0/4147826870 >> v2:172.21.15.192:3300/0 conn(0x7f08340cdb40 0x7f08340cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.331+0000 7f0832ffd700 1 -- 172.21.15.50:0/4147826870 >> v1:172.21.15.192:6789/0 conn(0x7f083406b940 legacy=0x7f083406bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.331+0000 7f0832ffd700 1 -- 172.21.15.50:0/4147826870 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083406c8e0 con 0x7f0834158f30 2023-11-28T11:54:51.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.331+0000 7f0832ffd700 1 --2- 172.21.15.50:0/4147826870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0834158f30 0x7f08340ca200 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f083415c840 tx=0x7f081c00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cfe11916479ad3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:51.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.331+0000 7f0831ffb700 1 -- 172.21.15.50:0/4147826870 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c00dd30 con 0x7f0834158f30 2023-11-28T11:54:51.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.331+0000 7f0831ffb700 1 -- 172.21.15.50:0/4147826870 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c00de90 con 0x7f0834158f30 2023-11-28T11:54:51.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.331+0000 7f0831ffb700 1 -- 172.21.15.50:0/4147826870 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c010690 con 0x7f0834158f30 2023-11-28T11:54:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.331+0000 7f0833fff700 1 -- 172.21.15.50:0/4147826870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0834158f30 msgr2=0x7f08340ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.331+0000 7f0833fff700 1 --2- 172.21.15.50:0/4147826870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0834158f30 0x7f08340ca200 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f083415c840 tx=0x7f081c00be90 comp rx=0 tx=0).stop 2023-11-28T11:54:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.331+0000 7f0833fff700 1 -- 172.21.15.50:0/4147826870 shutdown_connections 2023-11-28T11:54:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.331+0000 7f0833fff700 1 --2- 172.21.15.50:0/4147826870 >> v2:172.21.15.192:3300/0 conn(0x7f08340cdb40 0x7f08340cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.331+0000 7f0833fff700 1 --2- 172.21.15.50:0/4147826870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0834158f30 0x7f08340ca200 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.331+0000 7f0833fff700 1 -- 172.21.15.50:0/4147826870 >> 172.21.15.50:0/4147826870 conn(0x7f08340ccc50 msgr2=0x7f08340b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:51.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.331+0000 7f0833fff700 1 -- 172.21.15.50:0/4147826870 shutdown_connections 2023-11-28T11:54:51.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.331+0000 7f0833fff700 1 -- 172.21.15.50:0/4147826870 wait complete. 2023-11-28T11:54:51.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f0833fff700 1 Processor -- start 2023-11-28T11:54:51.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f0833fff700 1 -- start start 2023-11-28T11:54:51.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f0833fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f083406b940 0x7f08341568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:51.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f0833fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08340cdb40 0x7f08340c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:51.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f0833fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0834158f30 0x7f08340b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:51.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f0833fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0834156450 con 0x7f0834158f30 2023-11-28T11:54:51.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f0833fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0834155840 con 0x7f083406b940 2023-11-28T11:54:51.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f0833fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0834155b20 con 0x7f08340cdb40 2023-11-28T11:54:51.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f08337fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0834158f30 0x7f08340b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:51.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f08337fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0834158f30 0x7f08340b4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52258/0 (socket says 172.21.15.50:52258) 2023-11-28T11:54:51.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f08337fe700 1 -- 172.21.15.50:0/860406321 learned_addr learned my addr 172.21.15.50:0/860406321 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:51.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f0832ffd700 1 --2- 172.21.15.50:0/860406321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f083406b940 0x7f08341568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:51.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f08327fc700 1 --2- 172.21.15.50:0/860406321 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08340cdb40 0x7f08340c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:51.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f08337fe700 1 -- 172.21.15.50:0/860406321 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08340cdb40 msgr2=0x7f08340c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f08337fe700 1 --2- 172.21.15.50:0/860406321 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08340cdb40 0x7f08340c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f08337fe700 1 -- 172.21.15.50:0/860406321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f083406b940 msgr2=0x7f08341568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f08337fe700 1 --2- 172.21.15.50:0/860406321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f083406b940 0x7f08341568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f08337fe700 1 -- 172.21.15.50:0/860406321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081c00b810 con 0x7f0834158f30 2023-11-28T11:54:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.335+0000 7f08337fe700 1 --2- 172.21.15.50:0/860406321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0834158f30 0x7f08340b4630 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f082c00cc50 tx=0x7f082c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.339+0000 7f082bfff700 1 -- 172.21.15.50:0/860406321 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c003c20 con 0x7f0834158f30 2023-11-28T11:54:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.339+0000 7f082bfff700 1 -- 172.21.15.50:0/860406321 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082c003d80 con 0x7f0834158f30 2023-11-28T11:54:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.339+0000 7f0833fff700 1 -- 172.21.15.50:0/860406321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f083406e380 con 0x7f0834158f30 2023-11-28T11:54:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.339+0000 7f082bfff700 1 -- 172.21.15.50:0/860406321 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c00ab60 con 0x7f0834158f30 2023-11-28T11:54:51.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.339+0000 7f0833fff700 1 -- 172.21.15.50:0/860406321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083406e0a0 con 0x7f0834158f30 2023-11-28T11:54:51.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.339+0000 7f0833fff700 1 -- 172.21.15.50:0/860406321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f083406eb60 con 0x7f0834158f30 2023-11-28T11:54:51.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.339+0000 7f082bfff700 1 -- 172.21.15.50:0/860406321 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f082c010050 con 0x7f0834158f30 2023-11-28T11:54:51.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.339+0000 7f082bfff700 1 --2- 172.21.15.50:0/860406321 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0814064ee0 0x7f0814067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:51.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.339+0000 7f082bfff700 1 -- 172.21.15.50:0/860406321 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f082c082210 con 0x7f0834158f30 2023-11-28T11:54:51.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.343+0000 7f0832ffd700 1 --2- 172.21.15.50:0/860406321 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0814064ee0 0x7f0814067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:51.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.343+0000 7f0832ffd700 1 --2- 172.21.15.50:0/860406321 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0814064ee0 0x7f0814067390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f081c000c00 tx=0x7f081c013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:51.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.347+0000 7f082bfff700 1 -- 172.21.15.50:0/860406321 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f082c04ff10 con 0x7f0834158f30 2023-11-28T11:54:51.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.547+0000 7f0833fff700 1 -- 172.21.15.50:0/860406321 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0834155ce0 con 0x7f0834158f30 2023-11-28T11:54:51.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.547+0000 7f082bfff700 1 -- 172.21.15.50:0/860406321 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7f082c053530 con 0x7f0834158f30 2023-11-28T11:54:51.549 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:51.549 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2457318670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2457318670},{"type":"v1","addr":"172.21.15.192:6836","nonce":2457318670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3448258722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3448258722},{"type":"v1","addr":"172.21.15.192:6837","nonce":3448258722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/490368853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":490368853},{"type":"v1","addr":"172.21.15.50:6833","nonce":490368853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:53:40.797417+0000","modified":"2023-11-28T11:54:02.939902+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3764199418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3764199418},{"type":"v1","addr":"172.21.15.50:6835","nonce":3764199418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:54:51.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.551+0000 7f0833fff700 1 -- 172.21.15.50:0/860406321 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0814064ee0 msgr2=0x7f0814067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.551+0000 7f0833fff700 1 --2- 172.21.15.50:0/860406321 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0814064ee0 0x7f0814067390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f081c000c00 tx=0x7f081c013000 comp rx=0 tx=0).stop 2023-11-28T11:54:51.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.551+0000 7f0833fff700 1 -- 172.21.15.50:0/860406321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0834158f30 msgr2=0x7f08340b4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.551+0000 7f0833fff700 1 --2- 172.21.15.50:0/860406321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0834158f30 0x7f08340b4630 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f082c00cc50 tx=0x7f082c00cf60 comp rx=0 tx=0).stop 2023-11-28T11:54:51.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.551+0000 7f0833fff700 1 -- 172.21.15.50:0/860406321 shutdown_connections 2023-11-28T11:54:51.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.551+0000 7f0833fff700 1 --2- 172.21.15.50:0/860406321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0834158f30 0x7f08340b4630 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.551+0000 7f0833fff700 1 --2- 172.21.15.50:0/860406321 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08340cdb40 0x7f08340c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.551+0000 7f0833fff700 1 --2- 172.21.15.50:0/860406321 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0814064ee0 0x7f0814067390 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.551+0000 7f0833fff700 1 --2- 172.21.15.50:0/860406321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f083406b940 0x7f08341568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.551+0000 7f0833fff700 1 -- 172.21.15.50:0/860406321 >> 172.21.15.50:0/860406321 conn(0x7f08340ccc50 msgr2=0x7f0834153de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:51.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.551+0000 7f0833fff700 1 -- 172.21.15.50:0/860406321 shutdown_connections 2023-11-28T11:54:51.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.551+0000 7f0833fff700 1 -- 172.21.15.50:0/860406321 wait complete. 2023-11-28T11:54:51.555 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-11-28T11:54:51.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.679+0000 7f10b0c9b700 1 Processor -- start 2023-11-28T11:54:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.679+0000 7f10b0c9b700 1 -- start start 2023-11-28T11:54:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10b0c9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10ac159630 0x7f10ac0b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10b0c9b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ac069c40 con 0x7f10ac13e510 2023-11-28T11:54:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10b0c9b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ac13e9a0 con 0x7f10ac0706f0 2023-11-28T11:54:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10b0c9b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ac13c200 con 0x7f10ac159630 2023-11-28T11:54:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10aaffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f10ac13e510 0x7f10ac159a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34274/0 (socket says 172.21.15.50:34274) 2023-11-28T11:54:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10aaffd700 1 -- 172.21.15.50:0/3864069406 learned_addr learned my addr 172.21.15.50:0/3864069406 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10ab7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10ac159630 0x7f10ac0b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10aa7fc700 1 -- 172.21.15.50:0/3864069406 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938526020 0 0) 0x7f10ac069c40 con 0x7f10ac13e510 2023-11-28T11:54:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10aa7fc700 1 -- 172.21.15.50:0/3864069406 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10940035d0 con 0x7f10ac13e510 2023-11-28T11:54:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10aa7fc700 1 -- 172.21.15.50:0/3864069406 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4235882294 0 0) 0x7f10ac13e9a0 con 0x7f10ac0706f0 2023-11-28T11:54:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10aa7fc700 1 -- 172.21.15.50:0/3864069406 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10ac069c40 con 0x7f10ac0706f0 2023-11-28T11:54:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10ab7fe700 1 -- 172.21.15.50:0/3864069406 >> v1:172.21.15.192:6789/0 conn(0x7f10ac0706f0 legacy=0x7f10ac070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10ab7fe700 1 -- 172.21.15.50:0/3864069406 >> v1:172.21.15.50:6789/0 conn(0x7f10ac13e510 legacy=0x7f10ac159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10ab7fe700 1 -- 172.21.15.50:0/3864069406 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac13ec80 con 0x7f10ac159630 2023-11-28T11:54:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10ab7fe700 1 --2- 172.21.15.50:0/3864069406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10ac159630 0x7f10ac0b1cb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f109c009850 tx=0x7f109c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f08d9b88024529 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10aa7fc700 1 -- 172.21.15.50:0/3864069406 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c011830 con 0x7f10ac159630 2023-11-28T11:54:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10aa7fc700 1 -- 172.21.15.50:0/3864069406 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c011990 con 0x7f10ac159630 2023-11-28T11:54:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10aa7fc700 1 -- 172.21.15.50:0/3864069406 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c011d00 con 0x7f10ac159630 2023-11-28T11:54:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10b0c9b700 1 -- 172.21.15.50:0/3864069406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10ac159630 msgr2=0x7f10ac0b1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10b0c9b700 1 --2- 172.21.15.50:0/3864069406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10ac159630 0x7f10ac0b1cb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f109c009850 tx=0x7f109c009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10b0c9b700 1 -- 172.21.15.50:0/3864069406 shutdown_connections 2023-11-28T11:54:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10b0c9b700 1 --2- 172.21.15.50:0/3864069406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10ac159630 0x7f10ac0b1cb0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10b0c9b700 1 -- 172.21.15.50:0/3864069406 >> 172.21.15.50:0/3864069406 conn(0x7f10ac06e000 msgr2=0x7f10ac0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:51.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10b0c9b700 1 -- 172.21.15.50:0/3864069406 shutdown_connections 2023-11-28T11:54:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.683+0000 7f10b0c9b700 1 -- 172.21.15.50:0/3864069406 wait complete. 2023-11-28T11:54:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10b0c9b700 1 Processor -- start 2023-11-28T11:54:51.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10b0c9b700 1 -- start start 2023-11-28T11:54:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10b0c9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10ac0706f0 0x7f10ac158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10b0c9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10ac13e510 0x7f10ac06b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:51.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10b0c9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10ac159630 0x7f10ac0c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10b0c9b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac1f07a0 con 0x7f10ac159630 2023-11-28T11:54:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10b0c9b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac1ef860 con 0x7f10ac0706f0 2023-11-28T11:54:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10b0c9b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac1efb20 con 0x7f10ac13e510 2023-11-28T11:54:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10abfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10ac159630 0x7f10ac0c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:51.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10abfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10ac159630 0x7f10ac0c9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58352/0 (socket says 172.21.15.50:58352) 2023-11-28T11:54:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10abfff700 1 -- 172.21.15.50:0/2036990118 learned_addr learned my addr 172.21.15.50:0/2036990118 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10ab7fe700 1 --2- 172.21.15.50:0/2036990118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10ac0706f0 0x7f10ac158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10aaffd700 1 --2- 172.21.15.50:0/2036990118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10ac13e510 0x7f10ac06b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10abfff700 1 -- 172.21.15.50:0/2036990118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10ac13e510 msgr2=0x7f10ac06b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10abfff700 1 --2- 172.21.15.50:0/2036990118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10ac13e510 0x7f10ac06b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10abfff700 1 -- 172.21.15.50:0/2036990118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10ac0706f0 msgr2=0x7f10ac158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10abfff700 1 --2- 172.21.15.50:0/2036990118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10ac0706f0 0x7f10ac158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10abfff700 1 -- 172.21.15.50:0/2036990118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c0094b0 con 0x7f10ac159630 2023-11-28T11:54:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10abfff700 1 --2- 172.21.15.50:0/2036990118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10ac159630 0x7f10ac0c9cd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f10a400cbc0 tx=0x7f10a400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:51.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f1093fff700 1 -- 172.21.15.50:0/2036990118 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a4003c20 con 0x7f10ac159630 2023-11-28T11:54:51.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f1093fff700 1 -- 172.21.15.50:0/2036990118 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a4003da0 con 0x7f10ac159630 2023-11-28T11:54:51.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f1093fff700 1 -- 172.21.15.50:0/2036990118 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a400aa40 con 0x7f10ac159630 2023-11-28T11:54:51.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10b0c9b700 1 -- 172.21.15.50:0/2036990118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ac13f240 con 0x7f10ac159630 2023-11-28T11:54:51.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.687+0000 7f10b0c9b700 1 -- 172.21.15.50:0/2036990118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ac13ef60 con 0x7f10ac159630 2023-11-28T11:54:51.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.691+0000 7f10b0c9b700 1 -- 172.21.15.50:0/2036990118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ac072c20 con 0x7f10ac159630 2023-11-28T11:54:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.691+0000 7f1093fff700 1 -- 172.21.15.50:0/2036990118 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f10a4010050 con 0x7f10ac159630 2023-11-28T11:54:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.691+0000 7f1093fff700 1 --2- 172.21.15.50:0/2036990118 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1098064ee0 0x7f1098067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.691+0000 7f1093fff700 1 -- 172.21.15.50:0/2036990118 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f10a40820a0 con 0x7f10ac159630 2023-11-28T11:54:51.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.691+0000 7f10ab7fe700 1 --2- 172.21.15.50:0/2036990118 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1098064ee0 0x7f1098067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:51.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.691+0000 7f10ab7fe700 1 --2- 172.21.15.50:0/2036990118 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1098064ee0 0x7f1098067390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f109c0090b0 tx=0x7f109c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:51.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.699+0000 7f1093fff700 1 -- 172.21.15.50:0/2036990118 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f10a404fdc0 con 0x7f10ac159630 2023-11-28T11:54:51.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.863+0000 7f10b0c9b700 1 -- 172.21.15.50:0/2036990118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10ac0b30f0 con 0x7f10ac159630 2023-11-28T11:54:51.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.867+0000 7f1093fff700 1 -- 172.21.15.50:0/2036990118 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19689 (secure 0 0 0) 0x7f10a40533e0 con 0x7f10ac159630 2023-11-28T11:54:51.868 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:51.868 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:54:30.086945+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:51.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.867+0000 7f10b0c9b700 1 -- 172.21.15.50:0/2036990118 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1098064ee0 msgr2=0x7f1098067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.867+0000 7f10b0c9b700 1 --2- 172.21.15.50:0/2036990118 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1098064ee0 0x7f1098067390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f109c0090b0 tx=0x7f109c008030 comp rx=0 tx=0).stop 2023-11-28T11:54:51.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.867+0000 7f10b0c9b700 1 -- 172.21.15.50:0/2036990118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10ac159630 msgr2=0x7f10ac0c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:51.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.867+0000 7f10b0c9b700 1 --2- 172.21.15.50:0/2036990118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10ac159630 0x7f10ac0c9cd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f10a400cbc0 tx=0x7f10a400ced0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.867+0000 7f10b0c9b700 1 -- 172.21.15.50:0/2036990118 shutdown_connections 2023-11-28T11:54:51.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.867+0000 7f10b0c9b700 1 --2- 172.21.15.50:0/2036990118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10ac159630 0x7f10ac0c9cd0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.867+0000 7f10b0c9b700 1 --2- 172.21.15.50:0/2036990118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10ac13e510 0x7f10ac06b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.867+0000 7f10b0c9b700 1 --2- 172.21.15.50:0/2036990118 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1098064ee0 0x7f1098067390 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.867+0000 7f10b0c9b700 1 --2- 172.21.15.50:0/2036990118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10ac0706f0 0x7f10ac158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:51.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.867+0000 7f10b0c9b700 1 -- 172.21.15.50:0/2036990118 >> 172.21.15.50:0/2036990118 conn(0x7f10ac06e000 msgr2=0x7f10ac0b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:51.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.867+0000 7f10b0c9b700 1 -- 172.21.15.50:0/2036990118 shutdown_connections 2023-11-28T11:54:51.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.867+0000 7f10b0c9b700 1 -- 172.21.15.50:0/2036990118 wait complete. 2023-11-28T11:54:51.883 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T11:54:51.884 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:54:51.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.995+0000 7f830ca58700 1 Processor -- start 2023-11-28T11:54:51.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830ca58700 1 -- start start 2023-11-28T11:54:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830ca58700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83080c6bd0 0x7f83080cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830ca58700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f83080cdb30 0x7f83080c4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830ca58700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83080c6fa0 con 0x7f83080cc4f0 2023-11-28T11:54:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830ca58700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83080b2b10 con 0x7f83080cdb30 2023-11-28T11:54:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830ca58700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83080b21b0 con 0x7f83080c6bd0 2023-11-28T11:54:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830659c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f83080cc4f0 0x7f83080cd420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34276/0 (socket says 172.21.15.50:34276) 2023-11-28T11:54:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830659c700 1 -- 172.21.15.50:0/3207095938 learned_addr learned my addr 172.21.15.50:0/3207095938 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:52.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830759e700 1 --2- 172.21.15.50:0/3207095938 >> v2:172.21.15.192:3300/0 conn(0x7f83080cdb30 0x7f83080c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f8306d9d700 1 --2- 172.21.15.50:0/3207095938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83080c6bd0 0x7f83080cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f8305d9b700 1 -- 172.21.15.50:0/3207095938 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798713570 0 0) 0x7f83080c6fa0 con 0x7f83080cc4f0 2023-11-28T11:54:52.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f8305d9b700 1 -- 172.21.15.50:0/3207095938 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82f40035d0 con 0x7f83080cc4f0 2023-11-28T11:54:52.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830759e700 1 -- 172.21.15.50:0/3207095938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83080c6bd0 msgr2=0x7f83080cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:52.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830759e700 1 --2- 172.21.15.50:0/3207095938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83080c6bd0 0x7f83080cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830759e700 1 -- 172.21.15.50:0/3207095938 >> v1:172.21.15.50:6789/0 conn(0x7f83080cc4f0 legacy=0x7f83080cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:52.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830759e700 1 -- 172.21.15.50:0/3207095938 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83080b2f30 con 0x7f83080cdb30 2023-11-28T11:54:52.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830759e700 1 --2- 172.21.15.50:0/3207095938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83080cdb30 0x7f83080c4170 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8300009d90 tx=0x7f830000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4e20a43549afd47 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:52.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f8305d9b700 1 -- 172.21.15.50:0/3207095938 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830000e070 con 0x7f83080cdb30 2023-11-28T11:54:52.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f8305d9b700 1 -- 172.21.15.50:0/3207095938 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830000bb20 con 0x7f83080cdb30 2023-11-28T11:54:52.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f8305d9b700 1 -- 172.21.15.50:0/3207095938 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8300012430 con 0x7f83080cdb30 2023-11-28T11:54:52.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830ca58700 1 -- 172.21.15.50:0/3207095938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83080cdb30 msgr2=0x7f83080c4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:52.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830ca58700 1 --2- 172.21.15.50:0/3207095938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83080cdb30 0x7f83080c4170 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8300009d90 tx=0x7f830000b330 comp rx=0 tx=0).stop 2023-11-28T11:54:52.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830ca58700 1 -- 172.21.15.50:0/3207095938 shutdown_connections 2023-11-28T11:54:52.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830ca58700 1 --2- 172.21.15.50:0/3207095938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83080cdb30 0x7f83080c4170 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830ca58700 1 --2- 172.21.15.50:0/3207095938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83080c6bd0 0x7f83080cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830ca58700 1 -- 172.21.15.50:0/3207095938 >> 172.21.15.50:0/3207095938 conn(0x7f8308069c40 msgr2=0x7f830806a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:52.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830ca58700 1 -- 172.21.15.50:0/3207095938 shutdown_connections 2023-11-28T11:54:52.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:51.999+0000 7f830ca58700 1 -- 172.21.15.50:0/3207095938 wait complete. 2023-11-28T11:54:52.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f830ca58700 1 Processor -- start 2023-11-28T11:54:52.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f830ca58700 1 -- start start 2023-11-28T11:54:52.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f830ca58700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83080c6bd0 0x7f83081577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f830ca58700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83080cc4f0 0x7f830806b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f830ca58700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83080cdb30 0x7f83081e1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f830ca58700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83080b3780 con 0x7f83080cc4f0 2023-11-28T11:54:52.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f830ca58700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83080b3450 con 0x7f83080c6bd0 2023-11-28T11:54:52.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f830ca58700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8308157d20 con 0x7f83080cdb30 2023-11-28T11:54:52.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f830659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83080cc4f0 0x7f830806b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f830659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83080cc4f0 0x7f830806b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58368/0 (socket says 172.21.15.50:58368) 2023-11-28T11:54:52.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f830659c700 1 -- 172.21.15.50:0/448378424 learned_addr learned my addr 172.21.15.50:0/448378424 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:52.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f830759e700 1 --2- 172.21.15.50:0/448378424 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83080cdb30 0x7f83081e1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f8306d9d700 1 --2- 172.21.15.50:0/448378424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83080c6bd0 0x7f83081577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f830659c700 1 -- 172.21.15.50:0/448378424 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83080cdb30 msgr2=0x7f83081e1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:52.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f830659c700 1 --2- 172.21.15.50:0/448378424 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83080cdb30 0x7f83081e1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f830659c700 1 -- 172.21.15.50:0/448378424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83080c6bd0 msgr2=0x7f83081577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:52.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f830659c700 1 --2- 172.21.15.50:0/448378424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83080c6bd0 0x7f83081577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f830659c700 1 -- 172.21.15.50:0/448378424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8300009a70 con 0x7f83080cc4f0 2023-11-28T11:54:52.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.003+0000 7f8306d9d700 1 --2- 172.21.15.50:0/448378424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83080c6bd0 0x7f83081577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:52.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.007+0000 7f830659c700 1 --2- 172.21.15.50:0/448378424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83080cc4f0 0x7f830806b5e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f82f000c700 tx=0x7f82f000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:52.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.007+0000 7f82ff7fe700 1 -- 172.21.15.50:0/448378424 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0005d90 con 0x7f83080cc4f0 2023-11-28T11:54:52.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.007+0000 7f82ff7fe700 1 -- 172.21.15.50:0/448378424 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f00070d0 con 0x7f83080cc4f0 2023-11-28T11:54:52.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.007+0000 7f830ca58700 1 -- 172.21.15.50:0/448378424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83080b2730 con 0x7f83080cc4f0 2023-11-28T11:54:52.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.007+0000 7f82ff7fe700 1 -- 172.21.15.50:0/448378424 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0007480 con 0x7f83080cc4f0 2023-11-28T11:54:52.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.007+0000 7f830ca58700 1 -- 172.21.15.50:0/448378424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83080b2450 con 0x7f83080cc4f0 2023-11-28T11:54:52.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.007+0000 7f830ca58700 1 -- 172.21.15.50:0/448378424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83080cce20 con 0x7f83080cc4f0 2023-11-28T11:54:52.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.007+0000 7f82ff7fe700 1 -- 172.21.15.50:0/448378424 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f82f0019030 con 0x7f83080cc4f0 2023-11-28T11:54:52.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.011+0000 7f82ff7fe700 1 --2- 172.21.15.50:0/448378424 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f82e8064f10 0x7f82e80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.011+0000 7f82ff7fe700 1 -- 172.21.15.50:0/448378424 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f82f0081620 con 0x7f83080cc4f0 2023-11-28T11:54:52.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.011+0000 7f8306d9d700 1 --2- 172.21.15.50:0/448378424 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f82e8064f10 0x7f82e80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.011+0000 7f8306d9d700 1 --2- 172.21.15.50:0/448378424 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f82e8064f10 0x7f82e80673c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009c40 tx=0x7f82f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:52.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.019+0000 7f82ff7fe700 1 -- 172.21.15.50:0/448378424 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f82f004f400 con 0x7f83080cc4f0 2023-11-28T11:54:52.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.219+0000 7f830ca58700 1 -- 172.21.15.50:0/448378424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8308072c20 con 0x7f83080cc4f0 2023-11-28T11:54:52.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.223+0000 7f82ff7fe700 1 -- 172.21.15.50:0/448378424 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7f82f0017090 con 0x7f83080cc4f0 2023-11-28T11:54:52.224 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:52.224 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2457318670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2457318670},{"type":"v1","addr":"172.21.15.192:6836","nonce":2457318670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3448258722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3448258722},{"type":"v1","addr":"172.21.15.192:6837","nonce":3448258722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/490368853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":490368853},{"type":"v1","addr":"172.21.15.50:6833","nonce":490368853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:53:40.797417+0000","modified":"2023-11-28T11:54:02.939902+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3764199418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3764199418},{"type":"v1","addr":"172.21.15.50:6835","nonce":3764199418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:54:52.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.227+0000 7f830ca58700 1 -- 172.21.15.50:0/448378424 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f82e8064f10 msgr2=0x7f82e80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:52.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.227+0000 7f830ca58700 1 --2- 172.21.15.50:0/448378424 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f82e8064f10 0x7f82e80673c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009c40 tx=0x7f82f8008040 comp rx=0 tx=0).stop 2023-11-28T11:54:52.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.227+0000 7f830ca58700 1 -- 172.21.15.50:0/448378424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83080cc4f0 msgr2=0x7f830806b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:52.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.227+0000 7f830ca58700 1 --2- 172.21.15.50:0/448378424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83080cc4f0 0x7f830806b5e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f82f000c700 tx=0x7f82f000ca10 comp rx=0 tx=0).stop 2023-11-28T11:54:52.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.227+0000 7f830ca58700 1 -- 172.21.15.50:0/448378424 shutdown_connections 2023-11-28T11:54:52.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.227+0000 7f830ca58700 1 --2- 172.21.15.50:0/448378424 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83080cdb30 0x7f83081e1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.227+0000 7f830ca58700 1 --2- 172.21.15.50:0/448378424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83080cc4f0 0x7f830806b5e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.227+0000 7f830ca58700 1 --2- 172.21.15.50:0/448378424 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f82e8064f10 0x7f82e80673c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.227+0000 7f830ca58700 1 --2- 172.21.15.50:0/448378424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83080c6bd0 0x7f83081577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.227+0000 7f830ca58700 1 -- 172.21.15.50:0/448378424 >> 172.21.15.50:0/448378424 conn(0x7f8308069c40 msgr2=0x7f8308159ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:52.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.227+0000 7f830ca58700 1 -- 172.21.15.50:0/448378424 shutdown_connections 2023-11-28T11:54:52.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.227+0000 7f830ca58700 1 -- 172.21.15.50:0/448378424 wait complete. 2023-11-28T11:54:52.229 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-11-28T11:54:52.244 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:54:52.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae31e67700 1 Processor -- start 2023-11-28T11:54:52.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae31e67700 1 -- start start 2023-11-28T11:54:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae31e67700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae2c15fa60 0x7fae2c06aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae31e67700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fae2c0b19a0 0x7fae2c15ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae31e67700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae2c1604f0 con 0x7fae2c0ca110 2023-11-28T11:54:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae31e67700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c0cdae0 con 0x7fae2c0b19a0 2023-11-28T11:54:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae31e67700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c0ca560 con 0x7fae2c15fa60 2023-11-28T11:54:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae2b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae2c15fa60 0x7fae2c06aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae2bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fae2c0b19a0 0x7fae2c15ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae2bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fae2c0b19a0 0x7fae2c15ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:48092/0 (socket says 172.21.15.50:48092) 2023-11-28T11:54:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae2bfff700 1 -- 172.21.15.50:0/3491777087 learned_addr learned my addr 172.21.15.50:0/3491777087 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae2b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae2c15fa60 0x7fae2c06aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:46218/0 (socket says 172.21.15.50:46218) 2023-11-28T11:54:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae2b7fe700 1 -- 172.21.15.50:0/3491777087 >> v2:172.21.15.192:3300/0 conn(0x7fae2c0b19a0 msgr2=0x7fae2c15ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae2b7fe700 1 --2- 172.21.15.50:0/3491777087 >> v2:172.21.15.192:3300/0 conn(0x7fae2c0b19a0 0x7fae2c15ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae2b7fe700 1 -- 172.21.15.50:0/3491777087 >> v1:172.21.15.192:6789/0 conn(0x7fae2c0ca110 legacy=0x7fae2c0b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae2b7fe700 1 -- 172.21.15.50:0/3491777087 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c160720 con 0x7fae2c15fa60 2023-11-28T11:54:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae2bfff700 1 --2- 172.21.15.50:0/3491777087 >> v2:172.21.15.192:3300/0 conn(0x7fae2c0b19a0 0x7fae2c15ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.355+0000 7fae2b7fe700 1 --2- 172.21.15.50:0/3491777087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae2c15fa60 0x7fae2c06aa90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae20009850 tx=0x7fae20009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2cb03f911bb5c28 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.359+0000 7fae2a7fc700 1 -- 172.21.15.50:0/3491777087 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20011830 con 0x7fae2c15fa60 2023-11-28T11:54:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.359+0000 7fae2a7fc700 1 -- 172.21.15.50:0/3491777087 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae20011990 con 0x7fae2c15fa60 2023-11-28T11:54:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.359+0000 7fae2a7fc700 1 -- 172.21.15.50:0/3491777087 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20011d40 con 0x7fae2c15fa60 2023-11-28T11:54:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.359+0000 7fae31e67700 1 -- 172.21.15.50:0/3491777087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae2c15fa60 msgr2=0x7fae2c06aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.359+0000 7fae31e67700 1 --2- 172.21.15.50:0/3491777087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae2c15fa60 0x7fae2c06aa90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae20009850 tx=0x7fae20009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.359+0000 7fae31e67700 1 -- 172.21.15.50:0/3491777087 shutdown_connections 2023-11-28T11:54:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.359+0000 7fae31e67700 1 --2- 172.21.15.50:0/3491777087 >> v2:172.21.15.192:3300/0 conn(0x7fae2c0b19a0 0x7fae2c15ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.359+0000 7fae31e67700 1 --2- 172.21.15.50:0/3491777087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae2c15fa60 0x7fae2c06aa90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.359+0000 7fae31e67700 1 -- 172.21.15.50:0/3491777087 >> 172.21.15.50:0/3491777087 conn(0x7fae2c0cc290 msgr2=0x7fae2c0cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.359+0000 7fae31e67700 1 -- 172.21.15.50:0/3491777087 shutdown_connections 2023-11-28T11:54:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.359+0000 7fae31e67700 1 -- 172.21.15.50:0/3491777087 wait complete. 2023-11-28T11:54:52.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.359+0000 7fae31e67700 1 Processor -- start 2023-11-28T11:54:52.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.359+0000 7fae31e67700 1 -- start start 2023-11-28T11:54:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae31e67700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae2c0b19a0 0x7fae2c0b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae31e67700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae2c0ca110 0x7fae2c151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae31e67700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae2c15fa60 0x7fae2c0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae31e67700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c0b38e0 con 0x7fae2c0ca110 2023-11-28T11:54:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae31e67700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c152280 con 0x7fae2c0b19a0 2023-11-28T11:54:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae31e67700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c0c57e0 con 0x7fae2c15fa60 2023-11-28T11:54:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae2affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae2c0ca110 0x7fae2c151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae2affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae2c0ca110 0x7fae2c151d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58380/0 (socket says 172.21.15.50:58380) 2023-11-28T11:54:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae2b7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae2c0b19a0 0x7fae2c0b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae2affd700 1 -- 172.21.15.50:0/454702762 learned_addr learned my addr 172.21.15.50:0/454702762 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae2bfff700 1 --2- 172.21.15.50:0/454702762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae2c15fa60 0x7fae2c0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae2affd700 1 -- 172.21.15.50:0/454702762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae2c15fa60 msgr2=0x7fae2c0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:52.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae2affd700 1 --2- 172.21.15.50:0/454702762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae2c15fa60 0x7fae2c0c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae2affd700 1 -- 172.21.15.50:0/454702762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae2c0b19a0 msgr2=0x7fae2c0b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:52.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae2affd700 1 --2- 172.21.15.50:0/454702762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae2c0b19a0 0x7fae2c0b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae2affd700 1 -- 172.21.15.50:0/454702762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae24009b30 con 0x7fae2c0ca110 2023-11-28T11:54:52.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae2b7fe700 1 --2- 172.21.15.50:0/454702762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae2c0b19a0 0x7fae2c0b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:54:52.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae2affd700 1 --2- 172.21.15.50:0/454702762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae2c0ca110 0x7fae2c151d40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00c500 tx=0x7fae1c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:52.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae13fff700 1 -- 172.21.15.50:0/454702762 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c0052d0 con 0x7fae2c0ca110 2023-11-28T11:54:52.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae31e67700 1 -- 172.21.15.50:0/454702762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae200094b0 con 0x7fae2c0ca110 2023-11-28T11:54:52.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae13fff700 1 -- 172.21.15.50:0/454702762 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c005430 con 0x7fae2c0ca110 2023-11-28T11:54:52.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae31e67700 1 -- 172.21.15.50:0/454702762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2c160ce0 con 0x7fae2c0ca110 2023-11-28T11:54:52.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae13fff700 1 -- 172.21.15.50:0/454702762 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c0055a0 con 0x7fae2c0ca110 2023-11-28T11:54:52.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.363+0000 7fae31e67700 1 -- 172.21.15.50:0/454702762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2c160a00 con 0x7fae2c0ca110 2023-11-28T11:54:52.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.367+0000 7fae13fff700 1 -- 172.21.15.50:0/454702762 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fae1c019030 con 0x7fae2c0ca110 2023-11-28T11:54:52.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.367+0000 7fae13fff700 1 --2- 172.21.15.50:0/454702762 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fae18064f10 0x7fae180673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.367+0000 7fae13fff700 1 -- 172.21.15.50:0/454702762 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fae1c0814c0 con 0x7fae2c0ca110 2023-11-28T11:54:52.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.367+0000 7fae2b7fe700 1 --2- 172.21.15.50:0/454702762 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fae18064f10 0x7fae180673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.367+0000 7fae2b7fe700 1 --2- 172.21.15.50:0/454702762 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fae18064f10 0x7fae180673c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fae200090b0 tx=0x7fae2001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:52.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.371+0000 7fae13fff700 1 -- 172.21.15.50:0/454702762 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fae1c04f250 con 0x7fae2c0ca110 2023-11-28T11:54:52.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.571+0000 7fae31e67700 1 -- 172.21.15.50:0/454702762 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae2c0cdd30 con 0x7fae2c0ca110 2023-11-28T11:54:52.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.575+0000 7fae13fff700 1 -- 172.21.15.50:0/454702762 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7fae1c052870 con 0x7fae2c0ca110 2023-11-28T11:54:52.576 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:52.576 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2457318670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2457318670},{"type":"v1","addr":"172.21.15.192:6836","nonce":2457318670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3448258722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3448258722},{"type":"v1","addr":"172.21.15.192:6837","nonce":3448258722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/490368853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":490368853},{"type":"v1","addr":"172.21.15.50:6833","nonce":490368853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:53:40.797417+0000","modified":"2023-11-28T11:54:02.939902+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3764199418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3764199418},{"type":"v1","addr":"172.21.15.50:6835","nonce":3764199418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T11:54:52.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.575+0000 7fae31e67700 1 -- 172.21.15.50:0/454702762 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fae18064f10 msgr2=0x7fae180673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.575+0000 7fae31e67700 1 --2- 172.21.15.50:0/454702762 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fae18064f10 0x7fae180673c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fae200090b0 tx=0x7fae2001c040 comp rx=0 tx=0).stop 2023-11-28T11:54:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.575+0000 7fae31e67700 1 -- 172.21.15.50:0/454702762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae2c0ca110 msgr2=0x7fae2c151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.575+0000 7fae31e67700 1 --2- 172.21.15.50:0/454702762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae2c0ca110 0x7fae2c151d40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00c500 tx=0x7fae1c00c810 comp rx=0 tx=0).stop 2023-11-28T11:54:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.575+0000 7fae31e67700 1 -- 172.21.15.50:0/454702762 shutdown_connections 2023-11-28T11:54:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.575+0000 7fae31e67700 1 --2- 172.21.15.50:0/454702762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae2c15fa60 0x7fae2c0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.575+0000 7fae31e67700 1 --2- 172.21.15.50:0/454702762 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae2c0ca110 0x7fae2c151d40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.575+0000 7fae31e67700 1 --2- 172.21.15.50:0/454702762 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fae18064f10 0x7fae180673c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.575+0000 7fae31e67700 1 --2- 172.21.15.50:0/454702762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae2c0b19a0 0x7fae2c0b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.575+0000 7fae31e67700 1 -- 172.21.15.50:0/454702762 >> 172.21.15.50:0/454702762 conn(0x7fae2c0cc290 msgr2=0x7fae2c0ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:52.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.575+0000 7fae31e67700 1 -- 172.21.15.50:0/454702762 shutdown_connections 2023-11-28T11:54:52.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.575+0000 7fae31e67700 1 -- 172.21.15.50:0/454702762 wait complete. 2023-11-28T11:54:52.580 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-11-28T11:54:52.591 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:54:52.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f5885fe9700 1 Processor -- start 2023-11-28T11:54:52.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f5885fe9700 1 -- start start 2023-11-28T11:54:52.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f5885fe9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5880152bb0 0x7f588015caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f5885fe9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f588006c640 0x7f588006cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f5885fe9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5880152f80 con 0x7f58800706f0 2023-11-28T11:54:52.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f5885fe9700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588006d020 con 0x7f588006c640 2023-11-28T11:54:52.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f5885fe9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588015cfe0 con 0x7f5880152bb0 2023-11-28T11:54:52.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f587ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f588006c640 0x7f588006cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f587ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f588006c640 0x7f588006cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58392/0 (socket says 172.21.15.50:58392) 2023-11-28T11:54:52.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f587ffff700 1 -- 172.21.15.50:0/2584468185 learned_addr learned my addr 172.21.15.50:0/2584468185 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:52.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f5884fe7700 1 --2- 172.21.15.50:0/2584468185 >> v2:172.21.15.192:3300/0 conn(0x7f5880152bb0 0x7f588015caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f587ffff700 1 -- 172.21.15.50:0/2584468185 >> v2:172.21.15.192:3300/0 conn(0x7f5880152bb0 msgr2=0x7f588015caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:52.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f587ffff700 1 --2- 172.21.15.50:0/2584468185 >> v2:172.21.15.192:3300/0 conn(0x7f5880152bb0 0x7f588015caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f587ffff700 1 -- 172.21.15.50:0/2584468185 >> v1:172.21.15.192:6789/0 conn(0x7f58800706f0 legacy=0x7f5880070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:52.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f587ffff700 1 -- 172.21.15.50:0/2584468185 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5880159a30 con 0x7f588006c640 2023-11-28T11:54:52.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f587ffff700 1 --2- 172.21.15.50:0/2584468185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588006c640 0x7f588006cae0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f588006e890 tx=0x7f586c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cace6ceac16adbcd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:52.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f587f7fe700 1 -- 172.21.15.50:0/2584468185 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c00b8a0 con 0x7f588006c640 2023-11-28T11:54:52.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f587f7fe700 1 -- 172.21.15.50:0/2584468185 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c00ba00 con 0x7f588006c640 2023-11-28T11:54:52.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.707+0000 7f587f7fe700 1 -- 172.21.15.50:0/2584468185 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c00bd90 con 0x7f588006c640 2023-11-28T11:54:52.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.711+0000 7f5885fe9700 1 -- 172.21.15.50:0/2584468185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588006c640 msgr2=0x7f588006cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:52.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.711+0000 7f5885fe9700 1 --2- 172.21.15.50:0/2584468185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588006c640 0x7f588006cae0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f588006e890 tx=0x7f586c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.711+0000 7f5885fe9700 1 -- 172.21.15.50:0/2584468185 shutdown_connections 2023-11-28T11:54:52.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.711+0000 7f5885fe9700 1 --2- 172.21.15.50:0/2584468185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588006c640 0x7f588006cae0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.711+0000 7f5885fe9700 1 --2- 172.21.15.50:0/2584468185 >> v2:172.21.15.192:3300/0 conn(0x7f5880152bb0 0x7f588015caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.711+0000 7f5885fe9700 1 -- 172.21.15.50:0/2584468185 >> 172.21.15.50:0/2584468185 conn(0x7f588006e000 msgr2=0x7f58800b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:52.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.711+0000 7f5885fe9700 1 -- 172.21.15.50:0/2584468185 shutdown_connections 2023-11-28T11:54:52.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.711+0000 7f5885fe9700 1 -- 172.21.15.50:0/2584468185 wait complete. 2023-11-28T11:54:52.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5885fe9700 1 Processor -- start 2023-11-28T11:54:52.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5885fe9700 1 -- start start 2023-11-28T11:54:52.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5885fe9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588006c640 0x7f588015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5885fe9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58800706f0 0x7f58801577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5885fe9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5880152bb0 0x7f5880151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5885fe9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58801573b0 con 0x7f588006c640 2023-11-28T11:54:52.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5885fe9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5880156730 con 0x7f5880152bb0 2023-11-28T11:54:52.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5885fe9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5880156a10 con 0x7f58800706f0 2023-11-28T11:54:52.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5884fe7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588006c640 0x7f588015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5884fe7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588006c640 0x7f588015d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58408/0 (socket says 172.21.15.50:58408) 2023-11-28T11:54:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5884fe7700 1 -- 172.21.15.50:0/110086958 learned_addr learned my addr 172.21.15.50:0/110086958 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f587ffff700 1 --2- 172.21.15.50:0/110086958 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58800706f0 0x7f58801577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f58857e8700 1 --2- 172.21.15.50:0/110086958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5880152bb0 0x7f5880151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5884fe7700 1 -- 172.21.15.50:0/110086958 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58800706f0 msgr2=0x7f58801577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5884fe7700 1 --2- 172.21.15.50:0/110086958 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58800706f0 0x7f58801577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5884fe7700 1 -- 172.21.15.50:0/110086958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5880152bb0 msgr2=0x7f5880151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:52.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5884fe7700 1 --2- 172.21.15.50:0/110086958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5880152bb0 0x7f5880151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5884fe7700 1 -- 172.21.15.50:0/110086958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c009570 con 0x7f588006c640 2023-11-28T11:54:52.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f58857e8700 1 --2- 172.21.15.50:0/110086958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5880152bb0 0x7f5880151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:52.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5884fe7700 1 --2- 172.21.15.50:0/110086958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588006c640 0x7f588015d7f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f587400e810 tx=0x7f587400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:52.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f587d7fa700 1 -- 172.21.15.50:0/110086958 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874013610 con 0x7f588006c640 2023-11-28T11:54:52.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f587d7fa700 1 -- 172.21.15.50:0/110086958 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5874013770 con 0x7f588006c640 2023-11-28T11:54:52.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f587d7fa700 1 -- 172.21.15.50:0/110086958 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874013b20 con 0x7f588006c640 2023-11-28T11:54:52.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5885fe9700 1 -- 172.21.15.50:0/110086958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5880159190 con 0x7f588006c640 2023-11-28T11:54:52.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.715+0000 7f5885fe9700 1 -- 172.21.15.50:0/110086958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5880158eb0 con 0x7f588006c640 2023-11-28T11:54:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.719+0000 7f5885fe9700 1 -- 172.21.15.50:0/110086958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5880159470 con 0x7f588006c640 2023-11-28T11:54:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.719+0000 7f587d7fa700 1 -- 172.21.15.50:0/110086958 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5874023070 con 0x7f588006c640 2023-11-28T11:54:52.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.719+0000 7f587d7fa700 1 --2- 172.21.15.50:0/110086958 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5864064ee0 0x7f5864067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.719+0000 7f587d7fa700 1 -- 172.21.15.50:0/110086958 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5874081f50 con 0x7f588006c640 2023-11-28T11:54:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.719+0000 7f587ffff700 1 --2- 172.21.15.50:0/110086958 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5864064ee0 0x7f5864067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.723+0000 7f587ffff700 1 --2- 172.21.15.50:0/110086958 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5864064ee0 0x7f5864067390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f586c000c00 tx=0x7f586c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:52.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.723+0000 7f587d7fa700 1 -- 172.21.15.50:0/110086958 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f587404fc50 con 0x7f588006c640 2023-11-28T11:54:52.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.895+0000 7f5885fe9700 1 -- 172.21.15.50:0/110086958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5880066f50 con 0x7f588006c640 2023-11-28T11:54:52.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.899+0000 7f587d7fa700 1 -- 172.21.15.50:0/110086958 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19689 (secure 0 0 0) 0x7f5874053270 con 0x7f588006c640 2023-11-28T11:54:52.902 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:52.902 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:54:30.086945+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:53:38.462826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T11:53:39.778621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T11:53:42.870360+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:54:52.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.903+0000 7f5885fe9700 1 -- 172.21.15.50:0/110086958 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5864064ee0 msgr2=0x7f5864067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:52.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.903+0000 7f5885fe9700 1 --2- 172.21.15.50:0/110086958 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5864064ee0 0x7f5864067390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f586c000c00 tx=0x7f586c008030 comp rx=0 tx=0).stop 2023-11-28T11:54:52.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.903+0000 7f5885fe9700 1 -- 172.21.15.50:0/110086958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588006c640 msgr2=0x7f588015d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:52.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.903+0000 7f5885fe9700 1 --2- 172.21.15.50:0/110086958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588006c640 0x7f588015d7f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f587400e810 tx=0x7f587400eb20 comp rx=0 tx=0).stop 2023-11-28T11:54:52.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.903+0000 7f5885fe9700 1 -- 172.21.15.50:0/110086958 shutdown_connections 2023-11-28T11:54:52.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.903+0000 7f5885fe9700 1 --2- 172.21.15.50:0/110086958 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5864064ee0 0x7f5864067390 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.903+0000 7f5885fe9700 1 --2- 172.21.15.50:0/110086958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5880152bb0 0x7f5880151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.903+0000 7f5885fe9700 1 --2- 172.21.15.50:0/110086958 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58800706f0 0x7f58801577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.903+0000 7f5885fe9700 1 --2- 172.21.15.50:0/110086958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f588006c640 0x7f588015d7f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:52.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.903+0000 7f5885fe9700 1 -- 172.21.15.50:0/110086958 >> 172.21.15.50:0/110086958 conn(0x7f588006e000 msgr2=0x7f58800b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:52.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.903+0000 7f5885fe9700 1 -- 172.21.15.50:0/110086958 shutdown_connections 2023-11-28T11:54:52.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:52.903+0000 7f5885fe9700 1 -- 172.21.15.50:0/110086958 wait complete. 2023-11-28T11:54:52.917 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T11:54:53.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.031+0000 7f043759e700 1 Processor -- start 2023-11-28T11:54:53.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.031+0000 7f043759e700 1 -- start start 2023-11-28T11:54:53.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.031+0000 7f043759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0438159e70 0x7f043806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:53.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.031+0000 7f043759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043806ace0 con 0x7f04380cb470 2023-11-28T11:54:53.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.031+0000 7f043759e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043806a0d0 con 0x7f0438069c40 2023-11-28T11:54:53.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.031+0000 7f043759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043806a3b0 con 0x7f0438159e70 2023-11-28T11:54:53.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.031+0000 7f0436d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f04380cb470 0x7f04380c91d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34278/0 (socket says 172.21.15.50:34278) 2023-11-28T11:54:53.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.031+0000 7f0436d9d700 1 -- 172.21.15.50:0/1710675545 learned_addr learned my addr 172.21.15.50:0/1710675545 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:53.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.031+0000 7f043659c700 1 --2- 172.21.15.50:0/1710675545 >> v2:172.21.15.50:3300/0 conn(0x7f0438159e70 0x7f043806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:53.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.031+0000 7f043659c700 1 -- 172.21.15.50:0/1710675545 >> v1:172.21.15.192:6789/0 conn(0x7f0438069c40 legacy=0x7f04380cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:53.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.031+0000 7f0435d9b700 1 -- 172.21.15.50:0/1710675545 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194773057 0 0) 0x7f043806a0d0 con 0x7f0438069c40 2023-11-28T11:54:53.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.031+0000 7f043659c700 1 -- 172.21.15.50:0/1710675545 >> v1:172.21.15.50:6789/0 conn(0x7f04380cb470 legacy=0x7f04380c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:53.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.031+0000 7f043659c700 1 -- 172.21.15.50:0/1710675545 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043806a690 con 0x7f0438159e70 2023-11-28T11:54:53.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.035+0000 7f043659c700 1 --2- 172.21.15.50:0/1710675545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0438159e70 0x7f043806c9a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0428009850 tx=0x7f0428009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d309022a9cba0a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:53.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.035+0000 7f0435d9b700 1 -- 172.21.15.50:0/1710675545 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428011830 con 0x7f0438159e70 2023-11-28T11:54:53.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.035+0000 7f0435d9b700 1 -- 172.21.15.50:0/1710675545 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0428011990 con 0x7f0438159e70 2023-11-28T11:54:53.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.035+0000 7f0435d9b700 1 -- 172.21.15.50:0/1710675545 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428011d20 con 0x7f0438159e70 2023-11-28T11:54:53.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.035+0000 7f043759e700 1 -- 172.21.15.50:0/1710675545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0438159e70 msgr2=0x7f043806c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:53.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.035+0000 7f043759e700 1 --2- 172.21.15.50:0/1710675545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0438159e70 0x7f043806c9a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0428009850 tx=0x7f0428009b60 comp rx=0 tx=0).stop 2023-11-28T11:54:53.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.035+0000 7f043759e700 1 -- 172.21.15.50:0/1710675545 shutdown_connections 2023-11-28T11:54:53.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.035+0000 7f043759e700 1 --2- 172.21.15.50:0/1710675545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0438159e70 0x7f043806c9a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:53.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.035+0000 7f043759e700 1 -- 172.21.15.50:0/1710675545 >> 172.21.15.50:0/1710675545 conn(0x7f04380ce3e0 msgr2=0x7f04380ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:53.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.035+0000 7f043759e700 1 -- 172.21.15.50:0/1710675545 shutdown_connections 2023-11-28T11:54:53.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.035+0000 7f043759e700 1 -- 172.21.15.50:0/1710675545 wait complete. 2023-11-28T11:54:53.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.035+0000 7f043759e700 1 Processor -- start 2023-11-28T11:54:53.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.035+0000 7f043759e700 1 -- start start 2023-11-28T11:54:53.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0438069c40 0x7f04381f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:53.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04380cb470 0x7f0438158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0438071df0 0x7f043815c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04381f1a10 con 0x7f0438069c40 2023-11-28T11:54:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043759e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043815cf20 con 0x7f0438071df0 2023-11-28T11:54:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04381f1c80 con 0x7f04380cb470 2023-11-28T11:54:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0438069c40 0x7f04381f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0438069c40 0x7f04381f2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58420/0 (socket says 172.21.15.50:58420) 2023-11-28T11:54:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043659c700 1 -- 172.21.15.50:0/2634314781 learned_addr learned my addr 172.21.15.50:0/2634314781 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f042ffff700 1 --2- 172.21.15.50:0/2634314781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04380cb470 0x7f0438158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f0436d9d700 1 --2- 172.21.15.50:0/2634314781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0438071df0 0x7f043815c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043659c700 1 -- 172.21.15.50:0/2634314781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04380cb470 msgr2=0x7f0438158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:53.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043659c700 1 --2- 172.21.15.50:0/2634314781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04380cb470 0x7f0438158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043659c700 1 -- 172.21.15.50:0/2634314781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0438071df0 msgr2=0x7f043815c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043659c700 1 --2- 172.21.15.50:0/2634314781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0438071df0 0x7f043815c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043659c700 1 -- 172.21.15.50:0/2634314781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04280094b0 con 0x7f0438069c40 2023-11-28T11:54:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043659c700 1 --2- 172.21.15.50:0/2634314781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0438069c40 0x7f04381f2480 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0428009fd0 tx=0x7f0428004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f042effd700 1 -- 172.21.15.50:0/2634314781 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042800bd80 con 0x7f0438069c40 2023-11-28T11:54:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f042effd700 1 -- 172.21.15.50:0/2634314781 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042801f070 con 0x7f0438069c40 2023-11-28T11:54:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043759e700 1 -- 172.21.15.50:0/2634314781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043815a240 con 0x7f0438069c40 2023-11-28T11:54:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f042effd700 1 -- 172.21.15.50:0/2634314781 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042801a670 con 0x7f0438069c40 2023-11-28T11:54:53.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043759e700 1 -- 172.21.15.50:0/2634314781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043806a970 con 0x7f0438069c40 2023-11-28T11:54:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f043759e700 1 -- 172.21.15.50:0/2634314781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043806cea0 con 0x7f0438069c40 2023-11-28T11:54:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.039+0000 7f042effd700 1 -- 172.21.15.50:0/2634314781 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f042800f050 con 0x7f0438069c40 2023-11-28T11:54:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.043+0000 7f042effd700 1 --2- 172.21.15.50:0/2634314781 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f041c064ee0 0x7f041c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.043+0000 7f042effd700 1 -- 172.21.15.50:0/2634314781 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0428021070 con 0x7f0438069c40 2023-11-28T11:54:53.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.043+0000 7f042ffff700 1 --2- 172.21.15.50:0/2634314781 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f041c064ee0 0x7f041c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:53.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.043+0000 7f042ffff700 1 --2- 172.21.15.50:0/2634314781 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f041c064ee0 0x7f041c067390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f04380c1400 tx=0x7f0420009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.051+0000 7f042effd700 1 -- 172.21.15.50:0/2634314781 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0428051840 con 0x7f0438069c40 2023-11-28T11:54:53.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:53.247+0000 7f043759e700 1 -- 172.21.15.50:0/2634314781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f04381f2170 con 0x7f0438069c40 2023-11-28T11:54:54.210 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-11-28T11:54:54.207+0000 7f6bcfbc1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T11:54:54.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.215+0000 7f042effd700 1 -- 172.21.15.50:0/2634314781 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0428054e60 con 0x7f0438069c40 2023-11-28T11:54:54.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.219+0000 7f043759e700 1 -- 172.21.15.50:0/2634314781 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f041c064ee0 msgr2=0x7f041c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:54.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.219+0000 7f043759e700 1 --2- 172.21.15.50:0/2634314781 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f041c064ee0 0x7f041c067390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f04380c1400 tx=0x7f0420009040 comp rx=0 tx=0).stop 2023-11-28T11:54:54.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.219+0000 7f043759e700 1 -- 172.21.15.50:0/2634314781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0438069c40 msgr2=0x7f04381f2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.219+0000 7f043759e700 1 --2- 172.21.15.50:0/2634314781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0438069c40 0x7f04381f2480 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0428009fd0 tx=0x7f0428004770 comp rx=0 tx=0).stop 2023-11-28T11:54:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.223+0000 7f043759e700 1 -- 172.21.15.50:0/2634314781 shutdown_connections 2023-11-28T11:54:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.223+0000 7f043759e700 1 --2- 172.21.15.50:0/2634314781 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f041c064ee0 0x7f041c067390 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.223+0000 7f043759e700 1 --2- 172.21.15.50:0/2634314781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0438071df0 0x7f043815c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.223+0000 7f043759e700 1 --2- 172.21.15.50:0/2634314781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04380cb470 0x7f0438158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.223+0000 7f043759e700 1 --2- 172.21.15.50:0/2634314781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0438069c40 0x7f04381f2480 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.223+0000 7f043759e700 1 -- 172.21.15.50:0/2634314781 >> 172.21.15.50:0/2634314781 conn(0x7f04380ce3e0 msgr2=0x7f04380ac3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.223+0000 7f043759e700 1 -- 172.21.15.50:0/2634314781 shutdown_connections 2023-11-28T11:54:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.223+0000 7f043759e700 1 -- 172.21.15.50:0/2634314781 wait complete. 2023-11-28T11:54:54.225 INFO:tasks.ceph.mds.c.smithi050.stderr: -4232> 2023-11-28T11:53:46.497+0000 7fab8c263700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:54:54.226 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T11:54:54.242 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T11:54:54.260 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-11-28T11:54:54.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.351+0000 7fcc5df20700 1 Processor -- start 2023-11-28T11:54:54.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.351+0000 7fcc5df20700 1 -- start start 2023-11-28T11:54:54.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.351+0000 7fcc5df20700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc580cce60 0x7fcc580cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:54.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.351+0000 7fcc5df20700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc580cd2e0 con 0x7fcc580d31b0 2023-11-28T11:54:54.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.351+0000 7fcc5df20700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc580d00c0 con 0x7fcc5806ce60 2023-11-28T11:54:54.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.351+0000 7fcc5df20700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc580d3650 con 0x7fcc580cce60 2023-11-28T11:54:54.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.351+0000 7fcc57fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcc580d31b0 0x7fcc580cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34302/0 (socket says 172.21.15.50:34302) 2023-11-28T11:54:54.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.351+0000 7fcc57fff700 1 -- 172.21.15.50:0/2079086602 learned_addr learned my addr 172.21.15.50:0/2079086602 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:54.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.351+0000 7fcc5d71f700 1 --2- 172.21.15.50:0/2079086602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc580cce60 0x7fcc580cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:54.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.351+0000 7fcc577fe700 1 -- 172.21.15.50:0/2079086602 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420458563 0 0) 0x7fcc580d00c0 con 0x7fcc5806ce60 2023-11-28T11:54:54.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.351+0000 7fcc577fe700 1 -- 172.21.15.50:0/2079086602 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc400035d0 con 0x7fcc5806ce60 2023-11-28T11:54:54.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.351+0000 7fcc577fe700 1 -- 172.21.15.50:0/2079086602 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767481864 0 0) 0x7fcc580cd2e0 con 0x7fcc580d31b0 2023-11-28T11:54:54.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.351+0000 7fcc577fe700 1 -- 172.21.15.50:0/2079086602 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc580d00c0 con 0x7fcc580d31b0 2023-11-28T11:54:54.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.351+0000 7fcc5d71f700 1 -- 172.21.15.50:0/2079086602 >> v1:172.21.15.192:6789/0 conn(0x7fcc5806ce60 legacy=0x7fcc5806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:54.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.351+0000 7fcc5d71f700 1 -- 172.21.15.50:0/2079086602 >> v1:172.21.15.50:6789/0 conn(0x7fcc580d31b0 legacy=0x7fcc580cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:54.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.351+0000 7fcc5d71f700 1 -- 172.21.15.50:0/2079086602 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5806a7f0 con 0x7fcc580cce60 2023-11-28T11:54:54.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.355+0000 7fcc5d71f700 1 --2- 172.21.15.50:0/2079086602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc580cce60 0x7fcc580cfb80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcc480098b0 tx=0x7fcc48009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f11ee6ba8303eae0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:54.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.355+0000 7fcc577fe700 1 -- 172.21.15.50:0/2079086602 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc48011830 con 0x7fcc580cce60 2023-11-28T11:54:54.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.355+0000 7fcc577fe700 1 -- 172.21.15.50:0/2079086602 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc48011990 con 0x7fcc580cce60 2023-11-28T11:54:54.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.355+0000 7fcc577fe700 1 -- 172.21.15.50:0/2079086602 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc48011d20 con 0x7fcc580cce60 2023-11-28T11:54:54.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.355+0000 7fcc5df20700 1 -- 172.21.15.50:0/2079086602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc580cce60 msgr2=0x7fcc580cfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:54.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.355+0000 7fcc5df20700 1 --2- 172.21.15.50:0/2079086602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc580cce60 0x7fcc580cfb80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcc480098b0 tx=0x7fcc48009bc0 comp rx=0 tx=0).stop 2023-11-28T11:54:54.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.355+0000 7fcc5df20700 1 -- 172.21.15.50:0/2079086602 shutdown_connections 2023-11-28T11:54:54.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.355+0000 7fcc5df20700 1 --2- 172.21.15.50:0/2079086602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc580cce60 0x7fcc580cfb80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:54.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.355+0000 7fcc5df20700 1 -- 172.21.15.50:0/2079086602 >> 172.21.15.50:0/2079086602 conn(0x7fcc580b5760 msgr2=0x7fcc580b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:54.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.355+0000 7fcc5df20700 1 -- 172.21.15.50:0/2079086602 shutdown_connections 2023-11-28T11:54:54.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.355+0000 7fcc5df20700 1 -- 172.21.15.50:0/2079086602 wait complete. 2023-11-28T11:54:54.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.355+0000 7fcc5df20700 1 Processor -- start 2023-11-28T11:54:54.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.355+0000 7fcc5df20700 1 -- start start 2023-11-28T11:54:54.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5df20700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc5806ce60 0x7fcc580b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:54.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5df20700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc580cce60 0x7fcc580c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:54.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5df20700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc580d31b0 0x7fcc581f1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:54.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5df20700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc580b51b0 con 0x7fcc5806ce60 2023-11-28T11:54:54.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5df20700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc580b3eb0 con 0x7fcc580cce60 2023-11-28T11:54:54.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5df20700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc580b4190 con 0x7fcc580d31b0 2023-11-28T11:54:54.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5cf1e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc5806ce60 0x7fcc580b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:54.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5cf1e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc5806ce60 0x7fcc580b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58442/0 (socket says 172.21.15.50:58442) 2023-11-28T11:54:54.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5cf1e700 1 -- 172.21.15.50:0/3143762030 learned_addr learned my addr 172.21.15.50:0/3143762030 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:54.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc57fff700 1 --2- 172.21.15.50:0/3143762030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc580cce60 0x7fcc580c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:54.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5cf1e700 1 -- 172.21.15.50:0/3143762030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc580d31b0 msgr2=0x7fcc581f1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:54.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5d71f700 1 --2- 172.21.15.50:0/3143762030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc580d31b0 0x7fcc581f1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:54.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5cf1e700 1 --2- 172.21.15.50:0/3143762030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc580d31b0 0x7fcc581f1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:54.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5cf1e700 1 -- 172.21.15.50:0/3143762030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc580cce60 msgr2=0x7fcc580c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:54.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5cf1e700 1 --2- 172.21.15.50:0/3143762030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc580cce60 0x7fcc580c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:54.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5cf1e700 1 -- 172.21.15.50:0/3143762030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc480094b0 con 0x7fcc5806ce60 2023-11-28T11:54:54.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc57fff700 1 --2- 172.21.15.50:0/3143762030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc580cce60 0x7fcc580c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:54:54.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5d71f700 1 --2- 172.21.15.50:0/3143762030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc580d31b0 0x7fcc581f1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:54:54.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5cf1e700 1 --2- 172.21.15.50:0/3143762030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc5806ce60 0x7fcc580b4c70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000cc20 tx=0x7fcc5000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:54.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc557fa700 1 -- 172.21.15.50:0/3143762030 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50003c20 con 0x7fcc5806ce60 2023-11-28T11:54:54.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc557fa700 1 -- 172.21.15.50:0/3143762030 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc50003d80 con 0x7fcc5806ce60 2023-11-28T11:54:54.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5df20700 1 -- 172.21.15.50:0/3143762030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5806adb0 con 0x7fcc5806ce60 2023-11-28T11:54:54.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc557fa700 1 -- 172.21.15.50:0/3143762030 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5000ac40 con 0x7fcc5806ce60 2023-11-28T11:54:54.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5df20700 1 -- 172.21.15.50:0/3143762030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5806aad0 con 0x7fcc5806ce60 2023-11-28T11:54:54.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.359+0000 7fcc5df20700 1 -- 172.21.15.50:0/3143762030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5806b090 con 0x7fcc5806ce60 2023-11-28T11:54:54.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.363+0000 7fcc557fa700 1 -- 172.21.15.50:0/3143762030 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcc50010050 con 0x7fcc5806ce60 2023-11-28T11:54:54.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.363+0000 7fcc557fa700 1 --2- 172.21.15.50:0/3143762030 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcc44064ee0 0x7fcc44067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:54.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.363+0000 7fcc557fa700 1 -- 172.21.15.50:0/3143762030 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fcc50082cb0 con 0x7fcc5806ce60 2023-11-28T11:54:54.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.363+0000 7fcc57fff700 1 --2- 172.21.15.50:0/3143762030 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcc44064ee0 0x7fcc44067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:54.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.363+0000 7fcc57fff700 1 --2- 172.21.15.50:0/3143762030 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcc44064ee0 0x7fcc44067390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcc5815fe20 tx=0x7fcc4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:54.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.367+0000 7fcc557fa700 1 -- 172.21.15.50:0/3143762030 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcc50050b70 con 0x7fcc5806ce60 2023-11-28T11:54:54.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:54.567+0000 7fcc5df20700 1 -- 172.21.15.50:0/3143762030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcc58072c20 con 0x7fcc5806ce60 2023-11-28T11:54:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.231+0000 7fcc557fa700 1 -- 172.21.15.50:0/3143762030 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcc50054190 con 0x7fcc5806ce60 2023-11-28T11:54:55.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.235+0000 7fcc5df20700 1 -- 172.21.15.50:0/3143762030 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcc44064ee0 msgr2=0x7fcc44067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:55.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.235+0000 7fcc5df20700 1 --2- 172.21.15.50:0/3143762030 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcc44064ee0 0x7fcc44067390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcc5815fe20 tx=0x7fcc4c009040 comp rx=0 tx=0).stop 2023-11-28T11:54:55.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.235+0000 7fcc5df20700 1 -- 172.21.15.50:0/3143762030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc5806ce60 msgr2=0x7fcc580b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:55.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.235+0000 7fcc5df20700 1 --2- 172.21.15.50:0/3143762030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc5806ce60 0x7fcc580b4c70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000cc20 tx=0x7fcc5000a060 comp rx=0 tx=0).stop 2023-11-28T11:54:55.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.235+0000 7fcc5df20700 1 -- 172.21.15.50:0/3143762030 shutdown_connections 2023-11-28T11:54:55.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.235+0000 7fcc5df20700 1 --2- 172.21.15.50:0/3143762030 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc580d31b0 0x7fcc581f1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:55.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.235+0000 7fcc5df20700 1 --2- 172.21.15.50:0/3143762030 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcc44064ee0 0x7fcc44067390 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:55.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.235+0000 7fcc5df20700 1 --2- 172.21.15.50:0/3143762030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc580cce60 0x7fcc580c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:55.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.235+0000 7fcc5df20700 1 --2- 172.21.15.50:0/3143762030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc5806ce60 0x7fcc580b4c70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:55.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.235+0000 7fcc5df20700 1 -- 172.21.15.50:0/3143762030 >> 172.21.15.50:0/3143762030 conn(0x7fcc580b5760 msgr2=0x7fcc5815bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:55.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.235+0000 7fcc5df20700 1 -- 172.21.15.50:0/3143762030 shutdown_connections 2023-11-28T11:54:55.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.235+0000 7fcc5df20700 1 -- 172.21.15.50:0/3143762030 wait complete. 2023-11-28T11:54:55.253 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T11:54:55.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.371+0000 7f3180832700 1 Processor -- start 2023-11-28T11:54:55.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.371+0000 7f3180832700 1 -- start start 2023-11-28T11:54:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.371+0000 7f3180832700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f317c0ce750 0x7f317c06b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.371+0000 7f3180832700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f317c0cdaf0 0x7f317c06ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.371+0000 7f3180832700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317c06e7e0 con 0x7f317c06f1b0 2023-11-28T11:54:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.371+0000 7f3180832700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317c1593c0 con 0x7f317c0ce750 2023-11-28T11:54:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.371+0000 7f3180832700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317c06bf30 con 0x7f317c0cdaf0 2023-11-28T11:54:55.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.371+0000 7f317ad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f317c0ce750 0x7f317c06b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:55.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.371+0000 7f317ad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f317c0ce750 0x7f317c06b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58452/0 (socket says 172.21.15.50:58452) 2023-11-28T11:54:55.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.371+0000 7f317ad9d700 1 -- 172.21.15.50:0/1365548152 learned_addr learned my addr 172.21.15.50:0/1365548152 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:55.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.371+0000 7f317a59c700 1 --2- 172.21.15.50:0/1365548152 >> v2:172.21.15.192:3300/0 conn(0x7f317c0cdaf0 0x7f317c06ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:55.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f317ad9d700 1 -- 172.21.15.50:0/1365548152 >> v2:172.21.15.192:3300/0 conn(0x7f317c0cdaf0 msgr2=0x7f317c06ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:55.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f317ad9d700 1 --2- 172.21.15.50:0/1365548152 >> v2:172.21.15.192:3300/0 conn(0x7f317c0cdaf0 0x7f317c06ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:55.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f317ad9d700 1 -- 172.21.15.50:0/1365548152 >> v1:172.21.15.50:6789/0 conn(0x7f317c06f1b0 legacy=0x7f317c070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:55.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f317ad9d700 1 -- 172.21.15.50:0/1365548152 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c06c210 con 0x7f317c0ce750 2023-11-28T11:54:55.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f317a59c700 1 --2- 172.21.15.50:0/1365548152 >> v2:172.21.15.192:3300/0 conn(0x7f317c0cdaf0 0x7f317c06ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:54:55.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f317ad9d700 1 --2- 172.21.15.50:0/1365548152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f317c0ce750 0x7f317c06b5e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f317c0d01e0 tx=0x7f316c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c4eb22f93f8c2f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:55.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f3179d9b700 1 -- 172.21.15.50:0/1365548152 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c00b8a0 con 0x7f317c0ce750 2023-11-28T11:54:55.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f3179d9b700 1 -- 172.21.15.50:0/1365548152 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316c00ba00 con 0x7f317c0ce750 2023-11-28T11:54:55.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f3179d9b700 1 -- 172.21.15.50:0/1365548152 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c00bd90 con 0x7f317c0ce750 2023-11-28T11:54:55.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f3180832700 1 -- 172.21.15.50:0/1365548152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f317c0ce750 msgr2=0x7f317c06b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:55.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f3180832700 1 --2- 172.21.15.50:0/1365548152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f317c0ce750 0x7f317c06b5e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f317c0d01e0 tx=0x7f316c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:54:55.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f3180832700 1 -- 172.21.15.50:0/1365548152 shutdown_connections 2023-11-28T11:54:55.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f3180832700 1 --2- 172.21.15.50:0/1365548152 >> v2:172.21.15.192:3300/0 conn(0x7f317c0cdaf0 0x7f317c06ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:55.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f3180832700 1 --2- 172.21.15.50:0/1365548152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f317c0ce750 0x7f317c06b5e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:55.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f3180832700 1 -- 172.21.15.50:0/1365548152 >> 172.21.15.50:0/1365548152 conn(0x7f317c0cf5e0 msgr2=0x7f317c0cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:55.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f3180832700 1 -- 172.21.15.50:0/1365548152 shutdown_connections 2023-11-28T11:54:55.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f3180832700 1 -- 172.21.15.50:0/1365548152 wait complete. 2023-11-28T11:54:55.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f3180832700 1 Processor -- start 2023-11-28T11:54:55.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.375+0000 7f3180832700 1 -- start start 2023-11-28T11:54:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f3180832700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f317c06f1b0 0x7f317c0c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f3180832700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f317c0cdaf0 0x7f317c0c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:55.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f3180832700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f317c0ce750 0x7f317c155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:55.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f3180832700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c0c4730 con 0x7f317c0cdaf0 2023-11-28T11:54:55.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f3180832700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c156230 con 0x7f317c0ce750 2023-11-28T11:54:55.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f3180832700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317c0c7990 con 0x7f317c06f1b0 2023-11-28T11:54:55.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f317a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f317c0cdaf0 0x7f317c0c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:55.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f317a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f317c0cdaf0 0x7f317c0c41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58468/0 (socket says 172.21.15.50:58468) 2023-11-28T11:54:55.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f317a59c700 1 -- 172.21.15.50:0/2261587329 learned_addr learned my addr 172.21.15.50:0/2261587329 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:55.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f317b59e700 1 --2- 172.21.15.50:0/2261587329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f317c0ce750 0x7f317c155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:55.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f317ad9d700 1 --2- 172.21.15.50:0/2261587329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f317c06f1b0 0x7f317c0c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:55.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f317a59c700 1 -- 172.21.15.50:0/2261587329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f317c06f1b0 msgr2=0x7f317c0c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:55.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f317a59c700 1 --2- 172.21.15.50:0/2261587329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f317c06f1b0 0x7f317c0c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:55.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f317a59c700 1 -- 172.21.15.50:0/2261587329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f317c0ce750 msgr2=0x7f317c155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:55.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f317a59c700 1 --2- 172.21.15.50:0/2261587329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f317c0ce750 0x7f317c155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:55.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f317a59c700 1 -- 172.21.15.50:0/2261587329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c009570 con 0x7f317c0cdaf0 2023-11-28T11:54:55.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f317b59e700 1 --2- 172.21.15.50:0/2261587329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f317c0ce750 0x7f317c155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:55.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f317ad9d700 1 --2- 172.21.15.50:0/2261587329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f317c06f1b0 0x7f317c0c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:54:55.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f317a59c700 1 --2- 172.21.15.50:0/2261587329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f317c0cdaf0 0x7f317c0c41f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f317000c820 tx=0x7f317000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:55.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f31637fe700 1 -- 172.21.15.50:0/2261587329 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3170004220 con 0x7f317c0cdaf0 2023-11-28T11:54:55.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f31637fe700 1 -- 172.21.15.50:0/2261587329 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3170004380 con 0x7f317c0cdaf0 2023-11-28T11:54:55.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f31637fe700 1 -- 172.21.15.50:0/2261587329 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31700036c0 con 0x7f317c0cdaf0 2023-11-28T11:54:55.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f3180832700 1 -- 172.21.15.50:0/2261587329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317c06e470 con 0x7f317c0cdaf0 2023-11-28T11:54:55.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f3180832700 1 -- 172.21.15.50:0/2261587329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317c06c4f0 con 0x7f317c0cdaf0 2023-11-28T11:54:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.379+0000 7f3180832700 1 -- 172.21.15.50:0/2261587329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317c06bb20 con 0x7f317c0cdaf0 2023-11-28T11:54:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.383+0000 7f31637fe700 1 -- 172.21.15.50:0/2261587329 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3170020070 con 0x7f317c0cdaf0 2023-11-28T11:54:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.383+0000 7f31637fe700 1 --2- 172.21.15.50:0/2261587329 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3168064ee0 0x7f3168067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.383+0000 7f31637fe700 1 -- 172.21.15.50:0/2261587329 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f3170082480 con 0x7f317c0cdaf0 2023-11-28T11:54:55.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.383+0000 7f317ad9d700 1 --2- 172.21.15.50:0/2261587329 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3168064ee0 0x7f3168067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:55.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.383+0000 7f317ad9d700 1 --2- 172.21.15.50:0/2261587329 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3168064ee0 0x7f3168067390 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f316c014040 tx=0x7f316c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:55.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.387+0000 7f31637fe700 1 -- 172.21.15.50:0/2261587329 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f31700501b0 con 0x7f317c0cdaf0 2023-11-28T11:54:55.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:55.551+0000 7f3180832700 1 -- 172.21.15.50:0/2261587329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f317c0676e0 con 0x7f317c0cdaf0 2023-11-28T11:54:56.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.279+0000 7f31637fe700 1 -- 172.21.15.50:0/2261587329 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f31700537d0 con 0x7f317c0cdaf0 2023-11-28T11:54:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.283+0000 7f3180832700 1 -- 172.21.15.50:0/2261587329 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3168064ee0 msgr2=0x7f3168067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:56.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.283+0000 7f3180832700 1 --2- 172.21.15.50:0/2261587329 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3168064ee0 0x7f3168067390 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f316c014040 tx=0x7f316c008030 comp rx=0 tx=0).stop 2023-11-28T11:54:56.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.283+0000 7f3180832700 1 -- 172.21.15.50:0/2261587329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f317c0cdaf0 msgr2=0x7f317c0c41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:56.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.283+0000 7f3180832700 1 --2- 172.21.15.50:0/2261587329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f317c0cdaf0 0x7f317c0c41f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f317000c820 tx=0x7f317000cbe0 comp rx=0 tx=0).stop 2023-11-28T11:54:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.283+0000 7f3180832700 1 -- 172.21.15.50:0/2261587329 shutdown_connections 2023-11-28T11:54:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.283+0000 7f3180832700 1 --2- 172.21.15.50:0/2261587329 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3168064ee0 0x7f3168067390 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.283+0000 7f3180832700 1 --2- 172.21.15.50:0/2261587329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f317c0ce750 0x7f317c155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.283+0000 7f3180832700 1 --2- 172.21.15.50:0/2261587329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f317c0cdaf0 0x7f317c0c41f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.283+0000 7f3180832700 1 --2- 172.21.15.50:0/2261587329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f317c06f1b0 0x7f317c0c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.283+0000 7f3180832700 1 -- 172.21.15.50:0/2261587329 >> 172.21.15.50:0/2261587329 conn(0x7f317c0cf5e0 msgr2=0x7f317c06a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.287+0000 7f3180832700 1 -- 172.21.15.50:0/2261587329 shutdown_connections 2023-11-28T11:54:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.287+0000 7f3180832700 1 -- 172.21.15.50:0/2261587329 wait complete. 2023-11-28T11:54:56.289 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-11-28T11:54:56.306 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T11:54:56.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.431+0000 7f1c22a9e700 1 Processor -- start 2023-11-28T11:54:56.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.431+0000 7f1c22a9e700 1 -- start start 2023-11-28T11:54:56.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c22a9e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c1c0d2eb0 0x7f1c1c0d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:56.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c22a9e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c0cf0b0 con 0x7f1c1c06d8e0 2023-11-28T11:54:56.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c22a9e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c0cfc30 con 0x7f1c1c0b1eb0 2023-11-28T11:54:56.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c22a9e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c15c6a0 con 0x7f1c1c0d2eb0 2023-11-28T11:54:56.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c2129b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1c1c06d8e0 0x7f1c1c06a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34320/0 (socket says 172.21.15.50:34320) 2023-11-28T11:54:56.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c2129b700 1 -- 172.21.15.50:0/520019058 learned_addr learned my addr 172.21.15.50:0/520019058 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:56.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c2229d700 1 --2- 172.21.15.50:0/520019058 >> v2:172.21.15.50:3300/0 conn(0x7f1c1c0d2eb0 0x7f1c1c0d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:56.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c2229d700 1 -- 172.21.15.50:0/520019058 >> v1:172.21.15.192:6789/0 conn(0x7f1c1c0b1eb0 legacy=0x7f1c1c0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:56.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c2229d700 1 -- 172.21.15.50:0/520019058 >> v1:172.21.15.50:6789/0 conn(0x7f1c1c06d8e0 legacy=0x7f1c1c06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:56.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c2229d700 1 -- 172.21.15.50:0/520019058 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c0cf300 con 0x7f1c1c0d2eb0 2023-11-28T11:54:56.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c2229d700 1 --2- 172.21.15.50:0/520019058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c0d2eb0 0x7f1c1c0d1c70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009d90 tx=0x7f1c1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7222d276d308c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:56.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c20a9a700 1 -- 172.21.15.50:0/520019058 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1400e070 con 0x7f1c1c0d2eb0 2023-11-28T11:54:56.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c20a9a700 1 -- 172.21.15.50:0/520019058 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1400bbd0 con 0x7f1c1c0d2eb0 2023-11-28T11:54:56.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c20a9a700 1 -- 172.21.15.50:0/520019058 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14012430 con 0x7f1c1c0d2eb0 2023-11-28T11:54:56.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c22a9e700 1 -- 172.21.15.50:0/520019058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c0d2eb0 msgr2=0x7f1c1c0d1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:56.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c22a9e700 1 --2- 172.21.15.50:0/520019058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c0d2eb0 0x7f1c1c0d1c70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009d90 tx=0x7f1c1400b330 comp rx=0 tx=0).stop 2023-11-28T11:54:56.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c22a9e700 1 -- 172.21.15.50:0/520019058 shutdown_connections 2023-11-28T11:54:56.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c22a9e700 1 --2- 172.21.15.50:0/520019058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c0d2eb0 0x7f1c1c0d1c70 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:56.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c22a9e700 1 -- 172.21.15.50:0/520019058 >> 172.21.15.50:0/520019058 conn(0x7f1c1c09bbb0 msgr2=0x7f1c1c0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:56.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c22a9e700 1 -- 172.21.15.50:0/520019058 shutdown_connections 2023-11-28T11:54:56.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.435+0000 7f1c22a9e700 1 -- 172.21.15.50:0/520019058 wait complete. 2023-11-28T11:54:56.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.439+0000 7f1c22a9e700 1 Processor -- start 2023-11-28T11:54:56.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.439+0000 7f1c22a9e700 1 -- start start 2023-11-28T11:54:56.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.439+0000 7f1c22a9e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c1c06d8e0 0x7f1c1c1f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:56.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.439+0000 7f1c22a9e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c1c0d2eb0 0x7f1c1c0c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.439+0000 7f1c22a9e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c1f28d0 0x7f1c1c0af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.439+0000 7f1c22a9e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c1f4b30 con 0x7f1c1c1f28d0 2023-11-28T11:54:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.439+0000 7f1c22a9e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0c7e30 con 0x7f1c1c06d8e0 2023-11-28T11:54:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.439+0000 7f1c22a9e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0c7b00 con 0x7f1c1c0d2eb0 2023-11-28T11:54:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.439+0000 7f1c2229d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c1f28d0 0x7f1c1c0af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.439+0000 7f1c2229d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c1f28d0 0x7f1c1c0af830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58478/0 (socket says 172.21.15.50:58478) 2023-11-28T11:54:56.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.439+0000 7f1c2229d700 1 -- 172.21.15.50:0/3727462903 learned_addr learned my addr 172.21.15.50:0/3727462903 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:56.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.439+0000 7f1c21a9c700 1 --2- 172.21.15.50:0/3727462903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c1c06d8e0 0x7f1c1c1f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:56.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.439+0000 7f1c2129b700 1 --2- 172.21.15.50:0/3727462903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c1c0d2eb0 0x7f1c1c0c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:56.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.443+0000 7f1c2229d700 1 -- 172.21.15.50:0/3727462903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c1c0d2eb0 msgr2=0x7f1c1c0c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:56.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.443+0000 7f1c2229d700 1 --2- 172.21.15.50:0/3727462903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c1c0d2eb0 0x7f1c1c0c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:56.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.443+0000 7f1c2229d700 1 -- 172.21.15.50:0/3727462903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c1c06d8e0 msgr2=0x7f1c1c1f45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:56.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.443+0000 7f1c2229d700 1 --2- 172.21.15.50:0/3727462903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c1c06d8e0 0x7f1c1c1f45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:56.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.443+0000 7f1c2229d700 1 -- 172.21.15.50:0/3727462903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c14009a70 con 0x7f1c1c1f28d0 2023-11-28T11:54:56.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.443+0000 7f1c2229d700 1 --2- 172.21.15.50:0/3727462903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c1f28d0 0x7f1c1c0af830 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1c14014040 tx=0x7f1c14004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:56.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.443+0000 7f1c127fc700 1 -- 172.21.15.50:0/3727462903 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14012d20 con 0x7f1c1c1f28d0 2023-11-28T11:54:56.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.443+0000 7f1c127fc700 1 -- 172.21.15.50:0/3727462903 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c14020070 con 0x7f1c1c1f28d0 2023-11-28T11:54:56.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.443+0000 7f1c22a9e700 1 -- 172.21.15.50:0/3727462903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c0cf8c0 con 0x7f1c1c1f28d0 2023-11-28T11:54:56.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.443+0000 7f1c127fc700 1 -- 172.21.15.50:0/3727462903 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14012ea0 con 0x7f1c1c1f28d0 2023-11-28T11:54:56.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.443+0000 7f1c22a9e700 1 -- 172.21.15.50:0/3727462903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c0cf5e0 con 0x7f1c1c1f28d0 2023-11-28T11:54:56.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.443+0000 7f1c22a9e700 1 -- 172.21.15.50:0/3727462903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c0d2310 con 0x7f1c1c1f28d0 2023-11-28T11:54:56.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.443+0000 7f1c127fc700 1 -- 172.21.15.50:0/3727462903 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1c14004280 con 0x7f1c1c1f28d0 2023-11-28T11:54:56.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.447+0000 7f1c127fc700 1 --2- 172.21.15.50:0/3727462903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c00064f10 0x7f1c000673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:56.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.447+0000 7f1c127fc700 1 -- 172.21.15.50:0/3727462903 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f1c14022070 con 0x7f1c1c1f28d0 2023-11-28T11:54:56.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.447+0000 7f1c21a9c700 1 --2- 172.21.15.50:0/3727462903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c00064f10 0x7f1c000673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:56.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.447+0000 7f1c21a9c700 1 --2- 172.21.15.50:0/3727462903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c00064f10 0x7f1c000673c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1c18000f60 tx=0x7f1c18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:56.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.451+0000 7f1c127fc700 1 -- 172.21.15.50:0/3727462903 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1c14052470 con 0x7f1c1c1f28d0 2023-11-28T11:54:56.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:56.611+0000 7f1c22a9e700 1 -- 172.21.15.50:0/3727462903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1c1c072c20 con 0x7f1c1c1f28d0 2023-11-28T11:54:57.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.283+0000 7f1c127fc700 1 -- 172.21.15.50:0/3727462903 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1c14055a90 con 0x7f1c1c1f28d0 2023-11-28T11:54:57.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.287+0000 7f1c22a9e700 1 -- 172.21.15.50:0/3727462903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c00064f10 msgr2=0x7f1c000673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:57.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.287+0000 7f1c22a9e700 1 --2- 172.21.15.50:0/3727462903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c00064f10 0x7f1c000673c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1c18000f60 tx=0x7f1c18009040 comp rx=0 tx=0).stop 2023-11-28T11:54:57.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.287+0000 7f1c22a9e700 1 -- 172.21.15.50:0/3727462903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c1f28d0 msgr2=0x7f1c1c0af830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:57.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.287+0000 7f1c22a9e700 1 --2- 172.21.15.50:0/3727462903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c1f28d0 0x7f1c1c0af830 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1c14014040 tx=0x7f1c14004af0 comp rx=0 tx=0).stop 2023-11-28T11:54:57.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.287+0000 7f1c22a9e700 1 -- 172.21.15.50:0/3727462903 shutdown_connections 2023-11-28T11:54:57.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.287+0000 7f1c22a9e700 1 --2- 172.21.15.50:0/3727462903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c1c1f28d0 0x7f1c1c0af830 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:57.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.287+0000 7f1c22a9e700 1 --2- 172.21.15.50:0/3727462903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c1c0d2eb0 0x7f1c1c0c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:57.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.287+0000 7f1c22a9e700 1 --2- 172.21.15.50:0/3727462903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c00064f10 0x7f1c000673c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:57.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.287+0000 7f1c22a9e700 1 --2- 172.21.15.50:0/3727462903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c1c06d8e0 0x7f1c1c1f45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:57.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.287+0000 7f1c22a9e700 1 -- 172.21.15.50:0/3727462903 >> 172.21.15.50:0/3727462903 conn(0x7f1c1c09bbb0 msgr2=0x7f1c1c15bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:57.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.287+0000 7f1c22a9e700 1 -- 172.21.15.50:0/3727462903 shutdown_connections 2023-11-28T11:54:57.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.287+0000 7f1c22a9e700 1 -- 172.21.15.50:0/3727462903 wait complete. 2023-11-28T11:54:57.295 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-11-28T11:54:57.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-11-28T11:54:57.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.423+0000 7f5cc5fb7700 1 Processor -- start 2023-11-28T11:54:57.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.423+0000 7f5cc5fb7700 1 -- start start 2023-11-28T11:54:57.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc5fb7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5cc00b8240 0x7f5cc00cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:57.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc5fb7700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc00d0460 con 0x7f5cc006ce60 2023-11-28T11:54:57.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc5fb7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc00d2380 con 0x7f5cc00d1e30 2023-11-28T11:54:57.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc5fb7700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc00d3390 con 0x7f5cc00b8240 2023-11-28T11:54:57.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc4fb5700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5cc006ce60 0x7f5cc006d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34334/0 (socket says 172.21.15.50:34334) 2023-11-28T11:54:57.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc4fb5700 1 -- 172.21.15.50:0/3738842992 learned_addr learned my addr 172.21.15.50:0/3738842992 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:54:57.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc57b6700 1 --2- 172.21.15.50:0/3738842992 >> v2:172.21.15.50:3300/0 conn(0x7f5cc00b8240 0x7f5cc00cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:57.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc57b6700 1 -- 172.21.15.50:0/3738842992 >> v1:172.21.15.192:6789/0 conn(0x7f5cc00d1e30 legacy=0x7f5cc00cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:57.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc57b6700 1 -- 172.21.15.50:0/3738842992 >> v1:172.21.15.50:6789/0 conn(0x7f5cc006ce60 legacy=0x7f5cc006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:57.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc57b6700 1 -- 172.21.15.50:0/3738842992 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc00d2f00 con 0x7f5cc00b8240 2023-11-28T11:54:57.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cbf7fe700 1 -- 172.21.15.50:0/3738842992 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392663700 0 0) 0x7f5cc00d0460 con 0x7f5cc006ce60 2023-11-28T11:54:57.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc57b6700 1 --2- 172.21.15.50:0/3738842992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc00b8240 0x7f5cc00cf820 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009d90 tx=0x7f5cb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1470aff5929dd415 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:57.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cbf7fe700 1 -- 172.21.15.50:0/3738842992 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb800e070 con 0x7f5cc00b8240 2023-11-28T11:54:57.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cbf7fe700 1 -- 172.21.15.50:0/3738842992 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb800bbd0 con 0x7f5cc00b8240 2023-11-28T11:54:57.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cbf7fe700 1 -- 172.21.15.50:0/3738842992 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8012430 con 0x7f5cc00b8240 2023-11-28T11:54:57.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc5fb7700 1 -- 172.21.15.50:0/3738842992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc00b8240 msgr2=0x7f5cc00cf820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:57.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc5fb7700 1 --2- 172.21.15.50:0/3738842992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc00b8240 0x7f5cc00cf820 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009d90 tx=0x7f5cb800b330 comp rx=0 tx=0).stop 2023-11-28T11:54:57.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc5fb7700 1 -- 172.21.15.50:0/3738842992 shutdown_connections 2023-11-28T11:54:57.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc5fb7700 1 --2- 172.21.15.50:0/3738842992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc00b8240 0x7f5cc00cf820 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:57.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc5fb7700 1 -- 172.21.15.50:0/3738842992 >> 172.21.15.50:0/3738842992 conn(0x7f5cc009bbd0 msgr2=0x7f5cc00b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:57.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc5fb7700 1 -- 172.21.15.50:0/3738842992 shutdown_connections 2023-11-28T11:54:57.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.427+0000 7f5cc5fb7700 1 -- 172.21.15.50:0/3738842992 wait complete. 2023-11-28T11:54:57.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cc5fb7700 1 Processor -- start 2023-11-28T11:54:57.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cc5fb7700 1 -- start start 2023-11-28T11:54:57.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cc5fb7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cc006ce60 0x7f5cc00c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:57.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cc5fb7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc00b8240 0x7f5cc015e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:57.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cc5fb7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cc00d1e30 0x7f5cc01e5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:57.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cc5fb7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc0159060 con 0x7f5cc00b8240 2023-11-28T11:54:57.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cc5fb7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc01592b0 con 0x7f5cc00d1e30 2023-11-28T11:54:57.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cc5fb7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc0159590 con 0x7f5cc006ce60 2023-11-28T11:54:57.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cbffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc00b8240 0x7f5cc015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:57.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cbffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc00b8240 0x7f5cc015e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58490/0 (socket says 172.21.15.50:58490) 2023-11-28T11:54:57.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cbffff700 1 -- 172.21.15.50:0/108982263 learned_addr learned my addr 172.21.15.50:0/108982263 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:57.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cc57b6700 1 --2- 172.21.15.50:0/108982263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cc00d1e30 0x7f5cc01e5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:57.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cc4fb5700 1 --2- 172.21.15.50:0/108982263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cc006ce60 0x7f5cc00c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:57.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cbffff700 1 -- 172.21.15.50:0/108982263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cc006ce60 msgr2=0x7f5cc00c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:57.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cbffff700 1 --2- 172.21.15.50:0/108982263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cc006ce60 0x7f5cc00c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:57.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cbffff700 1 -- 172.21.15.50:0/108982263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cc00d1e30 msgr2=0x7f5cc01e5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:57.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cbffff700 1 --2- 172.21.15.50:0/108982263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cc00d1e30 0x7f5cc01e5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:57.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cbffff700 1 -- 172.21.15.50:0/108982263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb8009a70 con 0x7f5cc00b8240 2023-11-28T11:54:57.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.431+0000 7f5cbffff700 1 --2- 172.21.15.50:0/108982263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc00b8240 0x7f5cc015e030 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000c500 tx=0x7f5cb000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:57.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.435+0000 7f5cbd7fa700 1 -- 172.21.15.50:0/108982263 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00052d0 con 0x7f5cc00b8240 2023-11-28T11:54:57.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.435+0000 7f5cbd7fa700 1 -- 172.21.15.50:0/108982263 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb0005430 con 0x7f5cc00b8240 2023-11-28T11:54:57.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.435+0000 7f5cbd7fa700 1 -- 172.21.15.50:0/108982263 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00055a0 con 0x7f5cc00b8240 2023-11-28T11:54:57.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.435+0000 7f5cc5fb7700 1 -- 172.21.15.50:0/108982263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc015c700 con 0x7f5cc00b8240 2023-11-28T11:54:57.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.435+0000 7f5cc5fb7700 1 -- 172.21.15.50:0/108982263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc00b8680 con 0x7f5cc00b8240 2023-11-28T11:54:57.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.435+0000 7f5cc5fb7700 1 -- 172.21.15.50:0/108982263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc00d25d0 con 0x7f5cc00b8240 2023-11-28T11:54:57.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.435+0000 7f5cbd7fa700 1 -- 172.21.15.50:0/108982263 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5cb0019030 con 0x7f5cc00b8240 2023-11-28T11:54:57.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.435+0000 7f5cbd7fa700 1 --2- 172.21.15.50:0/108982263 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5cac064f10 0x7f5cac0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:57.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.439+0000 7f5cbd7fa700 1 -- 172.21.15.50:0/108982263 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f5cb00810d0 con 0x7f5cc00b8240 2023-11-28T11:54:57.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.439+0000 7f5cc4fb5700 1 --2- 172.21.15.50:0/108982263 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5cac064f10 0x7f5cac0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:57.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.439+0000 7f5cc4fb5700 1 --2- 172.21.15.50:0/108982263 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5cac064f10 0x7f5cac0673c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4007b30 tx=0x7f5cb4007a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:57.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.447+0000 7f5cbd7fa700 1 -- 172.21.15.50:0/108982263 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5cb004f200 con 0x7f5cc00b8240 2023-11-28T11:54:57.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:57.615+0000 7f5cc5fb7700 1 -- 172.21.15.50:0/108982263 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5cc0072500 con 0x7f5cc00b8240 2023-11-28T11:54:58.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.307+0000 7f5cbd7fa700 1 -- 172.21.15.50:0/108982263 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f5cb0052820 con 0x7f5cc00b8240 2023-11-28T11:54:58.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.315+0000 7f5cc5fb7700 1 -- 172.21.15.50:0/108982263 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5cac064f10 msgr2=0x7f5cac0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:58.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.315+0000 7f5cc5fb7700 1 --2- 172.21.15.50:0/108982263 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5cac064f10 0x7f5cac0673c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4007b30 tx=0x7f5cb4007a80 comp rx=0 tx=0).stop 2023-11-28T11:54:58.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.315+0000 7f5cc5fb7700 1 -- 172.21.15.50:0/108982263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc00b8240 msgr2=0x7f5cc015e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:58.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.315+0000 7f5cc5fb7700 1 --2- 172.21.15.50:0/108982263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc00b8240 0x7f5cc015e030 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000c500 tx=0x7f5cb000c810 comp rx=0 tx=0).stop 2023-11-28T11:54:58.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.315+0000 7f5cc5fb7700 1 -- 172.21.15.50:0/108982263 shutdown_connections 2023-11-28T11:54:58.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.315+0000 7f5cc5fb7700 1 --2- 172.21.15.50:0/108982263 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5cac064f10 0x7f5cac0673c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:58.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.315+0000 7f5cc5fb7700 1 --2- 172.21.15.50:0/108982263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cc00d1e30 0x7f5cc01e5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:58.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.315+0000 7f5cc5fb7700 1 --2- 172.21.15.50:0/108982263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cc00b8240 0x7f5cc015e030 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:58.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.315+0000 7f5cc5fb7700 1 --2- 172.21.15.50:0/108982263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cc006ce60 0x7f5cc00c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:58.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.315+0000 7f5cc5fb7700 1 -- 172.21.15.50:0/108982263 >> 172.21.15.50:0/108982263 conn(0x7f5cc009bbd0 msgr2=0x7f5cc00b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:58.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.315+0000 7f5cc5fb7700 1 -- 172.21.15.50:0/108982263 shutdown_connections 2023-11-28T11:54:58.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.315+0000 7f5cc5fb7700 1 -- 172.21.15.50:0/108982263 wait complete. 2023-11-28T11:54:58.319 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data_ec' removed 2023-11-28T11:54:58.335 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T11:54:58.335 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T11:54:58.335 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T11:54:58.335 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:54:58.336 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T11:54:58.336 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T11:54:58.336 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T11:54:58.336 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:54:58.336 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T11:54:58.336 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T11:54:58.337 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T11:54:58.337 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:54:58.337 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T11:54:58.337 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T11:54:58.337 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T11:54:58.337 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:54:58.347 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T11:54:58.347 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T11:54:58.349 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T11:54:58.349 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T11:54:58.350 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T11:54:58.350 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T11:54:58.351 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T11:54:58.351 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T11:54:58.352 INFO:tasks.ceph.mds.c:Started 2023-11-28T11:54:58.352 DEBUG:teuthology.parallel:result is None 2023-11-28T11:54:58.353 INFO:tasks.ceph.mds.a:Started 2023-11-28T11:54:58.353 DEBUG:teuthology.parallel:result is None 2023-11-28T11:54:58.392 INFO:tasks.ceph.mds.b:Started 2023-11-28T11:54:58.392 DEBUG:teuthology.parallel:result is None 2023-11-28T11:54:58.392 INFO:tasks.ceph.mds.d:Started 2023-11-28T11:54:58.393 DEBUG:teuthology.parallel:result is None 2023-11-28T11:54:58.393 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T11:54:58.424 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-11-28T11:54:58.435 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-11-28T11:54:58.471 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-11-28T11:54:58.474 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-11-28T11:54:58.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.523+0000 7f52ca56e700 1 Processor -- start 2023-11-28T11:54:58.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.523+0000 7f52ca56e700 1 -- start start 2023-11-28T11:54:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52ca56e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c4160700 0x7f52c40b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52ca56e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52c40cced0 0x7f52c40cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52ca56e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c40cc520 con 0x7f52c41617d0 2023-11-28T11:54:58.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52ca56e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c40b1360 con 0x7f52c40cced0 2023-11-28T11:54:58.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52ca56e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40b1170 con 0x7f52c4160700 2023-11-28T11:54:58.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52c8b0b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52c40cced0 0x7f52c40cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:58.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52c8b0b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52c40cced0 0x7f52c40cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58532/0 (socket says 172.21.15.50:58532) 2023-11-28T11:54:58.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52c8b0b700 1 -- 172.21.15.50:0/2391266660 learned_addr learned my addr 172.21.15.50:0/2391266660 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:58.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52c3fff700 1 --2- 172.21.15.50:0/2391266660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c4160700 0x7f52c40b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:58.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52c8b0b700 1 -- 172.21.15.50:0/2391266660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c4160700 msgr2=0x7f52c40b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:58.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52c8b0b700 1 --2- 172.21.15.50:0/2391266660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c4160700 0x7f52c40b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:58.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52c8b0b700 1 -- 172.21.15.50:0/2391266660 >> v1:172.21.15.192:6789/0 conn(0x7f52c41617d0 legacy=0x7f52c40c9750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T11:54:58.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52c8b0b700 1 -- 172.21.15.50:0/2391266660 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c40cc800 con 0x7f52c40cced0 2023-11-28T11:54:58.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52c8b0b700 1 --2- 172.21.15.50:0/2391266660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c40cced0 0x7f52c40cd350 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009e50 tx=0x7f52bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e41da4ed1e6911 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:58.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52c2ffd700 1 -- 172.21.15.50:0/2391266660 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc00e070 con 0x7f52c40cced0 2023-11-28T11:54:58.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52c2ffd700 1 -- 172.21.15.50:0/2391266660 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc003a40 con 0x7f52c40cced0 2023-11-28T11:54:58.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52c2ffd700 1 -- 172.21.15.50:0/2391266660 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc003df0 con 0x7f52c40cced0 2023-11-28T11:54:58.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52ca56e700 1 -- 172.21.15.50:0/2391266660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c40cced0 msgr2=0x7f52c40cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:58.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52ca56e700 1 --2- 172.21.15.50:0/2391266660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c40cced0 0x7f52c40cd350 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009e50 tx=0x7f52bc00b330 comp rx=0 tx=0).stop 2023-11-28T11:54:58.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52ca56e700 1 -- 172.21.15.50:0/2391266660 shutdown_connections 2023-11-28T11:54:58.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52ca56e700 1 --2- 172.21.15.50:0/2391266660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c40cced0 0x7f52c40cd350 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:58.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52ca56e700 1 --2- 172.21.15.50:0/2391266660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c4160700 0x7f52c40b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:58.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52ca56e700 1 -- 172.21.15.50:0/2391266660 >> 172.21.15.50:0/2391266660 conn(0x7f52c406caf0 msgr2=0x7f52c40ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:58.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52ca56e700 1 -- 172.21.15.50:0/2391266660 shutdown_connections 2023-11-28T11:54:58.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.527+0000 7f52ca56e700 1 -- 172.21.15.50:0/2391266660 wait complete. 2023-11-28T11:54:58.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52ca56e700 1 Processor -- start 2023-11-28T11:54:58.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52ca56e700 1 -- start start 2023-11-28T11:54:58.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52ca56e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c40cced0 0x7f52c41f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:58.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52ca56e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52c4160700 0x7f52c41fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:58.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52ca56e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c41617d0 0x7f52c41fa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:58.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52ca56e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40c8330 con 0x7f52c41617d0 2023-11-28T11:54:58.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52ca56e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40b4190 con 0x7f52c4160700 2023-11-28T11:54:58.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52ca56e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40b4470 con 0x7f52c40cced0 2023-11-28T11:54:58.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52c8b0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c41617d0 0x7f52c41fa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:58.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52c8b0b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c41617d0 0x7f52c41fa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58536/0 (socket says 172.21.15.50:58536) 2023-11-28T11:54:58.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52c8b0b700 1 -- 172.21.15.50:0/1657604909 learned_addr learned my addr 172.21.15.50:0/1657604909 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:58.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52c3fff700 1 --2- 172.21.15.50:0/1657604909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c40cced0 0x7f52c41f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:58.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52c37fe700 1 --2- 172.21.15.50:0/1657604909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52c4160700 0x7f52c41fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:58.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52c3fff700 1 -- 172.21.15.50:0/1657604909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52c4160700 msgr2=0x7f52c41fa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:58.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52c3fff700 1 --2- 172.21.15.50:0/1657604909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52c4160700 0x7f52c41fa1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:58.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52c3fff700 1 -- 172.21.15.50:0/1657604909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c41617d0 msgr2=0x7f52c41fa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:58.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52c3fff700 1 --2- 172.21.15.50:0/1657604909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c41617d0 0x7f52c41fa6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:58.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52c3fff700 1 -- 172.21.15.50:0/1657604909 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc009b30 con 0x7f52c40cced0 2023-11-28T11:54:58.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.531+0000 7f52c3fff700 1 --2- 172.21.15.50:0/1657604909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c40cced0 0x7f52c41f9c60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f52b800c7f0 tx=0x7f52b800cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:58.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.535+0000 7f52c0ff9700 1 -- 172.21.15.50:0/1657604909 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8011800 con 0x7f52c40cced0 2023-11-28T11:54:58.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.535+0000 7f52c0ff9700 1 -- 172.21.15.50:0/1657604909 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b8011960 con 0x7f52c40cced0 2023-11-28T11:54:58.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.535+0000 7f52ca56e700 1 -- 172.21.15.50:0/1657604909 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c4160ad0 con 0x7f52c40cced0 2023-11-28T11:54:58.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.535+0000 7f52ca56e700 1 -- 172.21.15.50:0/1657604909 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c4161c20 con 0x7f52c40cced0 2023-11-28T11:54:58.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.535+0000 7f52c0ff9700 1 -- 172.21.15.50:0/1657604909 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8011cd0 con 0x7f52c40cced0 2023-11-28T11:54:58.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.535+0000 7f52c0ff9700 1 -- 172.21.15.50:0/1657604909 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f52b8017030 con 0x7f52c40cced0 2023-11-28T11:54:58.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.535+0000 7f52ca56e700 1 -- 172.21.15.50:0/1657604909 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a4005310 con 0x7f52c40cced0 2023-11-28T11:54:58.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.535+0000 7f52c0ff9700 1 --2- 172.21.15.50:0/1657604909 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f52b0064ee0 0x7f52b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:58.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.535+0000 7f52c0ff9700 1 -- 172.21.15.50:0/1657604909 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f52b8081710 con 0x7f52c40cced0 2023-11-28T11:54:58.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.535+0000 7f52c37fe700 1 --2- 172.21.15.50:0/1657604909 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f52b0064ee0 0x7f52b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:58.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.535+0000 7f52c37fe700 1 --2- 172.21.15.50:0/1657604909 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f52b0064ee0 0x7f52b0067390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f52c40cf3c0 tx=0x7f52b40090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.543+0000 7f52c0ff9700 1 -- 172.21.15.50:0/1657604909 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f52b804f9f0 con 0x7f52c40cced0 2023-11-28T11:54:58.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:58.711+0000 7f52ca56e700 1 -- 172.21.15.50:0/1657604909 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f52a4005b40 con 0x7f52c40cced0 2023-11-28T11:54:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.515+0000 7f52c0ff9700 1 -- 172.21.15.50:0/1657604909 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7f52b8053010 con 0x7f52c40cced0 2023-11-28T11:54:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.519+0000 7f52ca56e700 1 -- 172.21.15.50:0/1657604909 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f52b0064ee0 msgr2=0x7f52b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.519+0000 7f52ca56e700 1 --2- 172.21.15.50:0/1657604909 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f52b0064ee0 0x7f52b0067390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f52c40cf3c0 tx=0x7f52b40090e0 comp rx=0 tx=0).stop 2023-11-28T11:54:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.519+0000 7f52ca56e700 1 -- 172.21.15.50:0/1657604909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c40cced0 msgr2=0x7f52c41f9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.519+0000 7f52ca56e700 1 --2- 172.21.15.50:0/1657604909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c40cced0 0x7f52c41f9c60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f52b800c7f0 tx=0x7f52b800cb00 comp rx=0 tx=0).stop 2023-11-28T11:54:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.519+0000 7f52ca56e700 1 -- 172.21.15.50:0/1657604909 shutdown_connections 2023-11-28T11:54:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.519+0000 7f52ca56e700 1 --2- 172.21.15.50:0/1657604909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52c41617d0 0x7f52c41fa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.519+0000 7f52ca56e700 1 --2- 172.21.15.50:0/1657604909 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f52b0064ee0 0x7f52b0067390 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.519+0000 7f52ca56e700 1 --2- 172.21.15.50:0/1657604909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52c4160700 0x7f52c41fa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.519+0000 7f52ca56e700 1 --2- 172.21.15.50:0/1657604909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52c40cced0 0x7f52c41f9c60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.519+0000 7f52ca56e700 1 -- 172.21.15.50:0/1657604909 >> 172.21.15.50:0/1657604909 conn(0x7f52c406caf0 msgr2=0x7f52c4160cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.519+0000 7f52ca56e700 1 -- 172.21.15.50:0/1657604909 shutdown_connections 2023-11-28T11:54:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.519+0000 7f52ca56e700 1 -- 172.21.15.50:0/1657604909 wait complete. 2023-11-28T11:54:59.524 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-11-28T11:54:59.538 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T11:54:59.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.707+0000 7f360ad1a700 1 Processor -- start 2023-11-28T11:54:59.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.707+0000 7f360ad1a700 1 -- start start 2023-11-28T11:54:59.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f360ad1a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3604153420 0x7f36040c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:59.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f360ad1a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f360415cb50 0x7f360415cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:59.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f360ad1a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36040cad30 con 0x7f36041537f0 2023-11-28T11:54:59.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f360ad1a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36040cdda0 con 0x7f360415cb50 2023-11-28T11:54:59.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f360ad1a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360415d510 con 0x7f3604153420 2023-11-28T11:54:59.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f36092b7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f360415cb50 0x7f360415cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:59.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f36092b7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f360415cb50 0x7f360415cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58544/0 (socket says 172.21.15.50:58544) 2023-11-28T11:54:59.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f36092b7700 1 -- 172.21.15.50:0/2612858267 learned_addr learned my addr 172.21.15.50:0/2612858267 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:59.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f3608ab6700 1 --2- 172.21.15.50:0/2612858267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3604153420 0x7f36040c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:59.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f36092b7700 1 -- 172.21.15.50:0/2612858267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3604153420 msgr2=0x7f36040c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:59.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f36092b7700 1 --2- 172.21.15.50:0/2612858267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3604153420 0x7f36040c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:59.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f36092b7700 1 -- 172.21.15.50:0/2612858267 >> v1:172.21.15.192:6789/0 conn(0x7f36041537f0 legacy=0x7f36040ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:54:59.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f36092b7700 1 -- 172.21.15.50:0/2612858267 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36040b0cd0 con 0x7f360415cb50 2023-11-28T11:54:59.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f3608ab6700 1 --2- 172.21.15.50:0/2612858267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3604153420 0x7f36040c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:54:59.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f36092b7700 1 --2- 172.21.15.50:0/2612858267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f360415cb50 0x7f360415cfd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00d150 tx=0x7f35fc00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136a24bbed7b27e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:59.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f36037fe700 1 -- 172.21.15.50:0/2612858267 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc010070 con 0x7f360415cb50 2023-11-28T11:54:59.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f36037fe700 1 -- 172.21.15.50:0/2612858267 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc00dd80 con 0x7f360415cb50 2023-11-28T11:54:59.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f36037fe700 1 -- 172.21.15.50:0/2612858267 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc00b310 con 0x7f360415cb50 2023-11-28T11:54:59.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f360ad1a700 1 -- 172.21.15.50:0/2612858267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f360415cb50 msgr2=0x7f360415cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:59.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f360ad1a700 1 --2- 172.21.15.50:0/2612858267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f360415cb50 0x7f360415cfd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00d150 tx=0x7f35fc00d460 comp rx=0 tx=0).stop 2023-11-28T11:54:59.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f360ad1a700 1 -- 172.21.15.50:0/2612858267 shutdown_connections 2023-11-28T11:54:59.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f360ad1a700 1 --2- 172.21.15.50:0/2612858267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f360415cb50 0x7f360415cfd0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:59.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f360ad1a700 1 --2- 172.21.15.50:0/2612858267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3604153420 0x7f36040c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:59.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f360ad1a700 1 -- 172.21.15.50:0/2612858267 >> 172.21.15.50:0/2612858267 conn(0x7f360406caf0 msgr2=0x7f36040ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:59.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f360ad1a700 1 -- 172.21.15.50:0/2612858267 shutdown_connections 2023-11-28T11:54:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.711+0000 7f360ad1a700 1 -- 172.21.15.50:0/2612858267 wait complete. 2023-11-28T11:54:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f360ad1a700 1 Processor -- start 2023-11-28T11:54:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f360ad1a700 1 -- start start 2023-11-28T11:54:59.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f360ad1a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3604153420 0x7f36040c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:59.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f360ad1a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36041537f0 0x7f360413f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:59.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f360ad1a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f360415cb50 0x7f36040c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:59.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f360ad1a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36041ed680 con 0x7f36041537f0 2023-11-28T11:54:59.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f360ad1a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36040c5f10 con 0x7f3604153420 2023-11-28T11:54:59.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f360ad1a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360413f790 con 0x7f360415cb50 2023-11-28T11:54:59.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f3603fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36041537f0 0x7f360413f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f3603fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36041537f0 0x7f360413f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58558/0 (socket says 172.21.15.50:58558) 2023-11-28T11:54:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f3603fff700 1 -- 172.21.15.50:0/804946903 learned_addr learned my addr 172.21.15.50:0/804946903 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:54:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f36092b7700 1 --2- 172.21.15.50:0/804946903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f360415cb50 0x7f36040c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f3608ab6700 1 --2- 172.21.15.50:0/804946903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3604153420 0x7f36040c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f3603fff700 1 -- 172.21.15.50:0/804946903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f360415cb50 msgr2=0x7f36040c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f3603fff700 1 --2- 172.21.15.50:0/804946903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f360415cb50 0x7f36040c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f3603fff700 1 -- 172.21.15.50:0/804946903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3604153420 msgr2=0x7f36040c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f3603fff700 1 --2- 172.21.15.50:0/804946903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3604153420 0x7f36040c5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f3603fff700 1 -- 172.21.15.50:0/804946903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc00bd40 con 0x7f36041537f0 2023-11-28T11:54:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f3603fff700 1 --2- 172.21.15.50:0/804946903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36041537f0 0x7f360413f250 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c4e0 tx=0x7f35f400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f36017fa700 1 -- 172.21.15.50:0/804946903 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4011790 con 0x7f36041537f0 2023-11-28T11:54:59.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f36017fa700 1 -- 172.21.15.50:0/804946903 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f4011910 con 0x7f36041537f0 2023-11-28T11:54:59.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f36017fa700 1 -- 172.21.15.50:0/804946903 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4011cc0 con 0x7f36041537f0 2023-11-28T11:54:59.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f360ad1a700 1 -- 172.21.15.50:0/804946903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36040b0f70 con 0x7f36041537f0 2023-11-28T11:54:59.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.715+0000 7f360ad1a700 1 -- 172.21.15.50:0/804946903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36040caa00 con 0x7f36041537f0 2023-11-28T11:54:59.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.719+0000 7f360ad1a700 1 -- 172.21.15.50:0/804946903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36040b1250 con 0x7f36041537f0 2023-11-28T11:54:59.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.719+0000 7f36017fa700 1 -- 172.21.15.50:0/804946903 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f35f4010050 con 0x7f36041537f0 2023-11-28T11:54:59.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.719+0000 7f36017fa700 1 --2- 172.21.15.50:0/804946903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f35e4064ee0 0x7f35e4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:54:59.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.719+0000 7f36017fa700 1 -- 172.21.15.50:0/804946903 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f35f4081950 con 0x7f36041537f0 2023-11-28T11:54:59.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.719+0000 7f3608ab6700 1 --2- 172.21.15.50:0/804946903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f35e4064ee0 0x7f35e4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:54:59.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.719+0000 7f3608ab6700 1 --2- 172.21.15.50:0/804946903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f35e4064ee0 0x7f35e4067390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f35ec006fd0 tx=0x7f35ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:54:59.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.727+0000 7f36017fa700 1 -- 172.21.15.50:0/804946903 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f35f404fd00 con 0x7f36041537f0 2023-11-28T11:54:59.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.951+0000 7f360ad1a700 1 -- 172.21.15.50:0/804946903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f360406ae50 con 0x7f36041537f0 2023-11-28T11:54:59.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.955+0000 7f36017fa700 1 -- 172.21.15.50:0/804946903 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f35f4053320 con 0x7f36041537f0 2023-11-28T11:54:59.956 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:54:59.956 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:54:59.956 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-11-28T11:54:59.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-11-28T11:54:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlxEENEhAA6uZF6YtncUs7dCDzIg5HbQ==", 2023-11-28T11:54:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:54:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-11-28T11:54:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-11-28T11:54:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:54:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-11-28T11:54:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlI0OKHBAADvJfgEbXc9Afy6aG4gVoXA==", 2023-11-28T11:54:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:54:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-11-28T11:54:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-11-28T11:54:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:54:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-11-28T11:54:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVl6ny0FRAAQgysr6oovp/2rDO2QIMXzw==", 2023-11-28T11:54:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:54:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-11-28T11:54:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-11-28T11:54:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:54:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-11-28T11:54:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlWutSIBAALVMWVV7ccbh3GllfVc1p3Q==", 2023-11-28T11:54:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:54:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-11-28T11:54:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-11-28T11:54:59.960 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:54:59.960 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.960 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-11-28T11:54:59.960 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCG1GVl1DHxHBAAMp735odHBA/poSyyfvSYpQ==", 2023-11-28T11:54:59.960 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.960 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:54:59.960 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:54:59.960 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:54:59.960 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-11-28T11:54:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCJ1GVlxoqwIBAAnUjVFlMfRBksZ6XYz47T9Q==", 2023-11-28T11:54:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:54:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:54:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:54:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-11-28T11:54:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCM1GVlRf7iKBAAxyR/SK4psHpRinUXgEFWVQ==", 2023-11-28T11:54:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:54:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:54:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:54:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-11-28T11:54:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCP1GVlsV/wKxAAvVIJRCRq4uLf16aZE9Y7vw==", 2023-11-28T11:54:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:54:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:54:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:54:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-11-28T11:54:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCV1GVlTQT5DhAAx8BnPWKTw75FEfwY4QW1eg==", 2023-11-28T11:54:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:54:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:54:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:54:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-11-28T11:54:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCY1GVlYiehJBAA9fB7aokSkcuqUIrdCT4AVQ==", 2023-11-28T11:54:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:54:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:54:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:54:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-11-28T11:54:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCb1GVlx8AcKRAAyyFUzBGKYgqFZTCjrzWfTQ==", 2023-11-28T11:54:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:54:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:54:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:54:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-11-28T11:54:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCe1GVl8dJlLRAA3CbH6oyPSGBufsdUzrNqqg==", 2023-11-28T11:54:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:54:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:54:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:54:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-11-28T11:54:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlGwP8IxAAH+0SIBXHi15FUfxG3kL6CQ==", 2023-11-28T11:54:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:54:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-11-28T11:54:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-11-28T11:54:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-11-28T11:54:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-11-28T11:54:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlBPqBLRAA5NUjqXl9G+lXnEItcBKO0Q==", 2023-11-28T11:54:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:54:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-11-28T11:54:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-11-28T11:54:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-11-28T11:54:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-11-28T11:54:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlXn7/KRAAEPpLgrFMHsa7/ok0jPzaAw==", 2023-11-28T11:54:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:54:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-11-28T11:54:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-11-28T11:54:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-11-28T11:54:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-11-28T11:54:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVly52uMBAAkzwG3hsY3hpSoc6tEbzs/w==", 2023-11-28T11:54:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:54:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-11-28T11:54:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-11-28T11:54:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-11-28T11:54:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-11-28T11:54:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCE1GVlpGE5ORAAfnfy5U/jVTM4qlLvSzOG1A==", 2023-11-28T11:54:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-11-28T11:54:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-11-28T11:54:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-11-28T11:54:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:54:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-mds", 2023-11-28T11:54:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCz1GVlpJkjAxAAQQb6urSdSahL+SgPPphW6g==", 2023-11-28T11:54:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-mds" 2023-11-28T11:54:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-mgr", 2023-11-28T11:54:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCz1GVlSbojAxAAanTDY4NW6OOVQlv90d3Vnw==", 2023-11-28T11:54:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-28T11:54:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-osd", 2023-11-28T11:54:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCz1GVl9dIjAxAAUIUwsg9PcLWWKjHIqA9Sfw==", 2023-11-28T11:54:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-osd" 2023-11-28T11:54:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rbd", 2023-11-28T11:54:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCz1GVlIOwjAxAAtcTTwLtb1Acz4OF5woxzrw==", 2023-11-28T11:54:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-28T11:54:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-28T11:54:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCz1GVlyQMkAxAAxzNV6D1pMqh9t8ofp31MSg==", 2023-11-28T11:54:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-28T11:54:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rgw", 2023-11-28T11:54:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCz1GVlGBwkAxAA5G7DznTP8N1LIM0uJzC/vQ==", 2023-11-28T11:54:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-28T11:54:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-11-28T11:54:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlGibYDRAAkIMRzwJqRzmiXvmizp2vBA==", 2023-11-28T11:54:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-11-28T11:54:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-11-28T11:54:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:54:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:54:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:54:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-11-28T11:54:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlkx3HChAAps/lgazBLgFHSJJI81Zstg==", 2023-11-28T11:54:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:54:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-11-28T11:54:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-11-28T11:54:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:54:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:54:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-11-28T11:54:59.975 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:54:59.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.955+0000 7f360ad1a700 1 -- 172.21.15.50:0/804946903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f35e4064ee0 msgr2=0x7f35e4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:59.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.955+0000 7f360ad1a700 1 --2- 172.21.15.50:0/804946903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f35e4064ee0 0x7f35e4067390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f35ec006fd0 tx=0x7f35ec008040 comp rx=0 tx=0).stop 2023-11-28T11:54:59.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.955+0000 7f360ad1a700 1 -- 172.21.15.50:0/804946903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36041537f0 msgr2=0x7f360413f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:54:59.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.955+0000 7f360ad1a700 1 --2- 172.21.15.50:0/804946903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36041537f0 0x7f360413f250 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c4e0 tx=0x7f35f400c8a0 comp rx=0 tx=0).stop 2023-11-28T11:54:59.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.955+0000 7f360ad1a700 1 -- 172.21.15.50:0/804946903 shutdown_connections 2023-11-28T11:54:59.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.955+0000 7f360ad1a700 1 --2- 172.21.15.50:0/804946903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f360415cb50 0x7f36040c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:59.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.955+0000 7f360ad1a700 1 --2- 172.21.15.50:0/804946903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36041537f0 0x7f360413f250 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:59.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.955+0000 7f360ad1a700 1 --2- 172.21.15.50:0/804946903 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f35e4064ee0 0x7f35e4067390 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:59.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.955+0000 7f360ad1a700 1 --2- 172.21.15.50:0/804946903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3604153420 0x7f36040c5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:54:59.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.955+0000 7f360ad1a700 1 -- 172.21.15.50:0/804946903 >> 172.21.15.50:0/804946903 conn(0x7f360406caf0 msgr2=0x7f36040c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:54:59.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.955+0000 7f360ad1a700 1 -- 172.21.15.50:0/804946903 shutdown_connections 2023-11-28T11:54:59.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:54:59.955+0000 7f360ad1a700 1 -- 172.21.15.50:0/804946903 wait complete. 2023-11-28T11:54:59.978 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-28T11:55:00.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.091+0000 7f4787888700 1 Processor -- start 2023-11-28T11:55:00.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.091+0000 7f4787888700 1 -- start start 2023-11-28T11:55:00.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4787888700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f47801510d0 0x7f478015b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4787888700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4780069c40 0x7f47800b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4787888700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47800c98a0 0x7f47800c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4787888700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47800c95d0 con 0x7f47800c98a0 2023-11-28T11:55:00.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4787888700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47800c8e00 con 0x7f47801510d0 2023-11-28T11:55:00.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4787888700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47800ca200 con 0x7f4780069c40 2023-11-28T11:55:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4785e25700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47800c98a0 0x7f47800c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4785e25700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47800c98a0 0x7f47800c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58566/0 (socket says 172.21.15.50:58566) 2023-11-28T11:55:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4785e25700 1 -- 172.21.15.50:0/2761691558 learned_addr learned my addr 172.21.15.50:0/2761691558 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4785624700 1 --2- 172.21.15.50:0/2761691558 >> v2:172.21.15.192:3300/0 conn(0x7f47801510d0 0x7f478015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4784e23700 1 --2- 172.21.15.50:0/2761691558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4780069c40 0x7f47800b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4785e25700 1 -- 172.21.15.50:0/2761691558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4780069c40 msgr2=0x7f47800b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4785e25700 1 --2- 172.21.15.50:0/2761691558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4780069c40 0x7f47800b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4785e25700 1 -- 172.21.15.50:0/2761691558 >> v2:172.21.15.192:3300/0 conn(0x7f47801510d0 msgr2=0x7f478015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4785e25700 1 --2- 172.21.15.50:0/2761691558 >> v2:172.21.15.192:3300/0 conn(0x7f47801510d0 0x7f478015b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4785e25700 1 -- 172.21.15.50:0/2761691558 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47800b1170 con 0x7f47800c98a0 2023-11-28T11:55:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4785624700 1 --2- 172.21.15.50:0/2761691558 >> v2:172.21.15.192:3300/0 conn(0x7f47801510d0 0x7f478015b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:00.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4785e25700 1 --2- 172.21.15.50:0/2761691558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47800c98a0 0x7f47800c9cc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f47800cf8b0 tx=0x7f477800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ddedcaf6d6fe68 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:00.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4777fff700 1 -- 172.21.15.50:0/2761691558 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477800e070 con 0x7f47800c98a0 2023-11-28T11:55:00.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4777fff700 1 -- 172.21.15.50:0/2761691558 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477800b910 con 0x7f47800c98a0 2023-11-28T11:55:00.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4777fff700 1 -- 172.21.15.50:0/2761691558 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477800bcc0 con 0x7f47800c98a0 2023-11-28T11:55:00.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4787888700 1 -- 172.21.15.50:0/2761691558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47800c98a0 msgr2=0x7f47800c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:00.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4787888700 1 --2- 172.21.15.50:0/2761691558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47800c98a0 0x7f47800c9cc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f47800cf8b0 tx=0x7f477800b330 comp rx=0 tx=0).stop 2023-11-28T11:55:00.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4787888700 1 -- 172.21.15.50:0/2761691558 shutdown_connections 2023-11-28T11:55:00.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4787888700 1 --2- 172.21.15.50:0/2761691558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47800c98a0 0x7f47800c9cc0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4787888700 1 --2- 172.21.15.50:0/2761691558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4780069c40 0x7f47800b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4787888700 1 --2- 172.21.15.50:0/2761691558 >> v2:172.21.15.192:3300/0 conn(0x7f47801510d0 0x7f478015b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4787888700 1 -- 172.21.15.50:0/2761691558 >> 172.21.15.50:0/2761691558 conn(0x7f478006caf0 msgr2=0x7f47800ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:00.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4787888700 1 -- 172.21.15.50:0/2761691558 shutdown_connections 2023-11-28T11:55:00.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.095+0000 7f4787888700 1 -- 172.21.15.50:0/2761691558 wait complete. 2023-11-28T11:55:00.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.099+0000 7f4787888700 1 Processor -- start 2023-11-28T11:55:00.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.099+0000 7f4787888700 1 -- start start 2023-11-28T11:55:00.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.099+0000 7f4787888700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4780069c40 0x7f47801f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.099+0000 7f4787888700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47800c98a0 0x7f478014c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.099+0000 7f4787888700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47801510d0 0x7f478015af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.099+0000 7f4787888700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4780154100 con 0x7f4780069c40 2023-11-28T11:55:00.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.099+0000 7f4787888700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47801543e0 con 0x7f47801510d0 2023-11-28T11:55:00.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.099+0000 7f4787888700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47801f49a0 con 0x7f47800c98a0 2023-11-28T11:55:00.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.099+0000 7f4784e23700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47800c98a0 0x7f478014c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.099+0000 7f4785624700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4780069c40 0x7f47801f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.099+0000 7f4784e23700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47800c98a0 0x7f478014c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:46360/0 (socket says 172.21.15.50:46360) 2023-11-28T11:55:00.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.099+0000 7f4785e25700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47801510d0 0x7f478015af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.099+0000 7f4784e23700 1 -- 172.21.15.50:0/374166279 learned_addr learned my addr 172.21.15.50:0/374166279 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:00.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.099+0000 7f4785624700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4780069c40 0x7f47801f5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58580/0 (socket says 172.21.15.50:58580) 2023-11-28T11:55:00.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.103+0000 7f4785624700 1 -- 172.21.15.50:0/374166279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47800c98a0 msgr2=0x7f478014c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:00.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.103+0000 7f4785624700 1 --2- 172.21.15.50:0/374166279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47800c98a0 0x7f478014c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.103+0000 7f4785624700 1 -- 172.21.15.50:0/374166279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47801510d0 msgr2=0x7f478015af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:00.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.103+0000 7f4785624700 1 --2- 172.21.15.50:0/374166279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47801510d0 0x7f478015af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.103+0000 7f4785624700 1 -- 172.21.15.50:0/374166279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47700094b0 con 0x7f4780069c40 2023-11-28T11:55:00.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.103+0000 7f4785e25700 1 --2- 172.21.15.50:0/374166279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47801510d0 0x7f478015af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:00.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.103+0000 7f4785624700 1 --2- 172.21.15.50:0/374166279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4780069c40 0x7f47801f5480 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f477000e9b0 tx=0x7f477000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:00.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.103+0000 7f4775ffb700 1 -- 172.21.15.50:0/374166279 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000c640 con 0x7f4780069c40 2023-11-28T11:55:00.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.103+0000 7f4775ffb700 1 -- 172.21.15.50:0/374166279 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477000c7a0 con 0x7f4780069c40 2023-11-28T11:55:00.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.103+0000 7f4787888700 1 -- 172.21.15.50:0/374166279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4778009b30 con 0x7f4780069c40 2023-11-28T11:55:00.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.103+0000 7f4775ffb700 1 -- 172.21.15.50:0/374166279 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000cb50 con 0x7f4780069c40 2023-11-28T11:55:00.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.103+0000 7f4787888700 1 -- 172.21.15.50:0/374166279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47800c92f0 con 0x7f4780069c40 2023-11-28T11:55:00.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.103+0000 7f4787888700 1 -- 172.21.15.50:0/374166279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47800c9010 con 0x7f4780069c40 2023-11-28T11:55:00.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.107+0000 7f4775ffb700 1 -- 172.21.15.50:0/374166279 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4770019030 con 0x7f4780069c40 2023-11-28T11:55:00.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.107+0000 7f4775ffb700 1 --2- 172.21.15.50:0/374166279 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f476c064ee0 0x7f476c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.107+0000 7f4775ffb700 1 -- 172.21.15.50:0/374166279 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4770081a70 con 0x7f4780069c40 2023-11-28T11:55:00.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.107+0000 7f4784e23700 1 --2- 172.21.15.50:0/374166279 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f476c064ee0 0x7f476c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.107+0000 7f4784e23700 1 --2- 172.21.15.50:0/374166279 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f476c064ee0 0x7f476c067390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f47800cddb0 tx=0x7f477c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:00.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.111+0000 7f4775ffb700 1 -- 172.21.15.50:0/374166279 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f477004fdc0 con 0x7f4780069c40 2023-11-28T11:55:00.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.331+0000 7f4787888700 1 -- 172.21.15.50:0/374166279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f4780070170 con 0x7f4780069c40 2023-11-28T11:55:00.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.339+0000 7f4775ffb700 1 -- 172.21.15.50:0/374166279 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f477000ccb0 con 0x7f4780069c40 2023-11-28T11:55:00.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.339+0000 7f4787888700 1 -- 172.21.15.50:0/374166279 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f476c064ee0 msgr2=0x7f476c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:00.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.339+0000 7f4787888700 1 --2- 172.21.15.50:0/374166279 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f476c064ee0 0x7f476c067390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f47800cddb0 tx=0x7f477c009240 comp rx=0 tx=0).stop 2023-11-28T11:55:00.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.339+0000 7f4787888700 1 -- 172.21.15.50:0/374166279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4780069c40 msgr2=0x7f47801f5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:00.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.339+0000 7f4787888700 1 --2- 172.21.15.50:0/374166279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4780069c40 0x7f47801f5480 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f477000e9b0 tx=0x7f477000ecc0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.339+0000 7f4787888700 1 -- 172.21.15.50:0/374166279 shutdown_connections 2023-11-28T11:55:00.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.339+0000 7f4787888700 1 --2- 172.21.15.50:0/374166279 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f476c064ee0 0x7f476c067390 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.339+0000 7f4787888700 1 --2- 172.21.15.50:0/374166279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47801510d0 0x7f478015af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.339+0000 7f4787888700 1 --2- 172.21.15.50:0/374166279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47800c98a0 0x7f478014c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.339+0000 7f4787888700 1 --2- 172.21.15.50:0/374166279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4780069c40 0x7f47801f5480 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.339+0000 7f4787888700 1 -- 172.21.15.50:0/374166279 >> 172.21.15.50:0/374166279 conn(0x7f478006caf0 msgr2=0x7f478014f520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:00.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.339+0000 7f4787888700 1 -- 172.21.15.50:0/374166279 shutdown_connections 2023-11-28T11:55:00.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.339+0000 7f4787888700 1 -- 172.21.15.50:0/374166279 wait complete. 2023-11-28T11:55:00.356 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-28T11:55:00.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.471+0000 7f5140953700 1 Processor -- start 2023-11-28T11:55:00.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.471+0000 7f5140953700 1 -- start start 2023-11-28T11:55:00.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.471+0000 7f5140953700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f513c159e70 0x7f513c06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.471+0000 7f5140953700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f513c0cb470 0x7f513c0c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.471+0000 7f5140953700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f513c06ace0 con 0x7f513c069c40 2023-11-28T11:55:00.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.471+0000 7f5140953700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f513c06a0d0 con 0x7f513c159e70 2023-11-28T11:55:00.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.471+0000 7f5140953700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513c06a3b0 con 0x7f513c0cb470 2023-11-28T11:55:00.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f513bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f513c0cb470 0x7f513c0c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f513bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f513c0cb470 0x7f513c0c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:46370/0 (socket says 172.21.15.50:46370) 2023-11-28T11:55:00.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f513bfff700 1 -- 172.21.15.50:0/3205317288 learned_addr learned my addr 172.21.15.50:0/3205317288 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:00.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f513b7fe700 1 --2- 172.21.15.50:0/3205317288 >> v2:172.21.15.192:3300/0 conn(0x7f513c159e70 0x7f513c06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f513a7fc700 1 -- 172.21.15.50:0/3205317288 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778306939 0 0) 0x7f513c06ace0 con 0x7f513c069c40 2023-11-28T11:55:00.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f513bfff700 1 -- 172.21.15.50:0/3205317288 >> v2:172.21.15.192:3300/0 conn(0x7f513c159e70 msgr2=0x7f513c06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:00.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f513bfff700 1 --2- 172.21.15.50:0/3205317288 >> v2:172.21.15.192:3300/0 conn(0x7f513c159e70 0x7f513c06c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f513bfff700 1 -- 172.21.15.50:0/3205317288 >> v1:172.21.15.192:6789/0 conn(0x7f513c069c40 legacy=0x7f513c0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:00.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f513bfff700 1 -- 172.21.15.50:0/3205317288 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c06a690 con 0x7f513c0cb470 2023-11-28T11:55:00.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f513bfff700 1 --2- 172.21.15.50:0/3205317288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f513c0cb470 0x7f513c0c91d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5134009910 tx=0x7f5134009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4db023059703a39 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:00.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f513a7fc700 1 -- 172.21.15.50:0/3205317288 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134011830 con 0x7f513c0cb470 2023-11-28T11:55:00.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f513a7fc700 1 -- 172.21.15.50:0/3205317288 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5134011990 con 0x7f513c0cb470 2023-11-28T11:55:00.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f513a7fc700 1 -- 172.21.15.50:0/3205317288 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134011d40 con 0x7f513c0cb470 2023-11-28T11:55:00.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f5140953700 1 -- 172.21.15.50:0/3205317288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f513c0cb470 msgr2=0x7f513c0c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:00.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f5140953700 1 --2- 172.21.15.50:0/3205317288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f513c0cb470 0x7f513c0c91d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5134009910 tx=0x7f5134009c20 comp rx=0 tx=0).stop 2023-11-28T11:55:00.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f5140953700 1 -- 172.21.15.50:0/3205317288 shutdown_connections 2023-11-28T11:55:00.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f5140953700 1 --2- 172.21.15.50:0/3205317288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f513c0cb470 0x7f513c0c91d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f5140953700 1 --2- 172.21.15.50:0/3205317288 >> v2:172.21.15.192:3300/0 conn(0x7f513c159e70 0x7f513c06c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f5140953700 1 -- 172.21.15.50:0/3205317288 >> 172.21.15.50:0/3205317288 conn(0x7f513c0ce3e0 msgr2=0x7f513c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:00.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f5140953700 1 -- 172.21.15.50:0/3205317288 shutdown_connections 2023-11-28T11:55:00.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f5140953700 1 -- 172.21.15.50:0/3205317288 wait complete. 2023-11-28T11:55:00.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f5140953700 1 Processor -- start 2023-11-28T11:55:00.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.475+0000 7f5140953700 1 -- start start 2023-11-28T11:55:00.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f5140953700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f513c069c40 0x7f513c1f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f5140953700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f513c0cb470 0x7f513c0ae940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f5140953700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f513c159e70 0x7f513c15c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f5140953700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c0710b0 con 0x7f513c159e70 2023-11-28T11:55:00.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f5140953700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c0adb80 con 0x7f513c0cb470 2023-11-28T11:55:00.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f5140953700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513c0ade60 con 0x7f513c069c40 2023-11-28T11:55:00.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f513bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f513c159e70 0x7f513c15c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f513bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f513c159e70 0x7f513c15c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58594/0 (socket says 172.21.15.50:58594) 2023-11-28T11:55:00.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f513bfff700 1 -- 172.21.15.50:0/1055900337 learned_addr learned my addr 172.21.15.50:0/1055900337 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:00.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f513affd700 1 --2- 172.21.15.50:0/1055900337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f513c0cb470 0x7f513c0ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f513b7fe700 1 --2- 172.21.15.50:0/1055900337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f513c069c40 0x7f513c1f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f513bfff700 1 -- 172.21.15.50:0/1055900337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f513c069c40 msgr2=0x7f513c1f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:00.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f513bfff700 1 --2- 172.21.15.50:0/1055900337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f513c069c40 0x7f513c1f21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f513bfff700 1 -- 172.21.15.50:0/1055900337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f513c0cb470 msgr2=0x7f513c0ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:00.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f513bfff700 1 --2- 172.21.15.50:0/1055900337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f513c0cb470 0x7f513c0ae940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f513bfff700 1 -- 172.21.15.50:0/1055900337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5134009570 con 0x7f513c159e70 2023-11-28T11:55:00.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f513bfff700 1 --2- 172.21.15.50:0/1055900337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f513c159e70 0x7f513c15c5a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f513c06a4f0 tx=0x7f5134004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:00.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f5123fff700 1 -- 172.21.15.50:0/1055900337 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134004590 con 0x7f513c159e70 2023-11-28T11:55:00.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f5123fff700 1 -- 172.21.15.50:0/1055900337 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51340036c0 con 0x7f513c159e70 2023-11-28T11:55:00.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f5140953700 1 -- 172.21.15.50:0/1055900337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513c15a240 con 0x7f513c159e70 2023-11-28T11:55:00.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f5123fff700 1 -- 172.21.15.50:0/1055900337 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134003a50 con 0x7f513c159e70 2023-11-28T11:55:00.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.479+0000 7f5140953700 1 -- 172.21.15.50:0/1055900337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513c06a970 con 0x7f513c159e70 2023-11-28T11:55:00.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.483+0000 7f5140953700 1 -- 172.21.15.50:0/1055900337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513c06cee0 con 0x7f513c159e70 2023-11-28T11:55:00.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.483+0000 7f5123fff700 1 -- 172.21.15.50:0/1055900337 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f513400f050 con 0x7f513c159e70 2023-11-28T11:55:00.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.483+0000 7f5123fff700 1 --2- 172.21.15.50:0/1055900337 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5128064ee0 0x7f5128067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.483+0000 7f5123fff700 1 -- 172.21.15.50:0/1055900337 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5134083200 con 0x7f513c159e70 2023-11-28T11:55:00.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.483+0000 7f513b7fe700 1 --2- 172.21.15.50:0/1055900337 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5128064ee0 0x7f5128067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.483+0000 7f513b7fe700 1 --2- 172.21.15.50:0/1055900337 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5128064ee0 0x7f5128067390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5130009ae0 tx=0x7f5130008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:00.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.491+0000 7f5123fff700 1 -- 172.21.15.50:0/1055900337 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5134051530 con 0x7f513c159e70 2023-11-28T11:55:00.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.707+0000 7f5140953700 1 -- 172.21.15.50:0/1055900337 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f513c072500 con 0x7f513c159e70 2023-11-28T11:55:00.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.715+0000 7f5123fff700 1 -- 172.21.15.50:0/1055900337 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f51340150a0 con 0x7f513c159e70 2023-11-28T11:55:00.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.719+0000 7f5140953700 1 -- 172.21.15.50:0/1055900337 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5128064ee0 msgr2=0x7f5128067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:00.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.719+0000 7f5140953700 1 --2- 172.21.15.50:0/1055900337 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5128064ee0 0x7f5128067390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5130009ae0 tx=0x7f5130008040 comp rx=0 tx=0).stop 2023-11-28T11:55:00.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.719+0000 7f5140953700 1 -- 172.21.15.50:0/1055900337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f513c159e70 msgr2=0x7f513c15c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:00.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.719+0000 7f5140953700 1 --2- 172.21.15.50:0/1055900337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f513c159e70 0x7f513c15c5a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f513c06a4f0 tx=0x7f5134004770 comp rx=0 tx=0).stop 2023-11-28T11:55:00.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.719+0000 7f5140953700 1 -- 172.21.15.50:0/1055900337 shutdown_connections 2023-11-28T11:55:00.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.719+0000 7f5140953700 1 --2- 172.21.15.50:0/1055900337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f513c159e70 0x7f513c15c5a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.719+0000 7f5140953700 1 --2- 172.21.15.50:0/1055900337 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5128064ee0 0x7f5128067390 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.719+0000 7f5140953700 1 --2- 172.21.15.50:0/1055900337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f513c0cb470 0x7f513c0ae940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.719+0000 7f5140953700 1 --2- 172.21.15.50:0/1055900337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f513c069c40 0x7f513c1f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.719+0000 7f5140953700 1 -- 172.21.15.50:0/1055900337 >> 172.21.15.50:0/1055900337 conn(0x7f513c0ce3e0 msgr2=0x7f513c0ab950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:00.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.719+0000 7f5140953700 1 -- 172.21.15.50:0/1055900337 shutdown_connections 2023-11-28T11:55:00.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.719+0000 7f5140953700 1 -- 172.21.15.50:0/1055900337 wait complete. 2023-11-28T11:55:00.734 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-28T11:55:00.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13ce430700 1 Processor -- start 2023-11-28T11:55:00.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13ce430700 1 -- start start 2023-11-28T11:55:00.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13ce430700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f13c80ceef0 0x7f13c806a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13ce430700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c80cae70 con 0x7f13c81606b0 2023-11-28T11:55:00.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13ce430700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c80cbc10 con 0x7f13c80c1ac0 2023-11-28T11:55:00.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13ce430700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c80cb130 con 0x7f13c80ceef0 2023-11-28T11:55:00.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13cd42e700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f13c81606b0 0x7f13c80c13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34360/0 (socket says 172.21.15.50:34360) 2023-11-28T11:55:00.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13cd42e700 1 -- 172.21.15.50:0/1211363392 learned_addr learned my addr 172.21.15.50:0/1211363392 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:00.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13cdc2f700 1 --2- 172.21.15.50:0/1211363392 >> v2:172.21.15.192:3300/0 conn(0x7f13c80ceef0 0x7f13c806a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13bbfff700 1 -- 172.21.15.50:0/1211363392 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504623806 0 0) 0x7f13c80cae70 con 0x7f13c81606b0 2023-11-28T11:55:00.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13bbfff700 1 -- 172.21.15.50:0/1211363392 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13b40035d0 con 0x7f13c81606b0 2023-11-28T11:55:00.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13bbfff700 1 -- 172.21.15.50:0/1211363392 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2108372970 0 0) 0x7f13b40035d0 con 0x7f13c81606b0 2023-11-28T11:55:00.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13bbfff700 1 -- 172.21.15.50:0/1211363392 >> v2:172.21.15.192:3300/0 conn(0x7f13c80ceef0 msgr2=0x7f13c806a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:00.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13bbfff700 1 --2- 172.21.15.50:0/1211363392 >> v2:172.21.15.192:3300/0 conn(0x7f13c80ceef0 0x7f13c806a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13bbfff700 1 -- 172.21.15.50:0/1211363392 >> v1:172.21.15.192:6789/0 conn(0x7f13c80c1ac0 legacy=0x7f13c8069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:00.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13bbfff700 1 -- 172.21.15.50:0/1211363392 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c80cb410 con 0x7f13c81606b0 2023-11-28T11:55:00.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13bbfff700 1 -- 172.21.15.50:0/1211363392 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f13c4001670 con 0x7f13c81606b0 2023-11-28T11:55:00.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13bbfff700 1 -- 172.21.15.50:0/1211363392 >> v1:172.21.15.50:6789/0 conn(0x7f13c81606b0 legacy=0x7f13c80c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:00.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13bbfff700 1 --2- 172.21.15.50:0/1211363392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4003a20 0x7f13b4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13bbfff700 1 --2- 172.21.15.50:0/1211363392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13b4004410 0x7f13b40048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13bbfff700 1 --2- 172.21.15.50:0/1211363392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13b40050d0 0x7f13b400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13bbfff700 1 -- 172.21.15.50:0/1211363392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c80cb130 con 0x7f13b4003a20 2023-11-28T11:55:00.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13bbfff700 1 -- 172.21.15.50:0/1211363392 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b400c020 con 0x7f13b4004410 2023-11-28T11:55:00.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13bbfff700 1 -- 172.21.15.50:0/1211363392 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b400c1e0 con 0x7f13b40050d0 2023-11-28T11:55:00.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13cd42e700 1 --2- 172.21.15.50:0/1211363392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4003a20 0x7f13b4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13ccc2d700 1 --2- 172.21.15.50:0/1211363392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13b4004410 0x7f13b40048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13cdc2f700 1 --2- 172.21.15.50:0/1211363392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13b40050d0 0x7f13b400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13ccc2d700 1 -- 172.21.15.50:0/1211363392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13b40050d0 msgr2=0x7f13b400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13ccc2d700 1 --2- 172.21.15.50:0/1211363392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13b40050d0 0x7f13b400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13ccc2d700 1 -- 172.21.15.50:0/1211363392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4003a20 msgr2=0x7f13b4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13ccc2d700 1 --2- 172.21.15.50:0/1211363392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4003a20 0x7f13b4003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13ccc2d700 1 -- 172.21.15.50:0/1211363392 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b40035d0 con 0x7f13b4004410 2023-11-28T11:55:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13cdc2f700 1 -- 172.21.15.50:0/1211363392 reap_dead start 2023-11-28T11:55:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13cd42e700 1 --2- 172.21.15.50:0/1211363392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4003a20 0x7f13b4003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.847+0000 7f13ccc2d700 1 --2- 172.21.15.50:0/1211363392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13b4004410 0x7f13b40048d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f13c000c260 tx=0x7f13b40058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a23d052b1f4b3309 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.851+0000 7f13bbfff700 1 -- 172.21.15.50:0/1211363392 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c0001e70 con 0x7f13b4004410 2023-11-28T11:55:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.851+0000 7f13bbfff700 1 -- 172.21.15.50:0/1211363392 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c000ce20 con 0x7f13b4004410 2023-11-28T11:55:00.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.851+0000 7f13bbfff700 1 -- 172.21.15.50:0/1211363392 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c0003c60 con 0x7f13b4004410 2023-11-28T11:55:00.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.851+0000 7f13ce430700 1 -- 172.21.15.50:0/1211363392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13b4004410 msgr2=0x7f13b40048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:00.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.851+0000 7f13ce430700 1 --2- 172.21.15.50:0/1211363392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13b4004410 0x7f13b40048d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f13c000c260 tx=0x7f13b40058a0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.851+0000 7f13ce430700 1 -- 172.21.15.50:0/1211363392 shutdown_connections 2023-11-28T11:55:00.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.851+0000 7f13ce430700 1 --2- 172.21.15.50:0/1211363392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13b4004410 0x7f13b40048d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.851+0000 7f13ce430700 1 -- 172.21.15.50:0/1211363392 >> 172.21.15.50:0/1211363392 conn(0x7f13c80ce3e0 msgr2=0x7f13c80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:00.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.851+0000 7f13ce430700 1 -- 172.21.15.50:0/1211363392 shutdown_connections 2023-11-28T11:55:00.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.851+0000 7f13ce430700 1 -- 172.21.15.50:0/1211363392 wait complete. 2023-11-28T11:55:00.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.851+0000 7f13ce430700 1 Processor -- start 2023-11-28T11:55:00.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.851+0000 7f13ce430700 1 -- start start 2023-11-28T11:55:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13ce430700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4004410 0x7f13c815bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13ce430700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13c81622b0 0x7f13c8160a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13ce430700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13c815f640 0x7f13c815a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13ce430700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c8160fc0 con 0x7f13b4004410 2023-11-28T11:55:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13ce430700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c8161810 con 0x7f13c815f640 2023-11-28T11:55:00.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13ce430700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c81611f0 con 0x7f13c81622b0 2023-11-28T11:55:00.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13cd42e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4004410 0x7f13c815bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13cd42e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4004410 0x7f13c815bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58618/0 (socket says 172.21.15.50:58618) 2023-11-28T11:55:00.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13cd42e700 1 -- 172.21.15.50:0/611086117 learned_addr learned my addr 172.21.15.50:0/611086117 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:00.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13ccc2d700 1 --2- 172.21.15.50:0/611086117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13c81622b0 0x7f13c8160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13cdc2f700 1 --2- 172.21.15.50:0/611086117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13c815f640 0x7f13c815a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13cd42e700 1 -- 172.21.15.50:0/611086117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13c81622b0 msgr2=0x7f13c8160a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:00.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13cd42e700 1 --2- 172.21.15.50:0/611086117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13c81622b0 0x7f13c8160a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13cd42e700 1 -- 172.21.15.50:0/611086117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13c815f640 msgr2=0x7f13c815a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:00.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13cd42e700 1 --2- 172.21.15.50:0/611086117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13c815f640 0x7f13c815a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:00.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13cd42e700 1 -- 172.21.15.50:0/611086117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c80b36c0 con 0x7f13b4004410 2023-11-28T11:55:00.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13cd42e700 1 --2- 172.21.15.50:0/611086117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4004410 0x7f13c815bb80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f13c4007300 tx=0x7f13c4007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:00.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13b9ffb700 1 -- 172.21.15.50:0/611086117 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c400f850 con 0x7f13b4004410 2023-11-28T11:55:00.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13b9ffb700 1 -- 172.21.15.50:0/611086117 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c400f9b0 con 0x7f13b4004410 2023-11-28T11:55:00.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13ce430700 1 -- 172.21.15.50:0/611086117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c80cb6f0 con 0x7f13b4004410 2023-11-28T11:55:00.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13b9ffb700 1 -- 172.21.15.50:0/611086117 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c400fd20 con 0x7f13b4004410 2023-11-28T11:55:00.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.855+0000 7f13ce430700 1 -- 172.21.15.50:0/611086117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c80ad610 con 0x7f13b4004410 2023-11-28T11:55:00.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.859+0000 7f13ce430700 1 -- 172.21.15.50:0/611086117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c8072500 con 0x7f13b4004410 2023-11-28T11:55:00.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.859+0000 7f13b9ffb700 1 -- 172.21.15.50:0/611086117 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f13c401d460 con 0x7f13b4004410 2023-11-28T11:55:00.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.859+0000 7f13b9ffb700 1 --2- 172.21.15.50:0/611086117 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f13ac064ee0 0x7f13ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:00.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.859+0000 7f13b9ffb700 1 -- 172.21.15.50:0/611086117 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f13c4081cb0 con 0x7f13b4004410 2023-11-28T11:55:00.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.859+0000 7f13ccc2d700 1 --2- 172.21.15.50:0/611086117 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f13ac064ee0 0x7f13ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:00.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.859+0000 7f13ccc2d700 1 --2- 172.21.15.50:0/611086117 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f13ac064ee0 0x7f13ac067390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f13c0000f80 tx=0x7f13c0005000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:00.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:00.867+0000 7f13b9ffb700 1 -- 172.21.15.50:0/611086117 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f13c4050000 con 0x7f13b4004410 2023-11-28T11:55:01.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.087+0000 7f13ce430700 1 -- 172.21.15.50:0/611086117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f13c80ad380 con 0x7f13b4004410 2023-11-28T11:55:01.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.099+0000 7f13b9ffb700 1 -- 172.21.15.50:0/611086117 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f13c4053620 con 0x7f13b4004410 2023-11-28T11:55:01.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.099+0000 7f13ce430700 1 -- 172.21.15.50:0/611086117 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f13ac064ee0 msgr2=0x7f13ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.099+0000 7f13ce430700 1 --2- 172.21.15.50:0/611086117 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f13ac064ee0 0x7f13ac067390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f13c0000f80 tx=0x7f13c0005000 comp rx=0 tx=0).stop 2023-11-28T11:55:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.099+0000 7f13ce430700 1 -- 172.21.15.50:0/611086117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4004410 msgr2=0x7f13c815bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.099+0000 7f13ce430700 1 --2- 172.21.15.50:0/611086117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4004410 0x7f13c815bb80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f13c4007300 tx=0x7f13c4007610 comp rx=0 tx=0).stop 2023-11-28T11:55:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.099+0000 7f13ce430700 1 -- 172.21.15.50:0/611086117 shutdown_connections 2023-11-28T11:55:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.099+0000 7f13ce430700 1 --2- 172.21.15.50:0/611086117 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f13ac064ee0 0x7f13ac067390 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.099+0000 7f13ce430700 1 --2- 172.21.15.50:0/611086117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13c815f640 0x7f13c815a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.099+0000 7f13ce430700 1 --2- 172.21.15.50:0/611086117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13c81622b0 0x7f13c8160a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.099+0000 7f13ce430700 1 --2- 172.21.15.50:0/611086117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4004410 0x7f13c815bb80 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.099+0000 7f13ce430700 1 -- 172.21.15.50:0/611086117 >> 172.21.15.50:0/611086117 conn(0x7f13c80ce3e0 msgr2=0x7f13c80ade40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.099+0000 7f13ce430700 1 -- 172.21.15.50:0/611086117 shutdown_connections 2023-11-28T11:55:01.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.099+0000 7f13ce430700 1 -- 172.21.15.50:0/611086117 wait complete. 2023-11-28T11:55:01.116 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-28T11:55:01.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.235+0000 7f2db5923700 1 Processor -- start 2023-11-28T11:55:01.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.235+0000 7f2db5923700 1 -- start start 2023-11-28T11:55:01.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.235+0000 7f2db5923700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2db01607b0 0x7f2db00cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:01.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.235+0000 7f2db5923700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db00cc730 con 0x7f2db00cd000 2023-11-28T11:55:01.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.235+0000 7f2db5923700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db00b1f30 con 0x7f2db00cc360 2023-11-28T11:55:01.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.235+0000 7f2db5923700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db00d04c0 con 0x7f2db01607b0 2023-11-28T11:55:01.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.235+0000 7f2db5122700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2db00cd000 0x7f2db00afdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:34364/0 (socket says 172.21.15.50:34364) 2023-11-28T11:55:01.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.235+0000 7f2db5122700 1 -- 172.21.15.50:0/2873374446 learned_addr learned my addr 172.21.15.50:0/2873374446 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:01.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2daffff700 1 --2- 172.21.15.50:0/2873374446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2db01607b0 0x7f2db00cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:01.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2daf7fe700 1 -- 172.21.15.50:0/2873374446 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927632601 0 0) 0x7f2db00cc730 con 0x7f2db00cd000 2023-11-28T11:55:01.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2daf7fe700 1 -- 172.21.15.50:0/2873374446 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d980035d0 con 0x7f2db00cd000 2023-11-28T11:55:01.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2daf7fe700 1 -- 172.21.15.50:0/2873374446 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230524465 0 0) 0x7f2db00b1f30 con 0x7f2db00cc360 2023-11-28T11:55:01.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2daf7fe700 1 -- 172.21.15.50:0/2873374446 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2db00cc730 con 0x7f2db00cc360 2023-11-28T11:55:01.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2daf7fe700 1 -- 172.21.15.50:0/2873374446 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4025574174 0 0) 0x7f2d980035d0 con 0x7f2db00cd000 2023-11-28T11:55:01.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2daffff700 1 -- 172.21.15.50:0/2873374446 >> v1:172.21.15.192:6789/0 conn(0x7f2db00cc360 legacy=0x7f2db00ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:01.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2daffff700 1 -- 172.21.15.50:0/2873374446 >> v1:172.21.15.50:6789/0 conn(0x7f2db00cd000 legacy=0x7f2db00afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:01.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2daffff700 1 -- 172.21.15.50:0/2873374446 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db00d01e0 con 0x7f2db01607b0 2023-11-28T11:55:01.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2daffff700 1 --2- 172.21.15.50:0/2873374446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2db01607b0 0x7f2db00cfbd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009e10 tx=0x7f2da000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2c792550d953444 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:01.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2daf7fe700 1 -- 172.21.15.50:0/2873374446 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da000e070 con 0x7f2db01607b0 2023-11-28T11:55:01.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2daf7fe700 1 -- 172.21.15.50:0/2873374446 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da0003a40 con 0x7f2db01607b0 2023-11-28T11:55:01.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2daf7fe700 1 -- 172.21.15.50:0/2873374446 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8001670 con 0x7f2db01607b0 2023-11-28T11:55:01.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2db5923700 1 -- 172.21.15.50:0/2873374446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2db01607b0 msgr2=0x7f2db00cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:01.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2db5923700 1 --2- 172.21.15.50:0/2873374446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2db01607b0 0x7f2db00cfbd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009e10 tx=0x7f2da000b330 comp rx=0 tx=0).stop 2023-11-28T11:55:01.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2db5923700 1 -- 172.21.15.50:0/2873374446 shutdown_connections 2023-11-28T11:55:01.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2db5923700 1 --2- 172.21.15.50:0/2873374446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2db01607b0 0x7f2db00cfbd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2db5923700 1 -- 172.21.15.50:0/2873374446 >> 172.21.15.50:0/2873374446 conn(0x7f2db00b2140 msgr2=0x7f2db00b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:01.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2db5923700 1 -- 172.21.15.50:0/2873374446 shutdown_connections 2023-11-28T11:55:01.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.239+0000 7f2db5923700 1 -- 172.21.15.50:0/2873374446 wait complete. 2023-11-28T11:55:01.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db5923700 1 Processor -- start 2023-11-28T11:55:01.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db5923700 1 -- start start 2023-11-28T11:55:01.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db5923700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2db00cc360 0x7f2db01f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:01.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db5923700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2db00cd000 0x7f2db00c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:01.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db5923700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2db01607b0 0x7f2db006b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:01.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db5923700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db01f4f60 con 0x7f2db01607b0 2023-11-28T11:55:01.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db5923700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db0148af0 con 0x7f2db00cc360 2023-11-28T11:55:01.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db5923700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db0148dd0 con 0x7f2db00cd000 2023-11-28T11:55:01.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db5122700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2db01607b0 0x7f2db006b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:01.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db5122700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2db01607b0 0x7f2db006b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58634/0 (socket says 172.21.15.50:58634) 2023-11-28T11:55:01.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db5122700 1 -- 172.21.15.50:0/1648339408 learned_addr learned my addr 172.21.15.50:0/1648339408 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:01.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2daffff700 1 --2- 172.21.15.50:0/1648339408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2db00cd000 0x7f2db00c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:01.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db4921700 1 --2- 172.21.15.50:0/1648339408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2db00cc360 0x7f2db01f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db5122700 1 -- 172.21.15.50:0/1648339408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2db00cd000 msgr2=0x7f2db00c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db5122700 1 --2- 172.21.15.50:0/1648339408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2db00cd000 0x7f2db00c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db5122700 1 -- 172.21.15.50:0/1648339408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2db00cc360 msgr2=0x7f2db01f2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db5122700 1 --2- 172.21.15.50:0/1648339408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2db00cc360 0x7f2db01f2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db5122700 1 -- 172.21.15.50:0/1648339408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da0009a70 con 0x7f2db01607b0 2023-11-28T11:55:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2db5122700 1 --2- 172.21.15.50:0/1648339408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2db01607b0 0x7f2db006b5e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2da800c520 tx=0x7f2da800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2dad7fa700 1 -- 172.21.15.50:0/1648339408 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8004ca0 con 0x7f2db01607b0 2023-11-28T11:55:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.243+0000 7f2dad7fa700 1 -- 172.21.15.50:0/1648339408 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da8004e00 con 0x7f2db01607b0 2023-11-28T11:55:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.247+0000 7f2db5923700 1 -- 172.21.15.50:0/1648339408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db015ffb0 con 0x7f2db01607b0 2023-11-28T11:55:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.247+0000 7f2dad7fa700 1 -- 172.21.15.50:0/1648339408 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8007310 con 0x7f2db01607b0 2023-11-28T11:55:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.247+0000 7f2db5923700 1 -- 172.21.15.50:0/1648339408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db015fcd0 con 0x7f2db01607b0 2023-11-28T11:55:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.247+0000 7f2db5923700 1 -- 172.21.15.50:0/1648339408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db0160290 con 0x7f2db01607b0 2023-11-28T11:55:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.247+0000 7f2dad7fa700 1 -- 172.21.15.50:0/1648339408 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2da801a020 con 0x7f2db01607b0 2023-11-28T11:55:01.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.247+0000 7f2dad7fa700 1 --2- 172.21.15.50:0/1648339408 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2d9c064ee0 0x7f2d9c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:01.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.247+0000 7f2dad7fa700 1 -- 172.21.15.50:0/1648339408 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2da8081820 con 0x7f2db01607b0 2023-11-28T11:55:01.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.247+0000 7f2db4921700 1 --2- 172.21.15.50:0/1648339408 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2d9c064ee0 0x7f2d9c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:01.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.251+0000 7f2db4921700 1 --2- 172.21.15.50:0/1648339408 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2d9c064ee0 0x7f2d9c067390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2da40011e0 tx=0x7f2da4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:01.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.255+0000 7f2dad7fa700 1 -- 172.21.15.50:0/1648339408 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2da804fb50 con 0x7f2db01607b0 2023-11-28T11:55:01.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.483+0000 7f2db5923700 1 -- 172.21.15.50:0/1648339408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f2db0072500 con 0x7f2db01607b0 2023-11-28T11:55:01.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.491+0000 7f2dad7fa700 1 -- 172.21.15.50:0/1648339408 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2da8053170 con 0x7f2db01607b0 2023-11-28T11:55:01.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.491+0000 7f2db5923700 1 -- 172.21.15.50:0/1648339408 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2d9c064ee0 msgr2=0x7f2d9c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.491+0000 7f2db5923700 1 --2- 172.21.15.50:0/1648339408 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2d9c064ee0 0x7f2d9c067390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2da40011e0 tx=0x7f2da4009040 comp rx=0 tx=0).stop 2023-11-28T11:55:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.491+0000 7f2db5923700 1 -- 172.21.15.50:0/1648339408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2db01607b0 msgr2=0x7f2db006b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.491+0000 7f2db5923700 1 --2- 172.21.15.50:0/1648339408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2db01607b0 0x7f2db006b5e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2da800c520 tx=0x7f2da800c830 comp rx=0 tx=0).stop 2023-11-28T11:55:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.491+0000 7f2db5923700 1 -- 172.21.15.50:0/1648339408 shutdown_connections 2023-11-28T11:55:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.491+0000 7f2db5923700 1 --2- 172.21.15.50:0/1648339408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2db01607b0 0x7f2db006b5e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.491+0000 7f2db5923700 1 --2- 172.21.15.50:0/1648339408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2db00cd000 0x7f2db00c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.491+0000 7f2db5923700 1 --2- 172.21.15.50:0/1648339408 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2d9c064ee0 0x7f2d9c067390 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.491+0000 7f2db5923700 1 --2- 172.21.15.50:0/1648339408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2db00cc360 0x7f2db01f2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.491+0000 7f2db5923700 1 -- 172.21.15.50:0/1648339408 >> 172.21.15.50:0/1648339408 conn(0x7f2db00b2140 msgr2=0x7f2db00b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:01.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.491+0000 7f2db5923700 1 -- 172.21.15.50:0/1648339408 shutdown_connections 2023-11-28T11:55:01.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.491+0000 7f2db5923700 1 -- 172.21.15.50:0/1648339408 wait complete. 2023-11-28T11:55:01.508 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-28T11:55:01.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9ab48d0700 1 Processor -- start 2023-11-28T11:55:01.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9ab48d0700 1 -- start start 2023-11-28T11:55:01.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9ab48d0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab0069c40 0x7f9ab00b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:01.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9ab48d0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab00b21f0 con 0x7f9ab00706f0 2023-11-28T11:55:01.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9ab48d0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab00b2420 con 0x7f9ab0158f20 2023-11-28T11:55:01.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9ab48d0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab006b120 con 0x7f9ab0069c40 2023-11-28T11:55:01.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9ab00706f0 0x7f9ab00cc360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42192/0 (socket says 172.21.15.50:42192) 2023-11-28T11:55:01.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaffff700 1 -- 172.21.15.50:0/2010183192 learned_addr learned my addr 172.21.15.50:0/2010183192 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:01.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aa6ffd700 1 --2- 172.21.15.50:0/2010183192 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab0069c40 0x7f9ab00b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaeffd700 1 -- 172.21.15.50:0/2010183192 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971984584 0 0) 0x7f9ab00b21f0 con 0x7f9ab00706f0 2023-11-28T11:55:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaeffd700 1 -- 172.21.15.50:0/2010183192 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a9c0057e0 con 0x7f9ab00706f0 2023-11-28T11:55:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaeffd700 1 -- 172.21.15.50:0/2010183192 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80968100 0 0) 0x7f9ab00b2420 con 0x7f9ab0158f20 2023-11-28T11:55:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaeffd700 1 -- 172.21.15.50:0/2010183192 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ab00b21f0 con 0x7f9ab0158f20 2023-11-28T11:55:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaeffd700 1 -- 172.21.15.50:0/2010183192 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 211089140 0 0) 0x7f9a9c0057e0 con 0x7f9ab00706f0 2023-11-28T11:55:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaeffd700 1 -- 172.21.15.50:0/2010183192 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab0069c40 msgr2=0x7f9ab00b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaeffd700 1 --2- 172.21.15.50:0/2010183192 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab0069c40 0x7f9ab00b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaeffd700 1 -- 172.21.15.50:0/2010183192 >> v1:172.21.15.192:6789/0 conn(0x7f9ab0158f20 legacy=0x7f9ab00b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaeffd700 1 -- 172.21.15.50:0/2010183192 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab00b2700 con 0x7f9ab00706f0 2023-11-28T11:55:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaeffd700 1 -- 172.21.15.50:0/2010183192 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f9aa8001970 con 0x7f9ab00706f0 2023-11-28T11:55:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaeffd700 1 -- 172.21.15.50:0/2010183192 >> v1:172.21.15.50:6789/0 conn(0x7f9ab00706f0 legacy=0x7f9ab00cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaeffd700 1 --2- 172.21.15.50:0/2010183192 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a9c005df0 0x7f9a9c0061c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaeffd700 1 --2- 172.21.15.50:0/2010183192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a9c006a80 0x7f9a9c006ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaeffd700 1 --2- 172.21.15.50:0/2010183192 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab0069c40 0x7f9a9c007430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaeffd700 1 -- 172.21.15.50:0/2010183192 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c00dcf0 con 0x7f9a9c006a80 2023-11-28T11:55:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaeffd700 1 -- 172.21.15.50:0/2010183192 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c00de60 con 0x7f9a9c005df0 2023-11-28T11:55:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaeffd700 1 -- 172.21.15.50:0/2010183192 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c00e020 con 0x7f9ab0069c40 2023-11-28T11:55:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aa6ffd700 1 --2- 172.21.15.50:0/2010183192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a9c006a80 0x7f9a9c006ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaf7fe700 1 --2- 172.21.15.50:0/2010183192 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a9c005df0 0x7f9a9c0061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.623+0000 7f9aaffff700 1 --2- 172.21.15.50:0/2010183192 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab0069c40 0x7f9a9c007430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9aa6ffd700 1 -- 172.21.15.50:0/2010183192 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab0069c40 msgr2=0x7f9a9c007430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9aa6ffd700 1 --2- 172.21.15.50:0/2010183192 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab0069c40 0x7f9a9c007430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9aa6ffd700 1 -- 172.21.15.50:0/2010183192 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a9c005df0 msgr2=0x7f9a9c0061c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9aa6ffd700 1 --2- 172.21.15.50:0/2010183192 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a9c005df0 0x7f9a9c0061c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9aa6ffd700 1 -- 172.21.15.50:0/2010183192 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c0057e0 con 0x7f9a9c006a80 2023-11-28T11:55:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9aaffff700 1 --2- 172.21.15.50:0/2010183192 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab0069c40 0x7f9a9c007430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9aa6ffd700 1 --2- 172.21.15.50:0/2010183192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a9c006a80 0x7f9a9c006ef0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009b70 tx=0x7f9a9c007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa678833bca2755e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9aaeffd700 1 -- 172.21.15.50:0/2010183192 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9800e6c0 con 0x7f9a9c006a80 2023-11-28T11:55:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9aaeffd700 1 -- 172.21.15.50:0/2010183192 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9800e820 con 0x7f9a9c006a80 2023-11-28T11:55:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9aaeffd700 1 -- 172.21.15.50:0/2010183192 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9800eb90 con 0x7f9a9c006a80 2023-11-28T11:55:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9ab48d0700 1 -- 172.21.15.50:0/2010183192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a9c006a80 msgr2=0x7f9a9c006ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9ab48d0700 1 --2- 172.21.15.50:0/2010183192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a9c006a80 0x7f9a9c006ef0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009b70 tx=0x7f9a9c007ab0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9aaffff700 1 -- 172.21.15.50:0/2010183192 reap_dead start 2023-11-28T11:55:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9ab48d0700 1 -- 172.21.15.50:0/2010183192 shutdown_connections 2023-11-28T11:55:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9ab48d0700 1 -- 172.21.15.50:0/2010183192 >> 172.21.15.50:0/2010183192 conn(0x7f9ab006e000 msgr2=0x7f9ab00b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9ab48d0700 1 -- 172.21.15.50:0/2010183192 shutdown_connections 2023-11-28T11:55:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9ab48d0700 1 -- 172.21.15.50:0/2010183192 wait complete. 2023-11-28T11:55:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9ab48d0700 1 Processor -- start 2023-11-28T11:55:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9ab48d0700 1 -- start start 2023-11-28T11:55:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9ab48d0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a9c006a80 0x7f9ab01f4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9ab48d0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab00ad8d0 0x7f9ab00afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9ab48d0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab00afff0 0x7f9ab0159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9ab48d0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab0159390 con 0x7f9ab00ad8d0 2023-11-28T11:55:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9ab48d0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab01f5380 con 0x7f9a9c006a80 2023-11-28T11:55:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9ab48d0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab01f5660 con 0x7f9ab00afff0 2023-11-28T11:55:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9aa6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab00ad8d0 0x7f9ab00afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9aaf7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a9c006a80 0x7f9ab01f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.627+0000 7f9aa6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab00ad8d0 0x7f9ab00afab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38626/0 (socket says 172.21.15.50:38626) 2023-11-28T11:55:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.631+0000 7f9aaffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab00afff0 0x7f9ab0159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.631+0000 7f9aaf7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a9c006a80 0x7f9ab01f4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:33596/0 (socket says 172.21.15.50:33596) 2023-11-28T11:55:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.631+0000 7f9aa6ffd700 1 -- 172.21.15.50:0/1994085482 learned_addr learned my addr 172.21.15.50:0/1994085482 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.631+0000 7f9aa6ffd700 1 -- 172.21.15.50:0/1994085482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab00afff0 msgr2=0x7f9ab0159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.631+0000 7f9aa6ffd700 1 --2- 172.21.15.50:0/1994085482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab00afff0 0x7f9ab0159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.631+0000 7f9aa6ffd700 1 -- 172.21.15.50:0/1994085482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a9c006a80 msgr2=0x7f9ab01f4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.631+0000 7f9aa6ffd700 1 --2- 172.21.15.50:0/1994085482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a9c006a80 0x7f9ab01f4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.631+0000 7f9aa6ffd700 1 -- 172.21.15.50:0/1994085482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab00b2cc0 con 0x7f9ab00ad8d0 2023-11-28T11:55:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.631+0000 7f9aaf7fe700 1 --2- 172.21.15.50:0/1994085482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a9c006a80 0x7f9ab01f4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.631+0000 7f9aa6ffd700 1 --2- 172.21.15.50:0/1994085482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab00ad8d0 0x7f9ab00afab0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00de30 tx=0x7f9a980047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.631+0000 7f9aacff9700 1 -- 172.21.15.50:0/1994085482 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9800e6c0 con 0x7f9ab00ad8d0 2023-11-28T11:55:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.631+0000 7f9aacff9700 1 -- 172.21.15.50:0/1994085482 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a98013cd0 con 0x7f9ab00ad8d0 2023-11-28T11:55:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.631+0000 7f9aacff9700 1 -- 172.21.15.50:0/1994085482 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9801c690 con 0x7f9ab00ad8d0 2023-11-28T11:55:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.631+0000 7f9ab48d0700 1 -- 172.21.15.50:0/1994085482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab00b29e0 con 0x7f9ab00ad8d0 2023-11-28T11:55:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.631+0000 7f9ab48d0700 1 -- 172.21.15.50:0/1994085482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab00b2fa0 con 0x7f9ab00ad8d0 2023-11-28T11:55:01.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.631+0000 7f9ab48d0700 1 -- 172.21.15.50:0/1994085482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab0072c20 con 0x7f9ab00ad8d0 2023-11-28T11:55:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.635+0000 7f9aacff9700 1 -- 172.21.15.50:0/1994085482 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9a98019030 con 0x7f9ab00ad8d0 2023-11-28T11:55:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.635+0000 7f9aacff9700 1 --2- 172.21.15.50:0/1994085482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9a90064f10 0x7f9a900673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.635+0000 7f9aacff9700 1 -- 172.21.15.50:0/1994085482 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9a98083230 con 0x7f9ab00ad8d0 2023-11-28T11:55:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.635+0000 7f9aaf7fe700 1 --2- 172.21.15.50:0/1994085482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9a90064f10 0x7f9a900673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.635+0000 7f9aaf7fe700 1 --2- 172.21.15.50:0/1994085482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9a90064f10 0x7f9a900673c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00ae0b0 tx=0x7f9aa0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:01.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.643+0000 7f9aacff9700 1 -- 172.21.15.50:0/1994085482 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9a980514f0 con 0x7f9ab00ad8d0 2023-11-28T11:55:01.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.867+0000 7f9ab48d0700 1 -- 172.21.15.50:0/1994085482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f9ab00aee30 con 0x7f9ab00ad8d0 2023-11-28T11:55:01.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.871+0000 7f9aacff9700 1 -- 172.21.15.50:0/1994085482 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9a98054b10 con 0x7f9ab00ad8d0 2023-11-28T11:55:01.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.875+0000 7f9ab48d0700 1 -- 172.21.15.50:0/1994085482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9a90064f10 msgr2=0x7f9a900673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:01.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.875+0000 7f9ab48d0700 1 --2- 172.21.15.50:0/1994085482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9a90064f10 0x7f9a900673c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00ae0b0 tx=0x7f9aa0009040 comp rx=0 tx=0).stop 2023-11-28T11:55:01.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.875+0000 7f9ab48d0700 1 -- 172.21.15.50:0/1994085482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab00ad8d0 msgr2=0x7f9ab00afab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:01.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.875+0000 7f9ab48d0700 1 --2- 172.21.15.50:0/1994085482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab00ad8d0 0x7f9ab00afab0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00de30 tx=0x7f9a980047e0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.875+0000 7f9ab48d0700 1 -- 172.21.15.50:0/1994085482 shutdown_connections 2023-11-28T11:55:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.875+0000 7f9ab48d0700 1 --2- 172.21.15.50:0/1994085482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab00afff0 0x7f9ab0159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.875+0000 7f9ab48d0700 1 --2- 172.21.15.50:0/1994085482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab00ad8d0 0x7f9ab00afab0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.875+0000 7f9ab48d0700 1 --2- 172.21.15.50:0/1994085482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9a90064f10 0x7f9a900673c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.875+0000 7f9ab48d0700 1 --2- 172.21.15.50:0/1994085482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a9c006a80 0x7f9ab01f4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.875+0000 7f9ab48d0700 1 -- 172.21.15.50:0/1994085482 >> 172.21.15.50:0/1994085482 conn(0x7f9ab006e000 msgr2=0x7f9ab006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.875+0000 7f9ab48d0700 1 -- 172.21.15.50:0/1994085482 shutdown_connections 2023-11-28T11:55:01.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.875+0000 7f9ab48d0700 1 -- 172.21.15.50:0/1994085482 wait complete. 2023-11-28T11:55:01.891 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-28T11:55:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.999+0000 7f4fb6c96700 1 Processor -- start 2023-11-28T11:55:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:01.999+0000 7f4fb6c96700 1 -- start start 2023-11-28T11:55:02.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb6c96700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4fb015c150 0x7f4fb01607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb6c96700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4fb00c9e70 0x7f4fb00cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb6c96700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb015c520 con 0x7f4fb00cc430 2023-11-28T11:55:02.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb6c96700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb00ca680 con 0x7f4fb00c9e70 2023-11-28T11:55:02.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb6c96700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb00ca960 con 0x7f4fb015c150 2023-11-28T11:55:02.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb6495700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4fb00cc430 0x7f4fb0070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42202/0 (socket says 172.21.15.50:42202) 2023-11-28T11:55:02.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb5493700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4fb00c9e70 0x7f4fb00cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb6495700 1 -- 172.21.15.50:0/5322122 learned_addr learned my addr 172.21.15.50:0/5322122 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:02.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb5c94700 1 --2- 172.21.15.50:0/5322122 >> v2:172.21.15.192:3300/0 conn(0x7f4fb015c150 0x7f4fb01607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb5493700 1 -- 172.21.15.50:0/5322122 >> v2:172.21.15.192:3300/0 conn(0x7f4fb015c150 msgr2=0x7f4fb01607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:02.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb5493700 1 --2- 172.21.15.50:0/5322122 >> v2:172.21.15.192:3300/0 conn(0x7f4fb015c150 0x7f4fb01607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb5493700 1 -- 172.21.15.50:0/5322122 >> v1:172.21.15.50:6789/0 conn(0x7f4fb00cc430 legacy=0x7f4fb0070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb5493700 1 -- 172.21.15.50:0/5322122 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb00cf330 con 0x7f4fb00c9e70 2023-11-28T11:55:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb5c94700 1 --2- 172.21.15.50:0/5322122 >> v2:172.21.15.192:3300/0 conn(0x7f4fb015c150 0x7f4fb01607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb5493700 1 --2- 172.21.15.50:0/5322122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb00c9e70 0x7f4fb00cbef0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0070b20 tx=0x7f4fac009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f44a8d7cc75e47 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb4c92700 1 -- 172.21.15.50:0/5322122 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac011830 con 0x7f4fb00c9e70 2023-11-28T11:55:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb4c92700 1 -- 172.21.15.50:0/5322122 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac011990 con 0x7f4fb00c9e70 2023-11-28T11:55:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb4c92700 1 -- 172.21.15.50:0/5322122 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac011d40 con 0x7f4fb00c9e70 2023-11-28T11:55:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb6c96700 1 -- 172.21.15.50:0/5322122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb00c9e70 msgr2=0x7f4fb00cbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb6c96700 1 --2- 172.21.15.50:0/5322122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb00c9e70 0x7f4fb00cbef0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0070b20 tx=0x7f4fac009b30 comp rx=0 tx=0).stop 2023-11-28T11:55:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb6c96700 1 -- 172.21.15.50:0/5322122 shutdown_connections 2023-11-28T11:55:02.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb6c96700 1 --2- 172.21.15.50:0/5322122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb00c9e70 0x7f4fb00cbef0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb6c96700 1 --2- 172.21.15.50:0/5322122 >> v2:172.21.15.192:3300/0 conn(0x7f4fb015c150 0x7f4fb01607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb6c96700 1 -- 172.21.15.50:0/5322122 >> 172.21.15.50:0/5322122 conn(0x7f4fb006ec40 msgr2=0x7f4fb00b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:02.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb6c96700 1 -- 172.21.15.50:0/5322122 shutdown_connections 2023-11-28T11:55:02.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.003+0000 7f4fb6c96700 1 -- 172.21.15.50:0/5322122 wait complete. 2023-11-28T11:55:02.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.007+0000 7f4fb6c96700 1 Processor -- start 2023-11-28T11:55:02.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.007+0000 7f4fb6c96700 1 -- start start 2023-11-28T11:55:02.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.007+0000 7f4fb6c96700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fb00c9e70 0x7f4fb0157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.007+0000 7f4fb6c96700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb00cc430 0x7f4fb015e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.007+0000 7f4fb6c96700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fb015c150 0x7f4fb015c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.007+0000 7f4fb6c96700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb015dc00 con 0x7f4fb00cc430 2023-11-28T11:55:02.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.007+0000 7f4fb6c96700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb015d360 con 0x7f4fb00c9e70 2023-11-28T11:55:02.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.007+0000 7f4fb6c96700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb015d640 con 0x7f4fb015c150 2023-11-28T11:55:02.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.007+0000 7f4fb5493700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb00cc430 0x7f4fb015e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.007+0000 7f4fb5493700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb00cc430 0x7f4fb015e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38648/0 (socket says 172.21.15.50:38648) 2023-11-28T11:55:02.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.007+0000 7f4fb5493700 1 -- 172.21.15.50:0/2426864335 learned_addr learned my addr 172.21.15.50:0/2426864335 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:02.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.007+0000 7f4fb6495700 1 --2- 172.21.15.50:0/2426864335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fb015c150 0x7f4fb015c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.007+0000 7f4fb5c94700 1 --2- 172.21.15.50:0/2426864335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fb00c9e70 0x7f4fb0157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.011+0000 7f4fb5493700 1 -- 172.21.15.50:0/2426864335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fb015c150 msgr2=0x7f4fb015c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.011+0000 7f4fb5493700 1 --2- 172.21.15.50:0/2426864335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fb015c150 0x7f4fb015c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.011+0000 7f4fb5493700 1 -- 172.21.15.50:0/2426864335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fb00c9e70 msgr2=0x7f4fb0157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.011+0000 7f4fb5493700 1 --2- 172.21.15.50:0/2426864335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fb00c9e70 0x7f4fb0157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.011+0000 7f4fb5493700 1 -- 172.21.15.50:0/2426864335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac0094b0 con 0x7f4fb00cc430 2023-11-28T11:55:02.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.011+0000 7f4fb6495700 1 --2- 172.21.15.50:0/2426864335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fb015c150 0x7f4fb015c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:02.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.011+0000 7f4fb5493700 1 --2- 172.21.15.50:0/2426864335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb00cc430 0x7f4fb015e470 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0090b0 tx=0x7f4fac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:02.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.011+0000 7f4fa67fc700 1 -- 172.21.15.50:0/2426864335 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac004570 con 0x7f4fb00cc430 2023-11-28T11:55:02.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.011+0000 7f4fa67fc700 1 -- 172.21.15.50:0/2426864335 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac01f070 con 0x7f4fb00cc430 2023-11-28T11:55:02.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.011+0000 7f4fb6c96700 1 -- 172.21.15.50:0/2426864335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb00cdb20 con 0x7f4fb00cc430 2023-11-28T11:55:02.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.011+0000 7f4fa67fc700 1 -- 172.21.15.50:0/2426864335 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac003900 con 0x7f4fb00cc430 2023-11-28T11:55:02.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.011+0000 7f4fb6c96700 1 -- 172.21.15.50:0/2426864335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb00cd840 con 0x7f4fb00cc430 2023-11-28T11:55:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.011+0000 7f4fa67fc700 1 -- 172.21.15.50:0/2426864335 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4fac02a020 con 0x7f4fb00cc430 2023-11-28T11:55:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.011+0000 7f4fb6c96700 1 -- 172.21.15.50:0/2426864335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb00cde00 con 0x7f4fb00cc430 2023-11-28T11:55:02.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.011+0000 7f4fa67fc700 1 --2- 172.21.15.50:0/2426864335 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4f94064ee0 0x7f4f94067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.011+0000 7f4fa67fc700 1 -- 172.21.15.50:0/2426864335 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4fac083380 con 0x7f4fb00cc430 2023-11-28T11:55:02.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.015+0000 7f4fb5c94700 1 --2- 172.21.15.50:0/2426864335 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4f94064ee0 0x7f4f94067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.015+0000 7f4fb5c94700 1 --2- 172.21.15.50:0/2426864335 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4f94064ee0 0x7f4f94067390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4fb015e230 tx=0x7f4fa0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:02.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.023+0000 7f4fa67fc700 1 -- 172.21.15.50:0/2426864335 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4fac0516b0 con 0x7f4fb00cc430 2023-11-28T11:55:02.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.243+0000 7f4fb6c96700 1 -- 172.21.15.50:0/2426864335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f4fb0072c20 con 0x7f4fb00cc430 2023-11-28T11:55:02.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.251+0000 7f4fa67fc700 1 -- 172.21.15.50:0/2426864335 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4fac054cd0 con 0x7f4fb00cc430 2023-11-28T11:55:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.251+0000 7f4fb6c96700 1 -- 172.21.15.50:0/2426864335 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4f94064ee0 msgr2=0x7f4f94067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.251+0000 7f4fb6c96700 1 --2- 172.21.15.50:0/2426864335 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4f94064ee0 0x7f4f94067390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4fb015e230 tx=0x7f4fa0008040 comp rx=0 tx=0).stop 2023-11-28T11:55:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.251+0000 7f4fb6c96700 1 -- 172.21.15.50:0/2426864335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb00cc430 msgr2=0x7f4fb015e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.251+0000 7f4fb6c96700 1 --2- 172.21.15.50:0/2426864335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb00cc430 0x7f4fb015e470 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0090b0 tx=0x7f4fac004770 comp rx=0 tx=0).stop 2023-11-28T11:55:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.251+0000 7f4fb6c96700 1 -- 172.21.15.50:0/2426864335 shutdown_connections 2023-11-28T11:55:02.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.251+0000 7f4fb6c96700 1 --2- 172.21.15.50:0/2426864335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fb015c150 0x7f4fb015c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.251+0000 7f4fb6c96700 1 --2- 172.21.15.50:0/2426864335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb00cc430 0x7f4fb015e470 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.251+0000 7f4fb6c96700 1 --2- 172.21.15.50:0/2426864335 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4f94064ee0 0x7f4f94067390 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.251+0000 7f4fb6c96700 1 --2- 172.21.15.50:0/2426864335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fb00c9e70 0x7f4fb0157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.251+0000 7f4fb6c96700 1 -- 172.21.15.50:0/2426864335 >> 172.21.15.50:0/2426864335 conn(0x7f4fb006ec40 msgr2=0x7f4fb015a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.251+0000 7f4fb6c96700 1 -- 172.21.15.50:0/2426864335 shutdown_connections 2023-11-28T11:55:02.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.251+0000 7f4fb6c96700 1 -- 172.21.15.50:0/2426864335 wait complete. 2023-11-28T11:55:02.268 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:55:02.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.379+0000 7f8a1edcd700 1 Processor -- start 2023-11-28T11:55:02.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.379+0000 7f8a1edcd700 1 -- start start 2023-11-28T11:55:02.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.379+0000 7f8a1edcd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a181607b0 0x7f8a180cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.379+0000 7f8a1edcd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a180cc430 0x7f8a180ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.379+0000 7f8a1edcd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a1815c520 con 0x7f8a1815c150 2023-11-28T11:55:02.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.379+0000 7f8a1edcd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a18160c00 con 0x7f8a180cc430 2023-11-28T11:55:02.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.379+0000 7f8a1edcd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a180ca680 con 0x7f8a181607b0 2023-11-28T11:55:02.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.379+0000 7f8a1e5cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a180cc430 0x7f8a180ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.379+0000 7f8a1e5cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a180cc430 0x7f8a180ce320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38652/0 (socket says 172.21.15.50:38652) 2023-11-28T11:55:02.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.379+0000 7f8a1e5cc700 1 -- 172.21.15.50:0/3241340423 learned_addr learned my addr 172.21.15.50:0/3241340423 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:02.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1d5ca700 1 --2- 172.21.15.50:0/3241340423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a181607b0 0x7f8a180cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1e5cc700 1 -- 172.21.15.50:0/3241340423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a181607b0 msgr2=0x7f8a180cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:02.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1e5cc700 1 --2- 172.21.15.50:0/3241340423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a181607b0 0x7f8a180cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1e5cc700 1 -- 172.21.15.50:0/3241340423 >> v1:172.21.15.192:6789/0 conn(0x7f8a1815c150 legacy=0x7f8a180c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1e5cc700 1 -- 172.21.15.50:0/3241340423 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a180ca960 con 0x7f8a180cc430 2023-11-28T11:55:02.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1e5cc700 1 --2- 172.21.15.50:0/3241340423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a180cc430 0x7f8a180ce320 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009e50 tx=0x7f8a1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e56828ee9d6df0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:02.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1cdc9700 1 -- 172.21.15.50:0/3241340423 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1000e070 con 0x7f8a180cc430 2023-11-28T11:55:02.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1cdc9700 1 -- 172.21.15.50:0/3241340423 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1000b910 con 0x7f8a180cc430 2023-11-28T11:55:02.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1cdc9700 1 -- 172.21.15.50:0/3241340423 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1000bcc0 con 0x7f8a180cc430 2023-11-28T11:55:02.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1edcd700 1 -- 172.21.15.50:0/3241340423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a180cc430 msgr2=0x7f8a180ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1edcd700 1 --2- 172.21.15.50:0/3241340423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a180cc430 0x7f8a180ce320 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009e50 tx=0x7f8a1000b330 comp rx=0 tx=0).stop 2023-11-28T11:55:02.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1edcd700 1 -- 172.21.15.50:0/3241340423 shutdown_connections 2023-11-28T11:55:02.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1edcd700 1 --2- 172.21.15.50:0/3241340423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a180cc430 0x7f8a180ce320 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1edcd700 1 --2- 172.21.15.50:0/3241340423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a181607b0 0x7f8a180cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1edcd700 1 -- 172.21.15.50:0/3241340423 >> 172.21.15.50:0/3241340423 conn(0x7f8a1806ec40 msgr2=0x7f8a180b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:02.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1edcd700 1 -- 172.21.15.50:0/3241340423 shutdown_connections 2023-11-28T11:55:02.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1edcd700 1 -- 172.21.15.50:0/3241340423 wait complete. 2023-11-28T11:55:02.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.383+0000 7f8a1edcd700 1 Processor -- start 2023-11-28T11:55:02.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1edcd700 1 -- start start 2023-11-28T11:55:02.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1edcd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a180cc430 0x7f8a180b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1edcd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a1815c150 0x7f8a181f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1edcd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a181607b0 0x7f8a181f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1edcd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a181f2390 con 0x7f8a1815c150 2023-11-28T11:55:02.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1edcd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a180c3140 con 0x7f8a181607b0 2023-11-28T11:55:02.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1edcd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a180c33e0 con 0x7f8a180cc430 2023-11-28T11:55:02.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1d5ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a1815c150 0x7f8a181f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1d5ca700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a1815c150 0x7f8a181f1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38662/0 (socket says 172.21.15.50:38662) 2023-11-28T11:55:02.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1d5ca700 1 -- 172.21.15.50:0/329616507 learned_addr learned my addr 172.21.15.50:0/329616507 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:02.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1ddcb700 1 --2- 172.21.15.50:0/329616507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a180cc430 0x7f8a180b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1e5cc700 1 --2- 172.21.15.50:0/329616507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a181607b0 0x7f8a181f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1d5ca700 1 -- 172.21.15.50:0/329616507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a180cc430 msgr2=0x7f8a180b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1d5ca700 1 --2- 172.21.15.50:0/329616507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a180cc430 0x7f8a180b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1d5ca700 1 -- 172.21.15.50:0/329616507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a181607b0 msgr2=0x7f8a181f2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1d5ca700 1 --2- 172.21.15.50:0/329616507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a181607b0 0x7f8a181f2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1d5ca700 1 -- 172.21.15.50:0/329616507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a10009b30 con 0x7f8a1815c150 2023-11-28T11:55:02.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1ddcb700 1 --2- 172.21.15.50:0/329616507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a180cc430 0x7f8a180b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:02.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1d5ca700 1 --2- 172.21.15.50:0/329616507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a1815c150 0x7f8a181f1e50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800e840 tx=0x7f8a0800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:02.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a0e7fc700 1 -- 172.21.15.50:0/329616507 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a080095a0 con 0x7f8a1815c150 2023-11-28T11:55:02.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a0e7fc700 1 -- 172.21.15.50:0/329616507 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0800c690 con 0x7f8a1815c150 2023-11-28T11:55:02.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1edcd700 1 -- 172.21.15.50:0/329616507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a180cdb20 con 0x7f8a1815c150 2023-11-28T11:55:02.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a0e7fc700 1 -- 172.21.15.50:0/329616507 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0800ca00 con 0x7f8a1815c150 2023-11-28T11:55:02.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.387+0000 7f8a1edcd700 1 -- 172.21.15.50:0/329616507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a180cd840 con 0x7f8a1815c150 2023-11-28T11:55:02.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.391+0000 7f8a1edcd700 1 -- 172.21.15.50:0/329616507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a180cde00 con 0x7f8a1815c150 2023-11-28T11:55:02.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.391+0000 7f8a0e7fc700 1 -- 172.21.15.50:0/329616507 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8a08019030 con 0x7f8a1815c150 2023-11-28T11:55:02.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.391+0000 7f8a0e7fc700 1 --2- 172.21.15.50:0/329616507 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f89fc064ee0 0x7f89fc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.391+0000 7f8a0e7fc700 1 -- 172.21.15.50:0/329616507 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8a08081cf0 con 0x7f8a1815c150 2023-11-28T11:55:02.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.391+0000 7f8a1ddcb700 1 --2- 172.21.15.50:0/329616507 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f89fc064ee0 0x7f89fc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.391+0000 7f8a1ddcb700 1 --2- 172.21.15.50:0/329616507 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f89fc064ee0 0x7f89fc067390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8a1806c650 tx=0x7f8a14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:02.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.399+0000 7f8a0e7fc700 1 -- 172.21.15.50:0/329616507 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8a0804fed0 con 0x7f8a1815c150 2023-11-28T11:55:02.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.563+0000 7f8a1edcd700 1 -- 172.21.15.50:0/329616507 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a18072c20 con 0x7f8a1815c150 2023-11-28T11:55:02.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.563+0000 7f8a0e7fc700 1 -- 172.21.15.50:0/329616507 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+14318 (secure 0 0 0) 0x7f8a080534f0 con 0x7f8a1815c150 2023-11-28T11:55:02.567 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:02.567 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":36,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:54:59.503517+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:55:02.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.567+0000 7f8a1edcd700 1 -- 172.21.15.50:0/329616507 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f89fc064ee0 msgr2=0x7f89fc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.567+0000 7f8a1edcd700 1 --2- 172.21.15.50:0/329616507 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f89fc064ee0 0x7f89fc067390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8a1806c650 tx=0x7f8a14009040 comp rx=0 tx=0).stop 2023-11-28T11:55:02.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.567+0000 7f8a1edcd700 1 -- 172.21.15.50:0/329616507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a1815c150 msgr2=0x7f8a181f1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.567+0000 7f8a1edcd700 1 --2- 172.21.15.50:0/329616507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a1815c150 0x7f8a181f1e50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800e840 tx=0x7f8a0800ec00 comp rx=0 tx=0).stop 2023-11-28T11:55:02.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.567+0000 7f8a1edcd700 1 -- 172.21.15.50:0/329616507 shutdown_connections 2023-11-28T11:55:02.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.567+0000 7f8a1edcd700 1 --2- 172.21.15.50:0/329616507 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f89fc064ee0 0x7f89fc067390 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.567+0000 7f8a1edcd700 1 --2- 172.21.15.50:0/329616507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a181607b0 0x7f8a181f2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.567+0000 7f8a1edcd700 1 --2- 172.21.15.50:0/329616507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a1815c150 0x7f8a181f1e50 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.567+0000 7f8a1edcd700 1 --2- 172.21.15.50:0/329616507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a180cc430 0x7f8a180b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.567+0000 7f8a1edcd700 1 -- 172.21.15.50:0/329616507 >> 172.21.15.50:0/329616507 conn(0x7f8a1806ec40 msgr2=0x7f8a180c9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:02.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.567+0000 7f8a1edcd700 1 -- 172.21.15.50:0/329616507 shutdown_connections 2023-11-28T11:55:02.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.567+0000 7f8a1edcd700 1 -- 172.21.15.50:0/329616507 wait complete. 2023-11-28T11:55:02.582 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:55:02.583 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:55:02.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.703+0000 7f4d32752700 1 Processor -- start 2023-11-28T11:55:02.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.703+0000 7f4d32752700 1 -- start start 2023-11-28T11:55:02.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.703+0000 7f4d32752700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d2c0cc2f0 0x7f4d2c0ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.703+0000 7f4d32752700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4d2c15a3e0 0x7f4d2c0cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.703+0000 7f4d32752700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2c09c0e0 con 0x7f4d2c0b2d30 2023-11-28T11:55:02.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.703+0000 7f4d32752700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c0ccc00 con 0x7f4d2c15a3e0 2023-11-28T11:55:02.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.703+0000 7f4d32752700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0b13e0 con 0x7f4d2c0cc2f0 2023-11-28T11:55:02.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.703+0000 7f4d30f4f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4d2c15a3e0 0x7f4d2c0cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.703+0000 7f4d31750700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d2c0cc2f0 0x7f4d2c0ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.703+0000 7f4d31f51700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4d2c0b2d30 0x7f4d2c069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:37982/0 (socket says 172.21.15.50:37982) 2023-11-28T11:55:02.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.703+0000 7f4d30f4f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4d2c15a3e0 0x7f4d2c0cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:33636/0 (socket says 172.21.15.50:33636) 2023-11-28T11:55:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.703+0000 7f4d31f51700 1 -- 172.21.15.50:0/2574725 learned_addr learned my addr 172.21.15.50:0/2574725 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.703+0000 7f4d30f4f700 1 -- 172.21.15.50:0/2574725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d2c0cc2f0 msgr2=0x7f4d2c0ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.703+0000 7f4d30f4f700 1 --2- 172.21.15.50:0/2574725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d2c0cc2f0 0x7f4d2c0ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.703+0000 7f4d30f4f700 1 -- 172.21.15.50:0/2574725 >> v1:172.21.15.192:6789/0 conn(0x7f4d2c0b2d30 legacy=0x7f4d2c069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.703+0000 7f4d30f4f700 1 -- 172.21.15.50:0/2574725 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c0b16c0 con 0x7f4d2c15a3e0 2023-11-28T11:55:02.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.707+0000 7f4d30f4f700 1 --2- 172.21.15.50:0/2574725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d2c15a3e0 0x7f4d2c0cc6c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009d90 tx=0x7f4d2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34d684b20bea2af3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.707+0000 7f4d23fff700 1 -- 172.21.15.50:0/2574725 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2800e070 con 0x7f4d2c15a3e0 2023-11-28T11:55:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.707+0000 7f4d23fff700 1 -- 172.21.15.50:0/2574725 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2800bb20 con 0x7f4d2c15a3e0 2023-11-28T11:55:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.707+0000 7f4d23fff700 1 -- 172.21.15.50:0/2574725 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28012430 con 0x7f4d2c15a3e0 2023-11-28T11:55:02.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.707+0000 7f4d32752700 1 -- 172.21.15.50:0/2574725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d2c15a3e0 msgr2=0x7f4d2c0cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.707+0000 7f4d32752700 1 --2- 172.21.15.50:0/2574725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d2c15a3e0 0x7f4d2c0cc6c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009d90 tx=0x7f4d2800b330 comp rx=0 tx=0).stop 2023-11-28T11:55:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.707+0000 7f4d32752700 1 -- 172.21.15.50:0/2574725 shutdown_connections 2023-11-28T11:55:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.707+0000 7f4d32752700 1 --2- 172.21.15.50:0/2574725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d2c15a3e0 0x7f4d2c0cc6c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.707+0000 7f4d32752700 1 --2- 172.21.15.50:0/2574725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d2c0cc2f0 0x7f4d2c0ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.707+0000 7f4d32752700 1 -- 172.21.15.50:0/2574725 >> 172.21.15.50:0/2574725 conn(0x7f4d2c0cae70 msgr2=0x7f4d2c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:02.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.707+0000 7f4d32752700 1 -- 172.21.15.50:0/2574725 shutdown_connections 2023-11-28T11:55:02.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.707+0000 7f4d32752700 1 -- 172.21.15.50:0/2574725 wait complete. 2023-11-28T11:55:02.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.707+0000 7f4d32752700 1 Processor -- start 2023-11-28T11:55:02.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.707+0000 7f4d32752700 1 -- start start 2023-11-28T11:55:02.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d32752700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d2c0b2d30 0x7f4d2c06fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d32752700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d2c0cc2f0 0x7f4d2c071b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d32752700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c15a3e0 0x7f4d2c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d32752700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c1f0ba0 con 0x7f4d2c15a3e0 2023-11-28T11:55:02.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d32752700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c1f0e80 con 0x7f4d2c0b2d30 2023-11-28T11:55:02.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d32752700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c1f1160 con 0x7f4d2c0cc2f0 2023-11-28T11:55:02.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d31f51700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c15a3e0 0x7f4d2c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d31f51700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c15a3e0 0x7f4d2c15bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38678/0 (socket says 172.21.15.50:38678) 2023-11-28T11:55:02.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d31f51700 1 -- 172.21.15.50:0/863241116 learned_addr learned my addr 172.21.15.50:0/863241116 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:02.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d31750700 1 --2- 172.21.15.50:0/863241116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d2c0b2d30 0x7f4d2c06fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d30f4f700 1 --2- 172.21.15.50:0/863241116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d2c0cc2f0 0x7f4d2c071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d31750700 1 -- 172.21.15.50:0/863241116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d2c0cc2f0 msgr2=0x7f4d2c071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d31750700 1 --2- 172.21.15.50:0/863241116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d2c0cc2f0 0x7f4d2c071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d31750700 1 -- 172.21.15.50:0/863241116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c15a3e0 msgr2=0x7f4d2c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d31750700 1 --2- 172.21.15.50:0/863241116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c15a3e0 0x7f4d2c15bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d31750700 1 -- 172.21.15.50:0/863241116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d28009a70 con 0x7f4d2c0b2d30 2023-11-28T11:55:02.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d31750700 1 --2- 172.21.15.50:0/863241116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d2c0b2d30 0x7f4d2c06fc40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00e870 tx=0x7f4d1c00eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:02.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d21ffb700 1 -- 172.21.15.50:0/863241116 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c013680 con 0x7f4d2c0b2d30 2023-11-28T11:55:02.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d21ffb700 1 -- 172.21.15.50:0/863241116 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c0137e0 con 0x7f4d2c0b2d30 2023-11-28T11:55:02.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d32752700 1 -- 172.21.15.50:0/863241116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c0b1c80 con 0x7f4d2c0b2d30 2023-11-28T11:55:02.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d21ffb700 1 -- 172.21.15.50:0/863241116 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c013b70 con 0x7f4d2c0b2d30 2023-11-28T11:55:02.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d32752700 1 -- 172.21.15.50:0/863241116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2c0b19a0 con 0x7f4d2c0b2d30 2023-11-28T11:55:02.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.711+0000 7f4d32752700 1 -- 172.21.15.50:0/863241116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2c06a350 con 0x7f4d2c0b2d30 2023-11-28T11:55:02.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.715+0000 7f4d21ffb700 1 -- 172.21.15.50:0/863241116 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4d1c019030 con 0x7f4d2c0b2d30 2023-11-28T11:55:02.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.715+0000 7f4d21ffb700 1 --2- 172.21.15.50:0/863241116 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4d10064ee0 0x7f4d10067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:02.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.715+0000 7f4d21ffb700 1 -- 172.21.15.50:0/863241116 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4d1c082100 con 0x7f4d2c0b2d30 2023-11-28T11:55:02.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.715+0000 7f4d30f4f700 1 --2- 172.21.15.50:0/863241116 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4d10064ee0 0x7f4d10067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:02.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.715+0000 7f4d30f4f700 1 --2- 172.21.15.50:0/863241116 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4d10064ee0 0x7f4d10067390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0b44a0 tx=0x7f4d28011000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:02.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.723+0000 7f4d21ffb700 1 -- 172.21.15.50:0/863241116 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4d1c0504b0 con 0x7f4d2c0b2d30 2023-11-28T11:55:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.887+0000 7f4d32752700 1 -- 172.21.15.50:0/863241116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4d2c072500 con 0x7f4d2c0b2d30 2023-11-28T11:55:02.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.887+0000 7f4d21ffb700 1 -- 172.21.15.50:0/863241116 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4d1c021020 con 0x7f4d2c0b2d30 2023-11-28T11:55:02.891 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:55:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.891+0000 7f4d32752700 1 -- 172.21.15.50:0/863241116 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4d10064ee0 msgr2=0x7f4d10067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.891+0000 7f4d32752700 1 --2- 172.21.15.50:0/863241116 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4d10064ee0 0x7f4d10067390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0b44a0 tx=0x7f4d28011000 comp rx=0 tx=0).stop 2023-11-28T11:55:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.891+0000 7f4d32752700 1 -- 172.21.15.50:0/863241116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d2c0b2d30 msgr2=0x7f4d2c06fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.891+0000 7f4d32752700 1 --2- 172.21.15.50:0/863241116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d2c0b2d30 0x7f4d2c06fc40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00e870 tx=0x7f4d1c00eb80 comp rx=0 tx=0).stop 2023-11-28T11:55:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.891+0000 7f4d32752700 1 -- 172.21.15.50:0/863241116 shutdown_connections 2023-11-28T11:55:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.891+0000 7f4d32752700 1 --2- 172.21.15.50:0/863241116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d2c15a3e0 0x7f4d2c15bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.891+0000 7f4d32752700 1 --2- 172.21.15.50:0/863241116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d2c0cc2f0 0x7f4d2c071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.891+0000 7f4d32752700 1 --2- 172.21.15.50:0/863241116 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4d10064ee0 0x7f4d10067390 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.891+0000 7f4d32752700 1 --2- 172.21.15.50:0/863241116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d2c0b2d30 0x7f4d2c06fc40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.891+0000 7f4d32752700 1 -- 172.21.15.50:0/863241116 >> 172.21.15.50:0/863241116 conn(0x7f4d2c0cae70 msgr2=0x7f4d2c06b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:02.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.891+0000 7f4d32752700 1 -- 172.21.15.50:0/863241116 shutdown_connections 2023-11-28T11:55:02.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:02.891+0000 7f4d32752700 1 -- 172.21.15.50:0/863241116 wait complete. 2023-11-28T11:55:02.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:55:03.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.019+0000 7fe372a65700 1 Processor -- start 2023-11-28T11:55:03.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.019+0000 7fe372a65700 1 -- start start 2023-11-28T11:55:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe372a65700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe36c0b00e0 0x7fe36c15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe372a65700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe36c09bdb0 0x7fe36c15d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe372a65700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe36c0cbb30 0x7fe36c15dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe372a65700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36c0b2db0 con 0x7fe36c09bdb0 2023-11-28T11:55:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe372a65700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36c0b3240 con 0x7fe36c0cbb30 2023-11-28T11:55:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe372a65700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c06d840 con 0x7fe36c0b00e0 2023-11-28T11:55:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe371262700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe36c09bdb0 0x7fe36c15d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe371262700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe36c09bdb0 0x7fe36c15d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38690/0 (socket says 172.21.15.50:38690) 2023-11-28T11:55:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe371262700 1 -- 172.21.15.50:0/1534784677 learned_addr learned my addr 172.21.15.50:0/1534784677 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe372264700 1 --2- 172.21.15.50:0/1534784677 >> v2:172.21.15.192:3300/0 conn(0x7fe36c0cbb30 0x7fe36c15dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe371a63700 1 --2- 172.21.15.50:0/1534784677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe36c0b00e0 0x7fe36c15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe371262700 1 -- 172.21.15.50:0/1534784677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe36c0b00e0 msgr2=0x7fe36c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe371262700 1 --2- 172.21.15.50:0/1534784677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe36c0b00e0 0x7fe36c15d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe371262700 1 -- 172.21.15.50:0/1534784677 >> v2:172.21.15.192:3300/0 conn(0x7fe36c0cbb30 msgr2=0x7fe36c15dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe371262700 1 --2- 172.21.15.50:0/1534784677 >> v2:172.21.15.192:3300/0 conn(0x7fe36c0cbb30 0x7fe36c15dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe371262700 1 -- 172.21.15.50:0/1534784677 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c06d560 con 0x7fe36c09bdb0 2023-11-28T11:55:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe372264700 1 --2- 172.21.15.50:0/1534784677 >> v2:172.21.15.192:3300/0 conn(0x7fe36c0cbb30 0x7fe36c15dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:03.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe371262700 1 --2- 172.21.15.50:0/1534784677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c09bdb0 0x7fe36c15d820 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0ac6b0 tx=0x7fe35c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261f5b7290dcb100 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe370a61700 1 -- 172.21.15.50:0/1534784677 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c00b8a0 con 0x7fe36c09bdb0 2023-11-28T11:55:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe370a61700 1 -- 172.21.15.50:0/1534784677 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35c00ba00 con 0x7fe36c09bdb0 2023-11-28T11:55:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.023+0000 7fe370a61700 1 -- 172.21.15.50:0/1534784677 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c00bd90 con 0x7fe36c09bdb0 2023-11-28T11:55:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.027+0000 7fe372a65700 1 -- 172.21.15.50:0/1534784677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c09bdb0 msgr2=0x7fe36c15d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.027+0000 7fe372a65700 1 --2- 172.21.15.50:0/1534784677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c09bdb0 0x7fe36c15d820 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0ac6b0 tx=0x7fe35c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.027+0000 7fe372a65700 1 -- 172.21.15.50:0/1534784677 shutdown_connections 2023-11-28T11:55:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.027+0000 7fe372a65700 1 --2- 172.21.15.50:0/1534784677 >> v2:172.21.15.192:3300/0 conn(0x7fe36c0cbb30 0x7fe36c15dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.027+0000 7fe372a65700 1 --2- 172.21.15.50:0/1534784677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c09bdb0 0x7fe36c15d820 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.027+0000 7fe372a65700 1 --2- 172.21.15.50:0/1534784677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe36c0b00e0 0x7fe36c15d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.027+0000 7fe372a65700 1 -- 172.21.15.50:0/1534784677 >> 172.21.15.50:0/1534784677 conn(0x7fe36c0cae70 msgr2=0x7fe36c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.027+0000 7fe372a65700 1 -- 172.21.15.50:0/1534784677 shutdown_connections 2023-11-28T11:55:03.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.027+0000 7fe372a65700 1 -- 172.21.15.50:0/1534784677 wait complete. 2023-11-28T11:55:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.027+0000 7fe372a65700 1 Processor -- start 2023-11-28T11:55:03.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.027+0000 7fe372a65700 1 -- start start 2023-11-28T11:55:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372a65700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe36c09bdb0 0x7fe36c1549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372a65700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe36c0b00e0 0x7fe36c159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372a65700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cbb30 0x7fe36c0add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372a65700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c1f9b60 con 0x7fe36c0cbb30 2023-11-28T11:55:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372a65700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c154f30 con 0x7fe36c0b00e0 2023-11-28T11:55:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372a65700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c1f8ee0 con 0x7fe36c09bdb0 2023-11-28T11:55:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372264700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cbb30 0x7fe36c0add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372264700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cbb30 0x7fe36c0add50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38700/0 (socket says 172.21.15.50:38700) 2023-11-28T11:55:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372264700 1 -- 172.21.15.50:0/2309291713 learned_addr learned my addr 172.21.15.50:0/2309291713 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe371a63700 1 --2- 172.21.15.50:0/2309291713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe36c09bdb0 0x7fe36c1549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe371262700 1 --2- 172.21.15.50:0/2309291713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe36c0b00e0 0x7fe36c159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372264700 1 -- 172.21.15.50:0/2309291713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe36c09bdb0 msgr2=0x7fe36c1549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372264700 1 --2- 172.21.15.50:0/2309291713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe36c09bdb0 0x7fe36c1549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372264700 1 -- 172.21.15.50:0/2309291713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe36c0b00e0 msgr2=0x7fe36c159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372264700 1 --2- 172.21.15.50:0/2309291713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe36c0b00e0 0x7fe36c159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372264700 1 -- 172.21.15.50:0/2309291713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c009570 con 0x7fe36c0cbb30 2023-11-28T11:55:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372264700 1 --2- 172.21.15.50:0/2309291713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cbb30 0x7fe36c0add50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe364007e70 tx=0x7fe36400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe3627fc700 1 -- 172.21.15.50:0/2309291713 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36400dcc0 con 0x7fe36c0cbb30 2023-11-28T11:55:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe3627fc700 1 -- 172.21.15.50:0/2309291713 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36400f040 con 0x7fe36c0cbb30 2023-11-28T11:55:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372a65700 1 -- 172.21.15.50:0/2309291713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36c0ac3d0 con 0x7fe36c0cbb30 2023-11-28T11:55:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe3627fc700 1 -- 172.21.15.50:0/2309291713 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364015640 con 0x7fe36c0cbb30 2023-11-28T11:55:03.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372a65700 1 -- 172.21.15.50:0/2309291713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36c0ac0f0 con 0x7fe36c0cbb30 2023-11-28T11:55:03.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.031+0000 7fe372a65700 1 -- 172.21.15.50:0/2309291713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe36c0cc9f0 con 0x7fe36c0cbb30 2023-11-28T11:55:03.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.035+0000 7fe3627fc700 1 -- 172.21.15.50:0/2309291713 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe36401c030 con 0x7fe36c0cbb30 2023-11-28T11:55:03.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.035+0000 7fe3627fc700 1 --2- 172.21.15.50:0/2309291713 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe350064ee0 0x7fe350067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.035+0000 7fe3627fc700 1 -- 172.21.15.50:0/2309291713 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe364081bc0 con 0x7fe36c0cbb30 2023-11-28T11:55:03.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.035+0000 7fe371a63700 1 --2- 172.21.15.50:0/2309291713 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe350064ee0 0x7fe350067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.035+0000 7fe371a63700 1 --2- 172.21.15.50:0/2309291713 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe350064ee0 0x7fe350067390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe368009970 tx=0x7fe368008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:03.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.043+0000 7fe3627fc700 1 -- 172.21.15.50:0/2309291713 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe36404ff10 con 0x7fe36c0cbb30 2023-11-28T11:55:03.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.203+0000 7fe372a65700 1 -- 172.21.15.50:0/2309291713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe36c0b1bc0 con 0x7fe36c0cbb30 2023-11-28T11:55:03.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.203+0000 7fe3627fc700 1 -- 172.21.15.50:0/2309291713 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe36401a020 con 0x7fe36c0cbb30 2023-11-28T11:55:03.206 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:55:03.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.207+0000 7fe372a65700 1 -- 172.21.15.50:0/2309291713 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe350064ee0 msgr2=0x7fe350067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:03.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.207+0000 7fe372a65700 1 --2- 172.21.15.50:0/2309291713 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe350064ee0 0x7fe350067390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe368009970 tx=0x7fe368008040 comp rx=0 tx=0).stop 2023-11-28T11:55:03.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.207+0000 7fe372a65700 1 -- 172.21.15.50:0/2309291713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cbb30 msgr2=0x7fe36c0add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:03.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.207+0000 7fe372a65700 1 --2- 172.21.15.50:0/2309291713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cbb30 0x7fe36c0add50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe364007e70 tx=0x7fe36400d3b0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.207+0000 7fe372a65700 1 -- 172.21.15.50:0/2309291713 shutdown_connections 2023-11-28T11:55:03.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.207+0000 7fe372a65700 1 --2- 172.21.15.50:0/2309291713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe36c0cbb30 0x7fe36c0add50 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.207+0000 7fe372a65700 1 --2- 172.21.15.50:0/2309291713 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe350064ee0 0x7fe350067390 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.207+0000 7fe372a65700 1 --2- 172.21.15.50:0/2309291713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe36c0b00e0 0x7fe36c159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.207+0000 7fe372a65700 1 --2- 172.21.15.50:0/2309291713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe36c09bdb0 0x7fe36c1549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.207+0000 7fe372a65700 1 -- 172.21.15.50:0/2309291713 >> 172.21.15.50:0/2309291713 conn(0x7fe36c0cae70 msgr2=0x7fe36c0af140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:03.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.207+0000 7fe372a65700 1 -- 172.21.15.50:0/2309291713 shutdown_connections 2023-11-28T11:55:03.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.207+0000 7fe372a65700 1 -- 172.21.15.50:0/2309291713 wait complete. 2023-11-28T11:55:03.221 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T11:55:03.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.331+0000 7f142e39b700 1 Processor -- start 2023-11-28T11:55:03.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.331+0000 7f142e39b700 1 -- start start 2023-11-28T11:55:03.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f142e39b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1428158fd0 0x7f142806ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f142e39b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14280b1cb0 0x7f14280b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f142e39b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14280b2dc0 con 0x7f14280706f0 2023-11-28T11:55:03.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f142e39b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142806b070 con 0x7f1428158fd0 2023-11-28T11:55:03.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f142e39b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14280b21b0 con 0x7f14280b1cb0 2023-11-28T11:55:03.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f142cb98700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1428158fd0 0x7f142806ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f142db9a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14280b1cb0 0x7f14280b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f142cb98700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1428158fd0 0x7f142806ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:33672/0 (socket says 172.21.15.50:33672) 2023-11-28T11:55:03.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f142db9a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14280b1cb0 0x7f14280b3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:45818/0 (socket says 172.21.15.50:45818) 2023-11-28T11:55:03.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f142cb98700 1 -- 172.21.15.50:0/917289194 learned_addr learned my addr 172.21.15.50:0/917289194 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:03.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f142db9a700 1 -- 172.21.15.50:0/917289194 >> v2:172.21.15.192:3300/0 conn(0x7f1428158fd0 msgr2=0x7f142806ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f142db9a700 1 --2- 172.21.15.50:0/917289194 >> v2:172.21.15.192:3300/0 conn(0x7f1428158fd0 0x7f142806ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f142db9a700 1 -- 172.21.15.50:0/917289194 >> v1:172.21.15.192:6789/0 conn(0x7f14280706f0 legacy=0x7f1428070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f142db9a700 1 -- 172.21.15.50:0/917289194 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14280b2490 con 0x7f14280b1cb0 2023-11-28T11:55:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f142db9a700 1 --2- 172.21.15.50:0/917289194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14280b1cb0 0x7f14280b3250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1420009d90 tx=0x7f142000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdd8300ba1172975 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f141ffff700 1 -- 172.21.15.50:0/917289194 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142000e070 con 0x7f14280b1cb0 2023-11-28T11:55:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f141ffff700 1 -- 172.21.15.50:0/917289194 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142000bb20 con 0x7f14280b1cb0 2023-11-28T11:55:03.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.335+0000 7f141ffff700 1 -- 172.21.15.50:0/917289194 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420012430 con 0x7f14280b1cb0 2023-11-28T11:55:03.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142e39b700 1 -- 172.21.15.50:0/917289194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14280b1cb0 msgr2=0x7f14280b3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:03.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142e39b700 1 --2- 172.21.15.50:0/917289194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14280b1cb0 0x7f14280b3250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1420009d90 tx=0x7f142000b330 comp rx=0 tx=0).stop 2023-11-28T11:55:03.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142e39b700 1 -- 172.21.15.50:0/917289194 shutdown_connections 2023-11-28T11:55:03.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142e39b700 1 --2- 172.21.15.50:0/917289194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14280b1cb0 0x7f14280b3250 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142e39b700 1 --2- 172.21.15.50:0/917289194 >> v2:172.21.15.192:3300/0 conn(0x7f1428158fd0 0x7f142806ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142e39b700 1 -- 172.21.15.50:0/917289194 >> 172.21.15.50:0/917289194 conn(0x7f142806e000 msgr2=0x7f14280b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:03.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142e39b700 1 -- 172.21.15.50:0/917289194 shutdown_connections 2023-11-28T11:55:03.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142e39b700 1 -- 172.21.15.50:0/917289194 wait complete. 2023-11-28T11:55:03.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142e39b700 1 Processor -- start 2023-11-28T11:55:03.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142e39b700 1 -- start start 2023-11-28T11:55:03.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142e39b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14280706f0 0x7f142815da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142e39b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14280b1cb0 0x7f142815e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142e39b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1428158fd0 0x7f142815ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142e39b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142815e100 con 0x7f14280b1cb0 2023-11-28T11:55:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142e39b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14281650c0 con 0x7f14280706f0 2023-11-28T11:55:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142e39b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142815b710 con 0x7f1428158fd0 2023-11-28T11:55:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142cb98700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14280b1cb0 0x7f142815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142cb98700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14280b1cb0 0x7f142815e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38714/0 (socket says 172.21.15.50:38714) 2023-11-28T11:55:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142cb98700 1 -- 172.21.15.50:0/1383650583 learned_addr learned my addr 172.21.15.50:0/1383650583 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142db9a700 1 --2- 172.21.15.50:0/1383650583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1428158fd0 0x7f142815ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.339+0000 7f142d399700 1 --2- 172.21.15.50:0/1383650583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14280706f0 0x7f142815da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.343+0000 7f142cb98700 1 -- 172.21.15.50:0/1383650583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1428158fd0 msgr2=0x7f142815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:03.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.343+0000 7f142cb98700 1 --2- 172.21.15.50:0/1383650583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1428158fd0 0x7f142815ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.343+0000 7f142cb98700 1 -- 172.21.15.50:0/1383650583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14280706f0 msgr2=0x7f142815da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:03.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.343+0000 7f142cb98700 1 --2- 172.21.15.50:0/1383650583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14280706f0 0x7f142815da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.343+0000 7f142cb98700 1 -- 172.21.15.50:0/1383650583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1420009a70 con 0x7f14280b1cb0 2023-11-28T11:55:03.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.343+0000 7f142db9a700 1 --2- 172.21.15.50:0/1383650583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1428158fd0 0x7f142815ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:03.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.343+0000 7f142cb98700 1 --2- 172.21.15.50:0/1383650583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14280b1cb0 0x7f142815e740 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f141800e890 tx=0x7f141800eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:03.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.343+0000 7f141dffb700 1 -- 172.21.15.50:0/1383650583 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1418009620 con 0x7f14280b1cb0 2023-11-28T11:55:03.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.343+0000 7f141dffb700 1 -- 172.21.15.50:0/1383650583 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1418013680 con 0x7f14280b1cb0 2023-11-28T11:55:03.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.343+0000 7f142e39b700 1 -- 172.21.15.50:0/1383650583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14280b2a50 con 0x7f14280b1cb0 2023-11-28T11:55:03.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.343+0000 7f141dffb700 1 -- 172.21.15.50:0/1383650583 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1418013a30 con 0x7f14280b1cb0 2023-11-28T11:55:03.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.343+0000 7f142e39b700 1 -- 172.21.15.50:0/1383650583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14280b2770 con 0x7f14280b1cb0 2023-11-28T11:55:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.343+0000 7f142e39b700 1 -- 172.21.15.50:0/1383650583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1428069ef0 con 0x7f14280b1cb0 2023-11-28T11:55:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.343+0000 7f141dffb700 1 -- 172.21.15.50:0/1383650583 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1418023070 con 0x7f14280b1cb0 2023-11-28T11:55:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.343+0000 7f141dffb700 1 --2- 172.21.15.50:0/1383650583 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f140c064ee0 0x7f140c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.343+0000 7f141dffb700 1 -- 172.21.15.50:0/1383650583 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1418081e60 con 0x7f14280b1cb0 2023-11-28T11:55:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.343+0000 7f142d399700 1 --2- 172.21.15.50:0/1383650583 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f140c064ee0 0x7f140c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.347+0000 7f142d399700 1 --2- 172.21.15.50:0/1383650583 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f140c064ee0 0x7f140c067390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1428164c10 tx=0x7f1424009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:03.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.351+0000 7f141dffb700 1 -- 172.21.15.50:0/1383650583 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1418050190 con 0x7f14280b1cb0 2023-11-28T11:55:03.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.515+0000 7f142e39b700 1 -- 172.21.15.50:0/1383650583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1428072c20 con 0x7f14280b1cb0 2023-11-28T11:55:03.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.515+0000 7f141dffb700 1 -- 172.21.15.50:0/1383650583 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+126 (secure 0 0 0) 0x7f14180537b0 con 0x7f14280b1cb0 2023-11-28T11:55:03.518 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:03.518 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-11-28T11:55:03.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:03.518 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-11-28T11:55:03.518 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2023-11-28T11:55:03.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:03.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:03.519 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2023-11-28T11:55:03.519 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-11-28T11:55:03.519 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:03.519 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-11-28T11:55:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.519+0000 7f142e39b700 1 -- 172.21.15.50:0/1383650583 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f140c064ee0 msgr2=0x7f140c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.519+0000 7f142e39b700 1 --2- 172.21.15.50:0/1383650583 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f140c064ee0 0x7f140c067390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1428164c10 tx=0x7f1424009040 comp rx=0 tx=0).stop 2023-11-28T11:55:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.519+0000 7f142e39b700 1 -- 172.21.15.50:0/1383650583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14280b1cb0 msgr2=0x7f142815e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.519+0000 7f142e39b700 1 --2- 172.21.15.50:0/1383650583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14280b1cb0 0x7f142815e740 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f141800e890 tx=0x7f141800eba0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.519+0000 7f142e39b700 1 -- 172.21.15.50:0/1383650583 shutdown_connections 2023-11-28T11:55:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.519+0000 7f142e39b700 1 --2- 172.21.15.50:0/1383650583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1428158fd0 0x7f142815ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.519+0000 7f142e39b700 1 --2- 172.21.15.50:0/1383650583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14280b1cb0 0x7f142815e740 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.519+0000 7f142e39b700 1 --2- 172.21.15.50:0/1383650583 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f140c064ee0 0x7f140c067390 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.519+0000 7f142e39b700 1 --2- 172.21.15.50:0/1383650583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14280706f0 0x7f142815da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.519+0000 7f142e39b700 1 -- 172.21.15.50:0/1383650583 >> 172.21.15.50:0/1383650583 conn(0x7f142806e000 msgr2=0x7f142806b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:03.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.519+0000 7f142e39b700 1 -- 172.21.15.50:0/1383650583 shutdown_connections 2023-11-28T11:55:03.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.519+0000 7f142e39b700 1 -- 172.21.15.50:0/1383650583 wait complete. 2023-11-28T11:55:03.538 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T11:55:03.539 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T11:55:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.659+0000 7fef50881700 1 Processor -- start 2023-11-28T11:55:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.659+0000 7fef50881700 1 -- start start 2023-11-28T11:55:03.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.659+0000 7fef50881700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef4c159ee0 0x7fef4c0cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef50881700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef4c069c40 con 0x7fef4c0b4d10 2023-11-28T11:55:03.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef50881700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef4c15da60 con 0x7fef4c15a2b0 2023-11-28T11:55:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef50881700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef4c069e90 con 0x7fef4c159ee0 2023-11-28T11:55:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef4ad9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fef4c0b4d10 0x7fef4c0d0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42208/0 (socket says 172.21.15.50:42208) 2023-11-28T11:55:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef4ad9d700 1 -- 172.21.15.50:0/819785012 learned_addr learned my addr 172.21.15.50:0/819785012 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:03.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef4a59c700 1 --2- 172.21.15.50:0/819785012 >> v2:172.21.15.192:3300/0 conn(0x7fef4c159ee0 0x7fef4c0cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef4959a700 1 -- 172.21.15.50:0/819785012 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855803860 0 0) 0x7fef4c069c40 con 0x7fef4c0b4d10 2023-11-28T11:55:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef4959a700 1 -- 172.21.15.50:0/819785012 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef340035d0 con 0x7fef4c0b4d10 2023-11-28T11:55:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef4959a700 1 -- 172.21.15.50:0/819785012 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3733600445 0 0) 0x7fef340035d0 con 0x7fef4c0b4d10 2023-11-28T11:55:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef4a59c700 1 -- 172.21.15.50:0/819785012 >> v1:172.21.15.192:6789/0 conn(0x7fef4c15a2b0 legacy=0x7fef4c0b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef4a59c700 1 -- 172.21.15.50:0/819785012 >> v1:172.21.15.50:6789/0 conn(0x7fef4c0b4d10 legacy=0x7fef4c0d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef4a59c700 1 -- 172.21.15.50:0/819785012 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c06a170 con 0x7fef4c159ee0 2023-11-28T11:55:03.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef4a59c700 1 --2- 172.21.15.50:0/819785012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef4c159ee0 0x7fef4c0cd1d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009850 tx=0x7fef3c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c3301e2c0b719ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef4959a700 1 -- 172.21.15.50:0/819785012 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef440019f0 con 0x7fef4c159ee0 2023-11-28T11:55:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef4959a700 1 -- 172.21.15.50:0/819785012 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3c004030 con 0x7fef4c159ee0 2023-11-28T11:55:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef4959a700 1 -- 172.21.15.50:0/819785012 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c0043a0 con 0x7fef4c159ee0 2023-11-28T11:55:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef50881700 1 -- 172.21.15.50:0/819785012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef4c159ee0 msgr2=0x7fef4c0cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef50881700 1 --2- 172.21.15.50:0/819785012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef4c159ee0 0x7fef4c0cd1d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009850 tx=0x7fef3c009b60 comp rx=0 tx=0).stop 2023-11-28T11:55:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef50881700 1 -- 172.21.15.50:0/819785012 shutdown_connections 2023-11-28T11:55:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef50881700 1 --2- 172.21.15.50:0/819785012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef4c159ee0 0x7fef4c0cd1d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef50881700 1 -- 172.21.15.50:0/819785012 >> 172.21.15.50:0/819785012 conn(0x7fef4c06cb60 msgr2=0x7fef4c0cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef50881700 1 -- 172.21.15.50:0/819785012 shutdown_connections 2023-11-28T11:55:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.663+0000 7fef50881700 1 -- 172.21.15.50:0/819785012 wait complete. 2023-11-28T11:55:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.667+0000 7fef50881700 1 Processor -- start 2023-11-28T11:55:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.667+0000 7fef50881700 1 -- start start 2023-11-28T11:55:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.667+0000 7fef50881700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef4c0b4d10 0x7fef4c0c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.667+0000 7fef50881700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef4c159ee0 0x7fef4c0b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.667+0000 7fef50881700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4c15a2b0 0x7fef4c0b8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.667+0000 7fef50881700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c15eae0 con 0x7fef4c15a2b0 2023-11-28T11:55:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.667+0000 7fef50881700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c15dbf0 con 0x7fef4c0b4d10 2023-11-28T11:55:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.667+0000 7fef50881700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c15ded0 con 0x7fef4c159ee0 2023-11-28T11:55:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.667+0000 7fef4ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4c15a2b0 0x7fef4c0b8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.667+0000 7fef4ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4c15a2b0 0x7fef4c0b8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38722/0 (socket says 172.21.15.50:38722) 2023-11-28T11:55:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.667+0000 7fef4ad9d700 1 -- 172.21.15.50:0/2791836109 learned_addr learned my addr 172.21.15.50:0/2791836109 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.667+0000 7fef4a59c700 1 --2- 172.21.15.50:0/2791836109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef4c0b4d10 0x7fef4c0c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.667+0000 7fef49d9b700 1 --2- 172.21.15.50:0/2791836109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef4c159ee0 0x7fef4c0b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.671+0000 7fef4ad9d700 1 -- 172.21.15.50:0/2791836109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef4c159ee0 msgr2=0x7fef4c0b7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.671+0000 7fef4ad9d700 1 --2- 172.21.15.50:0/2791836109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef4c159ee0 0x7fef4c0b7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.671+0000 7fef4ad9d700 1 -- 172.21.15.50:0/2791836109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef4c0b4d10 msgr2=0x7fef4c0c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.671+0000 7fef4ad9d700 1 --2- 172.21.15.50:0/2791836109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef4c0b4d10 0x7fef4c0c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.671+0000 7fef4ad9d700 1 -- 172.21.15.50:0/2791836109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c0094b0 con 0x7fef4c15a2b0 2023-11-28T11:55:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.671+0000 7fef4ad9d700 1 --2- 172.21.15.50:0/2791836109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4c15a2b0 0x7fef4c0b8470 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fef44001560 tx=0x7fef4400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.671+0000 7fef3affd700 1 -- 172.21.15.50:0/2791836109 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4400aaa0 con 0x7fef4c15a2b0 2023-11-28T11:55:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.671+0000 7fef3affd700 1 -- 172.21.15.50:0/2791836109 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4400ac00 con 0x7fef4c15a2b0 2023-11-28T11:55:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.671+0000 7fef50881700 1 -- 172.21.15.50:0/2791836109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4c06a730 con 0x7fef4c15a2b0 2023-11-28T11:55:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.671+0000 7fef3affd700 1 -- 172.21.15.50:0/2791836109 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef440070d0 con 0x7fef4c15a2b0 2023-11-28T11:55:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.671+0000 7fef50881700 1 -- 172.21.15.50:0/2791836109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4c06a450 con 0x7fef4c15a2b0 2023-11-28T11:55:03.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.671+0000 7fef50881700 1 -- 172.21.15.50:0/2791836109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4c06ac50 con 0x7fef4c15a2b0 2023-11-28T11:55:03.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.675+0000 7fef3affd700 1 -- 172.21.15.50:0/2791836109 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fef4401a030 con 0x7fef4c15a2b0 2023-11-28T11:55:03.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.675+0000 7fef3affd700 1 --2- 172.21.15.50:0/2791836109 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef2c064f10 0x7fef2c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.675+0000 7fef3affd700 1 -- 172.21.15.50:0/2791836109 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fef44081860 con 0x7fef4c15a2b0 2023-11-28T11:55:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.675+0000 7fef4a59c700 1 --2- 172.21.15.50:0/2791836109 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef2c064f10 0x7fef2c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.675+0000 7fef4a59c700 1 --2- 172.21.15.50:0/2791836109 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef2c064f10 0x7fef2c0673c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0090b0 tx=0x7fef3c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:03.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.679+0000 7fef3affd700 1 -- 172.21.15.50:0/2791836109 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fef4404fc10 con 0x7fef4c15a2b0 2023-11-28T11:55:03.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:03.843+0000 7fef50881700 1 -- 172.21.15.50:0/2791836109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fef4c072500 con 0x7fef4c15a2b0 2023-11-28T11:55:04.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.803+0000 7fef3affd700 1 -- 172.21.15.50:0/2791836109 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 138+0+0 (secure 0 0 0) 0x7fef440180b0 con 0x7fef4c15a2b0 2023-11-28T11:55:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.815+0000 7fef50881700 1 -- 172.21.15.50:0/2791836109 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef2c064f10 msgr2=0x7fef2c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.815+0000 7fef50881700 1 --2- 172.21.15.50:0/2791836109 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef2c064f10 0x7fef2c0673c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0090b0 tx=0x7fef3c008030 comp rx=0 tx=0).stop 2023-11-28T11:55:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.815+0000 7fef50881700 1 -- 172.21.15.50:0/2791836109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4c15a2b0 msgr2=0x7fef4c0b8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.815+0000 7fef50881700 1 --2- 172.21.15.50:0/2791836109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4c15a2b0 0x7fef4c0b8470 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fef44001560 tx=0x7fef4400cf20 comp rx=0 tx=0).stop 2023-11-28T11:55:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.815+0000 7fef50881700 1 -- 172.21.15.50:0/2791836109 shutdown_connections 2023-11-28T11:55:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.815+0000 7fef50881700 1 --2- 172.21.15.50:0/2791836109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef4c15a2b0 0x7fef4c0b8470 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.815+0000 7fef50881700 1 --2- 172.21.15.50:0/2791836109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef4c159ee0 0x7fef4c0b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.815+0000 7fef50881700 1 --2- 172.21.15.50:0/2791836109 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef2c064f10 0x7fef2c0673c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.815+0000 7fef50881700 1 --2- 172.21.15.50:0/2791836109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef4c0b4d10 0x7fef4c0c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.815+0000 7fef50881700 1 -- 172.21.15.50:0/2791836109 >> 172.21.15.50:0/2791836109 conn(0x7fef4c06cb60 msgr2=0x7fef4c0c6700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.815+0000 7fef50881700 1 -- 172.21.15.50:0/2791836109 shutdown_connections 2023-11-28T11:55:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.815+0000 7fef50881700 1 -- 172.21.15.50:0/2791836109 wait complete. 2023-11-28T11:55:04.820 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-11-28T11:55:04.833 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T11:55:04.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.955+0000 7f8d7cf87700 1 Processor -- start 2023-11-28T11:55:04.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.955+0000 7f8d7cf87700 1 -- start start 2023-11-28T11:55:04.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.955+0000 7f8d7cf87700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d7806b250 0x7f8d780cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:04.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.955+0000 7f8d7cf87700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8d780cb350 0x7f8d78162b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:04.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.955+0000 7f8d7cf87700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d780ce040 con 0x7f8d78158f10 2023-11-28T11:55:04.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.955+0000 7f8d7cf87700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d780cb7d0 con 0x7f8d780cb350 2023-11-28T11:55:04.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.955+0000 7f8d7cf87700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d780c9460 con 0x7f8d7806b250 2023-11-28T11:55:04.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.955+0000 7f8d777fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8d78158f10 0x7f8d780cd930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42216/0 (socket says 172.21.15.50:42216) 2023-11-28T11:55:04.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.955+0000 7f8d777fe700 1 -- 172.21.15.50:0/1979010446 learned_addr learned my addr 172.21.15.50:0/1979010446 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:04.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.955+0000 7f8d77fff700 1 --2- 172.21.15.50:0/1979010446 >> v2:172.21.15.192:3300/0 conn(0x7f8d780cb350 0x7f8d78162b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:04.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.955+0000 7f8d76ffd700 1 --2- 172.21.15.50:0/1979010446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d7806b250 0x7f8d780cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.955+0000 7f8d767fc700 1 -- 172.21.15.50:0/1979010446 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105556691 0 0) 0x7f8d6c001110 con 0x7f8d78158f10 2023-11-28T11:55:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.955+0000 7f8d767fc700 1 -- 172.21.15.50:0/1979010446 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d600035d0 con 0x7f8d78158f10 2023-11-28T11:55:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d77fff700 1 -- 172.21.15.50:0/1979010446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d7806b250 msgr2=0x7f8d780cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d77fff700 1 --2- 172.21.15.50:0/1979010446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d7806b250 0x7f8d780cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d77fff700 1 -- 172.21.15.50:0/1979010446 >> v1:172.21.15.50:6789/0 conn(0x7f8d78158f10 legacy=0x7f8d780cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d767fc700 1 -- 172.21.15.50:0/1979010446 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1082778361 0 0) 0x7f8d600035d0 con 0x7f8d78158f10 2023-11-28T11:55:04.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d77fff700 1 -- 172.21.15.50:0/1979010446 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d780c9fe0 con 0x7f8d780cb350 2023-11-28T11:55:04.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d76ffd700 1 --2- 172.21.15.50:0/1979010446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d7806b250 0x7f8d780cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:04.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d77fff700 1 --2- 172.21.15.50:0/1979010446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d780cb350 0x7f8d78162b40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8d70009d90 tx=0x7f8d7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=121f4283bc131a66 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:04.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d767fc700 1 -- 172.21.15.50:0/1979010446 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7000e070 con 0x7f8d780cb350 2023-11-28T11:55:04.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d767fc700 1 -- 172.21.15.50:0/1979010446 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d70003a40 con 0x7f8d780cb350 2023-11-28T11:55:04.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d767fc700 1 -- 172.21.15.50:0/1979010446 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c001800 con 0x7f8d780cb350 2023-11-28T11:55:04.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d7cf87700 1 -- 172.21.15.50:0/1979010446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d780cb350 msgr2=0x7f8d78162b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:04.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d7cf87700 1 --2- 172.21.15.50:0/1979010446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d780cb350 0x7f8d78162b40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8d70009d90 tx=0x7f8d7000b330 comp rx=0 tx=0).stop 2023-11-28T11:55:04.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d7cf87700 1 -- 172.21.15.50:0/1979010446 shutdown_connections 2023-11-28T11:55:04.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d7cf87700 1 --2- 172.21.15.50:0/1979010446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d780cb350 0x7f8d78162b40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:04.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d7cf87700 1 --2- 172.21.15.50:0/1979010446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d7806b250 0x7f8d780cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:04.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d7cf87700 1 -- 172.21.15.50:0/1979010446 >> 172.21.15.50:0/1979010446 conn(0x7f8d780ce400 msgr2=0x7f8d780ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:04.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d7cf87700 1 -- 172.21.15.50:0/1979010446 shutdown_connections 2023-11-28T11:55:04.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d7cf87700 1 -- 172.21.15.50:0/1979010446 wait complete. 2023-11-28T11:55:04.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d7cf87700 1 Processor -- start 2023-11-28T11:55:04.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.959+0000 7f8d7cf87700 1 -- start start 2023-11-28T11:55:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d7cf87700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7806b250 0x7f8d780ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d7cf87700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d780cb350 0x7f8d780c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d7cf87700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d78158f10 0x7f8d780c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d7cf87700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d780c5f50 con 0x7f8d7806b250 2023-11-28T11:55:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d7cf87700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d780c72a0 con 0x7f8d78158f10 2023-11-28T11:55:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d7cf87700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d780c6200 con 0x7f8d780cb350 2023-11-28T11:55:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d777fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7806b250 0x7f8d780ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d777fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7806b250 0x7f8d780ad110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38734/0 (socket says 172.21.15.50:38734) 2023-11-28T11:55:04.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d777fe700 1 -- 172.21.15.50:0/881220868 learned_addr learned my addr 172.21.15.50:0/881220868 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d76ffd700 1 --2- 172.21.15.50:0/881220868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d780cb350 0x7f8d780c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d77fff700 1 --2- 172.21.15.50:0/881220868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d78158f10 0x7f8d780c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d777fe700 1 -- 172.21.15.50:0/881220868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d780cb350 msgr2=0x7f8d780c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d777fe700 1 --2- 172.21.15.50:0/881220868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d780cb350 0x7f8d780c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d777fe700 1 -- 172.21.15.50:0/881220868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d78158f10 msgr2=0x7f8d780c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d777fe700 1 --2- 172.21.15.50:0/881220868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d78158f10 0x7f8d780c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d777fe700 1 -- 172.21.15.50:0/881220868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d680094b0 con 0x7f8d7806b250 2023-11-28T11:55:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d76ffd700 1 --2- 172.21.15.50:0/881220868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d780cb350 0x7f8d780c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d77fff700 1 --2- 172.21.15.50:0/881220868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d78158f10 0x7f8d780c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:04.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d777fe700 1 --2- 172.21.15.50:0/881220868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7806b250 0x7f8d780ad110 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00c550 tx=0x7f8d6c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d5ffff700 1 -- 172.21.15.50:0/881220868 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c004ca0 con 0x7f8d7806b250 2023-11-28T11:55:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d5ffff700 1 -- 172.21.15.50:0/881220868 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c004e20 con 0x7f8d7806b250 2023-11-28T11:55:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d7cf87700 1 -- 172.21.15.50:0/881220868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d70009a70 con 0x7f8d7806b250 2023-11-28T11:55:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d5ffff700 1 -- 172.21.15.50:0/881220868 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c007310 con 0x7f8d7806b250 2023-11-28T11:55:04.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.963+0000 7f8d7cf87700 1 -- 172.21.15.50:0/881220868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d780c96b0 con 0x7f8d7806b250 2023-11-28T11:55:04.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.967+0000 7f8d5ffff700 1 -- 172.21.15.50:0/881220868 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8d6c01a020 con 0x7f8d7806b250 2023-11-28T11:55:04.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.967+0000 7f8d7cf87700 1 -- 172.21.15.50:0/881220868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7806dc90 con 0x7f8d7806b250 2023-11-28T11:55:04.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.967+0000 7f8d5ffff700 1 --2- 172.21.15.50:0/881220868 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d64064ee0 0x7f8d64067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:04.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.967+0000 7f8d5ffff700 1 -- 172.21.15.50:0/881220868 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f8d6c0819e0 con 0x7f8d7806b250 2023-11-28T11:55:04.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.967+0000 7f8d76ffd700 1 --2- 172.21.15.50:0/881220868 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d64064ee0 0x7f8d64067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:04.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.967+0000 7f8d76ffd700 1 --2- 172.21.15.50:0/881220868 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d64064ee0 0x7f8d64067390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8d780c8fa0 tx=0x7f8d68008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:04.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:04.975+0000 7f8d5ffff700 1 -- 172.21.15.50:0/881220868 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8d6c04fb30 con 0x7f8d7806b250 2023-11-28T11:55:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.135+0000 7f8d7cf87700 1 -- 172.21.15.50:0/881220868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8d780c9990 con 0x7f8d7806b250 2023-11-28T11:55:05.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.819+0000 7f8d5ffff700 1 -- 172.21.15.50:0/881220868 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8d6c053150 con 0x7f8d7806b250 2023-11-28T11:55:05.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.827+0000 7f8d7cf87700 1 -- 172.21.15.50:0/881220868 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d64064ee0 msgr2=0x7f8d64067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:05.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.827+0000 7f8d7cf87700 1 --2- 172.21.15.50:0/881220868 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d64064ee0 0x7f8d64067390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8d780c8fa0 tx=0x7f8d68008040 comp rx=0 tx=0).stop 2023-11-28T11:55:05.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.827+0000 7f8d7cf87700 1 -- 172.21.15.50:0/881220868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7806b250 msgr2=0x7f8d780ad110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:05.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.827+0000 7f8d7cf87700 1 --2- 172.21.15.50:0/881220868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7806b250 0x7f8d780ad110 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00c550 tx=0x7f8d6c00c910 comp rx=0 tx=0).stop 2023-11-28T11:55:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.843+0000 7f8d7cf87700 1 -- 172.21.15.50:0/881220868 shutdown_connections 2023-11-28T11:55:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.843+0000 7f8d7cf87700 1 --2- 172.21.15.50:0/881220868 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d64064ee0 0x7f8d64067390 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:05.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.843+0000 7f8d7cf87700 1 --2- 172.21.15.50:0/881220868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d78158f10 0x7f8d780c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.843+0000 7f8d7cf87700 1 --2- 172.21.15.50:0/881220868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d780cb350 0x7f8d780c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.843+0000 7f8d7cf87700 1 --2- 172.21.15.50:0/881220868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7806b250 0x7f8d780ad110 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.843+0000 7f8d7cf87700 1 -- 172.21.15.50:0/881220868 >> 172.21.15.50:0/881220868 conn(0x7f8d780ce400 msgr2=0x7f8d780ade10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.843+0000 7f8d7cf87700 1 -- 172.21.15.50:0/881220868 shutdown_connections 2023-11-28T11:55:05.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.843+0000 7f8d7cf87700 1 -- 172.21.15.50:0/881220868 wait complete. 2023-11-28T11:55:05.847 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-11-28T11:55:05.859 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T11:55:05.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.975+0000 7fdc9a6f7700 1 Processor -- start 2023-11-28T11:55:05.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.975+0000 7fdc9a6f7700 1 -- start start 2023-11-28T11:55:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc9a6f7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdc940cac40 0x7fdc9406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc9a6f7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc9406ac50 0x7fdc940c9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc9a6f7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc940cdb00 con 0x7fdc940ad4d0 2023-11-28T11:55:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc9a6f7700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc940cf2d0 con 0x7fdc9406ac50 2023-11-28T11:55:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc9a6f7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc940cc0e0 con 0x7fdc940cac40 2023-11-28T11:55:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc99ef6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc9406ac50 0x7fdc940c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc99ef6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc9406ac50 0x7fdc940c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38736/0 (socket says 172.21.15.50:38736) 2023-11-28T11:55:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc99ef6700 1 -- 172.21.15.50:0/3063518343 learned_addr learned my addr 172.21.15.50:0/3063518343 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc996f5700 1 --2- 172.21.15.50:0/3063518343 >> v2:172.21.15.192:3300/0 conn(0x7fdc940cac40 0x7fdc9406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:05.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc99ef6700 1 -- 172.21.15.50:0/3063518343 >> v2:172.21.15.192:3300/0 conn(0x7fdc940cac40 msgr2=0x7fdc9406fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:05.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc99ef6700 1 --2- 172.21.15.50:0/3063518343 >> v2:172.21.15.192:3300/0 conn(0x7fdc940cac40 0x7fdc9406fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:05.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc99ef6700 1 -- 172.21.15.50:0/3063518343 >> v1:172.21.15.192:6789/0 conn(0x7fdc940ad4d0 legacy=0x7fdc940cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:05.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc99ef6700 1 -- 172.21.15.50:0/3063518343 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc940cdda0 con 0x7fdc9406ac50 2023-11-28T11:55:05.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc99ef6700 1 --2- 172.21.15.50:0/3063518343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc9406ac50 0x7fdc940c9720 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdc940ce340 tx=0x7fdc8c00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20809d3d35dbb36 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:05.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc87fff700 1 -- 172.21.15.50:0/3063518343 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c010070 con 0x7fdc9406ac50 2023-11-28T11:55:05.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc87fff700 1 -- 172.21.15.50:0/3063518343 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c00dce0 con 0x7fdc9406ac50 2023-11-28T11:55:05.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc87fff700 1 -- 172.21.15.50:0/3063518343 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00b310 con 0x7fdc9406ac50 2023-11-28T11:55:05.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc9a6f7700 1 -- 172.21.15.50:0/3063518343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc9406ac50 msgr2=0x7fdc940c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:05.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc9a6f7700 1 --2- 172.21.15.50:0/3063518343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc9406ac50 0x7fdc940c9720 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdc940ce340 tx=0x7fdc8c00d430 comp rx=0 tx=0).stop 2023-11-28T11:55:05.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc9a6f7700 1 -- 172.21.15.50:0/3063518343 shutdown_connections 2023-11-28T11:55:05.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc9a6f7700 1 --2- 172.21.15.50:0/3063518343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc9406ac50 0x7fdc940c9720 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:05.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc9a6f7700 1 --2- 172.21.15.50:0/3063518343 >> v2:172.21.15.192:3300/0 conn(0x7fdc940cac40 0x7fdc9406fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:05.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc9a6f7700 1 -- 172.21.15.50:0/3063518343 >> 172.21.15.50:0/3063518343 conn(0x7fdc940ce3e0 msgr2=0x7fdc940ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:05.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc9a6f7700 1 -- 172.21.15.50:0/3063518343 shutdown_connections 2023-11-28T11:55:05.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.979+0000 7fdc9a6f7700 1 -- 172.21.15.50:0/3063518343 wait complete. 2023-11-28T11:55:05.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.983+0000 7fdc9a6f7700 1 Processor -- start 2023-11-28T11:55:05.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.983+0000 7fdc9a6f7700 1 -- start start 2023-11-28T11:55:05.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.983+0000 7fdc9a6f7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc9406ac50 0x7fdc941f1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:05.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.983+0000 7fdc9a6f7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc940ad4d0 0x7fdc940c2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:05.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.983+0000 7fdc9a6f7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc940cac40 0x7fdc940af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:05.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.983+0000 7fdc9a6f7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940c6a00 con 0x7fdc940cac40 2023-11-28T11:55:05.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.983+0000 7fdc9a6f7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940c6ce0 con 0x7fdc940ad4d0 2023-11-28T11:55:05.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.983+0000 7fdc9a6f7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940c6fc0 con 0x7fdc9406ac50 2023-11-28T11:55:05.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.983+0000 7fdc99ef6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc940cac40 0x7fdc940af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:05.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.983+0000 7fdc99ef6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc940cac40 0x7fdc940af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38740/0 (socket says 172.21.15.50:38740) 2023-11-28T11:55:05.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.983+0000 7fdc98ef4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc940ad4d0 0x7fdc940c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:05.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.983+0000 7fdc99ef6700 1 -- 172.21.15.50:0/2942283885 learned_addr learned my addr 172.21.15.50:0/2942283885 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:05.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.983+0000 7fdc996f5700 1 --2- 172.21.15.50:0/2942283885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc9406ac50 0x7fdc941f1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:05.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.987+0000 7fdc99ef6700 1 -- 172.21.15.50:0/2942283885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc9406ac50 msgr2=0x7fdc941f1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:05.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.987+0000 7fdc99ef6700 1 --2- 172.21.15.50:0/2942283885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc9406ac50 0x7fdc941f1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:05.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.987+0000 7fdc99ef6700 1 -- 172.21.15.50:0/2942283885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc940ad4d0 msgr2=0x7fdc940c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:05.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.987+0000 7fdc99ef6700 1 --2- 172.21.15.50:0/2942283885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc940ad4d0 0x7fdc940c2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:05.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.987+0000 7fdc99ef6700 1 -- 172.21.15.50:0/2942283885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c00bd40 con 0x7fdc940cac40 2023-11-28T11:55:05.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.987+0000 7fdc98ef4700 1 --2- 172.21.15.50:0/2942283885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc940ad4d0 0x7fdc940c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:05.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.987+0000 7fdc99ef6700 1 --2- 172.21.15.50:0/2942283885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc940cac40 0x7fdc940af2c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fdc9406fa40 tx=0x7fdc8c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:05.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.987+0000 7fdc85ffb700 1 -- 172.21.15.50:0/2942283885 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c009a10 con 0x7fdc940cac40 2023-11-28T11:55:05.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.987+0000 7fdc85ffb700 1 -- 172.21.15.50:0/2942283885 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c009b70 con 0x7fdc940cac40 2023-11-28T11:55:05.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.987+0000 7fdc85ffb700 1 -- 172.21.15.50:0/2942283885 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00b4c0 con 0x7fdc940cac40 2023-11-28T11:55:05.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.987+0000 7fdc9a6f7700 1 -- 172.21.15.50:0/2942283885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc940cc3c0 con 0x7fdc940cac40 2023-11-28T11:55:05.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.987+0000 7fdc9a6f7700 1 -- 172.21.15.50:0/2942283885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc940ce080 con 0x7fdc940cac40 2023-11-28T11:55:05.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.987+0000 7fdc9a6f7700 1 -- 172.21.15.50:0/2942283885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc940cc550 con 0x7fdc940cac40 2023-11-28T11:55:05.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.987+0000 7fdc85ffb700 1 -- 172.21.15.50:0/2942283885 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdc8c004040 con 0x7fdc940cac40 2023-11-28T11:55:05.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.991+0000 7fdc85ffb700 1 --2- 172.21.15.50:0/2942283885 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc78064ee0 0x7fdc78067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:05.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.991+0000 7fdc85ffb700 1 -- 172.21.15.50:0/2942283885 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6282+0+0 (secure 0 0 0) 0x7fdc8c083790 con 0x7fdc940cac40 2023-11-28T11:55:05.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.991+0000 7fdc996f5700 1 --2- 172.21.15.50:0/2942283885 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc78064ee0 0x7fdc78067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:05.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.991+0000 7fdc996f5700 1 --2- 172.21.15.50:0/2942283885 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc78064ee0 0x7fdc78067390 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009be0 tx=0x7fdc880091c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:05.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:05.995+0000 7fdc85ffb700 1 -- 172.21.15.50:0/2942283885 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdc8c0517f0 con 0x7fdc940cac40 2023-11-28T11:55:06.123 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:55:06.125 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:55:06.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.195+0000 7fdc9a6f7700 1 -- 172.21.15.50:0/2942283885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdc940b4000 con 0x7fdc940cac40 2023-11-28T11:55:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.223+0000 7fdc85ffb700 1 -- 172.21.15.50:0/2942283885 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdc8c054e10 con 0x7fdc940cac40 2023-11-28T11:55:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.231+0000 7fdc9a6f7700 1 -- 172.21.15.50:0/2942283885 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc78064ee0 msgr2=0x7fdc78067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.231+0000 7fdc9a6f7700 1 --2- 172.21.15.50:0/2942283885 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc78064ee0 0x7fdc78067390 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009be0 tx=0x7fdc880091c0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.231+0000 7fdc9a6f7700 1 -- 172.21.15.50:0/2942283885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc940cac40 msgr2=0x7fdc940af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:06.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.231+0000 7fdc9a6f7700 1 --2- 172.21.15.50:0/2942283885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc940cac40 0x7fdc940af2c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fdc9406fa40 tx=0x7fdc8c004af0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.231+0000 7fdc9a6f7700 1 -- 172.21.15.50:0/2942283885 shutdown_connections 2023-11-28T11:55:06.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.231+0000 7fdc9a6f7700 1 --2- 172.21.15.50:0/2942283885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc940cac40 0x7fdc940af2c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.231+0000 7fdc9a6f7700 1 --2- 172.21.15.50:0/2942283885 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fdc78064ee0 0x7fdc78067390 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.231+0000 7fdc9a6f7700 1 --2- 172.21.15.50:0/2942283885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc940ad4d0 0x7fdc940c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.231+0000 7fdc9a6f7700 1 --2- 172.21.15.50:0/2942283885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc9406ac50 0x7fdc941f1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.231+0000 7fdc9a6f7700 1 -- 172.21.15.50:0/2942283885 >> 172.21.15.50:0/2942283885 conn(0x7fdc940ce3e0 msgr2=0x7fdc940cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:06.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.231+0000 7fdc9a6f7700 1 -- 172.21.15.50:0/2942283885 shutdown_connections 2023-11-28T11:55:06.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.231+0000 7fdc9a6f7700 1 -- 172.21.15.50:0/2942283885 wait complete. 2023-11-28T11:55:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 6 and data pool 7 2023-11-28T11:55:06.252 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:55:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.351+0000 7f22c58fe700 1 Processor -- start 2023-11-28T11:55:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.351+0000 7f22c58fe700 1 -- start start 2023-11-28T11:55:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.351+0000 7f22c58fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22c015c780 0x7f22c00cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.351+0000 7f22c58fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f22c00ce4a0 0x7f22c0071030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.351+0000 7f22c58fe700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c00ca490 con 0x7f22c015c3b0 2023-11-28T11:55:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.351+0000 7f22c58fe700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c00cdad0 con 0x7f22c015c780 2023-11-28T11:55:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.351+0000 7f22c58fe700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c00cd4c0 con 0x7f22c00ce4a0 2023-11-28T11:55:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22bffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22c015c780 0x7f22c00cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22bffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22c015c780 0x7f22c00cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38754/0 (socket says 172.21.15.50:38754) 2023-11-28T11:55:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22c50fd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f22c00ce4a0 0x7f22c0071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22bffff700 1 -- 172.21.15.50:0/932776598 learned_addr learned my addr 172.21.15.50:0/932776598 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:06.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22bffff700 1 -- 172.21.15.50:0/932776598 >> v2:172.21.15.192:3300/0 conn(0x7f22c00ce4a0 msgr2=0x7f22c0071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:06.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22bffff700 1 --2- 172.21.15.50:0/932776598 >> v2:172.21.15.192:3300/0 conn(0x7f22c00ce4a0 0x7f22c0071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22bffff700 1 -- 172.21.15.50:0/932776598 >> v1:172.21.15.192:6789/0 conn(0x7f22c015c3b0 legacy=0x7f22c00c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:06.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22bffff700 1 -- 172.21.15.50:0/932776598 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c00ca6d0 con 0x7f22c015c780 2023-11-28T11:55:06.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22c50fd700 1 --2- 172.21.15.50:0/932776598 >> v2:172.21.15.192:3300/0 conn(0x7f22c00ce4a0 0x7f22c0071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:06.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22bffff700 1 --2- 172.21.15.50:0/932776598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c015c780 0x7f22c00cdf60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f22c0071fb0 tx=0x7f22ac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f345e05714176d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:06.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22bf7fe700 1 -- 172.21.15.50:0/932776598 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac011830 con 0x7f22c015c780 2023-11-28T11:55:06.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22bf7fe700 1 -- 172.21.15.50:0/932776598 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac011990 con 0x7f22c015c780 2023-11-28T11:55:06.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22bf7fe700 1 -- 172.21.15.50:0/932776598 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac011d20 con 0x7f22c015c780 2023-11-28T11:55:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22c58fe700 1 -- 172.21.15.50:0/932776598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c015c780 msgr2=0x7f22c00cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22c58fe700 1 --2- 172.21.15.50:0/932776598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c015c780 0x7f22c00cdf60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f22c0071fb0 tx=0x7f22ac009bf0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22c58fe700 1 -- 172.21.15.50:0/932776598 shutdown_connections 2023-11-28T11:55:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22c58fe700 1 --2- 172.21.15.50:0/932776598 >> v2:172.21.15.192:3300/0 conn(0x7f22c00ce4a0 0x7f22c0071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22c58fe700 1 --2- 172.21.15.50:0/932776598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c015c780 0x7f22c00cdf60 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22c58fe700 1 -- 172.21.15.50:0/932776598 >> 172.21.15.50:0/932776598 conn(0x7f22c00b1d40 msgr2=0x7f22c00cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:06.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22c58fe700 1 -- 172.21.15.50:0/932776598 shutdown_connections 2023-11-28T11:55:06.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.355+0000 7f22c58fe700 1 -- 172.21.15.50:0/932776598 wait complete. 2023-11-28T11:55:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.359+0000 7f22c58fe700 1 Processor -- start 2023-11-28T11:55:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.359+0000 7f22c58fe700 1 -- start start 2023-11-28T11:55:06.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.359+0000 7f22c58fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c00ce4a0 0x7f22c00ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:06.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.359+0000 7f22c58fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22c015c3b0 0x7f22c01f1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:06.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.359+0000 7f22c58fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22c015c780 0x7f22c01f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:06.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.359+0000 7f22c58fe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c00b3e10 con 0x7f22c00ce4a0 2023-11-28T11:55:06.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.359+0000 7f22c58fe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c00b4020 con 0x7f22c015c780 2023-11-28T11:55:06.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.359+0000 7f22c58fe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c00b4300 con 0x7f22c015c3b0 2023-11-28T11:55:06.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22c48fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c00ce4a0 0x7f22c00ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:06.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22c48fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c00ce4a0 0x7f22c00ab8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38762/0 (socket says 172.21.15.50:38762) 2023-11-28T11:55:06.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22c48fc700 1 -- 172.21.15.50:0/96438770 learned_addr learned my addr 172.21.15.50:0/96438770 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:06.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22bffff700 1 --2- 172.21.15.50:0/96438770 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22c015c3b0 0x7f22c01f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:06.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22c50fd700 1 --2- 172.21.15.50:0/96438770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22c015c780 0x7f22c01f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:06.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22c48fc700 1 -- 172.21.15.50:0/96438770 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22c015c3b0 msgr2=0x7f22c01f1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:06.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22c48fc700 1 --2- 172.21.15.50:0/96438770 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22c015c3b0 0x7f22c01f1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22c48fc700 1 -- 172.21.15.50:0/96438770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22c015c780 msgr2=0x7f22c01f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:06.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22c48fc700 1 --2- 172.21.15.50:0/96438770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22c015c780 0x7f22c01f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22c48fc700 1 -- 172.21.15.50:0/96438770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b8009a70 con 0x7f22c00ce4a0 2023-11-28T11:55:06.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22c50fd700 1 --2- 172.21.15.50:0/96438770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22c015c780 0x7f22c01f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:06.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22c48fc700 1 --2- 172.21.15.50:0/96438770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c00ce4a0 0x7f22c00ab8d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f22b400c500 tx=0x7f22b400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:06.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22bd7fa700 1 -- 172.21.15.50:0/96438770 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40052d0 con 0x7f22c00ce4a0 2023-11-28T11:55:06.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22bd7fa700 1 -- 172.21.15.50:0/96438770 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b4005430 con 0x7f22c00ce4a0 2023-11-28T11:55:06.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22c58fe700 1 -- 172.21.15.50:0/96438770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ac009570 con 0x7f22c00ce4a0 2023-11-28T11:55:06.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22bd7fa700 1 -- 172.21.15.50:0/96438770 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40055a0 con 0x7f22c00ce4a0 2023-11-28T11:55:06.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22c58fe700 1 -- 172.21.15.50:0/96438770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c00ca9b0 con 0x7f22c00ce4a0 2023-11-28T11:55:06.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22c58fe700 1 -- 172.21.15.50:0/96438770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c00cd760 con 0x7f22c00ce4a0 2023-11-28T11:55:06.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.363+0000 7f22bd7fa700 1 -- 172.21.15.50:0/96438770 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f22b4019030 con 0x7f22c00ce4a0 2023-11-28T11:55:06.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.367+0000 7f22bd7fa700 1 --2- 172.21.15.50:0/96438770 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f22a4064ee0 0x7f22a4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:06.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.367+0000 7f22bd7fa700 1 -- 172.21.15.50:0/96438770 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f22b4081140 con 0x7f22c00ce4a0 2023-11-28T11:55:06.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.367+0000 7f22bffff700 1 --2- 172.21.15.50:0/96438770 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f22a4064ee0 0x7f22a4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:06.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.367+0000 7f22bffff700 1 --2- 172.21.15.50:0/96438770 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f22a4064ee0 0x7f22a4067390 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f22ac000c00 tx=0x7f22ac008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:06.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.371+0000 7f22bd7fa700 1 -- 172.21.15.50:0/96438770 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f22b404f1a0 con 0x7f22c00ce4a0 2023-11-28T11:55:06.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.539+0000 7f22c58fe700 1 -- 172.21.15.50:0/96438770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22c00cab40 con 0x7f22c00ce4a0 2023-11-28T11:55:06.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.543+0000 7f22bd7fa700 1 -- 172.21.15.50:0/96438770 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+17987 (secure 0 0 0) 0x7f22b40527c0 con 0x7f22c00ce4a0 2023-11-28T11:55:06.544 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:06.544 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:55:06.199769+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:55:03.889842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T11:55:05.177617+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:55:06.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.543+0000 7f22c58fe700 1 -- 172.21.15.50:0/96438770 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f22a4064ee0 msgr2=0x7f22a4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:06.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.543+0000 7f22c58fe700 1 --2- 172.21.15.50:0/96438770 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f22a4064ee0 0x7f22a4067390 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f22ac000c00 tx=0x7f22ac008030 comp rx=0 tx=0).stop 2023-11-28T11:55:06.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.543+0000 7f22c58fe700 1 -- 172.21.15.50:0/96438770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c00ce4a0 msgr2=0x7f22c00ab8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:06.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.543+0000 7f22c58fe700 1 --2- 172.21.15.50:0/96438770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c00ce4a0 0x7f22c00ab8d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f22b400c500 tx=0x7f22b400c810 comp rx=0 tx=0).stop 2023-11-28T11:55:06.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.543+0000 7f22c58fe700 1 -- 172.21.15.50:0/96438770 shutdown_connections 2023-11-28T11:55:06.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.543+0000 7f22c58fe700 1 --2- 172.21.15.50:0/96438770 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f22a4064ee0 0x7f22a4067390 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.543+0000 7f22c58fe700 1 --2- 172.21.15.50:0/96438770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22c015c780 0x7f22c01f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.543+0000 7f22c58fe700 1 --2- 172.21.15.50:0/96438770 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22c015c3b0 0x7f22c01f1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.543+0000 7f22c58fe700 1 --2- 172.21.15.50:0/96438770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22c00ce4a0 0x7f22c00ab8d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.543+0000 7f22c58fe700 1 -- 172.21.15.50:0/96438770 >> 172.21.15.50:0/96438770 conn(0x7f22c00b1d40 msgr2=0x7f22c00af020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:06.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.543+0000 7f22c58fe700 1 -- 172.21.15.50:0/96438770 shutdown_connections 2023-11-28T11:55:06.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.543+0000 7f22c58fe700 1 -- 172.21.15.50:0/96438770 wait complete. 2023-11-28T11:55:06.560 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:55:06.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.675+0000 7f0411cff700 1 Processor -- start 2023-11-28T11:55:06.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.675+0000 7f0411cff700 1 -- start start 2023-11-28T11:55:06.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.675+0000 7f0411cff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f040c1607b0 0x7f040c0cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:06.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.675+0000 7f0411cff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f040c0cc430 0x7f040c0ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:06.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.675+0000 7f0411cff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040c15c520 con 0x7f040c15c150 2023-11-28T11:55:06.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.675+0000 7f0411cff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f040c0ca680 con 0x7f040c1607b0 2023-11-28T11:55:06.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.675+0000 7f0411cff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040c0ca960 con 0x7f040c0cc430 2023-11-28T11:55:06.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f0410cfd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f040c15c150 0x7f040c0c9e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42230/0 (socket says 172.21.15.50:42230) 2023-11-28T11:55:06.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f0410cfd700 1 -- 172.21.15.50:0/637041056 learned_addr learned my addr 172.21.15.50:0/637041056 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f04114fe700 1 --2- 172.21.15.50:0/637041056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f040c0cc430 0x7f040c0ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f040bfff700 1 --2- 172.21.15.50:0/637041056 >> v2:172.21.15.192:3300/0 conn(0x7f040c1607b0 0x7f040c0cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f040b7fe700 1 -- 172.21.15.50:0/637041056 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047053937 0 0) 0x7f040c15c520 con 0x7f040c15c150 2023-11-28T11:55:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f040b7fe700 1 -- 172.21.15.50:0/637041056 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03f80035d0 con 0x7f040c15c150 2023-11-28T11:55:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f04114fe700 1 -- 172.21.15.50:0/637041056 >> v2:172.21.15.192:3300/0 conn(0x7f040c1607b0 msgr2=0x7f040c0cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f04114fe700 1 --2- 172.21.15.50:0/637041056 >> v2:172.21.15.192:3300/0 conn(0x7f040c1607b0 0x7f040c0cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f04114fe700 1 -- 172.21.15.50:0/637041056 >> v1:172.21.15.50:6789/0 conn(0x7f040c15c150 legacy=0x7f040c0c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:06.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f04114fe700 1 -- 172.21.15.50:0/637041056 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c0cd840 con 0x7f040c0cc430 2023-11-28T11:55:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f04114fe700 1 --2- 172.21.15.50:0/637041056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f040c0cc430 0x7f040c0ce320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0404009850 tx=0x7f0404009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fe313be2abffbfe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f040b7fe700 1 -- 172.21.15.50:0/637041056 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404011830 con 0x7f040c0cc430 2023-11-28T11:55:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f040b7fe700 1 -- 172.21.15.50:0/637041056 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0404011990 con 0x7f040c0cc430 2023-11-28T11:55:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f040b7fe700 1 -- 172.21.15.50:0/637041056 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404011d00 con 0x7f040c0cc430 2023-11-28T11:55:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f0411cff700 1 -- 172.21.15.50:0/637041056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f040c0cc430 msgr2=0x7f040c0ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f0411cff700 1 --2- 172.21.15.50:0/637041056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f040c0cc430 0x7f040c0ce320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0404009850 tx=0x7f0404009b60 comp rx=0 tx=0).stop 2023-11-28T11:55:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f0411cff700 1 -- 172.21.15.50:0/637041056 shutdown_connections 2023-11-28T11:55:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f0411cff700 1 --2- 172.21.15.50:0/637041056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f040c0cc430 0x7f040c0ce320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f0411cff700 1 --2- 172.21.15.50:0/637041056 >> v2:172.21.15.192:3300/0 conn(0x7f040c1607b0 0x7f040c0cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f0411cff700 1 -- 172.21.15.50:0/637041056 >> 172.21.15.50:0/637041056 conn(0x7f040c06ec40 msgr2=0x7f040c0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f0411cff700 1 -- 172.21.15.50:0/637041056 shutdown_connections 2023-11-28T11:55:06.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.679+0000 7f0411cff700 1 -- 172.21.15.50:0/637041056 wait complete. 2023-11-28T11:55:06.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0411cff700 1 Processor -- start 2023-11-28T11:55:06.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0411cff700 1 -- start start 2023-11-28T11:55:06.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0411cff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f040c0cc430 0x7f040c0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:06.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0411cff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f040c15c150 0x7f040c0ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:06.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0411cff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f040c1607b0 0x7f040c0c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:06.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0411cff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c0b2a50 con 0x7f040c0cc430 2023-11-28T11:55:06.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0411cff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c0b4e20 con 0x7f040c15c150 2023-11-28T11:55:06.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0411cff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040c1583e0 con 0x7f040c1607b0 2023-11-28T11:55:06.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0410cfd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f040c0cc430 0x7f040c0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:06.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0410cfd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f040c0cc430 0x7f040c0b48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38772/0 (socket says 172.21.15.50:38772) 2023-11-28T11:55:06.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0410cfd700 1 -- 172.21.15.50:0/3896160228 learned_addr learned my addr 172.21.15.50:0/3896160228 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:06.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f04114fe700 1 --2- 172.21.15.50:0/3896160228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f040c1607b0 0x7f040c0c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:06.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f040bfff700 1 --2- 172.21.15.50:0/3896160228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f040c15c150 0x7f040c0ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:06.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0410cfd700 1 -- 172.21.15.50:0/3896160228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f040c1607b0 msgr2=0x7f040c0c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:06.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0410cfd700 1 --2- 172.21.15.50:0/3896160228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f040c1607b0 0x7f040c0c4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0410cfd700 1 -- 172.21.15.50:0/3896160228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f040c15c150 msgr2=0x7f040c0ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:06.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0410cfd700 1 --2- 172.21.15.50:0/3896160228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f040c15c150 0x7f040c0ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0410cfd700 1 -- 172.21.15.50:0/3896160228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04040094b0 con 0x7f040c0cc430 2023-11-28T11:55:06.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0410cfd700 1 --2- 172.21.15.50:0/3896160228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f040c0cc430 0x7f040c0b48e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00c4f0 tx=0x7f03fc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:06.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f04097fa700 1 -- 172.21.15.50:0/3896160228 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc005d90 con 0x7f040c0cc430 2023-11-28T11:55:06.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f04097fa700 1 -- 172.21.15.50:0/3896160228 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc0070d0 con 0x7f040c0cc430 2023-11-28T11:55:06.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f04097fa700 1 -- 172.21.15.50:0/3896160228 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc007440 con 0x7f040c0cc430 2023-11-28T11:55:06.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0411cff700 1 -- 172.21.15.50:0/3896160228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040c0cde00 con 0x7f040c0cc430 2023-11-28T11:55:06.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0411cff700 1 -- 172.21.15.50:0/3896160228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040c0cdb20 con 0x7f040c0cc430 2023-11-28T11:55:06.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.683+0000 7f0411cff700 1 -- 172.21.15.50:0/3896160228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040c0cc8b0 con 0x7f040c0cc430 2023-11-28T11:55:06.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.687+0000 7f04097fa700 1 -- 172.21.15.50:0/3896160228 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f03fc019030 con 0x7f040c0cc430 2023-11-28T11:55:06.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.687+0000 7f04097fa700 1 --2- 172.21.15.50:0/3896160228 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f03ec064f10 0x7f03ec0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:06.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.687+0000 7f04097fa700 1 -- 172.21.15.50:0/3896160228 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f03fc0811b0 con 0x7f040c0cc430 2023-11-28T11:55:06.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.687+0000 7f040bfff700 1 --2- 172.21.15.50:0/3896160228 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f03ec064f10 0x7f03ec0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:06.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.687+0000 7f040bfff700 1 --2- 172.21.15.50:0/3896160228 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f03ec064f10 0x7f03ec0673c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f040c15fc50 tx=0x7f03f400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:06.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.695+0000 7f04097fa700 1 -- 172.21.15.50:0/3896160228 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f03fc04a400 con 0x7f040c0cc430 2023-11-28T11:55:06.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.863+0000 7f0411cff700 1 -- 172.21.15.50:0/3896160228 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f040c072c20 con 0x7f040c0cc430 2023-11-28T11:55:06.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.867+0000 7f04097fa700 1 -- 172.21.15.50:0/3896160228 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+17987 (secure 0 0 0) 0x7f03fc04f240 con 0x7f040c0cc430 2023-11-28T11:55:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:06.869 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:55:06.199769+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:55:03.889842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T11:55:05.177617+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:55:06.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.867+0000 7f0411cff700 1 -- 172.21.15.50:0/3896160228 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f03ec064f10 msgr2=0x7f03ec0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:06.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.867+0000 7f0411cff700 1 --2- 172.21.15.50:0/3896160228 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f03ec064f10 0x7f03ec0673c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f040c15fc50 tx=0x7f03f400b040 comp rx=0 tx=0).stop 2023-11-28T11:55:06.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.867+0000 7f0411cff700 1 -- 172.21.15.50:0/3896160228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f040c0cc430 msgr2=0x7f040c0b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:06.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.867+0000 7f0411cff700 1 --2- 172.21.15.50:0/3896160228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f040c0cc430 0x7f040c0b48e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00c4f0 tx=0x7f03fc00c800 comp rx=0 tx=0).stop 2023-11-28T11:55:06.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.867+0000 7f0411cff700 1 -- 172.21.15.50:0/3896160228 shutdown_connections 2023-11-28T11:55:06.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.867+0000 7f0411cff700 1 --2- 172.21.15.50:0/3896160228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f040c1607b0 0x7f040c0c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.867+0000 7f0411cff700 1 --2- 172.21.15.50:0/3896160228 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f03ec064f10 0x7f03ec0673c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.867+0000 7f0411cff700 1 --2- 172.21.15.50:0/3896160228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f040c15c150 0x7f040c0ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.867+0000 7f0411cff700 1 --2- 172.21.15.50:0/3896160228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f040c0cc430 0x7f040c0b48e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:06.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.867+0000 7f0411cff700 1 -- 172.21.15.50:0/3896160228 >> 172.21.15.50:0/3896160228 conn(0x7f040c06ec40 msgr2=0x7f040c0cfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:06.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.867+0000 7f0411cff700 1 -- 172.21.15.50:0/3896160228 shutdown_connections 2023-11-28T11:55:06.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.867+0000 7f0411cff700 1 -- 172.21.15.50:0/3896160228 wait complete. 2023-11-28T11:55:06.884 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T11:55:07.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.999+0000 7f67e5b06700 1 Processor -- start 2023-11-28T11:55:07.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:06.999+0000 7f67e5b06700 1 -- start start 2023-11-28T11:55:07.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67e5b06700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67e006ce60 0x7f67e00b8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:07.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67e5b06700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f67e00d1e30 0x7f67e006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:07.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67e5b06700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e00d0460 con 0x7f67e006a3a0 2023-11-28T11:55:07.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67e5b06700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e00d3390 con 0x7f67e00d1e30 2023-11-28T11:55:07.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67e5b06700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e00d2380 con 0x7f67e006ce60 2023-11-28T11:55:07.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67dffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f67e00d1e30 0x7f67e006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:07.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67e4b04700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67e006ce60 0x7f67e00b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:07.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67dffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f67e00d1e30 0x7f67e006d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:33764/0 (socket says 172.21.15.50:33764) 2023-11-28T11:55:07.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67dffff700 1 -- 172.21.15.50:0/2484573949 learned_addr learned my addr 172.21.15.50:0/2484573949 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:07.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67dffff700 1 -- 172.21.15.50:0/2484573949 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67e006ce60 msgr2=0x7f67e00b8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:07.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67dffff700 1 --2- 172.21.15.50:0/2484573949 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67e006ce60 0x7f67e00b8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:07.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67dffff700 1 -- 172.21.15.50:0/2484573949 >> v1:172.21.15.192:6789/0 conn(0x7f67e006a3a0 legacy=0x7f67e006a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:07.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67dffff700 1 -- 172.21.15.50:0/2484573949 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e00d2f00 con 0x7f67e00d1e30 2023-11-28T11:55:07.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67dffff700 1 --2- 172.21.15.50:0/2484573949 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67e00d1e30 0x7f67e006d230 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f67d0009910 tx=0x7f67d0009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0620cfb28fef3ab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:07.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67df7fe700 1 -- 172.21.15.50:0/2484573949 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0011830 con 0x7f67e00d1e30 2023-11-28T11:55:07.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67df7fe700 1 -- 172.21.15.50:0/2484573949 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d0011990 con 0x7f67e00d1e30 2023-11-28T11:55:07.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67df7fe700 1 -- 172.21.15.50:0/2484573949 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0011d40 con 0x7f67e00d1e30 2023-11-28T11:55:07.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67e5b06700 1 -- 172.21.15.50:0/2484573949 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67e00d1e30 msgr2=0x7f67e006d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:07.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.003+0000 7f67e5b06700 1 --2- 172.21.15.50:0/2484573949 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67e00d1e30 0x7f67e006d230 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f67d0009910 tx=0x7f67d0009c20 comp rx=0 tx=0).stop 2023-11-28T11:55:07.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5b06700 1 -- 172.21.15.50:0/2484573949 shutdown_connections 2023-11-28T11:55:07.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5b06700 1 --2- 172.21.15.50:0/2484573949 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67e00d1e30 0x7f67e006d230 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:07.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5b06700 1 --2- 172.21.15.50:0/2484573949 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67e006ce60 0x7f67e00b8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:07.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5b06700 1 -- 172.21.15.50:0/2484573949 >> 172.21.15.50:0/2484573949 conn(0x7f67e009bbd0 msgr2=0x7f67e00b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:07.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5b06700 1 -- 172.21.15.50:0/2484573949 shutdown_connections 2023-11-28T11:55:07.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5b06700 1 -- 172.21.15.50:0/2484573949 wait complete. 2023-11-28T11:55:07.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5b06700 1 Processor -- start 2023-11-28T11:55:07.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5b06700 1 -- start start 2023-11-28T11:55:07.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5b06700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67e006a3a0 0x7f67e014dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:07.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5b06700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67e006ce60 0x7f67e015ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:07.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5b06700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e00d1e30 0x7f67e00b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:07.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5b06700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e014e320 con 0x7f67e00d1e30 2023-11-28T11:55:07.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5b06700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e015ce90 con 0x7f67e006ce60 2023-11-28T11:55:07.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5b06700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e015d170 con 0x7f67e006a3a0 2023-11-28T11:55:07.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5305700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e00d1e30 0x7f67e00b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:07.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5305700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e00d1e30 0x7f67e00b0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38776/0 (socket says 172.21.15.50:38776) 2023-11-28T11:55:07.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5305700 1 -- 172.21.15.50:0/1493527273 learned_addr learned my addr 172.21.15.50:0/1493527273 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:07.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e4b04700 1 --2- 172.21.15.50:0/1493527273 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67e006a3a0 0x7f67e014dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:07.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67dffff700 1 --2- 172.21.15.50:0/1493527273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67e006ce60 0x7f67e015ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:07.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5305700 1 -- 172.21.15.50:0/1493527273 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67e006a3a0 msgr2=0x7f67e014dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:07.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5305700 1 --2- 172.21.15.50:0/1493527273 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67e006a3a0 0x7f67e014dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:07.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5305700 1 -- 172.21.15.50:0/1493527273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67e006ce60 msgr2=0x7f67e015ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:07.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5305700 1 --2- 172.21.15.50:0/1493527273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67e006ce60 0x7f67e015ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:07.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e5305700 1 -- 172.21.15.50:0/1493527273 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d0009570 con 0x7f67e00d1e30 2023-11-28T11:55:07.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67dffff700 1 --2- 172.21.15.50:0/1493527273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67e006ce60 0x7f67e015ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:55:07.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.007+0000 7f67e4b04700 1 --2- 172.21.15.50:0/1493527273 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67e006a3a0 0x7f67e014dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:55:07.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.011+0000 7f67e5305700 1 --2- 172.21.15.50:0/1493527273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e00d1e30 0x7f67e00b0500 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f67d800cc50 tx=0x7f67d800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:07.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.011+0000 7f67dd7fa700 1 -- 172.21.15.50:0/1493527273 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d800ad80 con 0x7f67e00d1e30 2023-11-28T11:55:07.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.011+0000 7f67dd7fa700 1 -- 172.21.15.50:0/1493527273 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d800ce50 con 0x7f67e00d1e30 2023-11-28T11:55:07.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.011+0000 7f67dd7fa700 1 -- 172.21.15.50:0/1493527273 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8003c60 con 0x7f67e00d1e30 2023-11-28T11:55:07.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.011+0000 7f67e5b06700 1 -- 172.21.15.50:0/1493527273 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e006d770 con 0x7f67e00d1e30 2023-11-28T11:55:07.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.011+0000 7f67e5b06700 1 -- 172.21.15.50:0/1493527273 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e00d0120 con 0x7f67e00d1e30 2023-11-28T11:55:07.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.011+0000 7f67e5b06700 1 -- 172.21.15.50:0/1493527273 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e015c700 con 0x7f67e00d1e30 2023-11-28T11:55:07.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.011+0000 7f67dd7fa700 1 -- 172.21.15.50:0/1493527273 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f67d8010050 con 0x7f67e00d1e30 2023-11-28T11:55:07.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.011+0000 7f67dd7fa700 1 --2- 172.21.15.50:0/1493527273 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f67cc064ee0 0x7f67cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:07.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.011+0000 7f67dd7fa700 1 -- 172.21.15.50:0/1493527273 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f67d8081f90 con 0x7f67e00d1e30 2023-11-28T11:55:07.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.015+0000 7f67e4b04700 1 --2- 172.21.15.50:0/1493527273 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f67cc064ee0 0x7f67cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:07.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.015+0000 7f67e4b04700 1 --2- 172.21.15.50:0/1493527273 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f67cc064ee0 0x7f67cc067390 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009b70 tx=0x7f67d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:07.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.019+0000 7f67dd7fa700 1 -- 172.21.15.50:0/1493527273 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f67d804fff0 con 0x7f67e00d1e30 2023-11-28T11:55:07.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:07.219+0000 7f67e5b06700 1 -- 172.21.15.50:0/1493527273 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f67e00c6180 con 0x7f67e00d1e30 2023-11-28T11:55:08.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.219+0000 7f67dd7fa700 1 -- 172.21.15.50:0/1493527273 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f67e00c6180 con 0x7f67e00d1e30 2023-11-28T11:55:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.227+0000 7f67e5b06700 1 -- 172.21.15.50:0/1493527273 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f67cc064ee0 msgr2=0x7f67cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.227+0000 7f67e5b06700 1 --2- 172.21.15.50:0/1493527273 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f67cc064ee0 0x7f67cc067390 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009b70 tx=0x7f67d4008040 comp rx=0 tx=0).stop 2023-11-28T11:55:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.227+0000 7f67e5b06700 1 -- 172.21.15.50:0/1493527273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e00d1e30 msgr2=0x7f67e00b0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.227+0000 7f67e5b06700 1 --2- 172.21.15.50:0/1493527273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e00d1e30 0x7f67e00b0500 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f67d800cc50 tx=0x7f67d800a340 comp rx=0 tx=0).stop 2023-11-28T11:55:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.227+0000 7f67e5b06700 1 -- 172.21.15.50:0/1493527273 shutdown_connections 2023-11-28T11:55:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.227+0000 7f67e5b06700 1 --2- 172.21.15.50:0/1493527273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67e00d1e30 0x7f67e00b0500 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.227+0000 7f67e5b06700 1 --2- 172.21.15.50:0/1493527273 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f67cc064ee0 0x7f67cc067390 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.227+0000 7f67e5b06700 1 --2- 172.21.15.50:0/1493527273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67e006ce60 0x7f67e015ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.227+0000 7f67e5b06700 1 --2- 172.21.15.50:0/1493527273 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67e006a3a0 0x7f67e014dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.227+0000 7f67e5b06700 1 -- 172.21.15.50:0/1493527273 >> 172.21.15.50:0/1493527273 conn(0x7f67e009bbd0 msgr2=0x7f67e015be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.227+0000 7f67e5b06700 1 -- 172.21.15.50:0/1493527273 shutdown_connections 2023-11-28T11:55:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.227+0000 7f67e5b06700 1 -- 172.21.15.50:0/1493527273 wait complete. 2023-11-28T11:55:08.245 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T11:55:08.245 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T11:55:08.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02faabc700 1 Processor -- start 2023-11-28T11:55:08.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02faabc700 1 -- start start 2023-11-28T11:55:08.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02faabc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f02f40b1ae0 0x7f02f406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:08.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02faabc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f40cf0e0 0x7f02f40cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:08.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02faabc700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f40cfa80 con 0x7f02f406a4c0 2023-11-28T11:55:08.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02faabc700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f40d0ab0 con 0x7f02f40b1ae0 2023-11-28T11:55:08.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02faabc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f406a9c0 con 0x7f02f40cf0e0 2023-11-28T11:55:08.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02f9aba700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f02f40b1ae0 0x7f02f406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:08.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02f92b9700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f02f406a4c0 0x7f02f40d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42242/0 (socket says 172.21.15.50:42242) 2023-11-28T11:55:08.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02f92b9700 1 -- 172.21.15.50:0/2907069789 learned_addr learned my addr 172.21.15.50:0/2907069789 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:08.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02fa2bb700 1 --2- 172.21.15.50:0/2907069789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f40cf0e0 0x7f02f40cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:08.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02f8ab8700 1 -- 172.21.15.50:0/2907069789 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353670402 0 0) 0x7f02f40cfa80 con 0x7f02f406a4c0 2023-11-28T11:55:08.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02f8ab8700 1 -- 172.21.15.50:0/2907069789 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02e00035d0 con 0x7f02f406a4c0 2023-11-28T11:55:08.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02f9aba700 1 -- 172.21.15.50:0/2907069789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f40cf0e0 msgr2=0x7f02f40cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:08.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02f9aba700 1 --2- 172.21.15.50:0/2907069789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f40cf0e0 0x7f02f40cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:08.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02f9aba700 1 -- 172.21.15.50:0/2907069789 >> v1:172.21.15.50:6789/0 conn(0x7f02f406a4c0 legacy=0x7f02f40d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:08.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02f9aba700 1 -- 172.21.15.50:0/2907069789 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f406aca0 con 0x7f02f40b1ae0 2023-11-28T11:55:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02f9aba700 1 --2- 172.21.15.50:0/2907069789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f40b1ae0 0x7f02f406d8e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f02f0009850 tx=0x7f02f0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb786b06cf99e9a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02f8ab8700 1 -- 172.21.15.50:0/2907069789 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0011830 con 0x7f02f40b1ae0 2023-11-28T11:55:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02f8ab8700 1 -- 172.21.15.50:0/2907069789 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f0011990 con 0x7f02f40b1ae0 2023-11-28T11:55:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.375+0000 7f02f8ab8700 1 -- 172.21.15.50:0/2907069789 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0011d40 con 0x7f02f40b1ae0 2023-11-28T11:55:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02faabc700 1 -- 172.21.15.50:0/2907069789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f40b1ae0 msgr2=0x7f02f406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02faabc700 1 --2- 172.21.15.50:0/2907069789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f40b1ae0 0x7f02f406d8e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f02f0009850 tx=0x7f02f0009b60 comp rx=0 tx=0).stop 2023-11-28T11:55:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02faabc700 1 -- 172.21.15.50:0/2907069789 shutdown_connections 2023-11-28T11:55:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02faabc700 1 --2- 172.21.15.50:0/2907069789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f40cf0e0 0x7f02f40cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02faabc700 1 --2- 172.21.15.50:0/2907069789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f40b1ae0 0x7f02f406d8e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02faabc700 1 -- 172.21.15.50:0/2907069789 >> 172.21.15.50:0/2907069789 conn(0x7f02f409bbd0 msgr2=0x7f02f40b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02faabc700 1 -- 172.21.15.50:0/2907069789 shutdown_connections 2023-11-28T11:55:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02faabc700 1 -- 172.21.15.50:0/2907069789 wait complete. 2023-11-28T11:55:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02faabc700 1 Processor -- start 2023-11-28T11:55:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02faabc700 1 -- start start 2023-11-28T11:55:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02faabc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02f406a4c0 0x7f02f4159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02faabc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f40b1ae0 0x7f02f409db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02faabc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f40cf0e0 0x7f02f409e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02faabc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f409e6b0 con 0x7f02f40cf0e0 2023-11-28T11:55:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02faabc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f415b810 con 0x7f02f406a4c0 2023-11-28T11:55:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02faabc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f415e6b0 con 0x7f02f40b1ae0 2023-11-28T11:55:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02fa2bb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f40cf0e0 0x7f02f409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02fa2bb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f40cf0e0 0x7f02f409e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38792/0 (socket says 172.21.15.50:38792) 2023-11-28T11:55:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02fa2bb700 1 -- 172.21.15.50:0/2682494240 learned_addr learned my addr 172.21.15.50:0/2682494240 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02f9aba700 1 --2- 172.21.15.50:0/2682494240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02f406a4c0 0x7f02f4159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02f92b9700 1 --2- 172.21.15.50:0/2682494240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f40b1ae0 0x7f02f409db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02fa2bb700 1 -- 172.21.15.50:0/2682494240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f40b1ae0 msgr2=0x7f02f409db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02fa2bb700 1 --2- 172.21.15.50:0/2682494240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f40b1ae0 0x7f02f409db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02fa2bb700 1 -- 172.21.15.50:0/2682494240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02f406a4c0 msgr2=0x7f02f4159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02fa2bb700 1 --2- 172.21.15.50:0/2682494240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02f406a4c0 0x7f02f4159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02fa2bb700 1 -- 172.21.15.50:0/2682494240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f00094b0 con 0x7f02f40cf0e0 2023-11-28T11:55:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02f9aba700 1 --2- 172.21.15.50:0/2682494240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02f406a4c0 0x7f02f4159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:08.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02fa2bb700 1 --2- 172.21.15.50:0/2682494240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f40cf0e0 0x7f02f409e080 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00efc0 tx=0x7f02ec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:08.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02ea7fc700 1 -- 172.21.15.50:0/2682494240 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec00cd40 con 0x7f02f40cf0e0 2023-11-28T11:55:08.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02ea7fc700 1 -- 172.21.15.50:0/2682494240 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec00f040 con 0x7f02f40cf0e0 2023-11-28T11:55:08.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02ea7fc700 1 -- 172.21.15.50:0/2682494240 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec0146c0 con 0x7f02f40cf0e0 2023-11-28T11:55:08.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.379+0000 7f02faabc700 1 -- 172.21.15.50:0/2682494240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f40b4380 con 0x7f02f40cf0e0 2023-11-28T11:55:08.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.383+0000 7f02faabc700 1 -- 172.21.15.50:0/2682494240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f406af80 con 0x7f02f40cf0e0 2023-11-28T11:55:08.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.383+0000 7f02faabc700 1 -- 172.21.15.50:0/2682494240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f40b1eb0 con 0x7f02f40cf0e0 2023-11-28T11:55:08.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.383+0000 7f02ea7fc700 1 -- 172.21.15.50:0/2682494240 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f02ec014820 con 0x7f02f40cf0e0 2023-11-28T11:55:08.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.383+0000 7f02ea7fc700 1 --2- 172.21.15.50:0/2682494240 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f02d8064ee0 0x7f02d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:08.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.383+0000 7f02ea7fc700 1 -- 172.21.15.50:0/2682494240 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f02ec082b50 con 0x7f02f40cf0e0 2023-11-28T11:55:08.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.383+0000 7f02f9aba700 1 --2- 172.21.15.50:0/2682494240 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f02d8064ee0 0x7f02d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.387+0000 7f02f9aba700 1 --2- 172.21.15.50:0/2682494240 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f02d8064ee0 0x7f02d8067390 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f02f00090b0 tx=0x7f02f0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:08.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.395+0000 7f02ea7fc700 1 -- 172.21.15.50:0/2682494240 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f02ec050ac0 con 0x7f02f40cf0e0 2023-11-28T11:55:08.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:08.595+0000 7f02faabc700 1 -- 172.21.15.50:0/2682494240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f02f4072500 con 0x7f02f40cf0e0 2023-11-28T11:55:09.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.223+0000 7f02ea7fc700 1 -- 172.21.15.50:0/2682494240 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f02ec00cea0 con 0x7f02f40cf0e0 2023-11-28T11:55:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.227+0000 7f02faabc700 1 -- 172.21.15.50:0/2682494240 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f02d8064ee0 msgr2=0x7f02d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.227+0000 7f02faabc700 1 --2- 172.21.15.50:0/2682494240 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f02d8064ee0 0x7f02d8067390 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f02f00090b0 tx=0x7f02f0008030 comp rx=0 tx=0).stop 2023-11-28T11:55:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.227+0000 7f02faabc700 1 -- 172.21.15.50:0/2682494240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f40cf0e0 msgr2=0x7f02f409e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.227+0000 7f02faabc700 1 --2- 172.21.15.50:0/2682494240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f40cf0e0 0x7f02f409e080 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00efc0 tx=0x7f02ec00c3a0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.227+0000 7f02faabc700 1 -- 172.21.15.50:0/2682494240 shutdown_connections 2023-11-28T11:55:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.227+0000 7f02faabc700 1 --2- 172.21.15.50:0/2682494240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02f40cf0e0 0x7f02f409e080 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.227+0000 7f02faabc700 1 --2- 172.21.15.50:0/2682494240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f40b1ae0 0x7f02f409db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.227+0000 7f02faabc700 1 --2- 172.21.15.50:0/2682494240 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f02d8064ee0 0x7f02d8067390 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.227+0000 7f02faabc700 1 --2- 172.21.15.50:0/2682494240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02f406a4c0 0x7f02f4159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.227+0000 7f02faabc700 1 -- 172.21.15.50:0/2682494240 >> 172.21.15.50:0/2682494240 conn(0x7f02f409bbd0 msgr2=0x7f02f40cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.227+0000 7f02faabc700 1 -- 172.21.15.50:0/2682494240 shutdown_connections 2023-11-28T11:55:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.231+0000 7f02faabc700 1 -- 172.21.15.50:0/2682494240 wait complete. 2023-11-28T11:55:09.249 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T11:55:09.249 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:55:09.325 INFO:tasks.ceph.mds.c.smithi050.stderr:2023-11-28T11:55:09.323+0000 7f71f2ea9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:55:09.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.367+0000 7f147b59e700 1 Processor -- start 2023-11-28T11:55:09.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.367+0000 7f147b59e700 1 -- start start 2023-11-28T11:55:09.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.367+0000 7f147b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f147c0b1ca0 0x7f147c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:09.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.367+0000 7f147b59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f147c06a330 0x7f147c0cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:09.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.367+0000 7f147b59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c0cf070 con 0x7f147c0d2780 2023-11-28T11:55:09.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.367+0000 7f147b59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147c0b2070 con 0x7f147c06a330 2023-11-28T11:55:09.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.367+0000 7f147b59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c06a8a0 con 0x7f147c0b1ca0 2023-11-28T11:55:09.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.367+0000 7f1479d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f147c06a330 0x7f147c0cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:09.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.367+0000 7f147ad9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f147c0d2780 0x7f147c0cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42248/0 (socket says 172.21.15.50:42248) 2023-11-28T11:55:09.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.367+0000 7f147ad9d700 1 -- 172.21.15.50:0/2381168083 learned_addr learned my addr 172.21.15.50:0/2381168083 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f147a59c700 1 --2- 172.21.15.50:0/2381168083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f147c0b1ca0 0x7f147c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:09.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f147959a700 1 -- 172.21.15.50:0/2381168083 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469852377 0 0) 0x7f147c0cf070 con 0x7f147c0d2780 2023-11-28T11:55:09.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f147959a700 1 -- 172.21.15.50:0/2381168083 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14680035d0 con 0x7f147c0d2780 2023-11-28T11:55:09.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f1479d9b700 1 -- 172.21.15.50:0/2381168083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f147c0b1ca0 msgr2=0x7f147c0b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:09.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f1479d9b700 1 --2- 172.21.15.50:0/2381168083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f147c0b1ca0 0x7f147c0b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f1479d9b700 1 -- 172.21.15.50:0/2381168083 >> v1:172.21.15.50:6789/0 conn(0x7f147c0d2780 legacy=0x7f147c0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f1479d9b700 1 -- 172.21.15.50:0/2381168083 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c06ab80 con 0x7f147c06a330 2023-11-28T11:55:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f1479d9b700 1 --2- 172.21.15.50:0/2381168083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f147c06a330 0x7f147c0cce40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1464009850 tx=0x7f1464009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd4d34fddaaca31 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f147959a700 1 -- 172.21.15.50:0/2381168083 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1464011830 con 0x7f147c06a330 2023-11-28T11:55:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f147959a700 1 -- 172.21.15.50:0/2381168083 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1464011990 con 0x7f147c06a330 2023-11-28T11:55:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f147959a700 1 -- 172.21.15.50:0/2381168083 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1464011d40 con 0x7f147c06a330 2023-11-28T11:55:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f147b59e700 1 -- 172.21.15.50:0/2381168083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f147c06a330 msgr2=0x7f147c0cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f147b59e700 1 --2- 172.21.15.50:0/2381168083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f147c06a330 0x7f147c0cce40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1464009850 tx=0x7f1464009b60 comp rx=0 tx=0).stop 2023-11-28T11:55:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f147b59e700 1 -- 172.21.15.50:0/2381168083 shutdown_connections 2023-11-28T11:55:09.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f147b59e700 1 --2- 172.21.15.50:0/2381168083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f147c06a330 0x7f147c0cce40 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f147b59e700 1 --2- 172.21.15.50:0/2381168083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f147c0b1ca0 0x7f147c0b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f147b59e700 1 -- 172.21.15.50:0/2381168083 >> 172.21.15.50:0/2381168083 conn(0x7f147c0b5740 msgr2=0x7f147c0b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:09.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f147b59e700 1 -- 172.21.15.50:0/2381168083 shutdown_connections 2023-11-28T11:55:09.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.371+0000 7f147b59e700 1 -- 172.21.15.50:0/2381168083 wait complete. 2023-11-28T11:55:09.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147b59e700 1 Processor -- start 2023-11-28T11:55:09.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147b59e700 1 -- start start 2023-11-28T11:55:09.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147b59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f147c06a330 0x7f147c0b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:09.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f147c0b1ca0 0x7f147c158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:09.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f147c0d2780 0x7f147c0c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:09.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0c6a80 con 0x7f147c0d2780 2023-11-28T11:55:09.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147b59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0c9260 con 0x7f147c06a330 2023-11-28T11:55:09.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147b59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0c8f80 con 0x7f147c0b1ca0 2023-11-28T11:55:09.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f147c0d2780 0x7f147c0c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:09.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f147c0d2780 0x7f147c0c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38812/0 (socket says 172.21.15.50:38812) 2023-11-28T11:55:09.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147ad9d700 1 -- 172.21.15.50:0/2671654510 learned_addr learned my addr 172.21.15.50:0/2671654510 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:09.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f1479d9b700 1 --2- 172.21.15.50:0/2671654510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f147c0b1ca0 0x7f147c158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:09.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147a59c700 1 --2- 172.21.15.50:0/2671654510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f147c06a330 0x7f147c0b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:09.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147ad9d700 1 -- 172.21.15.50:0/2671654510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f147c0b1ca0 msgr2=0x7f147c158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:09.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147ad9d700 1 --2- 172.21.15.50:0/2671654510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f147c0b1ca0 0x7f147c158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147ad9d700 1 -- 172.21.15.50:0/2671654510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f147c06a330 msgr2=0x7f147c0b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:09.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147ad9d700 1 --2- 172.21.15.50:0/2671654510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f147c06a330 0x7f147c0b38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147ad9d700 1 -- 172.21.15.50:0/2671654510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14640094b0 con 0x7f147c0d2780 2023-11-28T11:55:09.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147ad9d700 1 --2- 172.21.15.50:0/2671654510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f147c0d2780 0x7f147c0c85a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f147400cb70 tx=0x7f147400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:09.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f1472ffd700 1 -- 172.21.15.50:0/2671654510 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474007480 con 0x7f147c0d2780 2023-11-28T11:55:09.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f1472ffd700 1 -- 172.21.15.50:0/2671654510 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14740075e0 con 0x7f147c0d2780 2023-11-28T11:55:09.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147b59e700 1 -- 172.21.15.50:0/2671654510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c06b140 con 0x7f147c0d2780 2023-11-28T11:55:09.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f1472ffd700 1 -- 172.21.15.50:0/2671654510 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474007950 con 0x7f147c0d2780 2023-11-28T11:55:09.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.375+0000 7f147b59e700 1 -- 172.21.15.50:0/2671654510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c06ae60 con 0x7f147c0d2780 2023-11-28T11:55:09.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.379+0000 7f147b59e700 1 -- 172.21.15.50:0/2671654510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c0cd380 con 0x7f147c0d2780 2023-11-28T11:55:09.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.379+0000 7f1472ffd700 1 -- 172.21.15.50:0/2671654510 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1474019030 con 0x7f147c0d2780 2023-11-28T11:55:09.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.379+0000 7f1472ffd700 1 --2- 172.21.15.50:0/2671654510 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f145c064ee0 0x7f145c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:09.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.379+0000 7f1472ffd700 1 -- 172.21.15.50:0/2671654510 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1474081790 con 0x7f147c0d2780 2023-11-28T11:55:09.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.379+0000 7f147a59c700 1 --2- 172.21.15.50:0/2671654510 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f145c064ee0 0x7f145c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:09.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.379+0000 7f147a59c700 1 --2- 172.21.15.50:0/2671654510 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f145c064ee0 0x7f145c067390 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f146c009bf0 tx=0x7f146c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:09.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.383+0000 7f1472ffd700 1 -- 172.21.15.50:0/2671654510 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f147404a400 con 0x7f147c0d2780 2023-11-28T11:55:09.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.583+0000 7f147b59e700 1 -- 172.21.15.50:0/2671654510 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f147c0c6c30 con 0x7f147c0d2780 2023-11-28T11:55:09.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.583+0000 7f1472ffd700 1 -- 172.21.15.50:0/2671654510 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f147c0c6c30 con 0x7f147c0d2780 2023-11-28T11:55:09.586 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:09.586 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2392153383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2392153383},{"type":"v1","addr":"172.21.15.192:6837","nonce":2392153383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5515,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3694451276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3694451276},{"type":"v1","addr":"172.21.15.192:6835","nonce":3694451276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2782289763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2782289763},{"type":"v1","addr":"172.21.15.50:6833","nonce":2782289763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:55:06.200530+0000","modified":"2023-11-28T11:55:09.218769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5559},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5559":{"gid":5559,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2320802269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2320802269},{"type":"v1","addr":"172.21.15.50:6835","nonce":2320802269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:55:09.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.587+0000 7f147b59e700 1 -- 172.21.15.50:0/2671654510 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f145c064ee0 msgr2=0x7f145c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:09.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.587+0000 7f147b59e700 1 --2- 172.21.15.50:0/2671654510 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f145c064ee0 0x7f145c067390 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f146c009bf0 tx=0x7f146c009240 comp rx=0 tx=0).stop 2023-11-28T11:55:09.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.587+0000 7f147b59e700 1 -- 172.21.15.50:0/2671654510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f147c0d2780 msgr2=0x7f147c0c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:09.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.587+0000 7f147b59e700 1 --2- 172.21.15.50:0/2671654510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f147c0d2780 0x7f147c0c85a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f147400cb70 tx=0x7f147400cba0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.587+0000 7f147b59e700 1 -- 172.21.15.50:0/2671654510 shutdown_connections 2023-11-28T11:55:09.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.587+0000 7f147b59e700 1 --2- 172.21.15.50:0/2671654510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f147c0d2780 0x7f147c0c85a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.587+0000 7f147b59e700 1 --2- 172.21.15.50:0/2671654510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f147c0b1ca0 0x7f147c158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.587+0000 7f147b59e700 1 --2- 172.21.15.50:0/2671654510 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f145c064ee0 0x7f145c067390 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.587+0000 7f147b59e700 1 --2- 172.21.15.50:0/2671654510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f147c06a330 0x7f147c0b38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.587+0000 7f147b59e700 1 -- 172.21.15.50:0/2671654510 >> 172.21.15.50:0/2671654510 conn(0x7f147c0b5740 msgr2=0x7f147c0d18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:09.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.587+0000 7f147b59e700 1 -- 172.21.15.50:0/2671654510 shutdown_connections 2023-11-28T11:55:09.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.587+0000 7f147b59e700 1 -- 172.21.15.50:0/2671654510 wait complete. 2023-11-28T11:55:09.589 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-11-28T11:55:09.602 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:55:09.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.715+0000 7fb0ab59e700 1 Processor -- start 2023-11-28T11:55:09.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.715+0000 7fb0ab59e700 1 -- start start 2023-11-28T11:55:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.715+0000 7fb0ab59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0ac15c150 0x7fb0ac1607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.715+0000 7fb0ab59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0ac0c9e70 0x7fb0ac0cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.715+0000 7fb0ab59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0ac15c520 con 0x7fb0ac0cc430 2023-11-28T11:55:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.715+0000 7fb0ab59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ac0ca680 con 0x7fb0ac15c150 2023-11-28T11:55:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.715+0000 7fb0ab59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac0ca960 con 0x7fb0ac0c9e70 2023-11-28T11:55:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.715+0000 7fb0aa59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0ac15c150 0x7fb0ac1607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0aa59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0ac15c150 0x7fb0ac1607b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38818/0 (socket says 172.21.15.50:38818) 2023-11-28T11:55:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0aa59c700 1 -- 172.21.15.50:0/65360362 learned_addr learned my addr 172.21.15.50:0/65360362 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0a3fff700 1 --2- 172.21.15.50:0/65360362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0ac0c9e70 0x7fb0ac0cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0aa59c700 1 -- 172.21.15.50:0/65360362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0ac0c9e70 msgr2=0x7fb0ac0cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0aa59c700 1 --2- 172.21.15.50:0/65360362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0ac0c9e70 0x7fb0ac0cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0aa59c700 1 -- 172.21.15.50:0/65360362 >> v1:172.21.15.192:6789/0 conn(0x7fb0ac0cc430 legacy=0x7fb0ac070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:09.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0aa59c700 1 -- 172.21.15.50:0/65360362 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac0cf330 con 0x7fb0ac15c150 2023-11-28T11:55:09.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0aa59c700 1 --2- 172.21.15.50:0/65360362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0ac15c150 0x7fb0ac1607b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009910 tx=0x7fb09c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b1c3500657d1d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:09.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0a9d9b700 1 -- 172.21.15.50:0/65360362 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c011830 con 0x7fb0ac15c150 2023-11-28T11:55:09.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0a9d9b700 1 -- 172.21.15.50:0/65360362 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c011990 con 0x7fb0ac15c150 2023-11-28T11:55:09.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0a9d9b700 1 -- 172.21.15.50:0/65360362 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c011d40 con 0x7fb0ac15c150 2023-11-28T11:55:09.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0ab59e700 1 -- 172.21.15.50:0/65360362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0ac15c150 msgr2=0x7fb0ac1607b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:09.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0ab59e700 1 --2- 172.21.15.50:0/65360362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0ac15c150 0x7fb0ac1607b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009910 tx=0x7fb09c009c20 comp rx=0 tx=0).stop 2023-11-28T11:55:09.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0ab59e700 1 -- 172.21.15.50:0/65360362 shutdown_connections 2023-11-28T11:55:09.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0ab59e700 1 --2- 172.21.15.50:0/65360362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0ac0c9e70 0x7fb0ac0cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0ab59e700 1 --2- 172.21.15.50:0/65360362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0ac15c150 0x7fb0ac1607b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0ab59e700 1 -- 172.21.15.50:0/65360362 >> 172.21.15.50:0/65360362 conn(0x7fb0ac06ec40 msgr2=0x7fb0ac0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:09.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0ab59e700 1 -- 172.21.15.50:0/65360362 shutdown_connections 2023-11-28T11:55:09.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.719+0000 7fb0ab59e700 1 -- 172.21.15.50:0/65360362 wait complete. 2023-11-28T11:55:09.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0ab59e700 1 Processor -- start 2023-11-28T11:55:09.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0ab59e700 1 -- start start 2023-11-28T11:55:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0ab59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0ac0c9e70 0x7fb0ac1f1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0ab59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0ac0cc430 0x7fb0ac0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0ab59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0ac15c150 0x7fb0ac070e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0ab59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac0b2500 con 0x7fb0ac0cc430 2023-11-28T11:55:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0ab59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac0c3710 con 0x7fb0ac15c150 2023-11-28T11:55:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0ab59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac0c39f0 con 0x7fb0ac0c9e70 2023-11-28T11:55:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0a3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0ac0cc430 0x7fb0ac0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0a3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0ac0cc430 0x7fb0ac0c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38822/0 (socket says 172.21.15.50:38822) 2023-11-28T11:55:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0a3fff700 1 -- 172.21.15.50:0/3505098519 learned_addr learned my addr 172.21.15.50:0/3505098519 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0aa59c700 1 --2- 172.21.15.50:0/3505098519 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0ac0c9e70 0x7fb0ac1f1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0aad9d700 1 --2- 172.21.15.50:0/3505098519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0ac15c150 0x7fb0ac070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:09.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0a3fff700 1 -- 172.21.15.50:0/3505098519 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0ac0c9e70 msgr2=0x7fb0ac1f1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:09.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0a3fff700 1 --2- 172.21.15.50:0/3505098519 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0ac0c9e70 0x7fb0ac1f1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0a3fff700 1 -- 172.21.15.50:0/3505098519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0ac15c150 msgr2=0x7fb0ac070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0a3fff700 1 --2- 172.21.15.50:0/3505098519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0ac15c150 0x7fb0ac070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0a3fff700 1 -- 172.21.15.50:0/3505098519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c009570 con 0x7fb0ac0cc430 2023-11-28T11:55:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0a3fff700 1 --2- 172.21.15.50:0/3505098519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0ac0cc430 0x7fb0ac0c7660 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb09400e9d0 tx=0x7fb09400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0a2ffd700 1 -- 172.21.15.50:0/3505098519 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094009720 con 0x7fb0ac0cc430 2023-11-28T11:55:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0a2ffd700 1 -- 172.21.15.50:0/3505098519 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09400ee70 con 0x7fb0ac0cc430 2023-11-28T11:55:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0ab59e700 1 -- 172.21.15.50:0/3505098519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ac0cdb20 con 0x7fb0ac0cc430 2023-11-28T11:55:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0a2ffd700 1 -- 172.21.15.50:0/3505098519 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09400ca50 con 0x7fb0ac0cc430 2023-11-28T11:55:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.723+0000 7fb0ab59e700 1 -- 172.21.15.50:0/3505098519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ac0cd840 con 0x7fb0ac0cc430 2023-11-28T11:55:09.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.727+0000 7fb0ab59e700 1 -- 172.21.15.50:0/3505098519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ac0cde00 con 0x7fb0ac0cc430 2023-11-28T11:55:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.727+0000 7fb0a2ffd700 1 -- 172.21.15.50:0/3505098519 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb094019030 con 0x7fb0ac0cc430 2023-11-28T11:55:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.727+0000 7fb0a2ffd700 1 --2- 172.21.15.50:0/3505098519 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb08c064ee0 0x7fb08c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.727+0000 7fb0a2ffd700 1 -- 172.21.15.50:0/3505098519 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb094081ec0 con 0x7fb0ac0cc430 2023-11-28T11:55:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.727+0000 7fb0aa59c700 1 --2- 172.21.15.50:0/3505098519 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb08c064ee0 0x7fb08c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.727+0000 7fb0aa59c700 1 --2- 172.21.15.50:0/3505098519 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb08c064ee0 0x7fb08c067390 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb09c014040 tx=0x7fb09c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:09.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.735+0000 7fb0a2ffd700 1 -- 172.21.15.50:0/3505098519 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb09404fec0 con 0x7fb0ac0cc430 2023-11-28T11:55:09.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.899+0000 7fb0ab59e700 1 -- 172.21.15.50:0/3505098519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0ac072c20 con 0x7fb0ac0cc430 2023-11-28T11:55:09.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.903+0000 7fb0a2ffd700 1 -- 172.21.15.50:0/3505098519 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17974 (secure 0 0 0) 0x7fb0940534e0 con 0x7fb0ac0cc430 2023-11-28T11:55:09.905 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:09.905 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":40,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:55:07.205255+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:55:03.889842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T11:55:05.177617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:55:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.903+0000 7fb0ab59e700 1 -- 172.21.15.50:0/3505098519 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb08c064ee0 msgr2=0x7fb08c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.903+0000 7fb0ab59e700 1 --2- 172.21.15.50:0/3505098519 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb08c064ee0 0x7fb08c067390 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb09c014040 tx=0x7fb09c008030 comp rx=0 tx=0).stop 2023-11-28T11:55:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.903+0000 7fb0ab59e700 1 -- 172.21.15.50:0/3505098519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0ac0cc430 msgr2=0x7fb0ac0c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.903+0000 7fb0ab59e700 1 --2- 172.21.15.50:0/3505098519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0ac0cc430 0x7fb0ac0c7660 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb09400e9d0 tx=0x7fb09400ece0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.903+0000 7fb0ab59e700 1 -- 172.21.15.50:0/3505098519 shutdown_connections 2023-11-28T11:55:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.903+0000 7fb0ab59e700 1 --2- 172.21.15.50:0/3505098519 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb08c064ee0 0x7fb08c067390 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.903+0000 7fb0ab59e700 1 --2- 172.21.15.50:0/3505098519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0ac15c150 0x7fb0ac070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.903+0000 7fb0ab59e700 1 --2- 172.21.15.50:0/3505098519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0ac0cc430 0x7fb0ac0c7660 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.903+0000 7fb0ab59e700 1 --2- 172.21.15.50:0/3505098519 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0ac0c9e70 0x7fb0ac1f1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.903+0000 7fb0ab59e700 1 -- 172.21.15.50:0/3505098519 >> 172.21.15.50:0/3505098519 conn(0x7fb0ac06ec40 msgr2=0x7fb0ac0af280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.903+0000 7fb0ab59e700 1 -- 172.21.15.50:0/3505098519 shutdown_connections 2023-11-28T11:55:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:09.903+0000 7fb0ab59e700 1 -- 172.21.15.50:0/3505098519 wait complete. 2023-11-28T11:55:09.919 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T11:55:09.920 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:55:10.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.023+0000 7fe86a5c6700 1 Processor -- start 2023-11-28T11:55:10.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.023+0000 7fe86a5c6700 1 -- start start 2023-11-28T11:55:10.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.023+0000 7fe86a5c6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8640ce960 0x7fe86415d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.023+0000 7fe86a5c6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe8640d2500 0x7fe8640d2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.023+0000 7fe86a5c6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8640ccf60 con 0x7fe8640d2e70 2023-11-28T11:55:10.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.023+0000 7fe86a5c6700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8640d32d0 con 0x7fe8640d2500 2023-11-28T11:55:10.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.023+0000 7fe86a5c6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640b66a0 con 0x7fe8640ce960 2023-11-28T11:55:10.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.023+0000 7fe868dc3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe8640d2500 0x7fe8640d2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.023+0000 7fe868dc3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe8640d2500 0x7fe8640d2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38830/0 (socket says 172.21.15.50:38830) 2023-11-28T11:55:10.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.023+0000 7fe869dc5700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe8640d2e70 0x7fe86406a330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42258/0 (socket says 172.21.15.50:42258) 2023-11-28T11:55:10.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.023+0000 7fe868dc3700 1 -- 172.21.15.50:0/541287606 learned_addr learned my addr 172.21.15.50:0/541287606 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:10.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.023+0000 7fe8695c4700 1 --2- 172.21.15.50:0/541287606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8640ce960 0x7fe86415d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.023+0000 7fe868dc3700 1 -- 172.21.15.50:0/541287606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8640ce960 msgr2=0x7fe86415d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:10.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.023+0000 7fe868dc3700 1 --2- 172.21.15.50:0/541287606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8640ce960 0x7fe86415d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.023+0000 7fe868dc3700 1 -- 172.21.15.50:0/541287606 >> v1:172.21.15.50:6789/0 conn(0x7fe8640d2e70 legacy=0x7fe86406a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:10.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.023+0000 7fe85bfff700 1 -- 172.21.15.50:0/541287606 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291139911 0 0) 0x7fe8640ccf60 con 0x7fe8640d2e70 2023-11-28T11:55:10.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.027+0000 7fe868dc3700 1 -- 172.21.15.50:0/541287606 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8640b78b0 con 0x7fe8640d2500 2023-11-28T11:55:10.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.027+0000 7fe868dc3700 1 --2- 172.21.15.50:0/541287606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8640d2500 0x7fe8640d2930 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe854009910 tx=0x7fe854009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4d1b88616226e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:10.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.027+0000 7fe85bfff700 1 -- 172.21.15.50:0/541287606 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85400ba60 con 0x7fe8640d2500 2023-11-28T11:55:10.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.027+0000 7fe85bfff700 1 -- 172.21.15.50:0/541287606 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85400bbc0 con 0x7fe8640d2500 2023-11-28T11:55:10.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.027+0000 7fe85bfff700 1 -- 172.21.15.50:0/541287606 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854009e60 con 0x7fe8640d2500 2023-11-28T11:55:10.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.027+0000 7fe86a5c6700 1 -- 172.21.15.50:0/541287606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8640d2500 msgr2=0x7fe8640d2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:10.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.027+0000 7fe86a5c6700 1 --2- 172.21.15.50:0/541287606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8640d2500 0x7fe8640d2930 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe854009910 tx=0x7fe854009c20 comp rx=0 tx=0).stop 2023-11-28T11:55:10.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.027+0000 7fe86a5c6700 1 -- 172.21.15.50:0/541287606 shutdown_connections 2023-11-28T11:55:10.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.027+0000 7fe86a5c6700 1 --2- 172.21.15.50:0/541287606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8640d2500 0x7fe8640d2930 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.027+0000 7fe86a5c6700 1 --2- 172.21.15.50:0/541287606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8640ce960 0x7fe86415d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.027+0000 7fe86a5c6700 1 -- 172.21.15.50:0/541287606 >> 172.21.15.50:0/541287606 conn(0x7fe8640b5860 msgr2=0x7fe8640b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:10.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.027+0000 7fe86a5c6700 1 -- 172.21.15.50:0/541287606 shutdown_connections 2023-11-28T11:55:10.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.027+0000 7fe86a5c6700 1 -- 172.21.15.50:0/541287606 wait complete. 2023-11-28T11:55:10.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.027+0000 7fe86a5c6700 1 Processor -- start 2023-11-28T11:55:10.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe86a5c6700 1 -- start start 2023-11-28T11:55:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe86a5c6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8640ce960 0x7fe86409c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe86a5c6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8640d2e70 0x7fe8641f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe86a5c6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8640a00e0 0x7fe86415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe86a5c6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640b3c10 con 0x7fe8640ce960 2023-11-28T11:55:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe86a5c6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8641f5d30 con 0x7fe8640d2e70 2023-11-28T11:55:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe86a5c6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640a0580 con 0x7fe8640a00e0 2023-11-28T11:55:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe8695c4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8640ce960 0x7fe86409c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe8695c4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8640ce960 0x7fe86409c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38842/0 (socket says 172.21.15.50:38842) 2023-11-28T11:55:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe8695c4700 1 -- 172.21.15.50:0/3002560676 learned_addr learned my addr 172.21.15.50:0/3002560676 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe868dc3700 1 --2- 172.21.15.50:0/3002560676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8640d2e70 0x7fe8641f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe869dc5700 1 --2- 172.21.15.50:0/3002560676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8640a00e0 0x7fe86415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe8695c4700 1 -- 172.21.15.50:0/3002560676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8640a00e0 msgr2=0x7fe86415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe8695c4700 1 --2- 172.21.15.50:0/3002560676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8640a00e0 0x7fe86415aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe8695c4700 1 -- 172.21.15.50:0/3002560676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8640d2e70 msgr2=0x7fe8641f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:10.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe8695c4700 1 --2- 172.21.15.50:0/3002560676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8640d2e70 0x7fe8641f4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe8695c4700 1 -- 172.21.15.50:0/3002560676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe854009570 con 0x7fe8640ce960 2023-11-28T11:55:10.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe8695c4700 1 --2- 172.21.15.50:0/3002560676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8640ce960 0x7fe86409c610 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe86000e7c0 tx=0x7fe86000ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe859ffb700 1 -- 172.21.15.50:0/3002560676 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe860013610 con 0x7fe8640ce960 2023-11-28T11:55:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe859ffb700 1 -- 172.21.15.50:0/3002560676 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe860013770 con 0x7fe8640ce960 2023-11-28T11:55:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe86a5c6700 1 -- 172.21.15.50:0/3002560676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8640b7e50 con 0x7fe8640ce960 2023-11-28T11:55:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.031+0000 7fe859ffb700 1 -- 172.21.15.50:0/3002560676 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe860013ae0 con 0x7fe8640ce960 2023-11-28T11:55:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.035+0000 7fe86a5c6700 1 -- 172.21.15.50:0/3002560676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8640b7b70 con 0x7fe8640ce960 2023-11-28T11:55:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.035+0000 7fe86a5c6700 1 -- 172.21.15.50:0/3002560676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8640b8130 con 0x7fe8640ce960 2023-11-28T11:55:10.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.035+0000 7fe859ffb700 1 -- 172.21.15.50:0/3002560676 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe860023070 con 0x7fe8640ce960 2023-11-28T11:55:10.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.035+0000 7fe859ffb700 1 --2- 172.21.15.50:0/3002560676 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe848064f10 0x7fe8480673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.035+0000 7fe859ffb700 1 -- 172.21.15.50:0/3002560676 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe860081b70 con 0x7fe8640ce960 2023-11-28T11:55:10.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.039+0000 7fe868dc3700 1 --2- 172.21.15.50:0/3002560676 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe848064f10 0x7fe8480673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.039+0000 7fe868dc3700 1 --2- 172.21.15.50:0/3002560676 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe848064f10 0x7fe8480673c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe8640c60b0 tx=0x7fe854008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:10.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.043+0000 7fe859ffb700 1 -- 172.21.15.50:0/3002560676 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe86004fbd0 con 0x7fe8640ce960 2023-11-28T11:55:10.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.207+0000 7fe86a5c6700 1 -- 172.21.15.50:0/3002560676 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8640b3a70 con 0x7fe848064f10 2023-11-28T11:55:10.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.223+0000 7fe859ffb700 1 -- 172.21.15.50:0/3002560676 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295107 (secure 0 0 0) 0x7fe854006d30 con 0x7fe848064f10 2023-11-28T11:55:10.230 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.231+0000 7fe86a5c6700 1 -- 172.21.15.50:0/3002560676 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe848064f10 msgr2=0x7fe8480673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.231+0000 7fe86a5c6700 1 --2- 172.21.15.50:0/3002560676 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe848064f10 0x7fe8480673c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe8640c60b0 tx=0x7fe854008030 comp rx=0 tx=0).stop 2023-11-28T11:55:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.231+0000 7fe86a5c6700 1 -- 172.21.15.50:0/3002560676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8640ce960 msgr2=0x7fe86409c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.231+0000 7fe86a5c6700 1 --2- 172.21.15.50:0/3002560676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8640ce960 0x7fe86409c610 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe86000e7c0 tx=0x7fe86000ead0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.231+0000 7fe86a5c6700 1 -- 172.21.15.50:0/3002560676 shutdown_connections 2023-11-28T11:55:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.231+0000 7fe86a5c6700 1 --2- 172.21.15.50:0/3002560676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8640a00e0 0x7fe86415aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.231+0000 7fe86a5c6700 1 --2- 172.21.15.50:0/3002560676 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe848064f10 0x7fe8480673c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.231+0000 7fe86a5c6700 1 --2- 172.21.15.50:0/3002560676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8640d2e70 0x7fe8641f4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.231+0000 7fe86a5c6700 1 --2- 172.21.15.50:0/3002560676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8640ce960 0x7fe86409c610 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.231+0000 7fe86a5c6700 1 -- 172.21.15.50:0/3002560676 >> 172.21.15.50:0/3002560676 conn(0x7fe8640b5860 msgr2=0x7fe8640d1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:10.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.231+0000 7fe86a5c6700 1 -- 172.21.15.50:0/3002560676 shutdown_connections 2023-11-28T11:55:10.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.231+0000 7fe86a5c6700 1 -- 172.21.15.50:0/3002560676 wait complete. 2023-11-28T11:55:10.234 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:55:10.247 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-11-28T11:55:08.894087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":78040,"kb_used_data":4376,"kb_used_omap":0,"kb_used_meta":73600,"kb_avail":754896680,"statfs":{"total":773094113280,"available":773014200320,"internally_reserved":0,"allocated":4481024,"data_stored":2623016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":75366400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.092468"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.504129+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:54:58.504129+0000","last_peered":"2023-11-28T11:54:58.504129+0000","last_clean":"2023-11-28T11:54:58.504129+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:54:58.504129+0000","last_undegraded":"2023-11-28T11:54:58.504129+0000","last_fullsized":"2023-11-28T11:54:58.504129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.503537+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:54:58.503537+0000","last_peered":"2023-11-28T11:54:58.503537+0000","last_clean":"2023-11-28T11:54:58.503537+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:54:58.503537+0000","last_undegraded":"2023-11-28T11:54:58.503537+0000","last_fullsized":"2023-11-28T11:54:58.503537+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.512980+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:54:58.512980+0000","last_peered":"2023-11-28T11:54:58.512980+0000","last_clean":"2023-11-28T11:54:58.512980+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:54:58.512980+0000","last_undegraded":"2023-11-28T11:54:58.512980+0000","last_fullsized":"2023-11-28T11:54:58.512980+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.804893+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:54:58.804893+0000","last_peered":"2023-11-28T11:54:58.804893+0000","last_clean":"2023-11-28T11:54:58.804893+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:54:58.804893+0000","last_undegraded":"2023-11-28T11:54:58.804893+0000","last_fullsized":"2023-11-28T11:54:58.804893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":176,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:59.014641+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:54:59.014641+0000","last_peered":"2023-11-28T11:54:59.014641+0000","last_clean":"2023-11-28T11:54:59.014641+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:54:59.014641+0000","last_undegraded":"2023-11-28T11:54:59.014641+0000","last_fullsized":"2023-11-28T11:54:59.014641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.505539+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:54:58.505539+0000","last_peered":"2023-11-28T11:54:58.505539+0000","last_clean":"2023-11-28T11:54:58.505539+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:54:58.505539+0000","last_undegraded":"2023-11-28T11:54:58.505539+0000","last_fullsized":"2023-11-28T11:54:58.505539+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:59.014705+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:54:59.014705+0000","last_peered":"2023-11-28T11:54:59.014705+0000","last_clean":"2023-11-28T11:54:59.014705+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:54:59.014705+0000","last_undegraded":"2023-11-28T11:54:59.014705+0000","last_fullsized":"2023-11-28T11:54:59.014705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.494594+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:54:58.494594+0000","last_peered":"2023-11-28T11:54:58.494594+0000","last_clean":"2023-11-28T11:54:58.494594+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:54:58.494594+0000","last_undegraded":"2023-11-28T11:54:58.494594+0000","last_fullsized":"2023-11-28T11:54:58.494594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:59.014660+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:54:59.014660+0000","last_peered":"2023-11-28T11:54:59.014660+0000","last_clean":"2023-11-28T11:54:59.014660+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:54:59.014660+0000","last_undegraded":"2023-11-28T11:54:59.014660+0000","last_fullsized":"2023-11-28T11:54:59.014660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9564,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362276,"statfs":{"total":96636764160,"available":96626970624,"internally_reserved":0,"allocated":1003520,"data_stored":770160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.878},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.78400000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.61199999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.57699999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.85099999999999998}]},{"osd":6,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.93500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8344,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363496,"statfs":{"total":96636764160,"available":96628219904,"internally_reserved":0,"allocated":409600,"data_stored":179792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.84899999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.82599999999999996}]},{"osd":2,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.96899999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.80900000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.92900000000000005}]},{"osd":5,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.53000000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.73699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8476,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363364,"statfs":{"total":96636764160,"available":96628084736,"internally_reserved":0,"allocated":413696,"data_stored":180778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.0700000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.89600000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.044},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.1830000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.93300000000000005}]},{"osd":6,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.232},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.02}]},{"osd":7,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.337}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8604,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363236,"statfs":{"total":96636764160,"available":96627953664,"internally_reserved":0,"allocated":413696,"data_stored":180778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.55500000000000005}]},{"osd":1,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.93200000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.874}]},{"osd":3,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0900000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.196}]},{"osd":6,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.006}]},{"osd":7,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.121},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.96699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8472,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363368,"statfs":{"total":96636764160,"available":96628088832,"internally_reserved":0,"allocated":409600,"data_stored":179792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.495},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.65300000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.61599999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.75700000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":0.99199999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.745}]},{"osd":6,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.139},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.1679999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.1919999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8344,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363496,"statfs":{"total":96636764160,"available":96628219904,"internally_reserved":0,"allocated":409600,"data_stored":179792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.95299999999999996}]},{"osd":1,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.55500000000000005}]},{"osd":3,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.93000000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":0.80000000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.032}]},{"osd":6,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.081}]},{"osd":7,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":1.171}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13600,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":12608,"kb_avail":94358240,"statfs":{"total":96636764160,"available":96622837760,"internally_reserved":0,"allocated":1007616,"data_stored":771146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12910592},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.67300000000000004}]},{"osd":2,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.70199999999999996}]},{"osd":3,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.61799999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.119},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.29,"5min":2.29,"15min":2.29},"last":1.244}]},{"osd":5,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.0509999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.083},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":1.3460000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":3.0209999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.036}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12636,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94359204,"statfs":{"total":96636764160,"available":96623824896,"internally_reserved":0,"allocated":413696,"data_stored":180778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.623}]},{"osd":2,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71599999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.89700000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.92500000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.194},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.0569999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.018},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.075}]},{"osd":7,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.111}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:55:10.253 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:55:10.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.367+0000 7f48215e7700 1 Processor -- start 2023-11-28T11:55:10.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.367+0000 7f48215e7700 1 -- start start 2023-11-28T11:55:10.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f48215e7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f481c0ab850 0x7f481c06c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f48215e7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f481c0b2730 0x7f481c06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f48215e7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f481c069c40 con 0x7f481c144ce0 2023-11-28T11:55:10.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f48215e7700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481c069e90 con 0x7f481c0ab850 2023-11-28T11:55:10.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f48215e7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481c06a170 con 0x7f481c0b2730 2023-11-28T11:55:10.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f4813fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f481c0ab850 0x7f481c06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f4813fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f481c0ab850 0x7f481c06c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38852/0 (socket says 172.21.15.50:38852) 2023-11-28T11:55:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f4820de6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f481c0b2730 0x7f481c06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f4813fff700 1 -- 172.21.15.50:0/4068250352 learned_addr learned my addr 172.21.15.50:0/4068250352 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f4813fff700 1 -- 172.21.15.50:0/4068250352 >> v2:172.21.15.192:3300/0 conn(0x7f481c0b2730 msgr2=0x7f481c06cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f4813fff700 1 --2- 172.21.15.50:0/4068250352 >> v2:172.21.15.192:3300/0 conn(0x7f481c0b2730 0x7f481c06cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f4813fff700 1 -- 172.21.15.50:0/4068250352 >> v1:172.21.15.192:6789/0 conn(0x7f481c144ce0 legacy=0x7f481c1450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:10.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f4813fff700 1 -- 172.21.15.50:0/4068250352 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c06a450 con 0x7f481c0ab850 2023-11-28T11:55:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f4813fff700 1 --2- 172.21.15.50:0/4068250352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f481c0ab850 0x7f481c06c640 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f481c0b3990 tx=0x7f4804009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392aa9215ae1c61f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f481b7fe700 1 -- 172.21.15.50:0/4068250352 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804011830 con 0x7f481c0ab850 2023-11-28T11:55:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f481b7fe700 1 -- 172.21.15.50:0/4068250352 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4804011990 con 0x7f481c0ab850 2023-11-28T11:55:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f481b7fe700 1 -- 172.21.15.50:0/4068250352 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804011d20 con 0x7f481c0ab850 2023-11-28T11:55:10.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f48215e7700 1 -- 172.21.15.50:0/4068250352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f481c0ab850 msgr2=0x7f481c06c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:10.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f48215e7700 1 --2- 172.21.15.50:0/4068250352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f481c0ab850 0x7f481c06c640 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f481c0b3990 tx=0x7f4804009bf0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f48215e7700 1 -- 172.21.15.50:0/4068250352 shutdown_connections 2023-11-28T11:55:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f48215e7700 1 --2- 172.21.15.50:0/4068250352 >> v2:172.21.15.192:3300/0 conn(0x7f481c0b2730 0x7f481c06cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f48215e7700 1 --2- 172.21.15.50:0/4068250352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f481c0ab850 0x7f481c06c640 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f48215e7700 1 -- 172.21.15.50:0/4068250352 >> 172.21.15.50:0/4068250352 conn(0x7f481c06e000 msgr2=0x7f481c0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f48215e7700 1 -- 172.21.15.50:0/4068250352 shutdown_connections 2023-11-28T11:55:10.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.371+0000 7f48215e7700 1 -- 172.21.15.50:0/4068250352 wait complete. 2023-11-28T11:55:10.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f48215e7700 1 Processor -- start 2023-11-28T11:55:10.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f48215e7700 1 -- start start 2023-11-28T11:55:10.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f48215e7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f481c0ab850 0x7f481c140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f48215e7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f481c0b2730 0x7f481c0c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f48215e7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f481c144ce0 0x7f481c0af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f48215e7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c0c4520 con 0x7f481c0b2730 2023-11-28T11:55:10.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f48215e7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c0c4800 con 0x7f481c0ab850 2023-11-28T11:55:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f48215e7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481c0c4ae0 con 0x7f481c144ce0 2023-11-28T11:55:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f4813fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f481c0b2730 0x7f481c0c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f4813fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f481c0b2730 0x7f481c0c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38864/0 (socket says 172.21.15.50:38864) 2023-11-28T11:55:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f4820de6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f481c144ce0 0x7f481c0af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f4813fff700 1 -- 172.21.15.50:0/938373306 learned_addr learned my addr 172.21.15.50:0/938373306 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f481bfff700 1 --2- 172.21.15.50:0/938373306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f481c0ab850 0x7f481c140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f4813fff700 1 -- 172.21.15.50:0/938373306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f481c144ce0 msgr2=0x7f481c0af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f4813fff700 1 --2- 172.21.15.50:0/938373306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f481c144ce0 0x7f481c0af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f4813fff700 1 -- 172.21.15.50:0/938373306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f481c0ab850 msgr2=0x7f481c140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f4813fff700 1 --2- 172.21.15.50:0/938373306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f481c0ab850 0x7f481c140300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f4813fff700 1 -- 172.21.15.50:0/938373306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4804009570 con 0x7f481c0b2730 2023-11-28T11:55:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f4813fff700 1 --2- 172.21.15.50:0/938373306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f481c0b2730 0x7f481c0c3c20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4804000c00 tx=0x7f4804004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f48197fa700 1 -- 172.21.15.50:0/938373306 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804004510 con 0x7f481c0b2730 2023-11-28T11:55:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f48197fa700 1 -- 172.21.15.50:0/938373306 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480401e070 con 0x7f481c0b2730 2023-11-28T11:55:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f48215e7700 1 -- 172.21.15.50:0/938373306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481c145a20 con 0x7f481c0b2730 2023-11-28T11:55:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f48197fa700 1 -- 172.21.15.50:0/938373306 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804003900 con 0x7f481c0b2730 2023-11-28T11:55:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.375+0000 7f48215e7700 1 -- 172.21.15.50:0/938373306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481c06a730 con 0x7f481c0b2730 2023-11-28T11:55:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.379+0000 7f48215e7700 1 -- 172.21.15.50:0/938373306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481c145bb0 con 0x7f481c0b2730 2023-11-28T11:55:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.379+0000 7f48197fa700 1 -- 172.21.15.50:0/938373306 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f480400f050 con 0x7f481c0b2730 2023-11-28T11:55:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.379+0000 7f48197fa700 1 --2- 172.21.15.50:0/938373306 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f47fc064ee0 0x7f47fc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.379+0000 7f48197fa700 1 -- 172.21.15.50:0/938373306 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4804082c00 con 0x7f481c0b2730 2023-11-28T11:55:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.379+0000 7f481bfff700 1 --2- 172.21.15.50:0/938373306 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f47fc064ee0 0x7f47fc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.379+0000 7f481bfff700 1 --2- 172.21.15.50:0/938373306 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f47fc064ee0 0x7f47fc067390 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f481c06b890 tx=0x7f480c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:10.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.387+0000 7f48197fa700 1 -- 172.21.15.50:0/938373306 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4804088020 con 0x7f481c0b2730 2023-11-28T11:55:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.547+0000 7f48215e7700 1 -- 172.21.15.50:0/938373306 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f481c072c20 con 0x7f47fc064ee0 2023-11-28T11:55:10.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.563+0000 7f48197fa700 1 -- 172.21.15.50:0/938373306 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295107 (secure 0 0 0) 0x7f481c072c20 con 0x7f47fc064ee0 2023-11-28T11:55:10.569 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.567+0000 7f48215e7700 1 -- 172.21.15.50:0/938373306 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f47fc064ee0 msgr2=0x7f47fc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.567+0000 7f48215e7700 1 --2- 172.21.15.50:0/938373306 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f47fc064ee0 0x7f47fc067390 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f481c06b890 tx=0x7f480c009040 comp rx=0 tx=0).stop 2023-11-28T11:55:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.567+0000 7f48215e7700 1 -- 172.21.15.50:0/938373306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f481c0b2730 msgr2=0x7f481c0c3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.567+0000 7f48215e7700 1 --2- 172.21.15.50:0/938373306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f481c0b2730 0x7f481c0c3c20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4804000c00 tx=0x7f4804004770 comp rx=0 tx=0).stop 2023-11-28T11:55:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.571+0000 7f48215e7700 1 -- 172.21.15.50:0/938373306 shutdown_connections 2023-11-28T11:55:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.571+0000 7f48215e7700 1 --2- 172.21.15.50:0/938373306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f481c144ce0 0x7f481c0af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.571+0000 7f48215e7700 1 --2- 172.21.15.50:0/938373306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f481c0b2730 0x7f481c0c3c20 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.571+0000 7f48215e7700 1 --2- 172.21.15.50:0/938373306 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f47fc064ee0 0x7f47fc067390 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.571+0000 7f48215e7700 1 --2- 172.21.15.50:0/938373306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f481c0ab850 0x7f481c140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.571+0000 7f48215e7700 1 -- 172.21.15.50:0/938373306 >> 172.21.15.50:0/938373306 conn(0x7f481c06e000 msgr2=0x7f481c1429b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.571+0000 7f48215e7700 1 -- 172.21.15.50:0/938373306 shutdown_connections 2023-11-28T11:55:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.571+0000 7f48215e7700 1 -- 172.21.15.50:0/938373306 wait complete. 2023-11-28T11:55:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:55:10.586 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-11-28T11:55:08.894087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":78040,"kb_used_data":4376,"kb_used_omap":0,"kb_used_meta":73600,"kb_avail":754896680,"statfs":{"total":773094113280,"available":773014200320,"internally_reserved":0,"allocated":4481024,"data_stored":2623016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":75366400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.092468"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.504129+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:54:58.504129+0000","last_peered":"2023-11-28T11:54:58.504129+0000","last_clean":"2023-11-28T11:54:58.504129+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:54:58.504129+0000","last_undegraded":"2023-11-28T11:54:58.504129+0000","last_fullsized":"2023-11-28T11:54:58.504129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.503537+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:54:58.503537+0000","last_peered":"2023-11-28T11:54:58.503537+0000","last_clean":"2023-11-28T11:54:58.503537+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:54:58.503537+0000","last_undegraded":"2023-11-28T11:54:58.503537+0000","last_fullsized":"2023-11-28T11:54:58.503537+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.512980+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:54:58.512980+0000","last_peered":"2023-11-28T11:54:58.512980+0000","last_clean":"2023-11-28T11:54:58.512980+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:54:58.512980+0000","last_undegraded":"2023-11-28T11:54:58.512980+0000","last_fullsized":"2023-11-28T11:54:58.512980+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.804893+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:54:58.804893+0000","last_peered":"2023-11-28T11:54:58.804893+0000","last_clean":"2023-11-28T11:54:58.804893+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:54:58.804893+0000","last_undegraded":"2023-11-28T11:54:58.804893+0000","last_fullsized":"2023-11-28T11:54:58.804893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":176,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:59.014641+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:54:59.014641+0000","last_peered":"2023-11-28T11:54:59.014641+0000","last_clean":"2023-11-28T11:54:59.014641+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:54:59.014641+0000","last_undegraded":"2023-11-28T11:54:59.014641+0000","last_fullsized":"2023-11-28T11:54:59.014641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.505539+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:54:58.505539+0000","last_peered":"2023-11-28T11:54:58.505539+0000","last_clean":"2023-11-28T11:54:58.505539+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:54:58.505539+0000","last_undegraded":"2023-11-28T11:54:58.505539+0000","last_fullsized":"2023-11-28T11:54:58.505539+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:59.014705+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:54:59.014705+0000","last_peered":"2023-11-28T11:54:59.014705+0000","last_clean":"2023-11-28T11:54:59.014705+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:54:59.014705+0000","last_undegraded":"2023-11-28T11:54:59.014705+0000","last_fullsized":"2023-11-28T11:54:59.014705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.494594+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:54:58.494594+0000","last_peered":"2023-11-28T11:54:58.494594+0000","last_clean":"2023-11-28T11:54:58.494594+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:54:58.494594+0000","last_undegraded":"2023-11-28T11:54:58.494594+0000","last_fullsized":"2023-11-28T11:54:58.494594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:59.014660+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:54:59.014660+0000","last_peered":"2023-11-28T11:54:59.014660+0000","last_clean":"2023-11-28T11:54:59.014660+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:54:59.014660+0000","last_undegraded":"2023-11-28T11:54:59.014660+0000","last_fullsized":"2023-11-28T11:54:59.014660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9564,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362276,"statfs":{"total":96636764160,"available":96626970624,"internally_reserved":0,"allocated":1003520,"data_stored":770160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.878},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.78400000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.61199999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.57699999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.85099999999999998}]},{"osd":6,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.93500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8344,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363496,"statfs":{"total":96636764160,"available":96628219904,"internally_reserved":0,"allocated":409600,"data_stored":179792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.84899999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.82599999999999996}]},{"osd":2,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.96899999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.80900000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.92900000000000005}]},{"osd":5,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.53000000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.73699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8476,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363364,"statfs":{"total":96636764160,"available":96628084736,"internally_reserved":0,"allocated":413696,"data_stored":180778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.0700000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.89600000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.044},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.1830000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.93300000000000005}]},{"osd":6,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.232},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.02}]},{"osd":7,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.337}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8604,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363236,"statfs":{"total":96636764160,"available":96627953664,"internally_reserved":0,"allocated":413696,"data_stored":180778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.55500000000000005}]},{"osd":1,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.93200000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.874}]},{"osd":3,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0900000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.196}]},{"osd":6,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.006}]},{"osd":7,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.121},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.96699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8472,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363368,"statfs":{"total":96636764160,"available":96628088832,"internally_reserved":0,"allocated":409600,"data_stored":179792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.495},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.65300000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.61599999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.75700000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":0.99199999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.745}]},{"osd":6,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.139},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.1679999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.1919999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8344,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363496,"statfs":{"total":96636764160,"available":96628219904,"internally_reserved":0,"allocated":409600,"data_stored":179792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.95299999999999996}]},{"osd":1,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.55500000000000005}]},{"osd":3,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.93000000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":0.80000000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.032}]},{"osd":6,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.081}]},{"osd":7,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":1.171}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13600,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":12608,"kb_avail":94358240,"statfs":{"total":96636764160,"available":96622837760,"internally_reserved":0,"allocated":1007616,"data_stored":771146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12910592},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.67300000000000004}]},{"osd":2,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.70199999999999996}]},{"osd":3,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.61799999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.119},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.29,"5min":2.29,"15min":2.29},"last":1.244}]},{"osd":5,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.0509999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.083},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":1.3460000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":3.0209999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.036}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12636,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94359204,"statfs":{"total":96636764160,"available":96623824896,"internally_reserved":0,"allocated":413696,"data_stored":180778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.623}]},{"osd":2,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71599999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.89700000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.92500000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.194},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.0569999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.018},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.075}]},{"osd":7,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.111}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:55:10.591 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:55:10.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0cb0e2700 1 Processor -- start 2023-11-28T11:55:10.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0cb0e2700 1 -- start start 2023-11-28T11:55:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0cb0e2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa0c40c6bd0 0x7fa0c40cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0cb0e2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa0c40cc4f0 0x7fa0c40cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0cb0e2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0c40cc970 0x7fa0c40cd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0cb0e2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c40b2b10 con 0x7fa0c40cc4f0 2023-11-28T11:55:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0cb0e2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c40c6fa0 con 0x7fa0c40c6bd0 2023-11-28T11:55:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0cb0e2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40b21b0 con 0x7fa0c40cc970 2023-11-28T11:55:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0c98df700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa0c40cc4f0 0x7fa0c40cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0c98df700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa0c40cc4f0 0x7fa0c40cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38872/0 (socket says 172.21.15.50:38872) 2023-11-28T11:55:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0c98df700 1 -- 172.21.15.50:0/1003920663 learned_addr learned my addr 172.21.15.50:0/1003920663 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0ca0e0700 1 --2- 172.21.15.50:0/1003920663 >> v2:172.21.15.192:3300/0 conn(0x7fa0c40c6bd0 0x7fa0c40cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0ca8e1700 1 --2- 172.21.15.50:0/1003920663 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0c40cc970 0x7fa0c40cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0c98df700 1 -- 172.21.15.50:0/1003920663 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0c40cc970 msgr2=0x7fa0c40cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0c98df700 1 --2- 172.21.15.50:0/1003920663 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0c40cc970 0x7fa0c40cd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0c98df700 1 -- 172.21.15.50:0/1003920663 >> v2:172.21.15.192:3300/0 conn(0x7fa0c40c6bd0 msgr2=0x7fa0c40cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0c98df700 1 --2- 172.21.15.50:0/1003920663 >> v2:172.21.15.192:3300/0 conn(0x7fa0c40c6bd0 0x7fa0c40cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0c98df700 1 -- 172.21.15.50:0/1003920663 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c40b2f30 con 0x7fa0c40cc4f0 2023-11-28T11:55:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0ca8e1700 1 --2- 172.21.15.50:0/1003920663 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0c40cc970 0x7fa0c40cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.707+0000 7fa0c98df700 1 --2- 172.21.15.50:0/1003920663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40cc4f0 0x7fa0c40cd420 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40d1690 tx=0x7fa0b8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4010d1e720a2f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.711+0000 7fa0c90de700 1 -- 172.21.15.50:0/1003920663 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8011830 con 0x7fa0c40cc4f0 2023-11-28T11:55:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.711+0000 7fa0c90de700 1 -- 172.21.15.50:0/1003920663 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b8011990 con 0x7fa0c40cc4f0 2023-11-28T11:55:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.711+0000 7fa0c90de700 1 -- 172.21.15.50:0/1003920663 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8011d20 con 0x7fa0c40cc4f0 2023-11-28T11:55:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.711+0000 7fa0cb0e2700 1 -- 172.21.15.50:0/1003920663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40cc4f0 msgr2=0x7fa0c40cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.711+0000 7fa0cb0e2700 1 --2- 172.21.15.50:0/1003920663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40cc4f0 0x7fa0c40cd420 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40d1690 tx=0x7fa0b8009bf0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.711+0000 7fa0cb0e2700 1 -- 172.21.15.50:0/1003920663 shutdown_connections 2023-11-28T11:55:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.711+0000 7fa0cb0e2700 1 --2- 172.21.15.50:0/1003920663 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0c40cc970 0x7fa0c40cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.711+0000 7fa0cb0e2700 1 --2- 172.21.15.50:0/1003920663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40cc4f0 0x7fa0c40cd420 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.711+0000 7fa0cb0e2700 1 --2- 172.21.15.50:0/1003920663 >> v2:172.21.15.192:3300/0 conn(0x7fa0c40c6bd0 0x7fa0c40cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.711+0000 7fa0cb0e2700 1 -- 172.21.15.50:0/1003920663 >> 172.21.15.50:0/1003920663 conn(0x7fa0c4069c40 msgr2=0x7fa0c406a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:10.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.711+0000 7fa0cb0e2700 1 -- 172.21.15.50:0/1003920663 shutdown_connections 2023-11-28T11:55:10.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.711+0000 7fa0cb0e2700 1 -- 172.21.15.50:0/1003920663 wait complete. 2023-11-28T11:55:10.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.711+0000 7fa0cb0e2700 1 Processor -- start 2023-11-28T11:55:10.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.711+0000 7fa0cb0e2700 1 -- start start 2023-11-28T11:55:10.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0cb0e2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0c40c6bd0 0x7fa0c41e3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0cb0e2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40cc4f0 0x7fa0c4147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0cb0e2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0c40cc970 0x7fa0c4147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0cb0e2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c4148010 con 0x7fa0c40cc4f0 2023-11-28T11:55:10.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0cb0e2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40b5df0 con 0x7fa0c40c6bd0 2023-11-28T11:55:10.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0cb0e2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40b5270 con 0x7fa0c40cc970 2023-11-28T11:55:10.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0c98df700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40cc4f0 0x7fa0c4147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0c98df700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40cc4f0 0x7fa0c4147590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38888/0 (socket says 172.21.15.50:38888) 2023-11-28T11:55:10.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0c98df700 1 -- 172.21.15.50:0/2724643611 learned_addr learned my addr 172.21.15.50:0/2724643611 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:10.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0ca0e0700 1 --2- 172.21.15.50:0/2724643611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0c40c6bd0 0x7fa0c41e3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0ca8e1700 1 --2- 172.21.15.50:0/2724643611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0c40cc970 0x7fa0c4147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0c98df700 1 -- 172.21.15.50:0/2724643611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0c40cc970 msgr2=0x7fa0c4147ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:10.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0c98df700 1 --2- 172.21.15.50:0/2724643611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0c40cc970 0x7fa0c4147ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0c98df700 1 -- 172.21.15.50:0/2724643611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0c40c6bd0 msgr2=0x7fa0c41e3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:10.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0c98df700 1 --2- 172.21.15.50:0/2724643611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0c40c6bd0 0x7fa0c41e3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0c98df700 1 -- 172.21.15.50:0/2724643611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b8009570 con 0x7fa0c40cc4f0 2023-11-28T11:55:10.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0c98df700 1 --2- 172.21.15.50:0/2724643611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40cc4f0 0x7fa0c4147590 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa0c406b200 tx=0x7fa0b8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:10.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0b6ffd700 1 -- 172.21.15.50:0/2724643611 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8004240 con 0x7fa0c40cc4f0 2023-11-28T11:55:10.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0b6ffd700 1 -- 172.21.15.50:0/2724643611 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b801f070 con 0x7fa0c40cc4f0 2023-11-28T11:55:10.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0cb0e2700 1 -- 172.21.15.50:0/2724643611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c40b2730 con 0x7fa0c40cc4f0 2023-11-28T11:55:10.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0b6ffd700 1 -- 172.21.15.50:0/2724643611 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b80045c0 con 0x7fa0c40cc4f0 2023-11-28T11:55:10.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0cb0e2700 1 -- 172.21.15.50:0/2724643611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c40b2450 con 0x7fa0c40cc4f0 2023-11-28T11:55:10.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.715+0000 7fa0cb0e2700 1 -- 172.21.15.50:0/2724643611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c40cce20 con 0x7fa0c40cc4f0 2023-11-28T11:55:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.719+0000 7fa0b6ffd700 1 -- 172.21.15.50:0/2724643611 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa0b802a020 con 0x7fa0c40cc4f0 2023-11-28T11:55:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.719+0000 7fa0b6ffd700 1 --2- 172.21.15.50:0/2724643611 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa0a8064f10 0x7fa0a80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.719+0000 7fa0ca0e0700 1 --2- 172.21.15.50:0/2724643611 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa0a8064f10 0x7fa0a80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.719+0000 7fa0b6ffd700 1 -- 172.21.15.50:0/2724643611 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa0b8083220 con 0x7fa0c40cc4f0 2023-11-28T11:55:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.719+0000 7fa0ca0e0700 1 --2- 172.21.15.50:0/2724643611 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa0a8064f10 0x7fa0a80673c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009b70 tx=0x7fa0c0009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.723+0000 7fa0b6ffd700 1 -- 172.21.15.50:0/2724643611 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa0b8051280 con 0x7fa0c40cc4f0 2023-11-28T11:55:10.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.887+0000 7fa0cb0e2700 1 -- 172.21.15.50:0/2724643611 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0c406dc60 con 0x7fa0a8064f10 2023-11-28T11:55:10.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.899+0000 7fa0b6ffd700 1 -- 172.21.15.50:0/2724643611 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295107 (secure 0 0 0) 0x7fa0c0011810 con 0x7fa0a8064f10 2023-11-28T11:55:10.907 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:10.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.907+0000 7fa0cb0e2700 1 -- 172.21.15.50:0/2724643611 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa0a8064f10 msgr2=0x7fa0a80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:10.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.907+0000 7fa0cb0e2700 1 --2- 172.21.15.50:0/2724643611 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa0a8064f10 0x7fa0a80673c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009b70 tx=0x7fa0c0009240 comp rx=0 tx=0).stop 2023-11-28T11:55:10.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.907+0000 7fa0cb0e2700 1 -- 172.21.15.50:0/2724643611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40cc4f0 msgr2=0x7fa0c4147590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.907+0000 7fa0cb0e2700 1 --2- 172.21.15.50:0/2724643611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40cc4f0 0x7fa0c4147590 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa0c406b200 tx=0x7fa0b8004770 comp rx=0 tx=0).stop 2023-11-28T11:55:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.907+0000 7fa0cb0e2700 1 -- 172.21.15.50:0/2724643611 shutdown_connections 2023-11-28T11:55:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.907+0000 7fa0cb0e2700 1 --2- 172.21.15.50:0/2724643611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0c40cc970 0x7fa0c4147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.907+0000 7fa0cb0e2700 1 --2- 172.21.15.50:0/2724643611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0c40cc4f0 0x7fa0c4147590 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.907+0000 7fa0cb0e2700 1 --2- 172.21.15.50:0/2724643611 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa0a8064f10 0x7fa0a80673c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.907+0000 7fa0cb0e2700 1 --2- 172.21.15.50:0/2724643611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0c40c6bd0 0x7fa0c41e3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.907+0000 7fa0cb0e2700 1 -- 172.21.15.50:0/2724643611 >> 172.21.15.50:0/2724643611 conn(0x7fa0c4069c40 msgr2=0x7fa0c40ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.907+0000 7fa0cb0e2700 1 -- 172.21.15.50:0/2724643611 shutdown_connections 2023-11-28T11:55:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:10.907+0000 7fa0cb0e2700 1 -- 172.21.15.50:0/2724643611 wait complete. 2023-11-28T11:55:10.911 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:55:10.924 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-11-28T11:55:08.894087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":78040,"kb_used_data":4376,"kb_used_omap":0,"kb_used_meta":73600,"kb_avail":754896680,"statfs":{"total":773094113280,"available":773014200320,"internally_reserved":0,"allocated":4481024,"data_stored":2623016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":75366400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.092468"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.504129+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:54:58.504129+0000","last_peered":"2023-11-28T11:54:58.504129+0000","last_clean":"2023-11-28T11:54:58.504129+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:54:58.504129+0000","last_undegraded":"2023-11-28T11:54:58.504129+0000","last_fullsized":"2023-11-28T11:54:58.504129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.503537+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:54:58.503537+0000","last_peered":"2023-11-28T11:54:58.503537+0000","last_clean":"2023-11-28T11:54:58.503537+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:54:58.503537+0000","last_undegraded":"2023-11-28T11:54:58.503537+0000","last_fullsized":"2023-11-28T11:54:58.503537+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.512980+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:54:58.512980+0000","last_peered":"2023-11-28T11:54:58.512980+0000","last_clean":"2023-11-28T11:54:58.512980+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:54:58.512980+0000","last_undegraded":"2023-11-28T11:54:58.512980+0000","last_fullsized":"2023-11-28T11:54:58.512980+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.804893+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:54:58.804893+0000","last_peered":"2023-11-28T11:54:58.804893+0000","last_clean":"2023-11-28T11:54:58.804893+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:54:58.804893+0000","last_undegraded":"2023-11-28T11:54:58.804893+0000","last_fullsized":"2023-11-28T11:54:58.804893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":176,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:59.014641+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:54:59.014641+0000","last_peered":"2023-11-28T11:54:59.014641+0000","last_clean":"2023-11-28T11:54:59.014641+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:54:59.014641+0000","last_undegraded":"2023-11-28T11:54:59.014641+0000","last_fullsized":"2023-11-28T11:54:59.014641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.505539+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:54:58.505539+0000","last_peered":"2023-11-28T11:54:58.505539+0000","last_clean":"2023-11-28T11:54:58.505539+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:54:58.505539+0000","last_undegraded":"2023-11-28T11:54:58.505539+0000","last_fullsized":"2023-11-28T11:54:58.505539+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:59.014705+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:54:59.014705+0000","last_peered":"2023-11-28T11:54:59.014705+0000","last_clean":"2023-11-28T11:54:59.014705+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:54:59.014705+0000","last_undegraded":"2023-11-28T11:54:59.014705+0000","last_fullsized":"2023-11-28T11:54:59.014705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:58.494594+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:54:58.494594+0000","last_peered":"2023-11-28T11:54:58.494594+0000","last_clean":"2023-11-28T11:54:58.494594+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:54:58.494594+0000","last_undegraded":"2023-11-28T11:54:58.494594+0000","last_fullsized":"2023-11-28T11:54:58.494594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:05.802469+0000","last_change":"2023-11-28T11:55:05.802469+0000","last_active":"2023-11-28T11:55:05.802469+0000","last_peered":"2023-11-28T11:55:05.802469+0000","last_clean":"2023-11-28T11:55:05.802469+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:05.802469+0000","last_undegraded":"2023-11-28T11:55:05.802469+0000","last_fullsized":"2023-11-28T11:55:05.802469+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:55:04.797251+0000","last_change":"2023-11-28T11:55:04.797251+0000","last_active":"2023-11-28T11:55:04.797251+0000","last_peered":"2023-11-28T11:55:04.797251+0000","last_clean":"2023-11-28T11:55:04.797251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:55:04.797251+0000","last_undegraded":"2023-11-28T11:55:04.797251+0000","last_fullsized":"2023-11-28T11:55:04.797251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T11:54:59.014660+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:54:59.014660+0000","last_peered":"2023-11-28T11:54:59.014660+0000","last_clean":"2023-11-28T11:54:59.014660+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:54:59.014660+0000","last_undegraded":"2023-11-28T11:54:59.014660+0000","last_fullsized":"2023-11-28T11:54:59.014660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9564,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362276,"statfs":{"total":96636764160,"available":96626970624,"internally_reserved":0,"allocated":1003520,"data_stored":770160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.878},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.78400000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.61199999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.57699999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.85099999999999998}]},{"osd":6,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.93500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8344,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363496,"statfs":{"total":96636764160,"available":96628219904,"internally_reserved":0,"allocated":409600,"data_stored":179792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.84899999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.82599999999999996}]},{"osd":2,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.96899999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.80900000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.92900000000000005}]},{"osd":5,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.53000000000000003}]},{"osd":7,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.73699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8476,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363364,"statfs":{"total":96636764160,"available":96628084736,"internally_reserved":0,"allocated":413696,"data_stored":180778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.0700000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.89600000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.044},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.1830000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.93300000000000005}]},{"osd":6,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.232},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.02}]},{"osd":7,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.337}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8604,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363236,"statfs":{"total":96636764160,"available":96627953664,"internally_reserved":0,"allocated":413696,"data_stored":180778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.55500000000000005}]},{"osd":1,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.93200000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.874}]},{"osd":3,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0900000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.196}]},{"osd":6,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.006}]},{"osd":7,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.121},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.96699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8472,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363368,"statfs":{"total":96636764160,"available":96628088832,"internally_reserved":0,"allocated":409600,"data_stored":179792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.495},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.65300000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.61599999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.75700000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":0.99199999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.745}]},{"osd":6,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.139},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.1679999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.1919999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8344,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363496,"statfs":{"total":96636764160,"available":96628219904,"internally_reserved":0,"allocated":409600,"data_stored":179792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.95299999999999996}]},{"osd":1,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.55500000000000005}]},{"osd":3,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.93000000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":0.80000000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.032}]},{"osd":6,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.081}]},{"osd":7,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":1.171}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13600,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":12608,"kb_avail":94358240,"statfs":{"total":96636764160,"available":96622837760,"internally_reserved":0,"allocated":1007616,"data_stored":771146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12910592},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.67300000000000004}]},{"osd":2,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.70199999999999996}]},{"osd":3,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.61799999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.119},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.29,"5min":2.29,"15min":2.29},"last":1.244}]},{"osd":5,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.0509999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.083},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":1.3460000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":3.0209999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.036}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12636,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94359204,"statfs":{"total":96636764160,"available":96623824896,"internally_reserved":0,"allocated":413696,"data_stored":180778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.623}]},{"osd":2,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71599999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.89700000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.92500000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.194},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":1.0569999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.018},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.075}]},{"osd":7,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.111}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:55:10.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-11-28T11:55:10.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-11-28T11:55:10.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-11-28T11:55:10.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-11-28T11:55:10.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-11-28T11:55:10.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-11-28T11:55:10.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-11-28T11:55:10.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-11-28T11:55:10.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-11-28T11:55:10.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-11-28T11:55:10.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-11-28T11:55:10.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-11-28T11:55:10.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-11-28T11:55:10.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-11-28T11:55:10.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-11-28T11:55:10.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-11-28T11:55:10.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-11-28T11:55:10.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-11-28T11:55:10.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-11-28T11:55:10.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-11-28T11:55:10.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-11-28T11:55:10.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-11-28T11:55:10.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-11-28T11:55:10.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-11-28T11:55:10.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-11-28T11:55:10.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-11-28T11:55:10.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-11-28T11:55:10.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-11-28T11:55:10.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-11-28T11:55:10.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-11-28T11:55:10.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-11-28T11:55:10.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-11-28T11:55:10.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-11-28T11:55:10.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-11-28T11:55:10.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-11-28T11:55:10.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-11-28T11:55:10.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-11-28T11:55:10.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-11-28T11:55:10.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-11-28T11:55:10.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-11-28T11:55:10.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-11-28T11:55:10.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-11-28T11:55:10.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-11-28T11:55:10.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-11-28T11:55:10.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-11-28T11:55:10.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-11-28T11:55:10.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-11-28T11:55:10.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-11-28T11:55:10.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-11-28T11:55:10.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-11-28T11:55:10.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-11-28T11:55:10.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-11-28T11:55:10.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-11-28T11:55:10.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-11-28T11:55:10.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-11-28T11:55:10.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-11-28T11:55:10.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-11-28T11:55:10.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-11-28T11:55:10.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-11-28T11:55:10.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-11-28T11:55:10.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-11-28T11:55:10.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-11-28T11:55:10.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-11-28T11:55:10.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-11-28T11:55:10.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-11-28T11:55:10.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-11-28T11:55:10.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-11-28T11:55:10.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-11-28T11:55:10.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-11-28T11:55:10.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-11-28T11:55:10.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-11-28T11:55:10.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-11-28T11:55:10.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-11-28T11:55:10.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-11-28T11:55:10.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-11-28T11:55:10.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-11-28T11:55:10.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-11-28T11:55:10.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-11-28T11:55:10.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-11-28T11:55:10.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-11-28T11:55:10.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-11-28T11:55:10.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-11-28T11:55:10.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-11-28T11:55:10.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-11-28T11:55:10.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-11-28T11:55:10.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-11-28T11:55:10.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-11-28T11:55:10.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-11-28T11:55:10.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-11-28T11:55:10.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-11-28T11:55:10.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-11-28T11:55:10.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-11-28T11:55:10.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-11-28T11:55:10.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-11-28T11:55:10.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-11-28T11:55:10.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:05.802469+0000', 'last_change': '2023-11-28T11:55:05.802469+0000', 'last_active': '2023-11-28T11:55:05.802469+0000', 'last_peered': '2023-11-28T11:55:05.802469+0000', 'last_clean': '2023-11-28T11:55:05.802469+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:05.802469+0000', 'last_undegraded': '2023-11-28T11:55:05.802469+0000', 'last_fullsized': '2023-11-28T11:55:05.802469+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:05.802469+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-11-28T11:55:10.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:55:04.797251+0000', 'last_change': '2023-11-28T11:55:04.797251+0000', 'last_active': '2023-11-28T11:55:04.797251+0000', 'last_peered': '2023-11-28T11:55:04.797251+0000', 'last_clean': '2023-11-28T11:55:04.797251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:55:04.797251+0000', 'last_undegraded': '2023-11-28T11:55:04.797251+0000', 'last_fullsized': '2023-11-28T11:55:04.797251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'last_clean_scrub_stamp': '2023-11-28T11:55:04.797251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:55:10.948 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T11:55:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63bcfa5700 1 Processor -- start 2023-11-28T11:55:11.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63bcfa5700 1 -- start start 2023-11-28T11:55:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63bcfa5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f63b8160770 0x7f63b80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63bcfa5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f63b80cc600 0x7f63b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63bcfa5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b80c2fa0 con 0x7f63b80cef40 2023-11-28T11:55:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63bcfa5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b80cca00 con 0x7f63b8160770 2023-11-28T11:55:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63bcfa5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b8071e40 con 0x7f63b80cc600 2023-11-28T11:55:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63b77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f63b8160770 0x7f63b80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63b77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f63b8160770 0x7f63b80cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38900/0 (socket says 172.21.15.50:38900) 2023-11-28T11:55:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63b77fe700 1 -- 172.21.15.50:0/1538361741 learned_addr learned my addr 172.21.15.50:0/1538361741 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:11.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63b7fff700 1 --2- 172.21.15.50:0/1538361741 >> v2:172.21.15.192:3300/0 conn(0x7f63b80cc600 0x7f63b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63b77fe700 1 -- 172.21.15.50:0/1538361741 >> v2:172.21.15.192:3300/0 conn(0x7f63b80cc600 msgr2=0x7f63b806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63b77fe700 1 --2- 172.21.15.50:0/1538361741 >> v2:172.21.15.192:3300/0 conn(0x7f63b80cc600 0x7f63b806a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63b77fe700 1 -- 172.21.15.50:0/1538361741 >> v1:172.21.15.192:6789/0 conn(0x7f63b80cef40 legacy=0x7f63b80cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63b77fe700 1 -- 172.21.15.50:0/1538361741 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b8070f50 con 0x7f63b8160770 2023-11-28T11:55:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63b77fe700 1 --2- 172.21.15.50:0/1538361741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63b8160770 0x7f63b80cea00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f63b806d0d0 tx=0x7f63a0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac8e8868d116e19 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63b67fc700 1 -- 172.21.15.50:0/1538361741 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0011830 con 0x7f63b8160770 2023-11-28T11:55:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63b67fc700 1 -- 172.21.15.50:0/1538361741 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a0011990 con 0x7f63b8160770 2023-11-28T11:55:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63b67fc700 1 -- 172.21.15.50:0/1538361741 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0011d20 con 0x7f63b8160770 2023-11-28T11:55:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63bcfa5700 1 -- 172.21.15.50:0/1538361741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63b8160770 msgr2=0x7f63b80cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63bcfa5700 1 --2- 172.21.15.50:0/1538361741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63b8160770 0x7f63b80cea00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f63b806d0d0 tx=0x7f63a0009bf0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63bcfa5700 1 -- 172.21.15.50:0/1538361741 shutdown_connections 2023-11-28T11:55:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63bcfa5700 1 --2- 172.21.15.50:0/1538361741 >> v2:172.21.15.192:3300/0 conn(0x7f63b80cc600 0x7f63b806a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63bcfa5700 1 --2- 172.21.15.50:0/1538361741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63b8160770 0x7f63b80cea00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63bcfa5700 1 -- 172.21.15.50:0/1538361741 >> 172.21.15.50:0/1538361741 conn(0x7f63b806ec40 msgr2=0x7f63b80b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63bcfa5700 1 -- 172.21.15.50:0/1538361741 shutdown_connections 2023-11-28T11:55:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.087+0000 7f63bcfa5700 1 -- 172.21.15.50:0/1538361741 wait complete. 2023-11-28T11:55:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.091+0000 7f63bcfa5700 1 Processor -- start 2023-11-28T11:55:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.091+0000 7f63bcfa5700 1 -- start start 2023-11-28T11:55:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.091+0000 7f63bcfa5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63b80cc600 0x7f63b806bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.091+0000 7f63bcfa5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63b80cef40 0x7f63b81f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.091+0000 7f63bcfa5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63b8160770 0x7f63b81f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.091+0000 7f63bcfa5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b81f5af0 con 0x7f63b80cc600 2023-11-28T11:55:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.091+0000 7f63bcfa5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b80c99a0 con 0x7f63b8160770 2023-11-28T11:55:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63bcfa5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b80c9c80 con 0x7f63b80cef40 2023-11-28T11:55:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63b77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63b80cc600 0x7f63b806bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63b77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63b80cc600 0x7f63b806bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38908/0 (socket says 172.21.15.50:38908) 2023-11-28T11:55:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63b77fe700 1 -- 172.21.15.50:0/392539929 learned_addr learned my addr 172.21.15.50:0/392539929 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63b7fff700 1 --2- 172.21.15.50:0/392539929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63b8160770 0x7f63b81f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63b6ffd700 1 --2- 172.21.15.50:0/392539929 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63b80cef40 0x7f63b81f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63b77fe700 1 -- 172.21.15.50:0/392539929 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63b80cef40 msgr2=0x7f63b81f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63b77fe700 1 --2- 172.21.15.50:0/392539929 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63b80cef40 0x7f63b81f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63b77fe700 1 -- 172.21.15.50:0/392539929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63b8160770 msgr2=0x7f63b81f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63b77fe700 1 --2- 172.21.15.50:0/392539929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63b8160770 0x7f63b81f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63b77fe700 1 -- 172.21.15.50:0/392539929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a0009570 con 0x7f63b80cc600 2023-11-28T11:55:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63b7fff700 1 --2- 172.21.15.50:0/392539929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63b8160770 0x7f63b81f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63b77fe700 1 --2- 172.21.15.50:0/392539929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63b80cc600 0x7f63b806bc30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f63a0000c00 tx=0x7f63a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63affff700 1 -- 172.21.15.50:0/392539929 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0004610 con 0x7f63b80cc600 2023-11-28T11:55:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63affff700 1 -- 172.21.15.50:0/392539929 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a001e070 con 0x7f63b80cc600 2023-11-28T11:55:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63bcfa5700 1 -- 172.21.15.50:0/392539929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b8071510 con 0x7f63b80cc600 2023-11-28T11:55:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63affff700 1 -- 172.21.15.50:0/392539929 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00038e0 con 0x7f63b80cc600 2023-11-28T11:55:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63bcfa5700 1 -- 172.21.15.50:0/392539929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b8071230 con 0x7f63b80cc600 2023-11-28T11:55:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63affff700 1 -- 172.21.15.50:0/392539929 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f63a000f050 con 0x7f63b80cc600 2023-11-28T11:55:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.095+0000 7f63bcfa5700 1 -- 172.21.15.50:0/392539929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b80717f0 con 0x7f63b80cc600 2023-11-28T11:55:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.099+0000 7f63affff700 1 --2- 172.21.15.50:0/392539929 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6398064ee0 0x7f6398067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.099+0000 7f63affff700 1 -- 172.21.15.50:0/392539929 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f63a0082d60 con 0x7f63b80cc600 2023-11-28T11:55:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.099+0000 7f63b6ffd700 1 --2- 172.21.15.50:0/392539929 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6398064ee0 0x7f6398067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.099+0000 7f63b6ffd700 1 --2- 172.21.15.50:0/392539929 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6398064ee0 0x7f6398067390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f63b80c27c0 tx=0x7f63b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.107+0000 7f63affff700 1 -- 172.21.15.50:0/392539929 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f63a0050cd0 con 0x7f63b80cc600 2023-11-28T11:55:11.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.331+0000 7f63bcfa5700 1 -- 172.21.15.50:0/392539929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f63b8072c20 con 0x7f63b80cc600 2023-11-28T11:55:11.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.331+0000 7f63affff700 1 -- 172.21.15.50:0/392539929 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1014 (secure 0 0 0) 0x7f63a0020410 con 0x7f63b80cc600 2023-11-28T11:55:11.333 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:11.333 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":108,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":40,"num_osds":8,"num_up_osds":8,"osd_up_since":1701172413,"num_in_osds":8,"osd_in_since":1701172405,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592698,"bytes_used":81567744,"bytes_avail":773012545536,"bytes_total":773094113280,"write_bytes_sec":2386,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5559}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-11-28T11:54:46.886935+0000","services":{}},"progress_events":{}} 2023-11-28T11:55:11.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.331+0000 7f63bcfa5700 1 -- 172.21.15.50:0/392539929 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6398064ee0 msgr2=0x7f6398067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:11.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.331+0000 7f63bcfa5700 1 --2- 172.21.15.50:0/392539929 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6398064ee0 0x7f6398067390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f63b80c27c0 tx=0x7f63b0009040 comp rx=0 tx=0).stop 2023-11-28T11:55:11.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.331+0000 7f63bcfa5700 1 -- 172.21.15.50:0/392539929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63b80cc600 msgr2=0x7f63b806bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:11.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.331+0000 7f63bcfa5700 1 --2- 172.21.15.50:0/392539929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63b80cc600 0x7f63b806bc30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f63a0000c00 tx=0x7f63a0004770 comp rx=0 tx=0).stop 2023-11-28T11:55:11.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.335+0000 7f63bcfa5700 1 -- 172.21.15.50:0/392539929 shutdown_connections 2023-11-28T11:55:11.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.335+0000 7f63bcfa5700 1 --2- 172.21.15.50:0/392539929 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6398064ee0 0x7f6398067390 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.335+0000 7f63bcfa5700 1 --2- 172.21.15.50:0/392539929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63b8160770 0x7f63b81f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.335+0000 7f63bcfa5700 1 --2- 172.21.15.50:0/392539929 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63b80cef40 0x7f63b81f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.335+0000 7f63bcfa5700 1 --2- 172.21.15.50:0/392539929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63b80cc600 0x7f63b806bc30 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.335+0000 7f63bcfa5700 1 -- 172.21.15.50:0/392539929 >> 172.21.15.50:0/392539929 conn(0x7f63b806ec40 msgr2=0x7f63b806a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:11.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.335+0000 7f63bcfa5700 1 -- 172.21.15.50:0/392539929 shutdown_connections 2023-11-28T11:55:11.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.335+0000 7f63bcfa5700 1 -- 172.21.15.50:0/392539929 wait complete. 2023-11-28T11:55:11.348 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T11:55:11.348 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:55:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.463+0000 7f36674fb700 1 Processor -- start 2023-11-28T11:55:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.463+0000 7f36674fb700 1 -- start start 2023-11-28T11:55:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.463+0000 7f36674fb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3660158e60 0x7f36600c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.463+0000 7f36674fb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f36600cb460 0x7f36600cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.463+0000 7f36674fb700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36600cd8f0 con 0x7f36600ad490 2023-11-28T11:55:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.463+0000 7f36674fb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36600add00 con 0x7f36600cb460 2023-11-28T11:55:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.463+0000 7f36674fb700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36600cc4f0 con 0x7f3660158e60 2023-11-28T11:55:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.463+0000 7f3666cfa700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f36600cb460 0x7f36600cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:11.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.463+0000 7f3666cfa700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f36600cb460 0x7f36600cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38912/0 (socket says 172.21.15.50:38912) 2023-11-28T11:55:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.463+0000 7f3666cfa700 1 -- 172.21.15.50:0/20151201 learned_addr learned my addr 172.21.15.50:0/20151201 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.463+0000 7f36664f9700 1 --2- 172.21.15.50:0/20151201 >> v2:172.21.15.192:3300/0 conn(0x7f3660158e60 0x7f36600c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.463+0000 7f3666cfa700 1 -- 172.21.15.50:0/20151201 >> v2:172.21.15.192:3300/0 conn(0x7f3660158e60 msgr2=0x7f36600c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.463+0000 7f3666cfa700 1 --2- 172.21.15.50:0/20151201 >> v2:172.21.15.192:3300/0 conn(0x7f3660158e60 0x7f36600c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.463+0000 7f3666cfa700 1 -- 172.21.15.50:0/20151201 >> v1:172.21.15.192:6789/0 conn(0x7f36600ad490 legacy=0x7f36600cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.463+0000 7f3666cfa700 1 -- 172.21.15.50:0/20151201 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366006dc60 con 0x7f36600cb460 2023-11-28T11:55:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.467+0000 7f3666cfa700 1 --2- 172.21.15.50:0/20151201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36600cb460 0x7f36600cbfb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f366006f4e0 tx=0x7f365800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddca6226acbdc844 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.467+0000 7f36654f7700 1 -- 172.21.15.50:0/20151201 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3658010070 con 0x7f36600cb460 2023-11-28T11:55:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.467+0000 7f36654f7700 1 -- 172.21.15.50:0/20151201 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365800dd80 con 0x7f36600cb460 2023-11-28T11:55:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.467+0000 7f36654f7700 1 -- 172.21.15.50:0/20151201 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365800b310 con 0x7f36600cb460 2023-11-28T11:55:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.467+0000 7f36674fb700 1 -- 172.21.15.50:0/20151201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36600cb460 msgr2=0x7f36600cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.467+0000 7f36674fb700 1 --2- 172.21.15.50:0/20151201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36600cb460 0x7f36600cbfb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f366006f4e0 tx=0x7f365800d460 comp rx=0 tx=0).stop 2023-11-28T11:55:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.467+0000 7f36674fb700 1 -- 172.21.15.50:0/20151201 shutdown_connections 2023-11-28T11:55:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.467+0000 7f36674fb700 1 --2- 172.21.15.50:0/20151201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36600cb460 0x7f36600cbfb0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.467+0000 7f36674fb700 1 --2- 172.21.15.50:0/20151201 >> v2:172.21.15.192:3300/0 conn(0x7f3660158e60 0x7f36600c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.467+0000 7f36674fb700 1 -- 172.21.15.50:0/20151201 >> 172.21.15.50:0/20151201 conn(0x7f36600ce3e0 msgr2=0x7f36600ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.467+0000 7f36674fb700 1 -- 172.21.15.50:0/20151201 shutdown_connections 2023-11-28T11:55:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.467+0000 7f36674fb700 1 -- 172.21.15.50:0/20151201 wait complete. 2023-11-28T11:55:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.467+0000 7f36674fb700 1 Processor -- start 2023-11-28T11:55:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.467+0000 7f36674fb700 1 -- start start 2023-11-28T11:55:11.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f36674fb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36600ad490 0x7f36600ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:11.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f36674fb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36600cb460 0x7f36600c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:11.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f36674fb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3660158e60 0x7f36601544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:11.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f36674fb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36600c4b70 con 0x7f36600ad490 2023-11-28T11:55:11.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f36674fb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36600c3870 con 0x7f3660158e60 2023-11-28T11:55:11.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f36674fb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36600c3b50 con 0x7f36600cb460 2023-11-28T11:55:11.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f36664f9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36600ad490 0x7f36600ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:11.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f36664f9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36600ad490 0x7f36600ae6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38922/0 (socket says 172.21.15.50:38922) 2023-11-28T11:55:11.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f36664f9700 1 -- 172.21.15.50:0/1935640170 learned_addr learned my addr 172.21.15.50:0/1935640170 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:11.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f3665cf8700 1 --2- 172.21.15.50:0/1935640170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36600cb460 0x7f36600c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:11.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f3666cfa700 1 --2- 172.21.15.50:0/1935640170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3660158e60 0x7f36601544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:11.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f36664f9700 1 -- 172.21.15.50:0/1935640170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36600cb460 msgr2=0x7f36600c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:11.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f36664f9700 1 --2- 172.21.15.50:0/1935640170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36600cb460 0x7f36600c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f36664f9700 1 -- 172.21.15.50:0/1935640170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3660158e60 msgr2=0x7f36601544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:11.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f36664f9700 1 --2- 172.21.15.50:0/1935640170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3660158e60 0x7f36601544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f36664f9700 1 -- 172.21.15.50:0/1935640170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365800bd40 con 0x7f36600ad490 2023-11-28T11:55:11.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f36664f9700 1 --2- 172.21.15.50:0/1935640170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36600ad490 0x7f36600ae6c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f365c00d800 tx=0x7f365c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:11.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f3656ffd700 1 -- 172.21.15.50:0/1935640170 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c0125f0 con 0x7f36600ad490 2023-11-28T11:55:11.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f3656ffd700 1 -- 172.21.15.50:0/1935640170 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c012750 con 0x7f36600ad490 2023-11-28T11:55:11.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f36674fb700 1 -- 172.21.15.50:0/1935640170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3660159230 con 0x7f36600ad490 2023-11-28T11:55:11.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f3656ffd700 1 -- 172.21.15.50:0/1935640170 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c012ac0 con 0x7f36600ad490 2023-11-28T11:55:11.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.471+0000 7f36674fb700 1 -- 172.21.15.50:0/1935640170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36600cde90 con 0x7f36600ad490 2023-11-28T11:55:11.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.475+0000 7f36674fb700 1 -- 172.21.15.50:0/1935640170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366006d6a0 con 0x7f36600ad490 2023-11-28T11:55:11.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.475+0000 7f3656ffd700 1 -- 172.21.15.50:0/1935640170 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f365c012c20 con 0x7f36600ad490 2023-11-28T11:55:11.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.479+0000 7f3656ffd700 1 --2- 172.21.15.50:0/1935640170 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3644064ee0 0x7f3644067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:11.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.479+0000 7f3656ffd700 1 -- 172.21.15.50:0/1935640170 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f365c082c40 con 0x7f36600ad490 2023-11-28T11:55:11.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.479+0000 7f3665cf8700 1 --2- 172.21.15.50:0/1935640170 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3644064ee0 0x7f3644067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.479+0000 7f3665cf8700 1 --2- 172.21.15.50:0/1935640170 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3644064ee0 0x7f3644067390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3660157ad0 tx=0x7f3650009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:11.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.487+0000 7f3656ffd700 1 -- 172.21.15.50:0/1935640170 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f365c050d40 con 0x7f36600ad490 2023-11-28T11:55:11.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.647+0000 7f36674fb700 1 -- 172.21.15.50:0/1935640170 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36600c3cc0 con 0x7f3644064ee0 2023-11-28T11:55:11.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.659+0000 7f3656ffd700 1 -- 172.21.15.50:0/1935640170 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309815 (secure 0 0 0) 0x7f36600c3cc0 con 0x7f3644064ee0 2023-11-28T11:55:11.666 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:11.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.667+0000 7f36674fb700 1 -- 172.21.15.50:0/1935640170 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3644064ee0 msgr2=0x7f3644067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:11.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.667+0000 7f36674fb700 1 --2- 172.21.15.50:0/1935640170 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3644064ee0 0x7f3644067390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3660157ad0 tx=0x7f3650009040 comp rx=0 tx=0).stop 2023-11-28T11:55:11.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.667+0000 7f36674fb700 1 -- 172.21.15.50:0/1935640170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36600ad490 msgr2=0x7f36600ae6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:11.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.667+0000 7f36674fb700 1 --2- 172.21.15.50:0/1935640170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36600ad490 0x7f36600ae6c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f365c00d800 tx=0x7f365c00db10 comp rx=0 tx=0).stop 2023-11-28T11:55:11.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.667+0000 7f36674fb700 1 -- 172.21.15.50:0/1935640170 shutdown_connections 2023-11-28T11:55:11.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.667+0000 7f36674fb700 1 --2- 172.21.15.50:0/1935640170 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3644064ee0 0x7f3644067390 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.667+0000 7f36674fb700 1 --2- 172.21.15.50:0/1935640170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3660158e60 0x7f36601544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.667+0000 7f36674fb700 1 --2- 172.21.15.50:0/1935640170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36600cb460 0x7f36600c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.667+0000 7f36674fb700 1 --2- 172.21.15.50:0/1935640170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36600ad490 0x7f36600ae6c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.667+0000 7f36674fb700 1 -- 172.21.15.50:0/1935640170 >> 172.21.15.50:0/1935640170 conn(0x7f36600ce3e0 msgr2=0x7f3660069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.667+0000 7f36674fb700 1 -- 172.21.15.50:0/1935640170 shutdown_connections 2023-11-28T11:55:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:11.667+0000 7f36674fb700 1 -- 172.21.15.50:0/1935640170 wait complete. 2023-11-28T11:55:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:55:11.683 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-11-28T11:55:10.901283+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":79656,"kb_used_data":4776,"kb_used_omap":0,"kb_used_meta":74816,"kb_avail":754895064,"statfs":{"total":773094113280,"available":773012545536,"internally_reserved":0,"allocated":4890624,"data_stored":2822592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":76611584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.008381"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.241029+0000","last_change":"2023-11-28T11:55:06.236827+0000","last_active":"2023-11-28T11:55:06.241029+0000","last_peered":"2023-11-28T11:55:06.241029+0000","last_clean":"2023-11-28T11:55:06.241029+0000","last_became_active":"2023-11-28T11:55:06.236509+0000","last_became_peered":"2023-11-28T11:55:06.236509+0000","last_unstale":"2023-11-28T11:55:06.241029+0000","last_undegraded":"2023-11-28T11:55:06.241029+0000","last_fullsized":"2023-11-28T11:55:06.241029+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:57.634824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220166+0000","last_change":"2023-11-28T11:55:06.231044+0000","last_active":"2023-11-28T11:55:07.220166+0000","last_peered":"2023-11-28T11:55:07.220166+0000","last_clean":"2023-11-28T11:55:07.220166+0000","last_became_active":"2023-11-28T11:55:06.230776+0000","last_became_peered":"2023-11-28T11:55:06.230776+0000","last_unstale":"2023-11-28T11:55:07.220166+0000","last_undegraded":"2023-11-28T11:55:07.220166+0000","last_fullsized":"2023-11-28T11:55:07.220166+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:14.707977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221296+0000","last_change":"2023-11-28T11:55:06.230033+0000","last_active":"2023-11-28T11:55:07.221296+0000","last_peered":"2023-11-28T11:55:07.221296+0000","last_clean":"2023-11-28T11:55:07.221296+0000","last_became_active":"2023-11-28T11:55:06.229683+0000","last_became_peered":"2023-11-28T11:55:06.229683+0000","last_unstale":"2023-11-28T11:55:07.221296+0000","last_undegraded":"2023-11-28T11:55:07.221296+0000","last_fullsized":"2023-11-28T11:55:07.221296+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:26:34.964906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.247738+0000","last_change":"2023-11-28T11:55:06.242575+0000","last_active":"2023-11-28T11:55:06.247738+0000","last_peered":"2023-11-28T11:55:06.247738+0000","last_clean":"2023-11-28T11:55:06.247738+0000","last_became_active":"2023-11-28T11:55:06.242214+0000","last_became_peered":"2023-11-28T11:55:06.242214+0000","last_unstale":"2023-11-28T11:55:06.247738+0000","last_undegraded":"2023-11-28T11:55:06.247738+0000","last_fullsized":"2023-11-28T11:55:06.247738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:38:31.234809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220448+0000","last_change":"2023-11-28T11:55:06.226876+0000","last_active":"2023-11-28T11:55:07.220448+0000","last_peered":"2023-11-28T11:55:07.220448+0000","last_clean":"2023-11-28T11:55:07.220448+0000","last_became_active":"2023-11-28T11:55:06.226566+0000","last_became_peered":"2023-11-28T11:55:06.226566+0000","last_unstale":"2023-11-28T11:55:07.220448+0000","last_undegraded":"2023-11-28T11:55:07.220448+0000","last_fullsized":"2023-11-28T11:55:07.220448+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:40.581348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219371+0000","last_change":"2023-11-28T11:55:06.233755+0000","last_active":"2023-11-28T11:55:07.219371+0000","last_peered":"2023-11-28T11:55:07.219371+0000","last_clean":"2023-11-28T11:55:07.219371+0000","last_became_active":"2023-11-28T11:55:06.233482+0000","last_became_peered":"2023-11-28T11:55:06.233482+0000","last_unstale":"2023-11-28T11:55:07.219371+0000","last_undegraded":"2023-11-28T11:55:07.219371+0000","last_fullsized":"2023-11-28T11:55:07.219371+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:16.495251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.238686+0000","last_change":"2023-11-28T11:55:06.226370+0000","last_active":"2023-11-28T11:55:06.238686+0000","last_peered":"2023-11-28T11:55:06.238686+0000","last_clean":"2023-11-28T11:55:06.238686+0000","last_became_active":"2023-11-28T11:55:06.226064+0000","last_became_peered":"2023-11-28T11:55:06.226064+0000","last_unstale":"2023-11-28T11:55:06.238686+0000","last_undegraded":"2023-11-28T11:55:06.238686+0000","last_fullsized":"2023-11-28T11:55:06.238686+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:32.761671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.248174+0000","last_change":"2023-11-28T11:55:06.244625+0000","last_active":"2023-11-28T11:55:06.248174+0000","last_peered":"2023-11-28T11:55:06.248174+0000","last_clean":"2023-11-28T11:55:06.248174+0000","last_became_active":"2023-11-28T11:55:06.244350+0000","last_became_peered":"2023-11-28T11:55:06.244350+0000","last_unstale":"2023-11-28T11:55:06.248174+0000","last_undegraded":"2023-11-28T11:55:06.248174+0000","last_fullsized":"2023-11-28T11:55:06.248174+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:01:09.791004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.232178+0000","last_change":"2023-11-28T11:55:06.228384+0000","last_active":"2023-11-28T11:55:06.232178+0000","last_peered":"2023-11-28T11:55:06.232178+0000","last_clean":"2023-11-28T11:55:06.232178+0000","last_became_active":"2023-11-28T11:55:06.228071+0000","last_became_peered":"2023-11-28T11:55:06.228071+0000","last_unstale":"2023-11-28T11:55:06.232178+0000","last_undegraded":"2023-11-28T11:55:06.232178+0000","last_fullsized":"2023-11-28T11:55:06.232178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:02:09.032569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.247811+0000","last_change":"2023-11-28T11:55:06.242602+0000","last_active":"2023-11-28T11:55:06.247811+0000","last_peered":"2023-11-28T11:55:06.247811+0000","last_clean":"2023-11-28T11:55:06.247811+0000","last_became_active":"2023-11-28T11:55:06.242314+0000","last_became_peered":"2023-11-28T11:55:06.242314+0000","last_unstale":"2023-11-28T11:55:06.247811+0000","last_undegraded":"2023-11-28T11:55:06.247811+0000","last_fullsized":"2023-11-28T11:55:06.247811+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:26:34.964906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.242156+0000","last_change":"2023-11-28T11:55:06.231199+0000","last_active":"2023-11-28T11:55:06.242156+0000","last_peered":"2023-11-28T11:55:06.242156+0000","last_clean":"2023-11-28T11:55:06.242156+0000","last_became_active":"2023-11-28T11:55:06.230951+0000","last_became_peered":"2023-11-28T11:55:06.230951+0000","last_unstale":"2023-11-28T11:55:06.242156+0000","last_undegraded":"2023-11-28T11:55:06.242156+0000","last_fullsized":"2023-11-28T11:55:06.242156+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:16.495251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220157+0000","last_change":"2023-11-28T11:55:06.229571+0000","last_active":"2023-11-28T11:55:07.220157+0000","last_peered":"2023-11-28T11:55:07.220157+0000","last_clean":"2023-11-28T11:55:07.220157+0000","last_became_active":"2023-11-28T11:55:06.229283+0000","last_became_peered":"2023-11-28T11:55:06.229283+0000","last_unstale":"2023-11-28T11:55:07.220157+0000","last_undegraded":"2023-11-28T11:55:07.220157+0000","last_fullsized":"2023-11-28T11:55:07.220157+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:57.634824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.042863+0000","last_change":"2023-11-28T11:55:06.240644+0000","last_active":"2023-11-28T11:55:08.042863+0000","last_peered":"2023-11-28T11:55:08.042863+0000","last_clean":"2023-11-28T11:55:08.042863+0000","last_became_active":"2023-11-28T11:55:06.240276+0000","last_became_peered":"2023-11-28T11:55:06.240276+0000","last_unstale":"2023-11-28T11:55:08.042863+0000","last_undegraded":"2023-11-28T11:55:08.042863+0000","last_fullsized":"2023-11-28T11:55:08.042863+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:38:21.378947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.242120+0000","last_change":"2023-11-28T11:55:06.229308+0000","last_active":"2023-11-28T11:55:06.242120+0000","last_peered":"2023-11-28T11:55:06.242120+0000","last_clean":"2023-11-28T11:55:06.242120+0000","last_became_active":"2023-11-28T11:55:06.229033+0000","last_became_peered":"2023-11-28T11:55:06.229033+0000","last_unstale":"2023-11-28T11:55:06.242120+0000","last_undegraded":"2023-11-28T11:55:06.242120+0000","last_fullsized":"2023-11-28T11:55:06.242120+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:50:36.583187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219295+0000","last_change":"2023-11-28T11:55:06.232701+0000","last_active":"2023-11-28T11:55:07.219295+0000","last_peered":"2023-11-28T11:55:07.219295+0000","last_clean":"2023-11-28T11:55:07.219295+0000","last_became_active":"2023-11-28T11:55:06.227192+0000","last_became_peered":"2023-11-28T11:55:06.227192+0000","last_unstale":"2023-11-28T11:55:07.219295+0000","last_undegraded":"2023-11-28T11:55:07.219295+0000","last_fullsized":"2023-11-28T11:55:07.219295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:43:02.719592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.242846+0000","last_change":"2023-11-28T11:55:06.235977+0000","last_active":"2023-11-28T11:55:06.242846+0000","last_peered":"2023-11-28T11:55:06.242846+0000","last_clean":"2023-11-28T11:55:06.242846+0000","last_became_active":"2023-11-28T11:55:06.235454+0000","last_became_peered":"2023-11-28T11:55:06.235454+0000","last_unstale":"2023-11-28T11:55:06.242846+0000","last_undegraded":"2023-11-28T11:55:06.242846+0000","last_fullsized":"2023-11-28T11:55:06.242846+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:44:59.098222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221451+0000","last_change":"2023-11-28T11:55:06.219207+0000","last_active":"2023-11-28T11:55:07.221451+0000","last_peered":"2023-11-28T11:55:07.221451+0000","last_clean":"2023-11-28T11:55:07.221451+0000","last_became_active":"2023-11-28T11:55:06.218885+0000","last_became_peered":"2023-11-28T11:55:06.218885+0000","last_unstale":"2023-11-28T11:55:07.221451+0000","last_undegraded":"2023-11-28T11:55:07.221451+0000","last_fullsized":"2023-11-28T11:55:07.221451+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:07:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221307+0000","last_change":"2023-11-28T11:55:06.231298+0000","last_active":"2023-11-28T11:55:07.221307+0000","last_peered":"2023-11-28T11:55:07.221307+0000","last_clean":"2023-11-28T11:55:07.221307+0000","last_became_active":"2023-11-28T11:55:06.231005+0000","last_became_peered":"2023-11-28T11:55:06.231005+0000","last_unstale":"2023-11-28T11:55:07.221307+0000","last_undegraded":"2023-11-28T11:55:07.221307+0000","last_fullsized":"2023-11-28T11:55:07.221307+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:38:31.234809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.242906+0000","last_change":"2023-11-28T11:55:06.236171+0000","last_active":"2023-11-28T11:55:06.242906+0000","last_peered":"2023-11-28T11:55:06.242906+0000","last_clean":"2023-11-28T11:55:06.242906+0000","last_became_active":"2023-11-28T11:55:06.235794+0000","last_became_peered":"2023-11-28T11:55:06.235794+0000","last_unstale":"2023-11-28T11:55:06.242906+0000","last_undegraded":"2023-11-28T11:55:06.242906+0000","last_fullsized":"2023-11-28T11:55:06.242906+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:38:51.726308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.043178+0000","last_change":"2023-11-28T11:55:06.231263+0000","last_active":"2023-11-28T11:55:08.043178+0000","last_peered":"2023-11-28T11:55:08.043178+0000","last_clean":"2023-11-28T11:55:08.043178+0000","last_became_active":"2023-11-28T11:55:06.230943+0000","last_became_peered":"2023-11-28T11:55:06.230943+0000","last_unstale":"2023-11-28T11:55:08.043178+0000","last_undegraded":"2023-11-28T11:55:08.043178+0000","last_fullsized":"2023-11-28T11:55:08.043178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:11.448012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219425+0000","last_change":"2023-11-28T11:55:06.238526+0000","last_active":"2023-11-28T11:55:07.219425+0000","last_peered":"2023-11-28T11:55:07.219425+0000","last_clean":"2023-11-28T11:55:07.219425+0000","last_became_active":"2023-11-28T11:55:06.238292+0000","last_became_peered":"2023-11-28T11:55:06.238292+0000","last_unstale":"2023-11-28T11:55:07.219425+0000","last_undegraded":"2023-11-28T11:55:07.219425+0000","last_fullsized":"2023-11-28T11:55:07.219425+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:26:34.964906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.247901+0000","last_change":"2023-11-28T11:55:06.242940+0000","last_active":"2023-11-28T11:55:06.247901+0000","last_peered":"2023-11-28T11:55:06.247901+0000","last_clean":"2023-11-28T11:55:06.247901+0000","last_became_active":"2023-11-28T11:55:06.242633+0000","last_became_peered":"2023-11-28T11:55:06.242633+0000","last_unstale":"2023-11-28T11:55:06.247901+0000","last_undegraded":"2023-11-28T11:55:06.247901+0000","last_fullsized":"2023-11-28T11:55:06.247901+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:33.691957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.239592+0000","last_change":"2023-11-28T11:55:06.228908+0000","last_active":"2023-11-28T11:55:06.239592+0000","last_peered":"2023-11-28T11:55:06.239592+0000","last_clean":"2023-11-28T11:55:06.239592+0000","last_became_active":"2023-11-28T11:55:06.228308+0000","last_became_peered":"2023-11-28T11:55:06.228308+0000","last_unstale":"2023-11-28T11:55:06.239592+0000","last_undegraded":"2023-11-28T11:55:06.239592+0000","last_fullsized":"2023-11-28T11:55:06.239592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:32:36.774854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.245553+0000","last_change":"2023-11-28T11:55:06.240015+0000","last_active":"2023-11-28T11:55:06.245553+0000","last_peered":"2023-11-28T11:55:06.245553+0000","last_clean":"2023-11-28T11:55:06.245553+0000","last_became_active":"2023-11-28T11:55:06.239754+0000","last_became_peered":"2023-11-28T11:55:06.239754+0000","last_unstale":"2023-11-28T11:55:06.245553+0000","last_undegraded":"2023-11-28T11:55:06.245553+0000","last_fullsized":"2023-11-28T11:55:06.245553+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:47:38.195856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.242969+0000","last_change":"2023-11-28T11:55:06.238332+0000","last_active":"2023-11-28T11:55:06.242969+0000","last_peered":"2023-11-28T11:55:06.242969+0000","last_clean":"2023-11-28T11:55:06.242969+0000","last_became_active":"2023-11-28T11:55:06.237099+0000","last_became_peered":"2023-11-28T11:55:06.237099+0000","last_unstale":"2023-11-28T11:55:06.242969+0000","last_undegraded":"2023-11-28T11:55:06.242969+0000","last_fullsized":"2023-11-28T11:55:06.242969+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:18:07.145986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.043204+0000","last_change":"2023-11-28T11:55:06.235070+0000","last_active":"2023-11-28T11:55:08.043204+0000","last_peered":"2023-11-28T11:55:08.043204+0000","last_clean":"2023-11-28T11:55:08.043204+0000","last_became_active":"2023-11-28T11:55:06.234829+0000","last_became_peered":"2023-11-28T11:55:06.234829+0000","last_unstale":"2023-11-28T11:55:08.043204+0000","last_undegraded":"2023-11-28T11:55:08.043204+0000","last_fullsized":"2023-11-28T11:55:08.043204+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:18:45.335246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221447+0000","last_change":"2023-11-28T11:55:06.220711+0000","last_active":"2023-11-28T11:55:07.221447+0000","last_peered":"2023-11-28T11:55:07.221447+0000","last_clean":"2023-11-28T11:55:07.221447+0000","last_became_active":"2023-11-28T11:55:06.218889+0000","last_became_peered":"2023-11-28T11:55:06.218889+0000","last_unstale":"2023-11-28T11:55:07.221447+0000","last_undegraded":"2023-11-28T11:55:07.221447+0000","last_fullsized":"2023-11-28T11:55:07.221447+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:09:23.634439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220303+0000","last_change":"2023-11-28T11:55:06.229229+0000","last_active":"2023-11-28T11:55:07.220303+0000","last_peered":"2023-11-28T11:55:07.220303+0000","last_clean":"2023-11-28T11:55:07.220303+0000","last_became_active":"2023-11-28T11:55:06.228888+0000","last_became_peered":"2023-11-28T11:55:06.228888+0000","last_unstale":"2023-11-28T11:55:07.220303+0000","last_undegraded":"2023-11-28T11:55:07.220303+0000","last_fullsized":"2023-11-28T11:55:07.220303+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:16.488151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.242825+0000","last_change":"2023-11-28T11:55:06.235899+0000","last_active":"2023-11-28T11:55:06.242825+0000","last_peered":"2023-11-28T11:55:06.242825+0000","last_clean":"2023-11-28T11:55:06.242825+0000","last_became_active":"2023-11-28T11:55:06.235487+0000","last_became_peered":"2023-11-28T11:55:06.235487+0000","last_unstale":"2023-11-28T11:55:06.242825+0000","last_undegraded":"2023-11-28T11:55:06.242825+0000","last_fullsized":"2023-11-28T11:55:06.242825+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:13:03.345320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221184+0000","last_change":"2023-11-28T11:55:06.225203+0000","last_active":"2023-11-28T11:55:07.221184+0000","last_peered":"2023-11-28T11:55:07.221184+0000","last_clean":"2023-11-28T11:55:07.221184+0000","last_became_active":"2023-11-28T11:55:06.224895+0000","last_became_peered":"2023-11-28T11:55:06.224895+0000","last_unstale":"2023-11-28T11:55:07.221184+0000","last_undegraded":"2023-11-28T11:55:07.221184+0000","last_fullsized":"2023-11-28T11:55:07.221184+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:23:03.362862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219302+0000","last_change":"2023-11-28T11:55:06.233298+0000","last_active":"2023-11-28T11:55:07.219302+0000","last_peered":"2023-11-28T11:55:07.219302+0000","last_clean":"2023-11-28T11:55:07.219302+0000","last_became_active":"2023-11-28T11:55:06.227483+0000","last_became_peered":"2023-11-28T11:55:06.227483+0000","last_unstale":"2023-11-28T11:55:07.219302+0000","last_undegraded":"2023-11-28T11:55:07.219302+0000","last_fullsized":"2023-11-28T11:55:07.219302+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:23:03.362862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.042691+0000","last_change":"2023-11-28T11:55:06.229728+0000","last_active":"2023-11-28T11:55:08.042691+0000","last_peered":"2023-11-28T11:55:08.042691+0000","last_clean":"2023-11-28T11:55:08.042691+0000","last_became_active":"2023-11-28T11:55:06.229101+0000","last_became_peered":"2023-11-28T11:55:06.229101+0000","last_unstale":"2023-11-28T11:55:08.042691+0000","last_undegraded":"2023-11-28T11:55:08.042691+0000","last_fullsized":"2023-11-28T11:55:08.042691+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:02:15.061798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.334777+0000","last_change":"2023-11-28T11:55:06.243201+0000","last_active":"2023-11-28T11:55:08.334777+0000","last_peered":"2023-11-28T11:55:08.334777+0000","last_clean":"2023-11-28T11:55:08.334777+0000","last_became_active":"2023-11-28T11:55:06.242937+0000","last_became_peered":"2023-11-28T11:55:06.242937+0000","last_unstale":"2023-11-28T11:55:08.334777+0000","last_undegraded":"2023-11-28T11:55:08.334777+0000","last_fullsized":"2023-11-28T11:55:08.334777+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:18:07.145986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'4","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219940+0000","last_change":"2023-11-28T11:55:05.845554+0000","last_active":"2023-11-28T11:55:07.219940+0000","last_peered":"2023-11-28T11:55:07.219940+0000","last_clean":"2023-11-28T11:55:07.219940+0000","last_became_active":"2023-11-28T11:55:05.845262+0000","last_became_peered":"2023-11-28T11:55:05.845262+0000","last_unstale":"2023-11-28T11:55:07.219940+0000","last_undegraded":"2023-11-28T11:55:07.219940+0000","last_fullsized":"2023-11-28T11:55:07.219940+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:31.756453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.242950+0000","last_change":"2023-11-28T11:55:06.237768+0000","last_active":"2023-11-28T11:55:06.242950+0000","last_peered":"2023-11-28T11:55:06.242950+0000","last_clean":"2023-11-28T11:55:06.242950+0000","last_became_active":"2023-11-28T11:55:06.237390+0000","last_became_peered":"2023-11-28T11:55:06.237390+0000","last_unstale":"2023-11-28T11:55:06.242950+0000","last_undegraded":"2023-11-28T11:55:06.242950+0000","last_fullsized":"2023-11-28T11:55:06.242950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:12.738933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221552+0000","last_change":"2023-11-28T11:55:05.842909+0000","last_active":"2023-11-28T11:55:07.221552+0000","last_peered":"2023-11-28T11:55:07.221552+0000","last_clean":"2023-11-28T11:55:07.221552+0000","last_became_active":"2023-11-28T11:55:05.842181+0000","last_became_peered":"2023-11-28T11:55:05.842181+0000","last_unstale":"2023-11-28T11:55:07.221552+0000","last_undegraded":"2023-11-28T11:55:07.221552+0000","last_fullsized":"2023-11-28T11:55:07.221552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:18:32.190988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220304+0000","last_change":"2023-11-28T11:55:06.237891+0000","last_active":"2023-11-28T11:55:07.220304+0000","last_peered":"2023-11-28T11:55:07.220304+0000","last_clean":"2023-11-28T11:55:07.220304+0000","last_became_active":"2023-11-28T11:55:06.237563+0000","last_became_peered":"2023-11-28T11:55:06.237563+0000","last_unstale":"2023-11-28T11:55:07.220304+0000","last_undegraded":"2023-11-28T11:55:07.220304+0000","last_fullsized":"2023-11-28T11:55:07.220304+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:18:33.196205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.335124+0000","last_change":"2023-11-28T11:55:05.838764+0000","last_active":"2023-11-28T11:55:08.335124+0000","last_peered":"2023-11-28T11:55:08.335124+0000","last_clean":"2023-11-28T11:55:08.335124+0000","last_became_active":"2023-11-28T11:55:05.838297+0000","last_became_peered":"2023-11-28T11:55:05.838297+0000","last_unstale":"2023-11-28T11:55:08.335124+0000","last_undegraded":"2023-11-28T11:55:08.335124+0000","last_fullsized":"2023-11-28T11:55:08.335124+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:16:58.464218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.335142+0000","last_change":"2023-11-28T11:55:06.238107+0000","last_active":"2023-11-28T11:55:08.335142+0000","last_peered":"2023-11-28T11:55:08.335142+0000","last_clean":"2023-11-28T11:55:08.335142+0000","last_became_active":"2023-11-28T11:55:06.237807+0000","last_became_peered":"2023-11-28T11:55:06.237807+0000","last_unstale":"2023-11-28T11:55:08.335142+0000","last_undegraded":"2023-11-28T11:55:08.335142+0000","last_fullsized":"2023-11-28T11:55:08.335142+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:47:38.195856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.235602+0000","last_change":"2023-11-28T11:55:05.839128+0000","last_active":"2023-11-28T11:55:06.235602+0000","last_peered":"2023-11-28T11:55:06.235602+0000","last_clean":"2023-11-28T11:55:06.235602+0000","last_became_active":"2023-11-28T11:55:05.838770+0000","last_became_peered":"2023-11-28T11:55:05.838770+0000","last_unstale":"2023-11-28T11:55:06.235602+0000","last_undegraded":"2023-11-28T11:55:06.235602+0000","last_fullsized":"2023-11-28T11:55:06.235602+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:44.525674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221205+0000","last_change":"2023-11-28T11:55:06.238851+0000","last_active":"2023-11-28T11:55:07.221205+0000","last_peered":"2023-11-28T11:55:07.221205+0000","last_clean":"2023-11-28T11:55:07.221205+0000","last_became_active":"2023-11-28T11:55:06.238560+0000","last_became_peered":"2023-11-28T11:55:06.238560+0000","last_unstale":"2023-11-28T11:55:07.221205+0000","last_undegraded":"2023-11-28T11:55:07.221205+0000","last_fullsized":"2023-11-28T11:55:07.221205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:33.691957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219607+0000","last_change":"2023-11-28T11:55:05.846764+0000","last_active":"2023-11-28T11:55:07.219607+0000","last_peered":"2023-11-28T11:55:07.219607+0000","last_clean":"2023-11-28T11:55:07.219607+0000","last_became_active":"2023-11-28T11:55:05.846200+0000","last_became_peered":"2023-11-28T11:55:05.846200+0000","last_unstale":"2023-11-28T11:55:07.219607+0000","last_undegraded":"2023-11-28T11:55:07.219607+0000","last_fullsized":"2023-11-28T11:55:07.219607+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:13.702760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.245444+0000","last_change":"2023-11-28T11:55:06.232368+0000","last_active":"2023-11-28T11:55:06.245444+0000","last_peered":"2023-11-28T11:55:06.245444+0000","last_clean":"2023-11-28T11:55:06.245444+0000","last_became_active":"2023-11-28T11:55:06.232108+0000","last_became_peered":"2023-11-28T11:55:06.232108+0000","last_unstale":"2023-11-28T11:55:06.245444+0000","last_undegraded":"2023-11-28T11:55:06.245444+0000","last_fullsized":"2023-11-28T11:55:06.245444+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:07:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221442+0000","last_change":"2023-11-28T11:55:05.840762+0000","last_active":"2023-11-28T11:55:07.221442+0000","last_peered":"2023-11-28T11:55:07.221442+0000","last_clean":"2023-11-28T11:55:07.221442+0000","last_became_active":"2023-11-28T11:55:05.840523+0000","last_became_peered":"2023-11-28T11:55:05.840523+0000","last_unstale":"2023-11-28T11:55:07.221442+0000","last_undegraded":"2023-11-28T11:55:07.221442+0000","last_fullsized":"2023-11-28T11:55:07.221442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:56.629606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.248183+0000","last_change":"2023-11-28T11:55:06.244691+0000","last_active":"2023-11-28T11:55:06.248183+0000","last_peered":"2023-11-28T11:55:06.248183+0000","last_clean":"2023-11-28T11:55:06.248183+0000","last_became_active":"2023-11-28T11:55:06.244403+0000","last_became_peered":"2023-11-28T11:55:06.244403+0000","last_unstale":"2023-11-28T11:55:06.248183+0000","last_undegraded":"2023-11-28T11:55:06.248183+0000","last_fullsized":"2023-11-28T11:55:06.248183+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:23:03.362862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219761+0000","last_change":"2023-11-28T11:55:05.836815+0000","last_active":"2023-11-28T11:55:07.219761+0000","last_peered":"2023-11-28T11:55:07.219761+0000","last_clean":"2023-11-28T11:55:07.219761+0000","last_became_active":"2023-11-28T11:55:05.836303+0000","last_became_peered":"2023-11-28T11:55:05.836303+0000","last_unstale":"2023-11-28T11:55:07.219761+0000","last_undegraded":"2023-11-28T11:55:07.219761+0000","last_fullsized":"2023-11-28T11:55:07.219761+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:44:58.093005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.239612+0000","last_change":"2023-11-28T11:55:06.229095+0000","last_active":"2023-11-28T11:55:06.239612+0000","last_peered":"2023-11-28T11:55:06.239612+0000","last_clean":"2023-11-28T11:55:06.239612+0000","last_became_active":"2023-11-28T11:55:06.228614+0000","last_became_peered":"2023-11-28T11:55:06.228614+0000","last_unstale":"2023-11-28T11:55:06.239612+0000","last_undegraded":"2023-11-28T11:55:06.239612+0000","last_fullsized":"2023-11-28T11:55:06.239612+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:45.530892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.223911+0000","last_change":"2023-11-28T11:55:05.838098+0000","last_active":"2023-11-28T11:55:06.223911+0000","last_peered":"2023-11-28T11:55:06.223911+0000","last_clean":"2023-11-28T11:55:06.223911+0000","last_became_active":"2023-11-28T11:55:05.837637+0000","last_became_peered":"2023-11-28T11:55:05.837637+0000","last_unstale":"2023-11-28T11:55:06.223911+0000","last_undegraded":"2023-11-28T11:55:06.223911+0000","last_fullsized":"2023-11-28T11:55:06.223911+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:31.756453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221442+0000","last_change":"2023-11-28T11:55:06.231236+0000","last_active":"2023-11-28T11:55:07.221442+0000","last_peered":"2023-11-28T11:55:07.221442+0000","last_clean":"2023-11-28T11:55:07.221442+0000","last_became_active":"2023-11-28T11:55:06.230954+0000","last_became_peered":"2023-11-28T11:55:06.230954+0000","last_unstale":"2023-11-28T11:55:07.221442+0000","last_undegraded":"2023-11-28T11:55:07.221442+0000","last_fullsized":"2023-11-28T11:55:07.221442+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:16.495251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221623+0000","last_change":"2023-11-28T11:55:05.843964+0000","last_active":"2023-11-28T11:55:07.221623+0000","last_peered":"2023-11-28T11:55:07.221623+0000","last_clean":"2023-11-28T11:55:07.221623+0000","last_became_active":"2023-11-28T11:55:05.843719+0000","last_became_peered":"2023-11-28T11:55:05.843719+0000","last_unstale":"2023-11-28T11:55:07.221623+0000","last_undegraded":"2023-11-28T11:55:07.221623+0000","last_fullsized":"2023-11-28T11:55:07.221623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:25.424333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.238937+0000","last_change":"2023-11-28T11:55:06.229474+0000","last_active":"2023-11-28T11:55:06.238937+0000","last_peered":"2023-11-28T11:55:06.238937+0000","last_clean":"2023-11-28T11:55:06.238937+0000","last_became_active":"2023-11-28T11:55:06.229221+0000","last_became_peered":"2023-11-28T11:55:06.229221+0000","last_unstale":"2023-11-28T11:55:06.238937+0000","last_undegraded":"2023-11-28T11:55:06.238937+0000","last_fullsized":"2023-11-28T11:55:06.238937+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:26.429551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.225222+0000","last_change":"2023-11-28T11:55:05.840346+0000","last_active":"2023-11-28T11:55:06.225222+0000","last_peered":"2023-11-28T11:55:06.225222+0000","last_clean":"2023-11-28T11:55:06.225222+0000","last_became_active":"2023-11-28T11:55:05.839950+0000","last_became_peered":"2023-11-28T11:55:05.839950+0000","last_unstale":"2023-11-28T11:55:06.225222+0000","last_undegraded":"2023-11-28T11:55:06.225222+0000","last_fullsized":"2023-11-28T11:55:06.225222+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:25.424333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219748+0000","last_change":"2023-11-28T11:55:06.238161+0000","last_active":"2023-11-28T11:55:07.219748+0000","last_peered":"2023-11-28T11:55:07.219748+0000","last_clean":"2023-11-28T11:55:07.219748+0000","last_became_active":"2023-11-28T11:55:06.237891+0000","last_became_peered":"2023-11-28T11:55:06.237891+0000","last_unstale":"2023-11-28T11:55:07.219748+0000","last_undegraded":"2023-11-28T11:55:07.219748+0000","last_fullsized":"2023-11-28T11:55:07.219748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:38:31.234809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'3","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.240034+0000","last_change":"2023-11-28T11:55:05.840667+0000","last_active":"2023-11-28T11:55:06.240034+0000","last_peered":"2023-11-28T11:55:06.240034+0000","last_clean":"2023-11-28T11:55:06.240034+0000","last_became_active":"2023-11-28T11:55:05.840224+0000","last_became_peered":"2023-11-28T11:55:05.840224+0000","last_unstale":"2023-11-28T11:55:06.240034+0000","last_undegraded":"2023-11-28T11:55:06.240034+0000","last_fullsized":"2023-11-28T11:55:06.240034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:32:35.769637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.240910+0000","last_change":"2023-11-28T11:55:06.236209+0000","last_active":"2023-11-28T11:55:06.240910+0000","last_peered":"2023-11-28T11:55:06.240910+0000","last_clean":"2023-11-28T11:55:06.240910+0000","last_became_active":"2023-11-28T11:55:06.235841+0000","last_became_peered":"2023-11-28T11:55:06.235841+0000","last_unstale":"2023-11-28T11:55:06.240910+0000","last_undegraded":"2023-11-28T11:55:06.240910+0000","last_fullsized":"2023-11-28T11:55:06.240910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:57:30.229081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'6","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.043246+0000","last_change":"2023-11-28T11:55:05.839381+0000","last_active":"2023-11-28T11:55:08.043246+0000","last_peered":"2023-11-28T11:55:08.043246+0000","last_clean":"2023-11-28T11:55:08.043246+0000","last_became_active":"2023-11-28T11:55:05.839098+0000","last_became_peered":"2023-11-28T11:55:05.839098+0000","last_unstale":"2023-11-28T11:55:08.043246+0000","last_undegraded":"2023-11-28T11:55:08.043246+0000","last_fullsized":"2023-11-28T11:55:08.043246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:00:35.347876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.239776+0000","last_change":"2023-11-28T11:55:06.232344+0000","last_active":"2023-11-28T11:55:06.239776+0000","last_peered":"2023-11-28T11:55:06.239776+0000","last_clean":"2023-11-28T11:55:06.239776+0000","last_became_active":"2023-11-28T11:55:06.232059+0000","last_became_peered":"2023-11-28T11:55:06.232059+0000","last_unstale":"2023-11-28T11:55:06.239776+0000","last_undegraded":"2023-11-28T11:55:06.239776+0000","last_fullsized":"2023-11-28T11:55:06.239776+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:37.404513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219919+0000","last_change":"2023-11-28T11:55:05.844516+0000","last_active":"2023-11-28T11:55:07.219919+0000","last_peered":"2023-11-28T11:55:07.219919+0000","last_clean":"2023-11-28T11:55:07.219919+0000","last_became_active":"2023-11-28T11:55:05.844237+0000","last_became_peered":"2023-11-28T11:55:05.844237+0000","last_unstale":"2023-11-28T11:55:07.219919+0000","last_undegraded":"2023-11-28T11:55:07.219919+0000","last_fullsized":"2023-11-28T11:55:07.219919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:15.482934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.242764+0000","last_change":"2023-11-28T11:55:06.230810+0000","last_active":"2023-11-28T11:55:06.242764+0000","last_peered":"2023-11-28T11:55:06.242764+0000","last_clean":"2023-11-28T11:55:06.242764+0000","last_became_active":"2023-11-28T11:55:06.230486+0000","last_became_peered":"2023-11-28T11:55:06.230486+0000","last_unstale":"2023-11-28T11:55:06.242764+0000","last_undegraded":"2023-11-28T11:55:06.242764+0000","last_fullsized":"2023-11-28T11:55:06.242764+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:38.171273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.221853+0000","last_change":"2023-11-28T11:55:05.837851+0000","last_active":"2023-11-28T11:55:06.221853+0000","last_peered":"2023-11-28T11:55:06.221853+0000","last_clean":"2023-11-28T11:55:06.221853+0000","last_became_active":"2023-11-28T11:55:05.837519+0000","last_became_peered":"2023-11-28T11:55:05.837519+0000","last_unstale":"2023-11-28T11:55:06.221853+0000","last_undegraded":"2023-11-28T11:55:06.221853+0000","last_fullsized":"2023-11-28T11:55:06.221853+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:35.263973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219191+0000","last_change":"2023-11-28T11:55:06.233634+0000","last_active":"2023-11-28T11:55:07.219191+0000","last_peered":"2023-11-28T11:55:07.219191+0000","last_clean":"2023-11-28T11:55:07.219191+0000","last_became_active":"2023-11-28T11:55:06.233129+0000","last_became_peered":"2023-11-28T11:55:06.233129+0000","last_unstale":"2023-11-28T11:55:07.219191+0000","last_undegraded":"2023-11-28T11:55:07.219191+0000","last_fullsized":"2023-11-28T11:55:07.219191+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:13.482762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219417+0000","last_change":"2023-11-28T11:55:05.846919+0000","last_active":"2023-11-28T11:55:07.219417+0000","last_peered":"2023-11-28T11:55:07.219417+0000","last_clean":"2023-11-28T11:55:07.219417+0000","last_became_active":"2023-11-28T11:55:05.845929+0000","last_became_peered":"2023-11-28T11:55:05.845929+0000","last_unstale":"2023-11-28T11:55:07.219417+0000","last_undegraded":"2023-11-28T11:55:07.219417+0000","last_fullsized":"2023-11-28T11:55:07.219417+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:56.629606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.242670+0000","last_change":"2023-11-28T11:55:06.238581+0000","last_active":"2023-11-28T11:55:06.242670+0000","last_peered":"2023-11-28T11:55:06.242670+0000","last_clean":"2023-11-28T11:55:06.242670+0000","last_became_active":"2023-11-28T11:55:06.238284+0000","last_became_peered":"2023-11-28T11:55:06.238284+0000","last_unstale":"2023-11-28T11:55:06.242670+0000","last_undegraded":"2023-11-28T11:55:06.242670+0000","last_fullsized":"2023-11-28T11:55:06.242670+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:16.488151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'8","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.249533+0000","last_change":"2023-11-28T11:55:05.841540+0000","last_active":"2023-11-28T11:55:06.249533+0000","last_peered":"2023-11-28T11:55:06.249533+0000","last_clean":"2023-11-28T11:55:06.249533+0000","last_became_active":"2023-11-28T11:55:05.841256+0000","last_became_peered":"2023-11-28T11:55:05.841256+0000","last_unstale":"2023-11-28T11:55:06.249533+0000","last_undegraded":"2023-11-28T11:55:06.249533+0000","last_fullsized":"2023-11-28T11:55:06.249533+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:57:29.223863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.043202+0000","last_change":"2023-11-28T11:55:06.229492+0000","last_active":"2023-11-28T11:55:08.043202+0000","last_peered":"2023-11-28T11:55:08.043202+0000","last_clean":"2023-11-28T11:55:08.043202+0000","last_became_active":"2023-11-28T11:55:06.229225+0000","last_became_peered":"2023-11-28T11:55:06.229225+0000","last_unstale":"2023-11-28T11:55:08.043202+0000","last_undegraded":"2023-11-28T11:55:08.043202+0000","last_fullsized":"2023-11-28T11:55:08.043202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:16:59.469435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.043288+0000","last_change":"2023-11-28T11:55:05.847520+0000","last_active":"2023-11-28T11:55:08.043288+0000","last_peered":"2023-11-28T11:55:08.043288+0000","last_clean":"2023-11-28T11:55:08.043288+0000","last_became_active":"2023-11-28T11:55:05.847245+0000","last_became_peered":"2023-11-28T11:55:05.847245+0000","last_unstale":"2023-11-28T11:55:08.043288+0000","last_undegraded":"2023-11-28T11:55:08.043288+0000","last_fullsized":"2023-11-28T11:55:08.043288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:19:30.811950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.247959+0000","last_change":"2023-11-28T11:55:06.242958+0000","last_active":"2023-11-28T11:55:06.247959+0000","last_peered":"2023-11-28T11:55:06.247959+0000","last_clean":"2023-11-28T11:55:06.247959+0000","last_became_active":"2023-11-28T11:55:06.242674+0000","last_became_peered":"2023-11-28T11:55:06.242674+0000","last_unstale":"2023-11-28T11:55:06.247959+0000","last_undegraded":"2023-11-28T11:55:06.247959+0000","last_fullsized":"2023-11-28T11:55:06.247959+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:06.199582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221654+0000","last_change":"2023-11-28T11:55:05.839038+0000","last_active":"2023-11-28T11:55:07.221654+0000","last_peered":"2023-11-28T11:55:07.221654+0000","last_clean":"2023-11-28T11:55:07.221654+0000","last_became_active":"2023-11-28T11:55:05.838789+0000","last_became_peered":"2023-11-28T11:55:05.838789+0000","last_unstale":"2023-11-28T11:55:07.221654+0000","last_undegraded":"2023-11-28T11:55:07.221654+0000","last_fullsized":"2023-11-28T11:55:07.221654+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:39.576130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.243233+0000","last_change":"2023-11-28T11:55:06.238636+0000","last_active":"2023-11-28T11:55:06.243233+0000","last_peered":"2023-11-28T11:55:06.243233+0000","last_clean":"2023-11-28T11:55:06.243233+0000","last_became_active":"2023-11-28T11:55:06.238385+0000","last_became_peered":"2023-11-28T11:55:06.238385+0000","last_unstale":"2023-11-28T11:55:06.243233+0000","last_undegraded":"2023-11-28T11:55:06.243233+0000","last_fullsized":"2023-11-28T11:55:06.243233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:04.214382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220012+0000","last_change":"2023-11-28T11:55:05.836660+0000","last_active":"2023-11-28T11:55:07.220012+0000","last_peered":"2023-11-28T11:55:07.220012+0000","last_clean":"2023-11-28T11:55:07.220012+0000","last_became_active":"2023-11-28T11:55:05.836365+0000","last_became_peered":"2023-11-28T11:55:05.836365+0000","last_unstale":"2023-11-28T11:55:07.220012+0000","last_undegraded":"2023-11-28T11:55:07.220012+0000","last_fullsized":"2023-11-28T11:55:07.220012+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:36.399295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.242924+0000","last_change":"2023-11-28T11:55:06.236311+0000","last_active":"2023-11-28T11:55:06.242924+0000","last_peered":"2023-11-28T11:55:06.242924+0000","last_clean":"2023-11-28T11:55:06.242924+0000","last_became_active":"2023-11-28T11:55:06.236052+0000","last_became_peered":"2023-11-28T11:55:06.236052+0000","last_unstale":"2023-11-28T11:55:06.242924+0000","last_undegraded":"2023-11-28T11:55:06.242924+0000","last_fullsized":"2023-11-28T11:55:06.242924+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:53.533792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219962+0000","last_change":"2023-11-28T11:55:05.846545+0000","last_active":"2023-11-28T11:55:07.219962+0000","last_peered":"2023-11-28T11:55:07.219962+0000","last_clean":"2023-11-28T11:55:07.219962+0000","last_became_active":"2023-11-28T11:55:05.846217+0000","last_became_peered":"2023-11-28T11:55:05.846217+0000","last_unstale":"2023-11-28T11:55:07.219962+0000","last_undegraded":"2023-11-28T11:55:07.219962+0000","last_fullsized":"2023-11-28T11:55:07.219962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:57:29.223863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219489+0000","last_change":"2023-11-28T11:55:06.239234+0000","last_active":"2023-11-28T11:55:07.219489+0000","last_peered":"2023-11-28T11:55:07.219489+0000","last_clean":"2023-11-28T11:55:07.219489+0000","last_became_active":"2023-11-28T11:55:06.233952+0000","last_became_peered":"2023-11-28T11:55:06.233952+0000","last_unstale":"2023-11-28T11:55:07.219489+0000","last_undegraded":"2023-11-28T11:55:07.219489+0000","last_fullsized":"2023-11-28T11:55:07.219489+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:27.420410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219723+0000","last_change":"2023-11-28T11:55:05.847928+0000","last_active":"2023-11-28T11:55:07.219723+0000","last_peered":"2023-11-28T11:55:07.219723+0000","last_clean":"2023-11-28T11:55:07.219723+0000","last_became_active":"2023-11-28T11:55:05.847122+0000","last_became_peered":"2023-11-28T11:55:05.847122+0000","last_unstale":"2023-11-28T11:55:07.219723+0000","last_undegraded":"2023-11-28T11:55:07.219723+0000","last_fullsized":"2023-11-28T11:55:07.219723+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:18:32.190988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.334808+0000","last_change":"2023-11-28T11:55:06.223357+0000","last_active":"2023-11-28T11:55:08.334808+0000","last_peered":"2023-11-28T11:55:08.334808+0000","last_clean":"2023-11-28T11:55:08.334808+0000","last_became_active":"2023-11-28T11:55:06.223062+0000","last_became_peered":"2023-11-28T11:55:06.223062+0000","last_unstale":"2023-11-28T11:55:08.334808+0000","last_undegraded":"2023-11-28T11:55:08.334808+0000","last_fullsized":"2023-11-28T11:55:08.334808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:03:55.039319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220014+0000","last_change":"2023-11-28T11:55:05.840844+0000","last_active":"2023-11-28T11:55:07.220014+0000","last_peered":"2023-11-28T11:55:07.220014+0000","last_clean":"2023-11-28T11:55:07.220014+0000","last_became_active":"2023-11-28T11:55:05.839865+0000","last_became_peered":"2023-11-28T11:55:05.839865+0000","last_unstale":"2023-11-28T11:55:07.220014+0000","last_undegraded":"2023-11-28T11:55:07.220014+0000","last_fullsized":"2023-11-28T11:55:07.220014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:52.528575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.042663+0000","last_change":"2023-11-28T11:55:06.229916+0000","last_active":"2023-11-28T11:55:08.042663+0000","last_peered":"2023-11-28T11:55:08.042663+0000","last_clean":"2023-11-28T11:55:08.042663+0000","last_became_active":"2023-11-28T11:55:06.229418+0000","last_became_peered":"2023-11-28T11:55:06.229418+0000","last_unstale":"2023-11-28T11:55:08.042663+0000","last_undegraded":"2023-11-28T11:55:08.042663+0000","last_fullsized":"2023-11-28T11:55:08.042663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:16.529286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.224278+0000","last_change":"2023-11-28T11:55:05.841250+0000","last_active":"2023-11-28T11:55:06.224278+0000","last_peered":"2023-11-28T11:55:06.224278+0000","last_clean":"2023-11-28T11:55:06.224278+0000","last_became_active":"2023-11-28T11:55:05.840939+0000","last_became_peered":"2023-11-28T11:55:05.840939+0000","last_unstale":"2023-11-28T11:55:06.224278+0000","last_undegraded":"2023-11-28T11:55:06.224278+0000","last_fullsized":"2023-11-28T11:55:06.224278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:03.209165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.242008+0000","last_change":"2023-11-28T11:55:06.230328+0000","last_active":"2023-11-28T11:55:06.242008+0000","last_peered":"2023-11-28T11:55:06.242008+0000","last_clean":"2023-11-28T11:55:06.242008+0000","last_became_active":"2023-11-28T11:55:06.229070+0000","last_became_peered":"2023-11-28T11:55:06.229070+0000","last_unstale":"2023-11-28T11:55:06.242008+0000","last_undegraded":"2023-11-28T11:55:06.242008+0000","last_fullsized":"2023-11-28T11:55:06.242008+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:33.158785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.220512+0000","last_change":"2023-11-28T11:55:05.838579+0000","last_active":"2023-11-28T11:55:06.220512+0000","last_peered":"2023-11-28T11:55:06.220512+0000","last_clean":"2023-11-28T11:55:06.220512+0000","last_became_active":"2023-11-28T11:55:05.838216+0000","last_became_peered":"2023-11-28T11:55:05.838216+0000","last_unstale":"2023-11-28T11:55:06.220512+0000","last_undegraded":"2023-11-28T11:55:06.220512+0000","last_fullsized":"2023-11-28T11:55:06.220512+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:58.006330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220947+0000","last_change":"2023-11-28T11:55:06.238621+0000","last_active":"2023-11-28T11:55:07.220947+0000","last_peered":"2023-11-28T11:55:07.220947+0000","last_clean":"2023-11-28T11:55:07.220947+0000","last_became_active":"2023-11-28T11:55:06.238183+0000","last_became_peered":"2023-11-28T11:55:06.238183+0000","last_unstale":"2023-11-28T11:55:07.220947+0000","last_undegraded":"2023-11-28T11:55:07.220947+0000","last_fullsized":"2023-11-28T11:55:07.220947+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:13.482762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.224085+0000","last_change":"2023-11-28T11:55:05.847731+0000","last_active":"2023-11-28T11:55:06.224085+0000","last_peered":"2023-11-28T11:55:06.224085+0000","last_clean":"2023-11-28T11:55:06.224085+0000","last_became_active":"2023-11-28T11:55:05.847440+0000","last_became_peered":"2023-11-28T11:55:05.847440+0000","last_unstale":"2023-11-28T11:55:06.224085+0000","last_undegraded":"2023-11-28T11:55:06.224085+0000","last_fullsized":"2023-11-28T11:55:06.224085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:46:52.941096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:55:05.831362+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:55:05.831362+0000","last_peered":"2023-11-28T11:55:05.831362+0000","last_clean":"2023-11-28T11:55:05.831362+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:55:05.831362+0000","last_undegraded":"2023-11-28T11:55:05.831362+0000","last_fullsized":"2023-11-28T11:55:05.831362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219738+0000","last_change":"2023-11-28T11:55:06.220462+0000","last_active":"2023-11-28T11:55:07.219738+0000","last_peered":"2023-11-28T11:55:07.219738+0000","last_clean":"2023-11-28T11:55:07.219738+0000","last_became_active":"2023-11-28T11:55:06.220168+0000","last_became_peered":"2023-11-28T11:55:06.220168+0000","last_unstale":"2023-11-28T11:55:07.219738+0000","last_undegraded":"2023-11-28T11:55:07.219738+0000","last_fullsized":"2023-11-28T11:55:07.219738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:26.429551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.334577+0000","last_change":"2023-11-28T11:55:05.841163+0000","last_active":"2023-11-28T11:55:08.334577+0000","last_peered":"2023-11-28T11:55:08.334577+0000","last_clean":"2023-11-28T11:55:08.334577+0000","last_became_active":"2023-11-28T11:55:05.840902+0000","last_became_peered":"2023-11-28T11:55:05.840902+0000","last_unstale":"2023-11-28T11:55:08.334577+0000","last_undegraded":"2023-11-28T11:55:08.334577+0000","last_fullsized":"2023-11-28T11:55:08.334577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:02:14.056581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:55:05.831086+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:55:05.831086+0000","last_peered":"2023-11-28T11:55:05.831086+0000","last_clean":"2023-11-28T11:55:05.831086+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:55:05.831086+0000","last_undegraded":"2023-11-28T11:55:05.831086+0000","last_fullsized":"2023-11-28T11:55:05.831086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219436+0000","last_change":"2023-11-28T11:55:06.233817+0000","last_active":"2023-11-28T11:55:07.219436+0000","last_peered":"2023-11-28T11:55:07.219436+0000","last_clean":"2023-11-28T11:55:07.219436+0000","last_became_active":"2023-11-28T11:55:06.233532+0000","last_became_peered":"2023-11-28T11:55:06.233532+0000","last_unstale":"2023-11-28T11:55:07.219436+0000","last_undegraded":"2023-11-28T11:55:07.219436+0000","last_fullsized":"2023-11-28T11:55:07.219436+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:01:09.791004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221451+0000","last_change":"2023-11-28T11:55:05.845168+0000","last_active":"2023-11-28T11:55:07.221451+0000","last_peered":"2023-11-28T11:55:07.221451+0000","last_clean":"2023-11-28T11:55:07.221451+0000","last_became_active":"2023-11-28T11:55:05.844927+0000","last_became_peered":"2023-11-28T11:55:05.844927+0000","last_unstale":"2023-11-28T11:55:07.221451+0000","last_undegraded":"2023-11-28T11:55:07.221451+0000","last_fullsized":"2023-11-28T11:55:07.221451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:13.702760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.214007+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:55:06.214007+0000","last_peered":"2023-11-28T11:55:06.214007+0000","last_clean":"2023-11-28T11:55:06.214007+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:55:06.214007+0000","last_undegraded":"2023-11-28T11:55:06.214007+0000","last_fullsized":"2023-11-28T11:55:06.214007+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219586+0000","last_change":"2023-11-28T11:55:06.239420+0000","last_active":"2023-11-28T11:55:07.219586+0000","last_peered":"2023-11-28T11:55:07.219586+0000","last_clean":"2023-11-28T11:55:07.219586+0000","last_became_active":"2023-11-28T11:55:06.238684+0000","last_became_peered":"2023-11-28T11:55:06.238684+0000","last_unstale":"2023-11-28T11:55:07.219586+0000","last_undegraded":"2023-11-28T11:55:07.219586+0000","last_fullsized":"2023-11-28T11:55:07.219586+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:51.241072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.222001+0000","last_change":"2023-11-28T11:55:05.840188+0000","last_active":"2023-11-28T11:55:06.222001+0000","last_peered":"2023-11-28T11:55:06.222001+0000","last_clean":"2023-11-28T11:55:06.222001+0000","last_became_active":"2023-11-28T11:55:05.839877+0000","last_became_peered":"2023-11-28T11:55:05.839877+0000","last_unstale":"2023-11-28T11:55:06.222001+0000","last_undegraded":"2023-11-28T11:55:06.222001+0000","last_fullsized":"2023-11-28T11:55:06.222001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:47:37.190638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":31,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.213647+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:55:06.213647+0000","last_peered":"2023-11-28T11:55:06.213647+0000","last_clean":"2023-11-28T11:55:06.213647+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:55:06.213647+0000","last_undegraded":"2023-11-28T11:55:06.213647+0000","last_fullsized":"2023-11-28T11:55:06.213647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.240891+0000","last_change":"2023-11-28T11:55:06.236135+0000","last_active":"2023-11-28T11:55:06.240891+0000","last_peered":"2023-11-28T11:55:06.240891+0000","last_clean":"2023-11-28T11:55:06.240891+0000","last_became_active":"2023-11-28T11:55:06.235827+0000","last_became_peered":"2023-11-28T11:55:06.235827+0000","last_unstale":"2023-11-28T11:55:06.240891+0000","last_undegraded":"2023-11-28T11:55:06.240891+0000","last_fullsized":"2023-11-28T11:55:06.240891+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:46:53.946313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.334577+0000","last_change":"2023-11-28T11:55:05.839286+0000","last_active":"2023-11-28T11:55:08.334577+0000","last_peered":"2023-11-28T11:55:08.334577+0000","last_clean":"2023-11-28T11:55:08.334577+0000","last_became_active":"2023-11-28T11:55:05.837875+0000","last_became_peered":"2023-11-28T11:55:05.837875+0000","last_unstale":"2023-11-28T11:55:08.334577+0000","last_undegraded":"2023-11-28T11:55:08.334577+0000","last_fullsized":"2023-11-28T11:55:08.334577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:15.524068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":179,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:55:05.826226+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:55:05.826226+0000","last_peered":"2023-11-28T11:55:05.826226+0000","last_clean":"2023-11-28T11:55:05.826226+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:55:05.826226+0000","last_undegraded":"2023-11-28T11:55:05.826226+0000","last_fullsized":"2023-11-28T11:55:05.826226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.220764+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:55:06.220764+0000","last_peered":"2023-11-28T11:55:06.220764+0000","last_clean":"2023-11-28T11:55:06.220764+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:55:06.220764+0000","last_undegraded":"2023-11-28T11:55:06.220764+0000","last_fullsized":"2023-11-28T11:55:06.220764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.242398+0000","last_change":"2023-11-28T11:55:06.229218+0000","last_active":"2023-11-28T11:55:06.242398+0000","last_peered":"2023-11-28T11:55:06.242398+0000","last_clean":"2023-11-28T11:55:06.242398+0000","last_became_active":"2023-11-28T11:55:06.228480+0000","last_became_peered":"2023-11-28T11:55:06.228480+0000","last_unstale":"2023-11-28T11:55:06.242398+0000","last_undegraded":"2023-11-28T11:55:06.242398+0000","last_fullsized":"2023-11-28T11:55:06.242398+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:09:23.634439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.222817+0000","last_change":"2023-11-28T11:55:05.840489+0000","last_active":"2023-11-28T11:55:06.222817+0000","last_peered":"2023-11-28T11:55:06.222817+0000","last_clean":"2023-11-28T11:55:06.222817+0000","last_became_active":"2023-11-28T11:55:05.839871+0000","last_became_peered":"2023-11-28T11:55:05.839871+0000","last_unstale":"2023-11-28T11:55:06.222817+0000","last_undegraded":"2023-11-28T11:55:06.222817+0000","last_fullsized":"2023-11-28T11:55:06.222817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:18:06.140768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:55:05.826979+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:55:05.826979+0000","last_peered":"2023-11-28T11:55:05.826979+0000","last_clean":"2023-11-28T11:55:05.826979+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:55:05.826979+0000","last_undegraded":"2023-11-28T11:55:05.826979+0000","last_fullsized":"2023-11-28T11:55:05.826979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.248187+0000","last_change":"2023-11-28T11:55:06.244625+0000","last_active":"2023-11-28T11:55:06.248187+0000","last_peered":"2023-11-28T11:55:06.248187+0000","last_clean":"2023-11-28T11:55:06.248187+0000","last_became_active":"2023-11-28T11:55:06.244355+0000","last_became_peered":"2023-11-28T11:55:06.244355+0000","last_unstale":"2023-11-28T11:55:06.248187+0000","last_undegraded":"2023-11-28T11:55:06.248187+0000","last_fullsized":"2023-11-28T11:55:06.248187+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:02.211046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.454084+0000","last_change":"2023-11-28T11:55:05.846669+0000","last_active":"2023-11-28T11:55:08.454084+0000","last_peered":"2023-11-28T11:55:08.454084+0000","last_clean":"2023-11-28T11:55:08.454084+0000","last_became_active":"2023-11-28T11:55:05.846317+0000","last_became_peered":"2023-11-28T11:55:05.846317+0000","last_unstale":"2023-11-28T11:55:08.454084+0000","last_undegraded":"2023-11-28T11:55:08.454084+0000","last_fullsized":"2023-11-28T11:55:08.454084+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:46:52.941096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.213063+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:55:06.213063+0000","last_peered":"2023-11-28T11:55:06.213063+0000","last_clean":"2023-11-28T11:55:06.213063+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:55:06.213063+0000","last_undegraded":"2023-11-28T11:55:06.213063+0000","last_fullsized":"2023-11-28T11:55:06.213063+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.236017+0000","last_change":"2023-11-28T11:55:06.228062+0000","last_active":"2023-11-28T11:55:06.236017+0000","last_peered":"2023-11-28T11:55:06.236017+0000","last_clean":"2023-11-28T11:55:06.236017+0000","last_became_active":"2023-11-28T11:55:06.227802+0000","last_became_peered":"2023-11-28T11:55:06.227802+0000","last_unstale":"2023-11-28T11:55:06.236017+0000","last_undegraded":"2023-11-28T11:55:06.236017+0000","last_fullsized":"2023-11-28T11:55:06.236017+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:10:20.888745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220661+0000","last_change":"2023-11-28T11:55:05.846063+0000","last_active":"2023-11-28T11:55:07.220661+0000","last_peered":"2023-11-28T11:55:07.220661+0000","last_clean":"2023-11-28T11:55:07.220661+0000","last_became_active":"2023-11-28T11:55:05.845760+0000","last_became_peered":"2023-11-28T11:55:05.845760+0000","last_unstale":"2023-11-28T11:55:07.220661+0000","last_undegraded":"2023-11-28T11:55:07.220661+0000","last_fullsized":"2023-11-28T11:55:07.220661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:13:02.340103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-28T11:55:05.826606+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:55:05.826606+0000","last_peered":"2023-11-28T11:55:05.826606+0000","last_clean":"2023-11-28T11:55:05.826606+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:55:05.826606+0000","last_undegraded":"2023-11-28T11:55:05.826606+0000","last_fullsized":"2023-11-28T11:55:05.826606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9732,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362108,"statfs":{"total":96636764160,"available":96626798592,"internally_reserved":0,"allocated":1044480,"data_stored":791128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.84799999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.65700000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.1100000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.97699999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.753},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.88}]},{"osd":5,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.93100000000000005}]},{"osd":6,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.83199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8580,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363260,"statfs":{"total":96636764160,"available":96627978240,"internally_reserved":0,"allocated":454656,"data_stored":201326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.89200000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.84399999999999997}]},{"osd":2,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.92700000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.181},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.02}]},{"osd":5,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.1120000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.153}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8656,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363184,"statfs":{"total":96636764160,"available":96627900416,"internally_reserved":0,"allocated":466944,"data_stored":208699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.75800000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.0429999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.93700000000000006}]},{"osd":3,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.84899999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.117}]},{"osd":6,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.0089999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.96899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8792,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363048,"statfs":{"total":96636764160,"available":96627761152,"internally_reserved":0,"allocated":475136,"data_stored":210177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.64500000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.80200000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.93999999999999995}]},{"osd":3,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.91300000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.875}]},{"osd":6,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.137},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.3100000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.198},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.2230000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8724,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363116,"statfs":{"total":96636764160,"available":96627830784,"internally_reserved":0,"allocated":471040,"data_stored":208265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.46500000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.91300000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.497}]},{"osd":4,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":0.80900000000000005}]},{"osd":5,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.875}]},{"osd":6,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.0629999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.95699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8536,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363304,"statfs":{"total":96636764160,"available":96628023296,"internally_reserved":0,"allocated":475136,"data_stored":209213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.75700000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.86099999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.056},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.089}]},{"osd":4,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.234},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.1279999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.405}]},{"osd":6,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.006},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.2689999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":1.4630000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13832,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":12800,"kb_avail":94358008,"statfs":{"total":96636764160,"available":96622600192,"internally_reserved":0,"allocated":1048576,"data_stored":792094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13107200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.98999999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.1439999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.56200000000000006}]},{"osd":4,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.29,"5min":2.29,"15min":2.29},"last":1.0509999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.228},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.024}]},{"osd":6,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.96799999999999997}]},{"osd":7,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":3.0209999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.81499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12804,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":12352,"kb_avail":94359036,"statfs":{"total":96636764160,"available":96623652864,"internally_reserved":0,"allocated":454656,"data_stored":201690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12648448},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.58699999999999997}]},{"osd":2,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.89000000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.0369999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.147}]},{"osd":5,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.93400000000000005}]},{"osd":6,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.242},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.171}]},{"osd":7,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.272},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.196}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:55:14.690 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:55:14.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.815+0000 7f74a9908700 1 Processor -- start 2023-11-28T11:55:14.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.815+0000 7f74a9908700 1 -- start start 2023-11-28T11:55:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a9908700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a41510d0 0x7f74a415b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a9908700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a40c9010 con 0x7f74a4069c40 2023-11-28T11:55:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a9908700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a40c92f0 con 0x7f74a40c98a0 2023-11-28T11:55:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a9908700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40c95d0 con 0x7f74a41510d0 2023-11-28T11:55:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a27fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f74a4069c40 0x7f74a40b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50084/0 (socket says 172.21.15.50:50084) 2023-11-28T11:55:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a27fc700 1 -- 172.21.15.50:0/233320956 learned_addr learned my addr 172.21.15.50:0/233320956 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a2ffd700 1 --2- 172.21.15.50:0/233320956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a41510d0 0x7f74a415b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 -- 172.21.15.50:0/233320956 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388521058 0 0) 0x7f74a40c9010 con 0x7f74a4069c40 2023-11-28T11:55:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 -- 172.21.15.50:0/233320956 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74900035d0 con 0x7f74a4069c40 2023-11-28T11:55:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 -- 172.21.15.50:0/233320956 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 710758753 0 0) 0x7f74900035d0 con 0x7f74a4069c40 2023-11-28T11:55:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 -- 172.21.15.50:0/233320956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a41510d0 msgr2=0x7f74a415b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 --2- 172.21.15.50:0/233320956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a41510d0 0x7f74a415b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 -- 172.21.15.50:0/233320956 >> v1:172.21.15.192:6789/0 conn(0x7f74a40c98a0 legacy=0x7f74a4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 -- 172.21.15.50:0/233320956 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a4070170 con 0x7f74a4069c40 2023-11-28T11:55:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 -- 172.21.15.50:0/233320956 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f7494001670 con 0x7f74a4069c40 2023-11-28T11:55:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 -- 172.21.15.50:0/233320956 >> v1:172.21.15.50:6789/0 conn(0x7f74a4069c40 legacy=0x7f74a40b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 --2- 172.21.15.50:0/233320956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a41510d0 0x7f7490003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 --2- 172.21.15.50:0/233320956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7490003f90 0x7f7490004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 --2- 172.21.15.50:0/233320956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7490004db0 0x7f7490005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 -- 172.21.15.50:0/233320956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40c95d0 con 0x7f7490004db0 2023-11-28T11:55:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 -- 172.21.15.50:0/233320956 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749000bae0 con 0x7f7490003f90 2023-11-28T11:55:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 -- 172.21.15.50:0/233320956 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749000bca0 con 0x7f74a41510d0 2023-11-28T11:55:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a37fe700 1 --2- 172.21.15.50:0/233320956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7490004db0 0x7f7490005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a27fc700 1 --2- 172.21.15.50:0/233320956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7490003f90 0x7f7490004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a2ffd700 1 --2- 172.21.15.50:0/233320956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a41510d0 0x7f7490003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a37fe700 1 -- 172.21.15.50:0/233320956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a41510d0 msgr2=0x7f7490003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a37fe700 1 --2- 172.21.15.50:0/233320956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a41510d0 0x7f7490003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a37fe700 1 -- 172.21.15.50:0/233320956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7490003f90 msgr2=0x7f7490004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a37fe700 1 --2- 172.21.15.50:0/233320956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7490003f90 0x7f7490004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a37fe700 1 -- 172.21.15.50:0/233320956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74900035d0 con 0x7f7490004db0 2023-11-28T11:55:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a37fe700 1 --2- 172.21.15.50:0/233320956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7490004db0 0x7f7490005220 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f749c00c260 tx=0x7f74900058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391547bb63dc6c8d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 -- 172.21.15.50:0/233320956 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c001e70 con 0x7f7490004db0 2023-11-28T11:55:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 -- 172.21.15.50:0/233320956 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c00ce20 con 0x7f7490004db0 2023-11-28T11:55:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.819+0000 7f74a1ffb700 1 -- 172.21.15.50:0/233320956 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c012660 con 0x7f7490004db0 2023-11-28T11:55:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.823+0000 7f74a9908700 1 -- 172.21.15.50:0/233320956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7490004db0 msgr2=0x7f7490005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.823+0000 7f74a9908700 1 --2- 172.21.15.50:0/233320956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7490004db0 0x7f7490005220 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f749c00c260 tx=0x7f74900058a0 comp rx=0 tx=0).stop 2023-11-28T11:55:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.823+0000 7f74a37fe700 1 -- 172.21.15.50:0/233320956 reap_dead start 2023-11-28T11:55:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.823+0000 7f74a9908700 1 -- 172.21.15.50:0/233320956 shutdown_connections 2023-11-28T11:55:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.823+0000 7f74a9908700 1 -- 172.21.15.50:0/233320956 >> 172.21.15.50:0/233320956 conn(0x7f74a406caf0 msgr2=0x7f74a40ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.823+0000 7f74a9908700 1 -- 172.21.15.50:0/233320956 shutdown_connections 2023-11-28T11:55:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.823+0000 7f74a9908700 1 -- 172.21.15.50:0/233320956 wait complete. 2023-11-28T11:55:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a9908700 1 Processor -- start 2023-11-28T11:55:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a9908700 1 -- start start 2023-11-28T11:55:14.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a9908700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7490004db0 0x7f74a41e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a9908700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a4145e00 0x7f74a414d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a9908700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4159140 0x7f74a41595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a9908700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4159af0 con 0x7f74a4159140 2023-11-28T11:55:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a9908700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a41e52c0 con 0x7f7490004db0 2023-11-28T11:55:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a9908700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a41e4460 con 0x7f74a4145e00 2023-11-28T11:55:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4159140 0x7f74a41595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a27fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a4145e00 0x7f74a414d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a2ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7490004db0 0x7f74a41e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a37fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4159140 0x7f74a41595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49098/0 (socket says 172.21.15.50:49098) 2023-11-28T11:55:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a37fe700 1 -- 172.21.15.50:0/1239484516 learned_addr learned my addr 172.21.15.50:0/1239484516 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a37fe700 1 -- 172.21.15.50:0/1239484516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a4145e00 msgr2=0x7f74a414d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a37fe700 1 --2- 172.21.15.50:0/1239484516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a4145e00 0x7f74a414d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a37fe700 1 -- 172.21.15.50:0/1239484516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7490004db0 msgr2=0x7f74a41e3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a37fe700 1 --2- 172.21.15.50:0/1239484516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7490004db0 0x7f74a41e3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a37fe700 1 -- 172.21.15.50:0/1239484516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a415b260 con 0x7f74a4159140 2023-11-28T11:55:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f74a37fe700 1 --2- 172.21.15.50:0/1239484516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4159140 0x7f74a41595b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f749c00c850 tx=0x7f749c0015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.827+0000 7f749bfff700 1 -- 172.21.15.50:0/1239484516 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c003c30 con 0x7f74a4159140 2023-11-28T11:55:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.831+0000 7f749bfff700 1 -- 172.21.15.50:0/1239484516 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c003d90 con 0x7f74a4159140 2023-11-28T11:55:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.831+0000 7f74a9908700 1 -- 172.21.15.50:0/1239484516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a41514a0 con 0x7f74a4159140 2023-11-28T11:55:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.831+0000 7f749bfff700 1 -- 172.21.15.50:0/1239484516 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c005250 con 0x7f74a4159140 2023-11-28T11:55:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.831+0000 7f74a9908700 1 -- 172.21.15.50:0/1239484516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a415b3f0 con 0x7f74a4159140 2023-11-28T11:55:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.831+0000 7f74a9908700 1 -- 172.21.15.50:0/1239484516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a414dc80 con 0x7f74a4159140 2023-11-28T11:55:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.831+0000 7f749bfff700 1 -- 172.21.15.50:0/1239484516 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f749c02d070 con 0x7f74a4159140 2023-11-28T11:55:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.831+0000 7f749bfff700 1 --2- 172.21.15.50:0/1239484516 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7484064ee0 0x7f7484067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.831+0000 7f749bfff700 1 -- 172.21.15.50:0/1239484516 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f749c083670 con 0x7f74a4159140 2023-11-28T11:55:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.831+0000 7f74a2ffd700 1 --2- 172.21.15.50:0/1239484516 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7484064ee0 0x7f7484067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:14.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.835+0000 7f74a2ffd700 1 --2- 172.21.15.50:0/1239484516 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7484064ee0 0x7f7484067390 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f748c009c70 tx=0x7f748c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:14.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:14.839+0000 7f749bfff700 1 -- 172.21.15.50:0/1239484516 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f749c0515e0 con 0x7f74a4159140 2023-11-28T11:55:15.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.003+0000 7f74a9908700 1 -- 172.21.15.50:0/1239484516 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74a4072500 con 0x7f7484064ee0 2023-11-28T11:55:15.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.015+0000 7f749bfff700 1 -- 172.21.15.50:0/1239484516 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309649 (secure 0 0 0) 0x7f74a4072500 con 0x7f7484064ee0 2023-11-28T11:55:15.023 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:15.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.023+0000 7f74a9908700 1 -- 172.21.15.50:0/1239484516 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7484064ee0 msgr2=0x7f7484067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:15.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.023+0000 7f74a9908700 1 --2- 172.21.15.50:0/1239484516 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7484064ee0 0x7f7484067390 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f748c009c70 tx=0x7f748c009240 comp rx=0 tx=0).stop 2023-11-28T11:55:15.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.023+0000 7f74a9908700 1 -- 172.21.15.50:0/1239484516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4159140 msgr2=0x7f74a41595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:15.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.023+0000 7f74a9908700 1 --2- 172.21.15.50:0/1239484516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4159140 0x7f74a41595b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f749c00c850 tx=0x7f749c0015b0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.023+0000 7f74a9908700 1 -- 172.21.15.50:0/1239484516 shutdown_connections 2023-11-28T11:55:15.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.023+0000 7f74a9908700 1 --2- 172.21.15.50:0/1239484516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74a4159140 0x7f74a41595b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.023+0000 7f74a9908700 1 --2- 172.21.15.50:0/1239484516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a4145e00 0x7f74a414d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.023+0000 7f74a9908700 1 --2- 172.21.15.50:0/1239484516 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7484064ee0 0x7f7484067390 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.023+0000 7f74a9908700 1 --2- 172.21.15.50:0/1239484516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7490004db0 0x7f74a41e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.023+0000 7f74a9908700 1 -- 172.21.15.50:0/1239484516 >> 172.21.15.50:0/1239484516 conn(0x7f74a406caf0 msgr2=0x7f74a406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:15.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.023+0000 7f74a9908700 1 -- 172.21.15.50:0/1239484516 shutdown_connections 2023-11-28T11:55:15.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.023+0000 7f74a9908700 1 -- 172.21.15.50:0/1239484516 wait complete. 2023-11-28T11:55:15.027 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:55:15.039 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-11-28T11:55:14.902743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":79768,"kb_used_data":4824,"kb_used_omap":0,"kb_used_meta":74880,"kb_avail":754894952,"statfs":{"total":773094113280,"available":773012430848,"internally_reserved":0,"allocated":4939776,"data_stored":2850484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":76677120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.697800"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.956599+0000","last_change":"2023-11-28T11:55:06.236827+0000","last_active":"2023-11-28T11:55:08.956599+0000","last_peered":"2023-11-28T11:55:08.956599+0000","last_clean":"2023-11-28T11:55:08.956599+0000","last_became_active":"2023-11-28T11:55:06.236509+0000","last_became_peered":"2023-11-28T11:55:06.236509+0000","last_unstale":"2023-11-28T11:55:08.956599+0000","last_undegraded":"2023-11-28T11:55:08.956599+0000","last_fullsized":"2023-11-28T11:55:08.956599+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:57.634824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220166+0000","last_change":"2023-11-28T11:55:06.231044+0000","last_active":"2023-11-28T11:55:07.220166+0000","last_peered":"2023-11-28T11:55:07.220166+0000","last_clean":"2023-11-28T11:55:07.220166+0000","last_became_active":"2023-11-28T11:55:06.230776+0000","last_became_peered":"2023-11-28T11:55:06.230776+0000","last_unstale":"2023-11-28T11:55:07.220166+0000","last_undegraded":"2023-11-28T11:55:07.220166+0000","last_fullsized":"2023-11-28T11:55:07.220166+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:14.707977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221296+0000","last_change":"2023-11-28T11:55:06.230033+0000","last_active":"2023-11-28T11:55:07.221296+0000","last_peered":"2023-11-28T11:55:07.221296+0000","last_clean":"2023-11-28T11:55:07.221296+0000","last_became_active":"2023-11-28T11:55:06.229683+0000","last_became_peered":"2023-11-28T11:55:06.229683+0000","last_unstale":"2023-11-28T11:55:07.221296+0000","last_undegraded":"2023-11-28T11:55:07.221296+0000","last_fullsized":"2023-11-28T11:55:07.221296+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:26:34.964906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951462+0000","last_change":"2023-11-28T11:55:06.242575+0000","last_active":"2023-11-28T11:55:08.951462+0000","last_peered":"2023-11-28T11:55:08.951462+0000","last_clean":"2023-11-28T11:55:08.951462+0000","last_became_active":"2023-11-28T11:55:06.242214+0000","last_became_peered":"2023-11-28T11:55:06.242214+0000","last_unstale":"2023-11-28T11:55:08.951462+0000","last_undegraded":"2023-11-28T11:55:08.951462+0000","last_fullsized":"2023-11-28T11:55:08.951462+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:38:31.234809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220448+0000","last_change":"2023-11-28T11:55:06.226876+0000","last_active":"2023-11-28T11:55:07.220448+0000","last_peered":"2023-11-28T11:55:07.220448+0000","last_clean":"2023-11-28T11:55:07.220448+0000","last_became_active":"2023-11-28T11:55:06.226566+0000","last_became_peered":"2023-11-28T11:55:06.226566+0000","last_unstale":"2023-11-28T11:55:07.220448+0000","last_undegraded":"2023-11-28T11:55:07.220448+0000","last_fullsized":"2023-11-28T11:55:07.220448+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:40.581348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219371+0000","last_change":"2023-11-28T11:55:06.233755+0000","last_active":"2023-11-28T11:55:07.219371+0000","last_peered":"2023-11-28T11:55:07.219371+0000","last_clean":"2023-11-28T11:55:07.219371+0000","last_became_active":"2023-11-28T11:55:06.233482+0000","last_became_peered":"2023-11-28T11:55:06.233482+0000","last_unstale":"2023-11-28T11:55:07.219371+0000","last_undegraded":"2023-11-28T11:55:07.219371+0000","last_fullsized":"2023-11-28T11:55:07.219371+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:16.495251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.956151+0000","last_change":"2023-11-28T11:55:06.226370+0000","last_active":"2023-11-28T11:55:08.956151+0000","last_peered":"2023-11-28T11:55:08.956151+0000","last_clean":"2023-11-28T11:55:08.956151+0000","last_became_active":"2023-11-28T11:55:06.226064+0000","last_became_peered":"2023-11-28T11:55:06.226064+0000","last_unstale":"2023-11-28T11:55:08.956151+0000","last_undegraded":"2023-11-28T11:55:08.956151+0000","last_fullsized":"2023-11-28T11:55:08.956151+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:32.761671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951187+0000","last_change":"2023-11-28T11:55:06.244625+0000","last_active":"2023-11-28T11:55:08.951187+0000","last_peered":"2023-11-28T11:55:08.951187+0000","last_clean":"2023-11-28T11:55:08.951187+0000","last_became_active":"2023-11-28T11:55:06.244350+0000","last_became_peered":"2023-11-28T11:55:06.244350+0000","last_unstale":"2023-11-28T11:55:08.951187+0000","last_undegraded":"2023-11-28T11:55:08.951187+0000","last_fullsized":"2023-11-28T11:55:08.951187+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:01:09.791004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951603+0000","last_change":"2023-11-28T11:55:06.228384+0000","last_active":"2023-11-28T11:55:08.951603+0000","last_peered":"2023-11-28T11:55:08.951603+0000","last_clean":"2023-11-28T11:55:08.951603+0000","last_became_active":"2023-11-28T11:55:06.228071+0000","last_became_peered":"2023-11-28T11:55:06.228071+0000","last_unstale":"2023-11-28T11:55:08.951603+0000","last_undegraded":"2023-11-28T11:55:08.951603+0000","last_fullsized":"2023-11-28T11:55:08.951603+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:02:09.032569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951535+0000","last_change":"2023-11-28T11:55:06.242602+0000","last_active":"2023-11-28T11:55:08.951535+0000","last_peered":"2023-11-28T11:55:08.951535+0000","last_clean":"2023-11-28T11:55:08.951535+0000","last_became_active":"2023-11-28T11:55:06.242314+0000","last_became_peered":"2023-11-28T11:55:06.242314+0000","last_unstale":"2023-11-28T11:55:08.951535+0000","last_undegraded":"2023-11-28T11:55:08.951535+0000","last_fullsized":"2023-11-28T11:55:08.951535+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:26:34.964906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951513+0000","last_change":"2023-11-28T11:55:06.231199+0000","last_active":"2023-11-28T11:55:08.951513+0000","last_peered":"2023-11-28T11:55:08.951513+0000","last_clean":"2023-11-28T11:55:08.951513+0000","last_became_active":"2023-11-28T11:55:06.230951+0000","last_became_peered":"2023-11-28T11:55:06.230951+0000","last_unstale":"2023-11-28T11:55:08.951513+0000","last_undegraded":"2023-11-28T11:55:08.951513+0000","last_fullsized":"2023-11-28T11:55:08.951513+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:16.495251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220157+0000","last_change":"2023-11-28T11:55:06.229571+0000","last_active":"2023-11-28T11:55:07.220157+0000","last_peered":"2023-11-28T11:55:07.220157+0000","last_clean":"2023-11-28T11:55:07.220157+0000","last_became_active":"2023-11-28T11:55:06.229283+0000","last_became_peered":"2023-11-28T11:55:06.229283+0000","last_unstale":"2023-11-28T11:55:07.220157+0000","last_undegraded":"2023-11-28T11:55:07.220157+0000","last_fullsized":"2023-11-28T11:55:07.220157+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:57.634824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.042863+0000","last_change":"2023-11-28T11:55:06.240644+0000","last_active":"2023-11-28T11:55:08.042863+0000","last_peered":"2023-11-28T11:55:08.042863+0000","last_clean":"2023-11-28T11:55:08.042863+0000","last_became_active":"2023-11-28T11:55:06.240276+0000","last_became_peered":"2023-11-28T11:55:06.240276+0000","last_unstale":"2023-11-28T11:55:08.042863+0000","last_undegraded":"2023-11-28T11:55:08.042863+0000","last_fullsized":"2023-11-28T11:55:08.042863+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:38:21.378947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951378+0000","last_change":"2023-11-28T11:55:06.229308+0000","last_active":"2023-11-28T11:55:08.951378+0000","last_peered":"2023-11-28T11:55:08.951378+0000","last_clean":"2023-11-28T11:55:08.951378+0000","last_became_active":"2023-11-28T11:55:06.229033+0000","last_became_peered":"2023-11-28T11:55:06.229033+0000","last_unstale":"2023-11-28T11:55:08.951378+0000","last_undegraded":"2023-11-28T11:55:08.951378+0000","last_fullsized":"2023-11-28T11:55:08.951378+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:50:36.583187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219295+0000","last_change":"2023-11-28T11:55:06.232701+0000","last_active":"2023-11-28T11:55:07.219295+0000","last_peered":"2023-11-28T11:55:07.219295+0000","last_clean":"2023-11-28T11:55:07.219295+0000","last_became_active":"2023-11-28T11:55:06.227192+0000","last_became_peered":"2023-11-28T11:55:06.227192+0000","last_unstale":"2023-11-28T11:55:07.219295+0000","last_undegraded":"2023-11-28T11:55:07.219295+0000","last_fullsized":"2023-11-28T11:55:07.219295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:43:02.719592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.959024+0000","last_change":"2023-11-28T11:55:06.235977+0000","last_active":"2023-11-28T11:55:08.959024+0000","last_peered":"2023-11-28T11:55:08.959024+0000","last_clean":"2023-11-28T11:55:08.959024+0000","last_became_active":"2023-11-28T11:55:06.235454+0000","last_became_peered":"2023-11-28T11:55:06.235454+0000","last_unstale":"2023-11-28T11:55:08.959024+0000","last_undegraded":"2023-11-28T11:55:08.959024+0000","last_fullsized":"2023-11-28T11:55:08.959024+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:44:59.098222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221451+0000","last_change":"2023-11-28T11:55:06.219207+0000","last_active":"2023-11-28T11:55:07.221451+0000","last_peered":"2023-11-28T11:55:07.221451+0000","last_clean":"2023-11-28T11:55:07.221451+0000","last_became_active":"2023-11-28T11:55:06.218885+0000","last_became_peered":"2023-11-28T11:55:06.218885+0000","last_unstale":"2023-11-28T11:55:07.221451+0000","last_undegraded":"2023-11-28T11:55:07.221451+0000","last_fullsized":"2023-11-28T11:55:07.221451+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:07:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221307+0000","last_change":"2023-11-28T11:55:06.231298+0000","last_active":"2023-11-28T11:55:07.221307+0000","last_peered":"2023-11-28T11:55:07.221307+0000","last_clean":"2023-11-28T11:55:07.221307+0000","last_became_active":"2023-11-28T11:55:06.231005+0000","last_became_peered":"2023-11-28T11:55:06.231005+0000","last_unstale":"2023-11-28T11:55:07.221307+0000","last_undegraded":"2023-11-28T11:55:07.221307+0000","last_fullsized":"2023-11-28T11:55:07.221307+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:38:31.234809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.959221+0000","last_change":"2023-11-28T11:55:06.236171+0000","last_active":"2023-11-28T11:55:08.959221+0000","last_peered":"2023-11-28T11:55:08.959221+0000","last_clean":"2023-11-28T11:55:08.959221+0000","last_became_active":"2023-11-28T11:55:06.235794+0000","last_became_peered":"2023-11-28T11:55:06.235794+0000","last_unstale":"2023-11-28T11:55:08.959221+0000","last_undegraded":"2023-11-28T11:55:08.959221+0000","last_fullsized":"2023-11-28T11:55:08.959221+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:38:51.726308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.043178+0000","last_change":"2023-11-28T11:55:06.231263+0000","last_active":"2023-11-28T11:55:08.043178+0000","last_peered":"2023-11-28T11:55:08.043178+0000","last_clean":"2023-11-28T11:55:08.043178+0000","last_became_active":"2023-11-28T11:55:06.230943+0000","last_became_peered":"2023-11-28T11:55:06.230943+0000","last_unstale":"2023-11-28T11:55:08.043178+0000","last_undegraded":"2023-11-28T11:55:08.043178+0000","last_fullsized":"2023-11-28T11:55:08.043178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:16:11.448012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219425+0000","last_change":"2023-11-28T11:55:06.238526+0000","last_active":"2023-11-28T11:55:07.219425+0000","last_peered":"2023-11-28T11:55:07.219425+0000","last_clean":"2023-11-28T11:55:07.219425+0000","last_became_active":"2023-11-28T11:55:06.238292+0000","last_became_peered":"2023-11-28T11:55:06.238292+0000","last_unstale":"2023-11-28T11:55:07.219425+0000","last_undegraded":"2023-11-28T11:55:07.219425+0000","last_fullsized":"2023-11-28T11:55:07.219425+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:26:34.964906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951399+0000","last_change":"2023-11-28T11:55:06.242940+0000","last_active":"2023-11-28T11:55:08.951399+0000","last_peered":"2023-11-28T11:55:08.951399+0000","last_clean":"2023-11-28T11:55:08.951399+0000","last_became_active":"2023-11-28T11:55:06.242633+0000","last_became_peered":"2023-11-28T11:55:06.242633+0000","last_unstale":"2023-11-28T11:55:08.951399+0000","last_undegraded":"2023-11-28T11:55:08.951399+0000","last_fullsized":"2023-11-28T11:55:08.951399+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:33.691957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.959106+0000","last_change":"2023-11-28T11:55:06.228908+0000","last_active":"2023-11-28T11:55:08.959106+0000","last_peered":"2023-11-28T11:55:08.959106+0000","last_clean":"2023-11-28T11:55:08.959106+0000","last_became_active":"2023-11-28T11:55:06.228308+0000","last_became_peered":"2023-11-28T11:55:06.228308+0000","last_unstale":"2023-11-28T11:55:08.959106+0000","last_undegraded":"2023-11-28T11:55:08.959106+0000","last_fullsized":"2023-11-28T11:55:08.959106+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:32:36.774854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.959063+0000","last_change":"2023-11-28T11:55:06.240015+0000","last_active":"2023-11-28T11:55:08.959063+0000","last_peered":"2023-11-28T11:55:08.959063+0000","last_clean":"2023-11-28T11:55:08.959063+0000","last_became_active":"2023-11-28T11:55:06.239754+0000","last_became_peered":"2023-11-28T11:55:06.239754+0000","last_unstale":"2023-11-28T11:55:08.959063+0000","last_undegraded":"2023-11-28T11:55:08.959063+0000","last_fullsized":"2023-11-28T11:55:08.959063+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:47:38.195856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.959301+0000","last_change":"2023-11-28T11:55:06.238332+0000","last_active":"2023-11-28T11:55:08.959301+0000","last_peered":"2023-11-28T11:55:08.959301+0000","last_clean":"2023-11-28T11:55:08.959301+0000","last_became_active":"2023-11-28T11:55:06.237099+0000","last_became_peered":"2023-11-28T11:55:06.237099+0000","last_unstale":"2023-11-28T11:55:08.959301+0000","last_undegraded":"2023-11-28T11:55:08.959301+0000","last_fullsized":"2023-11-28T11:55:08.959301+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:18:07.145986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.043204+0000","last_change":"2023-11-28T11:55:06.235070+0000","last_active":"2023-11-28T11:55:08.043204+0000","last_peered":"2023-11-28T11:55:08.043204+0000","last_clean":"2023-11-28T11:55:08.043204+0000","last_became_active":"2023-11-28T11:55:06.234829+0000","last_became_peered":"2023-11-28T11:55:06.234829+0000","last_unstale":"2023-11-28T11:55:08.043204+0000","last_undegraded":"2023-11-28T11:55:08.043204+0000","last_fullsized":"2023-11-28T11:55:08.043204+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:18:45.335246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221447+0000","last_change":"2023-11-28T11:55:06.220711+0000","last_active":"2023-11-28T11:55:07.221447+0000","last_peered":"2023-11-28T11:55:07.221447+0000","last_clean":"2023-11-28T11:55:07.221447+0000","last_became_active":"2023-11-28T11:55:06.218889+0000","last_became_peered":"2023-11-28T11:55:06.218889+0000","last_unstale":"2023-11-28T11:55:07.221447+0000","last_undegraded":"2023-11-28T11:55:07.221447+0000","last_fullsized":"2023-11-28T11:55:07.221447+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:09:23.634439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220303+0000","last_change":"2023-11-28T11:55:06.229229+0000","last_active":"2023-11-28T11:55:07.220303+0000","last_peered":"2023-11-28T11:55:07.220303+0000","last_clean":"2023-11-28T11:55:07.220303+0000","last_became_active":"2023-11-28T11:55:06.228888+0000","last_became_peered":"2023-11-28T11:55:06.228888+0000","last_unstale":"2023-11-28T11:55:07.220303+0000","last_undegraded":"2023-11-28T11:55:07.220303+0000","last_fullsized":"2023-11-28T11:55:07.220303+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:16.488151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.959148+0000","last_change":"2023-11-28T11:55:06.235899+0000","last_active":"2023-11-28T11:55:08.959148+0000","last_peered":"2023-11-28T11:55:08.959148+0000","last_clean":"2023-11-28T11:55:08.959148+0000","last_became_active":"2023-11-28T11:55:06.235487+0000","last_became_peered":"2023-11-28T11:55:06.235487+0000","last_unstale":"2023-11-28T11:55:08.959148+0000","last_undegraded":"2023-11-28T11:55:08.959148+0000","last_fullsized":"2023-11-28T11:55:08.959148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:13:03.345320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221184+0000","last_change":"2023-11-28T11:55:06.225203+0000","last_active":"2023-11-28T11:55:07.221184+0000","last_peered":"2023-11-28T11:55:07.221184+0000","last_clean":"2023-11-28T11:55:07.221184+0000","last_became_active":"2023-11-28T11:55:06.224895+0000","last_became_peered":"2023-11-28T11:55:06.224895+0000","last_unstale":"2023-11-28T11:55:07.221184+0000","last_undegraded":"2023-11-28T11:55:07.221184+0000","last_fullsized":"2023-11-28T11:55:07.221184+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:23:03.362862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219302+0000","last_change":"2023-11-28T11:55:06.233298+0000","last_active":"2023-11-28T11:55:07.219302+0000","last_peered":"2023-11-28T11:55:07.219302+0000","last_clean":"2023-11-28T11:55:07.219302+0000","last_became_active":"2023-11-28T11:55:06.227483+0000","last_became_peered":"2023-11-28T11:55:06.227483+0000","last_unstale":"2023-11-28T11:55:07.219302+0000","last_undegraded":"2023-11-28T11:55:07.219302+0000","last_fullsized":"2023-11-28T11:55:07.219302+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:23:03.362862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.042691+0000","last_change":"2023-11-28T11:55:06.229728+0000","last_active":"2023-11-28T11:55:08.042691+0000","last_peered":"2023-11-28T11:55:08.042691+0000","last_clean":"2023-11-28T11:55:08.042691+0000","last_became_active":"2023-11-28T11:55:06.229101+0000","last_became_peered":"2023-11-28T11:55:06.229101+0000","last_unstale":"2023-11-28T11:55:08.042691+0000","last_undegraded":"2023-11-28T11:55:08.042691+0000","last_fullsized":"2023-11-28T11:55:08.042691+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:02:15.061798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.334777+0000","last_change":"2023-11-28T11:55:06.243201+0000","last_active":"2023-11-28T11:55:08.334777+0000","last_peered":"2023-11-28T11:55:08.334777+0000","last_clean":"2023-11-28T11:55:08.334777+0000","last_became_active":"2023-11-28T11:55:06.242937+0000","last_became_peered":"2023-11-28T11:55:06.242937+0000","last_unstale":"2023-11-28T11:55:08.334777+0000","last_undegraded":"2023-11-28T11:55:08.334777+0000","last_fullsized":"2023-11-28T11:55:08.334777+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:18:07.145986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'4","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219940+0000","last_change":"2023-11-28T11:55:05.845554+0000","last_active":"2023-11-28T11:55:07.219940+0000","last_peered":"2023-11-28T11:55:07.219940+0000","last_clean":"2023-11-28T11:55:07.219940+0000","last_became_active":"2023-11-28T11:55:05.845262+0000","last_became_peered":"2023-11-28T11:55:05.845262+0000","last_unstale":"2023-11-28T11:55:07.219940+0000","last_undegraded":"2023-11-28T11:55:07.219940+0000","last_fullsized":"2023-11-28T11:55:07.219940+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:31.756453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.959259+0000","last_change":"2023-11-28T11:55:06.237768+0000","last_active":"2023-11-28T11:55:08.959259+0000","last_peered":"2023-11-28T11:55:08.959259+0000","last_clean":"2023-11-28T11:55:08.959259+0000","last_became_active":"2023-11-28T11:55:06.237390+0000","last_became_peered":"2023-11-28T11:55:06.237390+0000","last_unstale":"2023-11-28T11:55:08.959259+0000","last_undegraded":"2023-11-28T11:55:08.959259+0000","last_fullsized":"2023-11-28T11:55:08.959259+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:12.738933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221552+0000","last_change":"2023-11-28T11:55:05.842909+0000","last_active":"2023-11-28T11:55:07.221552+0000","last_peered":"2023-11-28T11:55:07.221552+0000","last_clean":"2023-11-28T11:55:07.221552+0000","last_became_active":"2023-11-28T11:55:05.842181+0000","last_became_peered":"2023-11-28T11:55:05.842181+0000","last_unstale":"2023-11-28T11:55:07.221552+0000","last_undegraded":"2023-11-28T11:55:07.221552+0000","last_fullsized":"2023-11-28T11:55:07.221552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:18:32.190988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220304+0000","last_change":"2023-11-28T11:55:06.237891+0000","last_active":"2023-11-28T11:55:07.220304+0000","last_peered":"2023-11-28T11:55:07.220304+0000","last_clean":"2023-11-28T11:55:07.220304+0000","last_became_active":"2023-11-28T11:55:06.237563+0000","last_became_peered":"2023-11-28T11:55:06.237563+0000","last_unstale":"2023-11-28T11:55:07.220304+0000","last_undegraded":"2023-11-28T11:55:07.220304+0000","last_fullsized":"2023-11-28T11:55:07.220304+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:18:33.196205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.335124+0000","last_change":"2023-11-28T11:55:05.838764+0000","last_active":"2023-11-28T11:55:08.335124+0000","last_peered":"2023-11-28T11:55:08.335124+0000","last_clean":"2023-11-28T11:55:08.335124+0000","last_became_active":"2023-11-28T11:55:05.838297+0000","last_became_peered":"2023-11-28T11:55:05.838297+0000","last_unstale":"2023-11-28T11:55:08.335124+0000","last_undegraded":"2023-11-28T11:55:08.335124+0000","last_fullsized":"2023-11-28T11:55:08.335124+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:16:58.464218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.335142+0000","last_change":"2023-11-28T11:55:06.238107+0000","last_active":"2023-11-28T11:55:08.335142+0000","last_peered":"2023-11-28T11:55:08.335142+0000","last_clean":"2023-11-28T11:55:08.335142+0000","last_became_active":"2023-11-28T11:55:06.237807+0000","last_became_peered":"2023-11-28T11:55:06.237807+0000","last_unstale":"2023-11-28T11:55:08.335142+0000","last_undegraded":"2023-11-28T11:55:08.335142+0000","last_fullsized":"2023-11-28T11:55:08.335142+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:47:38.195856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"39'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.956356+0000","last_change":"2023-11-28T11:55:05.839128+0000","last_active":"2023-11-28T11:55:08.956356+0000","last_peered":"2023-11-28T11:55:08.956356+0000","last_clean":"2023-11-28T11:55:08.956356+0000","last_became_active":"2023-11-28T11:55:05.838770+0000","last_became_peered":"2023-11-28T11:55:05.838770+0000","last_unstale":"2023-11-28T11:55:08.956356+0000","last_undegraded":"2023-11-28T11:55:08.956356+0000","last_fullsized":"2023-11-28T11:55:08.956356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:44.525674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221205+0000","last_change":"2023-11-28T11:55:06.238851+0000","last_active":"2023-11-28T11:55:07.221205+0000","last_peered":"2023-11-28T11:55:07.221205+0000","last_clean":"2023-11-28T11:55:07.221205+0000","last_became_active":"2023-11-28T11:55:06.238560+0000","last_became_peered":"2023-11-28T11:55:06.238560+0000","last_unstale":"2023-11-28T11:55:07.221205+0000","last_undegraded":"2023-11-28T11:55:07.221205+0000","last_fullsized":"2023-11-28T11:55:07.221205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:33.691957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219607+0000","last_change":"2023-11-28T11:55:05.846764+0000","last_active":"2023-11-28T11:55:07.219607+0000","last_peered":"2023-11-28T11:55:07.219607+0000","last_clean":"2023-11-28T11:55:07.219607+0000","last_became_active":"2023-11-28T11:55:05.846200+0000","last_became_peered":"2023-11-28T11:55:05.846200+0000","last_unstale":"2023-11-28T11:55:07.219607+0000","last_undegraded":"2023-11-28T11:55:07.219607+0000","last_fullsized":"2023-11-28T11:55:07.219607+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:13.702760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951441+0000","last_change":"2023-11-28T11:55:06.232368+0000","last_active":"2023-11-28T11:55:08.951441+0000","last_peered":"2023-11-28T11:55:08.951441+0000","last_clean":"2023-11-28T11:55:08.951441+0000","last_became_active":"2023-11-28T11:55:06.232108+0000","last_became_peered":"2023-11-28T11:55:06.232108+0000","last_unstale":"2023-11-28T11:55:08.951441+0000","last_undegraded":"2023-11-28T11:55:08.951441+0000","last_fullsized":"2023-11-28T11:55:08.951441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:07:28.763927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221442+0000","last_change":"2023-11-28T11:55:05.840762+0000","last_active":"2023-11-28T11:55:07.221442+0000","last_peered":"2023-11-28T11:55:07.221442+0000","last_clean":"2023-11-28T11:55:07.221442+0000","last_became_active":"2023-11-28T11:55:05.840523+0000","last_became_peered":"2023-11-28T11:55:05.840523+0000","last_unstale":"2023-11-28T11:55:07.221442+0000","last_undegraded":"2023-11-28T11:55:07.221442+0000","last_fullsized":"2023-11-28T11:55:07.221442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:56.629606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951224+0000","last_change":"2023-11-28T11:55:06.244691+0000","last_active":"2023-11-28T11:55:08.951224+0000","last_peered":"2023-11-28T11:55:08.951224+0000","last_clean":"2023-11-28T11:55:08.951224+0000","last_became_active":"2023-11-28T11:55:06.244403+0000","last_became_peered":"2023-11-28T11:55:06.244403+0000","last_unstale":"2023-11-28T11:55:08.951224+0000","last_undegraded":"2023-11-28T11:55:08.951224+0000","last_fullsized":"2023-11-28T11:55:08.951224+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:23:03.362862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219761+0000","last_change":"2023-11-28T11:55:05.836815+0000","last_active":"2023-11-28T11:55:07.219761+0000","last_peered":"2023-11-28T11:55:07.219761+0000","last_clean":"2023-11-28T11:55:07.219761+0000","last_became_active":"2023-11-28T11:55:05.836303+0000","last_became_peered":"2023-11-28T11:55:05.836303+0000","last_unstale":"2023-11-28T11:55:07.219761+0000","last_undegraded":"2023-11-28T11:55:07.219761+0000","last_fullsized":"2023-11-28T11:55:07.219761+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:44:58.093005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.959085+0000","last_change":"2023-11-28T11:55:06.229095+0000","last_active":"2023-11-28T11:55:08.959085+0000","last_peered":"2023-11-28T11:55:08.959085+0000","last_clean":"2023-11-28T11:55:08.959085+0000","last_became_active":"2023-11-28T11:55:06.228614+0000","last_became_peered":"2023-11-28T11:55:06.228614+0000","last_unstale":"2023-11-28T11:55:08.959085+0000","last_undegraded":"2023-11-28T11:55:08.959085+0000","last_fullsized":"2023-11-28T11:55:08.959085+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:45.530892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951247+0000","last_change":"2023-11-28T11:55:05.838098+0000","last_active":"2023-11-28T11:55:08.951247+0000","last_peered":"2023-11-28T11:55:08.951247+0000","last_clean":"2023-11-28T11:55:08.951247+0000","last_became_active":"2023-11-28T11:55:05.837637+0000","last_became_peered":"2023-11-28T11:55:05.837637+0000","last_unstale":"2023-11-28T11:55:08.951247+0000","last_undegraded":"2023-11-28T11:55:08.951247+0000","last_fullsized":"2023-11-28T11:55:08.951247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:31.756453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221442+0000","last_change":"2023-11-28T11:55:06.231236+0000","last_active":"2023-11-28T11:55:07.221442+0000","last_peered":"2023-11-28T11:55:07.221442+0000","last_clean":"2023-11-28T11:55:07.221442+0000","last_became_active":"2023-11-28T11:55:06.230954+0000","last_became_peered":"2023-11-28T11:55:06.230954+0000","last_unstale":"2023-11-28T11:55:07.221442+0000","last_undegraded":"2023-11-28T11:55:07.221442+0000","last_fullsized":"2023-11-28T11:55:07.221442+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:16.495251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221623+0000","last_change":"2023-11-28T11:55:05.843964+0000","last_active":"2023-11-28T11:55:07.221623+0000","last_peered":"2023-11-28T11:55:07.221623+0000","last_clean":"2023-11-28T11:55:07.221623+0000","last_became_active":"2023-11-28T11:55:05.843719+0000","last_became_peered":"2023-11-28T11:55:05.843719+0000","last_unstale":"2023-11-28T11:55:07.221623+0000","last_undegraded":"2023-11-28T11:55:07.221623+0000","last_fullsized":"2023-11-28T11:55:07.221623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:25.424333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.956621+0000","last_change":"2023-11-28T11:55:06.229474+0000","last_active":"2023-11-28T11:55:08.956621+0000","last_peered":"2023-11-28T11:55:08.956621+0000","last_clean":"2023-11-28T11:55:08.956621+0000","last_became_active":"2023-11-28T11:55:06.229221+0000","last_became_peered":"2023-11-28T11:55:06.229221+0000","last_unstale":"2023-11-28T11:55:08.956621+0000","last_undegraded":"2023-11-28T11:55:08.956621+0000","last_fullsized":"2023-11-28T11:55:08.956621+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:26.429551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951578+0000","last_change":"2023-11-28T11:55:05.840346+0000","last_active":"2023-11-28T11:55:08.951578+0000","last_peered":"2023-11-28T11:55:08.951578+0000","last_clean":"2023-11-28T11:55:08.951578+0000","last_became_active":"2023-11-28T11:55:05.839950+0000","last_became_peered":"2023-11-28T11:55:05.839950+0000","last_unstale":"2023-11-28T11:55:08.951578+0000","last_undegraded":"2023-11-28T11:55:08.951578+0000","last_fullsized":"2023-11-28T11:55:08.951578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:25.424333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219748+0000","last_change":"2023-11-28T11:55:06.238161+0000","last_active":"2023-11-28T11:55:07.219748+0000","last_peered":"2023-11-28T11:55:07.219748+0000","last_clean":"2023-11-28T11:55:07.219748+0000","last_became_active":"2023-11-28T11:55:06.237891+0000","last_became_peered":"2023-11-28T11:55:06.237891+0000","last_unstale":"2023-11-28T11:55:07.219748+0000","last_undegraded":"2023-11-28T11:55:07.219748+0000","last_fullsized":"2023-11-28T11:55:07.219748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:38:31.234809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'3","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.956524+0000","last_change":"2023-11-28T11:55:05.840667+0000","last_active":"2023-11-28T11:55:08.956524+0000","last_peered":"2023-11-28T11:55:08.956524+0000","last_clean":"2023-11-28T11:55:08.956524+0000","last_became_active":"2023-11-28T11:55:05.840224+0000","last_became_peered":"2023-11-28T11:55:05.840224+0000","last_unstale":"2023-11-28T11:55:08.956524+0000","last_undegraded":"2023-11-28T11:55:08.956524+0000","last_fullsized":"2023-11-28T11:55:08.956524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:32:35.769637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.956421+0000","last_change":"2023-11-28T11:55:06.236209+0000","last_active":"2023-11-28T11:55:08.956421+0000","last_peered":"2023-11-28T11:55:08.956421+0000","last_clean":"2023-11-28T11:55:08.956421+0000","last_became_active":"2023-11-28T11:55:06.235841+0000","last_became_peered":"2023-11-28T11:55:06.235841+0000","last_unstale":"2023-11-28T11:55:08.956421+0000","last_undegraded":"2023-11-28T11:55:08.956421+0000","last_fullsized":"2023-11-28T11:55:08.956421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:57:30.229081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'6","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.043246+0000","last_change":"2023-11-28T11:55:05.839381+0000","last_active":"2023-11-28T11:55:08.043246+0000","last_peered":"2023-11-28T11:55:08.043246+0000","last_clean":"2023-11-28T11:55:08.043246+0000","last_became_active":"2023-11-28T11:55:05.839098+0000","last_became_peered":"2023-11-28T11:55:05.839098+0000","last_unstale":"2023-11-28T11:55:08.043246+0000","last_undegraded":"2023-11-28T11:55:08.043246+0000","last_fullsized":"2023-11-28T11:55:08.043246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:00:35.347876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.959126+0000","last_change":"2023-11-28T11:55:06.232344+0000","last_active":"2023-11-28T11:55:08.959126+0000","last_peered":"2023-11-28T11:55:08.959126+0000","last_clean":"2023-11-28T11:55:08.959126+0000","last_became_active":"2023-11-28T11:55:06.232059+0000","last_became_peered":"2023-11-28T11:55:06.232059+0000","last_unstale":"2023-11-28T11:55:08.959126+0000","last_undegraded":"2023-11-28T11:55:08.959126+0000","last_fullsized":"2023-11-28T11:55:08.959126+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:37.404513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219919+0000","last_change":"2023-11-28T11:55:05.844516+0000","last_active":"2023-11-28T11:55:07.219919+0000","last_peered":"2023-11-28T11:55:07.219919+0000","last_clean":"2023-11-28T11:55:07.219919+0000","last_became_active":"2023-11-28T11:55:05.844237+0000","last_became_peered":"2023-11-28T11:55:05.844237+0000","last_unstale":"2023-11-28T11:55:07.219919+0000","last_undegraded":"2023-11-28T11:55:07.219919+0000","last_fullsized":"2023-11-28T11:55:07.219919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:15.482934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951421+0000","last_change":"2023-11-28T11:55:06.230810+0000","last_active":"2023-11-28T11:55:08.951421+0000","last_peered":"2023-11-28T11:55:08.951421+0000","last_clean":"2023-11-28T11:55:08.951421+0000","last_became_active":"2023-11-28T11:55:06.230486+0000","last_became_peered":"2023-11-28T11:55:06.230486+0000","last_unstale":"2023-11-28T11:55:08.951421+0000","last_undegraded":"2023-11-28T11:55:08.951421+0000","last_fullsized":"2023-11-28T11:55:08.951421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:38.171273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.956216+0000","last_change":"2023-11-28T11:55:05.837851+0000","last_active":"2023-11-28T11:55:08.956216+0000","last_peered":"2023-11-28T11:55:08.956216+0000","last_clean":"2023-11-28T11:55:08.956216+0000","last_became_active":"2023-11-28T11:55:05.837519+0000","last_became_peered":"2023-11-28T11:55:05.837519+0000","last_unstale":"2023-11-28T11:55:08.956216+0000","last_undegraded":"2023-11-28T11:55:08.956216+0000","last_fullsized":"2023-11-28T11:55:08.956216+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:35.263973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219191+0000","last_change":"2023-11-28T11:55:06.233634+0000","last_active":"2023-11-28T11:55:07.219191+0000","last_peered":"2023-11-28T11:55:07.219191+0000","last_clean":"2023-11-28T11:55:07.219191+0000","last_became_active":"2023-11-28T11:55:06.233129+0000","last_became_peered":"2023-11-28T11:55:06.233129+0000","last_unstale":"2023-11-28T11:55:07.219191+0000","last_undegraded":"2023-11-28T11:55:07.219191+0000","last_fullsized":"2023-11-28T11:55:07.219191+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:13.482762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219417+0000","last_change":"2023-11-28T11:55:05.846919+0000","last_active":"2023-11-28T11:55:07.219417+0000","last_peered":"2023-11-28T11:55:07.219417+0000","last_clean":"2023-11-28T11:55:07.219417+0000","last_became_active":"2023-11-28T11:55:05.845929+0000","last_became_peered":"2023-11-28T11:55:05.845929+0000","last_unstale":"2023-11-28T11:55:07.219417+0000","last_undegraded":"2023-11-28T11:55:07.219417+0000","last_fullsized":"2023-11-28T11:55:07.219417+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:56.629606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.956190+0000","last_change":"2023-11-28T11:55:06.238581+0000","last_active":"2023-11-28T11:55:08.956190+0000","last_peered":"2023-11-28T11:55:08.956190+0000","last_clean":"2023-11-28T11:55:08.956190+0000","last_became_active":"2023-11-28T11:55:06.238284+0000","last_became_peered":"2023-11-28T11:55:06.238284+0000","last_unstale":"2023-11-28T11:55:08.956190+0000","last_undegraded":"2023-11-28T11:55:08.956190+0000","last_fullsized":"2023-11-28T11:55:08.956190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:16.488151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'8","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951277+0000","last_change":"2023-11-28T11:55:05.841540+0000","last_active":"2023-11-28T11:55:08.951277+0000","last_peered":"2023-11-28T11:55:08.951277+0000","last_clean":"2023-11-28T11:55:08.951277+0000","last_became_active":"2023-11-28T11:55:05.841256+0000","last_became_peered":"2023-11-28T11:55:05.841256+0000","last_unstale":"2023-11-28T11:55:08.951277+0000","last_undegraded":"2023-11-28T11:55:08.951277+0000","last_fullsized":"2023-11-28T11:55:08.951277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:57:29.223863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.043202+0000","last_change":"2023-11-28T11:55:06.229492+0000","last_active":"2023-11-28T11:55:08.043202+0000","last_peered":"2023-11-28T11:55:08.043202+0000","last_clean":"2023-11-28T11:55:08.043202+0000","last_became_active":"2023-11-28T11:55:06.229225+0000","last_became_peered":"2023-11-28T11:55:06.229225+0000","last_unstale":"2023-11-28T11:55:08.043202+0000","last_undegraded":"2023-11-28T11:55:08.043202+0000","last_fullsized":"2023-11-28T11:55:08.043202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:16:59.469435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.043288+0000","last_change":"2023-11-28T11:55:05.847520+0000","last_active":"2023-11-28T11:55:08.043288+0000","last_peered":"2023-11-28T11:55:08.043288+0000","last_clean":"2023-11-28T11:55:08.043288+0000","last_became_active":"2023-11-28T11:55:05.847245+0000","last_became_peered":"2023-11-28T11:55:05.847245+0000","last_unstale":"2023-11-28T11:55:08.043288+0000","last_undegraded":"2023-11-28T11:55:08.043288+0000","last_fullsized":"2023-11-28T11:55:08.043288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:19:30.811950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951624+0000","last_change":"2023-11-28T11:55:06.242958+0000","last_active":"2023-11-28T11:55:08.951624+0000","last_peered":"2023-11-28T11:55:08.951624+0000","last_clean":"2023-11-28T11:55:08.951624+0000","last_became_active":"2023-11-28T11:55:06.242674+0000","last_became_peered":"2023-11-28T11:55:06.242674+0000","last_unstale":"2023-11-28T11:55:08.951624+0000","last_undegraded":"2023-11-28T11:55:08.951624+0000","last_fullsized":"2023-11-28T11:55:08.951624+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:06.199582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221654+0000","last_change":"2023-11-28T11:55:05.839038+0000","last_active":"2023-11-28T11:55:07.221654+0000","last_peered":"2023-11-28T11:55:07.221654+0000","last_clean":"2023-11-28T11:55:07.221654+0000","last_became_active":"2023-11-28T11:55:05.838789+0000","last_became_peered":"2023-11-28T11:55:05.838789+0000","last_unstale":"2023-11-28T11:55:07.221654+0000","last_undegraded":"2023-11-28T11:55:07.221654+0000","last_fullsized":"2023-11-28T11:55:07.221654+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:17:39.576130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.959169+0000","last_change":"2023-11-28T11:55:06.238636+0000","last_active":"2023-11-28T11:55:08.959169+0000","last_peered":"2023-11-28T11:55:08.959169+0000","last_clean":"2023-11-28T11:55:08.959169+0000","last_became_active":"2023-11-28T11:55:06.238385+0000","last_became_peered":"2023-11-28T11:55:06.238385+0000","last_unstale":"2023-11-28T11:55:08.959169+0000","last_undegraded":"2023-11-28T11:55:08.959169+0000","last_fullsized":"2023-11-28T11:55:08.959169+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:04.214382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220012+0000","last_change":"2023-11-28T11:55:05.836660+0000","last_active":"2023-11-28T11:55:07.220012+0000","last_peered":"2023-11-28T11:55:07.220012+0000","last_clean":"2023-11-28T11:55:07.220012+0000","last_became_active":"2023-11-28T11:55:05.836365+0000","last_became_peered":"2023-11-28T11:55:05.836365+0000","last_unstale":"2023-11-28T11:55:07.220012+0000","last_undegraded":"2023-11-28T11:55:07.220012+0000","last_fullsized":"2023-11-28T11:55:07.220012+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:58:36.399295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.959198+0000","last_change":"2023-11-28T11:55:06.236311+0000","last_active":"2023-11-28T11:55:08.959198+0000","last_peered":"2023-11-28T11:55:08.959198+0000","last_clean":"2023-11-28T11:55:08.959198+0000","last_became_active":"2023-11-28T11:55:06.236052+0000","last_became_peered":"2023-11-28T11:55:06.236052+0000","last_unstale":"2023-11-28T11:55:08.959198+0000","last_undegraded":"2023-11-28T11:55:08.959198+0000","last_fullsized":"2023-11-28T11:55:08.959198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:53.533792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219962+0000","last_change":"2023-11-28T11:55:05.846545+0000","last_active":"2023-11-28T11:55:07.219962+0000","last_peered":"2023-11-28T11:55:07.219962+0000","last_clean":"2023-11-28T11:55:07.219962+0000","last_became_active":"2023-11-28T11:55:05.846217+0000","last_became_peered":"2023-11-28T11:55:05.846217+0000","last_unstale":"2023-11-28T11:55:07.219962+0000","last_undegraded":"2023-11-28T11:55:07.219962+0000","last_fullsized":"2023-11-28T11:55:07.219962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:57:29.223863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219489+0000","last_change":"2023-11-28T11:55:06.239234+0000","last_active":"2023-11-28T11:55:07.219489+0000","last_peered":"2023-11-28T11:55:07.219489+0000","last_clean":"2023-11-28T11:55:07.219489+0000","last_became_active":"2023-11-28T11:55:06.233952+0000","last_became_peered":"2023-11-28T11:55:06.233952+0000","last_unstale":"2023-11-28T11:55:07.219489+0000","last_undegraded":"2023-11-28T11:55:07.219489+0000","last_fullsized":"2023-11-28T11:55:07.219489+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:27.420410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219723+0000","last_change":"2023-11-28T11:55:05.847928+0000","last_active":"2023-11-28T11:55:07.219723+0000","last_peered":"2023-11-28T11:55:07.219723+0000","last_clean":"2023-11-28T11:55:07.219723+0000","last_became_active":"2023-11-28T11:55:05.847122+0000","last_became_peered":"2023-11-28T11:55:05.847122+0000","last_unstale":"2023-11-28T11:55:07.219723+0000","last_undegraded":"2023-11-28T11:55:07.219723+0000","last_fullsized":"2023-11-28T11:55:07.219723+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:18:32.190988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.334808+0000","last_change":"2023-11-28T11:55:06.223357+0000","last_active":"2023-11-28T11:55:08.334808+0000","last_peered":"2023-11-28T11:55:08.334808+0000","last_clean":"2023-11-28T11:55:08.334808+0000","last_became_active":"2023-11-28T11:55:06.223062+0000","last_became_peered":"2023-11-28T11:55:06.223062+0000","last_unstale":"2023-11-28T11:55:08.334808+0000","last_undegraded":"2023-11-28T11:55:08.334808+0000","last_fullsized":"2023-11-28T11:55:08.334808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:03:55.039319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220014+0000","last_change":"2023-11-28T11:55:05.840844+0000","last_active":"2023-11-28T11:55:07.220014+0000","last_peered":"2023-11-28T11:55:07.220014+0000","last_clean":"2023-11-28T11:55:07.220014+0000","last_became_active":"2023-11-28T11:55:05.839865+0000","last_became_peered":"2023-11-28T11:55:05.839865+0000","last_unstale":"2023-11-28T11:55:07.220014+0000","last_undegraded":"2023-11-28T11:55:07.220014+0000","last_fullsized":"2023-11-28T11:55:07.220014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:52.528575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.042663+0000","last_change":"2023-11-28T11:55:06.229916+0000","last_active":"2023-11-28T11:55:08.042663+0000","last_peered":"2023-11-28T11:55:08.042663+0000","last_clean":"2023-11-28T11:55:08.042663+0000","last_became_active":"2023-11-28T11:55:06.229418+0000","last_became_peered":"2023-11-28T11:55:06.229418+0000","last_unstale":"2023-11-28T11:55:08.042663+0000","last_undegraded":"2023-11-28T11:55:08.042663+0000","last_fullsized":"2023-11-28T11:55:08.042663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:16.529286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951356+0000","last_change":"2023-11-28T11:55:05.841250+0000","last_active":"2023-11-28T11:55:08.951356+0000","last_peered":"2023-11-28T11:55:08.951356+0000","last_clean":"2023-11-28T11:55:08.951356+0000","last_became_active":"2023-11-28T11:55:05.840939+0000","last_became_peered":"2023-11-28T11:55:05.840939+0000","last_unstale":"2023-11-28T11:55:08.951356+0000","last_undegraded":"2023-11-28T11:55:08.951356+0000","last_fullsized":"2023-11-28T11:55:08.951356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:03.209165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951326+0000","last_change":"2023-11-28T11:55:06.230328+0000","last_active":"2023-11-28T11:55:08.951326+0000","last_peered":"2023-11-28T11:55:08.951326+0000","last_clean":"2023-11-28T11:55:08.951326+0000","last_became_active":"2023-11-28T11:55:06.229070+0000","last_became_peered":"2023-11-28T11:55:06.229070+0000","last_unstale":"2023-11-28T11:55:08.951326+0000","last_undegraded":"2023-11-28T11:55:08.951326+0000","last_fullsized":"2023-11-28T11:55:08.951326+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:20:33.158785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.956111+0000","last_change":"2023-11-28T11:55:05.838579+0000","last_active":"2023-11-28T11:55:08.956111+0000","last_peered":"2023-11-28T11:55:08.956111+0000","last_clean":"2023-11-28T11:55:08.956111+0000","last_became_active":"2023-11-28T11:55:05.838216+0000","last_became_peered":"2023-11-28T11:55:05.838216+0000","last_unstale":"2023-11-28T11:55:08.956111+0000","last_undegraded":"2023-11-28T11:55:08.956111+0000","last_fullsized":"2023-11-28T11:55:08.956111+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:02:58.006330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220947+0000","last_change":"2023-11-28T11:55:06.238621+0000","last_active":"2023-11-28T11:55:07.220947+0000","last_peered":"2023-11-28T11:55:07.220947+0000","last_clean":"2023-11-28T11:55:07.220947+0000","last_became_active":"2023-11-28T11:55:06.238183+0000","last_became_peered":"2023-11-28T11:55:06.238183+0000","last_unstale":"2023-11-28T11:55:07.220947+0000","last_undegraded":"2023-11-28T11:55:07.220947+0000","last_fullsized":"2023-11-28T11:55:07.220947+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:13.482762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951305+0000","last_change":"2023-11-28T11:55:05.847731+0000","last_active":"2023-11-28T11:55:08.951305+0000","last_peered":"2023-11-28T11:55:08.951305+0000","last_clean":"2023-11-28T11:55:08.951305+0000","last_became_active":"2023-11-28T11:55:05.847440+0000","last_became_peered":"2023-11-28T11:55:05.847440+0000","last_unstale":"2023-11-28T11:55:08.951305+0000","last_undegraded":"2023-11-28T11:55:08.951305+0000","last_fullsized":"2023-11-28T11:55:08.951305+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:46:52.941096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.232525+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:55:06.232525+0000","last_peered":"2023-11-28T11:55:06.232525+0000","last_clean":"2023-11-28T11:55:06.232525+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:55:06.232525+0000","last_undegraded":"2023-11-28T11:55:06.232525+0000","last_fullsized":"2023-11-28T11:55:06.232525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219738+0000","last_change":"2023-11-28T11:55:06.220462+0000","last_active":"2023-11-28T11:55:07.219738+0000","last_peered":"2023-11-28T11:55:07.219738+0000","last_clean":"2023-11-28T11:55:07.219738+0000","last_became_active":"2023-11-28T11:55:06.220168+0000","last_became_peered":"2023-11-28T11:55:06.220168+0000","last_unstale":"2023-11-28T11:55:07.219738+0000","last_undegraded":"2023-11-28T11:55:07.219738+0000","last_fullsized":"2023-11-28T11:55:07.219738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:15:26.429551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.334577+0000","last_change":"2023-11-28T11:55:05.841163+0000","last_active":"2023-11-28T11:55:08.334577+0000","last_peered":"2023-11-28T11:55:08.334577+0000","last_clean":"2023-11-28T11:55:08.334577+0000","last_became_active":"2023-11-28T11:55:05.840902+0000","last_became_peered":"2023-11-28T11:55:05.840902+0000","last_unstale":"2023-11-28T11:55:08.334577+0000","last_undegraded":"2023-11-28T11:55:08.334577+0000","last_fullsized":"2023-11-28T11:55:08.334577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:02:14.056581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.232040+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:55:06.232040+0000","last_peered":"2023-11-28T11:55:06.232040+0000","last_clean":"2023-11-28T11:55:06.232040+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:55:06.232040+0000","last_undegraded":"2023-11-28T11:55:06.232040+0000","last_fullsized":"2023-11-28T11:55:06.232040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219436+0000","last_change":"2023-11-28T11:55:06.233817+0000","last_active":"2023-11-28T11:55:07.219436+0000","last_peered":"2023-11-28T11:55:07.219436+0000","last_clean":"2023-11-28T11:55:07.219436+0000","last_became_active":"2023-11-28T11:55:06.233532+0000","last_became_peered":"2023-11-28T11:55:06.233532+0000","last_unstale":"2023-11-28T11:55:07.219436+0000","last_undegraded":"2023-11-28T11:55:07.219436+0000","last_fullsized":"2023-11-28T11:55:07.219436+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:01:09.791004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.221451+0000","last_change":"2023-11-28T11:55:05.845168+0000","last_active":"2023-11-28T11:55:07.221451+0000","last_peered":"2023-11-28T11:55:07.221451+0000","last_clean":"2023-11-28T11:55:07.221451+0000","last_became_active":"2023-11-28T11:55:05.844927+0000","last_became_peered":"2023-11-28T11:55:05.844927+0000","last_unstale":"2023-11-28T11:55:07.221451+0000","last_undegraded":"2023-11-28T11:55:07.221451+0000","last_fullsized":"2023-11-28T11:55:07.221451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:31:13.702760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.214007+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:55:06.214007+0000","last_peered":"2023-11-28T11:55:06.214007+0000","last_clean":"2023-11-28T11:55:06.214007+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:55:06.214007+0000","last_undegraded":"2023-11-28T11:55:06.214007+0000","last_fullsized":"2023-11-28T11:55:06.214007+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.219586+0000","last_change":"2023-11-28T11:55:06.239420+0000","last_active":"2023-11-28T11:55:07.219586+0000","last_peered":"2023-11-28T11:55:07.219586+0000","last_clean":"2023-11-28T11:55:07.219586+0000","last_became_active":"2023-11-28T11:55:06.238684+0000","last_became_peered":"2023-11-28T11:55:06.238684+0000","last_unstale":"2023-11-28T11:55:07.219586+0000","last_undegraded":"2023-11-28T11:55:07.219586+0000","last_fullsized":"2023-11-28T11:55:07.219586+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:16:51.241072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.956255+0000","last_change":"2023-11-28T11:55:05.840188+0000","last_active":"2023-11-28T11:55:08.956255+0000","last_peered":"2023-11-28T11:55:08.956255+0000","last_clean":"2023-11-28T11:55:08.956255+0000","last_became_active":"2023-11-28T11:55:05.839877+0000","last_became_peered":"2023-11-28T11:55:05.839877+0000","last_unstale":"2023-11-28T11:55:08.956255+0000","last_undegraded":"2023-11-28T11:55:08.956255+0000","last_fullsized":"2023-11-28T11:55:08.956255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:47:37.190638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":31,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.213647+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:55:06.213647+0000","last_peered":"2023-11-28T11:55:06.213647+0000","last_clean":"2023-11-28T11:55:06.213647+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:55:06.213647+0000","last_undegraded":"2023-11-28T11:55:06.213647+0000","last_fullsized":"2023-11-28T11:55:06.213647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.956473+0000","last_change":"2023-11-28T11:55:06.236135+0000","last_active":"2023-11-28T11:55:08.956473+0000","last_peered":"2023-11-28T11:55:08.956473+0000","last_clean":"2023-11-28T11:55:08.956473+0000","last_became_active":"2023-11-28T11:55:06.235827+0000","last_became_peered":"2023-11-28T11:55:06.235827+0000","last_unstale":"2023-11-28T11:55:08.956473+0000","last_undegraded":"2023-11-28T11:55:08.956473+0000","last_fullsized":"2023-11-28T11:55:08.956473+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:46:53.946313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.334577+0000","last_change":"2023-11-28T11:55:05.839286+0000","last_active":"2023-11-28T11:55:08.334577+0000","last_peered":"2023-11-28T11:55:08.334577+0000","last_clean":"2023-11-28T11:55:08.334577+0000","last_became_active":"2023-11-28T11:55:05.837875+0000","last_became_peered":"2023-11-28T11:55:05.837875+0000","last_unstale":"2023-11-28T11:55:08.334577+0000","last_undegraded":"2023-11-28T11:55:08.334577+0000","last_fullsized":"2023-11-28T11:55:08.334577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:15.524068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":180,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.220385+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:55:06.220385+0000","last_peered":"2023-11-28T11:55:06.220385+0000","last_clean":"2023-11-28T11:55:06.220385+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:55:06.220385+0000","last_undegraded":"2023-11-28T11:55:06.220385+0000","last_fullsized":"2023-11-28T11:55:06.220385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.220764+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:55:06.220764+0000","last_peered":"2023-11-28T11:55:06.220764+0000","last_clean":"2023-11-28T11:55:06.220764+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:55:06.220764+0000","last_undegraded":"2023-11-28T11:55:06.220764+0000","last_fullsized":"2023-11-28T11:55:06.220764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951484+0000","last_change":"2023-11-28T11:55:06.229218+0000","last_active":"2023-11-28T11:55:08.951484+0000","last_peered":"2023-11-28T11:55:08.951484+0000","last_clean":"2023-11-28T11:55:08.951484+0000","last_became_active":"2023-11-28T11:55:06.228480+0000","last_became_peered":"2023-11-28T11:55:06.228480+0000","last_unstale":"2023-11-28T11:55:08.951484+0000","last_undegraded":"2023-11-28T11:55:08.951484+0000","last_fullsized":"2023-11-28T11:55:08.951484+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:09:23.634439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.956571+0000","last_change":"2023-11-28T11:55:05.840489+0000","last_active":"2023-11-28T11:55:08.956571+0000","last_peered":"2023-11-28T11:55:08.956571+0000","last_clean":"2023-11-28T11:55:08.956571+0000","last_became_active":"2023-11-28T11:55:05.839871+0000","last_became_peered":"2023-11-28T11:55:05.839871+0000","last_unstale":"2023-11-28T11:55:08.956571+0000","last_undegraded":"2023-11-28T11:55:08.956571+0000","last_fullsized":"2023-11-28T11:55:08.956571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:18:06.140768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.221964+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:55:06.221964+0000","last_peered":"2023-11-28T11:55:06.221964+0000","last_clean":"2023-11-28T11:55:06.221964+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:55:06.221964+0000","last_undegraded":"2023-11-28T11:55:06.221964+0000","last_fullsized":"2023-11-28T11:55:06.221964+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.959281+0000","last_change":"2023-11-28T11:55:06.244625+0000","last_active":"2023-11-28T11:55:08.959281+0000","last_peered":"2023-11-28T11:55:08.959281+0000","last_clean":"2023-11-28T11:55:08.959281+0000","last_became_active":"2023-11-28T11:55:06.244355+0000","last_became_peered":"2023-11-28T11:55:06.244355+0000","last_unstale":"2023-11-28T11:55:08.959281+0000","last_undegraded":"2023-11-28T11:55:08.959281+0000","last_fullsized":"2023-11-28T11:55:08.959281+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:02.211046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.454084+0000","last_change":"2023-11-28T11:55:05.846669+0000","last_active":"2023-11-28T11:55:08.454084+0000","last_peered":"2023-11-28T11:55:08.454084+0000","last_clean":"2023-11-28T11:55:08.454084+0000","last_became_active":"2023-11-28T11:55:05.846317+0000","last_became_peered":"2023-11-28T11:55:05.846317+0000","last_unstale":"2023-11-28T11:55:08.454084+0000","last_undegraded":"2023-11-28T11:55:08.454084+0000","last_fullsized":"2023-11-28T11:55:08.454084+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:46:52.941096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.213063+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:55:06.213063+0000","last_peered":"2023-11-28T11:55:06.213063+0000","last_clean":"2023-11-28T11:55:06.213063+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:55:06.213063+0000","last_undegraded":"2023-11-28T11:55:06.213063+0000","last_fullsized":"2023-11-28T11:55:06.213063+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:08.951558+0000","last_change":"2023-11-28T11:55:06.228062+0000","last_active":"2023-11-28T11:55:08.951558+0000","last_peered":"2023-11-28T11:55:08.951558+0000","last_clean":"2023-11-28T11:55:08.951558+0000","last_became_active":"2023-11-28T11:55:06.227802+0000","last_became_peered":"2023-11-28T11:55:06.227802+0000","last_unstale":"2023-11-28T11:55:08.951558+0000","last_undegraded":"2023-11-28T11:55:08.951558+0000","last_fullsized":"2023-11-28T11:55:08.951558+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:05.802469+0000","last_clean_scrub_stamp":"2023-11-28T11:55:05.802469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:10:20.888745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-28T11:55:07.220661+0000","last_change":"2023-11-28T11:55:05.846063+0000","last_active":"2023-11-28T11:55:07.220661+0000","last_peered":"2023-11-28T11:55:07.220661+0000","last_clean":"2023-11-28T11:55:07.220661+0000","last_became_active":"2023-11-28T11:55:05.845760+0000","last_became_peered":"2023-11-28T11:55:05.845760+0000","last_unstale":"2023-11-28T11:55:07.220661+0000","last_undegraded":"2023-11-28T11:55:07.220661+0000","last_fullsized":"2023-11-28T11:55:07.220661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:04.797251+0000","last_clean_scrub_stamp":"2023-11-28T11:55:04.797251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:13:02.340103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-28T11:55:06.220607+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:55:06.220607+0000","last_peered":"2023-11-28T11:55:06.220607+0000","last_clean":"2023-11-28T11:55:06.220607+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:55:06.220607+0000","last_undegraded":"2023-11-28T11:55:06.220607+0000","last_fullsized":"2023-11-28T11:55:06.220607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9744,"kb_used_data":1032,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362096,"statfs":{"total":96636764160,"available":96626786304,"internally_reserved":0,"allocated":1056768,"data_stored":798101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":1.1439999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.76100000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.0109999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.113}]},{"osd":4,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":1.048},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.1879999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.871},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.94899999999999995}]},{"osd":6,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.22},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.2390000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8592,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363248,"statfs":{"total":96636764160,"available":96627965952,"internally_reserved":0,"allocated":466944,"data_stored":208299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.93899999999999995}]},{"osd":1,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.012}]},{"osd":2,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.0580000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.755}]},{"osd":4,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.121},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.248}]},{"osd":5,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.1830000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.206},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.087}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8656,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363184,"statfs":{"total":96636764160,"available":96627900416,"internally_reserved":0,"allocated":466944,"data_stored":208699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.139}]},{"osd":1,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.0029999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":1.208},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.319}]},{"osd":4,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.107}]},{"osd":6,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.268},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.0629999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.605}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8792,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363048,"statfs":{"total":96636764160,"available":96627761152,"internally_reserved":0,"allocated":475136,"data_stored":210177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.71599999999999997}]},{"osd":1,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.85099999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.755}]},{"osd":3,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.98699999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.88500000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.0509999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.026}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8724,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363116,"statfs":{"total":96636764160,"available":96627830784,"internally_reserved":0,"allocated":471040,"data_stored":208265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66100000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.0429999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.997},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.96299999999999997}]},{"osd":4,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.0940000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.155},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":1.224}]},{"osd":6,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.2589999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.306}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8536,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363304,"statfs":{"total":96636764160,"available":96628023296,"internally_reserved":0,"allocated":475136,"data_stored":209213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.60399999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.72399999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.877},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.92900000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.135}]},{"osd":5,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.008},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.087}]},{"osd":6,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.1699999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":1.107}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13844,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":12800,"kb_avail":94357996,"statfs":{"total":96636764160,"available":96622587904,"internally_reserved":0,"allocated":1060864,"data_stored":799067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13107200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.623}]},{"osd":2,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.80700000000000005}]},{"osd":3,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.73099999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.29,"5min":2.29,"15min":2.29},"last":1.0289999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.879},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.91600000000000004}]},{"osd":6,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":1.0009999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:54:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":3.0209999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.143},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.052}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12880,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":12416,"kb_avail":94358960,"statfs":{"total":96636764160,"available":96623575040,"internally_reserved":0,"allocated":466944,"data_stored":208663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12713984},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.623}]},{"osd":2,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.57399999999999995}]},{"osd":3,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.77600000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.751},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.874}]},{"osd":5,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.81999999999999995}]},{"osd":6,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Tue Nov 28 11:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.0089999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:55:15.044 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T11:55:15.044 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-28T11:55:15.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efcef2e8700 1 Processor -- start 2023-11-28T11:55:15.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efcef2e8700 1 -- start start 2023-11-28T11:55:15.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efcef2e8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efce0038990 0x7efce0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:15.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efcef2e8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce0054660 con 0x7efce00e2ab0 2023-11-28T11:55:15.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efcef2e8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce00e71a0 con 0x7efce0008ad0 2023-11-28T11:55:15.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efcef2e8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce0039350 con 0x7efce0038990 2023-11-28T11:55:15.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efcedae5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efce0038990 0x7efce0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:15.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efcee2e6700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efce00e2ab0 0x7efce00e6630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50088/0 (socket says 172.21.15.50:50088) 2023-11-28T11:55:15.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efcee2e6700 1 -- 172.21.15.50:0/4142046552 learned_addr learned my addr 172.21.15.50:0/4142046552 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:15.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efced2e4700 1 -- 172.21.15.50:0/4142046552 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995393771 0 0) 0x7efce00e71a0 con 0x7efce0008ad0 2023-11-28T11:55:15.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efced2e4700 1 -- 172.21.15.50:0/4142046552 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcd40035d0 con 0x7efce0008ad0 2023-11-28T11:55:15.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efced2e4700 1 -- 172.21.15.50:0/4142046552 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807834274 0 0) 0x7efce0054660 con 0x7efce00e2ab0 2023-11-28T11:55:15.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efcedae5700 1 -- 172.21.15.50:0/4142046552 >> v1:172.21.15.192:6789/0 conn(0x7efce0008ad0 legacy=0x7efce0008ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:15.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efcedae5700 1 -- 172.21.15.50:0/4142046552 >> v1:172.21.15.50:6789/0 conn(0x7efce00e2ab0 legacy=0x7efce00e6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:15.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efcedae5700 1 -- 172.21.15.50:0/4142046552 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce0007ff0 con 0x7efce0038990 2023-11-28T11:55:15.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efcedae5700 1 --2- 172.21.15.50:0/4142046552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efce0038990 0x7efce0038e10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7efce4009850 tx=0x7efce4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ecbc2d30bc11f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:15.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efced2e4700 1 -- 172.21.15.50:0/4142046552 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4011830 con 0x7efce0038990 2023-11-28T11:55:15.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efced2e4700 1 -- 172.21.15.50:0/4142046552 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce4011990 con 0x7efce0038990 2023-11-28T11:55:15.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.171+0000 7efced2e4700 1 -- 172.21.15.50:0/4142046552 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4011d00 con 0x7efce0038990 2023-11-28T11:55:15.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.175+0000 7efcef2e8700 1 -- 172.21.15.50:0/4142046552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efce0038990 msgr2=0x7efce0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:15.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.175+0000 7efcef2e8700 1 --2- 172.21.15.50:0/4142046552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efce0038990 0x7efce0038e10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7efce4009850 tx=0x7efce4009b60 comp rx=0 tx=0).stop 2023-11-28T11:55:15.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.175+0000 7efcef2e8700 1 -- 172.21.15.50:0/4142046552 shutdown_connections 2023-11-28T11:55:15.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.175+0000 7efcef2e8700 1 --2- 172.21.15.50:0/4142046552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efce0038990 0x7efce0038e10 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.175+0000 7efcef2e8700 1 -- 172.21.15.50:0/4142046552 >> 172.21.15.50:0/4142046552 conn(0x7efce0057ba0 msgr2=0x7efce0053990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:15.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.175+0000 7efcef2e8700 1 -- 172.21.15.50:0/4142046552 shutdown_connections 2023-11-28T11:55:15.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.175+0000 7efcef2e8700 1 -- 172.21.15.50:0/4142046552 wait complete. 2023-11-28T11:55:15.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.175+0000 7efcef2e8700 1 Processor -- start 2023-11-28T11:55:15.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.175+0000 7efcef2e8700 1 -- start start 2023-11-28T11:55:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcef2e8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efce0008ad0 0x7efce00d2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcef2e8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efce0038990 0x7efce00e17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcef2e8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efce00e2ab0 0x7efce00e1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcef2e8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce00e5d00 con 0x7efce0008ad0 2023-11-28T11:55:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcef2e8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce00e32f0 con 0x7efce00e2ab0 2023-11-28T11:55:15.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcef2e8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce00e35d0 con 0x7efce0038990 2023-11-28T11:55:15.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcee2e6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efce0008ad0 0x7efce00d2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:15.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcedae5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efce0038990 0x7efce00e17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:15.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efceeae7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efce00e2ab0 0x7efce00e1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:15.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcedae5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efce0038990 0x7efce00e17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:43796/0 (socket says 172.21.15.50:43796) 2023-11-28T11:55:15.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcedae5700 1 -- 172.21.15.50:0/2585506936 learned_addr learned my addr 172.21.15.50:0/2585506936 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:15.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcedae5700 1 -- 172.21.15.50:0/2585506936 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efce00e2ab0 msgr2=0x7efce00e1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:15.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcedae5700 1 --2- 172.21.15.50:0/2585506936 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efce00e2ab0 0x7efce00e1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcedae5700 1 -- 172.21.15.50:0/2585506936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efce0008ad0 msgr2=0x7efce00d2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcedae5700 1 --2- 172.21.15.50:0/2585506936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efce0008ad0 0x7efce00d2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcedae5700 1 -- 172.21.15.50:0/2585506936 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce40094b0 con 0x7efce0038990 2023-11-28T11:55:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efceeae7700 1 --2- 172.21.15.50:0/2585506936 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efce00e2ab0 0x7efce00e1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcedae5700 1 --2- 172.21.15.50:0/2585506936 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efce0038990 0x7efce00e17d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efce40090b0 tx=0x7efce4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcdeffd700 1 -- 172.21.15.50:0/2585506936 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4004510 con 0x7efce0038990 2023-11-28T11:55:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcef2e8700 1 -- 172.21.15.50:0/2585506936 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce00085b0 con 0x7efce0038990 2023-11-28T11:55:15.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcdeffd700 1 -- 172.21.15.50:0/2585506936 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce401f070 con 0x7efce0038990 2023-11-28T11:55:15.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcdeffd700 1 -- 172.21.15.50:0/2585506936 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce40038c0 con 0x7efce0038990 2023-11-28T11:55:15.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcef2e8700 1 -- 172.21.15.50:0/2585506936 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce00082d0 con 0x7efce0038990 2023-11-28T11:55:15.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.179+0000 7efcef2e8700 1 -- 172.21.15.50:0/2585506936 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce00e7480 con 0x7efce0038990 2023-11-28T11:55:15.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.183+0000 7efcdeffd700 1 -- 172.21.15.50:0/2585506936 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efce400f050 con 0x7efce0038990 2023-11-28T11:55:15.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.183+0000 7efcdeffd700 1 --2- 172.21.15.50:0/2585506936 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efccc064ee0 0x7efccc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:15.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.183+0000 7efcdeffd700 1 -- 172.21.15.50:0/2585506936 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7efce4021070 con 0x7efce0038990 2023-11-28T11:55:15.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.183+0000 7efcee2e6700 1 --2- 172.21.15.50:0/2585506936 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efccc064ee0 0x7efccc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:15.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.183+0000 7efcee2e6700 1 --2- 172.21.15.50:0/2585506936 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efccc064ee0 0x7efccc067390 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efcd8000f60 tx=0x7efcd8004a70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:15.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.191+0000 7efcdeffd700 1 -- 172.21.15.50:0/2585506936 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efce4051630 con 0x7efce0038990 2023-11-28T11:55:15.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.419+0000 7efcef2e8700 1 -- 172.21.15.50:0/2585506936 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7efce0005990 con 0x7efce0038990 2023-11-28T11:55:15.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.427+0000 7efcdeffd700 1 -- 172.21.15.50:0/2585506936 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 184+0+0 (secure 0 0 0) 0x7efce4054c50 con 0x7efce0038990 2023-11-28T11:55:15.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.431+0000 7efcef2e8700 1 -- 172.21.15.50:0/2585506936 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efccc064ee0 msgr2=0x7efccc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:15.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.431+0000 7efcef2e8700 1 --2- 172.21.15.50:0/2585506936 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efccc064ee0 0x7efccc067390 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efcd8000f60 tx=0x7efcd8004a70 comp rx=0 tx=0).stop 2023-11-28T11:55:15.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.431+0000 7efcef2e8700 1 -- 172.21.15.50:0/2585506936 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efce0038990 msgr2=0x7efce00e17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:15.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.431+0000 7efcef2e8700 1 --2- 172.21.15.50:0/2585506936 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efce0038990 0x7efce00e17d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efce40090b0 tx=0x7efce4004770 comp rx=0 tx=0).stop 2023-11-28T11:55:15.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.431+0000 7efcef2e8700 1 -- 172.21.15.50:0/2585506936 shutdown_connections 2023-11-28T11:55:15.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.431+0000 7efcef2e8700 1 --2- 172.21.15.50:0/2585506936 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efccc064ee0 0x7efccc067390 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.431+0000 7efcef2e8700 1 --2- 172.21.15.50:0/2585506936 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efce00e2ab0 0x7efce00e1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.431+0000 7efcef2e8700 1 --2- 172.21.15.50:0/2585506936 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efce0038990 0x7efce00e17d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.431+0000 7efcef2e8700 1 --2- 172.21.15.50:0/2585506936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efce0008ad0 0x7efce00d2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.431+0000 7efcef2e8700 1 -- 172.21.15.50:0/2585506936 >> 172.21.15.50:0/2585506936 conn(0x7efce0057ba0 msgr2=0x7efce0051540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:15.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.431+0000 7efcef2e8700 1 -- 172.21.15.50:0/2585506936 shutdown_connections 2023-11-28T11:55:15.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.431+0000 7efcef2e8700 1 -- 172.21.15.50:0/2585506936 wait complete. 2023-11-28T11:55:15.435 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-11-28T11:55:15.446 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:55:15.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.559+0000 7fb0311c3700 1 Processor -- start 2023-11-28T11:55:15.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.559+0000 7fb0311c3700 1 -- start start 2023-11-28T11:55:15.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.559+0000 7fb0311c3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb02c0ae290 0x7fb02c0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:15.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.559+0000 7fb0311c3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c06b830 con 0x7fb02c15c300 2023-11-28T11:55:15.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.559+0000 7fb02bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb02c15c300 0x7fb02c06b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50096/0 (socket says 172.21.15.50:50096) 2023-11-28T11:55:15.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.559+0000 7fb02bfff700 1 -- 172.21.15.50:0/386896683 learned_addr learned my addr 172.21.15.50:0/386896683 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:15.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.559+0000 7fb0311c3700 1 -- 172.21.15.50:0/386896683 --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c06a080 con 0x7fb02c06c640 2023-11-28T11:55:15.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.559+0000 7fb0311c3700 1 -- 172.21.15.50:0/386896683 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c06ad00 con 0x7fb02c0ae290 2023-11-28T11:55:15.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.559+0000 7fb02b7fe700 1 --2- 172.21.15.50:0/386896683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb02c0ae290 0x7fb02c0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:15.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb02affd700 1 -- 172.21.15.50:0/386896683 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187024260 0 0) 0x7fb02c06b830 con 0x7fb02c15c300 2023-11-28T11:55:15.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb02affd700 1 -- 172.21.15.50:0/386896683 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0140035d0 con 0x7fb02c15c300 2023-11-28T11:55:15.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb02affd700 1 -- 172.21.15.50:0/386896683 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076686149 0 0) 0x7fb02c06a080 con 0x7fb02c06c640 2023-11-28T11:55:15.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb02affd700 1 -- 172.21.15.50:0/386896683 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb02c06b830 con 0x7fb02c06c640 2023-11-28T11:55:15.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb02affd700 1 -- 172.21.15.50:0/386896683 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3220025649 0 0) 0x7fb0140035d0 con 0x7fb02c15c300 2023-11-28T11:55:15.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb02b7fe700 1 -- 172.21.15.50:0/386896683 >> v1:172.21.15.192:6789/0 conn(0x7fb02c06c640 legacy=0x7fb02c0ab850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:15.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb02b7fe700 1 -- 172.21.15.50:0/386896683 >> v1:172.21.15.50:6789/0 conn(0x7fb02c15c300 legacy=0x7fb02c06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:15.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb02b7fe700 1 -- 172.21.15.50:0/386896683 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c06a360 con 0x7fb02c0ae290 2023-11-28T11:55:15.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb02b7fe700 1 --2- 172.21.15.50:0/386896683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb02c0ae290 0x7fb02c0adbb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb020009880 tx=0x7fb020009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=908f836839bc93e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:15.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb02affd700 1 -- 172.21.15.50:0/386896683 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c001670 con 0x7fb02c0ae290 2023-11-28T11:55:15.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb02affd700 1 -- 172.21.15.50:0/386896683 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb020004030 con 0x7fb02c0ae290 2023-11-28T11:55:15.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb02affd700 1 -- 172.21.15.50:0/386896683 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200043a0 con 0x7fb02c0ae290 2023-11-28T11:55:15.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb0311c3700 1 -- 172.21.15.50:0/386896683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb02c0ae290 msgr2=0x7fb02c0adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:15.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb0311c3700 1 --2- 172.21.15.50:0/386896683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb02c0ae290 0x7fb02c0adbb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb020009880 tx=0x7fb020009b90 comp rx=0 tx=0).stop 2023-11-28T11:55:15.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb0311c3700 1 -- 172.21.15.50:0/386896683 shutdown_connections 2023-11-28T11:55:15.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb0311c3700 1 --2- 172.21.15.50:0/386896683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb02c0ae290 0x7fb02c0adbb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb0311c3700 1 -- 172.21.15.50:0/386896683 >> 172.21.15.50:0/386896683 conn(0x7fb02c06e000 msgr2=0x7fb02c0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:15.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb0311c3700 1 -- 172.21.15.50:0/386896683 shutdown_connections 2023-11-28T11:55:15.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.563+0000 7fb0311c3700 1 -- 172.21.15.50:0/386896683 wait complete. 2023-11-28T11:55:15.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.567+0000 7fb0311c3700 1 Processor -- start 2023-11-28T11:55:15.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.567+0000 7fb0311c3700 1 -- start start 2023-11-28T11:55:15.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.567+0000 7fb0311c3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb02c06c640 0x7fb02c1e6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:15.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.567+0000 7fb0311c3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb02c0ae290 0x7fb02c15d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:15.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.567+0000 7fb0311c3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb02c15c300 0x7fb02c15e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:15.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb0311c3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c15ed30 con 0x7fb02c0ae290 2023-11-28T11:55:15.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb0311c3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c15c6d0 con 0x7fb02c06c640 2023-11-28T11:55:15.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb0311c3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c15c9b0 con 0x7fb02c15c300 2023-11-28T11:55:15.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb02b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb02c0ae290 0x7fb02c15d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:15.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb02b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb02c0ae290 0x7fb02c15d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49132/0 (socket says 172.21.15.50:49132) 2023-11-28T11:55:15.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb02b7fe700 1 -- 172.21.15.50:0/2654139744 learned_addr learned my addr 172.21.15.50:0/2654139744 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:15.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb02bfff700 1 --2- 172.21.15.50:0/2654139744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb02c06c640 0x7fb02c1e6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:15.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb0309c2700 1 --2- 172.21.15.50:0/2654139744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb02c15c300 0x7fb02c15e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:15.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb02b7fe700 1 -- 172.21.15.50:0/2654139744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb02c15c300 msgr2=0x7fb02c15e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:15.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb02b7fe700 1 --2- 172.21.15.50:0/2654139744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb02c15c300 0x7fb02c15e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb02b7fe700 1 -- 172.21.15.50:0/2654139744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb02c06c640 msgr2=0x7fb02c1e6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb02b7fe700 1 --2- 172.21.15.50:0/2654139744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb02c06c640 0x7fb02c1e6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb02b7fe700 1 -- 172.21.15.50:0/2654139744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0200094b0 con 0x7fb02c0ae290 2023-11-28T11:55:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb02b7fe700 1 --2- 172.21.15.50:0/2654139744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb02c0ae290 0x7fb02c15d490 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb020000c00 tx=0x7fb020004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb028ff9700 1 -- 172.21.15.50:0/2654139744 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200045b0 con 0x7fb02c0ae290 2023-11-28T11:55:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb028ff9700 1 -- 172.21.15.50:0/2654139744 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb020003d00 con 0x7fb02c0ae290 2023-11-28T11:55:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb0311c3700 1 -- 172.21.15.50:0/2654139744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c06a920 con 0x7fb02c0ae290 2023-11-28T11:55:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb028ff9700 1 -- 172.21.15.50:0/2654139744 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020011870 con 0x7fb02c0ae290 2023-11-28T11:55:15.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb0311c3700 1 -- 172.21.15.50:0/2654139744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c06a640 con 0x7fb02c0ae290 2023-11-28T11:55:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.571+0000 7fb0311c3700 1 -- 172.21.15.50:0/2654139744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c0abf60 con 0x7fb02c0ae290 2023-11-28T11:55:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.575+0000 7fb028ff9700 1 -- 172.21.15.50:0/2654139744 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb02002c070 con 0x7fb02c0ae290 2023-11-28T11:55:15.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.575+0000 7fb028ff9700 1 --2- 172.21.15.50:0/2654139744 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb018064ee0 0x7fb018067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:15.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.575+0000 7fb028ff9700 1 -- 172.21.15.50:0/2654139744 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb020082b10 con 0x7fb02c0ae290 2023-11-28T11:55:15.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.575+0000 7fb02bfff700 1 --2- 172.21.15.50:0/2654139744 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb018064ee0 0x7fb018067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.575+0000 7fb02bfff700 1 --2- 172.21.15.50:0/2654139744 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb018064ee0 0x7fb018067390 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb02c1f4ad0 tx=0x7fb01c000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.579+0000 7fb028ff9700 1 -- 172.21.15.50:0/2654139744 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb020050b70 con 0x7fb02c0ae290 2023-11-28T11:55:15.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.771+0000 7fb0311c3700 1 -- 172.21.15.50:0/2654139744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb02c15f9c0 con 0x7fb02c0ae290 2023-11-28T11:55:15.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.771+0000 7fb028ff9700 1 -- 172.21.15.50:0/2654139744 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fb020054190 con 0x7fb02c0ae290 2023-11-28T11:55:15.774 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:15.774 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2392153383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2392153383},{"type":"v1","addr":"172.21.15.192:6837","nonce":2392153383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5515,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3694451276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3694451276},{"type":"v1","addr":"172.21.15.192:6835","nonce":3694451276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2782289763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2782289763},{"type":"v1","addr":"172.21.15.50:6833","nonce":2782289763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:55:06.200530+0000","modified":"2023-11-28T11:55:09.218769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5559},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5559":{"gid":5559,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2320802269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2320802269},{"type":"v1","addr":"172.21.15.50:6835","nonce":2320802269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:55:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.771+0000 7fb0311c3700 1 -- 172.21.15.50:0/2654139744 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb018064ee0 msgr2=0x7fb018067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.771+0000 7fb0311c3700 1 --2- 172.21.15.50:0/2654139744 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb018064ee0 0x7fb018067390 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb02c1f4ad0 tx=0x7fb01c000bc0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.771+0000 7fb0311c3700 1 -- 172.21.15.50:0/2654139744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb02c0ae290 msgr2=0x7fb02c15d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.771+0000 7fb0311c3700 1 --2- 172.21.15.50:0/2654139744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb02c0ae290 0x7fb02c15d490 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb020000c00 tx=0x7fb020004770 comp rx=0 tx=0).stop 2023-11-28T11:55:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.771+0000 7fb0311c3700 1 -- 172.21.15.50:0/2654139744 shutdown_connections 2023-11-28T11:55:15.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.771+0000 7fb0311c3700 1 --2- 172.21.15.50:0/2654139744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb02c15c300 0x7fb02c15e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.771+0000 7fb0311c3700 1 --2- 172.21.15.50:0/2654139744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb02c0ae290 0x7fb02c15d490 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.771+0000 7fb0311c3700 1 --2- 172.21.15.50:0/2654139744 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb018064ee0 0x7fb018067390 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.771+0000 7fb0311c3700 1 --2- 172.21.15.50:0/2654139744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb02c06c640 0x7fb02c1e6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:15.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.771+0000 7fb0311c3700 1 -- 172.21.15.50:0/2654139744 >> 172.21.15.50:0/2654139744 conn(0x7fb02c06e000 msgr2=0x7fb02c15aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:15.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.771+0000 7fb0311c3700 1 -- 172.21.15.50:0/2654139744 shutdown_connections 2023-11-28T11:55:15.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:15.771+0000 7fb0311c3700 1 -- 172.21.15.50:0/2654139744 wait complete. 2023-11-28T11:55:15.776 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-11-28T11:55:16.190 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T11:55:06.200530+0000', 'modified': '2023-11-28T11:55:09.218769+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5559}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5559': {'gid': 5559, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/2320802269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 2320802269}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 2320802269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T11:55:16.190 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T11:55:16.190 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-28T11:55:16.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4798b11700 1 Processor -- start 2023-11-28T11:55:16.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4798b11700 1 -- start start 2023-11-28T11:55:16.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4798b11700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47941606b0 0x7f47940c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4798b11700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47940ad610 0x7f47940c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4798b11700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47940cae70 con 0x7f47940ceef0 2023-11-28T11:55:16.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4798b11700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47940cbc10 con 0x7f47941606b0 2023-11-28T11:55:16.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4798b11700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47940cb130 con 0x7f47940ad610 2023-11-28T11:55:16.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f47937fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47941606b0 0x7f47940c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f47937fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f47941606b0 0x7f47940c13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49142/0 (socket says 172.21.15.50:49142) 2023-11-28T11:55:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f47937fe700 1 -- 172.21.15.50:0/3488747747 learned_addr learned my addr 172.21.15.50:0/3488747747 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4793fff700 1 --2- 172.21.15.50:0/3488747747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47940ad610 0x7f47940c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f47937fe700 1 -- 172.21.15.50:0/3488747747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47940ad610 msgr2=0x7f47940c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f47937fe700 1 --2- 172.21.15.50:0/3488747747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47940ad610 0x7f47940c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f47937fe700 1 -- 172.21.15.50:0/3488747747 >> v1:172.21.15.192:6789/0 conn(0x7f47940ceef0 legacy=0x7f4794164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:16.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f47937fe700 1 -- 172.21.15.50:0/3488747747 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47940cb410 con 0x7f47941606b0 2023-11-28T11:55:16.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f47937fe700 1 --2- 172.21.15.50:0/3488747747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47941606b0 0x7f47940c13b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4784009910 tx=0x7f4784009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d8e2a594aff658 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:16.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4792ffd700 1 -- 172.21.15.50:0/3488747747 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478400ba60 con 0x7f47941606b0 2023-11-28T11:55:16.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4792ffd700 1 -- 172.21.15.50:0/3488747747 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478400bbc0 con 0x7f47941606b0 2023-11-28T11:55:16.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4792ffd700 1 -- 172.21.15.50:0/3488747747 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784009e60 con 0x7f47941606b0 2023-11-28T11:55:16.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4798b11700 1 -- 172.21.15.50:0/3488747747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47941606b0 msgr2=0x7f47940c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:16.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4798b11700 1 --2- 172.21.15.50:0/3488747747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47941606b0 0x7f47940c13b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4784009910 tx=0x7f4784009c20 comp rx=0 tx=0).stop 2023-11-28T11:55:16.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4798b11700 1 -- 172.21.15.50:0/3488747747 shutdown_connections 2023-11-28T11:55:16.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4798b11700 1 --2- 172.21.15.50:0/3488747747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47940ad610 0x7f47940c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4798b11700 1 --2- 172.21.15.50:0/3488747747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47941606b0 0x7f47940c13b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4798b11700 1 -- 172.21.15.50:0/3488747747 >> 172.21.15.50:0/3488747747 conn(0x7f47940ce3e0 msgr2=0x7f47940ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:16.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4798b11700 1 -- 172.21.15.50:0/3488747747 shutdown_connections 2023-11-28T11:55:16.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.319+0000 7f4798b11700 1 -- 172.21.15.50:0/3488747747 wait complete. 2023-11-28T11:55:16.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f4798b11700 1 Processor -- start 2023-11-28T11:55:16.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f4798b11700 1 -- start start 2023-11-28T11:55:16.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f4798b11700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47940ad610 0x7f47941596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f4798b11700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47940ceef0 0x7f479415ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f4798b11700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47941606b0 0x7f47940c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f4798b11700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4794159c10 con 0x7f47940ad610 2023-11-28T11:55:16.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f4798b11700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47940c3fd0 con 0x7f47940ceef0 2023-11-28T11:55:16.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f4798b11700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47940c33c0 con 0x7f47941606b0 2023-11-28T11:55:16.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f47937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47940ad610 0x7f47941596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f47937fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47940ad610 0x7f47941596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49144/0 (socket says 172.21.15.50:49144) 2023-11-28T11:55:16.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f47937fe700 1 -- 172.21.15.50:0/3020886683 learned_addr learned my addr 172.21.15.50:0/3020886683 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:16.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f478affd700 1 --2- 172.21.15.50:0/3020886683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47940ceef0 0x7f479415ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f4793fff700 1 --2- 172.21.15.50:0/3020886683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47941606b0 0x7f47940c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f47937fe700 1 -- 172.21.15.50:0/3020886683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47941606b0 msgr2=0x7f47940c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:16.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f47937fe700 1 --2- 172.21.15.50:0/3020886683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47941606b0 0x7f47940c4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f47937fe700 1 -- 172.21.15.50:0/3020886683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47940ceef0 msgr2=0x7f479415ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:16.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f47937fe700 1 --2- 172.21.15.50:0/3020886683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47940ceef0 0x7f479415ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f47937fe700 1 -- 172.21.15.50:0/3020886683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4784009570 con 0x7f47940ad610 2023-11-28T11:55:16.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f47937fe700 1 --2- 172.21.15.50:0/3020886683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47940ad610 0x7f47941596d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4784014040 tx=0x7f4784004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:16.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.323+0000 7f4790ff9700 1 -- 172.21.15.50:0/3020886683 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784004510 con 0x7f47940ad610 2023-11-28T11:55:16.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.327+0000 7f4790ff9700 1 -- 172.21.15.50:0/3020886683 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478401e070 con 0x7f47940ad610 2023-11-28T11:55:16.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.327+0000 7f4798b11700 1 -- 172.21.15.50:0/3020886683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479406ac50 con 0x7f47940ad610 2023-11-28T11:55:16.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.327+0000 7f4790ff9700 1 -- 172.21.15.50:0/3020886683 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784003900 con 0x7f47940ad610 2023-11-28T11:55:16.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.327+0000 7f4798b11700 1 -- 172.21.15.50:0/3020886683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47940cb6f0 con 0x7f47940ad610 2023-11-28T11:55:16.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.327+0000 7f4790ff9700 1 -- 172.21.15.50:0/3020886683 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f478400f050 con 0x7f47940ad610 2023-11-28T11:55:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.327+0000 7f4790ff9700 1 --2- 172.21.15.50:0/3020886683 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4774064ee0 0x7f4774067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.327+0000 7f4790ff9700 1 -- 172.21.15.50:0/3020886683 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4784020070 con 0x7f47940ad610 2023-11-28T11:55:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f478affd700 1 --2- 172.21.15.50:0/3020886683 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4774064ee0 0x7f4774067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f479cff3740 1 Processor -- start 2023-11-28T11:55:16.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f478affd700 1 --2- 172.21.15.50:0/3020886683 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4774064ee0 0x7f4774067390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f47941f9210 tx=0x7f477c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:16.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f479cff3740 1 -- start start 2023-11-28T11:55:16.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f479cff3740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x101cae0 0x12cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f479cff3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101c710 0x12cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f479cff3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1067790 0x12cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f479cff3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x118bae0 con 0x101c710 2023-11-28T11:55:16.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f479cff3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x11fbbd0 con 0x1067790 2023-11-28T11:55:16.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f479cff3740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x11f4ed0 con 0x101cae0 2023-11-28T11:55:16.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f478affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101c710 0x12cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f4793fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1067790 0x12cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f47937fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x101cae0 0x12cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f4793fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1067790 0x12cd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:54194/0 (socket says 172.21.15.50:54194) 2023-11-28T11:55:16.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f478affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101c710 0x12cd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49148/0 (socket says 172.21.15.50:49148) 2023-11-28T11:55:16.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f4793fff700 1 -- 172.21.15.50:0/3923848382 learned_addr learned my addr 172.21.15.50:0/3923848382 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:16.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f4793fff700 1 -- 172.21.15.50:0/3923848382 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x101cae0 msgr2=0x12cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f4793fff700 1 --2- 172.21.15.50:0/3923848382 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x101cae0 0x12cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f4793fff700 1 -- 172.21.15.50:0/3923848382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101c710 msgr2=0x12cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f4793fff700 1 --2- 172.21.15.50:0/3923848382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101c710 0x12cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f4793fff700 1 -- 172.21.15.50:0/3923848382 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x121acc0 con 0x1067790 2023-11-28T11:55:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.331+0000 7f4793fff700 1 --2- 172.21.15.50:0/3923848382 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1067790 0x12cd880 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f478c009fd0 tx=0x7f478c003d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=374e88962c993b09 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f47897fa700 1 -- 172.21.15.50:0/3923848382 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c003eb0 con 0x1067790 2023-11-28T11:55:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f47897fa700 1 -- 172.21.15.50:0/3923848382 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c004740 con 0x1067790 2023-11-28T11:55:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f47897fa700 1 -- 172.21.15.50:0/3923848382 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c015420 con 0x1067790 2023-11-28T11:55:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 1 -- 172.21.15.50:0/3923848382 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1067790 msgr2=0x12cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 1 --2- 172.21.15.50:0/3923848382 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1067790 0x12cd880 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f478c009fd0 tx=0x7f478c003d20 comp rx=0 tx=0).stop 2023-11-28T11:55:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 1 -- 172.21.15.50:0/3923848382 shutdown_connections 2023-11-28T11:55:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 1 --2- 172.21.15.50:0/3923848382 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1067790 0x12cd880 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 1 --2- 172.21.15.50:0/3923848382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101c710 0x12cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 1 --2- 172.21.15.50:0/3923848382 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x101cae0 0x12cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 1 -- 172.21.15.50:0/3923848382 >> 172.21.15.50:0/3923848382 conn(0x101ceb0 msgr2=0x12b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 1 -- 172.21.15.50:0/3923848382 shutdown_connections 2023-11-28T11:55:16.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 1 -- 172.21.15.50:0/3923848382 wait complete. 2023-11-28T11:55:16.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 1 -- start start 2023-11-28T11:55:16.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 1 Processor -- start 2023-11-28T11:55:16.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x101c710 0x12b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101cae0 0x12ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1067790 0x128e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x10a1b20 con 0x101cae0 2023-11-28T11:55:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x128cc10 con 0x101c710 2023-11-28T11:55:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x128ceb0 con 0x1067790 2023-11-28T11:55:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f479cff3740 10 client.0 _ll_register_callbacks cb 0x12510d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:55:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f478affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101cae0 0x12ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f478affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101cae0 0x12ce8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49164/0 (socket says 172.21.15.50:49164) 2023-11-28T11:55:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f47937fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x101c710 0x12b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f478affd700 1 -- 172.21.15.50:0/3562146783 learned_addr learned my addr 172.21.15.50:0/3562146783 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f4793fff700 1 --2- 172.21.15.50:0/3562146783 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1067790 0x128e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f47937fe700 1 -- 172.21.15.50:0/3562146783 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1067790 msgr2=0x128e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.335+0000 7f47937fe700 1 --2- 172.21.15.50:0/3562146783 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1067790 0x128e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f47937fe700 1 -- 172.21.15.50:0/3562146783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101cae0 msgr2=0x12ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:16.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f47937fe700 1 --2- 172.21.15.50:0/3562146783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101cae0 0x12ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f47937fe700 1 -- 172.21.15.50:0/3562146783 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f478c011040 con 0x101c710 2023-11-28T11:55:16.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f478affd700 1 --2- 172.21.15.50:0/3562146783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101cae0 0x12ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:16.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f47937fe700 1 --2- 172.21.15.50:0/3562146783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x101c710 0x12b3c90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f478405cc50 tx=0x7f4784054ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9a0bbfd68af728 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:16.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f47727fc700 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2023-11-28T11:55:16.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f47727fc700 1 -- 172.21.15.50:0/3562146783 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47840548b0 con 0x101c710 2023-11-28T11:55:16.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f47727fc700 1 -- 172.21.15.50:0/3562146783 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f478405cef0 con 0x101c710 2023-11-28T11:55:16.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 1 -- 172.21.15.50:0/3562146783 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x11edf50 con 0x101c710 2023-11-28T11:55:16.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f47727fc700 1 -- 172.21.15.50:0/3562146783 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f478406c0d0 con 0x101c710 2023-11-28T11:55:16.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 10 client.5716 fetch_fsmap learned FSMap version 17 2023-11-28T11:55:16.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 1 -- 172.21.15.50:0/3562146783 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x10689e0 con 0x101c710 2023-11-28T11:55:16.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f47727fc700 1 -- 172.21.15.50:0/3562146783 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x11edf50 con 0x101c710 2023-11-28T11:55:16.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f47727fc700 1 -- 172.21.15.50:0/3562146783 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 17) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f478405ed20 con 0x101c710 2023-11-28T11:55:16.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 10 client.5716 fetch_fsmap finished waiting for FSMap version 17 2023-11-28T11:55:16.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 10 client.5716 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T11:55:16.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 20 client.5716 populate_metadata read hostname 'smithi050' 2023-11-28T11:55:16.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 1 --2- 172.21.15.50:0/3562146783 >> [v2:172.21.15.50:6834/2320802269,v1:172.21.15.50:6835/2320802269] conn(0x128b710 0x12e6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 4 client.5716 mds_command: new command op to 5559 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:55:16.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 1 -- 172.21.15.50:0/3562146783 --> [v2:172.21.15.50:6834/2320802269,v1:172.21.15.50:6835/2320802269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x11edc70 con 0x128b710 2023-11-28T11:55:16.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f478affd700 1 --2- 172.21.15.50:0/3562146783 >> [v2:172.21.15.50:6834/2320802269,v1:172.21.15.50:6835/2320802269] conn(0x128b710 0x12e6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f47727fc700 10 client.5716 ms_handle_connect on v2:172.21.15.50:6834/2320802269 2023-11-28T11:55:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f478affd700 1 --2- 172.21.15.50:0/3562146783 >> [v2:172.21.15.50:6834/2320802269,v1:172.21.15.50:6835/2320802269] conn(0x128b710 0x12e6fa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=455add838b9fa040 server_cookie=49a1e4eba0f200b3 in_seq=0 out_seq=0 2023-11-28T11:55:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f47727fc700 1 -- 172.21.15.50:0/3562146783 <== mds.0 v2:172.21.15.50:6834/2320802269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x11edc70 con 0x128b710 2023-11-28T11:55:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f47727fc700 10 client.5716 handle_command_reply: tid=0 2023-11-28T11:55:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 1 client.5716 shutdown 2023-11-28T11:55:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 1 -- 172.21.15.50:0/3562146783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x101c710 msgr2=0x12b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 1 --2- 172.21.15.50:0/3562146783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x101c710 0x12b3c90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f478405cc50 tx=0x7f4784054ac0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 1 -- 172.21.15.50:0/3562146783 shutdown_connections 2023-11-28T11:55:16.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 1 --2- 172.21.15.50:0/3562146783 >> [v2:172.21.15.50:6834/2320802269,v1:172.21.15.50:6835/2320802269] conn(0x128b710 0x12e6fa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 1 --2- 172.21.15.50:0/3562146783 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1067790 0x128e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f47727fc700 0 client.5716 ms_handle_reset on v2:172.21.15.50:6834/2320802269 2023-11-28T11:55:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 1 --2- 172.21.15.50:0/3562146783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101cae0 0x12ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 1 --2- 172.21.15.50:0/3562146783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x101c710 0x12b3c90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.339+0000 7f479cff3740 1 -- 172.21.15.50:0/3562146783 >> 172.21.15.50:0/3562146783 conn(0x101ceb0 msgr2=0x12b57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.343+0000 7f479cff3740 1 -- 172.21.15.50:0/3562146783 shutdown_connections 2023-11-28T11:55:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.343+0000 7f479cff3740 1 -- 172.21.15.50:0/3562146783 wait complete. 2023-11-28T11:55:16.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.343+0000 7f479cff3740 20 client.5716 trim_cache size 0 max 16384 2023-11-28T11:55:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.363+0000 7f479cff3740 1 Processor -- start 2023-11-28T11:55:16.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.363+0000 7f479cff3740 1 -- start start 2023-11-28T11:55:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.363+0000 7f479cff3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x101c710 0x12e2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.363+0000 7f479cff3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101cae0 0x12e31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.363+0000 7f479cff3740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1067790 0x12dab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.363+0000 7f479cff3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x11f26e0 con 0x101cae0 2023-11-28T11:55:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.363+0000 7f479cff3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x11f0840 con 0x101c710 2023-11-28T11:55:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.363+0000 7f479cff3740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x11f7a30 con 0x1067790 2023-11-28T11:55:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.363+0000 7f478affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101cae0 0x12e31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.363+0000 7f478affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101cae0 0x12e31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49180/0 (socket says 172.21.15.50:49180) 2023-11-28T11:55:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.363+0000 7f478affd700 1 -- 172.21.15.50:0/2878994486 learned_addr learned my addr 172.21.15.50:0/2878994486 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:16.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.363+0000 7f4793fff700 1 --2- 172.21.15.50:0/2878994486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1067790 0x12dab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.363+0000 7f47937fe700 1 --2- 172.21.15.50:0/2878994486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x101c710 0x12e2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f478affd700 1 -- 172.21.15.50:0/2878994486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1067790 msgr2=0x12dab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:16.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f478affd700 1 --2- 172.21.15.50:0/2878994486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1067790 0x12dab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f478affd700 1 -- 172.21.15.50:0/2878994486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x101c710 msgr2=0x12e2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:16.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f478affd700 1 --2- 172.21.15.50:0/2878994486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x101c710 0x12e2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f478affd700 1 -- 172.21.15.50:0/2878994486 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47940c4d00 con 0x101cae0 2023-11-28T11:55:16.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f4793fff700 1 --2- 172.21.15.50:0/2878994486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1067790 0x12dab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:16.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f478affd700 1 --2- 172.21.15.50:0/2878994486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101cae0 0x12e31f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x128d5c0 tx=0x7f477c00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f156879f0e1bc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:16.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f4789ffb700 1 -- 172.21.15.50:0/2878994486 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c028040 con 0x101cae0 2023-11-28T11:55:16.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f4789ffb700 1 -- 172.21.15.50:0/2878994486 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c0160d0 con 0x101cae0 2023-11-28T11:55:16.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f4789ffb700 1 -- 172.21.15.50:0/2878994486 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c029440 con 0x101cae0 2023-11-28T11:55:16.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f479cff3740 1 -- 172.21.15.50:0/2878994486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101cae0 msgr2=0x12e31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:16.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f479cff3740 1 --2- 172.21.15.50:0/2878994486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101cae0 0x12e31f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x128d5c0 tx=0x7f477c00a000 comp rx=0 tx=0).stop 2023-11-28T11:55:16.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f479cff3740 1 -- 172.21.15.50:0/2878994486 shutdown_connections 2023-11-28T11:55:16.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f479cff3740 1 --2- 172.21.15.50:0/2878994486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1067790 0x12dab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f479cff3740 1 --2- 172.21.15.50:0/2878994486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x101cae0 0x12e31f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f479cff3740 1 --2- 172.21.15.50:0/2878994486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x101c710 0x12e2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f479cff3740 1 -- 172.21.15.50:0/2878994486 >> 172.21.15.50:0/2878994486 conn(0x101ceb0 msgr2=0x128c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:16.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f479cff3740 1 -- 172.21.15.50:0/2878994486 shutdown_connections 2023-11-28T11:55:16.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f479cff3740 1 -- 172.21.15.50:0/2878994486 wait complete. 2023-11-28T11:55:16.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.367+0000 7f479cff3740 1 -- start start 2023-11-28T11:55:16.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f479cff3740 1 Processor -- start 2023-11-28T11:55:16.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f479cff3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x101c710 0x12e6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f479cff3740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x101cae0 0x12dc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f479cff3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1067790 0x12e5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f479cff3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x11cade0 con 0x1067790 2023-11-28T11:55:16.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f479cff3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x12b5a90 con 0x101c710 2023-11-28T11:55:16.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f479cff3740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x12cb910 con 0x101cae0 2023-11-28T11:55:16.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f479cff3740 10 client.0 _ll_register_callbacks cb 0x11a12d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:55:16.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f4793fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1067790 0x12e5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f47937fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x101c710 0x12e6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f4793fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1067790 0x12e5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49194/0 (socket says 172.21.15.50:49194) 2023-11-28T11:55:16.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f4793fff700 1 -- 172.21.15.50:0/1938140131 learned_addr learned my addr 172.21.15.50:0/1938140131 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:16.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f478affd700 1 --2- 172.21.15.50:0/1938140131 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x101cae0 0x12dc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f4793fff700 1 -- 172.21.15.50:0/1938140131 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x101cae0 msgr2=0x12dc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:16.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f4793fff700 1 --2- 172.21.15.50:0/1938140131 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x101cae0 0x12dc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f4793fff700 1 -- 172.21.15.50:0/1938140131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x101c710 msgr2=0x12e6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:16.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f4793fff700 1 --2- 172.21.15.50:0/1938140131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x101c710 0x12e6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f4793fff700 1 -- 172.21.15.50:0/1938140131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x121acc0 con 0x1067790 2023-11-28T11:55:16.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f47937fe700 1 --2- 172.21.15.50:0/1938140131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x101c710 0x12e6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:16.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f4793fff700 1 --2- 172.21.15.50:0/1938140131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1067790 0x12e5d20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f478c004320 tx=0x7f478c004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2748842f76d14bb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:16.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f47727fc700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:55:16.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f47727fc700 1 -- 172.21.15.50:0/1938140131 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c025070 con 0x1067790 2023-11-28T11:55:16.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f47727fc700 1 -- 172.21.15.50:0/1938140131 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f478c015630 con 0x1067790 2023-11-28T11:55:16.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f479cff3740 1 -- 172.21.15.50:0/1938140131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f478c004740 con 0x1067790 2023-11-28T11:55:16.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f47727fc700 1 -- 172.21.15.50:0/1938140131 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f478c004980 con 0x1067790 2023-11-28T11:55:16.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f479cff3740 10 client.5766 fetch_fsmap learned FSMap version 17 2023-11-28T11:55:16.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.371+0000 7f479cff3740 1 -- 172.21.15.50:0/1938140131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7f47940cae70 con 0x1067790 2023-11-28T11:55:16.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f47727fc700 1 -- 172.21.15.50:0/1938140131 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c004740 con 0x1067790 2023-11-28T11:55:16.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f47727fc700 1 -- 172.21.15.50:0/1938140131 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 17) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f478c0157f0 con 0x1067790 2023-11-28T11:55:16.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 10 client.5766 fetch_fsmap finished waiting for FSMap version 17 2023-11-28T11:55:16.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 10 client.5766 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T11:55:16.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 20 client.5766 populate_metadata read hostname 'smithi050' 2023-11-28T11:55:16.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 1 --2- 172.21.15.50:0/1938140131 >> [v2:172.21.15.50:6834/2320802269,v1:172.21.15.50:6835/2320802269] conn(0x12e7570 0x12e7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 4 client.5766 mds_command: new command op to 5559 tid=0[{"prefix": "status"}] 2023-11-28T11:55:16.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 1 -- 172.21.15.50:0/1938140131 --> [v2:172.21.15.50:6834/2320802269,v1:172.21.15.50:6835/2320802269] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1099260 con 0x12e7570 2023-11-28T11:55:16.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f47937fe700 1 --2- 172.21.15.50:0/1938140131 >> [v2:172.21.15.50:6834/2320802269,v1:172.21.15.50:6835/2320802269] conn(0x12e7570 0x12e7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f47727fc700 10 client.5766 ms_handle_connect on v2:172.21.15.50:6834/2320802269 2023-11-28T11:55:16.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f47937fe700 1 --2- 172.21.15.50:0/1938140131 >> [v2:172.21.15.50:6834/2320802269,v1:172.21.15.50:6835/2320802269] conn(0x12e7570 0x12e7940 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cf2a8d28a88e3b1 server_cookie=3aaf2e9c1b7e4e3c in_seq=0 out_seq=0 2023-11-28T11:55:16.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f47727fc700 1 -- 172.21.15.50:0/1938140131 <== mds.0 v2:172.21.15.50:6834/2320802269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x1099260 con 0x12e7570 2023-11-28T11:55:16.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f47727fc700 10 client.5766 handle_command_reply: tid=0 2023-11-28T11:55:16.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 1 client.5766 shutdown 2023-11-28T11:55:16.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 1 -- 172.21.15.50:0/1938140131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1067790 msgr2=0x12e5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:16.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 1 --2- 172.21.15.50:0/1938140131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1067790 0x12e5d20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f478c004320 tx=0x7f478c004b60 comp rx=0 tx=0).stop 2023-11-28T11:55:16.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 1 -- 172.21.15.50:0/1938140131 shutdown_connections 2023-11-28T11:55:16.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 1 --2- 172.21.15.50:0/1938140131 >> [v2:172.21.15.50:6834/2320802269,v1:172.21.15.50:6835/2320802269] conn(0x12e7570 0x12e7940 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 1 --2- 172.21.15.50:0/1938140131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1067790 0x12e5d20 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 1 --2- 172.21.15.50:0/1938140131 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x101cae0 0x12dc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 1 --2- 172.21.15.50:0/1938140131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x101c710 0x12e6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f47727fc700 0 client.5766 ms_handle_reset on v2:172.21.15.50:6834/2320802269 2023-11-28T11:55:16.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 1 -- 172.21.15.50:0/1938140131 >> 172.21.15.50:0/1938140131 conn(0x101ceb0 msgr2=0x12e2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:16.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 1 -- 172.21.15.50:0/1938140131 shutdown_connections 2023-11-28T11:55:16.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 1 -- 172.21.15.50:0/1938140131 wait complete. 2023-11-28T11:55:16.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f479cff3740 20 client.5766 trim_cache size 0 max 16384 2023-11-28T11:55:16.382 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:55:16.382 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "cfe07b6e-9334-49cb-bc97-5dba7caa4ff8", 2023-11-28T11:55:16.382 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-11-28T11:55:16.382 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 5559, 2023-11-28T11:55:16.382 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-11-28T11:55:16.383 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-11-28T11:55:16.383 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-11-28T11:55:16.383 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 10.172445417, 2023-11-28T11:55:16.383 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 17, 2023-11-28T11:55:16.383 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 40, 2023-11-28T11:55:16.383 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 40, 2023-11-28T11:55:16.383 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 17.939299955999999 2023-11-28T11:55:16.383 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:55:16.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f4798b11700 1 -- 172.21.15.50:0/3020886683 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4774064ee0 msgr2=0x7f4774067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:16.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f4798b11700 1 --2- 172.21.15.50:0/3020886683 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4774064ee0 0x7f4774067390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f47941f9210 tx=0x7f477c009040 comp rx=0 tx=0).stop 2023-11-28T11:55:16.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f4798b11700 1 -- 172.21.15.50:0/3020886683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47940ad610 msgr2=0x7f47941596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:16.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f4798b11700 1 --2- 172.21.15.50:0/3020886683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47940ad610 0x7f47941596d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4784014040 tx=0x7f4784004770 comp rx=0 tx=0).stop 2023-11-28T11:55:16.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f4798b11700 1 -- 172.21.15.50:0/3020886683 shutdown_connections 2023-11-28T11:55:16.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f4798b11700 1 --2- 172.21.15.50:0/3020886683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47941606b0 0x7f47940c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f4798b11700 1 --2- 172.21.15.50:0/3020886683 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4774064ee0 0x7f4774067390 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f4798b11700 1 --2- 172.21.15.50:0/3020886683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47940ceef0 0x7f479415ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f4798b11700 1 --2- 172.21.15.50:0/3020886683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47940ad610 0x7f47941596d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f4798b11700 1 -- 172.21.15.50:0/3020886683 >> 172.21.15.50:0/3020886683 conn(0x7f47940ce3e0 msgr2=0x7f479406ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:16.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f4798b11700 1 -- 172.21.15.50:0/3020886683 shutdown_connections 2023-11-28T11:55:16.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.375+0000 7f4798b11700 1 -- 172.21.15.50:0/3020886683 wait complete. 2023-11-28T11:55:16.397 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:55:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.515+0000 7f4571c4f700 1 Processor -- start 2023-11-28T11:55:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.515+0000 7f4571c4f700 1 -- start start 2023-11-28T11:55:16.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f4571c4f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f456c15d650 0x7f456c0ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f4571c4f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f456c0cc020 0x7f456c0cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f4571c4f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456c0cc9b0 con 0x7f456c1594f0 2023-11-28T11:55:16.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f4571c4f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456c0cd720 con 0x7f456c15d650 2023-11-28T11:55:16.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f4571c4f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c0cd990 con 0x7f456c0cc020 2023-11-28T11:55:16.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f4570c4d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f456c15d650 0x7f456c0ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f456bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f456c0cc020 0x7f456c0cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f456bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f456c0cc020 0x7f456c0cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:43902/0 (socket says 172.21.15.50:43902) 2023-11-28T11:55:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f4570c4d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f456c15d650 0x7f456c0ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:54216/0 (socket says 172.21.15.50:54216) 2023-11-28T11:55:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f457144e700 1 --1- 172.21.15.50:0/2648947388 >> v1:172.21.15.192:6789/0 conn(0x7f456c1594f0 0x7f456c159970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:41262/0 (socket says 172.21.15.50:41262) 2023-11-28T11:55:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f456bfff700 1 -- 172.21.15.50:0/2648947388 learned_addr learned my addr 172.21.15.50:0/2648947388 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f456b7fe700 1 -- 172.21.15.50:0/2648947388 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914690215 0 0) 0x7f4564001490 con 0x7f456c1594f0 2023-11-28T11:55:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f456b7fe700 1 -- 172.21.15.50:0/2648947388 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f455c0035d0 con 0x7f456c1594f0 2023-11-28T11:55:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f456bfff700 1 -- 172.21.15.50:0/2648947388 >> v2:172.21.15.192:3300/0 conn(0x7f456c15d650 msgr2=0x7f456c0ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f456bfff700 1 --2- 172.21.15.50:0/2648947388 >> v2:172.21.15.192:3300/0 conn(0x7f456c15d650 0x7f456c0ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f456bfff700 1 -- 172.21.15.50:0/2648947388 >> v1:172.21.15.192:6789/0 conn(0x7f456c1594f0 legacy=0x7f456c159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f456bfff700 1 -- 172.21.15.50:0/2648947388 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c0cdc70 con 0x7f456c0cc020 2023-11-28T11:55:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f4570c4d700 1 --2- 172.21.15.50:0/2648947388 >> v2:172.21.15.192:3300/0 conn(0x7f456c15d650 0x7f456c0ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f456bfff700 1 --2- 172.21.15.50:0/2648947388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f456c0cc020 0x7f456c0cc470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4558009910 tx=0x7f4558009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f99b7aa6b6c0ae9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:16.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f456b7fe700 1 -- 172.21.15.50:0/2648947388 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558011830 con 0x7f456c0cc020 2023-11-28T11:55:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f456b7fe700 1 -- 172.21.15.50:0/2648947388 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4558011990 con 0x7f456c0cc020 2023-11-28T11:55:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f456b7fe700 1 -- 172.21.15.50:0/2648947388 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558011d40 con 0x7f456c0cc020 2023-11-28T11:55:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f4571c4f700 1 -- 172.21.15.50:0/2648947388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f456c0cc020 msgr2=0x7f456c0cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.519+0000 7f4571c4f700 1 --2- 172.21.15.50:0/2648947388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f456c0cc020 0x7f456c0cc470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4558009910 tx=0x7f4558009c20 comp rx=0 tx=0).stop 2023-11-28T11:55:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.523+0000 7f4571c4f700 1 -- 172.21.15.50:0/2648947388 shutdown_connections 2023-11-28T11:55:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.523+0000 7f4571c4f700 1 --2- 172.21.15.50:0/2648947388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f456c0cc020 0x7f456c0cc470 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.523+0000 7f4571c4f700 1 --2- 172.21.15.50:0/2648947388 >> v2:172.21.15.192:3300/0 conn(0x7f456c15d650 0x7f456c0ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.523+0000 7f4571c4f700 1 -- 172.21.15.50:0/2648947388 >> 172.21.15.50:0/2648947388 conn(0x7f456c06ec40 msgr2=0x7f456c0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.523+0000 7f4571c4f700 1 -- 172.21.15.50:0/2648947388 shutdown_connections 2023-11-28T11:55:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.523+0000 7f4571c4f700 1 -- 172.21.15.50:0/2648947388 wait complete. 2023-11-28T11:55:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.523+0000 7f4571c4f700 1 Processor -- start 2023-11-28T11:55:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.523+0000 7f4571c4f700 1 -- start start 2023-11-28T11:55:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.523+0000 7f4571c4f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f456c0cc020 0x7f456c14fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.523+0000 7f4571c4f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c1594f0 0x7f456c14d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.523+0000 7f4571c4f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f456c15d650 0x7f456c150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.523+0000 7f4571c4f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c1504b0 con 0x7f456c1594f0 2023-11-28T11:55:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.523+0000 7f4571c4f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c14c310 con 0x7f456c0cc020 2023-11-28T11:55:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.523+0000 7f4571c4f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c14c5f0 con 0x7f456c15d650 2023-11-28T11:55:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.523+0000 7f456bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c1594f0 0x7f456c14d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.523+0000 7f456bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c1594f0 0x7f456c14d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49198/0 (socket says 172.21.15.50:49198) 2023-11-28T11:55:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.523+0000 7f456bfff700 1 -- 172.21.15.50:0/163683463 learned_addr learned my addr 172.21.15.50:0/163683463 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.527+0000 7f457144e700 1 --2- 172.21.15.50:0/163683463 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f456c15d650 0x7f456c150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.527+0000 7f4570c4d700 1 --2- 172.21.15.50:0/163683463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f456c0cc020 0x7f456c14fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.527+0000 7f456bfff700 1 -- 172.21.15.50:0/163683463 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f456c15d650 msgr2=0x7f456c150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.527+0000 7f456bfff700 1 --2- 172.21.15.50:0/163683463 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f456c15d650 0x7f456c150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.527+0000 7f456bfff700 1 -- 172.21.15.50:0/163683463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f456c0cc020 msgr2=0x7f456c14fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.527+0000 7f456bfff700 1 --2- 172.21.15.50:0/163683463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f456c0cc020 0x7f456c14fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.527+0000 7f456bfff700 1 -- 172.21.15.50:0/163683463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45600094b0 con 0x7f456c1594f0 2023-11-28T11:55:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.527+0000 7f456bfff700 1 --2- 172.21.15.50:0/163683463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c1594f0 0x7f456c14d0d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4558000c00 tx=0x7f4558004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.527+0000 7f45697fa700 1 -- 172.21.15.50:0/163683463 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558004300 con 0x7f456c1594f0 2023-11-28T11:55:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.527+0000 7f45697fa700 1 -- 172.21.15.50:0/163683463 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455801f070 con 0x7f456c1594f0 2023-11-28T11:55:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.527+0000 7f4571c4f700 1 -- 172.21.15.50:0/163683463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4558009570 con 0x7f456c1594f0 2023-11-28T11:55:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.527+0000 7f45697fa700 1 -- 172.21.15.50:0/163683463 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45580036c0 con 0x7f456c1594f0 2023-11-28T11:55:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.527+0000 7f4571c4f700 1 -- 172.21.15.50:0/163683463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456c15a250 con 0x7f456c1594f0 2023-11-28T11:55:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.527+0000 7f45697fa700 1 -- 172.21.15.50:0/163683463 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f455800f050 con 0x7f456c1594f0 2023-11-28T11:55:16.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.531+0000 7f4571c4f700 1 -- 172.21.15.50:0/163683463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456c0cdf50 con 0x7f456c1594f0 2023-11-28T11:55:16.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.531+0000 7f45697fa700 1 --2- 172.21.15.50:0/163683463 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4550064ee0 0x7f4550067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:16.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.531+0000 7f45697fa700 1 -- 172.21.15.50:0/163683463 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f45580834e0 con 0x7f456c1594f0 2023-11-28T11:55:16.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.531+0000 7f4570c4d700 1 --2- 172.21.15.50:0/163683463 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4550064ee0 0x7f4550067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:16.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.531+0000 7f4570c4d700 1 --2- 172.21.15.50:0/163683463 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4550064ee0 0x7f4550067390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f456c0b26f0 tx=0x7f4560009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:16.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.535+0000 7f45697fa700 1 -- 172.21.15.50:0/163683463 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f45580513d0 con 0x7f456c1594f0 2023-11-28T11:55:16.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.731+0000 7f4571c4f700 1 -- 172.21.15.50:0/163683463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f456c06bb80 con 0x7f456c1594f0 2023-11-28T11:55:16.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.731+0000 7f45697fa700 1 -- 172.21.15.50:0/163683463 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4558022380 con 0x7f456c1594f0 2023-11-28T11:55:16.732 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T11:55:16.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.731+0000 7f4571c4f700 1 -- 172.21.15.50:0/163683463 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4550064ee0 msgr2=0x7f4550067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:16.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.731+0000 7f4571c4f700 1 --2- 172.21.15.50:0/163683463 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4550064ee0 0x7f4550067390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f456c0b26f0 tx=0x7f4560009240 comp rx=0 tx=0).stop 2023-11-28T11:55:16.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.731+0000 7f4571c4f700 1 -- 172.21.15.50:0/163683463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c1594f0 msgr2=0x7f456c14d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:16.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.731+0000 7f4571c4f700 1 --2- 172.21.15.50:0/163683463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c1594f0 0x7f456c14d0d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4558000c00 tx=0x7f4558004770 comp rx=0 tx=0).stop 2023-11-28T11:55:16.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.731+0000 7f4571c4f700 1 -- 172.21.15.50:0/163683463 shutdown_connections 2023-11-28T11:55:16.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.731+0000 7f4571c4f700 1 --2- 172.21.15.50:0/163683463 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f456c15d650 0x7f456c150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.731+0000 7f4571c4f700 1 --2- 172.21.15.50:0/163683463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f456c1594f0 0x7f456c14d0d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.731+0000 7f4571c4f700 1 --2- 172.21.15.50:0/163683463 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4550064ee0 0x7f4550067390 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.731+0000 7f4571c4f700 1 --2- 172.21.15.50:0/163683463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f456c0cc020 0x7f456c14fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.731+0000 7f4571c4f700 1 -- 172.21.15.50:0/163683463 >> 172.21.15.50:0/163683463 conn(0x7f456c06ec40 msgr2=0x7f456c163f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.731+0000 7f4571c4f700 1 -- 172.21.15.50:0/163683463 shutdown_connections 2023-11-28T11:55:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:16.731+0000 7f4571c4f700 1 -- 172.21.15.50:0/163683463 wait complete. 2023-11-28T11:55:16.747 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:55:16.748 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:55:16.748 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-11-28T11:55:16.748 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T11:55:16.748 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T11:55:16.748 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:55:16.748 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T11:55:16.748 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:55:16.748 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:55:16.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:16.749 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-11-28T11:55:16.756 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:55:16.756 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:55:16.756 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:55:16.757 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:55:16.757 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-11-28T11:55:16.757 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:55:16.757 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:55:16.757 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:55:16.757 INFO:teuthology.orchestra.run.smithi050.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:55:16.757 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:55:16.757 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T11:55:16.757 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42476sec preferred_lft 42476sec 2023-11-28T11:55:16.757 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-11-28T11:55:16.757 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:55:16.757 INFO:teuthology.orchestra.run.smithi050.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:55:16.758 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:55:16.758 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:55:16.758 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:55:16.758 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T11:55:16.758 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:5d:90:5e:15 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:55:16.758 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T11:55:16.758 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:55:16.758 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:55:16.758 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether da:3b:9e:d1:db:b2 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:55:16.758 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T11:55:16.758 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:55:16.758 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::8086:d1ff:fed7:f4c8/64 scope link 2023-11-28T11:55:16.759 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:55:16.759 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:55:16.759 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether da:3b:9e:d1:db:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T11:55:16.759 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d83b:9eff:fed1:dbb2/64 scope link 2023-11-28T11:55:16.759 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:55:16.759 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:55:16.759 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether fa:16:94:5d:56:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T11:55:16.759 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f816:94ff:fe5d:5673/64 scope link 2023-11-28T11:55:16.759 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:55:16.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:16.760 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:55:16.813 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-11-28T11:55:16.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:16.815 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-11-28T11:55:16.824 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-11-28T11:55:16.824 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:55:16.824 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T11:55:16.824 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T11:55:16.824 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T11:55:16.825 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:55:16.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:16.825 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-11-28T11:55:16.825 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-11-28T11:55:16.825 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T11:55:16.826 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T11:55:16.826 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T11:55:16.826 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-11-28T11:55:16.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:16.866 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-11-28T11:55:16.914 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T11:55:16.914 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T11:55:16.915 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:55:16.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:16.916 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-11-28T11:55:16.932 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T11:55:16.933 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:55:16.934 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T11:55:16.941 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:55:16.941 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:55:16.941 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:55:16.989 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:55:17.006 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:55:17.006 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:55:17.017 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:55:17.018 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:55:17.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:17.019 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:55:17.024 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T11:55:17.025 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-28T11:55:17.069 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:55:17.087 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:55:17.087 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:55:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:55:17.098 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:55:17.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:17.098 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:55:17.162 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:2023-11-28T11:55:17.159+0000 7fdb89324640 -1 init, newargv = 0x5602311de7f0 newargc=15 2023-11-28T11:55:17.163 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[47859]: starting ceph client 2023-11-28T11:55:17.172 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[47859]: starting fuse 2023-11-28T11:55:18.205 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:55:18.224 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:55:18.224 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:55:18.235 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:55:18.236 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:55:18.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:18.237 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:55:18.243 INFO:teuthology.orchestra.run.smithi050.stdout:52 2023-11-28T11:55:18.243 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-28T11:55:18.244 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:55:18.244 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-11-28T11:55:18.244 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-11-28T11:55:18.244 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-11-28T11:55:18.244 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-11-28T11:55:18.244 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:55:18.244 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-11-28T11:55:18.244 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T11:55:18.244 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-11-28T11:55:18.245 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T11:55:18.245 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:55:18.245 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-11-28T11:55:18.245 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-11-28T11:55:18.245 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-11-28T11:55:18.245 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-11-28T11:55:18.245 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:55:18.245 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-11-28T11:55:18.245 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T11:55:18.245 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T11:55:18.245 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T11:55:18.245 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-11-28T11:55:18.245 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-11-28T11:55:18.246 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-11-28T11:55:18.246 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T11:55:18.246 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:55:18.246 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.0")) 2023-11-28T11:55:18.246 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-11-28T11:55:18.334 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.0.47859.asok 2023-11-28T11:55:18.516 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47859.asok 2023-11-28T11:55:18.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:18.517 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47859.asok status 2023-11-28T11:55:18.666 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:55:18.667 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-11-28T11:55:18.667 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T11:55:18.667 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T11:55:18.667 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "0", 2023-11-28T11:55:18.667 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-11-28T11:55:18.667 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T11:55:18.667 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "47859", 2023-11-28T11:55:18.667 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-11-28T11:55:18.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:18.667 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-11-28T11:55:18.668 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-11-28T11:55:18.668 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 5775, 2023-11-28T11:55:18.668 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-11-28T11:55:18.668 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-11-28T11:55:18.668 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-11-28T11:55:18.668 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 5775 2023-11-28T11:55:18.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:18.668 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-11-28T11:55:18.668 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-11-28T11:55:18.668 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:55:18.668 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1033405219 2023-11-28T11:55:18.668 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:18.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:18.669 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-11-28T11:55:18.669 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-11-28T11:55:18.669 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:55:18.669 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1033405219 2023-11-28T11:55:18.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:18.669 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.5775 192.168.0.1:0/1033405219", 2023-11-28T11:55:18.669 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/1033405219", 2023-11-28T11:55:18.669 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-11-28T11:55:18.669 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 17, 2023-11-28T11:55:18.669 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 40, 2023-11-28T11:55:18.669 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-11-28T11:55:18.669 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-11-28T11:55:18.669 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-11-28T11:55:18.669 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:55:18.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:18.677 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-11-28T11:55:18.677 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T11:55:18.685 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-11-28T11:55:18.686 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T11:55:18.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:18.686 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:55:18.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:18.704 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2023-11-28T11:55:18.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:18.771 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2023-11-28T11:55:18.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:18.783 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2023-11-28T11:55:18.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:18.797 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2023-11-28T11:55:18.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:18.817 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2023-11-28T11:55:18.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:18.830 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-11-28T11:55:18.900 INFO:teuthology.orchestra.run.smithi050.stdout:./ 2023-11-28T11:55:18.901 INFO:teuthology.orchestra.run.smithi050.stdout:./rfile 2023-11-28T11:55:18.901 INFO:teuthology.orchestra.run.smithi050.stdout:./parentdir 2023-11-28T11:55:18.901 INFO:teuthology.orchestra.run.smithi050.stdout:./parentdir/pfile 2023-11-28T11:55:18.901 INFO:teuthology.orchestra.run.smithi050.stdout:./parentdir/childdir 2023-11-28T11:55:18.901 INFO:teuthology.orchestra.run.smithi050.stdout:./parentdir/childdir/cfile 2023-11-28T11:55:18.902 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:55:18.902 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-11-28T11:55:18.902 DEBUG:teuthology.orchestra.run.smithi050:> import stat 2023-11-28T11:55:18.902 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:55:18.902 DEBUG:teuthology.orchestra.run.smithi050:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-11-28T11:55:18.902 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-11-28T11:55:18.972 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-11-28T11:55:19.161 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:55:19.161 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-11-28T11:55:19.161 DEBUG:teuthology.orchestra.run.smithi050:> import stat 2023-11-28T11:55:19.161 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:55:19.161 DEBUG:teuthology.orchestra.run.smithi050:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2023-11-28T11:55:19.161 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-11-28T11:55:19.232 INFO:teuthology.orchestra.run.smithi050.stdout:1099511627778 2023-11-28T11:55:19.419 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:55:19.419 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-11-28T11:55:19.419 DEBUG:teuthology.orchestra.run.smithi050:> import stat 2023-11-28T11:55:19.419 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:55:19.419 DEBUG:teuthology.orchestra.run.smithi050:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2023-11-28T11:55:19.419 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-11-28T11:55:19.494 INFO:teuthology.orchestra.run.smithi050.stdout:1099511627776 2023-11-28T11:55:19.683 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:55:19.683 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-11-28T11:55:19.683 DEBUG:teuthology.orchestra.run.smithi050:> import stat 2023-11-28T11:55:19.683 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:55:19.683 DEBUG:teuthology.orchestra.run.smithi050:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2023-11-28T11:55:19.683 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-11-28T11:55:19.793 INFO:teuthology.orchestra.run.smithi050.stdout:1099511628279 2023-11-28T11:55:19.984 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:55:19.984 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-11-28T11:55:19.985 DEBUG:teuthology.orchestra.run.smithi050:> import stat 2023-11-28T11:55:19.985 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:55:19.985 DEBUG:teuthology.orchestra.run.smithi050:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2023-11-28T11:55:19.985 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-11-28T11:55:20.060 INFO:teuthology.orchestra.run.smithi050.stdout:1099511627777 2023-11-28T11:55:20.248 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:55:20.248 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-11-28T11:55:20.248 DEBUG:teuthology.orchestra.run.smithi050:> import stat 2023-11-28T11:55:20.249 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:55:20.249 DEBUG:teuthology.orchestra.run.smithi050:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2023-11-28T11:55:20.249 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-11-28T11:55:20.323 INFO:teuthology.orchestra.run.smithi050.stdout:1099511628280 2023-11-28T11:55:20.510 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:55:20.510 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:55:20.516 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:55:20.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.635+0000 7f9545b5c700 1 Processor -- start 2023-11-28T11:55:20.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.635+0000 7f9545b5c700 1 -- start start 2023-11-28T11:55:20.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.635+0000 7f9545b5c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95401606b0 0x7f95400c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:20.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.635+0000 7f9545b5c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f95400ad610 0x7f95400c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:20.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.635+0000 7f9545b5c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95400cae70 con 0x7f95400ceef0 2023-11-28T11:55:20.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.635+0000 7f9545b5c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95400cbc10 con 0x7f95400ad610 2023-11-28T11:55:20.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.635+0000 7f9545b5c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95400cb130 con 0x7f95401606b0 2023-11-28T11:55:20.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.635+0000 7f953ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f95400ceef0 0x7f9540164040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50102/0 (socket says 172.21.15.50:50102) 2023-11-28T11:55:20.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.635+0000 7f953ffff700 1 -- 172.21.15.50:0/1230640628 learned_addr learned my addr 172.21.15.50:0/1230640628 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:20.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.635+0000 7f954535b700 1 --2- 172.21.15.50:0/1230640628 >> v2:172.21.15.50:3300/0 conn(0x7f95400ad610 0x7f95400c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:20.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f9544b5a700 1 --2- 172.21.15.50:0/1230640628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95401606b0 0x7f95400c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:20.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f953f7fe700 1 -- 172.21.15.50:0/1230640628 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447441682 0 0) 0x7f95400cae70 con 0x7f95400ceef0 2023-11-28T11:55:20.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f954535b700 1 -- 172.21.15.50:0/1230640628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95401606b0 msgr2=0x7f95400c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:20.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f954535b700 1 --2- 172.21.15.50:0/1230640628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95401606b0 0x7f95400c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:20.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f954535b700 1 -- 172.21.15.50:0/1230640628 >> v1:172.21.15.50:6789/0 conn(0x7f95400ceef0 legacy=0x7f9540164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:20.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f954535b700 1 -- 172.21.15.50:0/1230640628 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95400cb410 con 0x7f95400ad610 2023-11-28T11:55:20.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f954535b700 1 --2- 172.21.15.50:0/1230640628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95400ad610 0x7f95400c18f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9538009d90 tx=0x7f953800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8798b5bed7275b32 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:20.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f953f7fe700 1 -- 172.21.15.50:0/1230640628 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953800e070 con 0x7f95400ad610 2023-11-28T11:55:20.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f953f7fe700 1 -- 172.21.15.50:0/1230640628 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953800bbd0 con 0x7f95400ad610 2023-11-28T11:55:20.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f953f7fe700 1 -- 172.21.15.50:0/1230640628 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9538012430 con 0x7f95400ad610 2023-11-28T11:55:20.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f9545b5c700 1 -- 172.21.15.50:0/1230640628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95400ad610 msgr2=0x7f95400c18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:20.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f9545b5c700 1 --2- 172.21.15.50:0/1230640628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95400ad610 0x7f95400c18f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9538009d90 tx=0x7f953800b330 comp rx=0 tx=0).stop 2023-11-28T11:55:20.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f9545b5c700 1 -- 172.21.15.50:0/1230640628 shutdown_connections 2023-11-28T11:55:20.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f9545b5c700 1 --2- 172.21.15.50:0/1230640628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95400ad610 0x7f95400c18f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:20.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f9545b5c700 1 --2- 172.21.15.50:0/1230640628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95401606b0 0x7f95400c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:20.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f9545b5c700 1 -- 172.21.15.50:0/1230640628 >> 172.21.15.50:0/1230640628 conn(0x7f95400ce3e0 msgr2=0x7f95400ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:20.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f9545b5c700 1 -- 172.21.15.50:0/1230640628 shutdown_connections 2023-11-28T11:55:20.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f9545b5c700 1 -- 172.21.15.50:0/1230640628 wait complete. 2023-11-28T11:55:20.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f9545b5c700 1 Processor -- start 2023-11-28T11:55:20.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.639+0000 7f9545b5c700 1 -- start start 2023-11-28T11:55:20.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f9545b5c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95400ad610 0x7f95400c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:20.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f9545b5c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95400ceef0 0x7f95400c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:20.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f9545b5c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95401606b0 0x7f95401f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:20.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f9545b5c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95401f69e0 con 0x7f95400ceef0 2023-11-28T11:55:20.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f9545b5c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954014ff60 con 0x7f95400ad610 2023-11-28T11:55:20.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f9545b5c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954014f1a0 con 0x7f95401606b0 2023-11-28T11:55:20.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f953ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95400ceef0 0x7f95400c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:20.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f953ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95400ceef0 0x7f95400c39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49206/0 (socket says 172.21.15.50:49206) 2023-11-28T11:55:20.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f953ffff700 1 -- 172.21.15.50:0/1487360272 learned_addr learned my addr 172.21.15.50:0/1487360272 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:20.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f954535b700 1 --2- 172.21.15.50:0/1487360272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95401606b0 0x7f95401f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:20.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f9544b5a700 1 --2- 172.21.15.50:0/1487360272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95400ad610 0x7f95400c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:20.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f953ffff700 1 -- 172.21.15.50:0/1487360272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95401606b0 msgr2=0x7f95401f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:20.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f953ffff700 1 --2- 172.21.15.50:0/1487360272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95401606b0 0x7f95401f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:20.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f953ffff700 1 -- 172.21.15.50:0/1487360272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95400ad610 msgr2=0x7f95400c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:20.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f953ffff700 1 --2- 172.21.15.50:0/1487360272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95400ad610 0x7f95400c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:20.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f953ffff700 1 -- 172.21.15.50:0/1487360272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9538009a70 con 0x7f95400ceef0 2023-11-28T11:55:20.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f953ffff700 1 --2- 172.21.15.50:0/1487360272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95400ceef0 0x7f95400c39f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f953400c4e0 tx=0x7f953400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:20.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f953d7fa700 1 -- 172.21.15.50:0/1487360272 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534004ca0 con 0x7f95400ceef0 2023-11-28T11:55:20.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f953d7fa700 1 -- 172.21.15.50:0/1487360272 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9534004e20 con 0x7f95400ceef0 2023-11-28T11:55:20.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f9545b5c700 1 -- 172.21.15.50:0/1487360272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954006ac50 con 0x7f95400ceef0 2023-11-28T11:55:20.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f953d7fa700 1 -- 172.21.15.50:0/1487360272 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534007310 con 0x7f95400ceef0 2023-11-28T11:55:20.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f9545b5c700 1 -- 172.21.15.50:0/1487360272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95400cb6f0 con 0x7f95400ceef0 2023-11-28T11:55:20.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.643+0000 7f9545b5c700 1 -- 172.21.15.50:0/1487360272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95400b3680 con 0x7f95400ceef0 2023-11-28T11:55:20.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.647+0000 7f953d7fa700 1 -- 172.21.15.50:0/1487360272 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f953401a020 con 0x7f95400ceef0 2023-11-28T11:55:20.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.647+0000 7f953d7fa700 1 --2- 172.21.15.50:0/1487360272 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9524064ee0 0x7f9524067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:20.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.647+0000 7f953d7fa700 1 -- 172.21.15.50:0/1487360272 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9534081b80 con 0x7f95400ceef0 2023-11-28T11:55:20.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.647+0000 7f9544b5a700 1 --2- 172.21.15.50:0/1487360272 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9524064ee0 0x7f9524067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:20.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.647+0000 7f9544b5a700 1 --2- 172.21.15.50:0/1487360272 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9524064ee0 0x7f9524067390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f952c00b9d0 tx=0x7f952c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:20.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.651+0000 7f953d7fa700 1 -- 172.21.15.50:0/1487360272 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f953404fbe0 con 0x7f95400ceef0 2023-11-28T11:55:20.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.815+0000 7f9545b5c700 1 -- 172.21.15.50:0/1487360272 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9540072500 con 0x7f95400ceef0 2023-11-28T11:55:20.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.819+0000 7f953d7fa700 1 -- 172.21.15.50:0/1487360272 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17974 (secure 0 0 0) 0x7f9534053200 con 0x7f95400ceef0 2023-11-28T11:55:20.821 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:20.821 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":40,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:55:07.205255+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:55:03.889842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T11:55:05.177617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:55:20.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.823+0000 7f9545b5c700 1 -- 172.21.15.50:0/1487360272 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9524064ee0 msgr2=0x7f9524067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:20.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.823+0000 7f9545b5c700 1 --2- 172.21.15.50:0/1487360272 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9524064ee0 0x7f9524067390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f952c00b9d0 tx=0x7f952c008040 comp rx=0 tx=0).stop 2023-11-28T11:55:20.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.823+0000 7f9545b5c700 1 -- 172.21.15.50:0/1487360272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95400ceef0 msgr2=0x7f95400c39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:20.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.823+0000 7f9545b5c700 1 --2- 172.21.15.50:0/1487360272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95400ceef0 0x7f95400c39f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f953400c4e0 tx=0x7f953400c7f0 comp rx=0 tx=0).stop 2023-11-28T11:55:20.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.823+0000 7f9545b5c700 1 -- 172.21.15.50:0/1487360272 shutdown_connections 2023-11-28T11:55:20.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.823+0000 7f9545b5c700 1 --2- 172.21.15.50:0/1487360272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95401606b0 0x7f95401f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:20.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.823+0000 7f9545b5c700 1 --2- 172.21.15.50:0/1487360272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95400ceef0 0x7f95400c39f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:20.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.823+0000 7f9545b5c700 1 --2- 172.21.15.50:0/1487360272 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9524064ee0 0x7f9524067390 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:20.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.823+0000 7f9545b5c700 1 --2- 172.21.15.50:0/1487360272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95400ad610 0x7f95400c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:20.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.823+0000 7f9545b5c700 1 -- 172.21.15.50:0/1487360272 >> 172.21.15.50:0/1487360272 conn(0x7f95400ce3e0 msgr2=0x7f954006bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:20.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.823+0000 7f9545b5c700 1 -- 172.21.15.50:0/1487360272 shutdown_connections 2023-11-28T11:55:20.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.823+0000 7f9545b5c700 1 -- 172.21.15.50:0/1487360272 wait complete. 2023-11-28T11:55:20.842 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:55:03.889842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:55:05.177617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:55:20.843 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:55:20.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.963+0000 7f2b1f4b6700 1 Processor -- start 2023-11-28T11:55:20.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.963+0000 7f2b1f4b6700 1 -- start start 2023-11-28T11:55:20.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1f4b6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2b1806ce60 0x7f2b180d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1f4b6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b180cf470 0x7f2b180cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1f4b6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b180cd300 con 0x7f2b180cce60 2023-11-28T11:55:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1f4b6700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b1815c8b0 con 0x7f2b180cf470 2023-11-28T11:55:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1f4b6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b1806a7f0 con 0x7f2b1806ce60 2023-11-28T11:55:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1ecb5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b180cf470 0x7f2b180cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1dcb3700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2b180cce60 0x7f2b1806d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50104/0 (socket says 172.21.15.50:50104) 2023-11-28T11:55:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1dcb3700 1 -- 172.21.15.50:0/2484039789 learned_addr learned my addr 172.21.15.50:0/2484039789 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1e4b4700 1 --2- 172.21.15.50:0/2484039789 >> v2:172.21.15.192:3300/0 conn(0x7f2b1806ce60 0x7f2b180d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1d4b2700 1 -- 172.21.15.50:0/2484039789 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886768369 0 0) 0x7f2b08001110 con 0x7f2b180cce60 2023-11-28T11:55:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1d4b2700 1 -- 172.21.15.50:0/2484039789 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b040035d0 con 0x7f2b180cce60 2023-11-28T11:55:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1ecb5700 1 -- 172.21.15.50:0/2484039789 >> v2:172.21.15.192:3300/0 conn(0x7f2b1806ce60 msgr2=0x7f2b180d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:20.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1ecb5700 1 --2- 172.21.15.50:0/2484039789 >> v2:172.21.15.192:3300/0 conn(0x7f2b1806ce60 0x7f2b180d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:20.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1ecb5700 1 -- 172.21.15.50:0/2484039789 >> v1:172.21.15.50:6789/0 conn(0x7f2b180cce60 legacy=0x7f2b1806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:20.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1ecb5700 1 -- 172.21.15.50:0/2484039789 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1806aad0 con 0x7f2b180cf470 2023-11-28T11:55:20.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1e4b4700 1 --2- 172.21.15.50:0/2484039789 >> v2:172.21.15.192:3300/0 conn(0x7f2b1806ce60 0x7f2b180d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1ecb5700 1 --2- 172.21.15.50:0/2484039789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b180cf470 0x7f2b180cf8f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009d90 tx=0x7f2b1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8445ad02e3ae9d71 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1d4b2700 1 -- 172.21.15.50:0/2484039789 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1000e070 con 0x7f2b180cf470 2023-11-28T11:55:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1d4b2700 1 -- 172.21.15.50:0/2484039789 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1000bae0 con 0x7f2b180cf470 2023-11-28T11:55:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1d4b2700 1 -- 172.21.15.50:0/2484039789 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1000be90 con 0x7f2b180cf470 2023-11-28T11:55:20.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1f4b6700 1 -- 172.21.15.50:0/2484039789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b180cf470 msgr2=0x7f2b180cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1f4b6700 1 --2- 172.21.15.50:0/2484039789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b180cf470 0x7f2b180cf8f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009d90 tx=0x7f2b1000b330 comp rx=0 tx=0).stop 2023-11-28T11:55:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1f4b6700 1 -- 172.21.15.50:0/2484039789 shutdown_connections 2023-11-28T11:55:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1f4b6700 1 --2- 172.21.15.50:0/2484039789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b180cf470 0x7f2b180cf8f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:20.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1f4b6700 1 --2- 172.21.15.50:0/2484039789 >> v2:172.21.15.192:3300/0 conn(0x7f2b1806ce60 0x7f2b180d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:20.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1f4b6700 1 -- 172.21.15.50:0/2484039789 >> 172.21.15.50:0/2484039789 conn(0x7f2b180b5760 msgr2=0x7f2b180b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:20.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1f4b6700 1 -- 172.21.15.50:0/2484039789 shutdown_connections 2023-11-28T11:55:20.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.967+0000 7f2b1f4b6700 1 -- 172.21.15.50:0/2484039789 wait complete. 2023-11-28T11:55:20.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1f4b6700 1 Processor -- start 2023-11-28T11:55:20.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1f4b6700 1 -- start start 2023-11-28T11:55:20.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1f4b6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b1806ce60 0x7f2b18159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1f4b6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b180cce60 0x7f2b18159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1f4b6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b180cf470 0x7f2b180b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1f4b6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b181f1fb0 con 0x7f2b1806ce60 2023-11-28T11:55:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1f4b6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b180ced10 con 0x7f2b180cce60 2023-11-28T11:55:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1f4b6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b180cd4a0 con 0x7f2b180cf470 2023-11-28T11:55:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1e4b4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b1806ce60 0x7f2b18159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1e4b4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b1806ce60 0x7f2b18159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49224/0 (socket says 172.21.15.50:49224) 2023-11-28T11:55:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1e4b4700 1 -- 172.21.15.50:0/1291532565 learned_addr learned my addr 172.21.15.50:0/1291532565 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1ecb5700 1 --2- 172.21.15.50:0/1291532565 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b180cf470 0x7f2b180b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1dcb3700 1 --2- 172.21.15.50:0/1291532565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b180cce60 0x7f2b18159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1e4b4700 1 -- 172.21.15.50:0/1291532565 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b180cf470 msgr2=0x7f2b180b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1e4b4700 1 --2- 172.21.15.50:0/1291532565 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b180cf470 0x7f2b180b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1e4b4700 1 -- 172.21.15.50:0/1291532565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b180cce60 msgr2=0x7f2b18159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:20.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1e4b4700 1 --2- 172.21.15.50:0/1291532565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b180cce60 0x7f2b18159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:20.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1e4b4700 1 -- 172.21.15.50:0/1291532565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b10009a70 con 0x7f2b1806ce60 2023-11-28T11:55:20.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1e4b4700 1 --2- 172.21.15.50:0/1291532565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b1806ce60 0x7f2b18159030 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400e840 tx=0x7f2b1400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:20.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b0effd700 1 -- 172.21.15.50:0/1291532565 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14013610 con 0x7f2b1806ce60 2023-11-28T11:55:20.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b0effd700 1 -- 172.21.15.50:0/1291532565 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b14013770 con 0x7f2b1806ce60 2023-11-28T11:55:20.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b0effd700 1 -- 172.21.15.50:0/1291532565 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14013b00 con 0x7f2b1806ce60 2023-11-28T11:55:20.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1f4b6700 1 -- 172.21.15.50:0/1291532565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1806b090 con 0x7f2b1806ce60 2023-11-28T11:55:20.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.971+0000 7f2b1f4b6700 1 -- 172.21.15.50:0/1291532565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1806adb0 con 0x7f2b1806ce60 2023-11-28T11:55:20.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.975+0000 7f2b1f4b6700 1 -- 172.21.15.50:0/1291532565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b180b6470 con 0x7f2b1806ce60 2023-11-28T11:55:20.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.975+0000 7f2b0effd700 1 -- 172.21.15.50:0/1291532565 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2b14023070 con 0x7f2b1806ce60 2023-11-28T11:55:20.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.975+0000 7f2b0effd700 1 --2- 172.21.15.50:0/1291532565 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2afc064ee0 0x7f2afc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:20.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.975+0000 7f2b0effd700 1 -- 172.21.15.50:0/1291532565 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2b14081ac0 con 0x7f2b1806ce60 2023-11-28T11:55:20.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.975+0000 7f2b1dcb3700 1 --2- 172.21.15.50:0/1291532565 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2afc064ee0 0x7f2afc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:20.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.975+0000 7f2b1dcb3700 1 --2- 172.21.15.50:0/1291532565 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2afc064ee0 0x7f2afc067390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2b180b5390 tx=0x7f2b08007c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:20.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:20.979+0000 7f2b0effd700 1 -- 172.21.15.50:0/1291532565 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2b1404fa40 con 0x7f2b1806ce60 2023-11-28T11:55:21.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.143+0000 7f2b1f4b6700 1 -- 172.21.15.50:0/1291532565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2b1806c940 con 0x7f2b1806ce60 2023-11-28T11:55:21.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.147+0000 7f2b0effd700 1 -- 172.21.15.50:0/1291532565 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2b14081070 con 0x7f2b1806ce60 2023-11-28T11:55:21.147 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:55:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.147+0000 7f2b1f4b6700 1 -- 172.21.15.50:0/1291532565 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2afc064ee0 msgr2=0x7f2afc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.147+0000 7f2b1f4b6700 1 --2- 172.21.15.50:0/1291532565 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2afc064ee0 0x7f2afc067390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2b180b5390 tx=0x7f2b08007c60 comp rx=0 tx=0).stop 2023-11-28T11:55:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.147+0000 7f2b1f4b6700 1 -- 172.21.15.50:0/1291532565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b1806ce60 msgr2=0x7f2b18159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.147+0000 7f2b1f4b6700 1 --2- 172.21.15.50:0/1291532565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b1806ce60 0x7f2b18159030 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400e840 tx=0x7f2b1400eb50 comp rx=0 tx=0).stop 2023-11-28T11:55:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.147+0000 7f2b1f4b6700 1 -- 172.21.15.50:0/1291532565 shutdown_connections 2023-11-28T11:55:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.147+0000 7f2b1f4b6700 1 --2- 172.21.15.50:0/1291532565 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b180cf470 0x7f2b180b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.147+0000 7f2b1f4b6700 1 --2- 172.21.15.50:0/1291532565 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2afc064ee0 0x7f2afc067390 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.147+0000 7f2b1f4b6700 1 --2- 172.21.15.50:0/1291532565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b180cce60 0x7f2b18159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.147+0000 7f2b1f4b6700 1 --2- 172.21.15.50:0/1291532565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b1806ce60 0x7f2b18159030 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.147+0000 7f2b1f4b6700 1 -- 172.21.15.50:0/1291532565 >> 172.21.15.50:0/1291532565 conn(0x7f2b180b5760 msgr2=0x7f2b1815bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:21.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.147+0000 7f2b1f4b6700 1 -- 172.21.15.50:0/1291532565 shutdown_connections 2023-11-28T11:55:21.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.147+0000 7f2b1f4b6700 1 -- 172.21.15.50:0/1291532565 wait complete. 2023-11-28T11:55:21.162 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:55:21.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb398b6700 1 Processor -- start 2023-11-28T11:55:21.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb398b6700 1 -- start start 2023-11-28T11:55:21.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb398b6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffb340b00e0 0x7ffb3415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb398b6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb3409bdb0 0x7ffb3415d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb398b6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffb340cbb30 0x7ffb3415dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb398b6700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb340b2db0 con 0x7ffb340cbb30 2023-11-28T11:55:21.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb398b6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb340b3240 con 0x7ffb340b00e0 2023-11-28T11:55:21.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb398b6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3406d840 con 0x7ffb3409bdb0 2023-11-28T11:55:21.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb390b5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffb340cbb30 0x7ffb3415dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb390b5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffb340cbb30 0x7ffb3415dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49232/0 (socket says 172.21.15.50:49232) 2023-11-28T11:55:21.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb390b5700 1 -- 172.21.15.50:0/3186159853 learned_addr learned my addr 172.21.15.50:0/3186159853 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:21.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb33fff700 1 --2- 172.21.15.50:0/3186159853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb3409bdb0 0x7ffb3415d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb388b4700 1 --2- 172.21.15.50:0/3186159853 >> v2:172.21.15.192:3300/0 conn(0x7ffb340b00e0 0x7ffb3415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb390b5700 1 -- 172.21.15.50:0/3186159853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb3409bdb0 msgr2=0x7ffb3415d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:21.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb390b5700 1 --2- 172.21.15.50:0/3186159853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb3409bdb0 0x7ffb3415d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb390b5700 1 -- 172.21.15.50:0/3186159853 >> v2:172.21.15.192:3300/0 conn(0x7ffb340b00e0 msgr2=0x7ffb3415d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:21.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb390b5700 1 --2- 172.21.15.50:0/3186159853 >> v2:172.21.15.192:3300/0 conn(0x7ffb340b00e0 0x7ffb3415d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb390b5700 1 -- 172.21.15.50:0/3186159853 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3406d560 con 0x7ffb340cbb30 2023-11-28T11:55:21.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.279+0000 7ffb388b4700 1 --2- 172.21.15.50:0/3186159853 >> v2:172.21.15.192:3300/0 conn(0x7ffb340b00e0 0x7ffb3415d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:21.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.283+0000 7ffb390b5700 1 --2- 172.21.15.50:0/3186159853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb340cbb30 0x7ffb3415dd60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ffb3406fbf0 tx=0x7ffb2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba46c17f8d7af99e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:21.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.283+0000 7ffb337fe700 1 -- 172.21.15.50:0/3186159853 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c00e070 con 0x7ffb340cbb30 2023-11-28T11:55:21.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.283+0000 7ffb337fe700 1 -- 172.21.15.50:0/3186159853 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c00b910 con 0x7ffb340cbb30 2023-11-28T11:55:21.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.283+0000 7ffb337fe700 1 -- 172.21.15.50:0/3186159853 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c00bcc0 con 0x7ffb340cbb30 2023-11-28T11:55:21.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.283+0000 7ffb398b6700 1 -- 172.21.15.50:0/3186159853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb340cbb30 msgr2=0x7ffb3415dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:21.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.283+0000 7ffb398b6700 1 --2- 172.21.15.50:0/3186159853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb340cbb30 0x7ffb3415dd60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ffb3406fbf0 tx=0x7ffb2c00b330 comp rx=0 tx=0).stop 2023-11-28T11:55:21.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.283+0000 7ffb398b6700 1 -- 172.21.15.50:0/3186159853 shutdown_connections 2023-11-28T11:55:21.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.283+0000 7ffb398b6700 1 --2- 172.21.15.50:0/3186159853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb340cbb30 0x7ffb3415dd60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.283+0000 7ffb398b6700 1 --2- 172.21.15.50:0/3186159853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb3409bdb0 0x7ffb3415d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.283+0000 7ffb398b6700 1 --2- 172.21.15.50:0/3186159853 >> v2:172.21.15.192:3300/0 conn(0x7ffb340b00e0 0x7ffb3415d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.283+0000 7ffb398b6700 1 -- 172.21.15.50:0/3186159853 >> 172.21.15.50:0/3186159853 conn(0x7ffb340cae70 msgr2=0x7ffb340cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:21.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.283+0000 7ffb398b6700 1 -- 172.21.15.50:0/3186159853 shutdown_connections 2023-11-28T11:55:21.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.283+0000 7ffb398b6700 1 -- 172.21.15.50:0/3186159853 wait complete. 2023-11-28T11:55:21.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.283+0000 7ffb398b6700 1 Processor -- start 2023-11-28T11:55:21.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.283+0000 7ffb398b6700 1 -- start start 2023-11-28T11:55:21.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb398b6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb3409bdb0 0x7ffb34154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb398b6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb340b00e0 0x7ffb341469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb398b6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb340cbb30 0x7ffb34146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb398b6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340c8e90 con 0x7ffb340cbb30 2023-11-28T11:55:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb398b6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb34156990 con 0x7ffb340b00e0 2023-11-28T11:55:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb398b6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340c90e0 con 0x7ffb3409bdb0 2023-11-28T11:55:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb390b5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb340cbb30 0x7ffb34146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb390b5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb340cbb30 0x7ffb34146f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49236/0 (socket says 172.21.15.50:49236) 2023-11-28T11:55:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb390b5700 1 -- 172.21.15.50:0/3677501747 learned_addr learned my addr 172.21.15.50:0/3677501747 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb388b4700 1 --2- 172.21.15.50:0/3677501747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb3409bdb0 0x7ffb34154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb33fff700 1 --2- 172.21.15.50:0/3677501747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb340b00e0 0x7ffb341469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb390b5700 1 -- 172.21.15.50:0/3677501747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb3409bdb0 msgr2=0x7ffb34154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb390b5700 1 --2- 172.21.15.50:0/3677501747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb3409bdb0 0x7ffb34154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb390b5700 1 -- 172.21.15.50:0/3677501747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb340b00e0 msgr2=0x7ffb341469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:21.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb390b5700 1 --2- 172.21.15.50:0/3677501747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb340b00e0 0x7ffb341469c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb390b5700 1 -- 172.21.15.50:0/3677501747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c009b30 con 0x7ffb340cbb30 2023-11-28T11:55:21.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb390b5700 1 --2- 172.21.15.50:0/3677501747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb340cbb30 0x7ffb34146f00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c012000 tx=0x7ffb2c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:21.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb317fa700 1 -- 172.21.15.50:0/3677501747 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0048c0 con 0x7ffb340cbb30 2023-11-28T11:55:21.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb317fa700 1 -- 172.21.15.50:0/3677501747 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c0099b0 con 0x7ffb340cbb30 2023-11-28T11:55:21.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb398b6700 1 -- 172.21.15.50:0/3677501747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb340ac3d0 con 0x7ffb340cbb30 2023-11-28T11:55:21.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb317fa700 1 -- 172.21.15.50:0/3677501747 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c01c680 con 0x7ffb340cbb30 2023-11-28T11:55:21.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb398b6700 1 -- 172.21.15.50:0/3677501747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb340ac0f0 con 0x7ffb340cbb30 2023-11-28T11:55:21.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb398b6700 1 -- 172.21.15.50:0/3677501747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb340cc9f0 con 0x7ffb340cbb30 2023-11-28T11:55:21.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.287+0000 7ffb317fa700 1 -- 172.21.15.50:0/3677501747 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ffb2c022030 con 0x7ffb340cbb30 2023-11-28T11:55:21.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.291+0000 7ffb317fa700 1 --2- 172.21.15.50:0/3677501747 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ffb20064ee0 0x7ffb20067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.291+0000 7ffb317fa700 1 -- 172.21.15.50:0/3677501747 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ffb2c083710 con 0x7ffb340cbb30 2023-11-28T11:55:21.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.291+0000 7ffb388b4700 1 --2- 172.21.15.50:0/3677501747 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ffb20064ee0 0x7ffb20067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.291+0000 7ffb388b4700 1 --2- 172.21.15.50:0/3677501747 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ffb20064ee0 0x7ffb20067390 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffb280099f0 tx=0x7ffb28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:21.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.295+0000 7ffb317fa700 1 -- 172.21.15.50:0/3677501747 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ffb2c051770 con 0x7ffb340cbb30 2023-11-28T11:55:21.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.455+0000 7ffb398b6700 1 -- 172.21.15.50:0/3677501747 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb340c9ea0 con 0x7ffb340cbb30 2023-11-28T11:55:21.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.455+0000 7ffb317fa700 1 -- 172.21.15.50:0/3677501747 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb340c9ea0 con 0x7ffb340cbb30 2023-11-28T11:55:21.457 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:55:21.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.459+0000 7ffb398b6700 1 -- 172.21.15.50:0/3677501747 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ffb20064ee0 msgr2=0x7ffb20067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:21.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.459+0000 7ffb398b6700 1 --2- 172.21.15.50:0/3677501747 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ffb20064ee0 0x7ffb20067390 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffb280099f0 tx=0x7ffb28008040 comp rx=0 tx=0).stop 2023-11-28T11:55:21.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.459+0000 7ffb398b6700 1 -- 172.21.15.50:0/3677501747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb340cbb30 msgr2=0x7ffb34146f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:21.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.459+0000 7ffb398b6700 1 --2- 172.21.15.50:0/3677501747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb340cbb30 0x7ffb34146f00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c012000 tx=0x7ffb2c004af0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.459+0000 7ffb398b6700 1 -- 172.21.15.50:0/3677501747 shutdown_connections 2023-11-28T11:55:21.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.459+0000 7ffb398b6700 1 --2- 172.21.15.50:0/3677501747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb340cbb30 0x7ffb34146f00 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.459+0000 7ffb398b6700 1 --2- 172.21.15.50:0/3677501747 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ffb20064ee0 0x7ffb20067390 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.459+0000 7ffb398b6700 1 --2- 172.21.15.50:0/3677501747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb340b00e0 0x7ffb341469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.459+0000 7ffb398b6700 1 --2- 172.21.15.50:0/3677501747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb3409bdb0 0x7ffb34154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.459+0000 7ffb398b6700 1 -- 172.21.15.50:0/3677501747 >> 172.21.15.50:0/3677501747 conn(0x7ffb340cae70 msgr2=0x7ffb340ce3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:21.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.459+0000 7ffb398b6700 1 -- 172.21.15.50:0/3677501747 shutdown_connections 2023-11-28T11:55:21.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.459+0000 7ffb398b6700 1 -- 172.21.15.50:0/3677501747 wait complete. 2023-11-28T11:55:21.475 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:55:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.595+0000 7f295f48a700 1 Processor -- start 2023-11-28T11:55:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.595+0000 7f295f48a700 1 -- start start 2023-11-28T11:55:21.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.595+0000 7f295f48a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f295806ce60 0x7f29580b8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.595+0000 7f295f48a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f29580d1e30 0x7f295806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.595+0000 7f295f48a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f295806a3a0 0x7f295806a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.595+0000 7f295f48a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29580d3390 con 0x7f295806ce60 2023-11-28T11:55:21.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.595+0000 7f295f48a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29580d0460 con 0x7f29580d1e30 2023-11-28T11:55:21.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.595+0000 7f295f48a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29580d2380 con 0x7f295806a3a0 2023-11-28T11:55:21.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.595+0000 7f295e488700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f295806ce60 0x7f29580b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.595+0000 7f295e488700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f295806ce60 0x7f29580b8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49246/0 (socket says 172.21.15.50:49246) 2023-11-28T11:55:21.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.595+0000 7f295e488700 1 -- 172.21.15.50:0/3614026433 learned_addr learned my addr 172.21.15.50:0/3614026433 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:21.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.595+0000 7f295dc87700 1 --2- 172.21.15.50:0/3614026433 >> v2:172.21.15.192:3300/0 conn(0x7f29580d1e30 0x7f295806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.595+0000 7f295ec89700 1 --2- 172.21.15.50:0/3614026433 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f295806a3a0 0x7f295806a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295e488700 1 -- 172.21.15.50:0/3614026433 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f295806a3a0 msgr2=0x7f295806a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:21.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295e488700 1 --2- 172.21.15.50:0/3614026433 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f295806a3a0 0x7f295806a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295e488700 1 -- 172.21.15.50:0/3614026433 >> v2:172.21.15.192:3300/0 conn(0x7f29580d1e30 msgr2=0x7f295806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:21.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295e488700 1 --2- 172.21.15.50:0/3614026433 >> v2:172.21.15.192:3300/0 conn(0x7f29580d1e30 0x7f295806d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295e488700 1 -- 172.21.15.50:0/3614026433 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29580d2f00 con 0x7f295806ce60 2023-11-28T11:55:21.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295e488700 1 --2- 172.21.15.50:0/3614026433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295806ce60 0x7f29580b8240 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2958066b40 tx=0x7f2948009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f808834a0da8a1f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:21.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295d486700 1 -- 172.21.15.50:0/3614026433 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948011830 con 0x7f295806ce60 2023-11-28T11:55:21.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295d486700 1 -- 172.21.15.50:0/3614026433 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2948011990 con 0x7f295806ce60 2023-11-28T11:55:21.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295d486700 1 -- 172.21.15.50:0/3614026433 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948011d40 con 0x7f295806ce60 2023-11-28T11:55:21.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295f48a700 1 -- 172.21.15.50:0/3614026433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295806ce60 msgr2=0x7f29580b8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:21.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295f48a700 1 --2- 172.21.15.50:0/3614026433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295806ce60 0x7f29580b8240 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2958066b40 tx=0x7f2948009c20 comp rx=0 tx=0).stop 2023-11-28T11:55:21.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295f48a700 1 -- 172.21.15.50:0/3614026433 shutdown_connections 2023-11-28T11:55:21.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295f48a700 1 --2- 172.21.15.50:0/3614026433 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f295806a3a0 0x7f295806a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295f48a700 1 --2- 172.21.15.50:0/3614026433 >> v2:172.21.15.192:3300/0 conn(0x7f29580d1e30 0x7f295806d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295f48a700 1 --2- 172.21.15.50:0/3614026433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295806ce60 0x7f29580b8240 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295f48a700 1 -- 172.21.15.50:0/3614026433 >> 172.21.15.50:0/3614026433 conn(0x7f295809bbd0 msgr2=0x7f29580b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:21.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295f48a700 1 -- 172.21.15.50:0/3614026433 shutdown_connections 2023-11-28T11:55:21.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.599+0000 7f295f48a700 1 -- 172.21.15.50:0/3614026433 wait complete. 2023-11-28T11:55:21.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.603+0000 7f295f48a700 1 Processor -- start 2023-11-28T11:55:21.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.603+0000 7f295f48a700 1 -- start start 2023-11-28T11:55:21.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.603+0000 7f295f48a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295806a3a0 0x7f295809fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.603+0000 7f295f48a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f295806ce60 0x7f295815de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.603+0000 7f295f48a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29580d1e30 0x7f29580b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.603+0000 7f295f48a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29580a0340 con 0x7f295806a3a0 2023-11-28T11:55:21.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.603+0000 7f295f48a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29580c64d0 con 0x7f295806ce60 2023-11-28T11:55:21.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.603+0000 7f295f48a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29580c67b0 con 0x7f29580d1e30 2023-11-28T11:55:21.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.603+0000 7f295e488700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295806a3a0 0x7f295809fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.603+0000 7f295e488700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295806a3a0 0x7f295809fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49260/0 (socket says 172.21.15.50:49260) 2023-11-28T11:55:21.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.603+0000 7f295e488700 1 -- 172.21.15.50:0/1668121059 learned_addr learned my addr 172.21.15.50:0/1668121059 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:21.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.607+0000 7f295ec89700 1 --2- 172.21.15.50:0/1668121059 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29580d1e30 0x7f29580b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.607+0000 7f295dc87700 1 --2- 172.21.15.50:0/1668121059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f295806ce60 0x7f295815de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.607+0000 7f295e488700 1 -- 172.21.15.50:0/1668121059 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29580d1e30 msgr2=0x7f29580b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.607+0000 7f295e488700 1 --2- 172.21.15.50:0/1668121059 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29580d1e30 0x7f29580b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.607+0000 7f295e488700 1 -- 172.21.15.50:0/1668121059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f295806ce60 msgr2=0x7f295815de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.607+0000 7f295e488700 1 --2- 172.21.15.50:0/1668121059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f295806ce60 0x7f295815de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.607+0000 7f295e488700 1 -- 172.21.15.50:0/1668121059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2948009570 con 0x7f295806a3a0 2023-11-28T11:55:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.607+0000 7f295e488700 1 --2- 172.21.15.50:0/1668121059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295806a3a0 0x7f295809fe00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f29580d0410 tx=0x7f2948004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.607+0000 7f294effd700 1 -- 172.21.15.50:0/1668121059 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948004300 con 0x7f295806a3a0 2023-11-28T11:55:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.607+0000 7f294effd700 1 -- 172.21.15.50:0/1668121059 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294801f070 con 0x7f295806a3a0 2023-11-28T11:55:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.607+0000 7f295f48a700 1 -- 172.21.15.50:0/1668121059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295815c700 con 0x7f295806a3a0 2023-11-28T11:55:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.607+0000 7f294effd700 1 -- 172.21.15.50:0/1668121059 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29480036c0 con 0x7f295806a3a0 2023-11-28T11:55:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.607+0000 7f295f48a700 1 -- 172.21.15.50:0/1668121059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295806d770 con 0x7f295806a3a0 2023-11-28T11:55:21.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.607+0000 7f295f48a700 1 -- 172.21.15.50:0/1668121059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29580d25d0 con 0x7f295806a3a0 2023-11-28T11:55:21.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.607+0000 7f294effd700 1 -- 172.21.15.50:0/1668121059 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f294802a020 con 0x7f295806a3a0 2023-11-28T11:55:21.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.607+0000 7f294effd700 1 --2- 172.21.15.50:0/1668121059 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f293c064f10 0x7f293c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.611+0000 7f294effd700 1 -- 172.21.15.50:0/1668121059 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f29480834a0 con 0x7f295806a3a0 2023-11-28T11:55:21.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.611+0000 7f295dc87700 1 --2- 172.21.15.50:0/1668121059 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f293c064f10 0x7f293c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.611+0000 7f295dc87700 1 --2- 172.21.15.50:0/1668121059 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f293c064f10 0x7f293c0673c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f295815f8e0 tx=0x7f2954008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:21.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.615+0000 7f294effd700 1 -- 172.21.15.50:0/1668121059 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2948051390 con 0x7f295806a3a0 2023-11-28T11:55:21.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.775+0000 7f295f48a700 1 -- 172.21.15.50:0/1668121059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2958065e50 con 0x7f295806a3a0 2023-11-28T11:55:21.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.779+0000 7f294effd700 1 -- 172.21.15.50:0/1668121059 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f29480549b0 con 0x7f295806a3a0 2023-11-28T11:55:21.779 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:55:21.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.783+0000 7f295f48a700 1 -- 172.21.15.50:0/1668121059 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f293c064f10 msgr2=0x7f293c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:21.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.783+0000 7f295f48a700 1 --2- 172.21.15.50:0/1668121059 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f293c064f10 0x7f293c0673c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f295815f8e0 tx=0x7f2954008040 comp rx=0 tx=0).stop 2023-11-28T11:55:21.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.783+0000 7f295f48a700 1 -- 172.21.15.50:0/1668121059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295806a3a0 msgr2=0x7f295809fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:21.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.783+0000 7f295f48a700 1 --2- 172.21.15.50:0/1668121059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295806a3a0 0x7f295809fe00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f29580d0410 tx=0x7f2948004770 comp rx=0 tx=0).stop 2023-11-28T11:55:21.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.783+0000 7f295f48a700 1 -- 172.21.15.50:0/1668121059 shutdown_connections 2023-11-28T11:55:21.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.783+0000 7f295f48a700 1 --2- 172.21.15.50:0/1668121059 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29580d1e30 0x7f29580b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.783+0000 7f295f48a700 1 --2- 172.21.15.50:0/1668121059 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f293c064f10 0x7f293c0673c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.783+0000 7f295f48a700 1 --2- 172.21.15.50:0/1668121059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f295806ce60 0x7f295815de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.783+0000 7f295f48a700 1 --2- 172.21.15.50:0/1668121059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f295806a3a0 0x7f295809fe00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.783+0000 7f295f48a700 1 -- 172.21.15.50:0/1668121059 >> 172.21.15.50:0/1668121059 conn(0x7f295809bbd0 msgr2=0x7f29580b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:21.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.783+0000 7f295f48a700 1 -- 172.21.15.50:0/1668121059 shutdown_connections 2023-11-28T11:55:21.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.783+0000 7f295f48a700 1 -- 172.21.15.50:0/1668121059 wait complete. 2023-11-28T11:55:21.799 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:55:21.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.919+0000 7f15253eb700 1 Processor -- start 2023-11-28T11:55:21.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.919+0000 7f15253eb700 1 -- start start 2023-11-28T11:55:21.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f15253eb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15180de420 0x7f1518008370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f15253eb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f15180088b0 0x7f1518037880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f15253eb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1518037dc0 0x7f15180e4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f15253eb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1518038240 con 0x7f1518037dc0 2023-11-28T11:55:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f15253eb700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15180e0d40 con 0x7f15180088b0 2023-11-28T11:55:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f15253eb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15180e1020 con 0x7f15180de420 2023-11-28T11:55:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f1524bea700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1518037dc0 0x7f15180e4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f1524bea700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1518037dc0 0x7f15180e4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36286/0 (socket says 172.21.15.50:36286) 2023-11-28T11:55:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f1524bea700 1 -- 172.21.15.50:0/620749900 learned_addr learned my addr 172.21.15.50:0/620749900 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f151f7fe700 1 --2- 172.21.15.50:0/620749900 >> v2:172.21.15.192:3300/0 conn(0x7f15180088b0 0x7f1518037880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f151ffff700 1 --2- 172.21.15.50:0/620749900 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15180de420 0x7f1518008370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f1524bea700 1 -- 172.21.15.50:0/620749900 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15180de420 msgr2=0x7f1518008370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f1524bea700 1 --2- 172.21.15.50:0/620749900 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15180de420 0x7f1518008370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f1524bea700 1 -- 172.21.15.50:0/620749900 >> v2:172.21.15.192:3300/0 conn(0x7f15180088b0 msgr2=0x7f1518037880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f1524bea700 1 --2- 172.21.15.50:0/620749900 >> v2:172.21.15.192:3300/0 conn(0x7f15180088b0 0x7f1518037880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f1524bea700 1 -- 172.21.15.50:0/620749900 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15180e1300 con 0x7f1518037dc0 2023-11-28T11:55:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f1524bea700 1 --2- 172.21.15.50:0/620749900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1518037dc0 0x7f15180e4220 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f152004f230 tx=0x7f1520073710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d381ace87f1c797 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f151effd700 1 -- 172.21.15.50:0/620749900 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520067660 con 0x7f1518037dc0 2023-11-28T11:55:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f151effd700 1 -- 172.21.15.50:0/620749900 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15200727d0 con 0x7f1518037dc0 2023-11-28T11:55:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f151effd700 1 -- 172.21.15.50:0/620749900 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520072c00 con 0x7f1518037dc0 2023-11-28T11:55:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f15253eb700 1 -- 172.21.15.50:0/620749900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1518037dc0 msgr2=0x7f15180e4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f15253eb700 1 --2- 172.21.15.50:0/620749900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1518037dc0 0x7f15180e4220 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f152004f230 tx=0x7f1520073710 comp rx=0 tx=0).stop 2023-11-28T11:55:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f15253eb700 1 -- 172.21.15.50:0/620749900 shutdown_connections 2023-11-28T11:55:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f15253eb700 1 --2- 172.21.15.50:0/620749900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1518037dc0 0x7f15180e4220 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f15253eb700 1 --2- 172.21.15.50:0/620749900 >> v2:172.21.15.192:3300/0 conn(0x7f15180088b0 0x7f1518037880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f15253eb700 1 --2- 172.21.15.50:0/620749900 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15180de420 0x7f1518008370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f15253eb700 1 -- 172.21.15.50:0/620749900 >> 172.21.15.50:0/620749900 conn(0x7f1518052880 msgr2=0x7f1518052c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f15253eb700 1 -- 172.21.15.50:0/620749900 shutdown_connections 2023-11-28T11:55:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.923+0000 7f15253eb700 1 -- 172.21.15.50:0/620749900 wait complete. 2023-11-28T11:55:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.927+0000 7f15253eb700 1 Processor -- start 2023-11-28T11:55:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.927+0000 7f15253eb700 1 -- start start 2023-11-28T11:55:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f15253eb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15180088b0 0x7f1518036780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f15253eb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1518037dc0 0x7f15180d45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f15253eb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15180de420 0x7f1518177990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f15253eb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15180d4af0 con 0x7f15180de420 2023-11-28T11:55:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f15253eb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1518049870 con 0x7f15180088b0 2023-11-28T11:55:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f15253eb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1518036df0 con 0x7f1518037dc0 2023-11-28T11:55:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f1524bea700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15180de420 0x7f1518177990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f1524bea700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15180de420 0x7f1518177990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36288/0 (socket says 172.21.15.50:36288) 2023-11-28T11:55:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f1524bea700 1 -- 172.21.15.50:0/3513243380 learned_addr learned my addr 172.21.15.50:0/3513243380 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f151ffff700 1 --2- 172.21.15.50:0/3513243380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15180088b0 0x7f1518036780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f151f7fe700 1 --2- 172.21.15.50:0/3513243380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1518037dc0 0x7f15180d45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f1524bea700 1 -- 172.21.15.50:0/3513243380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1518037dc0 msgr2=0x7f15180d45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f1524bea700 1 --2- 172.21.15.50:0/3513243380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1518037dc0 0x7f15180d45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f1524bea700 1 -- 172.21.15.50:0/3513243380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15180088b0 msgr2=0x7f1518036780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f1524bea700 1 --2- 172.21.15.50:0/3513243380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15180088b0 0x7f1518036780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f1524bea700 1 -- 172.21.15.50:0/3513243380 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152004e740 con 0x7f15180de420 2023-11-28T11:55:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f151f7fe700 1 --2- 172.21.15.50:0/3513243380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1518037dc0 0x7f15180d45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f151ffff700 1 --2- 172.21.15.50:0/3513243380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15180088b0 0x7f1518036780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f1524bea700 1 --2- 172.21.15.50:0/3513243380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15180de420 0x7f1518177990 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1520069bb0 tx=0x7f15200699b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:21.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f151cff9700 1 -- 172.21.15.50:0/3513243380 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520097070 con 0x7f15180de420 2023-11-28T11:55:21.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f151cff9700 1 -- 172.21.15.50:0/3513243380 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1520066b20 con 0x7f15180de420 2023-11-28T11:55:21.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f15253eb700 1 -- 172.21.15.50:0/3513243380 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15180e1b00 con 0x7f15180de420 2023-11-28T11:55:21.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f151cff9700 1 -- 172.21.15.50:0/3513243380 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520066ed0 con 0x7f15180de420 2023-11-28T11:55:21.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f15253eb700 1 -- 172.21.15.50:0/3513243380 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15180e15e0 con 0x7f15180de420 2023-11-28T11:55:21.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f15253eb700 1 -- 172.21.15.50:0/3513243380 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1518008e30 con 0x7f15180de420 2023-11-28T11:55:21.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.931+0000 7f151cff9700 1 -- 172.21.15.50:0/3513243380 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1520067b20 con 0x7f15180de420 2023-11-28T11:55:21.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.935+0000 7f151cff9700 1 --2- 172.21.15.50:0/3513243380 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1504064ee0 0x7f1504067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:21.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.935+0000 7f151cff9700 1 -- 172.21.15.50:0/3513243380 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f15200fbfb0 con 0x7f15180de420 2023-11-28T11:55:21.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.935+0000 7f151ffff700 1 --2- 172.21.15.50:0/3513243380 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1504064ee0 0x7f1504067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:21.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.935+0000 7f151ffff700 1 --2- 172.21.15.50:0/3513243380 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1504064ee0 0x7f1504067390 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f150c009c40 tx=0x7f150c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:21.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:21.943+0000 7f151cff9700 1 -- 172.21.15.50:0/3513243380 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f15200c9f90 con 0x7f15180de420 2023-11-28T11:55:22.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.103+0000 7f15253eb700 1 -- 172.21.15.50:0/3513243380 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15180059c0 con 0x7f15180de420 2023-11-28T11:55:22.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.107+0000 7f151cff9700 1 -- 172.21.15.50:0/3513243380 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f15200cd5b0 con 0x7f15180de420 2023-11-28T11:55:22.108 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:55:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.107+0000 7f15253eb700 1 -- 172.21.15.50:0/3513243380 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1504064ee0 msgr2=0x7f1504067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.107+0000 7f15253eb700 1 --2- 172.21.15.50:0/3513243380 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1504064ee0 0x7f1504067390 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f150c009c40 tx=0x7f150c008040 comp rx=0 tx=0).stop 2023-11-28T11:55:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.107+0000 7f15253eb700 1 -- 172.21.15.50:0/3513243380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15180de420 msgr2=0x7f1518177990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.107+0000 7f15253eb700 1 --2- 172.21.15.50:0/3513243380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15180de420 0x7f1518177990 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1520069bb0 tx=0x7f15200699b0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.107+0000 7f15253eb700 1 -- 172.21.15.50:0/3513243380 shutdown_connections 2023-11-28T11:55:22.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.107+0000 7f15253eb700 1 --2- 172.21.15.50:0/3513243380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15180de420 0x7f1518177990 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.107+0000 7f15253eb700 1 --2- 172.21.15.50:0/3513243380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1518037dc0 0x7f15180d45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.107+0000 7f15253eb700 1 --2- 172.21.15.50:0/3513243380 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1504064ee0 0x7f1504067390 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.107+0000 7f15253eb700 1 --2- 172.21.15.50:0/3513243380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15180088b0 0x7f1518036780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.107+0000 7f15253eb700 1 -- 172.21.15.50:0/3513243380 >> 172.21.15.50:0/3513243380 conn(0x7f1518052880 msgr2=0x7f1518052c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:22.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.107+0000 7f15253eb700 1 -- 172.21.15.50:0/3513243380 shutdown_connections 2023-11-28T11:55:22.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.107+0000 7f15253eb700 1 -- 172.21.15.50:0/3513243380 wait complete. 2023-11-28T11:55:22.123 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:55:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.239+0000 7f87a9cb9700 1 Processor -- start 2023-11-28T11:55:22.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.239+0000 7f87a9cb9700 1 -- start start 2023-11-28T11:55:22.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.239+0000 7f87a9cb9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87a4159e70 0x7f87a406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:22.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.239+0000 7f87a9cb9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f87a40cb470 0x7f87a40c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:22.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.239+0000 7f87a9cb9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a406ace0 con 0x7f87a4069c40 2023-11-28T11:55:22.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.239+0000 7f87a9cb9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a406a0d0 con 0x7f87a40cb470 2023-11-28T11:55:22.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.239+0000 7f87a9cb9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a406a3b0 con 0x7f87a4159e70 2023-11-28T11:55:22.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.239+0000 7f87a94b8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f87a40cb470 0x7f87a40c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:22.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.239+0000 7f87a94b8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f87a40cb470 0x7f87a40c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:43424/0 (socket says 172.21.15.50:43424) 2023-11-28T11:55:22.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.239+0000 7f87a94b8700 1 -- 172.21.15.50:0/283446176 learned_addr learned my addr 172.21.15.50:0/283446176 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:22.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.239+0000 7f87a8cb7700 1 --2- 172.21.15.50:0/283446176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87a4159e70 0x7f87a406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:22.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.239+0000 7f87a94b8700 1 -- 172.21.15.50:0/283446176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87a4159e70 msgr2=0x7f87a406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:22.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.239+0000 7f87a94b8700 1 --2- 172.21.15.50:0/283446176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87a4159e70 0x7f87a406c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.239+0000 7f87a94b8700 1 -- 172.21.15.50:0/283446176 >> v1:172.21.15.192:6789/0 conn(0x7f87a4069c40 legacy=0x7f87a40cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.239+0000 7f87a94b8700 1 -- 172.21.15.50:0/283446176 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a406a690 con 0x7f87a40cb470 2023-11-28T11:55:22.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.239+0000 7f87a94b8700 1 --2- 172.21.15.50:0/283446176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a40cb470 0x7f87a40c91d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f879c009e50 tx=0x7f879c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1327429aa06ea575 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:22.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.239+0000 7f87a37fe700 1 -- 172.21.15.50:0/283446176 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c00e070 con 0x7f87a40cb470 2023-11-28T11:55:22.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a37fe700 1 -- 172.21.15.50:0/283446176 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c00b910 con 0x7f87a40cb470 2023-11-28T11:55:22.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a37fe700 1 -- 172.21.15.50:0/283446176 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c00bcc0 con 0x7f87a40cb470 2023-11-28T11:55:22.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a9cb9700 1 -- 172.21.15.50:0/283446176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a40cb470 msgr2=0x7f87a40c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a9cb9700 1 --2- 172.21.15.50:0/283446176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a40cb470 0x7f87a40c91d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f879c009e50 tx=0x7f879c00b330 comp rx=0 tx=0).stop 2023-11-28T11:55:22.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a9cb9700 1 -- 172.21.15.50:0/283446176 shutdown_connections 2023-11-28T11:55:22.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a9cb9700 1 --2- 172.21.15.50:0/283446176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a40cb470 0x7f87a40c91d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a9cb9700 1 --2- 172.21.15.50:0/283446176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87a4159e70 0x7f87a406c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a9cb9700 1 -- 172.21.15.50:0/283446176 >> 172.21.15.50:0/283446176 conn(0x7f87a40ce3e0 msgr2=0x7f87a40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:22.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a9cb9700 1 -- 172.21.15.50:0/283446176 shutdown_connections 2023-11-28T11:55:22.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a9cb9700 1 -- 172.21.15.50:0/283446176 wait complete. 2023-11-28T11:55:22.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a9cb9700 1 Processor -- start 2023-11-28T11:55:22.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a9cb9700 1 -- start start 2023-11-28T11:55:22.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a9cb9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a4069c40 0x7f87a41f8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:22.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a9cb9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87a40cb470 0x7f87a4071160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:22.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a9cb9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87a4159e70 0x7f87a40c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:22.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a9cb9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a40716a0 con 0x7f87a40cb470 2023-11-28T11:55:22.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a9cb9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a40c2210 con 0x7f87a4069c40 2023-11-28T11:55:22.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a9cb9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a40c24f0 con 0x7f87a4159e70 2023-11-28T11:55:22.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.243+0000 7f87a3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87a40cb470 0x7f87a4071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:22.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87a40cb470 0x7f87a4071160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36290/0 (socket says 172.21.15.50:36290) 2023-11-28T11:55:22.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a3fff700 1 -- 172.21.15.50:0/3404570920 learned_addr learned my addr 172.21.15.50:0/3404570920 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:22.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a8cb7700 1 --2- 172.21.15.50:0/3404570920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a4069c40 0x7f87a41f8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:22.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a94b8700 1 --2- 172.21.15.50:0/3404570920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87a4159e70 0x7f87a40c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:22.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a3fff700 1 -- 172.21.15.50:0/3404570920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87a4159e70 msgr2=0x7f87a40c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a3fff700 1 --2- 172.21.15.50:0/3404570920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87a4159e70 0x7f87a40c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a3fff700 1 -- 172.21.15.50:0/3404570920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a4069c40 msgr2=0x7f87a41f8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a3fff700 1 --2- 172.21.15.50:0/3404570920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a4069c40 0x7f87a41f8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a3fff700 1 -- 172.21.15.50:0/3404570920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c009b30 con 0x7f87a40cb470 2023-11-28T11:55:22.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a8cb7700 1 --2- 172.21.15.50:0/3404570920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a4069c40 0x7f87a41f8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:22.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a3fff700 1 --2- 172.21.15.50:0/3404570920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87a40cb470 0x7f87a4071160 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f879000c500 tx=0x7f879000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:22.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a17fa700 1 -- 172.21.15.50:0/3404570920 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87900052d0 con 0x7f87a40cb470 2023-11-28T11:55:22.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a17fa700 1 -- 172.21.15.50:0/3404570920 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8790005430 con 0x7f87a40cb470 2023-11-28T11:55:22.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a9cb9700 1 -- 172.21.15.50:0/3404570920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a415a240 con 0x7f87a40cb470 2023-11-28T11:55:22.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a17fa700 1 -- 172.21.15.50:0/3404570920 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87900055a0 con 0x7f87a40cb470 2023-11-28T11:55:22.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a9cb9700 1 -- 172.21.15.50:0/3404570920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a406a970 con 0x7f87a40cb470 2023-11-28T11:55:22.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a9cb9700 1 -- 172.21.15.50:0/3404570920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a406cee0 con 0x7f87a40cb470 2023-11-28T11:55:22.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a17fa700 1 -- 172.21.15.50:0/3404570920 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8790010050 con 0x7f87a40cb470 2023-11-28T11:55:22.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a17fa700 1 --2- 172.21.15.50:0/3404570920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8788064f10 0x7f87880673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:22.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.247+0000 7f87a17fa700 1 -- 172.21.15.50:0/3404570920 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8790081070 con 0x7f87a40cb470 2023-11-28T11:55:22.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.251+0000 7f87a8cb7700 1 --2- 172.21.15.50:0/3404570920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8788064f10 0x7f87880673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:22.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.251+0000 7f87a8cb7700 1 --2- 172.21.15.50:0/3404570920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8788064f10 0x7f87880673c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8798009f40 tx=0x7f8798009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:22.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.255+0000 7f87a17fa700 1 -- 172.21.15.50:0/3404570920 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8790049400 con 0x7f87a40cb470 2023-11-28T11:55:22.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.431+0000 7f87a9cb9700 1 -- 172.21.15.50:0/3404570920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f87a406b6d0 con 0x7f87a40cb470 2023-11-28T11:55:22.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.435+0000 7f87a17fa700 1 -- 172.21.15.50:0/3404570920 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7f879004f070 con 0x7f87a40cb470 2023-11-28T11:55:22.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.435+0000 7f87a9cb9700 1 -- 172.21.15.50:0/3404570920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8788064f10 msgr2=0x7f87880673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.435+0000 7f87a9cb9700 1 --2- 172.21.15.50:0/3404570920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8788064f10 0x7f87880673c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8798009f40 tx=0x7f8798009240 comp rx=0 tx=0).stop 2023-11-28T11:55:22.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.435+0000 7f87a9cb9700 1 -- 172.21.15.50:0/3404570920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87a40cb470 msgr2=0x7f87a4071160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.435+0000 7f87a9cb9700 1 --2- 172.21.15.50:0/3404570920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87a40cb470 0x7f87a4071160 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f879000c500 tx=0x7f879000c810 comp rx=0 tx=0).stop 2023-11-28T11:55:22.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.435+0000 7f87a9cb9700 1 -- 172.21.15.50:0/3404570920 shutdown_connections 2023-11-28T11:55:22.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.435+0000 7f87a9cb9700 1 --2- 172.21.15.50:0/3404570920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87a4159e70 0x7f87a40c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.435+0000 7f87a9cb9700 1 --2- 172.21.15.50:0/3404570920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87a40cb470 0x7f87a4071160 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.435+0000 7f87a9cb9700 1 --2- 172.21.15.50:0/3404570920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8788064f10 0x7f87880673c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.435+0000 7f87a9cb9700 1 --2- 172.21.15.50:0/3404570920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87a4069c40 0x7f87a41f8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.435+0000 7f87a9cb9700 1 -- 172.21.15.50:0/3404570920 >> 172.21.15.50:0/3404570920 conn(0x7f87a40ce3e0 msgr2=0x7f87a40ace00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.435+0000 7f87a9cb9700 1 -- 172.21.15.50:0/3404570920 shutdown_connections 2023-11-28T11:55:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.435+0000 7f87a9cb9700 1 -- 172.21.15.50:0/3404570920 wait complete. 2023-11-28T11:55:22.441 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-11-28T11:55:22.451 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:55:22.451 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:55:22.457 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:55:22.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.571+0000 7f84ae62f700 1 Processor -- start 2023-11-28T11:55:22.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.571+0000 7f84ae62f700 1 -- start start 2023-11-28T11:55:22.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ae62f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a8158e60 0x7f84a80c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:22.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ae62f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f84a80cb460 0x7f84a80cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ae62f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a80cd8f0 con 0x7f84a80ad490 2023-11-28T11:55:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ae62f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a80add00 con 0x7f84a80cb460 2023-11-28T11:55:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ae62f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80cc4f0 con 0x7f84a8158e60 2023-11-28T11:55:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ade2e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f84a80cb460 0x7f84a80cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ace2c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f84a80ad490 0x7f84a80cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39778/0 (socket says 172.21.15.50:39778) 2023-11-28T11:55:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ace2c700 1 -- 172.21.15.50:0/1991415853 learned_addr learned my addr 172.21.15.50:0/1991415853 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ad62d700 1 --2- 172.21.15.50:0/1991415853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a8158e60 0x7f84a80c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ade2e700 1 -- 172.21.15.50:0/1991415853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a8158e60 msgr2=0x7f84a80c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ade2e700 1 --2- 172.21.15.50:0/1991415853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a8158e60 0x7f84a80c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ade2e700 1 -- 172.21.15.50:0/1991415853 >> v1:172.21.15.50:6789/0 conn(0x7f84a80ad490 legacy=0x7f84a80cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ade2e700 1 -- 172.21.15.50:0/1991415853 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a806dc60 con 0x7f84a80cb460 2023-11-28T11:55:22.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ade2e700 1 --2- 172.21.15.50:0/1991415853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a80cb460 0x7f84a80cbfb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009dc0 tx=0x7f84a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956a830d31dc2f36 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f849ffff700 1 -- 172.21.15.50:0/1991415853 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a000e070 con 0x7f84a80cb460 2023-11-28T11:55:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f849ffff700 1 -- 172.21.15.50:0/1991415853 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a000bae0 con 0x7f84a80cb460 2023-11-28T11:55:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f849ffff700 1 -- 172.21.15.50:0/1991415853 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a000be90 con 0x7f84a80cb460 2023-11-28T11:55:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ae62f700 1 -- 172.21.15.50:0/1991415853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a80cb460 msgr2=0x7f84a80cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ae62f700 1 --2- 172.21.15.50:0/1991415853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a80cb460 0x7f84a80cbfb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009dc0 tx=0x7f84a000b330 comp rx=0 tx=0).stop 2023-11-28T11:55:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ae62f700 1 -- 172.21.15.50:0/1991415853 shutdown_connections 2023-11-28T11:55:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ae62f700 1 --2- 172.21.15.50:0/1991415853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a80cb460 0x7f84a80cbfb0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ae62f700 1 --2- 172.21.15.50:0/1991415853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a8158e60 0x7f84a80c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ae62f700 1 -- 172.21.15.50:0/1991415853 >> 172.21.15.50:0/1991415853 conn(0x7f84a80ce3e0 msgr2=0x7f84a80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ae62f700 1 -- 172.21.15.50:0/1991415853 shutdown_connections 2023-11-28T11:55:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.575+0000 7f84ae62f700 1 -- 172.21.15.50:0/1991415853 wait complete. 2023-11-28T11:55:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ae62f700 1 Processor -- start 2023-11-28T11:55:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ae62f700 1 -- start start 2023-11-28T11:55:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ae62f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84a80ad490 0x7f84a80afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ae62f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a80cb460 0x7f84a80b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ae62f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a8158e60 0x7f84a8159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ae62f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a8159420 con 0x7f84a80cb460 2023-11-28T11:55:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ae62f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80b06c0 con 0x7f84a80ad490 2023-11-28T11:55:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ae62f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80b0910 con 0x7f84a8158e60 2023-11-28T11:55:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ace2c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a80cb460 0x7f84a80b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ace2c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a80cb460 0x7f84a80b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36318/0 (socket says 172.21.15.50:36318) 2023-11-28T11:55:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ace2c700 1 -- 172.21.15.50:0/1924751150 learned_addr learned my addr 172.21.15.50:0/1924751150 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ade2e700 1 --2- 172.21.15.50:0/1924751150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a8158e60 0x7f84a8159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ad62d700 1 --2- 172.21.15.50:0/1924751150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84a80ad490 0x7f84a80afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ace2c700 1 -- 172.21.15.50:0/1924751150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a8158e60 msgr2=0x7f84a8159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ace2c700 1 --2- 172.21.15.50:0/1924751150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a8158e60 0x7f84a8159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ace2c700 1 -- 172.21.15.50:0/1924751150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84a80ad490 msgr2=0x7f84a80afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ace2c700 1 --2- 172.21.15.50:0/1924751150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84a80ad490 0x7f84a80afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ace2c700 1 -- 172.21.15.50:0/1924751150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a0009a70 con 0x7f84a80cb460 2023-11-28T11:55:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ace2c700 1 --2- 172.21.15.50:0/1924751150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a80cb460 0x7f84a80b0180 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f849800c730 tx=0x7f849800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f849dffb700 1 -- 172.21.15.50:0/1924751150 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8498005d90 con 0x7f84a80cb460 2023-11-28T11:55:22.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f849dffb700 1 -- 172.21.15.50:0/1924751150 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84980070d0 con 0x7f84a80cb460 2023-11-28T11:55:22.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ae62f700 1 -- 172.21.15.50:0/1924751150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a8159230 con 0x7f84a80cb460 2023-11-28T11:55:22.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f849dffb700 1 -- 172.21.15.50:0/1924751150 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8498007440 con 0x7f84a80cb460 2023-11-28T11:55:22.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.579+0000 7f84ae62f700 1 -- 172.21.15.50:0/1924751150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a80cde90 con 0x7f84a80cb460 2023-11-28T11:55:22.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.583+0000 7f84ae62f700 1 -- 172.21.15.50:0/1924751150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a806d6a0 con 0x7f84a80cb460 2023-11-28T11:55:22.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.583+0000 7f849dffb700 1 -- 172.21.15.50:0/1924751150 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8498019030 con 0x7f84a80cb460 2023-11-28T11:55:22.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.583+0000 7f849dffb700 1 --2- 172.21.15.50:0/1924751150 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f848c064f10 0x7f848c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:22.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.583+0000 7f849dffb700 1 -- 172.21.15.50:0/1924751150 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8498081150 con 0x7f84a80cb460 2023-11-28T11:55:22.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.583+0000 7f84ad62d700 1 --2- 172.21.15.50:0/1924751150 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f848c064f10 0x7f848c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:22.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.587+0000 7f84ad62d700 1 --2- 172.21.15.50:0/1924751150 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f848c064f10 0x7f848c0673c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f84a809c3e0 tx=0x7f84a4009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:22.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.591+0000 7f849dffb700 1 -- 172.21.15.50:0/1924751150 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f849804a400 con 0x7f84a80cb460 2023-11-28T11:55:22.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.751+0000 7f84ae62f700 1 -- 172.21.15.50:0/1924751150 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84a8072500 con 0x7f84a80cb460 2023-11-28T11:55:22.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.755+0000 7f849dffb700 1 -- 172.21.15.50:0/1924751150 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17974 (secure 0 0 0) 0x7f849804f260 con 0x7f84a80cb460 2023-11-28T11:55:22.756 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:22.756 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":40,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:55:07.205255+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:55:03.889842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T11:55:05.177617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:55:22.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.755+0000 7f84ae62f700 1 -- 172.21.15.50:0/1924751150 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f848c064f10 msgr2=0x7f848c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.755+0000 7f84ae62f700 1 --2- 172.21.15.50:0/1924751150 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f848c064f10 0x7f848c0673c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f84a809c3e0 tx=0x7f84a4009240 comp rx=0 tx=0).stop 2023-11-28T11:55:22.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.759+0000 7f84ae62f700 1 -- 172.21.15.50:0/1924751150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a80cb460 msgr2=0x7f84a80b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.759+0000 7f84ae62f700 1 --2- 172.21.15.50:0/1924751150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a80cb460 0x7f84a80b0180 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f849800c730 tx=0x7f849800ca40 comp rx=0 tx=0).stop 2023-11-28T11:55:22.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.759+0000 7f84ae62f700 1 -- 172.21.15.50:0/1924751150 shutdown_connections 2023-11-28T11:55:22.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.759+0000 7f84ae62f700 1 --2- 172.21.15.50:0/1924751150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a8158e60 0x7f84a8159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.759+0000 7f84ae62f700 1 --2- 172.21.15.50:0/1924751150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a80cb460 0x7f84a80b0180 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.759+0000 7f84ae62f700 1 --2- 172.21.15.50:0/1924751150 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f848c064f10 0x7f848c0673c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.759+0000 7f84ae62f700 1 --2- 172.21.15.50:0/1924751150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84a80ad490 0x7f84a80afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.759+0000 7f84ae62f700 1 -- 172.21.15.50:0/1924751150 >> 172.21.15.50:0/1924751150 conn(0x7f84a80ce3e0 msgr2=0x7f84a80c9810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:22.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.759+0000 7f84ae62f700 1 -- 172.21.15.50:0/1924751150 shutdown_connections 2023-11-28T11:55:22.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.759+0000 7f84ae62f700 1 -- 172.21.15.50:0/1924751150 wait complete. 2023-11-28T11:55:22.777 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:55:03.889842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:55:05.177617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:55:22.778 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:55:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.899+0000 7f64c27ad700 1 Processor -- start 2023-11-28T11:55:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.899+0000 7f64c27ad700 1 -- start start 2023-11-28T11:55:22.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.899+0000 7f64c27ad700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64bc0cc590 0x7f64bc0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:22.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.899+0000 7f64c27ad700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64bc0cac70 con 0x7f64bc0cfdd0 2023-11-28T11:55:22.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.899+0000 7f64c27ad700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64bc0d0340 con 0x7f64bc0b2740 2023-11-28T11:55:22.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.899+0000 7f64c27ad700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc06c8e0 con 0x7f64bc0cc590 2023-11-28T11:55:22.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.899+0000 7f64c0faa700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f64bc0cfdd0 0x7f64bc0b2030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39792/0 (socket says 172.21.15.50:39792) 2023-11-28T11:55:22.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.899+0000 7f64c0faa700 1 -- 172.21.15.50:0/1217209228 learned_addr learned my addr 172.21.15.50:0/1217209228 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:22.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.899+0000 7f64c17ab700 1 --2- 172.21.15.50:0/1217209228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64bc0cc590 0x7f64bc0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:22.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.903+0000 7f64affff700 1 -- 172.21.15.50:0/1217209228 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533018726 0 0) 0x7f64bc0cac70 con 0x7f64bc0cfdd0 2023-11-28T11:55:22.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.903+0000 7f64affff700 1 -- 172.21.15.50:0/1217209228 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64a80035d0 con 0x7f64bc0cfdd0 2023-11-28T11:55:22.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.903+0000 7f64c17ab700 1 -- 172.21.15.50:0/1217209228 >> v1:172.21.15.192:6789/0 conn(0x7f64bc0b2740 legacy=0x7f64bc0cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.903+0000 7f64c17ab700 1 -- 172.21.15.50:0/1217209228 >> v1:172.21.15.50:6789/0 conn(0x7f64bc0cfdd0 legacy=0x7f64bc0b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.903+0000 7f64c17ab700 1 -- 172.21.15.50:0/1217209228 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc06d1d0 con 0x7f64bc0cc590 2023-11-28T11:55:22.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.903+0000 7f64c17ab700 1 --2- 172.21.15.50:0/1217209228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64bc0cc590 0x7f64bc0b0940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009880 tx=0x7f64b8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43ac008a9400538c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:22.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.903+0000 7f64affff700 1 -- 172.21.15.50:0/1217209228 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8011830 con 0x7f64bc0cc590 2023-11-28T11:55:22.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.903+0000 7f64affff700 1 -- 172.21.15.50:0/1217209228 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b8011990 con 0x7f64bc0cc590 2023-11-28T11:55:22.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.903+0000 7f64affff700 1 -- 172.21.15.50:0/1217209228 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8011d20 con 0x7f64bc0cc590 2023-11-28T11:55:22.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.903+0000 7f64c27ad700 1 -- 172.21.15.50:0/1217209228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64bc0cc590 msgr2=0x7f64bc0b0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.903+0000 7f64c27ad700 1 --2- 172.21.15.50:0/1217209228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64bc0cc590 0x7f64bc0b0940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009880 tx=0x7f64b8009b90 comp rx=0 tx=0).stop 2023-11-28T11:55:22.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.903+0000 7f64c27ad700 1 -- 172.21.15.50:0/1217209228 shutdown_connections 2023-11-28T11:55:22.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.903+0000 7f64c27ad700 1 --2- 172.21.15.50:0/1217209228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64bc0cc590 0x7f64bc0b0940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.903+0000 7f64c27ad700 1 -- 172.21.15.50:0/1217209228 >> 172.21.15.50:0/1217209228 conn(0x7f64bc0cd0a0 msgr2=0x7f64bc0cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:22.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.903+0000 7f64c27ad700 1 -- 172.21.15.50:0/1217209228 shutdown_connections 2023-11-28T11:55:22.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.903+0000 7f64c27ad700 1 -- 172.21.15.50:0/1217209228 wait complete. 2023-11-28T11:55:22.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c27ad700 1 Processor -- start 2023-11-28T11:55:22.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c27ad700 1 -- start start 2023-11-28T11:55:22.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c27ad700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64bc0b2740 0x7f64bc0b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c27ad700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64bc0cfdd0 0x7f64bc1f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c27ad700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64bc1f1460 0x7f64bc0b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c27ad700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc0b6550 con 0x7f64bc1f1460 2023-11-28T11:55:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c27ad700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc0b5940 con 0x7f64bc0cfdd0 2023-11-28T11:55:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c27ad700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc0b5c20 con 0x7f64bc0b2740 2023-11-28T11:55:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c1fac700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64bc1f1460 0x7f64bc0b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c1fac700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64bc1f1460 0x7f64bc0b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36332/0 (socket says 172.21.15.50:36332) 2023-11-28T11:55:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c1fac700 1 -- 172.21.15.50:0/2341450886 learned_addr learned my addr 172.21.15.50:0/2341450886 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c17ab700 1 --2- 172.21.15.50:0/2341450886 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64bc0b2740 0x7f64bc0b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c0faa700 1 --2- 172.21.15.50:0/2341450886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64bc0cfdd0 0x7f64bc1f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c1fac700 1 -- 172.21.15.50:0/2341450886 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64bc0b2740 msgr2=0x7f64bc0b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c1fac700 1 --2- 172.21.15.50:0/2341450886 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64bc0b2740 0x7f64bc0b5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c1fac700 1 -- 172.21.15.50:0/2341450886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64bc0cfdd0 msgr2=0x7f64bc1f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c1fac700 1 --2- 172.21.15.50:0/2341450886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64bc0cfdd0 0x7f64bc1f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c1fac700 1 -- 172.21.15.50:0/2341450886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b80094b0 con 0x7f64bc1f1460 2023-11-28T11:55:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c1fac700 1 --2- 172.21.15.50:0/2341450886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64bc1f1460 0x7f64bc0b0030 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f64b400cb50 tx=0x7f64b400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64adffb700 1 -- 172.21.15.50:0/2341450886 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4003c20 con 0x7f64bc1f1460 2023-11-28T11:55:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64adffb700 1 -- 172.21.15.50:0/2341450886 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b4003d80 con 0x7f64bc1f1460 2023-11-28T11:55:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c27ad700 1 -- 172.21.15.50:0/2341450886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64bc0ce520 con 0x7f64bc1f1460 2023-11-28T11:55:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64adffb700 1 -- 172.21.15.50:0/2341450886 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b400ab70 con 0x7f64bc1f1460 2023-11-28T11:55:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.907+0000 7f64c27ad700 1 -- 172.21.15.50:0/2341450886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64bc06d4b0 con 0x7f64bc1f1460 2023-11-28T11:55:22.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.911+0000 7f64c27ad700 1 -- 172.21.15.50:0/2341450886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64bc0b0e80 con 0x7f64bc1f1460 2023-11-28T11:55:22.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.911+0000 7f64adffb700 1 -- 172.21.15.50:0/2341450886 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f64b4010050 con 0x7f64bc1f1460 2023-11-28T11:55:22.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.911+0000 7f64adffb700 1 --2- 172.21.15.50:0/2341450886 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f64a0064ee0 0x7f64a0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:22.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.911+0000 7f64adffb700 1 -- 172.21.15.50:0/2341450886 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f64b4081ed0 con 0x7f64bc1f1460 2023-11-28T11:55:22.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.911+0000 7f64c17ab700 1 --2- 172.21.15.50:0/2341450886 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f64a0064ee0 0x7f64a0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.911+0000 7f64c17ab700 1 --2- 172.21.15.50:0/2341450886 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f64a0064ee0 0x7f64a0067390 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f64b80090b0 tx=0x7f64b8010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:22.919+0000 7f64adffb700 1 -- 172.21.15.50:0/2341450886 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f64b404ff30 con 0x7f64bc1f1460 2023-11-28T11:55:23.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.083+0000 7f64c27ad700 1 -- 172.21.15.50:0/2341450886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f64bc0c47b0 con 0x7f64bc1f1460 2023-11-28T11:55:23.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.083+0000 7f64adffb700 1 -- 172.21.15.50:0/2341450886 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f64bc0c47b0 con 0x7f64bc1f1460 2023-11-28T11:55:23.087 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:55:23.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.087+0000 7f64c27ad700 1 -- 172.21.15.50:0/2341450886 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f64a0064ee0 msgr2=0x7f64a0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.087+0000 7f64c27ad700 1 --2- 172.21.15.50:0/2341450886 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f64a0064ee0 0x7f64a0067390 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f64b80090b0 tx=0x7f64b8010000 comp rx=0 tx=0).stop 2023-11-28T11:55:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.087+0000 7f64c27ad700 1 -- 172.21.15.50:0/2341450886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64bc1f1460 msgr2=0x7f64bc0b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.087+0000 7f64c27ad700 1 --2- 172.21.15.50:0/2341450886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64bc1f1460 0x7f64bc0b0030 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f64b400cb50 tx=0x7f64b400cf10 comp rx=0 tx=0).stop 2023-11-28T11:55:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.087+0000 7f64c27ad700 1 -- 172.21.15.50:0/2341450886 shutdown_connections 2023-11-28T11:55:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.087+0000 7f64c27ad700 1 --2- 172.21.15.50:0/2341450886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64bc1f1460 0x7f64bc0b0030 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.087+0000 7f64c27ad700 1 --2- 172.21.15.50:0/2341450886 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f64a0064ee0 0x7f64a0067390 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.087+0000 7f64c27ad700 1 --2- 172.21.15.50:0/2341450886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64bc0cfdd0 0x7f64bc1f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.087+0000 7f64c27ad700 1 --2- 172.21.15.50:0/2341450886 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64bc0b2740 0x7f64bc0b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.087+0000 7f64c27ad700 1 -- 172.21.15.50:0/2341450886 >> 172.21.15.50:0/2341450886 conn(0x7f64bc0cd0a0 msgr2=0x7f64bc0cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.087+0000 7f64c27ad700 1 -- 172.21.15.50:0/2341450886 shutdown_connections 2023-11-28T11:55:23.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.087+0000 7f64c27ad700 1 -- 172.21.15.50:0/2341450886 wait complete. 2023-11-28T11:55:23.102 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:55:23.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.219+0000 7f607b59e700 1 Processor -- start 2023-11-28T11:55:23.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.219+0000 7f607b59e700 1 -- start start 2023-11-28T11:55:23.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f607c06ce60 0x7f607c0d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607b59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f607c0cce60 0x7f607c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607b59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607c0cd2d0 con 0x7f607c0cf470 2023-11-28T11:55:23.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607b59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607c15c8b0 con 0x7f607c0cce60 2023-11-28T11:55:23.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607b59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c06d770 con 0x7f607c06ce60 2023-11-28T11:55:23.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607ad9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f607c0cf470 0x7f607c0cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39802/0 (socket says 172.21.15.50:39802) 2023-11-28T11:55:23.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607ad9d700 1 -- 172.21.15.50:0/1592385761 learned_addr learned my addr 172.21.15.50:0/1592385761 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:23.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f6079d9b700 1 --2- 172.21.15.50:0/1592385761 >> v2:172.21.15.192:3300/0 conn(0x7f607c0cce60 0x7f607c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607a59c700 1 --2- 172.21.15.50:0/1592385761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f607c06ce60 0x7f607c0d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 -- 172.21.15.50:0/1592385761 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772035430 0 0) 0x7f607c0cd2d0 con 0x7f607c0cf470 2023-11-28T11:55:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 -- 172.21.15.50:0/1592385761 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60680035d0 con 0x7f607c0cf470 2023-11-28T11:55:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 -- 172.21.15.50:0/1592385761 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4045708933 0 0) 0x7f60680035d0 con 0x7f607c0cf470 2023-11-28T11:55:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 -- 172.21.15.50:0/1592385761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f607c06ce60 msgr2=0x7f607c0d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:23.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 --2- 172.21.15.50:0/1592385761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f607c06ce60 0x7f607c0d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 -- 172.21.15.50:0/1592385761 >> v2:172.21.15.192:3300/0 conn(0x7f607c0cce60 msgr2=0x7f607c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:23.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 --2- 172.21.15.50:0/1592385761 >> v2:172.21.15.192:3300/0 conn(0x7f607c0cce60 0x7f607c06d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 -- 172.21.15.50:0/1592385761 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c06a7f0 con 0x7f607c0cf470 2023-11-28T11:55:23.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 -- 172.21.15.50:0/1592385761 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f60740019f0 con 0x7f607c0cf470 2023-11-28T11:55:23.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 -- 172.21.15.50:0/1592385761 >> v1:172.21.15.50:6789/0 conn(0x7f607c0cf470 legacy=0x7f607c0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:23.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 --2- 172.21.15.50:0/1592385761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f607c06ce60 0x7f6068003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 --2- 172.21.15.50:0/1592385761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6068003fa0 0x7f6068004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 --2- 172.21.15.50:0/1592385761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6068004db0 0x7f6068005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 -- 172.21.15.50:0/1592385761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c15c8b0 con 0x7f6068003fa0 2023-11-28T11:55:23.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 -- 172.21.15.50:0/1592385761 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c06d770 con 0x7f6068004db0 2023-11-28T11:55:23.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 -- 172.21.15.50:0/1592385761 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606800ba60 con 0x7f607c06ce60 2023-11-28T11:55:23.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f6079d9b700 1 --2- 172.21.15.50:0/1592385761 >> v2:172.21.15.192:3300/0 conn(0x7f607c0cce60 0x7f607c06d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:23.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f6079d9b700 1 --2- 172.21.15.50:0/1592385761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6068003fa0 0x7f6068004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607a59c700 1 --2- 172.21.15.50:0/1592385761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f607c06ce60 0x7f6068003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607ad9d700 1 --2- 172.21.15.50:0/1592385761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6068004db0 0x7f6068005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f6079d9b700 1 -- 172.21.15.50:0/1592385761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f607c06ce60 msgr2=0x7f6068003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:23.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f6079d9b700 1 --2- 172.21.15.50:0/1592385761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f607c06ce60 0x7f6068003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f6079d9b700 1 -- 172.21.15.50:0/1592385761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6068004db0 msgr2=0x7f6068005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:23.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f6079d9b700 1 --2- 172.21.15.50:0/1592385761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6068004db0 0x7f6068005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f6079d9b700 1 -- 172.21.15.50:0/1592385761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60680035d0 con 0x7f6068003fa0 2023-11-28T11:55:23.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607ad9d700 1 --2- 172.21.15.50:0/1592385761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6068004db0 0x7f6068005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:23.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f6079d9b700 1 --2- 172.21.15.50:0/1592385761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6068003fa0 0x7f6068004870 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f606c009d20 tx=0x7f60680058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709d289b79370b35 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:23.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 -- 172.21.15.50:0/1592385761 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c009e70 con 0x7f6068003fa0 2023-11-28T11:55:23.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 -- 172.21.15.50:0/1592385761 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c004030 con 0x7f6068003fa0 2023-11-28T11:55:23.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.223+0000 7f607959a700 1 -- 172.21.15.50:0/1592385761 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c0043a0 con 0x7f6068003fa0 2023-11-28T11:55:23.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.227+0000 7f607b59e700 1 -- 172.21.15.50:0/1592385761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6068003fa0 msgr2=0x7f6068004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:23.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.227+0000 7f607b59e700 1 --2- 172.21.15.50:0/1592385761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6068003fa0 0x7f6068004870 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f606c009d20 tx=0x7f60680058a0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.227+0000 7f607ad9d700 1 -- 172.21.15.50:0/1592385761 reap_dead start 2023-11-28T11:55:23.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.227+0000 7f607b59e700 1 -- 172.21.15.50:0/1592385761 shutdown_connections 2023-11-28T11:55:23.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.227+0000 7f607b59e700 1 -- 172.21.15.50:0/1592385761 >> 172.21.15.50:0/1592385761 conn(0x7f607c0b5760 msgr2=0x7f607c0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:23.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.227+0000 7f607b59e700 1 -- 172.21.15.50:0/1592385761 shutdown_connections 2023-11-28T11:55:23.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.227+0000 7f607b59e700 1 -- 172.21.15.50:0/1592385761 wait complete. 2023-11-28T11:55:23.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f607b59e700 1 Processor -- start 2023-11-28T11:55:23.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f607b59e700 1 -- start start 2023-11-28T11:55:23.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f607b59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6068003fa0 0x7f607c151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f607b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f607c0c8630 0x7f607c0afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f607b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f607c159220 0x7f607c159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f607b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c159bd0 con 0x7f607c0c8630 2023-11-28T11:55:23.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f607b59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c0c81a0 con 0x7f6068003fa0 2023-11-28T11:55:23.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f607b59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c0c72b0 con 0x7f607c159220 2023-11-28T11:55:23.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f6079d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f607c0c8630 0x7f607c0afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f6079d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f607c0c8630 0x7f607c0afd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36356/0 (socket says 172.21.15.50:36356) 2023-11-28T11:55:23.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f6079d9b700 1 -- 172.21.15.50:0/903475722 learned_addr learned my addr 172.21.15.50:0/903475722 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:23.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f607a59c700 1 --2- 172.21.15.50:0/903475722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6068003fa0 0x7f607c151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f607ad9d700 1 --2- 172.21.15.50:0/903475722 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f607c159220 0x7f607c159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f6079d9b700 1 -- 172.21.15.50:0/903475722 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f607c159220 msgr2=0x7f607c159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:23.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f6079d9b700 1 --2- 172.21.15.50:0/903475722 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f607c159220 0x7f607c159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f6079d9b700 1 -- 172.21.15.50:0/903475722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6068003fa0 msgr2=0x7f607c151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:23.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f6079d9b700 1 --2- 172.21.15.50:0/903475722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6068003fa0 0x7f607c151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f6079d9b700 1 -- 172.21.15.50:0/903475722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c06adb0 con 0x7f607c0c8630 2023-11-28T11:55:23.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f607ad9d700 1 --2- 172.21.15.50:0/903475722 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f607c159220 0x7f607c159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:23.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.231+0000 7f6079d9b700 1 --2- 172.21.15.50:0/903475722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f607c0c8630 0x7f607c0afd60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6068004790 tx=0x7f606c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:23.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.235+0000 7f6072ffd700 1 -- 172.21.15.50:0/903475722 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c021070 con 0x7f607c0c8630 2023-11-28T11:55:23.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.235+0000 7f6072ffd700 1 -- 172.21.15.50:0/903475722 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c004590 con 0x7f607c0c8630 2023-11-28T11:55:23.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.235+0000 7f607b59e700 1 -- 172.21.15.50:0/903475722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607c06aad0 con 0x7f607c0c8630 2023-11-28T11:55:23.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.235+0000 7f6072ffd700 1 -- 172.21.15.50:0/903475722 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c003b10 con 0x7f607c0c8630 2023-11-28T11:55:23.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.235+0000 7f607b59e700 1 -- 172.21.15.50:0/903475722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607c06b090 con 0x7f607c0c8630 2023-11-28T11:55:23.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.235+0000 7f607b59e700 1 -- 172.21.15.50:0/903475722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607c000980 con 0x7f607c0c8630 2023-11-28T11:55:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.235+0000 7f6072ffd700 1 -- 172.21.15.50:0/903475722 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f606c019070 con 0x7f607c0c8630 2023-11-28T11:55:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.235+0000 7f6072ffd700 1 --2- 172.21.15.50:0/903475722 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f605c064f10 0x7f605c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.235+0000 7f6072ffd700 1 -- 172.21.15.50:0/903475722 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f606c082c70 con 0x7f607c0c8630 2023-11-28T11:55:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.235+0000 7f607a59c700 1 --2- 172.21.15.50:0/903475722 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f605c064f10 0x7f605c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.235+0000 7f607a59c700 1 --2- 172.21.15.50:0/903475722 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f605c064f10 0x7f605c0673c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f607c0d23d0 tx=0x7f6064008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:23.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.247+0000 7f6072ffd700 1 -- 172.21.15.50:0/903475722 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f606c050c50 con 0x7f607c0c8630 2023-11-28T11:55:23.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.403+0000 7f607b59e700 1 -- 172.21.15.50:0/903475722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f607c072c20 con 0x7f607c0c8630 2023-11-28T11:55:23.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.407+0000 7f6072ffd700 1 -- 172.21.15.50:0/903475722 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f606c054270 con 0x7f607c0c8630 2023-11-28T11:55:23.408 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:55:23.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.407+0000 7f607b59e700 1 -- 172.21.15.50:0/903475722 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f605c064f10 msgr2=0x7f605c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:23.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.407+0000 7f607b59e700 1 --2- 172.21.15.50:0/903475722 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f605c064f10 0x7f605c0673c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f607c0d23d0 tx=0x7f6064008040 comp rx=0 tx=0).stop 2023-11-28T11:55:23.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.407+0000 7f607b59e700 1 -- 172.21.15.50:0/903475722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f607c0c8630 msgr2=0x7f607c0afd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:23.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.407+0000 7f607b59e700 1 --2- 172.21.15.50:0/903475722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f607c0c8630 0x7f607c0afd60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6068004790 tx=0x7f606c0047e0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.407+0000 7f607b59e700 1 -- 172.21.15.50:0/903475722 shutdown_connections 2023-11-28T11:55:23.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.407+0000 7f607b59e700 1 --2- 172.21.15.50:0/903475722 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f607c159220 0x7f607c159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.407+0000 7f607b59e700 1 --2- 172.21.15.50:0/903475722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f607c0c8630 0x7f607c0afd60 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.407+0000 7f607b59e700 1 --2- 172.21.15.50:0/903475722 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f605c064f10 0x7f605c0673c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.407+0000 7f607b59e700 1 --2- 172.21.15.50:0/903475722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6068003fa0 0x7f607c151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.407+0000 7f607b59e700 1 -- 172.21.15.50:0/903475722 >> 172.21.15.50:0/903475722 conn(0x7f607c0b5760 msgr2=0x7f607c0d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:23.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.407+0000 7f607b59e700 1 -- 172.21.15.50:0/903475722 shutdown_connections 2023-11-28T11:55:23.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.407+0000 7f607b59e700 1 -- 172.21.15.50:0/903475722 wait complete. 2023-11-28T11:55:23.423 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:55:23.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.535+0000 7f5526f63700 1 Processor -- start 2023-11-28T11:55:23.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.535+0000 7f5526f63700 1 -- start start 2023-11-28T11:55:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.535+0000 7f5526f63700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f55200b1ae0 0x7f552006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.535+0000 7f5526f63700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006a4c0 0x7f55200d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.535+0000 7f5526f63700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552006a9c0 con 0x7f55200cf0e0 2023-11-28T11:55:23.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.535+0000 7f5526f63700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552006aca0 con 0x7f55200b1ae0 2023-11-28T11:55:23.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.535+0000 7f5526f63700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552006af80 con 0x7f552006a4c0 2023-11-28T11:55:23.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.535+0000 7f5525f61700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f55200b1ae0 0x7f552006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.535+0000 7f5525760700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006a4c0 0x7f55200d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.535+0000 7f5525f61700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f55200b1ae0 0x7f552006d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:43482/0 (socket says 172.21.15.50:43482) 2023-11-28T11:55:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.535+0000 7f5526762700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f55200cf0e0 0x7f55200b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:41156/0 (socket says 172.21.15.50:41156) 2023-11-28T11:55:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.535+0000 7f5525760700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006a4c0 0x7f55200d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:36712/0 (socket says 172.21.15.50:36712) 2023-11-28T11:55:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.535+0000 7f5525f61700 1 -- 172.21.15.50:0/3790734172 learned_addr learned my addr 172.21.15.50:0/3790734172 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.539+0000 7f5525f61700 1 -- 172.21.15.50:0/3790734172 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006a4c0 msgr2=0x7f55200d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.539+0000 7f5525f61700 1 --2- 172.21.15.50:0/3790734172 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006a4c0 0x7f55200d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.539+0000 7f5525f61700 1 -- 172.21.15.50:0/3790734172 >> v1:172.21.15.192:6789/0 conn(0x7f55200cf0e0 legacy=0x7f55200b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.539+0000 7f5525f61700 1 -- 172.21.15.50:0/3790734172 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55200b4380 con 0x7f55200b1ae0 2023-11-28T11:55:23.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.539+0000 7f5525760700 1 --2- 172.21.15.50:0/3790734172 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006a4c0 0x7f55200d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.539+0000 7f5525f61700 1 --2- 172.21.15.50:0/3790734172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55200b1ae0 0x7f552006d8e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5514009910 tx=0x7f5514009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91de93d38ffe56ce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.539+0000 7f5524f5f700 1 -- 172.21.15.50:0/3790734172 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514011830 con 0x7f55200b1ae0 2023-11-28T11:55:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.539+0000 7f5524f5f700 1 -- 172.21.15.50:0/3790734172 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5514011990 con 0x7f55200b1ae0 2023-11-28T11:55:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.539+0000 7f5524f5f700 1 -- 172.21.15.50:0/3790734172 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514011d40 con 0x7f55200b1ae0 2023-11-28T11:55:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.539+0000 7f5526f63700 1 -- 172.21.15.50:0/3790734172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55200b1ae0 msgr2=0x7f552006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.539+0000 7f5526f63700 1 --2- 172.21.15.50:0/3790734172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55200b1ae0 0x7f552006d8e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5514009910 tx=0x7f5514009c20 comp rx=0 tx=0).stop 2023-11-28T11:55:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.539+0000 7f5526f63700 1 -- 172.21.15.50:0/3790734172 shutdown_connections 2023-11-28T11:55:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.539+0000 7f5526f63700 1 --2- 172.21.15.50:0/3790734172 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006a4c0 0x7f55200d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.539+0000 7f5526f63700 1 --2- 172.21.15.50:0/3790734172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55200b1ae0 0x7f552006d8e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.539+0000 7f5526f63700 1 -- 172.21.15.50:0/3790734172 >> 172.21.15.50:0/3790734172 conn(0x7f552009bbd0 msgr2=0x7f55200b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.539+0000 7f5526f63700 1 -- 172.21.15.50:0/3790734172 shutdown_connections 2023-11-28T11:55:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.539+0000 7f5526f63700 1 -- 172.21.15.50:0/3790734172 wait complete. 2023-11-28T11:55:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5526f63700 1 Processor -- start 2023-11-28T11:55:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5526f63700 1 -- start start 2023-11-28T11:55:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5526f63700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552006a4c0 0x7f552009ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5526f63700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55200b1ae0 0x7f552015eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5526f63700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55200cf0e0 0x7f552015f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5526f63700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55200c8b40 con 0x7f552006a4c0 2023-11-28T11:55:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5526f63700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55200a04f0 con 0x7f55200b1ae0 2023-11-28T11:55:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5526f63700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55201f1b00 con 0x7f55200cf0e0 2023-11-28T11:55:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5525f61700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552006a4c0 0x7f552009ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5525f61700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552006a4c0 0x7f552009ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36362/0 (socket says 172.21.15.50:36362) 2023-11-28T11:55:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5525f61700 1 -- 172.21.15.50:0/2840087156 learned_addr learned my addr 172.21.15.50:0/2840087156 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5525760700 1 --2- 172.21.15.50:0/2840087156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55200b1ae0 0x7f552015eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5526762700 1 --2- 172.21.15.50:0/2840087156 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55200cf0e0 0x7f552015f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5525f61700 1 -- 172.21.15.50:0/2840087156 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55200cf0e0 msgr2=0x7f552015f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5525f61700 1 --2- 172.21.15.50:0/2840087156 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55200cf0e0 0x7f552015f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5525f61700 1 -- 172.21.15.50:0/2840087156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55200b1ae0 msgr2=0x7f552015eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5525f61700 1 --2- 172.21.15.50:0/2840087156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55200b1ae0 0x7f552015eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5525f61700 1 -- 172.21.15.50:0/2840087156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c0094b0 con 0x7f552006a4c0 2023-11-28T11:55:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5526762700 1 --2- 172.21.15.50:0/2840087156 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55200cf0e0 0x7f552015f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5525f61700 1 --2- 172.21.15.50:0/2840087156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552006a4c0 0x7f552009ffb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5514009f70 tx=0x7f5514004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f55127fc700 1 -- 172.21.15.50:0/2840087156 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514004380 con 0x7f552006a4c0 2023-11-28T11:55:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f55127fc700 1 -- 172.21.15.50:0/2840087156 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551401f070 con 0x7f552006a4c0 2023-11-28T11:55:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5526f63700 1 -- 172.21.15.50:0/2840087156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5514009570 con 0x7f552006a4c0 2023-11-28T11:55:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f55127fc700 1 -- 172.21.15.50:0/2840087156 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55140036c0 con 0x7f552006a4c0 2023-11-28T11:55:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.543+0000 7f5526f63700 1 -- 172.21.15.50:0/2840087156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55200b60e0 con 0x7f552006a4c0 2023-11-28T11:55:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.547+0000 7f5526f63700 1 -- 172.21.15.50:0/2840087156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55200b1eb0 con 0x7f552006a4c0 2023-11-28T11:55:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.547+0000 7f55127fc700 1 -- 172.21.15.50:0/2840087156 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f551402a020 con 0x7f552006a4c0 2023-11-28T11:55:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.547+0000 7f55127fc700 1 --2- 172.21.15.50:0/2840087156 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5504064ee0 0x7f5504067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.547+0000 7f55127fc700 1 -- 172.21.15.50:0/2840087156 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5514083490 con 0x7f552006a4c0 2023-11-28T11:55:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.547+0000 7f5525760700 1 --2- 172.21.15.50:0/2840087156 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5504064ee0 0x7f5504067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.547+0000 7f5525760700 1 --2- 172.21.15.50:0/2840087156 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5504064ee0 0x7f5504067390 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f552015b0e0 tx=0x7f551c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:23.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.551+0000 7f55127fc700 1 -- 172.21.15.50:0/2840087156 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f55140514f0 con 0x7f552006a4c0 2023-11-28T11:55:23.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.715+0000 7f5526f63700 1 -- 172.21.15.50:0/2840087156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55200d08e0 con 0x7f552006a4c0 2023-11-28T11:55:23.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.715+0000 7f55127fc700 1 -- 172.21.15.50:0/2840087156 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5514054b10 con 0x7f552006a4c0 2023-11-28T11:55:23.716 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:55:23.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.715+0000 7f5526f63700 1 -- 172.21.15.50:0/2840087156 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5504064ee0 msgr2=0x7f5504067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:23.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.715+0000 7f5526f63700 1 --2- 172.21.15.50:0/2840087156 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5504064ee0 0x7f5504067390 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f552015b0e0 tx=0x7f551c009240 comp rx=0 tx=0).stop 2023-11-28T11:55:23.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.715+0000 7f5526f63700 1 -- 172.21.15.50:0/2840087156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552006a4c0 msgr2=0x7f552009ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:23.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.715+0000 7f5526f63700 1 --2- 172.21.15.50:0/2840087156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552006a4c0 0x7f552009ffb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5514009f70 tx=0x7f5514004770 comp rx=0 tx=0).stop 2023-11-28T11:55:23.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.715+0000 7f5526f63700 1 -- 172.21.15.50:0/2840087156 shutdown_connections 2023-11-28T11:55:23.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.715+0000 7f5526f63700 1 --2- 172.21.15.50:0/2840087156 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55200cf0e0 0x7f552015f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.715+0000 7f5526f63700 1 --2- 172.21.15.50:0/2840087156 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5504064ee0 0x7f5504067390 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.715+0000 7f5526f63700 1 --2- 172.21.15.50:0/2840087156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55200b1ae0 0x7f552015eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.715+0000 7f5526f63700 1 --2- 172.21.15.50:0/2840087156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552006a4c0 0x7f552009ffb0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.715+0000 7f5526f63700 1 -- 172.21.15.50:0/2840087156 >> 172.21.15.50:0/2840087156 conn(0x7f552009bbd0 msgr2=0x7f55200b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:23.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.715+0000 7f5526f63700 1 -- 172.21.15.50:0/2840087156 shutdown_connections 2023-11-28T11:55:23.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.719+0000 7f5526f63700 1 -- 172.21.15.50:0/2840087156 wait complete. 2023-11-28T11:55:23.732 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:55:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.847+0000 7fefd6c29700 1 Processor -- start 2023-11-28T11:55:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.847+0000 7fefd6c29700 1 -- start start 2023-11-28T11:55:23.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.847+0000 7fefd6c29700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fefd0158ee0 0x7fefd00ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.847+0000 7fefd6c29700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fefd00cd5d0 0x7fefd00cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.847+0000 7fefd6c29700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefd00ce060 0x7fefd015c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.847+0000 7fefd6c29700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd006e000 con 0x7fefd0158ee0 2023-11-28T11:55:23.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.847+0000 7fefd6c29700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd006d1c0 con 0x7fefd00cd5d0 2023-11-28T11:55:23.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.847+0000 7fefd6c29700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd00ce480 con 0x7fefd00ce060 2023-11-28T11:55:23.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd5c27700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fefd0158ee0 0x7fefd00ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd5c27700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fefd0158ee0 0x7fefd00ae760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36374/0 (socket says 172.21.15.50:36374) 2023-11-28T11:55:23.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd5c27700 1 -- 172.21.15.50:0/2357870588 learned_addr learned my addr 172.21.15.50:0/2357870588 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:23.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd5426700 1 --2- 172.21.15.50:0/2357870588 >> v2:172.21.15.192:3300/0 conn(0x7fefd00cd5d0 0x7fefd00cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd6428700 1 --2- 172.21.15.50:0/2357870588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefd00ce060 0x7fefd015c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd5c27700 1 -- 172.21.15.50:0/2357870588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefd00ce060 msgr2=0x7fefd015c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd5c27700 1 --2- 172.21.15.50:0/2357870588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefd00ce060 0x7fefd015c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd5c27700 1 -- 172.21.15.50:0/2357870588 >> v2:172.21.15.192:3300/0 conn(0x7fefd00cd5d0 msgr2=0x7fefd00cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd5c27700 1 --2- 172.21.15.50:0/2357870588 >> v2:172.21.15.192:3300/0 conn(0x7fefd00cd5d0 0x7fefd00cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd5c27700 1 -- 172.21.15.50:0/2357870588 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd00ca3a0 con 0x7fefd0158ee0 2023-11-28T11:55:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd5426700 1 --2- 172.21.15.50:0/2357870588 >> v2:172.21.15.192:3300/0 conn(0x7fefd00cd5d0 0x7fefd00cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd5c27700 1 --2- 172.21.15.50:0/2357870588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd0158ee0 0x7fefd00ae760 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fefd015d8f0 tx=0x7fefcc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00a1c0c8f4942e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd4c25700 1 -- 172.21.15.50:0/2357870588 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc011830 con 0x7fefd0158ee0 2023-11-28T11:55:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd4c25700 1 -- 172.21.15.50:0/2357870588 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc011990 con 0x7fefd0158ee0 2023-11-28T11:55:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd4c25700 1 -- 172.21.15.50:0/2357870588 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc011d20 con 0x7fefd0158ee0 2023-11-28T11:55:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd6c29700 1 -- 172.21.15.50:0/2357870588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd0158ee0 msgr2=0x7fefd00ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd6c29700 1 --2- 172.21.15.50:0/2357870588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd0158ee0 0x7fefd00ae760 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fefd015d8f0 tx=0x7fefcc009bf0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd6c29700 1 -- 172.21.15.50:0/2357870588 shutdown_connections 2023-11-28T11:55:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd6c29700 1 --2- 172.21.15.50:0/2357870588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefd00ce060 0x7fefd015c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd6c29700 1 --2- 172.21.15.50:0/2357870588 >> v2:172.21.15.192:3300/0 conn(0x7fefd00cd5d0 0x7fefd00cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd6c29700 1 --2- 172.21.15.50:0/2357870588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd0158ee0 0x7fefd00ae760 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd6c29700 1 -- 172.21.15.50:0/2357870588 >> 172.21.15.50:0/2357870588 conn(0x7fefd00d0240 msgr2=0x7fefd00cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd6c29700 1 -- 172.21.15.50:0/2357870588 shutdown_connections 2023-11-28T11:55:23.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.851+0000 7fefd6c29700 1 -- 172.21.15.50:0/2357870588 wait complete. 2023-11-28T11:55:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd6c29700 1 Processor -- start 2023-11-28T11:55:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd6c29700 1 -- start start 2023-11-28T11:55:23.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd6c29700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefd00cd5d0 0x7fefd015a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd6c29700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefd00ce060 0x7fefd0157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd6c29700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd0158ee0 0x7fefd01579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd6c29700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd015bc20 con 0x7fefd0158ee0 2023-11-28T11:55:23.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd6c29700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd00c3220 con 0x7fefd00cd5d0 2023-11-28T11:55:23.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd6c29700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd015b010 con 0x7fefd00ce060 2023-11-28T11:55:23.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd6428700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd0158ee0 0x7fefd01579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd6428700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd0158ee0 0x7fefd01579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36380/0 (socket says 172.21.15.50:36380) 2023-11-28T11:55:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd6428700 1 -- 172.21.15.50:0/1320265179 learned_addr learned my addr 172.21.15.50:0/1320265179 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd5426700 1 --2- 172.21.15.50:0/1320265179 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefd00ce060 0x7fefd0157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd5c27700 1 --2- 172.21.15.50:0/1320265179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefd00cd5d0 0x7fefd015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd6428700 1 -- 172.21.15.50:0/1320265179 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefd00ce060 msgr2=0x7fefd0157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd6428700 1 --2- 172.21.15.50:0/1320265179 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefd00ce060 0x7fefd0157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd6428700 1 -- 172.21.15.50:0/1320265179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefd00cd5d0 msgr2=0x7fefd015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd6428700 1 --2- 172.21.15.50:0/1320265179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefd00cd5d0 0x7fefd015a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.855+0000 7fefd6428700 1 -- 172.21.15.50:0/1320265179 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc0009450 con 0x7fefd0158ee0 2023-11-28T11:55:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.859+0000 7fefd6428700 1 --2- 172.21.15.50:0/1320265179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd0158ee0 0x7fefd01579a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fefc800efc0 tx=0x7fefc800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.859+0000 7fefc67fc700 1 -- 172.21.15.50:0/1320265179 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc800cad0 con 0x7fefd0158ee0 2023-11-28T11:55:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.859+0000 7fefc67fc700 1 -- 172.21.15.50:0/1320265179 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc800f040 con 0x7fefd0158ee0 2023-11-28T11:55:23.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.859+0000 7fefd6c29700 1 -- 172.21.15.50:0/1320265179 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefcc009570 con 0x7fefd0158ee0 2023-11-28T11:55:23.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.859+0000 7fefc67fc700 1 -- 172.21.15.50:0/1320265179 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc800ce70 con 0x7fefd0158ee0 2023-11-28T11:55:23.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.859+0000 7fefd6c29700 1 -- 172.21.15.50:0/1320265179 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd006cc00 con 0x7fefd0158ee0 2023-11-28T11:55:23.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.859+0000 7fefd6c29700 1 -- 172.21.15.50:0/1320265179 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd006c920 con 0x7fefd0158ee0 2023-11-28T11:55:23.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.859+0000 7fefc67fc700 1 -- 172.21.15.50:0/1320265179 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fefc8014480 con 0x7fefd0158ee0 2023-11-28T11:55:23.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.859+0000 7fefc67fc700 1 --2- 172.21.15.50:0/1320265179 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fefb4064ee0 0x7fefb4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:23.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.859+0000 7fefc67fc700 1 -- 172.21.15.50:0/1320265179 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fefc8082c20 con 0x7fefd0158ee0 2023-11-28T11:55:23.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.859+0000 7fefd5c27700 1 --2- 172.21.15.50:0/1320265179 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fefb4064ee0 0x7fefb4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:23.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.863+0000 7fefd5c27700 1 --2- 172.21.15.50:0/1320265179 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fefb4064ee0 0x7fefb4067390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fefcc000c00 tx=0x7fefcc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:23.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:23.867+0000 7fefc67fc700 1 -- 172.21.15.50:0/1320265179 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fefc8050b30 con 0x7fefd0158ee0 2023-11-28T11:55:24.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.031+0000 7fefd6c29700 1 -- 172.21.15.50:0/1320265179 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fefd006cee0 con 0x7fefd0158ee0 2023-11-28T11:55:24.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.031+0000 7fefc67fc700 1 -- 172.21.15.50:0/1320265179 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7fefc8018020 con 0x7fefd0158ee0 2023-11-28T11:55:24.035 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:55:24.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.035+0000 7fefd6c29700 1 -- 172.21.15.50:0/1320265179 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fefb4064ee0 msgr2=0x7fefb4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:24.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.035+0000 7fefd6c29700 1 --2- 172.21.15.50:0/1320265179 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fefb4064ee0 0x7fefb4067390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fefcc000c00 tx=0x7fefcc008030 comp rx=0 tx=0).stop 2023-11-28T11:55:24.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.035+0000 7fefd6c29700 1 -- 172.21.15.50:0/1320265179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd0158ee0 msgr2=0x7fefd01579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.035+0000 7fefd6c29700 1 --2- 172.21.15.50:0/1320265179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd0158ee0 0x7fefd01579a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fefc800efc0 tx=0x7fefc800c0c0 comp rx=0 tx=0).stop 2023-11-28T11:55:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.035+0000 7fefd6c29700 1 -- 172.21.15.50:0/1320265179 shutdown_connections 2023-11-28T11:55:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.035+0000 7fefd6c29700 1 --2- 172.21.15.50:0/1320265179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefd0158ee0 0x7fefd01579a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.035+0000 7fefd6c29700 1 --2- 172.21.15.50:0/1320265179 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefd00ce060 0x7fefd0157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.035+0000 7fefd6c29700 1 --2- 172.21.15.50:0/1320265179 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fefb4064ee0 0x7fefb4067390 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.035+0000 7fefd6c29700 1 --2- 172.21.15.50:0/1320265179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefd00cd5d0 0x7fefd015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.035+0000 7fefd6c29700 1 -- 172.21.15.50:0/1320265179 >> 172.21.15.50:0/1320265179 conn(0x7fefd00d0240 msgr2=0x7fefd00b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:24.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.035+0000 7fefd6c29700 1 -- 172.21.15.50:0/1320265179 shutdown_connections 2023-11-28T11:55:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.035+0000 7fefd6c29700 1 -- 172.21.15.50:0/1320265179 wait complete. 2023-11-28T11:55:24.050 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:55:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.163+0000 7fef84194700 1 Processor -- start 2023-11-28T11:55:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef84194700 1 -- start start 2023-11-28T11:55:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef84194700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef7c15bed0 0x7fef7c06b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef84194700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef7c0707d0 0x7fef7c0cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef84194700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7c06b590 con 0x7fef7c070c20 2023-11-28T11:55:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef84194700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7c069fb0 con 0x7fef7c0707d0 2023-11-28T11:55:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef84194700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c06a290 con 0x7fef7c15bed0 2023-11-28T11:55:24.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef81f30700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef7c15bed0 0x7fef7c06b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:24.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef8172f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef7c0707d0 0x7fef7c0cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:24.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef81f30700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef7c15bed0 0x7fef7c06b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:36750/0 (socket says 172.21.15.50:36750) 2023-11-28T11:55:24.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef81f30700 1 -- 172.21.15.50:0/2787955354 learned_addr learned my addr 172.21.15.50:0/2787955354 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:24.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef8172f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef7c0707d0 0x7fef7c0cc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:43498/0 (socket says 172.21.15.50:43498) 2023-11-28T11:55:24.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef82731700 1 --1- 172.21.15.50:0/2787955354 >> v1:172.21.15.192:6789/0 conn(0x7fef7c070c20 0x7fef7c0c5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:41168/0 (socket says 172.21.15.50:41168) 2023-11-28T11:55:24.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef81f30700 1 -- 172.21.15.50:0/2787955354 >> v2:172.21.15.192:3300/0 conn(0x7fef7c0707d0 msgr2=0x7fef7c0cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:24.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef81f30700 1 --2- 172.21.15.50:0/2787955354 >> v2:172.21.15.192:3300/0 conn(0x7fef7c0707d0 0x7fef7c0cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:24.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef81f30700 1 -- 172.21.15.50:0/2787955354 >> v1:172.21.15.192:6789/0 conn(0x7fef7c070c20 legacy=0x7fef7c0c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:24.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef80f2e700 1 -- 172.21.15.50:0/2787955354 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049218027 0 0) 0x7fef7c06b590 con 0x7fef7c070c20 2023-11-28T11:55:24.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef81f30700 1 -- 172.21.15.50:0/2787955354 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c06a570 con 0x7fef7c15bed0 2023-11-28T11:55:24.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef81f30700 1 --2- 172.21.15.50:0/2787955354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef7c15bed0 0x7fef7c06b050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009910 tx=0x7fef6c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3197e53b106f9b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:24.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef80f2e700 1 -- 172.21.15.50:0/2787955354 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c011830 con 0x7fef7c15bed0 2023-11-28T11:55:24.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef80f2e700 1 -- 172.21.15.50:0/2787955354 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c011990 con 0x7fef7c15bed0 2023-11-28T11:55:24.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.167+0000 7fef80f2e700 1 -- 172.21.15.50:0/2787955354 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c011d40 con 0x7fef7c15bed0 2023-11-28T11:55:24.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.171+0000 7fef84194700 1 -- 172.21.15.50:0/2787955354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef7c15bed0 msgr2=0x7fef7c06b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:24.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.171+0000 7fef84194700 1 --2- 172.21.15.50:0/2787955354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef7c15bed0 0x7fef7c06b050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009910 tx=0x7fef6c009c20 comp rx=0 tx=0).stop 2023-11-28T11:55:24.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.171+0000 7fef84194700 1 -- 172.21.15.50:0/2787955354 shutdown_connections 2023-11-28T11:55:24.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.171+0000 7fef84194700 1 --2- 172.21.15.50:0/2787955354 >> v2:172.21.15.192:3300/0 conn(0x7fef7c0707d0 0x7fef7c0cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:24.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.171+0000 7fef84194700 1 --2- 172.21.15.50:0/2787955354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef7c15bed0 0x7fef7c06b050 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:24.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.171+0000 7fef84194700 1 -- 172.21.15.50:0/2787955354 >> 172.21.15.50:0/2787955354 conn(0x7fef7c06caf0 msgr2=0x7fef7c0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:24.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.171+0000 7fef84194700 1 -- 172.21.15.50:0/2787955354 shutdown_connections 2023-11-28T11:55:24.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.171+0000 7fef84194700 1 -- 172.21.15.50:0/2787955354 wait complete. 2023-11-28T11:55:24.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.171+0000 7fef84194700 1 Processor -- start 2023-11-28T11:55:24.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.171+0000 7fef84194700 1 -- start start 2023-11-28T11:55:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef84194700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7c0707d0 0x7fef7c1454d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef84194700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef7c070c20 0x7fef7c162800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef84194700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef7c15bed0 0x7fef7c162d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef84194700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c146b40 con 0x7fef7c15bed0 2023-11-28T11:55:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef84194700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c145fc0 con 0x7fef7c0707d0 2023-11-28T11:55:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef84194700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c1462a0 con 0x7fef7c070c20 2023-11-28T11:55:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef82731700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef7c15bed0 0x7fef7c162d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef81f30700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7c0707d0 0x7fef7c1454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef82731700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef7c15bed0 0x7fef7c162d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36386/0 (socket says 172.21.15.50:36386) 2023-11-28T11:55:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef82731700 1 -- 172.21.15.50:0/3081322858 learned_addr learned my addr 172.21.15.50:0/3081322858 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef8172f700 1 --2- 172.21.15.50:0/3081322858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef7c070c20 0x7fef7c162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef82731700 1 -- 172.21.15.50:0/3081322858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef7c070c20 msgr2=0x7fef7c162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef82731700 1 --2- 172.21.15.50:0/3081322858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef7c070c20 0x7fef7c162800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef82731700 1 -- 172.21.15.50:0/3081322858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7c0707d0 msgr2=0x7fef7c1454d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef82731700 1 --2- 172.21.15.50:0/3081322858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7c0707d0 0x7fef7c1454d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef82731700 1 -- 172.21.15.50:0/3081322858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c009570 con 0x7fef7c15bed0 2023-11-28T11:55:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef82731700 1 --2- 172.21.15.50:0/3081322858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef7c15bed0 0x7fef7c162d40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fef74002230 tx=0x7fef7400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef727fc700 1 -- 172.21.15.50:0/3081322858 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7400aac0 con 0x7fef7c15bed0 2023-11-28T11:55:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef84194700 1 -- 172.21.15.50:0/3081322858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7c06ab30 con 0x7fef7c15bed0 2023-11-28T11:55:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef727fc700 1 -- 172.21.15.50:0/3081322858 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7400ac40 con 0x7fef7c15bed0 2023-11-28T11:55:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef727fc700 1 -- 172.21.15.50:0/3081322858 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef740070d0 con 0x7fef7c15bed0 2023-11-28T11:55:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.175+0000 7fef84194700 1 -- 172.21.15.50:0/3081322858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c06a850 con 0x7fef7c15bed0 2023-11-28T11:55:24.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.179+0000 7fef84194700 1 -- 172.21.15.50:0/3081322858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7c069c40 con 0x7fef7c15bed0 2023-11-28T11:55:24.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.179+0000 7fef727fc700 1 -- 172.21.15.50:0/3081322858 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fef74010070 con 0x7fef7c15bed0 2023-11-28T11:55:24.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.179+0000 7fef727fc700 1 --2- 172.21.15.50:0/3081322858 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef60064ee0 0x7fef60067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.179+0000 7fef727fc700 1 -- 172.21.15.50:0/3081322858 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fef740819a0 con 0x7fef7c15bed0 2023-11-28T11:55:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.179+0000 7fef81f30700 1 --2- 172.21.15.50:0/3081322858 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef60064ee0 0x7fef60067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.179+0000 7fef81f30700 1 --2- 172.21.15.50:0/3081322858 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef60064ee0 0x7fef60067390 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fef6c000c00 tx=0x7fef6c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:24.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.187+0000 7fef727fc700 1 -- 172.21.15.50:0/3081322858 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fef7404f920 con 0x7fef7c15bed0 2023-11-28T11:55:24.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.355+0000 7fef84194700 1 -- 172.21.15.50:0/3081322858 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fef7c072500 con 0x7fef7c15bed0 2023-11-28T11:55:24.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.359+0000 7fef727fc700 1 -- 172.21.15.50:0/3081322858 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7fef74018080 con 0x7fef7c15bed0 2023-11-28T11:55:24.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.359+0000 7fef84194700 1 -- 172.21.15.50:0/3081322858 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef60064ee0 msgr2=0x7fef60067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:24.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.359+0000 7fef84194700 1 --2- 172.21.15.50:0/3081322858 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef60064ee0 0x7fef60067390 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fef6c000c00 tx=0x7fef6c008030 comp rx=0 tx=0).stop 2023-11-28T11:55:24.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.359+0000 7fef84194700 1 -- 172.21.15.50:0/3081322858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef7c15bed0 msgr2=0x7fef7c162d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:24.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.359+0000 7fef84194700 1 --2- 172.21.15.50:0/3081322858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef7c15bed0 0x7fef7c162d40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fef74002230 tx=0x7fef7400cf50 comp rx=0 tx=0).stop 2023-11-28T11:55:24.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.359+0000 7fef84194700 1 -- 172.21.15.50:0/3081322858 shutdown_connections 2023-11-28T11:55:24.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.359+0000 7fef84194700 1 --2- 172.21.15.50:0/3081322858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef7c15bed0 0x7fef7c162d40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:24.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.359+0000 7fef84194700 1 --2- 172.21.15.50:0/3081322858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef7c070c20 0x7fef7c162800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:24.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.359+0000 7fef84194700 1 --2- 172.21.15.50:0/3081322858 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef60064ee0 0x7fef60067390 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:24.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.359+0000 7fef84194700 1 --2- 172.21.15.50:0/3081322858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7c0707d0 0x7fef7c1454d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:24.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.359+0000 7fef84194700 1 -- 172.21.15.50:0/3081322858 >> 172.21.15.50:0/3081322858 conn(0x7fef7c06caf0 msgr2=0x7fef7c0c4440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:24.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.359+0000 7fef84194700 1 -- 172.21.15.50:0/3081322858 shutdown_connections 2023-11-28T11:55:24.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:24.359+0000 7fef84194700 1 -- 172.21.15.50:0/3081322858 wait complete. 2023-11-28T11:55:24.364 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-11-28T11:55:24.378 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-11-28T11:55:24.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:24.378 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T11:55:24.388 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[47859]: fuse finished with error 0 and tester_r 0 2023-11-28T11:55:24.390 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:55:30.491 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T11:55:30.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:30.492 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T11:55:30.500 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:55:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03fb59e700 1 Processor -- start 2023-11-28T11:55:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03fb59e700 1 -- start start 2023-11-28T11:55:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03fb59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f03fc0cadf0 0x7f03fc0cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03fb59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03fc158440 con 0x7f03fc06c8d0 2023-11-28T11:55:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03fb59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03fc0cb790 con 0x7f03fc158070 2023-11-28T11:55:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03fb59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03fc06b500 con 0x7f03fc0cadf0 2023-11-28T11:55:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03f9d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f03fc06c8d0 0x7f03fc06adf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39812/0 (socket says 172.21.15.50:39812) 2023-11-28T11:55:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03f9d9b700 1 -- 172.21.15.50:0/3513737280 learned_addr learned my addr 172.21.15.50:0/3513737280 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:30.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03fad9d700 1 --2- 172.21.15.50:0/3513737280 >> v2:172.21.15.192:3300/0 conn(0x7f03fc0cadf0 0x7f03fc0cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03f959a700 1 -- 172.21.15.50:0/3513737280 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770006550 0 0) 0x7f03fc158440 con 0x7f03fc06c8d0 2023-11-28T11:55:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03f959a700 1 -- 172.21.15.50:0/3513737280 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03e40035d0 con 0x7f03fc06c8d0 2023-11-28T11:55:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03f959a700 1 -- 172.21.15.50:0/3513737280 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1572659501 0 0) 0x7f03e40035d0 con 0x7f03fc06c8d0 2023-11-28T11:55:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03f959a700 1 -- 172.21.15.50:0/3513737280 >> v2:172.21.15.192:3300/0 conn(0x7f03fc0cadf0 msgr2=0x7f03fc0cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03f959a700 1 --2- 172.21.15.50:0/3513737280 >> v2:172.21.15.192:3300/0 conn(0x7f03fc0cadf0 0x7f03fc0cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03f959a700 1 -- 172.21.15.50:0/3513737280 >> v1:172.21.15.192:6789/0 conn(0x7f03fc158070 legacy=0x7f03fc0ad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03f959a700 1 -- 172.21.15.50:0/3513737280 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc06a960 con 0x7f03fc06c8d0 2023-11-28T11:55:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03f959a700 1 -- 172.21.15.50:0/3513737280 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f03ec001690 con 0x7f03fc06c8d0 2023-11-28T11:55:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.662+0000 7f03f959a700 1 -- 172.21.15.50:0/3513737280 >> v1:172.21.15.50:6789/0 conn(0x7f03fc06c8d0 legacy=0x7f03fc06adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03f959a700 1 --2- 172.21.15.50:0/3513737280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03e4003a20 0x7f03e4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03f959a700 1 --2- 172.21.15.50:0/3513737280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03e4004870 0x7f03e4004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:30.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03f959a700 1 --2- 172.21.15.50:0/3513737280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03e4005220 0x7f03e400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03f959a700 1 -- 172.21.15.50:0/3513737280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc06b500 con 0x7f03e4004870 2023-11-28T11:55:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03f959a700 1 -- 172.21.15.50:0/3513737280 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e400c0a0 con 0x7f03e4003a20 2023-11-28T11:55:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03f959a700 1 -- 172.21.15.50:0/3513737280 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e400c260 con 0x7f03e4005220 2023-11-28T11:55:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03f9d9b700 1 --2- 172.21.15.50:0/3513737280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03e4004870 0x7f03e4004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03fa59c700 1 --2- 172.21.15.50:0/3513737280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03e4003a20 0x7f03e4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03fad9d700 1 --2- 172.21.15.50:0/3513737280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03e4005220 0x7f03e400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03f9d9b700 1 -- 172.21.15.50:0/3513737280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03e4005220 msgr2=0x7f03e400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03f9d9b700 1 --2- 172.21.15.50:0/3513737280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03e4005220 0x7f03e400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03f9d9b700 1 -- 172.21.15.50:0/3513737280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03e4003a20 msgr2=0x7f03e4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03f9d9b700 1 --2- 172.21.15.50:0/3513737280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03e4003a20 0x7f03e4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03fad9d700 1 -- 172.21.15.50:0/3513737280 reap_dead start 2023-11-28T11:55:30.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03f9d9b700 1 -- 172.21.15.50:0/3513737280 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e40035d0 con 0x7f03e4004870 2023-11-28T11:55:30.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03fa59c700 1 --2- 172.21.15.50:0/3513737280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03e4003a20 0x7f03e4003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:30.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03f9d9b700 1 --2- 172.21.15.50:0/3513737280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03e4004870 0x7f03e4004ce0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f03fc06c880 tx=0x7f03e40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b43897270f44e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:30.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03f959a700 1 -- 172.21.15.50:0/3513737280 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec00cd80 con 0x7f03e4004870 2023-11-28T11:55:30.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03f959a700 1 -- 172.21.15.50:0/3513737280 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec005980 con 0x7f03e4004870 2023-11-28T11:55:30.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03f959a700 1 -- 172.21.15.50:0/3513737280 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec005d30 con 0x7f03e4004870 2023-11-28T11:55:30.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03fb59e700 1 -- 172.21.15.50:0/3513737280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03e4004870 msgr2=0x7f03e4004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:30.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03fb59e700 1 --2- 172.21.15.50:0/3513737280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03e4004870 0x7f03e4004ce0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f03fc06c880 tx=0x7f03e40058a0 comp rx=0 tx=0).stop 2023-11-28T11:55:30.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03fb59e700 1 -- 172.21.15.50:0/3513737280 shutdown_connections 2023-11-28T11:55:30.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03fb59e700 1 --2- 172.21.15.50:0/3513737280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03e4004870 0x7f03e4004ce0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:30.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03fb59e700 1 -- 172.21.15.50:0/3513737280 >> 172.21.15.50:0/3513737280 conn(0x7f03fc0ce3e0 msgr2=0x7f03fc0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:30.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03fb59e700 1 -- 172.21.15.50:0/3513737280 shutdown_connections 2023-11-28T11:55:30.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.666+0000 7f03fb59e700 1 -- 172.21.15.50:0/3513737280 wait complete. 2023-11-28T11:55:30.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.670+0000 7f03fb59e700 1 Processor -- start 2023-11-28T11:55:30.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.670+0000 7f03fb59e700 1 -- start start 2023-11-28T11:55:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.670+0000 7f03fb59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03e4004870 0x7f03fc15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.670+0000 7f03fb59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc0712c0 0x7f03fc1ed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.670+0000 7f03fb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03fc153740 0x7f03fc0c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.670+0000 7f03fb59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc0cf0f0 con 0x7f03fc153740 2023-11-28T11:55:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.670+0000 7f03fb59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc159e50 con 0x7f03e4004870 2023-11-28T11:55:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.670+0000 7f03fb59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc1ed610 con 0x7f03fc0712c0 2023-11-28T11:55:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.670+0000 7f03fad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03fc153740 0x7f03fc0c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.670+0000 7f03fa59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03e4004870 0x7f03fc15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.670+0000 7f03fad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03fc153740 0x7f03fc0c67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36400/0 (socket says 172.21.15.50:36400) 2023-11-28T11:55:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.670+0000 7f03fad9d700 1 -- 172.21.15.50:0/2783748093 learned_addr learned my addr 172.21.15.50:0/2783748093 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:30.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.670+0000 7f03f9d9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc0712c0 0x7f03fc1ed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:30.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.674+0000 7f03fad9d700 1 -- 172.21.15.50:0/2783748093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc0712c0 msgr2=0x7f03fc1ed0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:30.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.674+0000 7f03fad9d700 1 --2- 172.21.15.50:0/2783748093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc0712c0 0x7f03fc1ed0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:30.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.674+0000 7f03fad9d700 1 -- 172.21.15.50:0/2783748093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03e4004870 msgr2=0x7f03fc15ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:30.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.674+0000 7f03fad9d700 1 --2- 172.21.15.50:0/2783748093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03e4004870 0x7f03fc15ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:30.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.674+0000 7f03fad9d700 1 -- 172.21.15.50:0/2783748093 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc06d190 con 0x7f03fc153740 2023-11-28T11:55:30.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.674+0000 7f03fad9d700 1 --2- 172.21.15.50:0/2783748093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03fc153740 0x7f03fc0c67f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f03fc15cb20 tx=0x7f03f4011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:30.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.674+0000 7f03eaffd700 1 -- 172.21.15.50:0/2783748093 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f400e040 con 0x7f03fc153740 2023-11-28T11:55:30.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.674+0000 7f03eaffd700 1 -- 172.21.15.50:0/2783748093 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f400f040 con 0x7f03fc153740 2023-11-28T11:55:30.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.674+0000 7f03fb59e700 1 -- 172.21.15.50:0/2783748093 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03fc06ceb0 con 0x7f03fc153740 2023-11-28T11:55:30.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.674+0000 7f03eaffd700 1 -- 172.21.15.50:0/2783748093 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f400fc10 con 0x7f03fc153740 2023-11-28T11:55:30.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.674+0000 7f03fb59e700 1 -- 172.21.15.50:0/2783748093 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03fc06d470 con 0x7f03fc153740 2023-11-28T11:55:30.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.674+0000 7f03fb59e700 1 -- 172.21.15.50:0/2783748093 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03fc072500 con 0x7f03fc153740 2023-11-28T11:55:30.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.674+0000 7f03eaffd700 1 -- 172.21.15.50:0/2783748093 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f03f400fd70 con 0x7f03fc153740 2023-11-28T11:55:30.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.674+0000 7f03eaffd700 1 --2- 172.21.15.50:0/2783748093 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f03dc064f10 0x7f03dc0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:30.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.674+0000 7f03eaffd700 1 -- 172.21.15.50:0/2783748093 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f03f40825e0 con 0x7f03fc153740 2023-11-28T11:55:30.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.678+0000 7f03fa59c700 1 --2- 172.21.15.50:0/2783748093 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f03dc064f10 0x7f03dc0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:30.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.678+0000 7f03fa59c700 1 --2- 172.21.15.50:0/2783748093 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f03dc064f10 0x7f03dc0673c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f03f0001480 tx=0x7f03f0007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:30.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.682+0000 7f03eaffd700 1 -- 172.21.15.50:0/2783748093 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f03f4050600 con 0x7f03fc153740 2023-11-28T11:55:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.878+0000 7f03fb59e700 1 -- 172.21.15.50:0/2783748093 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03fc069ec0 con 0x7f03fc153740 2023-11-28T11:55:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.882+0000 7f03eaffd700 1 -- 172.21.15.50:0/2783748093 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f03f4053c20 con 0x7f03fc153740 2023-11-28T11:55:30.883 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:30.884 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2392153383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2392153383},{"type":"v1","addr":"172.21.15.192:6837","nonce":2392153383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5515,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3694451276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3694451276},{"type":"v1","addr":"172.21.15.192:6835","nonce":3694451276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2782289763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2782289763},{"type":"v1","addr":"172.21.15.50:6833","nonce":2782289763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:55:06.200530+0000","modified":"2023-11-28T11:55:09.218769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5559},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5559":{"gid":5559,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2320802269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2320802269},{"type":"v1","addr":"172.21.15.50:6835","nonce":2320802269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:55:30.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.886+0000 7f03fb59e700 1 -- 172.21.15.50:0/2783748093 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f03dc064f10 msgr2=0x7f03dc0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:30.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.886+0000 7f03fb59e700 1 --2- 172.21.15.50:0/2783748093 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f03dc064f10 0x7f03dc0673c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f03f0001480 tx=0x7f03f0007d30 comp rx=0 tx=0).stop 2023-11-28T11:55:30.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.886+0000 7f03fb59e700 1 -- 172.21.15.50:0/2783748093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03fc153740 msgr2=0x7f03fc0c67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:30.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.886+0000 7f03fb59e700 1 --2- 172.21.15.50:0/2783748093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03fc153740 0x7f03fc0c67f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f03fc15cb20 tx=0x7f03f4011ed0 comp rx=0 tx=0).stop 2023-11-28T11:55:30.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.886+0000 7f03fb59e700 1 -- 172.21.15.50:0/2783748093 shutdown_connections 2023-11-28T11:55:30.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.886+0000 7f03fb59e700 1 --2- 172.21.15.50:0/2783748093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03fc153740 0x7f03fc0c67f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:30.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.886+0000 7f03fb59e700 1 --2- 172.21.15.50:0/2783748093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc0712c0 0x7f03fc1ed0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:30.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.886+0000 7f03fb59e700 1 --2- 172.21.15.50:0/2783748093 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f03dc064f10 0x7f03dc0673c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:30.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.886+0000 7f03fb59e700 1 --2- 172.21.15.50:0/2783748093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03e4004870 0x7f03fc15ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:30.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.886+0000 7f03fb59e700 1 -- 172.21.15.50:0/2783748093 >> 172.21.15.50:0/2783748093 conn(0x7f03fc0ce3e0 msgr2=0x7f03fc0c8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:30.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.886+0000 7f03fb59e700 1 -- 172.21.15.50:0/2783748093 shutdown_connections 2023-11-28T11:55:30.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:30.886+0000 7f03fb59e700 1 -- 172.21.15.50:0/2783748093 wait complete. 2023-11-28T11:55:30.889 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-11-28T11:55:30.903 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-11-28T11:55:31.047 INFO:teuthology.orchestra.run.smithi050.stdout:{"message":"","return_code":0} 2023-11-28T11:55:31.048 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T11:55:31.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:55:31.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.158+0000 7fe688c6f700 1 Processor -- start 2023-11-28T11:55:31.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.158+0000 7fe688c6f700 1 -- start start 2023-11-28T11:55:31.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.158+0000 7fe688c6f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe6840cb460 0x7fe6840c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:31.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.158+0000 7fe688c6f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6840cd8f0 con 0x7fe6840ad490 2023-11-28T11:55:31.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.158+0000 7fe688c6f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe68406dc60 con 0x7fe684158e60 2023-11-28T11:55:31.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.158+0000 7fe688c6f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6840add00 con 0x7fe6840cb460 2023-11-28T11:55:31.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.158+0000 7fe683fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe6840ad490 0x7fe68406c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39828/0 (socket says 172.21.15.50:39828) 2023-11-28T11:55:31.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.158+0000 7fe683fff700 1 -- 172.21.15.50:0/54824343 learned_addr learned my addr 172.21.15.50:0/54824343 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:31.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe682ffd700 1 --2- 172.21.15.50:0/54824343 >> v2:172.21.15.192:3300/0 conn(0x7fe6840cb460 0x7fe6840c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:31.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe6827fc700 1 -- 172.21.15.50:0/54824343 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354881102 0 0) 0x7fe6840cd8f0 con 0x7fe6840ad490 2023-11-28T11:55:31.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe6827fc700 1 -- 172.21.15.50:0/54824343 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe66c0035d0 con 0x7fe6840ad490 2023-11-28T11:55:31.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe682ffd700 1 -- 172.21.15.50:0/54824343 >> v1:172.21.15.192:6789/0 conn(0x7fe684158e60 legacy=0x7fe6840cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:31.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe682ffd700 1 -- 172.21.15.50:0/54824343 >> v1:172.21.15.50:6789/0 conn(0x7fe6840ad490 legacy=0x7fe68406c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:31.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe682ffd700 1 -- 172.21.15.50:0/54824343 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6840cde90 con 0x7fe6840cb460 2023-11-28T11:55:31.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe682ffd700 1 --2- 172.21.15.50:0/54824343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6840cb460 0x7fe6840c8a30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe674009d90 tx=0x7fe67400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d8ab0fd02a90016 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:31.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe6827fc700 1 -- 172.21.15.50:0/54824343 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67400e070 con 0x7fe6840cb460 2023-11-28T11:55:31.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe6827fc700 1 -- 172.21.15.50:0/54824343 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67400bb20 con 0x7fe6840cb460 2023-11-28T11:55:31.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe6827fc700 1 -- 172.21.15.50:0/54824343 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67400be90 con 0x7fe6840cb460 2023-11-28T11:55:31.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe688c6f700 1 -- 172.21.15.50:0/54824343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6840cb460 msgr2=0x7fe6840c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:31.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe688c6f700 1 --2- 172.21.15.50:0/54824343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6840cb460 0x7fe6840c8a30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe674009d90 tx=0x7fe67400b330 comp rx=0 tx=0).stop 2023-11-28T11:55:31.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe688c6f700 1 -- 172.21.15.50:0/54824343 shutdown_connections 2023-11-28T11:55:31.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe688c6f700 1 --2- 172.21.15.50:0/54824343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6840cb460 0x7fe6840c8a30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:31.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe688c6f700 1 -- 172.21.15.50:0/54824343 >> 172.21.15.50:0/54824343 conn(0x7fe6840ce3e0 msgr2=0x7fe6840ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:31.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe688c6f700 1 -- 172.21.15.50:0/54824343 shutdown_connections 2023-11-28T11:55:31.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe688c6f700 1 -- 172.21.15.50:0/54824343 wait complete. 2023-11-28T11:55:31.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe688c6f700 1 Processor -- start 2023-11-28T11:55:31.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.162+0000 7fe688c6f700 1 -- start start 2023-11-28T11:55:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe688c6f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6840ad490 0x7fe684157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe688c6f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6840cb460 0x7fe6840c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe688c6f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684158e60 0x7fe6840b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe688c6f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6840c2c20 con 0x7fe684158e60 2023-11-28T11:55:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe688c6f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6841f13e0 con 0x7fe6840cb460 2023-11-28T11:55:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe688c6f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6841f16c0 con 0x7fe6840ad490 2023-11-28T11:55:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe683fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684158e60 0x7fe6840b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe683fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684158e60 0x7fe6840b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36412/0 (socket says 172.21.15.50:36412) 2023-11-28T11:55:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe683fff700 1 -- 172.21.15.50:0/1146277019 learned_addr learned my addr 172.21.15.50:0/1146277019 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:31.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe682ffd700 1 --2- 172.21.15.50:0/1146277019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6840cb460 0x7fe6840c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:31.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe6837fe700 1 --2- 172.21.15.50:0/1146277019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6840ad490 0x7fe684157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:31.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe683fff700 1 -- 172.21.15.50:0/1146277019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6840ad490 msgr2=0x7fe684157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:31.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe683fff700 1 --2- 172.21.15.50:0/1146277019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6840ad490 0x7fe684157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:31.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe683fff700 1 -- 172.21.15.50:0/1146277019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6840cb460 msgr2=0x7fe6840c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:31.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe683fff700 1 --2- 172.21.15.50:0/1146277019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6840cb460 0x7fe6840c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:31.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe683fff700 1 -- 172.21.15.50:0/1146277019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe674009a70 con 0x7fe684158e60 2023-11-28T11:55:31.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe6837fe700 1 --2- 172.21.15.50:0/1146277019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6840ad490 0x7fe684157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:31.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe683fff700 1 --2- 172.21.15.50:0/1146277019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684158e60 0x7fe6840b32e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe67c00c4f0 tx=0x7fe67c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe66bfff700 1 -- 172.21.15.50:0/1146277019 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c005d90 con 0x7fe684158e60 2023-11-28T11:55:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe66bfff700 1 -- 172.21.15.50:0/1146277019 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67c0070d0 con 0x7fe684158e60 2023-11-28T11:55:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe688c6f700 1 -- 172.21.15.50:0/1146277019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68406d6a0 con 0x7fe684158e60 2023-11-28T11:55:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe66bfff700 1 -- 172.21.15.50:0/1146277019 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c007460 con 0x7fe684158e60 2023-11-28T11:55:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe688c6f700 1 -- 172.21.15.50:0/1146277019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe684159230 con 0x7fe684158e60 2023-11-28T11:55:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe688c6f700 1 -- 172.21.15.50:0/1146277019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe68406d980 con 0x7fe684158e60 2023-11-28T11:55:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.166+0000 7fe66bfff700 1 -- 172.21.15.50:0/1146277019 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe67c019030 con 0x7fe684158e60 2023-11-28T11:55:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.170+0000 7fe66bfff700 1 --2- 172.21.15.50:0/1146277019 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe670064ee0 0x7fe670067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.170+0000 7fe66bfff700 1 -- 172.21.15.50:0/1146277019 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fe67c0814f0 con 0x7fe684158e60 2023-11-28T11:55:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.170+0000 7fe6837fe700 1 --2- 172.21.15.50:0/1146277019 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe670064ee0 0x7fe670067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:31.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.170+0000 7fe6837fe700 1 --2- 172.21.15.50:0/1146277019 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe670064ee0 0x7fe670067390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe678001700 tx=0x7fe678009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:31.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.174+0000 7fe66bfff700 1 -- 172.21.15.50:0/1146277019 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe67c04f420 con 0x7fe684158e60 2023-11-28T11:55:31.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.370+0000 7fe688c6f700 1 -- 172.21.15.50:0/1146277019 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6841f1be0 con 0x7fe684158e60 2023-11-28T11:55:31.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.374+0000 7fe66bfff700 1 -- 172.21.15.50:0/1146277019 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fe6841f1be0 con 0x7fe684158e60 2023-11-28T11:55:31.376 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:31.376 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2392153383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2392153383},{"type":"v1","addr":"172.21.15.192:6837","nonce":2392153383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5515,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3694451276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3694451276},{"type":"v1","addr":"172.21.15.192:6835","nonce":3694451276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2782289763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2782289763},{"type":"v1","addr":"172.21.15.50:6833","nonce":2782289763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:55:06.200530+0000","modified":"2023-11-28T11:55:09.218769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5559},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5559":{"gid":5559,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2320802269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2320802269},{"type":"v1","addr":"172.21.15.50:6835","nonce":2320802269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:55:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.378+0000 7fe688c6f700 1 -- 172.21.15.50:0/1146277019 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe670064ee0 msgr2=0x7fe670067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.378+0000 7fe688c6f700 1 --2- 172.21.15.50:0/1146277019 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe670064ee0 0x7fe670067390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe678001700 tx=0x7fe678009040 comp rx=0 tx=0).stop 2023-11-28T11:55:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.378+0000 7fe688c6f700 1 -- 172.21.15.50:0/1146277019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684158e60 msgr2=0x7fe6840b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.378+0000 7fe688c6f700 1 --2- 172.21.15.50:0/1146277019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684158e60 0x7fe6840b32e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe67c00c4f0 tx=0x7fe67c00c800 comp rx=0 tx=0).stop 2023-11-28T11:55:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.378+0000 7fe688c6f700 1 -- 172.21.15.50:0/1146277019 shutdown_connections 2023-11-28T11:55:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.378+0000 7fe688c6f700 1 --2- 172.21.15.50:0/1146277019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684158e60 0x7fe6840b32e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.378+0000 7fe688c6f700 1 --2- 172.21.15.50:0/1146277019 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe670064ee0 0x7fe670067390 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.378+0000 7fe688c6f700 1 --2- 172.21.15.50:0/1146277019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6840cb460 0x7fe6840c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.378+0000 7fe688c6f700 1 --2- 172.21.15.50:0/1146277019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6840ad490 0x7fe684157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.378+0000 7fe688c6f700 1 -- 172.21.15.50:0/1146277019 >> 172.21.15.50:0/1146277019 conn(0x7fe6840ce3e0 msgr2=0x7fe68406a660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.378+0000 7fe688c6f700 1 -- 172.21.15.50:0/1146277019 shutdown_connections 2023-11-28T11:55:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:31.378+0000 7fe688c6f700 1 -- 172.21.15.50:0/1146277019 wait complete. 2023-11-28T11:55:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-11-28T11:55:31.396 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json tag path /parentdir mytag 2023-11-28T11:55:31.519 INFO:teuthology.orchestra.run.smithi050.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2023-11-28T11:55:31.519 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2023-11-28T11:55:36.180 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:55:36.183 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:55:41.520 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2023-11-28T11:55:41.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.562+0000 7fab42c82140 1 Processor -- start 2023-11-28T11:55:41.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.562+0000 7fab42c82140 1 -- start start 2023-11-28T11:55:41.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab42c82140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563ef3d27870 0x563ef3ce0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab42c82140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ef3d9a970 0x563ef3d99c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab42c82140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x563ef3d9ad40 0x563ef3d0b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab42c82140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ef3c04240 con 0x563ef3d27870 2023-11-28T11:55:41.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab42c82140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ef3e43600 con 0x563ef3d9a970 2023-11-28T11:55:41.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab42c82140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ef3e43360 con 0x563ef3d9ad40 2023-11-28T11:55:41.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab407b7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563ef3d27870 0x563ef3ce0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab407b7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563ef3d27870 0x563ef3ce0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45050/0 (socket says 172.21.15.50:45050) 2023-11-28T11:55:41.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab407b7700 1 -- 172.21.15.50:0/3249327247 learned_addr learned my addr 172.21.15.50:0/3249327247 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:41.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab3ffb6700 1 --2- 172.21.15.50:0/3249327247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ef3d9a970 0x563ef3d99c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab40fb8700 1 --2- 172.21.15.50:0/3249327247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x563ef3d9ad40 0x563ef3d0b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab407b7700 1 -- 172.21.15.50:0/3249327247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x563ef3d9ad40 msgr2=0x563ef3d0b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:41.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab407b7700 1 --2- 172.21.15.50:0/3249327247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x563ef3d9ad40 0x563ef3d0b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab407b7700 1 -- 172.21.15.50:0/3249327247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ef3d9a970 msgr2=0x563ef3d99c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:41.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab407b7700 1 --2- 172.21.15.50:0/3249327247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ef3d9a970 0x563ef3d99c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab407b7700 1 -- 172.21.15.50:0/3249327247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3000a100 con 0x563ef3d27870 2023-11-28T11:55:41.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab40fb8700 1 --2- 172.21.15.50:0/3249327247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x563ef3d9ad40 0x563ef3d0b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:41.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab407b7700 1 --2- 172.21.15.50:0/3249327247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563ef3d27870 0x563ef3ce0480 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fab30000f80 tx=0x7fab3000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789ce09da44b8ba3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab3efb4700 1 -- 172.21.15.50:0/3249327247 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3000f790 con 0x563ef3d27870 2023-11-28T11:55:41.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab3efb4700 1 -- 172.21.15.50:0/3249327247 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3000fa60 con 0x563ef3d27870 2023-11-28T11:55:41.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab3efb4700 1 -- 172.21.15.50:0/3249327247 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3000fdf0 con 0x563ef3d27870 2023-11-28T11:55:41.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab42c82140 1 -- 172.21.15.50:0/3249327247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563ef3d27870 msgr2=0x563ef3ce0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab42c82140 1 --2- 172.21.15.50:0/3249327247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563ef3d27870 0x563ef3ce0480 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fab30000f80 tx=0x7fab3000f000 comp rx=0 tx=0).stop 2023-11-28T11:55:41.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab42c82140 1 -- 172.21.15.50:0/3249327247 shutdown_connections 2023-11-28T11:55:41.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab42c82140 1 --2- 172.21.15.50:0/3249327247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x563ef3d9ad40 0x563ef3d0b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab42c82140 1 --2- 172.21.15.50:0/3249327247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ef3d9a970 0x563ef3d99c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab42c82140 1 --2- 172.21.15.50:0/3249327247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563ef3d27870 0x563ef3ce0480 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab42c82140 1 -- 172.21.15.50:0/3249327247 >> 172.21.15.50:0/3249327247 conn(0x563ef3d07fb0 msgr2=0x563ef3d22570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:41.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab42c82140 1 -- 172.21.15.50:0/3249327247 shutdown_connections 2023-11-28T11:55:41.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.566+0000 7fab42c82140 1 -- 172.21.15.50:0/3249327247 wait complete. 2023-11-28T11:55:41.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.570+0000 7fab42c82140 1 Processor -- start 2023-11-28T11:55:41.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.570+0000 7fab42c82140 1 -- start start 2023-11-28T11:55:41.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.570+0000 7fab42c82140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ef3d27870 0x563ef3d98f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.570+0000 7fab42c82140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563ef3d9a970 0x563ef3d235c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.570+0000 7fab42c82140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x563ef3d9ad40 0x563ef3d23b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.570+0000 7fab42c82140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ef3d99480 con 0x563ef3d9a970 2023-11-28T11:55:41.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.570+0000 7fab42c82140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ef3e42170 con 0x563ef3d27870 2023-11-28T11:55:41.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.570+0000 7fab42c82140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ef3e3df10 con 0x563ef3d9ad40 2023-11-28T11:55:41.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.570+0000 7fab3ffb6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563ef3d9a970 0x563ef3d235c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.570+0000 7fab3ffb6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563ef3d9a970 0x563ef3d235c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45052/0 (socket says 172.21.15.50:45052) 2023-11-28T11:55:41.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.570+0000 7fab3ffb6700 1 -- 172.21.15.50:0/1735297374 learned_addr learned my addr 172.21.15.50:0/1735297374 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:41.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.570+0000 7fab40fb8700 1 --2- 172.21.15.50:0/1735297374 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x563ef3d9ad40 0x563ef3d23b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.570+0000 7fab407b7700 1 --2- 172.21.15.50:0/1735297374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ef3d27870 0x563ef3d98f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.574+0000 7fab3ffb6700 1 -- 172.21.15.50:0/1735297374 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x563ef3d9ad40 msgr2=0x563ef3d23b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.574+0000 7fab3ffb6700 1 --2- 172.21.15.50:0/1735297374 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x563ef3d9ad40 0x563ef3d23b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.574+0000 7fab3ffb6700 1 -- 172.21.15.50:0/1735297374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ef3d27870 msgr2=0x563ef3d98f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.574+0000 7fab3ffb6700 1 --2- 172.21.15.50:0/1735297374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ef3d27870 0x563ef3d98f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.574+0000 7fab3ffb6700 1 -- 172.21.15.50:0/1735297374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ef3c36760 con 0x563ef3d9a970 2023-11-28T11:55:41.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.574+0000 7fab3ffb6700 1 --2- 172.21.15.50:0/1735297374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563ef3d9a970 0x563ef3d235c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fab2800dcb0 tx=0x7fab2800b2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.574+0000 7fab3dfb2700 1 -- 172.21.15.50:0/1735297374 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2800bd80 con 0x563ef3d9a970 2023-11-28T11:55:41.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.574+0000 7fab3dfb2700 1 -- 172.21.15.50:0/1735297374 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2800f450 con 0x563ef3d9a970 2023-11-28T11:55:41.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.574+0000 7fab42c82140 1 -- 172.21.15.50:0/1735297374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563ef3c1c390 con 0x563ef3d9a970 2023-11-28T11:55:41.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.574+0000 7fab3dfb2700 1 -- 172.21.15.50:0/1735297374 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2800f800 con 0x563ef3d9a970 2023-11-28T11:55:41.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.574+0000 7fab42c82140 1 -- 172.21.15.50:0/1735297374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ef3c0f8b0 con 0x563ef3d9a970 2023-11-28T11:55:41.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.574+0000 7fab3dfb2700 1 -- 172.21.15.50:0/1735297374 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fab2800f960 con 0x563ef3d9a970 2023-11-28T11:55:41.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab3dfb2700 1 --2- 172.21.15.50:0/1735297374 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fab20063810 0x7fab20065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab3dfb2700 1 -- 172.21.15.50:0/1735297374 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fab280813c0 con 0x563ef3d9a970 2023-11-28T11:55:41.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab407b7700 1 --2- 172.21.15.50:0/1735297374 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fab20063810 0x7fab20065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab42c82140 1 --2- 172.21.15.50:0/1735297374 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x563ef3e3eb90 0x563ef3e3ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab42c82140 1 -- 172.21.15.50:0/1735297374 --> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] -- osd_op(unknown.0.0:1 6.10 6:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) v8 -- 0x563ef3e3f4d0 con 0x563ef3e3eb90 2023-11-28T11:55:41.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab40fb8700 1 --2- 172.21.15.50:0/1735297374 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x563ef3e3eb90 0x563ef3e3ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab407b7700 1 --2- 172.21.15.50:0/1735297374 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fab20063810 0x7fab20065cc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fab30013040 tx=0x7fab30008000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab40fb8700 1 --2- 172.21.15.50:0/1735297374 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x563ef3e3eb90 0x563ef3e3ef90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab40fb8700 1 -- 172.21.15.50:0/1735297374 <== osd.0 v2:172.21.15.50:6800/36462 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7fab38009990 con 0x563ef3e3eb90 2023-11-28T11:55:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab42c82140 1 -- 172.21.15.50:0/1735297374 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x563ef3e3eb90 msgr2=0x563ef3e3ef90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab42c82140 1 --2- 172.21.15.50:0/1735297374 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x563ef3e3eb90 0x563ef3e3ef90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab42c82140 1 -- 172.21.15.50:0/1735297374 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fab20063810 msgr2=0x7fab20065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab42c82140 1 --2- 172.21.15.50:0/1735297374 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fab20063810 0x7fab20065cc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fab30013040 tx=0x7fab30008000 comp rx=0 tx=0).stop 2023-11-28T11:55:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab42c82140 1 -- 172.21.15.50:0/1735297374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563ef3d9a970 msgr2=0x563ef3d235c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab42c82140 1 --2- 172.21.15.50:0/1735297374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563ef3d9a970 0x563ef3d235c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fab2800dcb0 tx=0x7fab2800b2f0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab40fb8700 1 -- 172.21.15.50:0/1735297374 reap_dead start 2023-11-28T11:55:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab42c82140 1 -- 172.21.15.50:0/1735297374 shutdown_connections 2023-11-28T11:55:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab42c82140 1 -- 172.21.15.50:0/1735297374 >> 172.21.15.50:0/1735297374 conn(0x563ef3d07fb0 msgr2=0x563ef3d99c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab42c82140 1 -- 172.21.15.50:0/1735297374 shutdown_connections 2023-11-28T11:55:41.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.578+0000 7fab42c82140 1 -- 172.21.15.50:0/1735297374 wait complete. 2023-11-28T11:55:41.586 INFO:teuthology.orchestra.run.smithi050.stdout:mytag 2023-11-28T11:55:41.587 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2023-11-28T11:55:41.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d3c04140 1 Processor -- start 2023-11-28T11:55:41.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d3c04140 1 -- start start 2023-11-28T11:55:41.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d3c04140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580ba4b1610 0x5580ba4dd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d3c04140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580ba4f5a90 0x5580ba615e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d3c04140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5580ba4f5e60 0x5580ba616350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d3c04140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580ba441180 con 0x5580ba4b1610 2023-11-28T11:55:41.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d3c04140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580ba3d4240 con 0x5580ba4f5a90 2023-11-28T11:55:41.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d3c04140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5580ba4f03c0 con 0x5580ba4f5e60 2023-11-28T11:55:41.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d1739700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580ba4b1610 0x5580ba4dd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d1739700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580ba4b1610 0x5580ba4dd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33652/0 (socket says 172.21.15.50:33652) 2023-11-28T11:55:41.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d1739700 1 -- 172.21.15.50:0/9678971 learned_addr learned my addr 172.21.15.50:0/9678971 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:41.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d0f38700 1 --2- 172.21.15.50:0/9678971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580ba4f5a90 0x5580ba615e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d1f3a700 1 --2- 172.21.15.50:0/9678971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5580ba4f5e60 0x5580ba616350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d1739700 1 -- 172.21.15.50:0/9678971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5580ba4f5e60 msgr2=0x5580ba616350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d1739700 1 --2- 172.21.15.50:0/9678971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5580ba4f5e60 0x5580ba616350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d1739700 1 -- 172.21.15.50:0/9678971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580ba4f5a90 msgr2=0x5580ba615e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d1739700 1 --2- 172.21.15.50:0/9678971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580ba4f5a90 0x5580ba615e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d1739700 1 -- 172.21.15.50:0/9678971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c4005d20 con 0x5580ba4b1610 2023-11-28T11:55:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.626+0000 7f42d1739700 1 --2- 172.21.15.50:0/9678971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580ba4b1610 0x5580ba4dd440 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00b370 tx=0x7f42cc00b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f133a555a68c54c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.630+0000 7f42cb7fe700 1 -- 172.21.15.50:0/9678971 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc014070 con 0x5580ba4b1610 2023-11-28T11:55:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.630+0000 7f42cb7fe700 1 -- 172.21.15.50:0/9678971 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc00f3f0 con 0x5580ba4b1610 2023-11-28T11:55:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.630+0000 7f42cb7fe700 1 -- 172.21.15.50:0/9678971 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc00f780 con 0x5580ba4b1610 2023-11-28T11:55:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.630+0000 7f42d3c04140 1 -- 172.21.15.50:0/9678971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580ba4b1610 msgr2=0x5580ba4dd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.630+0000 7f42d3c04140 1 --2- 172.21.15.50:0/9678971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580ba4b1610 0x5580ba4dd440 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00b370 tx=0x7f42cc00b680 comp rx=0 tx=0).stop 2023-11-28T11:55:41.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.630+0000 7f42d3c04140 1 -- 172.21.15.50:0/9678971 shutdown_connections 2023-11-28T11:55:41.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.630+0000 7f42d3c04140 1 --2- 172.21.15.50:0/9678971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5580ba4f5e60 0x5580ba616350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.630+0000 7f42d3c04140 1 --2- 172.21.15.50:0/9678971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580ba4f5a90 0x5580ba615e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.630+0000 7f42d3c04140 1 --2- 172.21.15.50:0/9678971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580ba4b1610 0x5580ba4dd440 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.630+0000 7f42d3c04140 1 -- 172.21.15.50:0/9678971 >> 172.21.15.50:0/9678971 conn(0x5580ba4dbdc0 msgr2=0x5580ba581fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:41.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.630+0000 7f42d3c04140 1 -- 172.21.15.50:0/9678971 shutdown_connections 2023-11-28T11:55:41.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.630+0000 7f42d3c04140 1 -- 172.21.15.50:0/9678971 wait complete. 2023-11-28T11:55:41.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.630+0000 7f42d3c04140 1 Processor -- start 2023-11-28T11:55:41.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.630+0000 7f42d3c04140 1 -- start start 2023-11-28T11:55:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d3c04140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5580ba4b1610 0x5580ba619960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d3c04140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580ba4f5a90 0x5580ba4da880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d3c04140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580ba4f5e60 0x5580ba580c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d3c04140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580ba60b710 con 0x5580ba4f5e60 2023-11-28T11:55:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d3c04140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580ba60b970 con 0x5580ba4f5a90 2023-11-28T11:55:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d3c04140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5580ba60bc10 con 0x5580ba4b1610 2023-11-28T11:55:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d1f3a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580ba4f5e60 0x5580ba580c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d1f3a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580ba4f5e60 0x5580ba580c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33660/0 (socket says 172.21.15.50:33660) 2023-11-28T11:55:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d1f3a700 1 -- 172.21.15.50:0/3102938134 learned_addr learned my addr 172.21.15.50:0/3102938134 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:41.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d1739700 1 --2- 172.21.15.50:0/3102938134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5580ba4b1610 0x5580ba619960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d0f38700 1 --2- 172.21.15.50:0/3102938134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580ba4f5a90 0x5580ba4da880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d1f3a700 1 -- 172.21.15.50:0/3102938134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5580ba4b1610 msgr2=0x5580ba619960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d1f3a700 1 --2- 172.21.15.50:0/3102938134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5580ba4b1610 0x5580ba619960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d1f3a700 1 -- 172.21.15.50:0/3102938134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580ba4f5a90 msgr2=0x5580ba4da880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d1f3a700 1 --2- 172.21.15.50:0/3102938134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580ba4f5a90 0x5580ba4da880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d1f3a700 1 -- 172.21.15.50:0/3102938134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc0015b0 con 0x5580ba4f5e60 2023-11-28T11:55:41.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d1f3a700 1 --2- 172.21.15.50:0/3102938134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580ba4f5e60 0x5580ba580c50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x5580ba4f6470 tx=0x7f42c4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42ca7fc700 1 -- 172.21.15.50:0/3102938134 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4008480 con 0x5580ba4f5e60 2023-11-28T11:55:41.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42ca7fc700 1 -- 172.21.15.50:0/3102938134 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c40085e0 con 0x5580ba4f5e60 2023-11-28T11:55:41.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d3c04140 1 -- 172.21.15.50:0/3102938134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5580ba3df8b0 con 0x5580ba4f5e60 2023-11-28T11:55:41.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42ca7fc700 1 -- 172.21.15.50:0/3102938134 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4008990 con 0x5580ba4f5e60 2023-11-28T11:55:41.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.634+0000 7f42d3c04140 1 -- 172.21.15.50:0/3102938134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5580ba3ec5d0 con 0x5580ba4f5e60 2023-11-28T11:55:41.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.638+0000 7f42ca7fc700 1 -- 172.21.15.50:0/3102938134 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f42c4008af0 con 0x5580ba4f5e60 2023-11-28T11:55:41.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.638+0000 7f42ca7fc700 1 --2- 172.21.15.50:0/3102938134 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f42b4063810 0x7f42b4065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.638+0000 7f42ca7fc700 1 -- 172.21.15.50:0/3102938134 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f42c4082930 con 0x5580ba4f5e60 2023-11-28T11:55:41.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.638+0000 7f42d1739700 1 --2- 172.21.15.50:0/3102938134 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f42b4063810 0x7f42b4065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.638+0000 7f42d3c04140 1 --2- 172.21.15.50:0/3102938134 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x5580ba581190 0x5580ba60c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.638+0000 7f42d3c04140 1 -- 172.21.15.50:0/3102938134 --> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] -- osd_op(unknown.0.0:1 6.7 6:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) v8 -- 0x5580ba60cb30 con 0x5580ba581190 2023-11-28T11:55:41.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.638+0000 7f42d0f38700 1 --2- 172.21.15.50:0/3102938134 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x5580ba581190 0x5580ba60c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.638+0000 7f42d1739700 1 --2- 172.21.15.50:0/3102938134 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f42b4063810 0x7f42b4065cc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f42cc000c00 tx=0x7f42cc011040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.642+0000 7f42d0f38700 1 --2- 172.21.15.50:0/3102938134 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x5580ba581190 0x5580ba60c5f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.642+0000 7f42d0f38700 1 -- 172.21.15.50:0/3102938134 <== osd.5 v2:172.21.15.192:6802/36817 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f42bc006020 con 0x5580ba581190 2023-11-28T11:55:41.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.642+0000 7f42d3c04140 1 -- 172.21.15.50:0/3102938134 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x5580ba581190 msgr2=0x5580ba60c5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.642+0000 7f42d3c04140 1 --2- 172.21.15.50:0/3102938134 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x5580ba581190 0x5580ba60c5f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.642+0000 7f42d3c04140 1 -- 172.21.15.50:0/3102938134 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f42b4063810 msgr2=0x7f42b4065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.642+0000 7f42d3c04140 1 --2- 172.21.15.50:0/3102938134 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f42b4063810 0x7f42b4065cc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f42cc000c00 tx=0x7f42cc011040 comp rx=0 tx=0).stop 2023-11-28T11:55:41.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.642+0000 7f42d3c04140 1 -- 172.21.15.50:0/3102938134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580ba4f5e60 msgr2=0x5580ba580c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.642+0000 7f42d3c04140 1 --2- 172.21.15.50:0/3102938134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5580ba4f5e60 0x5580ba580c50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x5580ba4f6470 tx=0x7f42c4002fb0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.642+0000 7f42d1f3a700 1 -- 172.21.15.50:0/3102938134 reap_dead start 2023-11-28T11:55:41.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.642+0000 7f42d3c04140 1 -- 172.21.15.50:0/3102938134 shutdown_connections 2023-11-28T11:55:41.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.642+0000 7f42d3c04140 1 -- 172.21.15.50:0/3102938134 >> 172.21.15.50:0/3102938134 conn(0x5580ba4dbdc0 msgr2=0x5580ba4f4960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:41.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.642+0000 7f42d3c04140 1 -- 172.21.15.50:0/3102938134 shutdown_connections 2023-11-28T11:55:41.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.642+0000 7f42d3c04140 1 -- 172.21.15.50:0/3102938134 wait complete. 2023-11-28T11:55:41.649 INFO:teuthology.orchestra.run.smithi050.stdout:mytag 2023-11-28T11:55:41.649 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2023-11-28T11:55:41.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430fa53140 1 Processor -- start 2023-11-28T11:55:41.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430fa53140 1 -- start start 2023-11-28T11:55:41.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430fa53140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55937cf61d20 0x55937cfa87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430fa53140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55937cfad280 0x55937cf92c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430fa53140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55937d0206d0 0x55937cfa8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430fa53140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937ce8a240 con 0x55937cfad280 2023-11-28T11:55:41.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430fa53140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937d020060 con 0x55937d0206d0 2023-11-28T11:55:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430fa53140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55937d01fdc0 con 0x55937cf61d20 2023-11-28T11:55:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430cd87700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55937cfad280 0x55937cf92c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430cd87700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55937cfad280 0x55937cf92c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33672/0 (socket says 172.21.15.50:33672) 2023-11-28T11:55:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430cd87700 1 -- 172.21.15.50:0/3534265204 learned_addr learned my addr 172.21.15.50:0/3534265204 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430d588700 1 --2- 172.21.15.50:0/3534265204 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55937cf61d20 0x55937cfa87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430dd89700 1 --2- 172.21.15.50:0/3534265204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55937d0206d0 0x55937cfa8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430cd87700 1 -- 172.21.15.50:0/3534265204 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55937cf61d20 msgr2=0x55937cfa87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430cd87700 1 --2- 172.21.15.50:0/3534265204 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55937cf61d20 0x55937cfa87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430cd87700 1 -- 172.21.15.50:0/3534265204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55937d0206d0 msgr2=0x55937cfa8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:41.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430cd87700 1 --2- 172.21.15.50:0/3534265204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55937d0206d0 0x55937cfa8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430cd87700 1 -- 172.21.15.50:0/3534265204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f8005d20 con 0x55937cfad280 2023-11-28T11:55:41.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f430cd87700 1 --2- 172.21.15.50:0/3534265204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55937cfad280 0x55937cf92c70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f42f80099a0 tx=0x7f42f8005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a89bf8be8d6c1d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f43077fe700 1 -- 172.21.15.50:0/3534265204 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f800f040 con 0x55937cfad280 2023-11-28T11:55:41.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f43077fe700 1 -- 172.21.15.50:0/3534265204 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f8008ab0 con 0x55937cfad280 2023-11-28T11:55:41.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.734+0000 7f43077fe700 1 -- 172.21.15.50:0/3534265204 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8008e20 con 0x55937cfad280 2023-11-28T11:55:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.738+0000 7f430fa53140 1 -- 172.21.15.50:0/3534265204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55937cfad280 msgr2=0x55937cf92c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.738+0000 7f430fa53140 1 --2- 172.21.15.50:0/3534265204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55937cfad280 0x55937cf92c70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f42f80099a0 tx=0x7f42f8005a00 comp rx=0 tx=0).stop 2023-11-28T11:55:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.738+0000 7f430fa53140 1 -- 172.21.15.50:0/3534265204 shutdown_connections 2023-11-28T11:55:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.738+0000 7f430fa53140 1 --2- 172.21.15.50:0/3534265204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55937d0206d0 0x55937cfa8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.738+0000 7f430fa53140 1 --2- 172.21.15.50:0/3534265204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55937cfad280 0x55937cf92c70 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.738+0000 7f430fa53140 1 --2- 172.21.15.50:0/3534265204 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55937cf61d20 0x55937cfa87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.738+0000 7f430fa53140 1 -- 172.21.15.50:0/3534265204 >> 172.21.15.50:0/3534265204 conn(0x55937cf8ff20 msgr2=0x55937cfa75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.738+0000 7f430fa53140 1 -- 172.21.15.50:0/3534265204 shutdown_connections 2023-11-28T11:55:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.738+0000 7f430fa53140 1 -- 172.21.15.50:0/3534265204 wait complete. 2023-11-28T11:55:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.738+0000 7f430fa53140 1 Processor -- start 2023-11-28T11:55:41.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.738+0000 7f430fa53140 1 -- start start 2023-11-28T11:55:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430fa53140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55937cf61d20 0x55937d01f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430fa53140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55937cfad280 0x55937d00a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430fa53140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55937d0206d0 0x55937d00a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430fa53140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937d0d0140 con 0x55937d0206d0 2023-11-28T11:55:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430fa53140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937d0d03e0 con 0x55937cf61d20 2023-11-28T11:55:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430fa53140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55937d0d0680 con 0x55937cfad280 2023-11-28T11:55:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430dd89700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55937d0206d0 0x55937d00a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430dd89700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55937d0206d0 0x55937d00a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33678/0 (socket says 172.21.15.50:33678) 2023-11-28T11:55:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430dd89700 1 -- 172.21.15.50:0/1363784434 learned_addr learned my addr 172.21.15.50:0/1363784434 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430d588700 1 --2- 172.21.15.50:0/1363784434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55937cf61d20 0x55937d01f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430cd87700 1 --2- 172.21.15.50:0/1363784434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55937cfad280 0x55937d00a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430dd89700 1 -- 172.21.15.50:0/1363784434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55937cfad280 msgr2=0x55937d00a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430dd89700 1 --2- 172.21.15.50:0/1363784434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55937cfad280 0x55937d00a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430dd89700 1 -- 172.21.15.50:0/1363784434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55937cf61d20 msgr2=0x55937d01f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430dd89700 1 --2- 172.21.15.50:0/1363784434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55937cf61d20 0x55937d01f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430dd89700 1 -- 172.21.15.50:0/1363784434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f8009600 con 0x55937d0206d0 2023-11-28T11:55:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430dd89700 1 --2- 172.21.15.50:0/1363784434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55937d0206d0 0x55937d00a910 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x55937cf67ed0 tx=0x7f4308003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f43067fc700 1 -- 172.21.15.50:0/1363784434 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4308010620 con 0x55937d0206d0 2023-11-28T11:55:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f43067fc700 1 -- 172.21.15.50:0/1363784434 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4308009030 con 0x55937d0206d0 2023-11-28T11:55:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430fa53140 1 -- 172.21.15.50:0/1363784434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55937ce958b0 con 0x55937d0206d0 2023-11-28T11:55:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f43067fc700 1 -- 172.21.15.50:0/1363784434 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4308010a00 con 0x55937d0206d0 2023-11-28T11:55:41.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.742+0000 7f430fa53140 1 -- 172.21.15.50:0/1363784434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430800a100 con 0x55937d0206d0 2023-11-28T11:55:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.746+0000 7f43067fc700 1 -- 172.21.15.50:0/1363784434 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f430800e050 con 0x55937d0206d0 2023-11-28T11:55:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.746+0000 7f43067fc700 1 --2- 172.21.15.50:0/1363784434 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f42f0063810 0x7f42f0065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.746+0000 7f43067fc700 1 -- 172.21.15.50:0/1363784434 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f43080821f0 con 0x55937d0206d0 2023-11-28T11:55:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.746+0000 7f430d588700 1 --2- 172.21.15.50:0/1363784434 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f42f0063810 0x7f42f0065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.746+0000 7f430fa53140 1 --2- 172.21.15.50:0/1363784434 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x55937d0d1060 0x55937d0d1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.746+0000 7f430fa53140 1 -- 172.21.15.50:0/1363784434 --> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] -- osd_op(unknown.0.0:1 7.36 7:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) v8 -- 0x55937d0d19a0 con 0x55937d0d1060 2023-11-28T11:55:41.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.746+0000 7f430cd87700 1 --2- 172.21.15.50:0/1363784434 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x55937d0d1060 0x55937d0d1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.746+0000 7f430d588700 1 --2- 172.21.15.50:0/1363784434 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f42f0063810 0x7f42f0065cc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4300004170 tx=0x7f4300000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.746+0000 7f430cd87700 1 --2- 172.21.15.50:0/1363784434 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x55937d0d1060 0x55937d0d1460 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.750+0000 7f430cd87700 1 -- 172.21.15.50:0/1363784434 <== osd.0 v2:172.21.15.50:6800/36462 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f42f8019020 con 0x55937d0d1060 2023-11-28T11:55:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.750+0000 7f430fa53140 1 -- 172.21.15.50:0/1363784434 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x55937d0d1060 msgr2=0x55937d0d1460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.750+0000 7f430fa53140 1 --2- 172.21.15.50:0/1363784434 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x55937d0d1060 0x55937d0d1460 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.750+0000 7f430fa53140 1 -- 172.21.15.50:0/1363784434 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f42f0063810 msgr2=0x7f42f0065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.750+0000 7f430fa53140 1 --2- 172.21.15.50:0/1363784434 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f42f0063810 0x7f42f0065cc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4300004170 tx=0x7f4300000bc0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.750+0000 7f430fa53140 1 -- 172.21.15.50:0/1363784434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55937d0206d0 msgr2=0x55937d00a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.750+0000 7f430fa53140 1 --2- 172.21.15.50:0/1363784434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55937d0206d0 0x55937d00a910 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x55937cf67ed0 tx=0x7f4308003330 comp rx=0 tx=0).stop 2023-11-28T11:55:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.750+0000 7f430dd89700 1 -- 172.21.15.50:0/1363784434 reap_dead start 2023-11-28T11:55:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.750+0000 7f430fa53140 1 -- 172.21.15.50:0/1363784434 shutdown_connections 2023-11-28T11:55:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.750+0000 7f430fa53140 1 -- 172.21.15.50:0/1363784434 >> 172.21.15.50:0/1363784434 conn(0x55937cf8ff20 msgr2=0x55937cf92c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.750+0000 7f430fa53140 1 -- 172.21.15.50:0/1363784434 shutdown_connections 2023-11-28T11:55:41.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.750+0000 7f430fa53140 1 -- 172.21.15.50:0/1363784434 wait complete. 2023-11-28T11:55:41.757 INFO:teuthology.orchestra.run.smithi050.stdout:mytag 2023-11-28T11:55:41.757 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2023-11-28T11:55:41.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54ab2ee140 1 Processor -- start 2023-11-28T11:55:41.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54ab2ee140 1 -- start start 2023-11-28T11:55:41.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54ab2ee140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595197327e0 0x559519745eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54ab2ee140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55951974aa90 0x5595197023c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54ab2ee140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951974ae60 0x559519702900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54ab2ee140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x559519629240 con 0x5595197327e0 2023-11-28T11:55:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54ab2ee140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595197d7850 con 0x55951974ae60 2023-11-28T11:55:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54ab2ee140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x559519748b30 con 0x55951974aa90 2023-11-28T11:55:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54a8e23700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595197327e0 0x559519745eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54a8622700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55951974aa90 0x5595197023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54a8e23700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595197327e0 0x559519745eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33694/0 (socket says 172.21.15.50:33694) 2023-11-28T11:55:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54a8e23700 1 -- 172.21.15.50:0/2351749472 learned_addr learned my addr 172.21.15.50:0/2351749472 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:41.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54a9624700 1 --2- 172.21.15.50:0/2351749472 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951974ae60 0x559519702900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54a8622700 1 -- 172.21.15.50:0/2351749472 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951974ae60 msgr2=0x559519702900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:41.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54a8622700 1 --2- 172.21.15.50:0/2351749472 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951974ae60 0x559519702900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54a8622700 1 -- 172.21.15.50:0/2351749472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595197327e0 msgr2=0x559519745eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:41.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54a8622700 1 --2- 172.21.15.50:0/2351749472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595197327e0 0x559519745eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.794+0000 7f54a8622700 1 -- 172.21.15.50:0/2351749472 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5490005d20 con 0x55951974aa90 2023-11-28T11:55:41.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54a8622700 1 --2- 172.21.15.50:0/2351749472 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55951974aa90 0x5595197023c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5490009850 tx=0x7f5490005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92d64bfa1ad5466d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54a7620700 1 -- 172.21.15.50:0/2351749472 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549000f040 con 0x55951974aa90 2023-11-28T11:55:41.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54a7620700 1 -- 172.21.15.50:0/2351749472 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5490008930 con 0x55951974aa90 2023-11-28T11:55:41.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54a7620700 1 -- 172.21.15.50:0/2351749472 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490008ca0 con 0x55951974aa90 2023-11-28T11:55:41.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54ab2ee140 1 -- 172.21.15.50:0/2351749472 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55951974aa90 msgr2=0x5595197023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54ab2ee140 1 --2- 172.21.15.50:0/2351749472 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55951974aa90 0x5595197023c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5490009850 tx=0x7f5490005a00 comp rx=0 tx=0).stop 2023-11-28T11:55:41.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54ab2ee140 1 -- 172.21.15.50:0/2351749472 shutdown_connections 2023-11-28T11:55:41.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54ab2ee140 1 --2- 172.21.15.50:0/2351749472 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951974ae60 0x559519702900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54ab2ee140 1 --2- 172.21.15.50:0/2351749472 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55951974aa90 0x5595197023c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54ab2ee140 1 --2- 172.21.15.50:0/2351749472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595197327e0 0x559519745eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54ab2ee140 1 -- 172.21.15.50:0/2351749472 >> 172.21.15.50:0/2351749472 conn(0x559519730dc0 msgr2=0x559519705540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:41.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54ab2ee140 1 -- 172.21.15.50:0/2351749472 shutdown_connections 2023-11-28T11:55:41.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54ab2ee140 1 -- 172.21.15.50:0/2351749472 wait complete. 2023-11-28T11:55:41.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54ab2ee140 1 Processor -- start 2023-11-28T11:55:41.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54ab2ee140 1 -- start start 2023-11-28T11:55:41.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54ab2ee140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595197327e0 0x5595197d6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54ab2ee140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55951974aa90 0x5595197bd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54ab2ee140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951974ae60 0x55951986b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54ab2ee140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595197d2330 con 0x55951974aa90 2023-11-28T11:55:41.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54ab2ee140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595197d5710 con 0x55951974ae60 2023-11-28T11:55:41.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54ab2ee140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595197d59b0 con 0x5595197327e0 2023-11-28T11:55:41.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54a8622700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55951974aa90 0x5595197bd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54a8622700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55951974aa90 0x5595197bd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33700/0 (socket says 172.21.15.50:33700) 2023-11-28T11:55:41.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54a8622700 1 -- 172.21.15.50:0/2578914684 learned_addr learned my addr 172.21.15.50:0/2578914684 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:41.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54a9624700 1 --2- 172.21.15.50:0/2578914684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951974ae60 0x55951986b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54a8e23700 1 --2- 172.21.15.50:0/2578914684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595197327e0 0x5595197d6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54a8622700 1 -- 172.21.15.50:0/2578914684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595197327e0 msgr2=0x5595197d6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54a8622700 1 --2- 172.21.15.50:0/2578914684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595197327e0 0x5595197d6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54a8622700 1 -- 172.21.15.50:0/2578914684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951974ae60 msgr2=0x55951986b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54a8622700 1 --2- 172.21.15.50:0/2578914684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951974ae60 0x55951986b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54a8622700 1 -- 172.21.15.50:0/2578914684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5490009450 con 0x55951974aa90 2023-11-28T11:55:41.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.798+0000 7f54a8622700 1 --2- 172.21.15.50:0/2578914684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55951974aa90 0x5595197bd3f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5490015040 tx=0x7f5490003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.802+0000 7f54a661e700 1 -- 172.21.15.50:0/2578914684 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549000f040 con 0x55951974aa90 2023-11-28T11:55:41.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.802+0000 7f54ab2ee140 1 -- 172.21.15.50:0/2578914684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595196348b0 con 0x55951974aa90 2023-11-28T11:55:41.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.802+0000 7f54a661e700 1 -- 172.21.15.50:0/2578914684 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5490022070 con 0x55951974aa90 2023-11-28T11:55:41.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.802+0000 7f54a661e700 1 -- 172.21.15.50:0/2578914684 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490013900 con 0x55951974aa90 2023-11-28T11:55:41.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.802+0000 7f54ab2ee140 1 -- 172.21.15.50:0/2578914684 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a0005de0 con 0x55951974aa90 2023-11-28T11:55:41.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.802+0000 7f54a661e700 1 -- 172.21.15.50:0/2578914684 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5490013a60 con 0x55951974aa90 2023-11-28T11:55:41.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.802+0000 7f54a661e700 1 --2- 172.21.15.50:0/2578914684 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f548c063840 0x7f548c065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.802+0000 7f54a661e700 1 -- 172.21.15.50:0/2578914684 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f5490082f20 con 0x55951974aa90 2023-11-28T11:55:41.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.802+0000 7f54ab2ee140 1 --2- 172.21.15.50:0/2578914684 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x5595197bd930 0x5595197d8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.802+0000 7f54ab2ee140 1 -- 172.21.15.50:0/2578914684 --> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] -- osd_op(unknown.0.0:1 7.19 7:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) v8 -- 0x5595197d86b0 con 0x5595197bd930 2023-11-28T11:55:41.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.802+0000 7f54a8e23700 1 --2- 172.21.15.50:0/2578914684 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f548c063840 0x7f548c065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.806+0000 7f54a9624700 1 --2- 172.21.15.50:0/2578914684 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x5595197bd930 0x5595197d8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.806+0000 7f54a8e23700 1 --2- 172.21.15.50:0/2578914684 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f548c063840 0x7f548c065cf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f54a000a5a0 tx=0x7f54a000f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.806+0000 7f54a9624700 1 --2- 172.21.15.50:0/2578914684 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x5595197bd930 0x5595197d8170 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.806+0000 7f54a9624700 1 -- 172.21.15.50:0/2578914684 <== osd.6 v2:172.21.15.192:6824/36820 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f5498003450 con 0x5595197bd930 2023-11-28T11:55:41.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.806+0000 7f54ab2ee140 1 -- 172.21.15.50:0/2578914684 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x5595197bd930 msgr2=0x5595197d8170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.806+0000 7f54ab2ee140 1 --2- 172.21.15.50:0/2578914684 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x5595197bd930 0x5595197d8170 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.806+0000 7f54ab2ee140 1 -- 172.21.15.50:0/2578914684 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f548c063840 msgr2=0x7f548c065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.806+0000 7f54ab2ee140 1 --2- 172.21.15.50:0/2578914684 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f548c063840 0x7f548c065cf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f54a000a5a0 tx=0x7f54a000f000 comp rx=0 tx=0).stop 2023-11-28T11:55:41.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.806+0000 7f54ab2ee140 1 -- 172.21.15.50:0/2578914684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55951974aa90 msgr2=0x5595197bd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.806+0000 7f54ab2ee140 1 --2- 172.21.15.50:0/2578914684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55951974aa90 0x5595197bd3f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5490015040 tx=0x7f5490003020 comp rx=0 tx=0).stop 2023-11-28T11:55:41.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.806+0000 7f54a9624700 1 -- 172.21.15.50:0/2578914684 reap_dead start 2023-11-28T11:55:41.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.806+0000 7f54ab2ee140 1 -- 172.21.15.50:0/2578914684 shutdown_connections 2023-11-28T11:55:41.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.806+0000 7f54ab2ee140 1 -- 172.21.15.50:0/2578914684 >> 172.21.15.50:0/2578914684 conn(0x559519730dc0 msgr2=0x559519705540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:41.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.806+0000 7f54ab2ee140 1 -- 172.21.15.50:0/2578914684 shutdown_connections 2023-11-28T11:55:41.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.806+0000 7f54ab2ee140 1 -- 172.21.15.50:0/2578914684 wait complete. 2023-11-28T11:55:41.814 INFO:teuthology.orchestra.run.smithi050.stdout:mytag 2023-11-28T11:55:41.814 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2023-11-28T11:55:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.850+0000 7ff1e6ed8140 1 Processor -- start 2023-11-28T11:55:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.850+0000 7ff1e6ed8140 1 -- start start 2023-11-28T11:55:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e6ed8140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d41f3d87e0 0x55d41f3eb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e6ed8140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55d41f3f0a90 0x55d41f468050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e6ed8140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d41f3f0e60 0x55d41f3e9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e6ed8140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41f2cf240 con 0x55d41f3f0e60 2023-11-28T11:55:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e6ed8140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41f3d5b40 con 0x55d41f3d87e0 2023-11-28T11:55:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e6ed8140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d41f47d1c0 con 0x55d41f3f0a90 2023-11-28T11:55:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e520e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d41f3f0e60 0x55d41f3e9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e4a0d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d41f3d87e0 0x55d41f3eb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e520e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d41f3f0e60 0x55d41f3e9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33714/0 (socket says 172.21.15.50:33714) 2023-11-28T11:55:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e520e700 1 -- 172.21.15.50:0/1833053519 learned_addr learned my addr 172.21.15.50:0/1833053519 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e420c700 1 --2- 172.21.15.50:0/1833053519 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55d41f3f0a90 0x55d41f468050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e520e700 1 -- 172.21.15.50:0/1833053519 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55d41f3f0a90 msgr2=0x55d41f468050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e520e700 1 --2- 172.21.15.50:0/1833053519 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55d41f3f0a90 0x55d41f468050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e520e700 1 -- 172.21.15.50:0/1833053519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d41f3d87e0 msgr2=0x55d41f3eb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e520e700 1 --2- 172.21.15.50:0/1833053519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d41f3d87e0 0x55d41f3eb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e520e700 1 -- 172.21.15.50:0/1833053519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc005de0 con 0x55d41f3f0e60 2023-11-28T11:55:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e4a0d700 1 --2- 172.21.15.50:0/1833053519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d41f3d87e0 0x55d41f3eb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e520e700 1 --2- 172.21.15.50:0/1833053519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d41f3f0e60 0x55d41f3e9650 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4001d30 tx=0x7ff1d400b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1f5d8861ee9591 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e320a700 1 -- 172.21.15.50:0/1833053519 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4014070 con 0x55d41f3f0e60 2023-11-28T11:55:41.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e320a700 1 -- 172.21.15.50:0/1833053519 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d4008030 con 0x55d41f3f0e60 2023-11-28T11:55:41.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e320a700 1 -- 172.21.15.50:0/1833053519 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d400bc80 con 0x55d41f3f0e60 2023-11-28T11:55:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e6ed8140 1 -- 172.21.15.50:0/1833053519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d41f3f0e60 msgr2=0x55d41f3e9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.854+0000 7ff1e6ed8140 1 --2- 172.21.15.50:0/1833053519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d41f3f0e60 0x55d41f3e9650 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4001d30 tx=0x7ff1d400b4c0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e6ed8140 1 -- 172.21.15.50:0/1833053519 shutdown_connections 2023-11-28T11:55:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e6ed8140 1 --2- 172.21.15.50:0/1833053519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d41f3f0e60 0x55d41f3e9650 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e6ed8140 1 --2- 172.21.15.50:0/1833053519 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55d41f3f0a90 0x55d41f468050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e6ed8140 1 --2- 172.21.15.50:0/1833053519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d41f3d87e0 0x55d41f3eb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e6ed8140 1 -- 172.21.15.50:0/1833053519 >> 172.21.15.50:0/1833053519 conn(0x55d41f3d6dc0 msgr2=0x55d41f3ab540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e6ed8140 1 -- 172.21.15.50:0/1833053519 shutdown_connections 2023-11-28T11:55:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e6ed8140 1 -- 172.21.15.50:0/1833053519 wait complete. 2023-11-28T11:55:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e6ed8140 1 Processor -- start 2023-11-28T11:55:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e6ed8140 1 -- start start 2023-11-28T11:55:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e6ed8140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d41f3d87e0 0x55d41f3cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e6ed8140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d41f3f0a90 0x55d41f3ed490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e6ed8140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55d41f3f0e60 0x55d41f462e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e6ed8140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41f3a7730 con 0x55d41f3d87e0 2023-11-28T11:55:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e6ed8140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41f3a79d0 con 0x55d41f3f0a90 2023-11-28T11:55:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e6ed8140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d41f3a7c70 con 0x55d41f3f0e60 2023-11-28T11:55:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e4a0d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d41f3d87e0 0x55d41f3cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e4a0d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d41f3d87e0 0x55d41f3cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33724/0 (socket says 172.21.15.50:33724) 2023-11-28T11:55:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e4a0d700 1 -- 172.21.15.50:0/576988582 learned_addr learned my addr 172.21.15.50:0/576988582 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e420c700 1 --2- 172.21.15.50:0/576988582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d41f3f0a90 0x55d41f3ed490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e520e700 1 --2- 172.21.15.50:0/576988582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55d41f3f0e60 0x55d41f462e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e4a0d700 1 -- 172.21.15.50:0/576988582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55d41f3f0e60 msgr2=0x55d41f462e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e4a0d700 1 --2- 172.21.15.50:0/576988582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55d41f3f0e60 0x55d41f462e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e4a0d700 1 -- 172.21.15.50:0/576988582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d41f3f0a90 msgr2=0x55d41f3ed490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e4a0d700 1 --2- 172.21.15.50:0/576988582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d41f3f0a90 0x55d41f3ed490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e4a0d700 1 -- 172.21.15.50:0/576988582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d41f301760 con 0x55d41f3d87e0 2023-11-28T11:55:41.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e420c700 1 --2- 172.21.15.50:0/576988582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d41f3f0a90 0x55d41f3ed490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:41.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e4a0d700 1 --2- 172.21.15.50:0/576988582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d41f3d87e0 0x55d41f3cfca0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc000c00 tx=0x7ff1dc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e2208700 1 -- 172.21.15.50:0/576988582 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc008690 con 0x55d41f3d87e0 2023-11-28T11:55:41.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e2208700 1 -- 172.21.15.50:0/576988582 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc020070 con 0x55d41f3d87e0 2023-11-28T11:55:41.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e6ed8140 1 -- 172.21.15.50:0/576988582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d400a040 con 0x55d41f3d87e0 2023-11-28T11:55:41.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e2208700 1 -- 172.21.15.50:0/576988582 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc01ca90 con 0x55d41f3d87e0 2023-11-28T11:55:41.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.858+0000 7ff1e6ed8140 1 -- 172.21.15.50:0/576988582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d41f2e7390 con 0x55d41f3d87e0 2023-11-28T11:55:41.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.862+0000 7ff1e2208700 1 -- 172.21.15.50:0/576988582 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff1dc01cbf0 con 0x55d41f3d87e0 2023-11-28T11:55:41.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.862+0000 7ff1e2208700 1 --2- 172.21.15.50:0/576988582 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff1c4063840 0x7ff1c4065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.862+0000 7ff1e2208700 1 -- 172.21.15.50:0/576988582 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7ff1dc082770 con 0x55d41f3d87e0 2023-11-28T11:55:41.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.862+0000 7ff1e420c700 1 --2- 172.21.15.50:0/576988582 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff1c4063840 0x7ff1c4065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.862+0000 7ff1e6ed8140 1 --2- 172.21.15.50:0/576988582 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x55d41f3abbc0 0x55d41f3a8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:41.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.862+0000 7ff1e6ed8140 1 -- 172.21.15.50:0/576988582 --> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] -- osd_op(unknown.0.0:1 7.12 7:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) v8 -- 0x55d41f3a8b90 con 0x55d41f3abbc0 2023-11-28T11:55:41.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.862+0000 7ff1e520e700 1 --2- 172.21.15.50:0/576988582 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x55d41f3abbc0 0x55d41f3a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:41.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.866+0000 7ff1e420c700 1 --2- 172.21.15.50:0/576988582 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff1c4063840 0x7ff1c4065cf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc005fd0 tx=0x7ff1cc007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.866+0000 7ff1e520e700 1 --2- 172.21.15.50:0/576988582 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x55d41f3abbc0 0x55d41f3a8650 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:41.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.866+0000 7ff1e520e700 1 -- 172.21.15.50:0/576988582 <== osd.6 v2:172.21.15.192:6824/36820 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7ff1d4016070 con 0x55d41f3abbc0 2023-11-28T11:55:41.869 INFO:teuthology.orchestra.run.smithi050.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2023-11-28T11:55:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.866+0000 7ff1e6ed8140 1 -- 172.21.15.50:0/576988582 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x55d41f3abbc0 msgr2=0x55d41f3a8650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.866+0000 7ff1e6ed8140 1 --2- 172.21.15.50:0/576988582 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x55d41f3abbc0 0x55d41f3a8650 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.866+0000 7ff1e6ed8140 1 -- 172.21.15.50:0/576988582 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff1c4063840 msgr2=0x7ff1c4065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.866+0000 7ff1e6ed8140 1 --2- 172.21.15.50:0/576988582 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff1c4063840 0x7ff1c4065cf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc005fd0 tx=0x7ff1cc007040 comp rx=0 tx=0).stop 2023-11-28T11:55:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.866+0000 7ff1e6ed8140 1 -- 172.21.15.50:0/576988582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d41f3d87e0 msgr2=0x55d41f3cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.866+0000 7ff1e6ed8140 1 --2- 172.21.15.50:0/576988582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d41f3d87e0 0x55d41f3cfca0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc000c00 tx=0x7ff1dc002fb0 comp rx=0 tx=0).stop 2023-11-28T11:55:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.866+0000 7ff1e520e700 1 -- 172.21.15.50:0/576988582 reap_dead start 2023-11-28T11:55:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.866+0000 7ff1e6ed8140 1 -- 172.21.15.50:0/576988582 shutdown_connections 2023-11-28T11:55:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.866+0000 7ff1e6ed8140 1 -- 172.21.15.50:0/576988582 >> 172.21.15.50:0/576988582 conn(0x55d41f3d6dc0 msgr2=0x55d41f466580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.866+0000 7ff1e6ed8140 1 -- 172.21.15.50:0/576988582 shutdown_connections 2023-11-28T11:55:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:41.866+0000 7ff1e6ed8140 1 -- 172.21.15.50:0/576988582 wait complete. 2023-11-28T11:55:41.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:55:41.873 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:55:41.873 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:55:41.891 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:55:41.911 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:55:41.911 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:55:41.911 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:55:41.919 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349436k,nr_inodes=4087359,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20953 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276116k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:55:41.919 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T11:55:41.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:41.919 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T11:55:41.969 INFO:teuthology.orchestra.run.smithi050.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-28T11:55:41.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:55:41.970 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:55:41.970 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:55:41.978 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17871 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:55:41.978 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T11:55:41.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:41.978 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T11:55:42.028 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-28T11:55:42.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:55:42.029 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:55:42.029 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:55:42.037 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349436k,nr_inodes=4087359,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20953 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276116k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:55:42.037 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T11:55:42.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:42.038 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T11:55:42.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:55:42.087 INFO:teuthology.orchestra.run.smithi050.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-28T11:55:42.087 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:55:42.088 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:55:42.095 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17871 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:55:42.096 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T11:55:42.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:55:42.096 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T11:55:42.103 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-28T11:55:42.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:55:42.104 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:55:42.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.226+0000 7f68493a5700 1 Processor -- start 2023-11-28T11:55:42.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.226+0000 7f68493a5700 1 -- start start 2023-11-28T11:55:42.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.226+0000 7f68493a5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f68440b1ca0 0x7f68440b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:42.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.226+0000 7f68493a5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f684406a330 0x7f68440cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:42.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.226+0000 7f68493a5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68440cf070 con 0x7f68440d2780 2023-11-28T11:55:42.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.226+0000 7f68493a5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68440b2070 con 0x7f68440b1ca0 2023-11-28T11:55:42.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.226+0000 7f68493a5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684406a8a0 con 0x7f684406a330 2023-11-28T11:55:42.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.226+0000 7f6848ba4700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f68440d2780 0x7f68440cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51308/0 (socket says 172.21.15.50:51308) 2023-11-28T11:55:42.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.226+0000 7f6848ba4700 1 -- 172.21.15.50:0/3670953095 learned_addr learned my addr 172.21.15.50:0/3670953095 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:42.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.226+0000 7f68437fe700 1 --2- 172.21.15.50:0/3670953095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f684406a330 0x7f68440cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:42.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.226+0000 7f6843fff700 1 --2- 172.21.15.50:0/3670953095 >> v2:172.21.15.192:3300/0 conn(0x7f68440b1ca0 0x7f68440b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:42.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f6842ffd700 1 -- 172.21.15.50:0/3670953095 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195077935 0 0) 0x7f68440cf070 con 0x7f68440d2780 2023-11-28T11:55:42.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f6842ffd700 1 -- 172.21.15.50:0/3670953095 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f682c0035d0 con 0x7f68440d2780 2023-11-28T11:55:42.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f68437fe700 1 -- 172.21.15.50:0/3670953095 >> v2:172.21.15.192:3300/0 conn(0x7f68440b1ca0 msgr2=0x7f68440b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:42.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f68437fe700 1 --2- 172.21.15.50:0/3670953095 >> v2:172.21.15.192:3300/0 conn(0x7f68440b1ca0 0x7f68440b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f68437fe700 1 -- 172.21.15.50:0/3670953095 >> v1:172.21.15.50:6789/0 conn(0x7f68440d2780 legacy=0x7f68440cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:42.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f68437fe700 1 -- 172.21.15.50:0/3670953095 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684406ab80 con 0x7f684406a330 2023-11-28T11:55:42.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f68437fe700 1 --2- 172.21.15.50:0/3670953095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f684406a330 0x7f68440cce40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6834009850 tx=0x7f6834009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c1d9e01c86d1e42 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:42.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f6842ffd700 1 -- 172.21.15.50:0/3670953095 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6834011830 con 0x7f684406a330 2023-11-28T11:55:42.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f6842ffd700 1 -- 172.21.15.50:0/3670953095 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6834011990 con 0x7f684406a330 2023-11-28T11:55:42.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f6842ffd700 1 -- 172.21.15.50:0/3670953095 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6834011d00 con 0x7f684406a330 2023-11-28T11:55:42.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f68493a5700 1 -- 172.21.15.50:0/3670953095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f684406a330 msgr2=0x7f68440cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:42.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f68493a5700 1 --2- 172.21.15.50:0/3670953095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f684406a330 0x7f68440cce40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6834009850 tx=0x7f6834009b60 comp rx=0 tx=0).stop 2023-11-28T11:55:42.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f68493a5700 1 -- 172.21.15.50:0/3670953095 shutdown_connections 2023-11-28T11:55:42.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f68493a5700 1 --2- 172.21.15.50:0/3670953095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f684406a330 0x7f68440cce40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f68493a5700 1 --2- 172.21.15.50:0/3670953095 >> v2:172.21.15.192:3300/0 conn(0x7f68440b1ca0 0x7f68440b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f68493a5700 1 -- 172.21.15.50:0/3670953095 >> 172.21.15.50:0/3670953095 conn(0x7f68440b5740 msgr2=0x7f68440b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:42.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f68493a5700 1 -- 172.21.15.50:0/3670953095 shutdown_connections 2023-11-28T11:55:42.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f68493a5700 1 -- 172.21.15.50:0/3670953095 wait complete. 2023-11-28T11:55:42.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.230+0000 7f68493a5700 1 Processor -- start 2023-11-28T11:55:42.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f68493a5700 1 -- start start 2023-11-28T11:55:42.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f68493a5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f684406a330 0x7f68440c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:42.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f68493a5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68440b1ca0 0x7f68440b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:42.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f68493a5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68440d2780 0x7f68440b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:42.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f68493a5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684415ea70 con 0x7f68440d2780 2023-11-28T11:55:42.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f68493a5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684415ddf0 con 0x7f68440b1ca0 2023-11-28T11:55:42.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f68493a5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684415e0d0 con 0x7f684406a330 2023-11-28T11:55:42.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f6848ba4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68440d2780 0x7f68440b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:42.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f68437fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68440b1ca0 0x7f68440b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:42.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f6843fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f684406a330 0x7f68440c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:42.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f6848ba4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68440d2780 0x7f68440b7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33728/0 (socket says 172.21.15.50:33728) 2023-11-28T11:55:42.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f6848ba4700 1 -- 172.21.15.50:0/1715132654 learned_addr learned my addr 172.21.15.50:0/1715132654 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:42.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f6848ba4700 1 -- 172.21.15.50:0/1715132654 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f684406a330 msgr2=0x7f68440c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:42.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f6848ba4700 1 --2- 172.21.15.50:0/1715132654 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f684406a330 0x7f68440c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f6848ba4700 1 -- 172.21.15.50:0/1715132654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68440b1ca0 msgr2=0x7f68440b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:42.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f6848ba4700 1 --2- 172.21.15.50:0/1715132654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68440b1ca0 0x7f68440b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f6848ba4700 1 -- 172.21.15.50:0/1715132654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68340094b0 con 0x7f68440d2780 2023-11-28T11:55:42.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f6848ba4700 1 --2- 172.21.15.50:0/1715132654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68440d2780 0x7f68440b7790 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f683c00cb10 tx=0x7f683c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:42.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f6840ff9700 1 -- 172.21.15.50:0/1715132654 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c007480 con 0x7f68440d2780 2023-11-28T11:55:42.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f6840ff9700 1 -- 172.21.15.50:0/1715132654 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c0075e0 con 0x7f68440d2780 2023-11-28T11:55:42.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f68493a5700 1 -- 172.21.15.50:0/1715132654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684406b140 con 0x7f68440d2780 2023-11-28T11:55:42.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f6840ff9700 1 -- 172.21.15.50:0/1715132654 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c007970 con 0x7f68440d2780 2023-11-28T11:55:42.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.234+0000 7f68493a5700 1 -- 172.21.15.50:0/1715132654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684406ae60 con 0x7f68440d2780 2023-11-28T11:55:42.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.238+0000 7f6840ff9700 1 -- 172.21.15.50:0/1715132654 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f683c019030 con 0x7f68440d2780 2023-11-28T11:55:42.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.238+0000 7f68493a5700 1 -- 172.21.15.50:0/1715132654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68440cd380 con 0x7f68440d2780 2023-11-28T11:55:42.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.238+0000 7f6840ff9700 1 --2- 172.21.15.50:0/1715132654 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6830064ee0 0x7f6830067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:42.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.238+0000 7f6840ff9700 1 -- 172.21.15.50:0/1715132654 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f683c081910 con 0x7f68440d2780 2023-11-28T11:55:42.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.238+0000 7f6843fff700 1 --2- 172.21.15.50:0/1715132654 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6830064ee0 0x7f6830067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:42.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.242+0000 7f6843fff700 1 --2- 172.21.15.50:0/1715132654 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6830064ee0 0x7f6830067390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6838009b50 tx=0x7f6838009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:42.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.246+0000 7f6840ff9700 1 -- 172.21.15.50:0/1715132654 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f683c04f840 con 0x7f68440d2780 2023-11-28T11:55:42.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.446+0000 7f68493a5700 1 -- 172.21.15.50:0/1715132654 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f684415ebb0 con 0x7f68440d2780 2023-11-28T11:55:42.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.446+0000 7f6840ff9700 1 -- 172.21.15.50:0/1715132654 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f684415ebb0 con 0x7f68440d2780 2023-11-28T11:55:42.450 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:42.450 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2392153383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2392153383},{"type":"v1","addr":"172.21.15.192:6837","nonce":2392153383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5515,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3694451276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3694451276},{"type":"v1","addr":"172.21.15.192:6835","nonce":3694451276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2782289763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2782289763},{"type":"v1","addr":"172.21.15.50:6833","nonce":2782289763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:55:06.200530+0000","modified":"2023-11-28T11:55:09.218769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5559},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5559":{"gid":5559,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2320802269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2320802269},{"type":"v1","addr":"172.21.15.50:6835","nonce":2320802269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:55:42.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.450+0000 7f68493a5700 1 -- 172.21.15.50:0/1715132654 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6830064ee0 msgr2=0x7f6830067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:42.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.450+0000 7f68493a5700 1 --2- 172.21.15.50:0/1715132654 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6830064ee0 0x7f6830067390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6838009b50 tx=0x7f6838009240 comp rx=0 tx=0).stop 2023-11-28T11:55:42.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.450+0000 7f68493a5700 1 -- 172.21.15.50:0/1715132654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68440d2780 msgr2=0x7f68440b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:42.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.450+0000 7f68493a5700 1 --2- 172.21.15.50:0/1715132654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68440d2780 0x7f68440b7790 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f683c00cb10 tx=0x7f683c00cb40 comp rx=0 tx=0).stop 2023-11-28T11:55:42.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.450+0000 7f68493a5700 1 -- 172.21.15.50:0/1715132654 shutdown_connections 2023-11-28T11:55:42.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.450+0000 7f68493a5700 1 --2- 172.21.15.50:0/1715132654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f68440d2780 0x7f68440b7790 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.450+0000 7f68493a5700 1 --2- 172.21.15.50:0/1715132654 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6830064ee0 0x7f6830067390 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.450+0000 7f68493a5700 1 --2- 172.21.15.50:0/1715132654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68440b1ca0 0x7f68440b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.450+0000 7f68493a5700 1 --2- 172.21.15.50:0/1715132654 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f684406a330 0x7f68440c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.450+0000 7f68493a5700 1 -- 172.21.15.50:0/1715132654 >> 172.21.15.50:0/1715132654 conn(0x7f68440b5740 msgr2=0x7f68440d2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:42.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.450+0000 7f68493a5700 1 -- 172.21.15.50:0/1715132654 shutdown_connections 2023-11-28T11:55:42.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.450+0000 7f68493a5700 1 -- 172.21.15.50:0/1715132654 wait complete. 2023-11-28T11:55:42.457 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-11-28T11:55:42.469 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:55:42.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.586+0000 7f10771af700 1 Processor -- start 2023-11-28T11:55:42.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.586+0000 7f10771af700 1 -- start start 2023-11-28T11:55:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10771af700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10700cc360 0x7f10700cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10771af700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f10700cd000 0x7f10700cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:42.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10771af700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10700cd980 con 0x7f10701607b0 2023-11-28T11:55:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10771af700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10700d04c0 con 0x7f10700cc360 2023-11-28T11:55:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10771af700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107015d460 con 0x7f10700cd000 2023-11-28T11:55:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10761ad700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10700cc360 0x7f10700cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10761ad700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f10700cc360 0x7f10700cfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33732/0 (socket says 172.21.15.50:33732) 2023-11-28T11:55:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10761ad700 1 -- 172.21.15.50:0/2911651968 learned_addr learned my addr 172.21.15.50:0/2911651968 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10769ae700 1 --2- 172.21.15.50:0/2911651968 >> v2:172.21.15.192:3300/0 conn(0x7f10700cd000 0x7f10700cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10761ad700 1 -- 172.21.15.50:0/2911651968 >> v2:172.21.15.192:3300/0 conn(0x7f10700cd000 msgr2=0x7f10700cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10761ad700 1 --2- 172.21.15.50:0/2911651968 >> v2:172.21.15.192:3300/0 conn(0x7f10700cd000 0x7f10700cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10761ad700 1 -- 172.21.15.50:0/2911651968 >> v1:172.21.15.192:6789/0 conn(0x7f10701607b0 legacy=0x7f10700ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:42.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10761ad700 1 -- 172.21.15.50:0/2911651968 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10700cc730 con 0x7f10700cc360 2023-11-28T11:55:42.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10761ad700 1 --2- 172.21.15.50:0/2911651968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700cc360 0x7f10700cfbd0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1070066220 tx=0x7f106c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5e2a7ce0f90035 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:42.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10751ab700 1 -- 172.21.15.50:0/2911651968 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c00b8a0 con 0x7f10700cc360 2023-11-28T11:55:42.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10751ab700 1 -- 172.21.15.50:0/2911651968 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c00ba00 con 0x7f10700cc360 2023-11-28T11:55:42.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10751ab700 1 -- 172.21.15.50:0/2911651968 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c00bd90 con 0x7f10700cc360 2023-11-28T11:55:42.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10771af700 1 -- 172.21.15.50:0/2911651968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700cc360 msgr2=0x7f10700cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:42.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10771af700 1 --2- 172.21.15.50:0/2911651968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700cc360 0x7f10700cfbd0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1070066220 tx=0x7f106c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10771af700 1 -- 172.21.15.50:0/2911651968 shutdown_connections 2023-11-28T11:55:42.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10771af700 1 --2- 172.21.15.50:0/2911651968 >> v2:172.21.15.192:3300/0 conn(0x7f10700cd000 0x7f10700cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10771af700 1 --2- 172.21.15.50:0/2911651968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700cc360 0x7f10700cfbd0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10771af700 1 -- 172.21.15.50:0/2911651968 >> 172.21.15.50:0/2911651968 conn(0x7f10700b2140 msgr2=0x7f10700b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:42.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10771af700 1 -- 172.21.15.50:0/2911651968 shutdown_connections 2023-11-28T11:55:42.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.590+0000 7f10771af700 1 -- 172.21.15.50:0/2911651968 wait complete. 2023-11-28T11:55:42.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10771af700 1 Processor -- start 2023-11-28T11:55:42.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10771af700 1 -- start start 2023-11-28T11:55:42.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10771af700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10700cc360 0x7f10701f4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:42.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10771af700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700cd000 0x7f1070158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:42.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10771af700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10701607b0 0x7f10701f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:42.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10771af700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10701f1b10 con 0x7f10700cd000 2023-11-28T11:55:42.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10771af700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10701f5280 con 0x7f10700cc360 2023-11-28T11:55:42.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10771af700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10701f5520 con 0x7f10701607b0 2023-11-28T11:55:42.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10759ac700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700cd000 0x7f1070158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:42.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10759ac700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700cd000 0x7f1070158c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33740/0 (socket says 172.21.15.50:33740) 2023-11-28T11:55:42.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10759ac700 1 -- 172.21.15.50:0/2503959039 learned_addr learned my addr 172.21.15.50:0/2503959039 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:42.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10769ae700 1 --2- 172.21.15.50:0/2503959039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10701607b0 0x7f10701f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:42.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10761ad700 1 --2- 172.21.15.50:0/2503959039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10700cc360 0x7f10701f4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:42.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10759ac700 1 -- 172.21.15.50:0/2503959039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10701607b0 msgr2=0x7f10701f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:42.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10759ac700 1 --2- 172.21.15.50:0/2503959039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10701607b0 0x7f10701f1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10759ac700 1 -- 172.21.15.50:0/2503959039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10700cc360 msgr2=0x7f10701f4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:42.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10759ac700 1 --2- 172.21.15.50:0/2503959039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10700cc360 0x7f10701f4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10759ac700 1 -- 172.21.15.50:0/2503959039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c009570 con 0x7f10700cd000 2023-11-28T11:55:42.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10769ae700 1 --2- 172.21.15.50:0/2503959039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10701607b0 0x7f10701f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:42.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10759ac700 1 --2- 172.21.15.50:0/2503959039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700cd000 0x7f1070158c50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1060001eb0 tx=0x7f106000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:42.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f1066ffd700 1 -- 172.21.15.50:0/2503959039 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10600052d0 con 0x7f10700cd000 2023-11-28T11:55:42.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10771af700 1 -- 172.21.15.50:0/2503959039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10700d01e0 con 0x7f10700cd000 2023-11-28T11:55:42.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f1066ffd700 1 -- 172.21.15.50:0/2503959039 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1060005450 con 0x7f10700cd000 2023-11-28T11:55:42.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f10771af700 1 -- 172.21.15.50:0/2503959039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10700b1f30 con 0x7f10700cd000 2023-11-28T11:55:42.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.594+0000 7f1066ffd700 1 -- 172.21.15.50:0/2503959039 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060006a80 con 0x7f10700cd000 2023-11-28T11:55:42.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.598+0000 7f10771af700 1 -- 172.21.15.50:0/2503959039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107015fcd0 con 0x7f10700cd000 2023-11-28T11:55:42.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.598+0000 7f1066ffd700 1 -- 172.21.15.50:0/2503959039 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1060010050 con 0x7f10700cd000 2023-11-28T11:55:42.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.598+0000 7f1066ffd700 1 --2- 172.21.15.50:0/2503959039 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1054064ee0 0x7f1054067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:42.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.598+0000 7f1066ffd700 1 -- 172.21.15.50:0/2503959039 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f1060081330 con 0x7f10700cd000 2023-11-28T11:55:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.598+0000 7f10761ad700 1 --2- 172.21.15.50:0/2503959039 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1054064ee0 0x7f1054067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.598+0000 7f10761ad700 1 --2- 172.21.15.50:0/2503959039 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1054064ee0 0x7f1054067390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f106c000c00 tx=0x7f106c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:42.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.606+0000 7f1066ffd700 1 -- 172.21.15.50:0/2503959039 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1060049400 con 0x7f10700cd000 2023-11-28T11:55:42.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.774+0000 7f10771af700 1 -- 172.21.15.50:0/2503959039 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1070072500 con 0x7f10700cd000 2023-11-28T11:55:42.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.778+0000 7f1066ffd700 1 -- 172.21.15.50:0/2503959039 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18066 (secure 0 0 0) 0x7f106004f1e0 con 0x7f10700cd000 2023-11-28T11:55:42.782 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:42.782 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":42,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:55:30.325177+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:55:03.889842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T11:55:05.177617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.37","mappings":[{"from":0,"to":5}]},{"pgid":"7.38","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:55:42.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.782+0000 7f10771af700 1 -- 172.21.15.50:0/2503959039 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1054064ee0 msgr2=0x7f1054067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:42.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.782+0000 7f10771af700 1 --2- 172.21.15.50:0/2503959039 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1054064ee0 0x7f1054067390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f106c000c00 tx=0x7f106c008030 comp rx=0 tx=0).stop 2023-11-28T11:55:42.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.782+0000 7f10771af700 1 -- 172.21.15.50:0/2503959039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700cd000 msgr2=0x7f1070158c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:42.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.782+0000 7f10771af700 1 --2- 172.21.15.50:0/2503959039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700cd000 0x7f1070158c50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1060001eb0 tx=0x7f106000c860 comp rx=0 tx=0).stop 2023-11-28T11:55:42.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.782+0000 7f10771af700 1 -- 172.21.15.50:0/2503959039 shutdown_connections 2023-11-28T11:55:42.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.782+0000 7f10771af700 1 --2- 172.21.15.50:0/2503959039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10701607b0 0x7f10701f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.782+0000 7f10771af700 1 --2- 172.21.15.50:0/2503959039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10700cd000 0x7f1070158c50 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.782+0000 7f10771af700 1 --2- 172.21.15.50:0/2503959039 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1054064ee0 0x7f1054067390 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.782+0000 7f10771af700 1 --2- 172.21.15.50:0/2503959039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10700cc360 0x7f10701f4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.782+0000 7f10771af700 1 -- 172.21.15.50:0/2503959039 >> 172.21.15.50:0/2503959039 conn(0x7f10700b2140 msgr2=0x7f107015f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:42.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.782+0000 7f10771af700 1 -- 172.21.15.50:0/2503959039 shutdown_connections 2023-11-28T11:55:42.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.782+0000 7f10771af700 1 -- 172.21.15.50:0/2503959039 wait complete. 2023-11-28T11:55:42.797 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:55:03.889842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:55:05.177617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:55:42.798 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:55:42.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a280c700 1 Processor -- start 2023-11-28T11:55:42.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a280c700 1 -- start start 2023-11-28T11:55:42.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a280c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f369c06a4c0 0x7f369c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:42.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a280c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369c06a9c0 con 0x7f369c0b1ae0 2023-11-28T11:55:42.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a280c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369c06aca0 con 0x7f369c0cf0e0 2023-11-28T11:55:42.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a280c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f369c0d0ab0 con 0x7f369c06a4c0 2023-11-28T11:55:42.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a1009700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f369c06a4c0 0x7f369c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:42.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a180a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f369c0b1ae0 0x7f369c0d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51310/0 (socket says 172.21.15.50:51310) 2023-11-28T11:55:42.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a180a700 1 -- 172.21.15.50:0/825941228 learned_addr learned my addr 172.21.15.50:0/825941228 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a0808700 1 -- 172.21.15.50:0/825941228 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914822077 0 0) 0x7f369c06a9c0 con 0x7f369c0b1ae0 2023-11-28T11:55:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a1009700 1 -- 172.21.15.50:0/825941228 >> v1:172.21.15.192:6789/0 conn(0x7f369c0cf0e0 legacy=0x7f369c0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a1009700 1 -- 172.21.15.50:0/825941228 >> v1:172.21.15.50:6789/0 conn(0x7f369c0b1ae0 legacy=0x7f369c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a1009700 1 -- 172.21.15.50:0/825941228 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c06af80 con 0x7f369c06a4c0 2023-11-28T11:55:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a1009700 1 --2- 172.21.15.50:0/825941228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f369c06a4c0 0x7f369c06d8e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f368c009850 tx=0x7f368c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec22f99027ed77e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a0808700 1 -- 172.21.15.50:0/825941228 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c011830 con 0x7f369c06a4c0 2023-11-28T11:55:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a0808700 1 -- 172.21.15.50:0/825941228 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368c011990 con 0x7f369c06a4c0 2023-11-28T11:55:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a0808700 1 -- 172.21.15.50:0/825941228 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c011d20 con 0x7f369c06a4c0 2023-11-28T11:55:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a280c700 1 -- 172.21.15.50:0/825941228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f369c06a4c0 msgr2=0x7f369c06d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a280c700 1 --2- 172.21.15.50:0/825941228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f369c06a4c0 0x7f369c06d8e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f368c009850 tx=0x7f368c009b60 comp rx=0 tx=0).stop 2023-11-28T11:55:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a280c700 1 -- 172.21.15.50:0/825941228 shutdown_connections 2023-11-28T11:55:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.918+0000 7f36a280c700 1 --2- 172.21.15.50:0/825941228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f369c06a4c0 0x7f369c06d8e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.922+0000 7f36a280c700 1 -- 172.21.15.50:0/825941228 >> 172.21.15.50:0/825941228 conn(0x7f369c09bbd0 msgr2=0x7f369c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.922+0000 7f36a280c700 1 -- 172.21.15.50:0/825941228 shutdown_connections 2023-11-28T11:55:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.922+0000 7f36a280c700 1 -- 172.21.15.50:0/825941228 wait complete. 2023-11-28T11:55:42.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.922+0000 7f36a280c700 1 Processor -- start 2023-11-28T11:55:42.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.922+0000 7f36a280c700 1 -- start start 2023-11-28T11:55:42.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a280c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f369c06a4c0 0x7f369c15eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:42.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a280c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f369c0b1ae0 0x7f369c15f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:42.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a280c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f369c0cf0e0 0x7f369c09fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:42.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a280c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c14d940 con 0x7f369c0cf0e0 2023-11-28T11:55:42.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a280c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c14ad00 con 0x7f369c06a4c0 2023-11-28T11:55:42.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a280c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369c14afe0 con 0x7f369c0b1ae0 2023-11-28T11:55:42.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a200b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f369c0cf0e0 0x7f369c09fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:42.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a200b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f369c0cf0e0 0x7f369c09fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33756/0 (socket says 172.21.15.50:33756) 2023-11-28T11:55:42.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a200b700 1 -- 172.21.15.50:0/827732234 learned_addr learned my addr 172.21.15.50:0/827732234 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:42.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a180a700 1 --2- 172.21.15.50:0/827732234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f369c06a4c0 0x7f369c15eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:42.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a1009700 1 --2- 172.21.15.50:0/827732234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f369c0b1ae0 0x7f369c15f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:42.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a200b700 1 -- 172.21.15.50:0/827732234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f369c0b1ae0 msgr2=0x7f369c15f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:42.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a200b700 1 --2- 172.21.15.50:0/827732234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f369c0b1ae0 0x7f369c15f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a200b700 1 -- 172.21.15.50:0/827732234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f369c06a4c0 msgr2=0x7f369c15eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:42.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a200b700 1 --2- 172.21.15.50:0/827732234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f369c06a4c0 0x7f369c15eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:42.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a200b700 1 -- 172.21.15.50:0/827732234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c0094b0 con 0x7f369c0cf0e0 2023-11-28T11:55:42.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a200b700 1 --2- 172.21.15.50:0/827732234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f369c0cf0e0 0x7f369c09fb30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f369400cc50 tx=0x7f369400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:42.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36927fc700 1 -- 172.21.15.50:0/827732234 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3694003c20 con 0x7f369c0cf0e0 2023-11-28T11:55:42.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36927fc700 1 -- 172.21.15.50:0/827732234 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3694003d80 con 0x7f369c0cf0e0 2023-11-28T11:55:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36927fc700 1 -- 172.21.15.50:0/827732234 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369400ab60 con 0x7f369c0cf0e0 2023-11-28T11:55:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a280c700 1 -- 172.21.15.50:0/827732234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369c0b1eb0 con 0x7f369c0cf0e0 2023-11-28T11:55:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a280c700 1 -- 172.21.15.50:0/827732234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369c0b4380 con 0x7f369c0cf0e0 2023-11-28T11:55:42.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36a280c700 1 -- 172.21.15.50:0/827732234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f369c0b60e0 con 0x7f369c0cf0e0 2023-11-28T11:55:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.926+0000 7f36927fc700 1 -- 172.21.15.50:0/827732234 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3694010050 con 0x7f369c0cf0e0 2023-11-28T11:55:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.930+0000 7f36927fc700 1 --2- 172.21.15.50:0/827732234 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3680064ee0 0x7f3680067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.930+0000 7f36927fc700 1 -- 172.21.15.50:0/827732234 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f3694081f10 con 0x7f369c0cf0e0 2023-11-28T11:55:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.930+0000 7f36a180a700 1 --2- 172.21.15.50:0/827732234 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3680064ee0 0x7f3680067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.930+0000 7f36a180a700 1 --2- 172.21.15.50:0/827732234 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3680064ee0 0x7f3680067390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3698000f60 tx=0x7f3698004a70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:42.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:42.934+0000 7f36927fc700 1 -- 172.21.15.50:0/827732234 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f369404ff30 con 0x7f369c0cf0e0 2023-11-28T11:55:43.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.098+0000 7f36a280c700 1 -- 172.21.15.50:0/827732234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f369c14b500 con 0x7f369c0cf0e0 2023-11-28T11:55:43.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.098+0000 7f36927fc700 1 -- 172.21.15.50:0/827732234 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7f369c14b500 con 0x7f369c0cf0e0 2023-11-28T11:55:43.100 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:55:43.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.098+0000 7f36a280c700 1 -- 172.21.15.50:0/827732234 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3680064ee0 msgr2=0x7f3680067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.098+0000 7f36a280c700 1 --2- 172.21.15.50:0/827732234 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3680064ee0 0x7f3680067390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3698000f60 tx=0x7f3698004a70 comp rx=0 tx=0).stop 2023-11-28T11:55:43.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.098+0000 7f36a280c700 1 -- 172.21.15.50:0/827732234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f369c0cf0e0 msgr2=0x7f369c09fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.098+0000 7f36a280c700 1 --2- 172.21.15.50:0/827732234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f369c0cf0e0 0x7f369c09fb30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f369400cc50 tx=0x7f369400cf60 comp rx=0 tx=0).stop 2023-11-28T11:55:43.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.098+0000 7f36a280c700 1 -- 172.21.15.50:0/827732234 shutdown_connections 2023-11-28T11:55:43.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.098+0000 7f36a280c700 1 --2- 172.21.15.50:0/827732234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f369c0cf0e0 0x7f369c09fb30 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.098+0000 7f36a280c700 1 --2- 172.21.15.50:0/827732234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f369c0b1ae0 0x7f369c15f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.098+0000 7f36a280c700 1 --2- 172.21.15.50:0/827732234 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3680064ee0 0x7f3680067390 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.098+0000 7f36a280c700 1 --2- 172.21.15.50:0/827732234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f369c06a4c0 0x7f369c15eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.098+0000 7f36a280c700 1 -- 172.21.15.50:0/827732234 >> 172.21.15.50:0/827732234 conn(0x7f369c09bbd0 msgr2=0x7f369c0af370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:43.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.098+0000 7f36a280c700 1 -- 172.21.15.50:0/827732234 shutdown_connections 2023-11-28T11:55:43.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.098+0000 7f36a280c700 1 -- 172.21.15.50:0/827732234 wait complete. 2023-11-28T11:55:43.115 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:55:43.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.234+0000 7f96ef59e700 1 Processor -- start 2023-11-28T11:55:43.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.234+0000 7f96ef59e700 1 -- start start 2023-11-28T11:55:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.234+0000 7f96ef59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f96f0162d80 0x7f96f0165160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.234+0000 7f96ef59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f00cb050 con 0x7f96f00b2110 2023-11-28T11:55:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.234+0000 7f96ef59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f015da00 con 0x7f96f00cf740 2023-11-28T11:55:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.234+0000 7f96ef59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f015dc50 con 0x7f96f0162d80 2023-11-28T11:55:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.234+0000 7f96ee59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f96f00b2110 0x7f96f00cfdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51318/0 (socket says 172.21.15.50:51318) 2023-11-28T11:55:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.234+0000 7f96ee59c700 1 -- 172.21.15.50:0/2523276746 learned_addr learned my addr 172.21.15.50:0/2523276746 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:43.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.234+0000 7f96eed9d700 1 --2- 172.21.15.50:0/2523276746 >> v2:172.21.15.50:3300/0 conn(0x7f96f0162d80 0x7f96f0165160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.238+0000 7f96eed9d700 1 -- 172.21.15.50:0/2523276746 >> v1:172.21.15.192:6789/0 conn(0x7f96f00cf740 legacy=0x7f96f00b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.238+0000 7f96eed9d700 1 -- 172.21.15.50:0/2523276746 >> v1:172.21.15.50:6789/0 conn(0x7f96f00b2110 legacy=0x7f96f00cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.238+0000 7f96eed9d700 1 -- 172.21.15.50:0/2523276746 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f015df30 con 0x7f96f0162d80 2023-11-28T11:55:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.238+0000 7f96eed9d700 1 --2- 172.21.15.50:0/2523276746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96f0162d80 0x7f96f0165160 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009d90 tx=0x7f96e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801c39357970f745 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.238+0000 7f96ed59a700 1 -- 172.21.15.50:0/2523276746 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e800e070 con 0x7f96f0162d80 2023-11-28T11:55:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.238+0000 7f96ed59a700 1 -- 172.21.15.50:0/2523276746 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e800bbd0 con 0x7f96f0162d80 2023-11-28T11:55:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.238+0000 7f96ed59a700 1 -- 172.21.15.50:0/2523276746 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e8012430 con 0x7f96f0162d80 2023-11-28T11:55:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.238+0000 7f96ef59e700 1 -- 172.21.15.50:0/2523276746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96f0162d80 msgr2=0x7f96f0165160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.238+0000 7f96ef59e700 1 --2- 172.21.15.50:0/2523276746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96f0162d80 0x7f96f0165160 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009d90 tx=0x7f96e800b330 comp rx=0 tx=0).stop 2023-11-28T11:55:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.238+0000 7f96ef59e700 1 -- 172.21.15.50:0/2523276746 shutdown_connections 2023-11-28T11:55:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.238+0000 7f96ef59e700 1 --2- 172.21.15.50:0/2523276746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96f0162d80 0x7f96f0165160 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.238+0000 7f96ef59e700 1 -- 172.21.15.50:0/2523276746 >> 172.21.15.50:0/2523276746 conn(0x7f96f00cd0a0 msgr2=0x7f96f00cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.238+0000 7f96ef59e700 1 -- 172.21.15.50:0/2523276746 shutdown_connections 2023-11-28T11:55:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.238+0000 7f96ef59e700 1 -- 172.21.15.50:0/2523276746 wait complete. 2023-11-28T11:55:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ef59e700 1 Processor -- start 2023-11-28T11:55:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ef59e700 1 -- start start 2023-11-28T11:55:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ef59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96f00b2110 0x7f96f00b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ef59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96f00cf740 0x7f96f0158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ef59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96f0162d80 0x7f96f0158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ef59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f01f0ff0 con 0x7f96f00b2110 2023-11-28T11:55:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ef59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f014fc30 con 0x7f96f0162d80 2023-11-28T11:55:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ef59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f00c8ce0 con 0x7f96f00cf740 2023-11-28T11:55:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ee59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96f00b2110 0x7f96f00b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:43.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ee59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96f00b2110 0x7f96f00b5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33772/0 (socket says 172.21.15.50:33772) 2023-11-28T11:55:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ee59c700 1 -- 172.21.15.50:0/3142664401 learned_addr learned my addr 172.21.15.50:0/3142664401 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96eed9d700 1 --2- 172.21.15.50:0/3142664401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96f0162d80 0x7f96f0158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96edd9b700 1 --2- 172.21.15.50:0/3142664401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96f00cf740 0x7f96f0158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ee59c700 1 -- 172.21.15.50:0/3142664401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96f00cf740 msgr2=0x7f96f0158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ee59c700 1 --2- 172.21.15.50:0/3142664401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96f00cf740 0x7f96f0158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ee59c700 1 -- 172.21.15.50:0/3142664401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96f0162d80 msgr2=0x7f96f0158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ee59c700 1 --2- 172.21.15.50:0/3142664401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96f0162d80 0x7f96f0158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ee59c700 1 -- 172.21.15.50:0/3142664401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e8009a70 con 0x7f96f00b2110 2023-11-28T11:55:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96eed9d700 1 --2- 172.21.15.50:0/3142664401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96f0162d80 0x7f96f0158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ee59c700 1 --2- 172.21.15.50:0/3142664401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96f00b2110 0x7f96f00b5fd0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f96e0001eb0 tx=0x7f96e000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96e6ffd700 1 -- 172.21.15.50:0/3142664401 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e0005d90 con 0x7f96f00b2110 2023-11-28T11:55:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96e6ffd700 1 -- 172.21.15.50:0/3142664401 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e00070d0 con 0x7f96f00b2110 2023-11-28T11:55:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ef59e700 1 -- 172.21.15.50:0/3142664401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f015e4f0 con 0x7f96f00b2110 2023-11-28T11:55:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96e6ffd700 1 -- 172.21.15.50:0/3142664401 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e0007440 con 0x7f96f00b2110 2023-11-28T11:55:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.242+0000 7f96ef59e700 1 -- 172.21.15.50:0/3142664401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f015e210 con 0x7f96f00b2110 2023-11-28T11:55:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.246+0000 7f96ef59e700 1 -- 172.21.15.50:0/3142664401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f00b0e60 con 0x7f96f00b2110 2023-11-28T11:55:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.246+0000 7f96e6ffd700 1 -- 172.21.15.50:0/3142664401 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f96e0019030 con 0x7f96f00b2110 2023-11-28T11:55:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.246+0000 7f96e6ffd700 1 --2- 172.21.15.50:0/3142664401 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f96d0064ee0 0x7f96d0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.246+0000 7f96e6ffd700 1 -- 172.21.15.50:0/3142664401 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f96e0081240 con 0x7f96f00b2110 2023-11-28T11:55:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.246+0000 7f96edd9b700 1 --2- 172.21.15.50:0/3142664401 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f96d0064ee0 0x7f96d0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.246+0000 7f96edd9b700 1 --2- 172.21.15.50:0/3142664401 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f96d0064ee0 0x7f96d0067390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f96f006e500 tx=0x7f96d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:43.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.250+0000 7f96e6ffd700 1 -- 172.21.15.50:0/3142664401 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f96e004a400 con 0x7f96f00b2110 2023-11-28T11:55:43.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.414+0000 7f96ef59e700 1 -- 172.21.15.50:0/3142664401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96f0072c20 con 0x7f96f00b2110 2023-11-28T11:55:43.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.418+0000 7f96e6ffd700 1 -- 172.21.15.50:0/3142664401 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96e004f310 con 0x7f96f00b2110 2023-11-28T11:55:43.419 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:55:43.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.418+0000 7f96ef59e700 1 -- 172.21.15.50:0/3142664401 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f96d0064ee0 msgr2=0x7f96d0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.418+0000 7f96ef59e700 1 --2- 172.21.15.50:0/3142664401 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f96d0064ee0 0x7f96d0067390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f96f006e500 tx=0x7f96d8009040 comp rx=0 tx=0).stop 2023-11-28T11:55:43.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.418+0000 7f96ef59e700 1 -- 172.21.15.50:0/3142664401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96f00b2110 msgr2=0x7f96f00b5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.418+0000 7f96ef59e700 1 --2- 172.21.15.50:0/3142664401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96f00b2110 0x7f96f00b5fd0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f96e0001eb0 tx=0x7f96e000c860 comp rx=0 tx=0).stop 2023-11-28T11:55:43.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.418+0000 7f96ef59e700 1 -- 172.21.15.50:0/3142664401 shutdown_connections 2023-11-28T11:55:43.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.418+0000 7f96ef59e700 1 --2- 172.21.15.50:0/3142664401 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f96d0064ee0 0x7f96d0067390 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.418+0000 7f96ef59e700 1 --2- 172.21.15.50:0/3142664401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96f0162d80 0x7f96f0158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.418+0000 7f96ef59e700 1 --2- 172.21.15.50:0/3142664401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96f00cf740 0x7f96f0158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.418+0000 7f96ef59e700 1 --2- 172.21.15.50:0/3142664401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96f00b2110 0x7f96f00b5fd0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.418+0000 7f96ef59e700 1 -- 172.21.15.50:0/3142664401 >> 172.21.15.50:0/3142664401 conn(0x7f96f00cd0a0 msgr2=0x7f96f00cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:43.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.418+0000 7f96ef59e700 1 -- 172.21.15.50:0/3142664401 shutdown_connections 2023-11-28T11:55:43.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.418+0000 7f96ef59e700 1 -- 172.21.15.50:0/3142664401 wait complete. 2023-11-28T11:55:43.435 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:55:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.550+0000 7f23ecc11700 1 Processor -- start 2023-11-28T11:55:43.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.550+0000 7f23ecc11700 1 -- start start 2023-11-28T11:55:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.550+0000 7f23ecc11700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23e815bb80 0x7f23e80b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.550+0000 7f23ecc11700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e80ccd00 con 0x7f23e80aaf40 2023-11-28T11:55:43.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.550+0000 7f23ecc11700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e80b19b0 con 0x7f23e806b370 2023-11-28T11:55:43.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.550+0000 7f23ecc11700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e80cd510 con 0x7f23e815bb80 2023-11-28T11:55:43.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.550+0000 7f23e6ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f23e80aaf40 0x7f23e80b2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51324/0 (socket says 172.21.15.50:51324) 2023-11-28T11:55:43.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.550+0000 7f23e6ffd700 1 -- 172.21.15.50:0/3460030975 learned_addr learned my addr 172.21.15.50:0/3460030975 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:43.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.550+0000 7f23e77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23e815bb80 0x7f23e80b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:43.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.550+0000 7f23e67fc700 1 -- 172.21.15.50:0/3460030975 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871919202 0 0) 0x7f23e80ccd00 con 0x7f23e80aaf40 2023-11-28T11:55:43.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.550+0000 7f23e67fc700 1 -- 172.21.15.50:0/3460030975 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23d00046e0 con 0x7f23e80aaf40 2023-11-28T11:55:43.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.554+0000 7f23e77fe700 1 -- 172.21.15.50:0/3460030975 >> v1:172.21.15.192:6789/0 conn(0x7f23e806b370 legacy=0x7f23e815c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.554+0000 7f23e77fe700 1 -- 172.21.15.50:0/3460030975 >> v1:172.21.15.50:6789/0 conn(0x7f23e80aaf40 legacy=0x7f23e80b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.554+0000 7f23e77fe700 1 -- 172.21.15.50:0/3460030975 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e80ccf50 con 0x7f23e815bb80 2023-11-28T11:55:43.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.554+0000 7f23e77fe700 1 --2- 172.21.15.50:0/3460030975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e815bb80 0x7f23e80b2450 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009850 tx=0x7f23dc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52111090746a160c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:43.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.554+0000 7f23e67fc700 1 -- 172.21.15.50:0/3460030975 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc011830 con 0x7f23e815bb80 2023-11-28T11:55:43.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.554+0000 7f23e67fc700 1 -- 172.21.15.50:0/3460030975 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc011990 con 0x7f23e815bb80 2023-11-28T11:55:43.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.554+0000 7f23e67fc700 1 -- 172.21.15.50:0/3460030975 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc011d40 con 0x7f23e815bb80 2023-11-28T11:55:43.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.554+0000 7f23ecc11700 1 -- 172.21.15.50:0/3460030975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e815bb80 msgr2=0x7f23e80b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.554+0000 7f23ecc11700 1 --2- 172.21.15.50:0/3460030975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e815bb80 0x7f23e80b2450 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009850 tx=0x7f23dc009b60 comp rx=0 tx=0).stop 2023-11-28T11:55:43.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.554+0000 7f23ecc11700 1 -- 172.21.15.50:0/3460030975 shutdown_connections 2023-11-28T11:55:43.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.554+0000 7f23ecc11700 1 --2- 172.21.15.50:0/3460030975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e815bb80 0x7f23e80b2450 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.554+0000 7f23ecc11700 1 -- 172.21.15.50:0/3460030975 >> 172.21.15.50:0/3460030975 conn(0x7f23e80cae70 msgr2=0x7f23e80cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:43.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.554+0000 7f23ecc11700 1 -- 172.21.15.50:0/3460030975 shutdown_connections 2023-11-28T11:55:43.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.554+0000 7f23ecc11700 1 -- 172.21.15.50:0/3460030975 wait complete. 2023-11-28T11:55:43.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.554+0000 7f23ecc11700 1 Processor -- start 2023-11-28T11:55:43.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.554+0000 7f23ecc11700 1 -- start start 2023-11-28T11:55:43.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23ecc11700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e806b370 0x7f23e8159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:43.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23ecc11700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23e80aaf40 0x7f23e815a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:43.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23ecc11700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23e815bb80 0x7f23e80ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:43.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23ecc11700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e815b040 con 0x7f23e806b370 2023-11-28T11:55:43.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23ecc11700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e8098dc0 con 0x7f23e80aaf40 2023-11-28T11:55:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23ecc11700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80990a0 con 0x7f23e815bb80 2023-11-28T11:55:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23e77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e806b370 0x7f23e8159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23e77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e806b370 0x7f23e8159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33786/0 (socket says 172.21.15.50:33786) 2023-11-28T11:55:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23e77fe700 1 -- 172.21.15.50:0/2868157954 learned_addr learned my addr 172.21.15.50:0/2868157954 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23e6ffd700 1 --2- 172.21.15.50:0/2868157954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23e80aaf40 0x7f23e815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23e7fff700 1 --2- 172.21.15.50:0/2868157954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23e815bb80 0x7f23e80ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23e77fe700 1 -- 172.21.15.50:0/2868157954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23e815bb80 msgr2=0x7f23e80ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23e77fe700 1 --2- 172.21.15.50:0/2868157954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23e815bb80 0x7f23e80ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23e77fe700 1 -- 172.21.15.50:0/2868157954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23e80aaf40 msgr2=0x7f23e815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23e77fe700 1 --2- 172.21.15.50:0/2868157954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23e80aaf40 0x7f23e815a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23e77fe700 1 -- 172.21.15.50:0/2868157954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc0094b0 con 0x7f23e806b370 2023-11-28T11:55:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23e77fe700 1 --2- 172.21.15.50:0/2868157954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e806b370 0x7f23e8159ab0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f23dc000c00 tx=0x7f23dc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23cffff700 1 -- 172.21.15.50:0/2868157954 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc01aac0 con 0x7f23e806b370 2023-11-28T11:55:43.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23ecc11700 1 -- 172.21.15.50:0/2868157954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e80b1c50 con 0x7f23e806b370 2023-11-28T11:55:43.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23cffff700 1 -- 172.21.15.50:0/2868157954 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc01f070 con 0x7f23e806b370 2023-11-28T11:55:43.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23cffff700 1 -- 172.21.15.50:0/2868157954 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc01ae60 con 0x7f23e806b370 2023-11-28T11:55:43.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23ecc11700 1 -- 172.21.15.50:0/2868157954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e80cd230 con 0x7f23e806b370 2023-11-28T11:55:43.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.558+0000 7f23ecc11700 1 -- 172.21.15.50:0/2868157954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e80b1f30 con 0x7f23e806b370 2023-11-28T11:55:43.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.562+0000 7f23cffff700 1 -- 172.21.15.50:0/2868157954 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f23dc00f050 con 0x7f23e806b370 2023-11-28T11:55:43.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.562+0000 7f23cffff700 1 --2- 172.21.15.50:0/2868157954 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f23d4064ee0 0x7f23d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:43.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.562+0000 7f23cffff700 1 -- 172.21.15.50:0/2868157954 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f23dc083230 con 0x7f23e806b370 2023-11-28T11:55:43.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.562+0000 7f23e6ffd700 1 --2- 172.21.15.50:0/2868157954 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f23d4064ee0 0x7f23d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:43.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.562+0000 7f23e6ffd700 1 --2- 172.21.15.50:0/2868157954 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f23d4064ee0 0x7f23d4067390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f23e80ceff0 tx=0x7f23d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:43.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.570+0000 7f23cffff700 1 -- 172.21.15.50:0/2868157954 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f23dc0511d0 con 0x7f23e806b370 2023-11-28T11:55:43.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.742+0000 7f23ecc11700 1 -- 172.21.15.50:0/2868157954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f23e8072500 con 0x7f23e806b370 2023-11-28T11:55:43.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.742+0000 7f23cffff700 1 -- 172.21.15.50:0/2868157954 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f23dc0547f0 con 0x7f23e806b370 2023-11-28T11:55:43.744 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:55:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.742+0000 7f23ecc11700 1 -- 172.21.15.50:0/2868157954 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f23d4064ee0 msgr2=0x7f23d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.742+0000 7f23ecc11700 1 --2- 172.21.15.50:0/2868157954 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f23d4064ee0 0x7f23d4067390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f23e80ceff0 tx=0x7f23d8009040 comp rx=0 tx=0).stop 2023-11-28T11:55:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.742+0000 7f23ecc11700 1 -- 172.21.15.50:0/2868157954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e806b370 msgr2=0x7f23e8159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.742+0000 7f23ecc11700 1 --2- 172.21.15.50:0/2868157954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e806b370 0x7f23e8159ab0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f23dc000c00 tx=0x7f23dc004770 comp rx=0 tx=0).stop 2023-11-28T11:55:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.742+0000 7f23ecc11700 1 -- 172.21.15.50:0/2868157954 shutdown_connections 2023-11-28T11:55:43.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.742+0000 7f23ecc11700 1 --2- 172.21.15.50:0/2868157954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23e815bb80 0x7f23e80ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.742+0000 7f23ecc11700 1 --2- 172.21.15.50:0/2868157954 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f23d4064ee0 0x7f23d4067390 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.742+0000 7f23ecc11700 1 --2- 172.21.15.50:0/2868157954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23e80aaf40 0x7f23e815a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.742+0000 7f23ecc11700 1 --2- 172.21.15.50:0/2868157954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23e806b370 0x7f23e8159ab0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.742+0000 7f23ecc11700 1 -- 172.21.15.50:0/2868157954 >> 172.21.15.50:0/2868157954 conn(0x7f23e80cae70 msgr2=0x7f23e80add50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:43.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.742+0000 7f23ecc11700 1 -- 172.21.15.50:0/2868157954 shutdown_connections 2023-11-28T11:55:43.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.742+0000 7f23ecc11700 1 -- 172.21.15.50:0/2868157954 wait complete. 2023-11-28T11:55:43.759 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:55:43.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.878+0000 7ff570c6a700 1 Processor -- start 2023-11-28T11:55:43.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.878+0000 7ff570c6a700 1 -- start start 2023-11-28T11:55:43.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.878+0000 7ff570c6a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff56c06ce60 0x7ff56c0b8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:43.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.878+0000 7ff570c6a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff56c0cf110 0x7ff56c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:43.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.878+0000 7ff570c6a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c0d0460 con 0x7ff56c0d1e30 2023-11-28T11:55:43.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.878+0000 7ff570c6a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c0d3390 con 0x7ff56c0cf110 2023-11-28T11:55:43.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.878+0000 7ff570c6a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c0d2380 con 0x7ff56c06ce60 2023-11-28T11:55:43.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.878+0000 7ff56bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff56c0cf110 0x7ff56c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:43.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.878+0000 7ff56affd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff56c0d1e30 0x7ff56c06d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51334/0 (socket says 172.21.15.50:51334) 2023-11-28T11:55:43.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.878+0000 7ff56affd700 1 -- 172.21.15.50:0/3126676385 learned_addr learned my addr 172.21.15.50:0/3126676385 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:43.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.878+0000 7ff56b7fe700 1 --2- 172.21.15.50:0/3126676385 >> v2:172.21.15.192:3300/0 conn(0x7ff56c06ce60 0x7ff56c0b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:43.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.878+0000 7ff56bfff700 1 -- 172.21.15.50:0/3126676385 >> v2:172.21.15.192:3300/0 conn(0x7ff56c06ce60 msgr2=0x7ff56c0b8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:43.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.878+0000 7ff56bfff700 1 --2- 172.21.15.50:0/3126676385 >> v2:172.21.15.192:3300/0 conn(0x7ff56c06ce60 0x7ff56c0b8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.878+0000 7ff56bfff700 1 -- 172.21.15.50:0/3126676385 >> v1:172.21.15.50:6789/0 conn(0x7ff56c0d1e30 legacy=0x7ff56c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.878+0000 7ff56bfff700 1 -- 172.21.15.50:0/3126676385 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c0d2f00 con 0x7ff56c0cf110 2023-11-28T11:55:43.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.878+0000 7ff56bfff700 1 --2- 172.21.15.50:0/3126676385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c0cf110 0x7ff56c0cf550 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff56c08b820 tx=0x7ff56400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ae2d0cf96913e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:43.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.882+0000 7ff56a7fc700 1 -- 172.21.15.50:0/3126676385 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56400e070 con 0x7ff56c0cf110 2023-11-28T11:55:43.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.882+0000 7ff56a7fc700 1 -- 172.21.15.50:0/3126676385 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56400bbd0 con 0x7ff56c0cf110 2023-11-28T11:55:43.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.882+0000 7ff56a7fc700 1 -- 172.21.15.50:0/3126676385 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564012430 con 0x7ff56c0cf110 2023-11-28T11:55:43.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.882+0000 7ff570c6a700 1 -- 172.21.15.50:0/3126676385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c0cf110 msgr2=0x7ff56c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.882+0000 7ff570c6a700 1 --2- 172.21.15.50:0/3126676385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c0cf110 0x7ff56c0cf550 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff56c08b820 tx=0x7ff56400b330 comp rx=0 tx=0).stop 2023-11-28T11:55:43.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.882+0000 7ff570c6a700 1 -- 172.21.15.50:0/3126676385 shutdown_connections 2023-11-28T11:55:43.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.882+0000 7ff570c6a700 1 --2- 172.21.15.50:0/3126676385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c0cf110 0x7ff56c0cf550 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.882+0000 7ff570c6a700 1 --2- 172.21.15.50:0/3126676385 >> v2:172.21.15.192:3300/0 conn(0x7ff56c06ce60 0x7ff56c0b8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.882+0000 7ff570c6a700 1 -- 172.21.15.50:0/3126676385 >> 172.21.15.50:0/3126676385 conn(0x7ff56c09bbd0 msgr2=0x7ff56c0b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:43.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.882+0000 7ff570c6a700 1 -- 172.21.15.50:0/3126676385 shutdown_connections 2023-11-28T11:55:43.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.882+0000 7ff570c6a700 1 -- 172.21.15.50:0/3126676385 wait complete. 2023-11-28T11:55:43.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.882+0000 7ff570c6a700 1 Processor -- start 2023-11-28T11:55:43.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.882+0000 7ff570c6a700 1 -- start start 2023-11-28T11:55:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff570c6a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c06ce60 0x7ff56c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff570c6a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff56c0cf110 0x7ff56c0b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff570c6a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff56c0d1e30 0x7ff56c14bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff570c6a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0c9150 con 0x7ff56c06ce60 2023-11-28T11:55:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff570c6a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0c82a0 con 0x7ff56c0cf110 2023-11-28T11:55:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff570c6a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0c8540 con 0x7ff56c0d1e30 2023-11-28T11:55:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff56b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c06ce60 0x7ff56c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff56b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c06ce60 0x7ff56c15df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33812/0 (socket says 172.21.15.50:33812) 2023-11-28T11:55:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff56b7fe700 1 -- 172.21.15.50:0/1522678115 learned_addr learned my addr 172.21.15.50:0/1522678115 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff56bfff700 1 --2- 172.21.15.50:0/1522678115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff56c0d1e30 0x7ff56c14bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff56affd700 1 --2- 172.21.15.50:0/1522678115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff56c0cf110 0x7ff56c0b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff56b7fe700 1 -- 172.21.15.50:0/1522678115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff56c0d1e30 msgr2=0x7ff56c14bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff56b7fe700 1 --2- 172.21.15.50:0/1522678115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff56c0d1e30 0x7ff56c14bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff56b7fe700 1 -- 172.21.15.50:0/1522678115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff56c0cf110 msgr2=0x7ff56c0b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:43.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff56b7fe700 1 --2- 172.21.15.50:0/1522678115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff56c0cf110 0x7ff56c0b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:43.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff56b7fe700 1 -- 172.21.15.50:0/1522678115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff564009a70 con 0x7ff56c06ce60 2023-11-28T11:55:43.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff56b7fe700 1 --2- 172.21.15.50:0/1522678115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c06ce60 0x7ff56c15df80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff56000d800 tx=0x7ff56000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:43.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff553fff700 1 -- 172.21.15.50:0/1522678115 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5600125f0 con 0x7ff56c06ce60 2023-11-28T11:55:43.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff553fff700 1 -- 172.21.15.50:0/1522678115 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff560012750 con 0x7ff56c06ce60 2023-11-28T11:55:43.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff570c6a700 1 -- 172.21.15.50:0/1522678115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56c0d25d0 con 0x7ff56c06ce60 2023-11-28T11:55:43.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff553fff700 1 -- 172.21.15.50:0/1522678115 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff560012ac0 con 0x7ff56c06ce60 2023-11-28T11:55:43.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff570c6a700 1 -- 172.21.15.50:0/1522678115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c15c700 con 0x7ff56c06ce60 2023-11-28T11:55:43.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.886+0000 7ff570c6a700 1 -- 172.21.15.50:0/1522678115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56c0d28b0 con 0x7ff56c06ce60 2023-11-28T11:55:43.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.890+0000 7ff553fff700 1 -- 172.21.15.50:0/1522678115 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff560012c20 con 0x7ff56c06ce60 2023-11-28T11:55:43.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.890+0000 7ff553fff700 1 --2- 172.21.15.50:0/1522678115 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff558064ee0 0x7ff558067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:43.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.890+0000 7ff553fff700 1 -- 172.21.15.50:0/1522678115 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7ff560082d50 con 0x7ff56c06ce60 2023-11-28T11:55:43.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.890+0000 7ff56affd700 1 --2- 172.21.15.50:0/1522678115 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff558064ee0 0x7ff558067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:43.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.890+0000 7ff56affd700 1 --2- 172.21.15.50:0/1522678115 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff558064ee0 0x7ff558067390 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff56c152510 tx=0x7ff55c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:43.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:43.898+0000 7ff553fff700 1 -- 172.21.15.50:0/1522678115 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff560050d70 con 0x7ff56c06ce60 2023-11-28T11:55:44.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.058+0000 7ff570c6a700 1 -- 172.21.15.50:0/1522678115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff56c072500 con 0x7ff56c06ce60 2023-11-28T11:55:44.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.058+0000 7ff553fff700 1 -- 172.21.15.50:0/1522678115 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff560054390 con 0x7ff56c06ce60 2023-11-28T11:55:44.061 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:55:44.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.058+0000 7ff570c6a700 1 -- 172.21.15.50:0/1522678115 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff558064ee0 msgr2=0x7ff558067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:44.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.058+0000 7ff570c6a700 1 --2- 172.21.15.50:0/1522678115 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff558064ee0 0x7ff558067390 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff56c152510 tx=0x7ff55c009040 comp rx=0 tx=0).stop 2023-11-28T11:55:44.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.058+0000 7ff570c6a700 1 -- 172.21.15.50:0/1522678115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c06ce60 msgr2=0x7ff56c15df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:44.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.058+0000 7ff570c6a700 1 --2- 172.21.15.50:0/1522678115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c06ce60 0x7ff56c15df80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff56000d800 tx=0x7ff56000db10 comp rx=0 tx=0).stop 2023-11-28T11:55:44.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.058+0000 7ff570c6a700 1 -- 172.21.15.50:0/1522678115 shutdown_connections 2023-11-28T11:55:44.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.058+0000 7ff570c6a700 1 --2- 172.21.15.50:0/1522678115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff56c0d1e30 0x7ff56c14bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.058+0000 7ff570c6a700 1 --2- 172.21.15.50:0/1522678115 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff558064ee0 0x7ff558067390 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.058+0000 7ff570c6a700 1 --2- 172.21.15.50:0/1522678115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff56c0cf110 0x7ff56c0b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.058+0000 7ff570c6a700 1 --2- 172.21.15.50:0/1522678115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff56c06ce60 0x7ff56c15df80 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.058+0000 7ff570c6a700 1 -- 172.21.15.50:0/1522678115 >> 172.21.15.50:0/1522678115 conn(0x7ff56c09bbd0 msgr2=0x7ff56c06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:44.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.062+0000 7ff570c6a700 1 -- 172.21.15.50:0/1522678115 shutdown_connections 2023-11-28T11:55:44.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.062+0000 7ff570c6a700 1 -- 172.21.15.50:0/1522678115 wait complete. 2023-11-28T11:55:44.075 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:55:44.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4ffff700 1 Processor -- start 2023-11-28T11:55:44.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4ffff700 1 -- start start 2023-11-28T11:55:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fce50159e70 0x7fce5006c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce50069c40 0x7fce500cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fce5006cee0 0x7fce500cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4ffff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce5006ace0 con 0x7fce50159e70 2023-11-28T11:55:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4ffff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce5006a0d0 con 0x7fce5006cee0 2023-11-28T11:55:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4ffff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5006a3b0 con 0x7fce50069c40 2023-11-28T11:55:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fce50159e70 0x7fce5006c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fce50159e70 0x7fce5006c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33814/0 (socket says 172.21.15.50:33814) 2023-11-28T11:55:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4effd700 1 -- 172.21.15.50:0/2852857098 learned_addr learned my addr 172.21.15.50:0/2852857098 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:44.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4e7fc700 1 --2- 172.21.15.50:0/2852857098 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce50069c40 0x7fce500cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4f7fe700 1 --2- 172.21.15.50:0/2852857098 >> v2:172.21.15.192:3300/0 conn(0x7fce5006cee0 0x7fce500cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4effd700 1 -- 172.21.15.50:0/2852857098 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce50069c40 msgr2=0x7fce500cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4effd700 1 --2- 172.21.15.50:0/2852857098 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce50069c40 0x7fce500cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4effd700 1 -- 172.21.15.50:0/2852857098 >> v2:172.21.15.192:3300/0 conn(0x7fce5006cee0 msgr2=0x7fce500cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4effd700 1 --2- 172.21.15.50:0/2852857098 >> v2:172.21.15.192:3300/0 conn(0x7fce5006cee0 0x7fce500cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4effd700 1 -- 172.21.15.50:0/2852857098 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5006a690 con 0x7fce50159e70 2023-11-28T11:55:44.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4effd700 1 --2- 172.21.15.50:0/2852857098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce50159e70 0x7fce5006c9a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fce500b12c0 tx=0x7fce4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274004891ad72a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:44.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4dffb700 1 -- 172.21.15.50:0/2852857098 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000e070 con 0x7fce50159e70 2023-11-28T11:55:44.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4dffb700 1 -- 172.21.15.50:0/2852857098 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4000b9c0 con 0x7fce50159e70 2023-11-28T11:55:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4dffb700 1 -- 172.21.15.50:0/2852857098 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000bd70 con 0x7fce50159e70 2023-11-28T11:55:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4ffff700 1 -- 172.21.15.50:0/2852857098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce50159e70 msgr2=0x7fce5006c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4ffff700 1 --2- 172.21.15.50:0/2852857098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce50159e70 0x7fce5006c9a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fce500b12c0 tx=0x7fce4000b330 comp rx=0 tx=0).stop 2023-11-28T11:55:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4ffff700 1 -- 172.21.15.50:0/2852857098 shutdown_connections 2023-11-28T11:55:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4ffff700 1 --2- 172.21.15.50:0/2852857098 >> v2:172.21.15.192:3300/0 conn(0x7fce5006cee0 0x7fce500cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4ffff700 1 --2- 172.21.15.50:0/2852857098 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce50069c40 0x7fce500cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4ffff700 1 --2- 172.21.15.50:0/2852857098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce50159e70 0x7fce5006c9a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4ffff700 1 -- 172.21.15.50:0/2852857098 >> 172.21.15.50:0/2852857098 conn(0x7fce500ce3e0 msgr2=0x7fce500ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4ffff700 1 -- 172.21.15.50:0/2852857098 shutdown_connections 2023-11-28T11:55:44.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.182+0000 7fce4ffff700 1 -- 172.21.15.50:0/2852857098 wait complete. 2023-11-28T11:55:44.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4ffff700 1 Processor -- start 2023-11-28T11:55:44.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4ffff700 1 -- start start 2023-11-28T11:55:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce50069c40 0x7fce50149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce5006cee0 0x7fce5015b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce50159e70 0x7fce5015b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4ffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce500c2c70 con 0x7fce50069c40 2023-11-28T11:55:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4ffff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce500c2f50 con 0x7fce50159e70 2023-11-28T11:55:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4ffff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce500c3230 con 0x7fce5006cee0 2023-11-28T11:55:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce50069c40 0x7fce50149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce50069c40 0x7fce50149f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33816/0 (socket says 172.21.15.50:33816) 2023-11-28T11:55:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4effd700 1 -- 172.21.15.50:0/332053085 learned_addr learned my addr 172.21.15.50:0/332053085 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4e7fc700 1 --2- 172.21.15.50:0/332053085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce5006cee0 0x7fce5015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4f7fe700 1 --2- 172.21.15.50:0/332053085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce50159e70 0x7fce5015b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4effd700 1 -- 172.21.15.50:0/332053085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce5006cee0 msgr2=0x7fce5015b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:44.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4effd700 1 --2- 172.21.15.50:0/332053085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce5006cee0 0x7fce5015b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4effd700 1 -- 172.21.15.50:0/332053085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce50159e70 msgr2=0x7fce5015b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:44.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4effd700 1 --2- 172.21.15.50:0/332053085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce50159e70 0x7fce5015b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4effd700 1 -- 172.21.15.50:0/332053085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce40009b30 con 0x7fce50069c40 2023-11-28T11:55:44.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4e7fc700 1 --2- 172.21.15.50:0/332053085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce5006cee0 0x7fce5015b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:44.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.186+0000 7fce4effd700 1 --2- 172.21.15.50:0/332053085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce50069c40 0x7fce50149f90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fce4000b370 tx=0x7fce40004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:44.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.190+0000 7fce477fe700 1 -- 172.21.15.50:0/332053085 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40004250 con 0x7fce50069c40 2023-11-28T11:55:44.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.190+0000 7fce477fe700 1 -- 172.21.15.50:0/332053085 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce400043b0 con 0x7fce50069c40 2023-11-28T11:55:44.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.190+0000 7fce4ffff700 1 -- 172.21.15.50:0/332053085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5015a240 con 0x7fce50069c40 2023-11-28T11:55:44.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.190+0000 7fce477fe700 1 -- 172.21.15.50:0/332053085 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40004740 con 0x7fce50069c40 2023-11-28T11:55:44.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.190+0000 7fce4ffff700 1 -- 172.21.15.50:0/332053085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5006a970 con 0x7fce50069c40 2023-11-28T11:55:44.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.190+0000 7fce4ffff700 1 -- 172.21.15.50:0/332053085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce500b32e0 con 0x7fce50069c40 2023-11-28T11:55:44.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.190+0000 7fce477fe700 1 -- 172.21.15.50:0/332053085 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fce4001b430 con 0x7fce50069c40 2023-11-28T11:55:44.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.190+0000 7fce477fe700 1 --2- 172.21.15.50:0/332053085 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fce30064ee0 0x7fce30067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.190+0000 7fce477fe700 1 -- 172.21.15.50:0/332053085 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fce400834c0 con 0x7fce50069c40 2023-11-28T11:55:44.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.190+0000 7fce4e7fc700 1 --2- 172.21.15.50:0/332053085 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fce30064ee0 0x7fce30067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.194+0000 7fce4e7fc700 1 --2- 172.21.15.50:0/332053085 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fce30064ee0 0x7fce30067390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fce50159580 tx=0x7fce38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.198+0000 7fce477fe700 1 -- 172.21.15.50:0/332053085 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fce40051440 con 0x7fce50069c40 2023-11-28T11:55:44.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.402+0000 7fce4ffff700 1 -- 172.21.15.50:0/332053085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce50072500 con 0x7fce50069c40 2023-11-28T11:55:44.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.402+0000 7fce477fe700 1 -- 172.21.15.50:0/332053085 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fce4001f090 con 0x7fce50069c40 2023-11-28T11:55:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:44.405 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2392153383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2392153383},{"type":"v1","addr":"172.21.15.192:6837","nonce":2392153383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5515,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3694451276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3694451276},{"type":"v1","addr":"172.21.15.192:6835","nonce":3694451276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2782289763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2782289763},{"type":"v1","addr":"172.21.15.50:6833","nonce":2782289763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:55:06.200530+0000","modified":"2023-11-28T11:55:09.218769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5559},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5559":{"gid":5559,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2320802269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2320802269},{"type":"v1","addr":"172.21.15.50:6835","nonce":2320802269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:55:44.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.402+0000 7fce4ffff700 1 -- 172.21.15.50:0/332053085 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fce30064ee0 msgr2=0x7fce30067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:44.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.402+0000 7fce4ffff700 1 --2- 172.21.15.50:0/332053085 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fce30064ee0 0x7fce30067390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fce50159580 tx=0x7fce38008040 comp rx=0 tx=0).stop 2023-11-28T11:55:44.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.402+0000 7fce4ffff700 1 -- 172.21.15.50:0/332053085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce50069c40 msgr2=0x7fce50149f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:44.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.402+0000 7fce4ffff700 1 --2- 172.21.15.50:0/332053085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce50069c40 0x7fce50149f90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fce4000b370 tx=0x7fce40004af0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.406+0000 7fce4ffff700 1 -- 172.21.15.50:0/332053085 shutdown_connections 2023-11-28T11:55:44.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.406+0000 7fce4ffff700 1 --2- 172.21.15.50:0/332053085 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fce30064ee0 0x7fce30067390 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.406+0000 7fce4ffff700 1 --2- 172.21.15.50:0/332053085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce50159e70 0x7fce5015b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.406+0000 7fce4ffff700 1 --2- 172.21.15.50:0/332053085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce5006cee0 0x7fce5015b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.406+0000 7fce4ffff700 1 --2- 172.21.15.50:0/332053085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce50069c40 0x7fce50149f90 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.406+0000 7fce4ffff700 1 -- 172.21.15.50:0/332053085 >> 172.21.15.50:0/332053085 conn(0x7fce500ce3e0 msgr2=0x7fce5006fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:44.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.406+0000 7fce4ffff700 1 -- 172.21.15.50:0/332053085 shutdown_connections 2023-11-28T11:55:44.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.406+0000 7fce4ffff700 1 -- 172.21.15.50:0/332053085 wait complete. 2023-11-28T11:55:44.409 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-11-28T11:55:44.420 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:55:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3f5688700 1 Processor -- start 2023-11-28T11:55:44.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3f5688700 1 -- start start 2023-11-28T11:55:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3f5688700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3f00cd5e0 0x7fb3f0071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3f5688700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f0069c40 0x7fb3f00c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3f5688700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f00cc420 con 0x7fb3f0160680 2023-11-28T11:55:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3f5688700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f00cc6c0 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3f5688700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f00cc9a0 con 0x7fb3f0069c40 2023-11-28T11:55:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3ee7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3f00cd5e0 0x7fb3f0071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3ee7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3f00cd5e0 0x7fb3f0071260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33832/0 (socket says 172.21.15.50:33832) 2023-11-28T11:55:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3ee7fc700 1 -- 172.21.15.50:0/3297412603 learned_addr learned my addr 172.21.15.50:0/3297412603 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3ef7fe700 1 --2- 172.21.15.50:0/3297412603 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f0069c40 0x7fb3f00c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3ee7fc700 1 -- 172.21.15.50:0/3297412603 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f0069c40 msgr2=0x7fb3f00c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3ee7fc700 1 --2- 172.21.15.50:0/3297412603 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f0069c40 0x7fb3f00c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3ee7fc700 1 -- 172.21.15.50:0/3297412603 >> v1:172.21.15.192:6789/0 conn(0x7fb3f0160680 legacy=0x7fb3f00cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3ee7fc700 1 -- 172.21.15.50:0/3297412603 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f00705c0 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3ef7fe700 1 --2- 172.21.15.50:0/3297412603 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f0069c40 0x7fb3f00c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:55:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3ee7fc700 1 --2- 172.21.15.50:0/3297412603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3f00cd5e0 0x7fb3f0071260 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009e50 tx=0x7fb3e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9928db1a2df04dcf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:44.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3edffb700 1 -- 172.21.15.50:0/3297412603 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e000e070 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3edffb700 1 -- 172.21.15.50:0/3297412603 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e0003a40 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.530+0000 7fb3edffb700 1 -- 172.21.15.50:0/3297412603 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0003df0 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.534+0000 7fb3f5688700 1 -- 172.21.15.50:0/3297412603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3f00cd5e0 msgr2=0x7fb3f0071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:44.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.534+0000 7fb3f5688700 1 --2- 172.21.15.50:0/3297412603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3f00cd5e0 0x7fb3f0071260 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009e50 tx=0x7fb3e000b330 comp rx=0 tx=0).stop 2023-11-28T11:55:44.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.534+0000 7fb3f5688700 1 -- 172.21.15.50:0/3297412603 shutdown_connections 2023-11-28T11:55:44.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.534+0000 7fb3f5688700 1 --2- 172.21.15.50:0/3297412603 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f0069c40 0x7fb3f00c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.534+0000 7fb3f5688700 1 --2- 172.21.15.50:0/3297412603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3f00cd5e0 0x7fb3f0071260 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.534+0000 7fb3f5688700 1 -- 172.21.15.50:0/3297412603 >> 172.21.15.50:0/3297412603 conn(0x7fb3f006caf0 msgr2=0x7fb3f00ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:44.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.534+0000 7fb3f5688700 1 -- 172.21.15.50:0/3297412603 shutdown_connections 2023-11-28T11:55:44.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.534+0000 7fb3f5688700 1 -- 172.21.15.50:0/3297412603 wait complete. 2023-11-28T11:55:44.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.534+0000 7fb3f5688700 1 Processor -- start 2023-11-28T11:55:44.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.534+0000 7fb3f5688700 1 -- start start 2023-11-28T11:55:44.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3f5688700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f0069c40 0x7fb3f0162d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3f5688700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f00cd5e0 0x7fb3f0160d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3f5688700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3f0160680 0x7fb3f015b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3f5688700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f00c6c80 con 0x7fb3f0160680 2023-11-28T11:55:44.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3f5688700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f00c6f60 con 0x7fb3f0069c40 2023-11-28T11:55:44.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3f5688700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f00c7240 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3ef7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3f0160680 0x7fb3f015b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3ef7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3f0160680 0x7fb3f015b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33840/0 (socket says 172.21.15.50:33840) 2023-11-28T11:55:44.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3ef7fe700 1 -- 172.21.15.50:0/2170120129 learned_addr learned my addr 172.21.15.50:0/2170120129 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:44.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3ee7fc700 1 --2- 172.21.15.50:0/2170120129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f00cd5e0 0x7fb3f0160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3eeffd700 1 --2- 172.21.15.50:0/2170120129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f0069c40 0x7fb3f0162d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3ee7fc700 1 -- 172.21.15.50:0/2170120129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f0069c40 msgr2=0x7fb3f0162d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:44.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3ee7fc700 1 --2- 172.21.15.50:0/2170120129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f0069c40 0x7fb3f0162d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3ee7fc700 1 -- 172.21.15.50:0/2170120129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3f0160680 msgr2=0x7fb3f015b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:44.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3ee7fc700 1 --2- 172.21.15.50:0/2170120129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3f0160680 0x7fb3f015b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3ee7fc700 1 -- 172.21.15.50:0/2170120129 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e0009b30 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3ee7fc700 1 --2- 172.21.15.50:0/2170120129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f00cd5e0 0x7fb3f0160d00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0014000 tx=0x7fb3e0004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:44.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3d77fe700 1 -- 172.21.15.50:0/2170120129 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0004440 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3d77fe700 1 -- 172.21.15.50:0/2170120129 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e00045c0 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3d77fe700 1 -- 172.21.15.50:0/2170120129 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0004970 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3f5688700 1 -- 172.21.15.50:0/2170120129 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f00c9750 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.538+0000 7fb3f5688700 1 -- 172.21.15.50:0/2170120129 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f0071940 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.542+0000 7fb3f5688700 1 -- 172.21.15.50:0/2170120129 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f0160a50 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.542+0000 7fb3d77fe700 1 -- 172.21.15.50:0/2170120129 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb3e0022030 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.542+0000 7fb3d77fe700 1 --2- 172.21.15.50:0/2170120129 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb3dc064ee0 0x7fb3dc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.542+0000 7fb3d77fe700 1 -- 172.21.15.50:0/2170120129 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fb3e0083370 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.542+0000 7fb3eeffd700 1 --2- 172.21.15.50:0/2170120129 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb3dc064ee0 0x7fb3dc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.542+0000 7fb3eeffd700 1 --2- 172.21.15.50:0/2170120129 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb3dc064ee0 0x7fb3dc067390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009980 tx=0x7fb3e40090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:44.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.554+0000 7fb3d77fe700 1 -- 172.21.15.50:0/2170120129 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb3e0051310 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.718+0000 7fb3f5688700 1 -- 172.21.15.50:0/2170120129 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3f0072500 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.722+0000 7fb3d77fe700 1 -- 172.21.15.50:0/2170120129 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18066 (secure 0 0 0) 0x7fb3e0054930 con 0x7fb3f00cd5e0 2023-11-28T11:55:44.726 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:44.726 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":42,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:55:30.325177+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:55:03.889842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T11:55:05.177617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.37","mappings":[{"from":0,"to":5}]},{"pgid":"7.38","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:55:44.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.726+0000 7fb3f5688700 1 -- 172.21.15.50:0/2170120129 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb3dc064ee0 msgr2=0x7fb3dc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:44.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.726+0000 7fb3f5688700 1 --2- 172.21.15.50:0/2170120129 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb3dc064ee0 0x7fb3dc067390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009980 tx=0x7fb3e40090e0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.726+0000 7fb3f5688700 1 -- 172.21.15.50:0/2170120129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f00cd5e0 msgr2=0x7fb3f0160d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:44.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.726+0000 7fb3f5688700 1 --2- 172.21.15.50:0/2170120129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f00cd5e0 0x7fb3f0160d00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0014000 tx=0x7fb3e0004af0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.726+0000 7fb3f5688700 1 -- 172.21.15.50:0/2170120129 shutdown_connections 2023-11-28T11:55:44.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.726+0000 7fb3f5688700 1 --2- 172.21.15.50:0/2170120129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3f0160680 0x7fb3f015b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.726+0000 7fb3f5688700 1 --2- 172.21.15.50:0/2170120129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f00cd5e0 0x7fb3f0160d00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.726+0000 7fb3f5688700 1 --2- 172.21.15.50:0/2170120129 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb3dc064ee0 0x7fb3dc067390 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.726+0000 7fb3f5688700 1 --2- 172.21.15.50:0/2170120129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f0069c40 0x7fb3f0162d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.726+0000 7fb3f5688700 1 -- 172.21.15.50:0/2170120129 >> 172.21.15.50:0/2170120129 conn(0x7fb3f006caf0 msgr2=0x7fb3f015cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:44.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.726+0000 7fb3f5688700 1 -- 172.21.15.50:0/2170120129 shutdown_connections 2023-11-28T11:55:44.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.726+0000 7fb3f5688700 1 -- 172.21.15.50:0/2170120129 wait complete. 2023-11-28T11:55:44.746 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T11:55:44.746 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:55:44.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.858+0000 7f5f48800700 1 Processor -- start 2023-11-28T11:55:44.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.858+0000 7f5f48800700 1 -- start start 2023-11-28T11:55:44.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.858+0000 7f5f48800700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5f440c1ac0 0x7f5f44069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.858+0000 7f5f48800700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5f440ceef0 0x7f5f4406a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.858+0000 7f5f48800700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f440cae70 con 0x7f5f441606b0 2023-11-28T11:55:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.858+0000 7f5f48800700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f440cbc10 con 0x7f5f440c1ac0 2023-11-28T11:55:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.858+0000 7f5f48800700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f440cb130 con 0x7f5f440ceef0 2023-11-28T11:55:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.858+0000 7f5f4259c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5f440c1ac0 0x7f5f44069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.858+0000 7f5f42d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5f441606b0 0x7f5f440c13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51346/0 (socket says 172.21.15.50:51346) 2023-11-28T11:55:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.858+0000 7f5f4259c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5f440c1ac0 0x7f5f44069c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33850/0 (socket says 172.21.15.50:33850) 2023-11-28T11:55:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.858+0000 7f5f42d9d700 1 -- 172.21.15.50:0/3064072755 learned_addr learned my addr 172.21.15.50:0/3064072755 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:44.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.858+0000 7f5f4359e700 1 --2- 172.21.15.50:0/3064072755 >> v2:172.21.15.192:3300/0 conn(0x7f5f440ceef0 0x7f5f4406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.858+0000 7f5f4259c700 1 -- 172.21.15.50:0/3064072755 >> v2:172.21.15.192:3300/0 conn(0x7f5f440ceef0 msgr2=0x7f5f4406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.858+0000 7f5f4259c700 1 --2- 172.21.15.50:0/3064072755 >> v2:172.21.15.192:3300/0 conn(0x7f5f440ceef0 0x7f5f4406a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.858+0000 7f5f4259c700 1 -- 172.21.15.50:0/3064072755 >> v1:172.21.15.50:6789/0 conn(0x7f5f441606b0 legacy=0x7f5f440c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:44.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.858+0000 7f5f41d9b700 1 -- 172.21.15.50:0/3064072755 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164914560 0 0) 0x7f5f440cae70 con 0x7f5f441606b0 2023-11-28T11:55:44.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.858+0000 7f5f4259c700 1 -- 172.21.15.50:0/3064072755 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f440cb410 con 0x7f5f440c1ac0 2023-11-28T11:55:44.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.862+0000 7f5f4359e700 1 --2- 172.21.15.50:0/3064072755 >> v2:172.21.15.192:3300/0 conn(0x7f5f440ceef0 0x7f5f4406a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:44.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.862+0000 7f5f4259c700 1 --2- 172.21.15.50:0/3064072755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f440c1ac0 0x7f5f44069c40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5f44072100 tx=0x7f5f34009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a309272ed3478c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:44.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.862+0000 7f5f41d9b700 1 -- 172.21.15.50:0/3064072755 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34011830 con 0x7f5f440c1ac0 2023-11-28T11:55:44.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.862+0000 7f5f41d9b700 1 -- 172.21.15.50:0/3064072755 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f34011990 con 0x7f5f440c1ac0 2023-11-28T11:55:44.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.862+0000 7f5f41d9b700 1 -- 172.21.15.50:0/3064072755 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34011d20 con 0x7f5f440c1ac0 2023-11-28T11:55:44.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.862+0000 7f5f48800700 1 -- 172.21.15.50:0/3064072755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f440c1ac0 msgr2=0x7f5f44069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:44.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.862+0000 7f5f48800700 1 --2- 172.21.15.50:0/3064072755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f440c1ac0 0x7f5f44069c40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5f44072100 tx=0x7f5f34009b30 comp rx=0 tx=0).stop 2023-11-28T11:55:44.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.862+0000 7f5f48800700 1 -- 172.21.15.50:0/3064072755 shutdown_connections 2023-11-28T11:55:44.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.862+0000 7f5f48800700 1 --2- 172.21.15.50:0/3064072755 >> v2:172.21.15.192:3300/0 conn(0x7f5f440ceef0 0x7f5f4406a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.862+0000 7f5f48800700 1 --2- 172.21.15.50:0/3064072755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f440c1ac0 0x7f5f44069c40 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.862+0000 7f5f48800700 1 -- 172.21.15.50:0/3064072755 >> 172.21.15.50:0/3064072755 conn(0x7f5f440ce3e0 msgr2=0x7f5f440ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:44.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.862+0000 7f5f48800700 1 -- 172.21.15.50:0/3064072755 shutdown_connections 2023-11-28T11:55:44.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.862+0000 7f5f48800700 1 -- 172.21.15.50:0/3064072755 wait complete. 2023-11-28T11:55:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f48800700 1 Processor -- start 2023-11-28T11:55:44.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f48800700 1 -- start start 2023-11-28T11:55:44.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f48800700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f440ceef0 0x7f5f4415a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f48800700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f441606b0 0x7f5f4415e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f48800700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f4415f990 0x7f5f440ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f48800700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f441f7740 con 0x7f5f440ceef0 2023-11-28T11:55:44.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f48800700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f441f66a0 con 0x7f5f4415f990 2023-11-28T11:55:44.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f48800700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f441f6980 con 0x7f5f441606b0 2023-11-28T11:55:44.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f42d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f440ceef0 0x7f5f4415a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f42d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f440ceef0 0x7f5f4415a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33852/0 (socket says 172.21.15.50:33852) 2023-11-28T11:55:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f42d9d700 1 -- 172.21.15.50:0/672039341 learned_addr learned my addr 172.21.15.50:0/672039341 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f4359e700 1 --2- 172.21.15.50:0/672039341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f4415f990 0x7f5f440ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f42d9d700 1 -- 172.21.15.50:0/672039341 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f441606b0 msgr2=0x7f5f4415e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f4259c700 1 --2- 172.21.15.50:0/672039341 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f441606b0 0x7f5f4415e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f42d9d700 1 --2- 172.21.15.50:0/672039341 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f441606b0 0x7f5f4415e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f42d9d700 1 -- 172.21.15.50:0/672039341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f4415f990 msgr2=0x7f5f440ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f42d9d700 1 --2- 172.21.15.50:0/672039341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f4415f990 0x7f5f440ac1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f42d9d700 1 -- 172.21.15.50:0/672039341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c009a70 con 0x7f5f440ceef0 2023-11-28T11:55:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f4359e700 1 --2- 172.21.15.50:0/672039341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f4415f990 0x7f5f440ac1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:55:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f4259c700 1 --2- 172.21.15.50:0/672039341 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f441606b0 0x7f5f4415e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:55:44.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f42d9d700 1 --2- 172.21.15.50:0/672039341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f440ceef0 0x7f5f4415a780 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800c4e0 tx=0x7f5f3800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f2b7fe700 1 -- 172.21.15.50:0/672039341 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38004ca0 con 0x7f5f440ceef0 2023-11-28T11:55:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f2b7fe700 1 -- 172.21.15.50:0/672039341 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f38004e20 con 0x7f5f440ceef0 2023-11-28T11:55:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f48800700 1 -- 172.21.15.50:0/672039341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f340094b0 con 0x7f5f440ceef0 2023-11-28T11:55:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f2b7fe700 1 -- 172.21.15.50:0/672039341 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38007310 con 0x7f5f440ceef0 2023-11-28T11:55:44.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.866+0000 7f5f48800700 1 -- 172.21.15.50:0/672039341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f440b36c0 con 0x7f5f440ceef0 2023-11-28T11:55:44.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.870+0000 7f5f48800700 1 -- 172.21.15.50:0/672039341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f440cb6f0 con 0x7f5f440ceef0 2023-11-28T11:55:44.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.870+0000 7f5f2b7fe700 1 -- 172.21.15.50:0/672039341 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5f3801a020 con 0x7f5f440ceef0 2023-11-28T11:55:44.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.870+0000 7f5f2b7fe700 1 --2- 172.21.15.50:0/672039341 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5f30064f10 0x7f5f300673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:44.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.870+0000 7f5f2b7fe700 1 -- 172.21.15.50:0/672039341 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f5f38081d00 con 0x7f5f440ceef0 2023-11-28T11:55:44.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.870+0000 7f5f4259c700 1 --2- 172.21.15.50:0/672039341 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5f30064f10 0x7f5f300673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:44.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.870+0000 7f5f4259c700 1 --2- 172.21.15.50:0/672039341 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5f30064f10 0x7f5f300673c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5f440c1eb0 tx=0x7f5f34008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:44.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:44.878+0000 7f5f2b7fe700 1 -- 172.21.15.50:0/672039341 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5f3804fbd0 con 0x7f5f440ceef0 2023-11-28T11:55:45.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.074+0000 7f5f48800700 1 -- 172.21.15.50:0/672039341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f440ad610 con 0x7f5f440ceef0 2023-11-28T11:55:45.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.078+0000 7f5f2b7fe700 1 -- 172.21.15.50:0/672039341 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f5f380531f0 con 0x7f5f440ceef0 2023-11-28T11:55:45.079 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:45.079 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2392153383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2392153383},{"type":"v1","addr":"172.21.15.192:6837","nonce":2392153383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5515,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3694451276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3694451276},{"type":"v1","addr":"172.21.15.192:6835","nonce":3694451276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2782289763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2782289763},{"type":"v1","addr":"172.21.15.50:6833","nonce":2782289763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:55:06.200530+0000","modified":"2023-11-28T11:55:09.218769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5559},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5559":{"gid":5559,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2320802269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2320802269},{"type":"v1","addr":"172.21.15.50:6835","nonce":2320802269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:55:45.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.078+0000 7f5f48800700 1 -- 172.21.15.50:0/672039341 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5f30064f10 msgr2=0x7f5f300673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.078+0000 7f5f48800700 1 --2- 172.21.15.50:0/672039341 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5f30064f10 0x7f5f300673c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5f440c1eb0 tx=0x7f5f34008030 comp rx=0 tx=0).stop 2023-11-28T11:55:45.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.078+0000 7f5f48800700 1 -- 172.21.15.50:0/672039341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f440ceef0 msgr2=0x7f5f4415a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.078+0000 7f5f48800700 1 --2- 172.21.15.50:0/672039341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f440ceef0 0x7f5f4415a780 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800c4e0 tx=0x7f5f3800c8a0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.078+0000 7f5f48800700 1 -- 172.21.15.50:0/672039341 shutdown_connections 2023-11-28T11:55:45.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.078+0000 7f5f48800700 1 --2- 172.21.15.50:0/672039341 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5f30064f10 0x7f5f300673c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.078+0000 7f5f48800700 1 --2- 172.21.15.50:0/672039341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f4415f990 0x7f5f440ac1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.078+0000 7f5f48800700 1 --2- 172.21.15.50:0/672039341 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f441606b0 0x7f5f4415e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.078+0000 7f5f48800700 1 --2- 172.21.15.50:0/672039341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f440ceef0 0x7f5f4415a780 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.078+0000 7f5f48800700 1 -- 172.21.15.50:0/672039341 >> 172.21.15.50:0/672039341 conn(0x7f5f440ce3e0 msgr2=0x7f5f440aeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:45.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.078+0000 7f5f48800700 1 -- 172.21.15.50:0/672039341 shutdown_connections 2023-11-28T11:55:45.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.078+0000 7f5f48800700 1 -- 172.21.15.50:0/672039341 wait complete. 2023-11-28T11:55:45.083 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-11-28T11:55:45.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:55:45.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.202+0000 7fde3ffff700 1 Processor -- start 2023-11-28T11:55:45.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.202+0000 7fde3ffff700 1 -- start start 2023-11-28T11:55:45.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.202+0000 7fde3ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fde400cf050 0x7fde4006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.202+0000 7fde3ffff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4015c6d0 con 0x7fde4006a530 2023-11-28T11:55:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.202+0000 7fde3ffff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4006a9d0 con 0x7fde400b4c10 2023-11-28T11:55:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.202+0000 7fde3ffff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4006ac60 con 0x7fde400cf050 2023-11-28T11:55:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.202+0000 7fde3e7fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fde4006a530 0x7fde400cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51356/0 (socket says 172.21.15.50:51356) 2023-11-28T11:55:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.202+0000 7fde3e7fc700 1 -- 172.21.15.50:0/2397424378 learned_addr learned my addr 172.21.15.50:0/2397424378 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.202+0000 7fde3effd700 1 --2- 172.21.15.50:0/2397424378 >> v2:172.21.15.192:3300/0 conn(0x7fde400cf050 0x7fde4006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:45.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3dffb700 1 -- 172.21.15.50:0/2397424378 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852728549 0 0) 0x7fde4015c6d0 con 0x7fde4006a530 2023-11-28T11:55:45.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3dffb700 1 -- 172.21.15.50:0/2397424378 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde280035d0 con 0x7fde4006a530 2023-11-28T11:55:45.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3dffb700 1 -- 172.21.15.50:0/2397424378 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752699122 0 0) 0x7fde4006a9d0 con 0x7fde400b4c10 2023-11-28T11:55:45.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3dffb700 1 -- 172.21.15.50:0/2397424378 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde4015c6d0 con 0x7fde400b4c10 2023-11-28T11:55:45.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3effd700 1 -- 172.21.15.50:0/2397424378 >> v1:172.21.15.192:6789/0 conn(0x7fde400b4c10 legacy=0x7fde400cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3effd700 1 -- 172.21.15.50:0/2397424378 >> v1:172.21.15.50:6789/0 conn(0x7fde4006a530 legacy=0x7fde400cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3dffb700 1 -- 172.21.15.50:0/2397424378 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1842261826 0 0) 0x7fde280035d0 con 0x7fde4006a530 2023-11-28T11:55:45.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3effd700 1 -- 172.21.15.50:0/2397424378 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4006af40 con 0x7fde400cf050 2023-11-28T11:55:45.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3effd700 1 --2- 172.21.15.50:0/2397424378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde400cf050 0x7fde4006d7d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fde34009850 tx=0x7fde34009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dfce0b6b2181151 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3dffb700 1 -- 172.21.15.50:0/2397424378 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde30001670 con 0x7fde400cf050 2023-11-28T11:55:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3dffb700 1 -- 172.21.15.50:0/2397424378 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde34004030 con 0x7fde400cf050 2023-11-28T11:55:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3dffb700 1 -- 172.21.15.50:0/2397424378 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde340043a0 con 0x7fde400cf050 2023-11-28T11:55:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3ffff700 1 -- 172.21.15.50:0/2397424378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde400cf050 msgr2=0x7fde4006d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3ffff700 1 --2- 172.21.15.50:0/2397424378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde400cf050 0x7fde4006d7d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fde34009850 tx=0x7fde34009b60 comp rx=0 tx=0).stop 2023-11-28T11:55:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3ffff700 1 -- 172.21.15.50:0/2397424378 shutdown_connections 2023-11-28T11:55:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3ffff700 1 --2- 172.21.15.50:0/2397424378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde400cf050 0x7fde4006d7d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3ffff700 1 -- 172.21.15.50:0/2397424378 >> 172.21.15.50:0/2397424378 conn(0x7fde4009bb30 msgr2=0x7fde400b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:45.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3ffff700 1 -- 172.21.15.50:0/2397424378 shutdown_connections 2023-11-28T11:55:45.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.206+0000 7fde3ffff700 1 -- 172.21.15.50:0/2397424378 wait complete. 2023-11-28T11:55:45.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3ffff700 1 Processor -- start 2023-11-28T11:55:45.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3ffff700 1 -- start start 2023-11-28T11:55:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde4006a530 0x7fde4015f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde400b4c10 0x7fde4014fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde400cf050 0x7fde4015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3ffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde401502a0 con 0x7fde4006a530 2023-11-28T11:55:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3ffff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4015da40 con 0x7fde400b4c10 2023-11-28T11:55:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3ffff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4015ce30 con 0x7fde400cf050 2023-11-28T11:55:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde4006a530 0x7fde4015f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde4006a530 0x7fde4015f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33860/0 (socket says 172.21.15.50:33860) 2023-11-28T11:55:45.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3effd700 1 -- 172.21.15.50:0/3193806346 learned_addr learned my addr 172.21.15.50:0/3193806346 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3e7fc700 1 --2- 172.21.15.50:0/3193806346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde400b4c10 0x7fde4014fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3f7fe700 1 --2- 172.21.15.50:0/3193806346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde400cf050 0x7fde4015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3effd700 1 -- 172.21.15.50:0/3193806346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde400cf050 msgr2=0x7fde4015ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3effd700 1 --2- 172.21.15.50:0/3193806346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde400cf050 0x7fde4015ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3effd700 1 -- 172.21.15.50:0/3193806346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde400b4c10 msgr2=0x7fde4014fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3effd700 1 --2- 172.21.15.50:0/3193806346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde400b4c10 0x7fde4014fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3effd700 1 -- 172.21.15.50:0/3193806346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde340094b0 con 0x7fde4006a530 2023-11-28T11:55:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.210+0000 7fde3effd700 1 --2- 172.21.15.50:0/3193806346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde4006a530 0x7fde4015f3a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fde34000c00 tx=0x7fde34004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.214+0000 7fde277fe700 1 -- 172.21.15.50:0/3193806346 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde34003c50 con 0x7fde4006a530 2023-11-28T11:55:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.214+0000 7fde277fe700 1 -- 172.21.15.50:0/3193806346 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3401f070 con 0x7fde4006a530 2023-11-28T11:55:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.214+0000 7fde277fe700 1 -- 172.21.15.50:0/3193806346 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde34011630 con 0x7fde4006a530 2023-11-28T11:55:45.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.214+0000 7fde3ffff700 1 -- 172.21.15.50:0/3193806346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde400b46f0 con 0x7fde4006a530 2023-11-28T11:55:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.214+0000 7fde3ffff700 1 -- 172.21.15.50:0/3193806346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde400b4410 con 0x7fde4006a530 2023-11-28T11:55:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.214+0000 7fde3ffff700 1 -- 172.21.15.50:0/3193806346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde4006b220 con 0x7fde4006a530 2023-11-28T11:55:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.214+0000 7fde277fe700 1 -- 172.21.15.50:0/3193806346 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fde34017020 con 0x7fde4006a530 2023-11-28T11:55:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.214+0000 7fde277fe700 1 --2- 172.21.15.50:0/3193806346 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fde2c064f10 0x7fde2c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:45.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.214+0000 7fde277fe700 1 -- 172.21.15.50:0/3193806346 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fde34021070 con 0x7fde4006a530 2023-11-28T11:55:45.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.214+0000 7fde3e7fc700 1 --2- 172.21.15.50:0/3193806346 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fde2c064f10 0x7fde2c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:45.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.218+0000 7fde3e7fc700 1 --2- 172.21.15.50:0/3193806346 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fde2c064f10 0x7fde2c0673c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fde400b02c0 tx=0x7fde30001690 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:45.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.222+0000 7fde277fe700 1 -- 172.21.15.50:0/3193806346 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fde34051790 con 0x7fde4006a530 2023-11-28T11:55:45.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.426+0000 7fde3ffff700 1 -- 172.21.15.50:0/3193806346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde40072500 con 0x7fde4006a530 2023-11-28T11:55:45.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.426+0000 7fde277fe700 1 -- 172.21.15.50:0/3193806346 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fde3402b090 con 0x7fde4006a530 2023-11-28T11:55:45.430 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:45.430 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2392153383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2392153383},{"type":"v1","addr":"172.21.15.192:6837","nonce":2392153383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5515,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3694451276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3694451276},{"type":"v1","addr":"172.21.15.192:6835","nonce":3694451276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2782289763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2782289763},{"type":"v1","addr":"172.21.15.50:6833","nonce":2782289763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:55:06.200530+0000","modified":"2023-11-28T11:55:09.218769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5559},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5559":{"gid":5559,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/2320802269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2320802269},{"type":"v1","addr":"172.21.15.50:6835","nonce":2320802269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T11:55:45.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.430+0000 7fde3ffff700 1 -- 172.21.15.50:0/3193806346 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fde2c064f10 msgr2=0x7fde2c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.430+0000 7fde3ffff700 1 --2- 172.21.15.50:0/3193806346 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fde2c064f10 0x7fde2c0673c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fde400b02c0 tx=0x7fde30001690 comp rx=0 tx=0).stop 2023-11-28T11:55:45.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.430+0000 7fde3ffff700 1 -- 172.21.15.50:0/3193806346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde4006a530 msgr2=0x7fde4015f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.430+0000 7fde3ffff700 1 --2- 172.21.15.50:0/3193806346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde4006a530 0x7fde4015f3a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fde34000c00 tx=0x7fde34004770 comp rx=0 tx=0).stop 2023-11-28T11:55:45.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.430+0000 7fde3ffff700 1 -- 172.21.15.50:0/3193806346 shutdown_connections 2023-11-28T11:55:45.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.430+0000 7fde3ffff700 1 --2- 172.21.15.50:0/3193806346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde400cf050 0x7fde4015ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.430+0000 7fde3ffff700 1 --2- 172.21.15.50:0/3193806346 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fde2c064f10 0x7fde2c0673c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.430+0000 7fde3ffff700 1 --2- 172.21.15.50:0/3193806346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde400b4c10 0x7fde4014fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.430+0000 7fde3ffff700 1 --2- 172.21.15.50:0/3193806346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde4006a530 0x7fde4015f3a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.430+0000 7fde3ffff700 1 -- 172.21.15.50:0/3193806346 >> 172.21.15.50:0/3193806346 conn(0x7fde4009bb30 msgr2=0x7fde400b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:45.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.430+0000 7fde3ffff700 1 -- 172.21.15.50:0/3193806346 shutdown_connections 2023-11-28T11:55:45.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.430+0000 7fde3ffff700 1 -- 172.21.15.50:0/3193806346 wait complete. 2023-11-28T11:55:45.434 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-11-28T11:55:45.449 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:55:45.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.558+0000 7fb0d759e700 1 Processor -- start 2023-11-28T11:55:45.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.558+0000 7fb0d759e700 1 -- start start 2023-11-28T11:55:45.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d759e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb0d80ca310 0x7fb0d806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:45.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d8069eb0 0x7fb0d806c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:45.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0d806cbb0 0x7fb0d815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:45.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d806d000 con 0x7fb0d806cbb0 2023-11-28T11:55:45.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d759e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d80cca10 con 0x7fb0d80ca310 2023-11-28T11:55:45.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d806a670 con 0x7fb0d8069eb0 2023-11-28T11:55:45.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d6d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0d806cbb0 0x7fb0d815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:45.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d6d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0d806cbb0 0x7fb0d815b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33866/0 (socket says 172.21.15.50:33866) 2023-11-28T11:55:45.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d6d9d700 1 -- 172.21.15.50:0/36675687 learned_addr learned my addr 172.21.15.50:0/36675687 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:45.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0cffff700 1 --2- 172.21.15.50:0/36675687 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d8069eb0 0x7fb0d806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:45.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d659c700 1 --2- 172.21.15.50:0/36675687 >> v2:172.21.15.192:3300/0 conn(0x7fb0d80ca310 0x7fb0d806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:45.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d6d9d700 1 -- 172.21.15.50:0/36675687 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d8069eb0 msgr2=0x7fb0d806c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:45.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d6d9d700 1 --2- 172.21.15.50:0/36675687 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d8069eb0 0x7fb0d806c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d6d9d700 1 -- 172.21.15.50:0/36675687 >> v2:172.21.15.192:3300/0 conn(0x7fb0d80ca310 msgr2=0x7fb0d806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:45.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d6d9d700 1 --2- 172.21.15.50:0/36675687 >> v2:172.21.15.192:3300/0 conn(0x7fb0d80ca310 0x7fb0d806c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d6d9d700 1 -- 172.21.15.50:0/36675687 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d806a950 con 0x7fb0d806cbb0 2023-11-28T11:55:45.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d659c700 1 --2- 172.21.15.50:0/36675687 >> v2:172.21.15.192:3300/0 conn(0x7fb0d80ca310 0x7fb0d806c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:45.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0cffff700 1 --2- 172.21.15.50:0/36675687 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d8069eb0 0x7fb0d806c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:45.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d6d9d700 1 --2- 172.21.15.50:0/36675687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0d806cbb0 0x7fb0d815b9f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb0d806d2f0 tx=0x7fb0d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3e190026bed93e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:45.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d5d9b700 1 -- 172.21.15.50:0/36675687 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d000e070 con 0x7fb0d806cbb0 2023-11-28T11:55:45.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d5d9b700 1 -- 172.21.15.50:0/36675687 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d000b9c0 con 0x7fb0d806cbb0 2023-11-28T11:55:45.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d5d9b700 1 -- 172.21.15.50:0/36675687 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d000bd70 con 0x7fb0d806cbb0 2023-11-28T11:55:45.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d759e700 1 -- 172.21.15.50:0/36675687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0d806cbb0 msgr2=0x7fb0d815b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d759e700 1 --2- 172.21.15.50:0/36675687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0d806cbb0 0x7fb0d815b9f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb0d806d2f0 tx=0x7fb0d000b330 comp rx=0 tx=0).stop 2023-11-28T11:55:45.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d759e700 1 -- 172.21.15.50:0/36675687 shutdown_connections 2023-11-28T11:55:45.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d759e700 1 --2- 172.21.15.50:0/36675687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0d806cbb0 0x7fb0d815b9f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d759e700 1 --2- 172.21.15.50:0/36675687 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d8069eb0 0x7fb0d806c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d759e700 1 --2- 172.21.15.50:0/36675687 >> v2:172.21.15.192:3300/0 conn(0x7fb0d80ca310 0x7fb0d806c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d759e700 1 -- 172.21.15.50:0/36675687 >> 172.21.15.50:0/36675687 conn(0x7fb0d80ce3e0 msgr2=0x7fb0d80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:45.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d759e700 1 -- 172.21.15.50:0/36675687 shutdown_connections 2023-11-28T11:55:45.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.562+0000 7fb0d759e700 1 -- 172.21.15.50:0/36675687 wait complete. 2023-11-28T11:55:45.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.566+0000 7fb0d759e700 1 Processor -- start 2023-11-28T11:55:45.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.566+0000 7fb0d759e700 1 -- start start 2023-11-28T11:55:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.566+0000 7fb0d759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0d8069eb0 0x7fb0d809ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.566+0000 7fb0d759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d806cbb0 0x7fb0d8157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.566+0000 7fb0d759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d80ca310 0x7fb0d81f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.566+0000 7fb0d759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d80c6a00 con 0x7fb0d8069eb0 2023-11-28T11:55:45.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.566+0000 7fb0d759e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d809c280 con 0x7fb0d806cbb0 2023-11-28T11:55:45.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.566+0000 7fb0d759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d80c6e20 con 0x7fb0d80ca310 2023-11-28T11:55:45.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.570+0000 7fb0d659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0d8069eb0 0x7fb0d809ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:45.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.570+0000 7fb0d659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0d8069eb0 0x7fb0d809ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33870/0 (socket says 172.21.15.50:33870) 2023-11-28T11:55:45.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.570+0000 7fb0d659c700 1 -- 172.21.15.50:0/3824987394 learned_addr learned my addr 172.21.15.50:0/3824987394 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:45.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.570+0000 7fb0d6d9d700 1 --2- 172.21.15.50:0/3824987394 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d80ca310 0x7fb0d81f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:45.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.570+0000 7fb0cffff700 1 --2- 172.21.15.50:0/3824987394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d806cbb0 0x7fb0d8157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:45.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.570+0000 7fb0d659c700 1 -- 172.21.15.50:0/3824987394 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d80ca310 msgr2=0x7fb0d81f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.570+0000 7fb0d659c700 1 --2- 172.21.15.50:0/3824987394 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d80ca310 0x7fb0d81f4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.570+0000 7fb0d659c700 1 -- 172.21.15.50:0/3824987394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d806cbb0 msgr2=0x7fb0d8157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.570+0000 7fb0d659c700 1 --2- 172.21.15.50:0/3824987394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d806cbb0 0x7fb0d8157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.570+0000 7fb0d659c700 1 -- 172.21.15.50:0/3824987394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d0009b30 con 0x7fb0d8069eb0 2023-11-28T11:55:45.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.570+0000 7fb0d659c700 1 --2- 172.21.15.50:0/3824987394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0d8069eb0 0x7fb0d809ba10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb0c800e790 tx=0x7fb0c800eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.570+0000 7fb0ceffd700 1 -- 172.21.15.50:0/3824987394 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c800c070 con 0x7fb0d8069eb0 2023-11-28T11:55:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.570+0000 7fb0ceffd700 1 -- 172.21.15.50:0/3824987394 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c8004230 con 0x7fb0d8069eb0 2023-11-28T11:55:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.570+0000 7fb0d759e700 1 -- 172.21.15.50:0/3824987394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d80c8a30 con 0x7fb0d8069eb0 2023-11-28T11:55:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.570+0000 7fb0ceffd700 1 -- 172.21.15.50:0/3824987394 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80045c0 con 0x7fb0d8069eb0 2023-11-28T11:55:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.570+0000 7fb0d759e700 1 -- 172.21.15.50:0/3824987394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d806ac30 con 0x7fb0d8069eb0 2023-11-28T11:55:45.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.570+0000 7fb0d759e700 1 -- 172.21.15.50:0/3824987394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d806af10 con 0x7fb0d8069eb0 2023-11-28T11:55:45.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.574+0000 7fb0ceffd700 1 -- 172.21.15.50:0/3824987394 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb0c8019020 con 0x7fb0d8069eb0 2023-11-28T11:55:45.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.574+0000 7fb0ceffd700 1 --2- 172.21.15.50:0/3824987394 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb0bc064ee0 0x7fb0bc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:45.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.574+0000 7fb0ceffd700 1 -- 172.21.15.50:0/3824987394 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fb0c8081d40 con 0x7fb0d8069eb0 2023-11-28T11:55:45.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.574+0000 7fb0cffff700 1 --2- 172.21.15.50:0/3824987394 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb0bc064ee0 0x7fb0bc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:45.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.574+0000 7fb0cffff700 1 --2- 172.21.15.50:0/3824987394 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb0bc064ee0 0x7fb0bc067390 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb0d815cec0 tx=0x7fb0c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:45.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.578+0000 7fb0ceffd700 1 -- 172.21.15.50:0/3824987394 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb0c804fc10 con 0x7fb0d8069eb0 2023-11-28T11:55:45.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.742+0000 7fb0d759e700 1 -- 172.21.15.50:0/3824987394 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0d81e6bc0 con 0x7fb0d8069eb0 2023-11-28T11:55:45.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.746+0000 7fb0ceffd700 1 -- 172.21.15.50:0/3824987394 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18066 (secure 0 0 0) 0x7fb0c8053230 con 0x7fb0d8069eb0 2023-11-28T11:55:45.750 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:45.751 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":42,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:55:30.325177+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:55:03.889842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T11:55:05.177617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.37","mappings":[{"from":0,"to":5}]},{"pgid":"7.38","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:55:45.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.750+0000 7fb0d759e700 1 -- 172.21.15.50:0/3824987394 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb0bc064ee0 msgr2=0x7fb0bc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.750+0000 7fb0d759e700 1 --2- 172.21.15.50:0/3824987394 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb0bc064ee0 0x7fb0bc067390 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb0d815cec0 tx=0x7fb0c0008040 comp rx=0 tx=0).stop 2023-11-28T11:55:45.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.750+0000 7fb0d759e700 1 -- 172.21.15.50:0/3824987394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0d8069eb0 msgr2=0x7fb0d809ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.750+0000 7fb0d759e700 1 --2- 172.21.15.50:0/3824987394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0d8069eb0 0x7fb0d809ba10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb0c800e790 tx=0x7fb0c800eaa0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.750+0000 7fb0d759e700 1 -- 172.21.15.50:0/3824987394 shutdown_connections 2023-11-28T11:55:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.750+0000 7fb0d759e700 1 --2- 172.21.15.50:0/3824987394 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d80ca310 0x7fb0d81f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.750+0000 7fb0d759e700 1 --2- 172.21.15.50:0/3824987394 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb0bc064ee0 0x7fb0bc067390 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.750+0000 7fb0d759e700 1 --2- 172.21.15.50:0/3824987394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d806cbb0 0x7fb0d8157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.750+0000 7fb0d759e700 1 --2- 172.21.15.50:0/3824987394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0d8069eb0 0x7fb0d809ba10 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.750+0000 7fb0d759e700 1 -- 172.21.15.50:0/3824987394 >> 172.21.15.50:0/3824987394 conn(0x7fb0d80ce3e0 msgr2=0x7fb0d80c7960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.750+0000 7fb0d759e700 1 -- 172.21.15.50:0/3824987394 shutdown_connections 2023-11-28T11:55:45.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.750+0000 7fb0d759e700 1 -- 172.21.15.50:0/3824987394 wait complete. 2023-11-28T11:55:45.767 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T11:55:45.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.878+0000 7f338937e700 1 Processor -- start 2023-11-28T11:55:45.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.878+0000 7f338937e700 1 -- start start 2023-11-28T11:55:45.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f338937e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33840b32e0 0x7f33840b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:45.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f338937e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33840b3c50 con 0x7f3384159f00 2023-11-28T11:55:45.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f338937e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f338415a2d0 con 0x7f33840c91d0 2023-11-28T11:55:45.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f338937e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338406b0c0 con 0x7f33840b32e0 2023-11-28T11:55:45.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f337b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33840b32e0 0x7f33840b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:45.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f3383fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3384159f00 0x7f338406c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51370/0 (socket says 172.21.15.50:51370) 2023-11-28T11:55:45.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f3383fff700 1 -- 172.21.15.50:0/289636469 learned_addr learned my addr 172.21.15.50:0/289636469 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f337b7fe700 1 -- 172.21.15.50:0/289636469 >> v1:172.21.15.192:6789/0 conn(0x7f33840c91d0 legacy=0x7f33840c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f337b7fe700 1 -- 172.21.15.50:0/289636469 >> v1:172.21.15.50:6789/0 conn(0x7f3384159f00 legacy=0x7f338406c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f337b7fe700 1 -- 172.21.15.50:0/289636469 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338406a020 con 0x7f33840b32e0 2023-11-28T11:55:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f33837fe700 1 -- 172.21.15.50:0/289636469 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74561653 0 0) 0x7f33840b3c50 con 0x7f3384159f00 2023-11-28T11:55:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f337b7fe700 1 --2- 172.21.15.50:0/289636469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33840b32e0 0x7f33840b3710 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f336c009850 tx=0x7f336c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73f1d1fa4284259 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f33837fe700 1 -- 172.21.15.50:0/289636469 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c011830 con 0x7f33840b32e0 2023-11-28T11:55:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f33837fe700 1 -- 172.21.15.50:0/289636469 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c011990 con 0x7f33840b32e0 2023-11-28T11:55:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f33837fe700 1 -- 172.21.15.50:0/289636469 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c011d20 con 0x7f33840b32e0 2023-11-28T11:55:45.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f338937e700 1 -- 172.21.15.50:0/289636469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33840b32e0 msgr2=0x7f33840b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f338937e700 1 --2- 172.21.15.50:0/289636469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33840b32e0 0x7f33840b3710 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f336c009850 tx=0x7f336c009b60 comp rx=0 tx=0).stop 2023-11-28T11:55:45.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f338937e700 1 -- 172.21.15.50:0/289636469 shutdown_connections 2023-11-28T11:55:45.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f338937e700 1 --2- 172.21.15.50:0/289636469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33840b32e0 0x7f33840b3710 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f338937e700 1 -- 172.21.15.50:0/289636469 >> 172.21.15.50:0/289636469 conn(0x7f33840ce3e0 msgr2=0x7f33840ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:45.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f338937e700 1 -- 172.21.15.50:0/289636469 shutdown_connections 2023-11-28T11:55:45.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.882+0000 7f338937e700 1 -- 172.21.15.50:0/289636469 wait complete. 2023-11-28T11:55:45.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.886+0000 7f338937e700 1 Processor -- start 2023-11-28T11:55:45.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.886+0000 7f338937e700 1 -- start start 2023-11-28T11:55:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.886+0000 7f338937e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33840b32e0 0x7f338415cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.886+0000 7f338937e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33840c91d0 0x7f33840c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.886+0000 7f338937e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3384159f00 0x7f33840c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.886+0000 7f338937e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33840ca970 con 0x7f33840b32e0 2023-11-28T11:55:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.886+0000 7f338937e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3384156b30 con 0x7f3384159f00 2023-11-28T11:55:45.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.886+0000 7f338937e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33841f3620 con 0x7f33840c91d0 2023-11-28T11:55:45.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.886+0000 7f3383fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33840b32e0 0x7f338415cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:45.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.886+0000 7f3383fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33840b32e0 0x7f338415cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33882/0 (socket says 172.21.15.50:33882) 2023-11-28T11:55:45.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.886+0000 7f3383fff700 1 -- 172.21.15.50:0/3699193987 learned_addr learned my addr 172.21.15.50:0/3699193987 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:45.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.886+0000 7f337b7fe700 1 --2- 172.21.15.50:0/3699193987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33840c91d0 0x7f33840c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:45.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.886+0000 7f3388b7d700 1 --2- 172.21.15.50:0/3699193987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3384159f00 0x7f33840c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:45.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.890+0000 7f3383fff700 1 -- 172.21.15.50:0/3699193987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33840c91d0 msgr2=0x7f33840c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.890+0000 7f3383fff700 1 --2- 172.21.15.50:0/3699193987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33840c91d0 0x7f33840c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.890+0000 7f3383fff700 1 -- 172.21.15.50:0/3699193987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3384159f00 msgr2=0x7f33840c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:45.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.890+0000 7f3383fff700 1 --2- 172.21.15.50:0/3699193987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3384159f00 0x7f33840c1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:45.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.890+0000 7f3383fff700 1 -- 172.21.15.50:0/3699193987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c0094b0 con 0x7f33840b32e0 2023-11-28T11:55:45.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.890+0000 7f3383fff700 1 --2- 172.21.15.50:0/3699193987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33840b32e0 0x7f338415cdb0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f337400c550 tx=0x7f337400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:45.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.890+0000 7f33817fa700 1 -- 172.21.15.50:0/3699193987 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374004ca0 con 0x7f33840b32e0 2023-11-28T11:55:45.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.890+0000 7f33817fa700 1 -- 172.21.15.50:0/3699193987 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3374004e00 con 0x7f33840b32e0 2023-11-28T11:55:45.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.890+0000 7f338937e700 1 -- 172.21.15.50:0/3699193987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338406a5e0 con 0x7f33840b32e0 2023-11-28T11:55:45.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.890+0000 7f33817fa700 1 -- 172.21.15.50:0/3699193987 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374007310 con 0x7f33840b32e0 2023-11-28T11:55:45.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.890+0000 7f338937e700 1 -- 172.21.15.50:0/3699193987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338406a300 con 0x7f33840b32e0 2023-11-28T11:55:45.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.890+0000 7f338937e700 1 -- 172.21.15.50:0/3699193987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338406a8c0 con 0x7f33840b32e0 2023-11-28T11:55:45.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.890+0000 7f33817fa700 1 -- 172.21.15.50:0/3699193987 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f337401a020 con 0x7f33840b32e0 2023-11-28T11:55:45.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.890+0000 7f33817fa700 1 --2- 172.21.15.50:0/3699193987 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3368064ee0 0x7f3368067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:45.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.890+0000 7f33817fa700 1 -- 172.21.15.50:0/3699193987 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f3374081bc0 con 0x7f33840b32e0 2023-11-28T11:55:45.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.890+0000 7f337b7fe700 1 --2- 172.21.15.50:0/3699193987 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3368064ee0 0x7f3368067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:45.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.894+0000 7f337b7fe700 1 --2- 172.21.15.50:0/3699193987 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3368064ee0 0x7f3368067390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f336c0090b0 tx=0x7f336c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:45.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:45.898+0000 7f33817fa700 1 -- 172.21.15.50:0/3699193987 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f337404faf0 con 0x7f33840b32e0 2023-11-28T11:55:46.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.094+0000 7f338937e700 1 -- 172.21.15.50:0/3699193987 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3384072500 con 0x7f33840b32e0 2023-11-28T11:55:46.407 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-11-28T11:55:46.406+0000 7f6bcfbc1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T11:55:46.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.422+0000 7f33817fa700 1 -- 172.21.15.50:0/3699193987 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3374053110 con 0x7f33840b32e0 2023-11-28T11:55:46.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.426+0000 7f338937e700 1 -- 172.21.15.50:0/3699193987 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3368064ee0 msgr2=0x7f3368067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:46.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.426+0000 7f338937e700 1 --2- 172.21.15.50:0/3699193987 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3368064ee0 0x7f3368067390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f336c0090b0 tx=0x7f336c01c040 comp rx=0 tx=0).stop 2023-11-28T11:55:46.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.426+0000 7f338937e700 1 -- 172.21.15.50:0/3699193987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33840b32e0 msgr2=0x7f338415cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:46.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.426+0000 7f338937e700 1 --2- 172.21.15.50:0/3699193987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33840b32e0 0x7f338415cdb0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f337400c550 tx=0x7f337400c860 comp rx=0 tx=0).stop 2023-11-28T11:55:46.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.426+0000 7f338937e700 1 -- 172.21.15.50:0/3699193987 shutdown_connections 2023-11-28T11:55:46.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.426+0000 7f338937e700 1 --2- 172.21.15.50:0/3699193987 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3368064ee0 0x7f3368067390 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:46.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.426+0000 7f338937e700 1 --2- 172.21.15.50:0/3699193987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3384159f00 0x7f33840c1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:46.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.426+0000 7f338937e700 1 --2- 172.21.15.50:0/3699193987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33840c91d0 0x7f33840c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:46.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.426+0000 7f338937e700 1 --2- 172.21.15.50:0/3699193987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33840b32e0 0x7f338415cdb0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:46.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.426+0000 7f338937e700 1 -- 172.21.15.50:0/3699193987 >> 172.21.15.50:0/3699193987 conn(0x7f33840ce3e0 msgr2=0x7f33840af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:46.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.426+0000 7f338937e700 1 -- 172.21.15.50:0/3699193987 shutdown_connections 2023-11-28T11:55:46.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.426+0000 7f338937e700 1 -- 172.21.15.50:0/3699193987 wait complete. 2023-11-28T11:55:46.433 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T11:55:46.433 INFO:tasks.ceph.mds.c.smithi050.stderr: -5805> 2023-11-28T11:55:09.323+0000 7f71f2ea9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:55:46.446 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T11:55:46.467 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-11-28T11:55:46.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.566+0000 7f07ed6f1700 1 Processor -- start 2023-11-28T11:55:46.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.566+0000 7f07ed6f1700 1 -- start start 2023-11-28T11:55:46.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.566+0000 7f07ed6f1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f07e815a3e0 0x7f07e80ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:46.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.566+0000 7f07ed6f1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07e80b2d30 0x7f07e8069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:46.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.566+0000 7f07ed6f1700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e809c0e0 con 0x7f07e80cc2f0 2023-11-28T11:55:46.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.566+0000 7f07ed6f1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e80b13e0 con 0x7f07e815a3e0 2023-11-28T11:55:46.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.566+0000 7f07ed6f1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80b16c0 con 0x7f07e80b2d30 2023-11-28T11:55:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.566+0000 7f07e7fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f07e80cc2f0 0x7f07e80cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51376/0 (socket says 172.21.15.50:51376) 2023-11-28T11:55:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.566+0000 7f07e7fff700 1 -- 172.21.15.50:0/2952411700 learned_addr learned my addr 172.21.15.50:0/2952411700 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.566+0000 7f07e77fe700 1 --2- 172.21.15.50:0/2952411700 >> v2:172.21.15.192:3300/0 conn(0x7f07e815a3e0 0x7f07e80ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.566+0000 7f07ecef0700 1 --2- 172.21.15.50:0/2952411700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07e80b2d30 0x7f07e8069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.566+0000 7f07e6ffd700 1 -- 172.21.15.50:0/2952411700 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683249423 0 0) 0x7f07e809c0e0 con 0x7f07e80cc2f0 2023-11-28T11:55:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.570+0000 7f07e6ffd700 1 -- 172.21.15.50:0/2952411700 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07d40035d0 con 0x7f07e80cc2f0 2023-11-28T11:55:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.570+0000 7f07e77fe700 1 -- 172.21.15.50:0/2952411700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07e80b2d30 msgr2=0x7f07e8069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.570+0000 7f07e77fe700 1 --2- 172.21.15.50:0/2952411700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07e80b2d30 0x7f07e8069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.570+0000 7f07e77fe700 1 -- 172.21.15.50:0/2952411700 >> v1:172.21.15.50:6789/0 conn(0x7f07e80cc2f0 legacy=0x7f07e80cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:46.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.570+0000 7f07e77fe700 1 -- 172.21.15.50:0/2952411700 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e80b19a0 con 0x7f07e815a3e0 2023-11-28T11:55:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.570+0000 7f07e77fe700 1 --2- 172.21.15.50:0/2952411700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07e815a3e0 0x7f07e80ac280 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009d90 tx=0x7f07d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3721b79630e34f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.570+0000 7f07e6ffd700 1 -- 172.21.15.50:0/2952411700 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d800e070 con 0x7f07e815a3e0 2023-11-28T11:55:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.570+0000 7f07e6ffd700 1 -- 172.21.15.50:0/2952411700 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d800bb20 con 0x7f07e815a3e0 2023-11-28T11:55:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.570+0000 7f07e6ffd700 1 -- 172.21.15.50:0/2952411700 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d800be90 con 0x7f07e815a3e0 2023-11-28T11:55:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.570+0000 7f07ed6f1700 1 -- 172.21.15.50:0/2952411700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07e815a3e0 msgr2=0x7f07e80ac280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.570+0000 7f07ed6f1700 1 --2- 172.21.15.50:0/2952411700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07e815a3e0 0x7f07e80ac280 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009d90 tx=0x7f07d800b330 comp rx=0 tx=0).stop 2023-11-28T11:55:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.570+0000 7f07ed6f1700 1 -- 172.21.15.50:0/2952411700 shutdown_connections 2023-11-28T11:55:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.570+0000 7f07ed6f1700 1 --2- 172.21.15.50:0/2952411700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07e80b2d30 0x7f07e8069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.570+0000 7f07ed6f1700 1 --2- 172.21.15.50:0/2952411700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07e815a3e0 0x7f07e80ac280 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:46.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.570+0000 7f07ed6f1700 1 -- 172.21.15.50:0/2952411700 >> 172.21.15.50:0/2952411700 conn(0x7f07e80cae70 msgr2=0x7f07e80cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:46.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.570+0000 7f07ed6f1700 1 -- 172.21.15.50:0/2952411700 shutdown_connections 2023-11-28T11:55:46.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.570+0000 7f07ed6f1700 1 -- 172.21.15.50:0/2952411700 wait complete. 2023-11-28T11:55:46.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07ed6f1700 1 Processor -- start 2023-11-28T11:55:46.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07ed6f1700 1 -- start start 2023-11-28T11:55:46.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07ed6f1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b2d30 0x7f07e81461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07ed6f1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07e80cc2f0 0x7f07e815d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07ed6f1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07e815a3e0 0x7f07e80c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07ed6f1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80c5810 con 0x7f07e80b2d30 2023-11-28T11:55:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07ed6f1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e806fd70 con 0x7f07e815a3e0 2023-11-28T11:55:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07ed6f1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80c6000 con 0x7f07e80cc2f0 2023-11-28T11:55:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07e7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b2d30 0x7f07e81461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07e7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b2d30 0x7f07e81461c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33904/0 (socket says 172.21.15.50:33904) 2023-11-28T11:55:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07e7fff700 1 -- 172.21.15.50:0/1825851235 learned_addr learned my addr 172.21.15.50:0/1825851235 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07e77fe700 1 --2- 172.21.15.50:0/1825851235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07e80cc2f0 0x7f07e815d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07ecef0700 1 --2- 172.21.15.50:0/1825851235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07e815a3e0 0x7f07e80c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07e7fff700 1 -- 172.21.15.50:0/1825851235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07e80cc2f0 msgr2=0x7f07e815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:46.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07e7fff700 1 --2- 172.21.15.50:0/1825851235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07e80cc2f0 0x7f07e815d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07e7fff700 1 -- 172.21.15.50:0/1825851235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07e815a3e0 msgr2=0x7f07e80c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07e7fff700 1 --2- 172.21.15.50:0/1825851235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07e815a3e0 0x7f07e80c5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.574+0000 7f07e7fff700 1 -- 172.21.15.50:0/1825851235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d8009a70 con 0x7f07e80b2d30 2023-11-28T11:55:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.578+0000 7f07e7fff700 1 --2- 172.21.15.50:0/1825851235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b2d30 0x7f07e81461c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f07d000c4d0 tx=0x7f07d000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.578+0000 7f07e4ff9700 1 -- 172.21.15.50:0/1825851235 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d00011d0 con 0x7f07e80b2d30 2023-11-28T11:55:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.578+0000 7f07e4ff9700 1 -- 172.21.15.50:0/1825851235 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d0005d90 con 0x7f07e80b2d30 2023-11-28T11:55:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.578+0000 7f07ed6f1700 1 -- 172.21.15.50:0/1825851235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e806a180 con 0x7f07e80b2d30 2023-11-28T11:55:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.578+0000 7f07e4ff9700 1 -- 172.21.15.50:0/1825851235 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d00072d0 con 0x7f07e80b2d30 2023-11-28T11:55:46.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.578+0000 7f07ed6f1700 1 -- 172.21.15.50:0/1825851235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e80b1c80 con 0x7f07e80b2d30 2023-11-28T11:55:46.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.578+0000 7f07ed6f1700 1 -- 172.21.15.50:0/1825851235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e806a310 con 0x7f07e80b2d30 2023-11-28T11:55:46.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.578+0000 7f07e4ff9700 1 -- 172.21.15.50:0/1825851235 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f07d0019030 con 0x7f07e80b2d30 2023-11-28T11:55:46.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.578+0000 7f07e4ff9700 1 --2- 172.21.15.50:0/1825851235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f07c8064ee0 0x7f07c8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:46.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.578+0000 7f07e4ff9700 1 -- 172.21.15.50:0/1825851235 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f07d00812f0 con 0x7f07e80b2d30 2023-11-28T11:55:46.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.578+0000 7f07e77fe700 1 --2- 172.21.15.50:0/1825851235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f07c8064ee0 0x7f07c8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:46.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.582+0000 7f07e77fe700 1 --2- 172.21.15.50:0/1825851235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f07c8064ee0 0x7f07c8067390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f07e80b44a0 tx=0x7f07d8011000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:46.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.586+0000 7f07e4ff9700 1 -- 172.21.15.50:0/1825851235 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f07d004a400 con 0x7f07e80b2d30 2023-11-28T11:55:46.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:46.786+0000 7f07ed6f1700 1 -- 172.21.15.50:0/1825851235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f07e8072500 con 0x7f07e80b2d30 2023-11-28T11:55:47.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.426+0000 7f07e4ff9700 1 -- 172.21.15.50:0/1825851235 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f07d0056e60 con 0x7f07e80b2d30 2023-11-28T11:55:47.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.430+0000 7f07ed6f1700 1 -- 172.21.15.50:0/1825851235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f07c8064ee0 msgr2=0x7f07c8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:47.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.430+0000 7f07ed6f1700 1 --2- 172.21.15.50:0/1825851235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f07c8064ee0 0x7f07c8067390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f07e80b44a0 tx=0x7f07d8011000 comp rx=0 tx=0).stop 2023-11-28T11:55:47.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.430+0000 7f07ed6f1700 1 -- 172.21.15.50:0/1825851235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b2d30 msgr2=0x7f07e81461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:47.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.430+0000 7f07ed6f1700 1 --2- 172.21.15.50:0/1825851235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b2d30 0x7f07e81461c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f07d000c4d0 tx=0x7f07d000c890 comp rx=0 tx=0).stop 2023-11-28T11:55:47.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.430+0000 7f07ed6f1700 1 -- 172.21.15.50:0/1825851235 shutdown_connections 2023-11-28T11:55:47.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.430+0000 7f07ed6f1700 1 --2- 172.21.15.50:0/1825851235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f07c8064ee0 0x7f07c8067390 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:47.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.430+0000 7f07ed6f1700 1 --2- 172.21.15.50:0/1825851235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07e815a3e0 0x7f07e80c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:47.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.430+0000 7f07ed6f1700 1 --2- 172.21.15.50:0/1825851235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07e80cc2f0 0x7f07e815d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:47.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.430+0000 7f07ed6f1700 1 --2- 172.21.15.50:0/1825851235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b2d30 0x7f07e81461c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:47.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.430+0000 7f07ed6f1700 1 -- 172.21.15.50:0/1825851235 >> 172.21.15.50:0/1825851235 conn(0x7f07e80cae70 msgr2=0x7f07e806aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:47.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.430+0000 7f07ed6f1700 1 -- 172.21.15.50:0/1825851235 shutdown_connections 2023-11-28T11:55:47.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.430+0000 7f07ed6f1700 1 -- 172.21.15.50:0/1825851235 wait complete. 2023-11-28T11:55:47.449 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T11:55:47.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.570+0000 7f8e1d0ad700 1 Processor -- start 2023-11-28T11:55:47.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.570+0000 7f8e1d0ad700 1 -- start start 2023-11-28T11:55:47.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.570+0000 7f8e1d0ad700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8e1815a2c0 0x7f8e180b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:47.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.570+0000 7f8e1d0ad700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8e180caef0 0x7f8e180b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:47.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.570+0000 7f8e1d0ad700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e180d0370 con 0x7f8e18159ef0 2023-11-28T11:55:47.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.570+0000 7f8e1d0ad700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e180d0650 con 0x7f8e180caef0 2023-11-28T11:55:47.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.570+0000 7f8e1d0ad700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1815ae30 con 0x7f8e1815a2c0 2023-11-28T11:55:47.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.570+0000 7f8e1c8ac700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8e180caef0 0x7f8e180b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:47.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.570+0000 7f8e1c8ac700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8e180caef0 0x7f8e180b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33912/0 (socket says 172.21.15.50:33912) 2023-11-28T11:55:47.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.570+0000 7f8e1c8ac700 1 -- 172.21.15.50:0/1373723116 learned_addr learned my addr 172.21.15.50:0/1373723116 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:47.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.570+0000 7f8e177fe700 1 --2- 172.21.15.50:0/1373723116 >> v2:172.21.15.192:3300/0 conn(0x7f8e1815a2c0 0x7f8e180b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e1c8ac700 1 -- 172.21.15.50:0/1373723116 >> v2:172.21.15.192:3300/0 conn(0x7f8e1815a2c0 msgr2=0x7f8e180b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:47.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e1c8ac700 1 --2- 172.21.15.50:0/1373723116 >> v2:172.21.15.192:3300/0 conn(0x7f8e1815a2c0 0x7f8e180b22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:47.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e1c8ac700 1 -- 172.21.15.50:0/1373723116 >> v1:172.21.15.192:6789/0 conn(0x7f8e18159ef0 legacy=0x7f8e180cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:47.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e1c8ac700 1 -- 172.21.15.50:0/1373723116 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1815a770 con 0x7f8e180caef0 2023-11-28T11:55:47.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e1c8ac700 1 --2- 172.21.15.50:0/1373723116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180caef0 0x7f8e180b2810 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8e1815eba0 tx=0x7f8e1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d692cfc3a6c4c73f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:47.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e16ffd700 1 -- 172.21.15.50:0/1373723116 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1000e070 con 0x7f8e180caef0 2023-11-28T11:55:47.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e16ffd700 1 -- 172.21.15.50:0/1373723116 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e10003a40 con 0x7f8e180caef0 2023-11-28T11:55:47.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e16ffd700 1 -- 172.21.15.50:0/1373723116 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10003df0 con 0x7f8e180caef0 2023-11-28T11:55:47.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e1d0ad700 1 -- 172.21.15.50:0/1373723116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180caef0 msgr2=0x7f8e180b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:47.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e1d0ad700 1 --2- 172.21.15.50:0/1373723116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180caef0 0x7f8e180b2810 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8e1815eba0 tx=0x7f8e1000b330 comp rx=0 tx=0).stop 2023-11-28T11:55:47.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e1d0ad700 1 -- 172.21.15.50:0/1373723116 shutdown_connections 2023-11-28T11:55:47.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e1d0ad700 1 --2- 172.21.15.50:0/1373723116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180caef0 0x7f8e180b2810 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:47.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e1d0ad700 1 --2- 172.21.15.50:0/1373723116 >> v2:172.21.15.192:3300/0 conn(0x7f8e1815a2c0 0x7f8e180b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:47.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e1d0ad700 1 -- 172.21.15.50:0/1373723116 >> 172.21.15.50:0/1373723116 conn(0x7f8e180cd2b0 msgr2=0x7f8e180cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:47.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e1d0ad700 1 -- 172.21.15.50:0/1373723116 shutdown_connections 2023-11-28T11:55:47.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e1d0ad700 1 -- 172.21.15.50:0/1373723116 wait complete. 2023-11-28T11:55:47.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e1d0ad700 1 Processor -- start 2023-11-28T11:55:47.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.574+0000 7f8e1d0ad700 1 -- start start 2023-11-28T11:55:47.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e1d0ad700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180caef0 0x7f8e1815c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:47.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e1d0ad700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e18159ef0 0x7f8e1815cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:47.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e1d0ad700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e1815a2c0 0x7f8e180c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:47.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e1d0ad700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e181541e0 con 0x7f8e180caef0 2023-11-28T11:55:47.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e1d0ad700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e181535e0 con 0x7f8e18159ef0 2023-11-28T11:55:47.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e1d0ad700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e181538b0 con 0x7f8e1815a2c0 2023-11-28T11:55:47.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e177fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e18159ef0 0x7f8e1815cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:47.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e177fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e18159ef0 0x7f8e1815cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:35340/0 (socket says 172.21.15.50:35340) 2023-11-28T11:55:47.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e177fe700 1 -- 172.21.15.50:0/2348210019 learned_addr learned my addr 172.21.15.50:0/2348210019 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:47.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e17fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180caef0 0x7f8e1815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:47.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e1c8ac700 1 --2- 172.21.15.50:0/2348210019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e1815a2c0 0x7f8e180c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:47.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e177fe700 1 -- 172.21.15.50:0/2348210019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e1815a2c0 msgr2=0x7f8e180c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:47.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e177fe700 1 --2- 172.21.15.50:0/2348210019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e1815a2c0 0x7f8e180c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:47.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e177fe700 1 -- 172.21.15.50:0/2348210019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180caef0 msgr2=0x7f8e1815c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:47.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e177fe700 1 --2- 172.21.15.50:0/2348210019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180caef0 0x7f8e1815c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:47.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e177fe700 1 -- 172.21.15.50:0/2348210019 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e10009b30 con 0x7f8e18159ef0 2023-11-28T11:55:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e177fe700 1 --2- 172.21.15.50:0/2348210019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e18159ef0 0x7f8e1815cbb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000e960 tx=0x7f8e0000ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e14ff9700 1 -- 172.21.15.50:0/2348210019 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00013680 con 0x7f8e18159ef0 2023-11-28T11:55:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e1d0ad700 1 -- 172.21.15.50:0/2348210019 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1815b250 con 0x7f8e18159ef0 2023-11-28T11:55:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e14ff9700 1 -- 172.21.15.50:0/2348210019 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e000137e0 con 0x7f8e18159ef0 2023-11-28T11:55:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e14ff9700 1 -- 172.21.15.50:0/2348210019 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00013b50 con 0x7f8e18159ef0 2023-11-28T11:55:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e1d0ad700 1 -- 172.21.15.50:0/2348210019 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1815aa50 con 0x7f8e18159ef0 2023-11-28T11:55:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.578+0000 7f8e1d0ad700 1 -- 172.21.15.50:0/2348210019 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1815b3e0 con 0x7f8e18159ef0 2023-11-28T11:55:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.582+0000 7f8e14ff9700 1 -- 172.21.15.50:0/2348210019 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8e00019030 con 0x7f8e18159ef0 2023-11-28T11:55:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.582+0000 7f8e14ff9700 1 --2- 172.21.15.50:0/2348210019 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8df8064ee0 0x7f8df8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.582+0000 7f8e14ff9700 1 -- 172.21.15.50:0/2348210019 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f8e00081f30 con 0x7f8e18159ef0 2023-11-28T11:55:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.582+0000 7f8e17fff700 1 --2- 172.21.15.50:0/2348210019 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8df8064ee0 0x7f8df8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:47.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.582+0000 7f8e17fff700 1 --2- 172.21.15.50:0/2348210019 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8df8064ee0 0x7f8df8067390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8e08000f60 tx=0x7f8e08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:47.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.590+0000 7f8e14ff9700 1 -- 172.21.15.50:0/2348210019 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8e0004fe80 con 0x7f8e18159ef0 2023-11-28T11:55:47.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:47.758+0000 7f8e1d0ad700 1 -- 172.21.15.50:0/2348210019 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8e180676e0 con 0x7f8e18159ef0 2023-11-28T11:55:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.486+0000 7f8e14ff9700 1 -- 172.21.15.50:0/2348210019 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8e00013cb0 con 0x7f8e18159ef0 2023-11-28T11:55:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.490+0000 7f8e1d0ad700 1 -- 172.21.15.50:0/2348210019 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8df8064ee0 msgr2=0x7f8df8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.490+0000 7f8e1d0ad700 1 --2- 172.21.15.50:0/2348210019 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8df8064ee0 0x7f8df8067390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8e08000f60 tx=0x7f8e08009040 comp rx=0 tx=0).stop 2023-11-28T11:55:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.490+0000 7f8e1d0ad700 1 -- 172.21.15.50:0/2348210019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e18159ef0 msgr2=0x7f8e1815cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.490+0000 7f8e1d0ad700 1 --2- 172.21.15.50:0/2348210019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e18159ef0 0x7f8e1815cbb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000e960 tx=0x7f8e0000ec70 comp rx=0 tx=0).stop 2023-11-28T11:55:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.490+0000 7f8e1d0ad700 1 -- 172.21.15.50:0/2348210019 shutdown_connections 2023-11-28T11:55:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.490+0000 7f8e1d0ad700 1 --2- 172.21.15.50:0/2348210019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e1815a2c0 0x7f8e180c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.490+0000 7f8e1d0ad700 1 --2- 172.21.15.50:0/2348210019 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8df8064ee0 0x7f8df8067390 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.490+0000 7f8e1d0ad700 1 --2- 172.21.15.50:0/2348210019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e18159ef0 0x7f8e1815cbb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.490+0000 7f8e1d0ad700 1 --2- 172.21.15.50:0/2348210019 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e180caef0 0x7f8e1815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.490+0000 7f8e1d0ad700 1 -- 172.21.15.50:0/2348210019 >> 172.21.15.50:0/2348210019 conn(0x7f8e180cd2b0 msgr2=0x7f8e1806f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.490+0000 7f8e1d0ad700 1 -- 172.21.15.50:0/2348210019 shutdown_connections 2023-11-28T11:55:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.490+0000 7f8e1d0ad700 1 -- 172.21.15.50:0/2348210019 wait complete. 2023-11-28T11:55:48.496 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-11-28T11:55:48.509 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T11:55:48.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.630+0000 7f699efe1700 1 Processor -- start 2023-11-28T11:55:48.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.630+0000 7f699efe1700 1 -- start start 2023-11-28T11:55:48.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699efe1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6998158f10 0x7f699806b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:48.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699efe1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f69980cb520 0x7f6998162b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:48.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699efe1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69980c9460 con 0x7f69980cd930 2023-11-28T11:55:48.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699efe1700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69980c9fe0 con 0x7f69980cb520 2023-11-28T11:55:48.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699efe1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699806dc90 con 0x7f6998158f10 2023-11-28T11:55:48.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699d7de700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f69980cd930 0x7f69980cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:41132/0 (socket says 172.21.15.50:41132) 2023-11-28T11:55:48.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699d7de700 1 -- 172.21.15.50:0/1555057418 learned_addr learned my addr 172.21.15.50:0/1555057418 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:48.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699e7e0700 1 --2- 172.21.15.50:0/1555057418 >> v2:172.21.15.50:3300/0 conn(0x7f69980cb520 0x7f6998162b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:48.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699dfdf700 1 --2- 172.21.15.50:0/1555057418 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6998158f10 0x7f699806b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:48.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699cfdd700 1 -- 172.21.15.50:0/1555057418 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318810536 0 0) 0x7f69980c9460 con 0x7f69980cd930 2023-11-28T11:55:48.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699cfdd700 1 -- 172.21.15.50:0/1555057418 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69840035d0 con 0x7f69980cd930 2023-11-28T11:55:48.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699e7e0700 1 -- 172.21.15.50:0/1555057418 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6998158f10 msgr2=0x7f699806b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:48.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699e7e0700 1 --2- 172.21.15.50:0/1555057418 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6998158f10 0x7f699806b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:48.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699e7e0700 1 -- 172.21.15.50:0/1555057418 >> v1:172.21.15.192:6789/0 conn(0x7f69980cd930 legacy=0x7f69980cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:48.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699e7e0700 1 -- 172.21.15.50:0/1555057418 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69980c96b0 con 0x7f69980cb520 2023-11-28T11:55:48.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699e7e0700 1 --2- 172.21.15.50:0/1555057418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69980cb520 0x7f6998162b40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6990009850 tx=0x7f6990009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b146b920ef302992 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:48.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699cfdd700 1 -- 172.21.15.50:0/1555057418 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990011830 con 0x7f69980cb520 2023-11-28T11:55:48.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699cfdd700 1 -- 172.21.15.50:0/1555057418 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6990011990 con 0x7f69980cb520 2023-11-28T11:55:48.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.634+0000 7f699cfdd700 1 -- 172.21.15.50:0/1555057418 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990011d40 con 0x7f69980cb520 2023-11-28T11:55:48.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.638+0000 7f699efe1700 1 -- 172.21.15.50:0/1555057418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69980cb520 msgr2=0x7f6998162b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:48.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.638+0000 7f699efe1700 1 --2- 172.21.15.50:0/1555057418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69980cb520 0x7f6998162b40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6990009850 tx=0x7f6990009b60 comp rx=0 tx=0).stop 2023-11-28T11:55:48.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.638+0000 7f699efe1700 1 -- 172.21.15.50:0/1555057418 shutdown_connections 2023-11-28T11:55:48.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.638+0000 7f699efe1700 1 --2- 172.21.15.50:0/1555057418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69980cb520 0x7f6998162b40 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:48.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.638+0000 7f699efe1700 1 --2- 172.21.15.50:0/1555057418 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6998158f10 0x7f699806b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:48.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.638+0000 7f699efe1700 1 -- 172.21.15.50:0/1555057418 >> 172.21.15.50:0/1555057418 conn(0x7f69980ce400 msgr2=0x7f69980ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:48.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.638+0000 7f699efe1700 1 -- 172.21.15.50:0/1555057418 shutdown_connections 2023-11-28T11:55:48.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.638+0000 7f699efe1700 1 -- 172.21.15.50:0/1555057418 wait complete. 2023-11-28T11:55:48.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.638+0000 7f699efe1700 1 Processor -- start 2023-11-28T11:55:48.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.638+0000 7f699efe1700 1 -- start start 2023-11-28T11:55:48.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699efe1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69980cb520 0x7f69980af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:48.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699efe1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69980cd930 0x7f69980add10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:48.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699efe1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6998158f10 0x7f69981e2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:48.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699efe1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69980af3c0 con 0x7f69980cb520 2023-11-28T11:55:48.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699efe1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69980ae7b0 con 0x7f69980cd930 2023-11-28T11:55:48.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699efe1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69980aea90 con 0x7f6998158f10 2023-11-28T11:55:48.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699dfdf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69980cb520 0x7f69980af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:48.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699dfdf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69980cb520 0x7f69980af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33926/0 (socket says 172.21.15.50:33926) 2023-11-28T11:55:48.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699dfdf700 1 -- 172.21.15.50:0/199394932 learned_addr learned my addr 172.21.15.50:0/199394932 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:48.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699d7de700 1 --2- 172.21.15.50:0/199394932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69980cd930 0x7f69980add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:48.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699e7e0700 1 --2- 172.21.15.50:0/199394932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6998158f10 0x7f69981e2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:48.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699dfdf700 1 -- 172.21.15.50:0/199394932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6998158f10 msgr2=0x7f69981e2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:48.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699dfdf700 1 --2- 172.21.15.50:0/199394932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6998158f10 0x7f69981e2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:48.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699dfdf700 1 -- 172.21.15.50:0/199394932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69980cd930 msgr2=0x7f69980add10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:48.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699dfdf700 1 --2- 172.21.15.50:0/199394932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69980cd930 0x7f69980add10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:48.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699dfdf700 1 -- 172.21.15.50:0/199394932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69900094b0 con 0x7f69980cb520 2023-11-28T11:55:48.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699e7e0700 1 --2- 172.21.15.50:0/199394932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6998158f10 0x7f69981e2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:48.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699dfdf700 1 --2- 172.21.15.50:0/199394932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69980cb520 0x7f69980af850 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6988009c50 tx=0x7f6988009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:48.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f698e7fc700 1 -- 172.21.15.50:0/199394932 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698800c940 con 0x7f69980cb520 2023-11-28T11:55:48.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f698e7fc700 1 -- 172.21.15.50:0/199394932 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698800caa0 con 0x7f69980cb520 2023-11-28T11:55:48.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699efe1700 1 -- 172.21.15.50:0/199394932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69980c9c70 con 0x7f69980cb520 2023-11-28T11:55:48.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f698e7fc700 1 -- 172.21.15.50:0/199394932 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698800ce10 con 0x7f69980cb520 2023-11-28T11:55:48.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699efe1700 1 -- 172.21.15.50:0/199394932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69980c9990 con 0x7f69980cb520 2023-11-28T11:55:48.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.642+0000 7f699efe1700 1 -- 172.21.15.50:0/199394932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69981592e0 con 0x7f69980cb520 2023-11-28T11:55:48.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.646+0000 7f698e7fc700 1 -- 172.21.15.50:0/199394932 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6988021030 con 0x7f69980cb520 2023-11-28T11:55:48.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.646+0000 7f698e7fc700 1 --2- 172.21.15.50:0/199394932 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f697c064ee0 0x7f697c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:48.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.646+0000 7f698e7fc700 1 -- 172.21.15.50:0/199394932 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6088+0+0 (secure 0 0 0) 0x7f69880857e0 con 0x7f69980cb520 2023-11-28T11:55:48.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.646+0000 7f699d7de700 1 --2- 172.21.15.50:0/199394932 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f697c064ee0 0x7f697c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:48.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.646+0000 7f699d7de700 1 --2- 172.21.15.50:0/199394932 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f697c064ee0 0x7f697c067390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6994001560 tx=0x7f6994001a90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:48.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.654+0000 7f698e7fc700 1 -- 172.21.15.50:0/199394932 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6988053960 con 0x7f69980cb520 2023-11-28T11:55:48.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:48.818+0000 7f699efe1700 1 -- 172.21.15.50:0/199394932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6998072500 con 0x7f69980cb520 2023-11-28T11:55:49.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.498+0000 7f698e7fc700 1 -- 172.21.15.50:0/199394932 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6988056f80 con 0x7f69980cb520 2023-11-28T11:55:49.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.502+0000 7f699efe1700 1 -- 172.21.15.50:0/199394932 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f697c064ee0 msgr2=0x7f697c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:49.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.502+0000 7f699efe1700 1 --2- 172.21.15.50:0/199394932 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f697c064ee0 0x7f697c067390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6994001560 tx=0x7f6994001a90 comp rx=0 tx=0).stop 2023-11-28T11:55:49.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.502+0000 7f699efe1700 1 -- 172.21.15.50:0/199394932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69980cb520 msgr2=0x7f69980af850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:49.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.502+0000 7f699efe1700 1 --2- 172.21.15.50:0/199394932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69980cb520 0x7f69980af850 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6988009c50 tx=0x7f6988009f60 comp rx=0 tx=0).stop 2023-11-28T11:55:49.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.502+0000 7f699efe1700 1 -- 172.21.15.50:0/199394932 shutdown_connections 2023-11-28T11:55:49.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.502+0000 7f699efe1700 1 --2- 172.21.15.50:0/199394932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6998158f10 0x7f69981e2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.502+0000 7f699efe1700 1 --2- 172.21.15.50:0/199394932 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f697c064ee0 0x7f697c067390 secure :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6994001560 tx=0x7f6994001a90 comp rx=0 tx=0).stop 2023-11-28T11:55:49.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.502+0000 7f699efe1700 1 --2- 172.21.15.50:0/199394932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69980cd930 0x7f69980add10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.502+0000 7f699efe1700 1 --2- 172.21.15.50:0/199394932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69980cb520 0x7f69980af850 secure :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6988009c50 tx=0x7f6988009f60 comp rx=0 tx=0).stop 2023-11-28T11:55:49.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.502+0000 7f699efe1700 1 -- 172.21.15.50:0/199394932 >> 172.21.15.50:0/199394932 conn(0x7f69980ce400 msgr2=0x7f69980c8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:49.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.506+0000 7f699efe1700 1 -- 172.21.15.50:0/199394932 shutdown_connections 2023-11-28T11:55:49.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.506+0000 7f699efe1700 1 -- 172.21.15.50:0/199394932 wait complete. 2023-11-28T11:55:49.509 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-11-28T11:55:49.521 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T11:55:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.634+0000 7fbb2e9f2700 1 Processor -- start 2023-11-28T11:55:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2e9f2700 1 -- start start 2023-11-28T11:55:49.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2e9f2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb2815d7e0 0x7fbb280cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:49.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2e9f2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb280cda90 con 0x7fbb28159040 2023-11-28T11:55:49.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2d9f0700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbb28159040 0x7fbb280c9fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51382/0 (socket says 172.21.15.50:51382) 2023-11-28T11:55:49.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2d9f0700 1 -- 172.21.15.50:0/991784105 learned_addr learned my addr 172.21.15.50:0/991784105 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:49.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2e9f2700 1 -- 172.21.15.50:0/991784105 --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb280cd480 con 0x7fbb280ce460 2023-11-28T11:55:49.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2e9f2700 1 -- 172.21.15.50:0/991784105 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28159410 con 0x7fbb2815d7e0 2023-11-28T11:55:49.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2d1ef700 1 --2- 172.21.15.50:0/991784105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb2815d7e0 0x7fbb280cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:49.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2c9ee700 1 -- 172.21.15.50:0/991784105 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247614489 0 0) 0x7fbb280cda90 con 0x7fbb28159040 2023-11-28T11:55:49.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2c9ee700 1 -- 172.21.15.50:0/991784105 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb140035d0 con 0x7fbb28159040 2023-11-28T11:55:49.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2c9ee700 1 -- 172.21.15.50:0/991784105 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024378295 0 0) 0x7fbb280cd480 con 0x7fbb280ce460 2023-11-28T11:55:49.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2c9ee700 1 -- 172.21.15.50:0/991784105 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb280cda90 con 0x7fbb280ce460 2023-11-28T11:55:49.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2c9ee700 1 -- 172.21.15.50:0/991784105 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2906226802 0 0) 0x7fbb140035d0 con 0x7fbb28159040 2023-11-28T11:55:49.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2c9ee700 1 -- 172.21.15.50:0/991784105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb2815d7e0 msgr2=0x7fbb280cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:49.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2c9ee700 1 --2- 172.21.15.50:0/991784105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb2815d7e0 0x7fbb280cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2c9ee700 1 -- 172.21.15.50:0/991784105 >> v1:172.21.15.192:6789/0 conn(0x7fbb280ce460 legacy=0x7fbb2806a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:49.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2c9ee700 1 -- 172.21.15.50:0/991784105 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb280ca7e0 con 0x7fbb28159040 2023-11-28T11:55:49.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2c9ee700 1 -- 172.21.15.50:0/991784105 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7fbb240050c0 con 0x7fbb28159040 2023-11-28T11:55:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2c9ee700 1 -- 172.21.15.50:0/991784105 >> v1:172.21.15.50:6789/0 conn(0x7fbb28159040 legacy=0x7fbb280c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2c9ee700 1 --2- 172.21.15.50:0/991784105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb14003be0 0x7fbb14003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2c9ee700 1 --2- 172.21.15.50:0/991784105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb14004870 0x7fbb14004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2c9ee700 1 --2- 172.21.15.50:0/991784105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb14005220 0x7fbb1400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2c9ee700 1 -- 172.21.15.50:0/991784105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28159410 con 0x7fbb14003be0 2023-11-28T11:55:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2c9ee700 1 -- 172.21.15.50:0/991784105 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1400c100 con 0x7fbb14005220 2023-11-28T11:55:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2c9ee700 1 -- 172.21.15.50:0/991784105 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1400c290 con 0x7fbb14004870 2023-11-28T11:55:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2d1ef700 1 --2- 172.21.15.50:0/991784105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb2815d7e0 0x7fbb280cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.638+0000 7fbb2d9f0700 1 --2- 172.21.15.50:0/991784105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb14003be0 0x7fbb14003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2e1f1700 1 --2- 172.21.15.50:0/991784105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb14005220 0x7fbb1400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2d1ef700 1 --2- 172.21.15.50:0/991784105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb14004870 0x7fbb14004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2d9f0700 1 -- 172.21.15.50:0/991784105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb14004870 msgr2=0x7fbb14004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2d9f0700 1 --2- 172.21.15.50:0/991784105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb14004870 0x7fbb14004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2d9f0700 1 -- 172.21.15.50:0/991784105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb14005220 msgr2=0x7fbb1400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2d9f0700 1 --2- 172.21.15.50:0/991784105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb14005220 0x7fbb1400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2d9f0700 1 -- 172.21.15.50:0/991784105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb140035d0 con 0x7fbb14003be0 2023-11-28T11:55:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2e1f1700 1 --2- 172.21.15.50:0/991784105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb14005220 0x7fbb1400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2d1ef700 1 --2- 172.21.15.50:0/991784105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb14004870 0x7fbb14004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:55:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2d9f0700 1 --2- 172.21.15.50:0/991784105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb14003be0 0x7fbb14003fd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbb24007fd0 tx=0x7fbb140058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45369f18f569e97 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2c9ee700 1 -- 172.21.15.50:0/991784105 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2400cc50 con 0x7fbb14003be0 2023-11-28T11:55:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2c9ee700 1 -- 172.21.15.50:0/991784105 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2400cdb0 con 0x7fbb14003be0 2023-11-28T11:55:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2c9ee700 1 -- 172.21.15.50:0/991784105 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb24005bc0 con 0x7fbb14003be0 2023-11-28T11:55:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2e9f2700 1 -- 172.21.15.50:0/991784105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb14003be0 msgr2=0x7fbb14003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2e9f2700 1 --2- 172.21.15.50:0/991784105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb14003be0 0x7fbb14003fd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbb24007fd0 tx=0x7fbb140058a0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2e1f1700 1 -- 172.21.15.50:0/991784105 reap_dead start 2023-11-28T11:55:49.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2e9f2700 1 -- 172.21.15.50:0/991784105 shutdown_connections 2023-11-28T11:55:49.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2e9f2700 1 -- 172.21.15.50:0/991784105 >> 172.21.15.50:0/991784105 conn(0x7fbb2806c660 msgr2=0x7fbb2806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:49.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2e9f2700 1 -- 172.21.15.50:0/991784105 shutdown_connections 2023-11-28T11:55:49.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.642+0000 7fbb2e9f2700 1 -- 172.21.15.50:0/991784105 wait complete. 2023-11-28T11:55:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2e9f2700 1 Processor -- start 2023-11-28T11:55:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2e9f2700 1 -- start start 2023-11-28T11:55:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2e9f2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb14003be0 0x7fbb281535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2e9f2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb281ef4f0 0x7fbb281ef960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2e9f2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb280c2880 0x7fbb280c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2e9f2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb280c3230 con 0x7fbb14003be0 2023-11-28T11:55:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2e9f2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb280cedc0 con 0x7fbb280c2880 2023-11-28T11:55:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2e9f2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb280c49f0 con 0x7fbb281ef4f0 2023-11-28T11:55:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2d9f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb14003be0 0x7fbb281535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:49.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2d9f0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb14003be0 0x7fbb281535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33936/0 (socket says 172.21.15.50:33936) 2023-11-28T11:55:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2d9f0700 1 -- 172.21.15.50:0/3640472315 learned_addr learned my addr 172.21.15.50:0/3640472315 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2e1f1700 1 --2- 172.21.15.50:0/3640472315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb280c2880 0x7fbb280c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2d1ef700 1 --2- 172.21.15.50:0/3640472315 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb281ef4f0 0x7fbb281ef960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2d9f0700 1 -- 172.21.15.50:0/3640472315 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb281ef4f0 msgr2=0x7fbb281ef960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2d9f0700 1 --2- 172.21.15.50:0/3640472315 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb281ef4f0 0x7fbb281ef960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2d9f0700 1 -- 172.21.15.50:0/3640472315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb280c2880 msgr2=0x7fbb280c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2d9f0700 1 --2- 172.21.15.50:0/3640472315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb280c2880 0x7fbb280c2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2d9f0700 1 -- 172.21.15.50:0/3640472315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb280caac0 con 0x7fbb14003be0 2023-11-28T11:55:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2d9f0700 1 --2- 172.21.15.50:0/3640472315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb14003be0 0x7fbb281535c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400c6a0 tx=0x7fbb24005380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb1e7fc700 1 -- 172.21.15.50:0/3640472315 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb24005af0 con 0x7fbb14003be0 2023-11-28T11:55:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb1e7fc700 1 -- 172.21.15.50:0/3640472315 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb24005c50 con 0x7fbb14003be0 2023-11-28T11:55:49.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2e9f2700 1 -- 172.21.15.50:0/3640472315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb280cd720 con 0x7fbb14003be0 2023-11-28T11:55:49.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb1e7fc700 1 -- 172.21.15.50:0/3640472315 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb240070d0 con 0x7fbb14003be0 2023-11-28T11:55:49.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.646+0000 7fbb2e9f2700 1 -- 172.21.15.50:0/3640472315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2806abf0 con 0x7fbb14003be0 2023-11-28T11:55:49.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.650+0000 7fbb2e9f2700 1 -- 172.21.15.50:0/3640472315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb28072c20 con 0x7fbb14003be0 2023-11-28T11:55:49.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.650+0000 7fbb1e7fc700 1 -- 172.21.15.50:0/3640472315 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbb24010070 con 0x7fbb14003be0 2023-11-28T11:55:49.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.650+0000 7fbb1e7fc700 1 --2- 172.21.15.50:0/3640472315 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbb0c064ee0 0x7fbb0c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:49.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.650+0000 7fbb1e7fc700 1 -- 172.21.15.50:0/3640472315 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fbb24083130 con 0x7fbb14003be0 2023-11-28T11:55:49.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.650+0000 7fbb2d1ef700 1 --2- 172.21.15.50:0/3640472315 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbb0c064ee0 0x7fbb0c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:49.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.650+0000 7fbb2d1ef700 1 --2- 172.21.15.50:0/3640472315 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbb0c064ee0 0x7fbb0c067390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbb28156b60 tx=0x7fbb18008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:49.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.658+0000 7fbb1e7fc700 1 -- 172.21.15.50:0/3640472315 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbb24051490 con 0x7fbb14003be0 2023-11-28T11:55:49.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.822+0000 7fbb2e9f2700 1 -- 172.21.15.50:0/3640472315 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbb280cd1c0 con 0x7fbb14003be0 2023-11-28T11:55:49.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.826+0000 7fbb1e7fc700 1 -- 172.21.15.50:0/3640472315 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbb240170a0 con 0x7fbb14003be0 2023-11-28T11:55:49.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.830+0000 7fbb2e9f2700 1 -- 172.21.15.50:0/3640472315 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbb0c064ee0 msgr2=0x7fbb0c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:49.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.830+0000 7fbb2e9f2700 1 --2- 172.21.15.50:0/3640472315 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbb0c064ee0 0x7fbb0c067390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbb28156b60 tx=0x7fbb18008040 comp rx=0 tx=0).stop 2023-11-28T11:55:49.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.830+0000 7fbb2e9f2700 1 -- 172.21.15.50:0/3640472315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb14003be0 msgr2=0x7fbb281535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:49.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.830+0000 7fbb2e9f2700 1 --2- 172.21.15.50:0/3640472315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb14003be0 0x7fbb281535c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400c6a0 tx=0x7fbb24005380 comp rx=0 tx=0).stop 2023-11-28T11:55:49.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.830+0000 7fbb2e9f2700 1 -- 172.21.15.50:0/3640472315 shutdown_connections 2023-11-28T11:55:49.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.830+0000 7fbb2e9f2700 1 --2- 172.21.15.50:0/3640472315 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbb0c064ee0 0x7fbb0c067390 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.830+0000 7fbb2e9f2700 1 --2- 172.21.15.50:0/3640472315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb280c2880 0x7fbb280c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.830+0000 7fbb2e9f2700 1 --2- 172.21.15.50:0/3640472315 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb281ef4f0 0x7fbb281ef960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.830+0000 7fbb2e9f2700 1 --2- 172.21.15.50:0/3640472315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb14003be0 0x7fbb281535c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.830+0000 7fbb2e9f2700 1 -- 172.21.15.50:0/3640472315 >> 172.21.15.50:0/3640472315 conn(0x7fbb2806c660 msgr2=0x7fbb28158280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:49.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.830+0000 7fbb2e9f2700 1 -- 172.21.15.50:0/3640472315 shutdown_connections 2023-11-28T11:55:49.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.830+0000 7fbb2e9f2700 1 -- 172.21.15.50:0/3640472315 wait complete. 2023-11-28T11:55:49.847 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-11-28T11:55:49.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.958+0000 7f07b491c700 1 Processor -- start 2023-11-28T11:55:49.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.958+0000 7f07b491c700 1 -- start start 2023-11-28T11:55:49.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.958+0000 7f07b491c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07b00cf050 0x7f07b006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:49.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.958+0000 7f07b491c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f07b006a530 0x7f07b00cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:49.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.958+0000 7f07b491c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07b00b4c10 0x7f07b00cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:49.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.958+0000 7f07b491c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b015c6d0 con 0x7f07b00cf050 2023-11-28T11:55:49.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.958+0000 7f07b491c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b006a9d0 con 0x7f07b006a530 2023-11-28T11:55:49.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.958+0000 7f07b491c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00cf960 con 0x7f07b00b4c10 2023-11-28T11:55:49.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.958+0000 7f07af7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07b00cf050 0x7f07b006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:49.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07af7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07b00cf050 0x7f07b006d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33938/0 (socket says 172.21.15.50:33938) 2023-11-28T11:55:49.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07af7fe700 1 -- 172.21.15.50:0/2625435267 learned_addr learned my addr 172.21.15.50:0/2625435267 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:49.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07a6ffd700 1 --2- 172.21.15.50:0/2625435267 >> v2:172.21.15.192:3300/0 conn(0x7f07b006a530 0x7f07b00cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:49.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07affff700 1 --2- 172.21.15.50:0/2625435267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07b00b4c10 0x7f07b00cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:49.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07af7fe700 1 -- 172.21.15.50:0/2625435267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07b00b4c10 msgr2=0x7f07b00cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:49.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07af7fe700 1 --2- 172.21.15.50:0/2625435267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07b00b4c10 0x7f07b00cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07af7fe700 1 -- 172.21.15.50:0/2625435267 >> v2:172.21.15.192:3300/0 conn(0x7f07b006a530 msgr2=0x7f07b00cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:49.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07af7fe700 1 --2- 172.21.15.50:0/2625435267 >> v2:172.21.15.192:3300/0 conn(0x7f07b006a530 0x7f07b00cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07af7fe700 1 -- 172.21.15.50:0/2625435267 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b006ac60 con 0x7f07b00cf050 2023-11-28T11:55:49.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07af7fe700 1 --2- 172.21.15.50:0/2625435267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07b00cf050 0x7f07b006d7d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f07b00d38d0 tx=0x7f07a0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0203136428093a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:49.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07aeffd700 1 -- 172.21.15.50:0/2625435267 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a0011830 con 0x7f07b00cf050 2023-11-28T11:55:49.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07aeffd700 1 -- 172.21.15.50:0/2625435267 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a0011990 con 0x7f07b00cf050 2023-11-28T11:55:49.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07aeffd700 1 -- 172.21.15.50:0/2625435267 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a0011d20 con 0x7f07b00cf050 2023-11-28T11:55:49.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07b491c700 1 -- 172.21.15.50:0/2625435267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07b00cf050 msgr2=0x7f07b006d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:49.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07b491c700 1 --2- 172.21.15.50:0/2625435267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07b00cf050 0x7f07b006d7d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f07b00d38d0 tx=0x7f07a0009bf0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07b491c700 1 -- 172.21.15.50:0/2625435267 shutdown_connections 2023-11-28T11:55:49.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07b491c700 1 --2- 172.21.15.50:0/2625435267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07b00b4c10 0x7f07b00cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07b491c700 1 --2- 172.21.15.50:0/2625435267 >> v2:172.21.15.192:3300/0 conn(0x7f07b006a530 0x7f07b00cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07b491c700 1 --2- 172.21.15.50:0/2625435267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07b00cf050 0x7f07b006d7d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07b491c700 1 -- 172.21.15.50:0/2625435267 >> 172.21.15.50:0/2625435267 conn(0x7f07b009bb30 msgr2=0x7f07b00b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:49.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07b491c700 1 -- 172.21.15.50:0/2625435267 shutdown_connections 2023-11-28T11:55:49.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.962+0000 7f07b491c700 1 -- 172.21.15.50:0/2625435267 wait complete. 2023-11-28T11:55:49.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.966+0000 7f07b491c700 1 Processor -- start 2023-11-28T11:55:49.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.966+0000 7f07b491c700 1 -- start start 2023-11-28T11:55:49.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.966+0000 7f07b491c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07b006a530 0x7f07b015f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:49.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.966+0000 7f07b491c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07b00b4c10 0x7f07b009c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:49.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.966+0000 7f07b491c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07b00cf050 0x7f07b009cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:49.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.966+0000 7f07b491c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00c92f0 con 0x7f07b006a530 2023-11-28T11:55:49.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.966+0000 7f07b491c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b009e590 con 0x7f07b00cf050 2023-11-28T11:55:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.966+0000 7f07b491c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b015fb00 con 0x7f07b00b4c10 2023-11-28T11:55:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.966+0000 7f07af7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07b006a530 0x7f07b015f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.966+0000 7f07af7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07b006a530 0x7f07b015f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33944/0 (socket says 172.21.15.50:33944) 2023-11-28T11:55:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.966+0000 7f07af7fe700 1 -- 172.21.15.50:0/1099682449 learned_addr learned my addr 172.21.15.50:0/1099682449 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.966+0000 7f07affff700 1 --2- 172.21.15.50:0/1099682449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07b00cf050 0x7f07b009cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.966+0000 7f07a6ffd700 1 --2- 172.21.15.50:0/1099682449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07b00b4c10 0x7f07b009c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.970+0000 7f07af7fe700 1 -- 172.21.15.50:0/1099682449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07b00b4c10 msgr2=0x7f07b009c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.970+0000 7f07af7fe700 1 --2- 172.21.15.50:0/1099682449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07b00b4c10 0x7f07b009c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.970+0000 7f07af7fe700 1 -- 172.21.15.50:0/1099682449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07b00cf050 msgr2=0x7f07b009cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.970+0000 7f07af7fe700 1 --2- 172.21.15.50:0/1099682449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07b00cf050 0x7f07b009cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:49.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.970+0000 7f07af7fe700 1 -- 172.21.15.50:0/1099682449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a0009570 con 0x7f07b006a530 2023-11-28T11:55:49.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.970+0000 7f07af7fe700 1 --2- 172.21.15.50:0/1099682449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07b006a530 0x7f07b015f5c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f07a0000c00 tx=0x7f07a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:49.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.970+0000 7f07acff9700 1 -- 172.21.15.50:0/1099682449 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a0004590 con 0x7f07b006a530 2023-11-28T11:55:49.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.970+0000 7f07acff9700 1 -- 172.21.15.50:0/1099682449 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a001e070 con 0x7f07b006a530 2023-11-28T11:55:49.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.970+0000 7f07b491c700 1 -- 172.21.15.50:0/1099682449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b00b4410 con 0x7f07b006a530 2023-11-28T11:55:49.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.970+0000 7f07acff9700 1 -- 172.21.15.50:0/1099682449 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a0003900 con 0x7f07b006a530 2023-11-28T11:55:49.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.970+0000 7f07b491c700 1 -- 172.21.15.50:0/1099682449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b006af40 con 0x7f07b006a530 2023-11-28T11:55:49.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.970+0000 7f07b491c700 1 -- 172.21.15.50:0/1099682449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b00b46f0 con 0x7f07b006a530 2023-11-28T11:55:49.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.970+0000 7f07acff9700 1 -- 172.21.15.50:0/1099682449 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f07a000f050 con 0x7f07b006a530 2023-11-28T11:55:49.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.970+0000 7f07acff9700 1 --2- 172.21.15.50:0/1099682449 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0790064ee0 0x7f0790067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:49.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.974+0000 7f07acff9700 1 -- 172.21.15.50:0/1099682449 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f07a0082870 con 0x7f07b006a530 2023-11-28T11:55:49.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.974+0000 7f07a6ffd700 1 --2- 172.21.15.50:0/1099682449 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0790064ee0 0x7f0790067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:49.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.974+0000 7f07a6ffd700 1 --2- 172.21.15.50:0/1099682449 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0790064ee0 0x7f0790067390 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f07b006ccc0 tx=0x7f0798008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:49.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:49.978+0000 7f07acff9700 1 -- 172.21.15.50:0/1099682449 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f07a0050b00 con 0x7f07b006a530 2023-11-28T11:55:50.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.202+0000 7f07b491c700 1 -- 172.21.15.50:0/1099682449 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f07b0072500 con 0x7f07b006a530 2023-11-28T11:55:50.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.498+0000 7f07acff9700 1 -- 172.21.15.50:0/1099682449 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v133) v1 ==== 142+0+0 (secure 0 0 0) 0x7f07a00200d0 con 0x7f07b006a530 2023-11-28T11:55:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.502+0000 7f07b491c700 1 -- 172.21.15.50:0/1099682449 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0790064ee0 msgr2=0x7f0790067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.502+0000 7f07b491c700 1 --2- 172.21.15.50:0/1099682449 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0790064ee0 0x7f0790067390 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f07b006ccc0 tx=0x7f0798008040 comp rx=0 tx=0).stop 2023-11-28T11:55:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.502+0000 7f07b491c700 1 -- 172.21.15.50:0/1099682449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07b006a530 msgr2=0x7f07b015f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.502+0000 7f07b491c700 1 --2- 172.21.15.50:0/1099682449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07b006a530 0x7f07b015f5c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f07a0000c00 tx=0x7f07a0004770 comp rx=0 tx=0).stop 2023-11-28T11:55:50.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.502+0000 7f07b491c700 1 -- 172.21.15.50:0/1099682449 shutdown_connections 2023-11-28T11:55:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.502+0000 7f07b491c700 1 --2- 172.21.15.50:0/1099682449 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0790064ee0 0x7f0790067390 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.502+0000 7f07b491c700 1 --2- 172.21.15.50:0/1099682449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07b00cf050 0x7f07b009cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.502+0000 7f07b491c700 1 --2- 172.21.15.50:0/1099682449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07b00b4c10 0x7f07b009c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.502+0000 7f07b491c700 1 --2- 172.21.15.50:0/1099682449 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07b006a530 0x7f07b015f5c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.502+0000 7f07b491c700 1 -- 172.21.15.50:0/1099682449 >> 172.21.15.50:0/1099682449 conn(0x7f07b009bb30 msgr2=0x7f07b00b33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.502+0000 7f07b491c700 1 -- 172.21.15.50:0/1099682449 shutdown_connections 2023-11-28T11:55:50.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.502+0000 7f07b491c700 1 -- 172.21.15.50:0/1099682449 wait complete. 2023-11-28T11:55:50.521 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2023-11-28T11:55:50.522 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2023-11-28T11:55:50.522 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T11:55:50.522 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-11-28T11:55:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.634+0000 7f0cae6c5700 1 Processor -- start 2023-11-28T11:55:50.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.634+0000 7f0cae6c5700 1 -- start start 2023-11-28T11:55:50.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.634+0000 7f0cae6c5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca8159e70 0x7f0ca806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:50.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.634+0000 7f0cae6c5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ca8069c40 0x7f0ca80cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:50.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.634+0000 7f0cae6c5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca806ace0 con 0x7f0ca806cee0 2023-11-28T11:55:50.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.634+0000 7f0cae6c5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca806a0d0 con 0x7f0ca8069c40 2023-11-28T11:55:50.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.634+0000 7f0cae6c5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca806a3b0 con 0x7f0ca8159e70 2023-11-28T11:55:50.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.634+0000 7f0cacec2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ca8069c40 0x7f0ca80cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:50.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.634+0000 7f0cadec4700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0ca806cee0 0x7f0ca80b32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:51388/0 (socket says 172.21.15.50:51388) 2023-11-28T11:55:50.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.634+0000 7f0cadec4700 1 -- 172.21.15.50:0/3239997411 learned_addr learned my addr 172.21.15.50:0/3239997411 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:50.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.634+0000 7f0cad6c3700 1 --2- 172.21.15.50:0/3239997411 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca8159e70 0x7f0ca806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:50.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0c9ffff700 1 -- 172.21.15.50:0/3239997411 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003705907 0 0) 0x7f0ca806ace0 con 0x7f0ca806cee0 2023-11-28T11:55:50.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0c9ffff700 1 -- 172.21.15.50:0/3239997411 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c940035d0 con 0x7f0ca806cee0 2023-11-28T11:55:50.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0cacec2700 1 -- 172.21.15.50:0/3239997411 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca8159e70 msgr2=0x7f0ca806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:50.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0cacec2700 1 --2- 172.21.15.50:0/3239997411 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca8159e70 0x7f0ca806c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:50.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0cacec2700 1 -- 172.21.15.50:0/3239997411 >> v1:172.21.15.50:6789/0 conn(0x7f0ca806cee0 legacy=0x7f0ca80b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0cacec2700 1 -- 172.21.15.50:0/3239997411 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca806a690 con 0x7f0ca8069c40 2023-11-28T11:55:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0cacec2700 1 --2- 172.21.15.50:0/3239997411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca8069c40 0x7f0ca80cad60 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009850 tx=0x7f0ca4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac57d640c412a7d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0c9ffff700 1 -- 172.21.15.50:0/3239997411 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4011830 con 0x7f0ca8069c40 2023-11-28T11:55:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0c9ffff700 1 -- 172.21.15.50:0/3239997411 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca4011990 con 0x7f0ca8069c40 2023-11-28T11:55:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0c9ffff700 1 -- 172.21.15.50:0/3239997411 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4011d40 con 0x7f0ca8069c40 2023-11-28T11:55:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0cae6c5700 1 -- 172.21.15.50:0/3239997411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca8069c40 msgr2=0x7f0ca80cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0cae6c5700 1 --2- 172.21.15.50:0/3239997411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca8069c40 0x7f0ca80cad60 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009850 tx=0x7f0ca4009b60 comp rx=0 tx=0).stop 2023-11-28T11:55:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0cae6c5700 1 -- 172.21.15.50:0/3239997411 shutdown_connections 2023-11-28T11:55:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0cae6c5700 1 --2- 172.21.15.50:0/3239997411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca8069c40 0x7f0ca80cad60 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0cae6c5700 1 --2- 172.21.15.50:0/3239997411 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca8159e70 0x7f0ca806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:50.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0cae6c5700 1 -- 172.21.15.50:0/3239997411 >> 172.21.15.50:0/3239997411 conn(0x7f0ca80ce3e0 msgr2=0x7f0ca80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:50.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0cae6c5700 1 -- 172.21.15.50:0/3239997411 shutdown_connections 2023-11-28T11:55:50.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.638+0000 7f0cae6c5700 1 -- 172.21.15.50:0/3239997411 wait complete. 2023-11-28T11:55:50.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.642+0000 7f0cae6c5700 1 Processor -- start 2023-11-28T11:55:50.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.642+0000 7f0cae6c5700 1 -- start start 2023-11-28T11:55:50.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cae6c5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca8069c40 0x7f0ca815c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:50.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cae6c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca806cee0 0x7f0ca815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:50.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cae6c5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ca8159e70 0x7f0ca8070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:50.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cae6c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca815d000 con 0x7f0ca806cee0 2023-11-28T11:55:50.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cae6c5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80c1f90 con 0x7f0ca8159e70 2023-11-28T11:55:50.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cae6c5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80c2270 con 0x7f0ca8069c40 2023-11-28T11:55:50.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cacec2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca806cee0 0x7f0ca815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:50.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cacec2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca806cee0 0x7f0ca815cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33954/0 (socket says 172.21.15.50:33954) 2023-11-28T11:55:50.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cacec2700 1 -- 172.21.15.50:0/201166118 learned_addr learned my addr 172.21.15.50:0/201166118 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:50.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cad6c3700 1 --2- 172.21.15.50:0/201166118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca8069c40 0x7f0ca815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:50.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cadec4700 1 --2- 172.21.15.50:0/201166118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ca8159e70 0x7f0ca8070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:50.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cacec2700 1 -- 172.21.15.50:0/201166118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca8069c40 msgr2=0x7f0ca815c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:50.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cacec2700 1 --2- 172.21.15.50:0/201166118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca8069c40 0x7f0ca815c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:50.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cacec2700 1 -- 172.21.15.50:0/201166118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ca8159e70 msgr2=0x7f0ca8070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:50.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cacec2700 1 --2- 172.21.15.50:0/201166118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ca8159e70 0x7f0ca8070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:50.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cacec2700 1 -- 172.21.15.50:0/201166118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca40094b0 con 0x7f0ca806cee0 2023-11-28T11:55:50.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cadec4700 1 --2- 172.21.15.50:0/201166118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ca8159e70 0x7f0ca8070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:50.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cacec2700 1 --2- 172.21.15.50:0/201166118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca806cee0 0x7f0ca815cac0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40090b0 tx=0x7f0ca4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:50.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0c9dffb700 1 -- 172.21.15.50:0/201166118 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4004380 con 0x7f0ca806cee0 2023-11-28T11:55:50.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0c9dffb700 1 -- 172.21.15.50:0/201166118 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca401f070 con 0x7f0ca806cee0 2023-11-28T11:55:50.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0c9dffb700 1 -- 172.21.15.50:0/201166118 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca40036c0 con 0x7f0ca806cee0 2023-11-28T11:55:50.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cae6c5700 1 -- 172.21.15.50:0/201166118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca815a240 con 0x7f0ca806cee0 2023-11-28T11:55:50.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cae6c5700 1 -- 172.21.15.50:0/201166118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca806a970 con 0x7f0ca806cee0 2023-11-28T11:55:50.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0cae6c5700 1 -- 172.21.15.50:0/201166118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca80ca1e0 con 0x7f0ca806cee0 2023-11-28T11:55:50.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.646+0000 7f0c9dffb700 1 -- 172.21.15.50:0/201166118 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0ca400f050 con 0x7f0ca806cee0 2023-11-28T11:55:50.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.650+0000 7f0c9dffb700 1 --2- 172.21.15.50:0/201166118 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0c8c064ee0 0x7f0c8c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:50.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.650+0000 7f0c9dffb700 1 -- 172.21.15.50:0/201166118 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0ca4082960 con 0x7f0ca806cee0 2023-11-28T11:55:50.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.650+0000 7f0cad6c3700 1 --2- 172.21.15.50:0/201166118 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0c8c064ee0 0x7f0c8c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:50.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.650+0000 7f0cad6c3700 1 --2- 172.21.15.50:0/201166118 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0c8c064ee0 0x7f0c8c067390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0ca806fca0 tx=0x7f0c98009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:50.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.654+0000 7f0c9dffb700 1 -- 172.21.15.50:0/201166118 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0ca4050cc0 con 0x7f0ca806cee0 2023-11-28T11:55:50.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:50.874+0000 7f0cae6c5700 1 -- 172.21.15.50:0/201166118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f0ca8072500 con 0x7f0ca806cee0 2023-11-28T11:55:51.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.506+0000 7f0c9dffb700 1 -- 172.21.15.50:0/201166118 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v134) v1 ==== 152+0+0 (secure 0 0 0) 0x7f0ca4006ce0 con 0x7f0ca806cee0 2023-11-28T11:55:51.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.510+0000 7f0cae6c5700 1 -- 172.21.15.50:0/201166118 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0c8c064ee0 msgr2=0x7f0c8c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.510+0000 7f0cae6c5700 1 --2- 172.21.15.50:0/201166118 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0c8c064ee0 0x7f0c8c067390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0ca806fca0 tx=0x7f0c98009240 comp rx=0 tx=0).stop 2023-11-28T11:55:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.510+0000 7f0cae6c5700 1 -- 172.21.15.50:0/201166118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca806cee0 msgr2=0x7f0ca815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.510+0000 7f0cae6c5700 1 --2- 172.21.15.50:0/201166118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca806cee0 0x7f0ca815cac0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40090b0 tx=0x7f0ca4004770 comp rx=0 tx=0).stop 2023-11-28T11:55:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.510+0000 7f0cae6c5700 1 -- 172.21.15.50:0/201166118 shutdown_connections 2023-11-28T11:55:51.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.510+0000 7f0cae6c5700 1 --2- 172.21.15.50:0/201166118 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0c8c064ee0 0x7f0c8c067390 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:51.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.510+0000 7f0cae6c5700 1 --2- 172.21.15.50:0/201166118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ca8159e70 0x7f0ca8070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:51.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.510+0000 7f0cae6c5700 1 --2- 172.21.15.50:0/201166118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ca806cee0 0x7f0ca815cac0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:51.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.510+0000 7f0cae6c5700 1 --2- 172.21.15.50:0/201166118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca8069c40 0x7f0ca815c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:51.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.510+0000 7f0cae6c5700 1 -- 172.21.15.50:0/201166118 >> 172.21.15.50:0/201166118 conn(0x7f0ca80ce3e0 msgr2=0x7f0ca80cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:51.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.510+0000 7f0cae6c5700 1 -- 172.21.15.50:0/201166118 shutdown_connections 2023-11-28T11:55:51.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.510+0000 7f0cae6c5700 1 -- 172.21.15.50:0/201166118 wait complete. 2023-11-28T11:55:51.528 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T11:55:51.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.658+0000 7f44cf59e700 1 Processor -- start 2023-11-28T11:55:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.658+0000 7f44cf59e700 1 -- start start 2023-11-28T11:55:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.658+0000 7f44cf59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f44d00cf7f0 0x7f44d006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.658+0000 7f44cf59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d006a9c0 con 0x7f44d006a4c0 2023-11-28T11:55:51.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.658+0000 7f44cf59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d006aca0 con 0x7f44d00b1ae0 2023-11-28T11:55:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.658+0000 7f44cf59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d00d0ab0 con 0x7f44d00cf7f0 2023-11-28T11:55:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.658+0000 7f44c5d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f44d006a4c0 0x7f44d00cf0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57014/0 (socket says 172.21.15.50:57014) 2023-11-28T11:55:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.658+0000 7f44c5d9b700 1 -- 172.21.15.50:0/29872635 learned_addr learned my addr 172.21.15.50:0/29872635 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:51.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.658+0000 7f44ced9d700 1 --2- 172.21.15.50:0/29872635 >> v2:172.21.15.192:3300/0 conn(0x7f44d00cf7f0 0x7f44d006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.658+0000 7f44cdd9b700 1 -- 172.21.15.50:0/29872635 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250449906 0 0) 0x7f44d006a9c0 con 0x7f44d006a4c0 2023-11-28T11:55:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.658+0000 7f44cdd9b700 1 -- 172.21.15.50:0/29872635 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44b00035d0 con 0x7f44d006a4c0 2023-11-28T11:55:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.658+0000 7f44ced9d700 1 -- 172.21.15.50:0/29872635 >> v1:172.21.15.192:6789/0 conn(0x7f44d00b1ae0 legacy=0x7f44d00d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:51.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.658+0000 7f44ced9d700 1 -- 172.21.15.50:0/29872635 >> v1:172.21.15.50:6789/0 conn(0x7f44d006a4c0 legacy=0x7f44d00cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.658+0000 7f44ced9d700 1 -- 172.21.15.50:0/29872635 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d006af80 con 0x7f44d00cf7f0 2023-11-28T11:55:51.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.658+0000 7f44ced9d700 1 --2- 172.21.15.50:0/29872635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d00cf7f0 0x7f44d006d8e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009d90 tx=0x7f44c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3091867481df304b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:51.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.662+0000 7f44cdd9b700 1 -- 172.21.15.50:0/29872635 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c800e070 con 0x7f44d00cf7f0 2023-11-28T11:55:51.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.662+0000 7f44cdd9b700 1 -- 172.21.15.50:0/29872635 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c800bb20 con 0x7f44d00cf7f0 2023-11-28T11:55:51.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.662+0000 7f44cdd9b700 1 -- 172.21.15.50:0/29872635 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8012430 con 0x7f44d00cf7f0 2023-11-28T11:55:51.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.662+0000 7f44cf59e700 1 -- 172.21.15.50:0/29872635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d00cf7f0 msgr2=0x7f44d006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:51.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.662+0000 7f44cf59e700 1 --2- 172.21.15.50:0/29872635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d00cf7f0 0x7f44d006d8e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009d90 tx=0x7f44c800b330 comp rx=0 tx=0).stop 2023-11-28T11:55:51.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.662+0000 7f44cf59e700 1 -- 172.21.15.50:0/29872635 shutdown_connections 2023-11-28T11:55:51.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.662+0000 7f44cf59e700 1 --2- 172.21.15.50:0/29872635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d00cf7f0 0x7f44d006d8e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:51.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.662+0000 7f44cf59e700 1 -- 172.21.15.50:0/29872635 >> 172.21.15.50:0/29872635 conn(0x7f44d009bbd0 msgr2=0x7f44d00b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:51.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.662+0000 7f44cf59e700 1 -- 172.21.15.50:0/29872635 shutdown_connections 2023-11-28T11:55:51.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.662+0000 7f44cf59e700 1 -- 172.21.15.50:0/29872635 wait complete. 2023-11-28T11:55:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.662+0000 7f44cf59e700 1 Processor -- start 2023-11-28T11:55:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.662+0000 7f44cf59e700 1 -- start start 2023-11-28T11:55:51.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44cf59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44d006a4c0 0x7f44d00c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44cf59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d00b1ae0 0x7f44d015c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44cf59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d00cf7f0 0x7f44d014a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44cf59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d014b3a0 con 0x7f44d00b1ae0 2023-11-28T11:55:51.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44cf59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d014b680 con 0x7f44d00cf7f0 2023-11-28T11:55:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44cf59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d014b960 con 0x7f44d006a4c0 2023-11-28T11:55:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44c5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d00b1ae0 0x7f44d015c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44ce59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44d006a4c0 0x7f44d00c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44ced9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d00cf7f0 0x7f44d014a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44ced9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d00cf7f0 0x7f44d014a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:60728/0 (socket says 172.21.15.50:60728) 2023-11-28T11:55:51.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44ced9d700 1 -- 172.21.15.50:0/892311926 learned_addr learned my addr 172.21.15.50:0/892311926 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44c5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d00b1ae0 0x7f44d015c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36378/0 (socket says 172.21.15.50:36378) 2023-11-28T11:55:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44ce59c700 1 -- 172.21.15.50:0/892311926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d00cf7f0 msgr2=0x7f44d014a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44ce59c700 1 --2- 172.21.15.50:0/892311926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d00cf7f0 0x7f44d014a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44ce59c700 1 -- 172.21.15.50:0/892311926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d00b1ae0 msgr2=0x7f44d015c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44ce59c700 1 --2- 172.21.15.50:0/892311926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d00b1ae0 0x7f44d015c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:51.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44ce59c700 1 -- 172.21.15.50:0/892311926 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c8009a70 con 0x7f44d006a4c0 2023-11-28T11:55:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44c5d9b700 1 --2- 172.21.15.50:0/892311926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d00b1ae0 0x7f44d015c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44ce59c700 1 --2- 172.21.15.50:0/892311926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44d006a4c0 0x7f44d00c7bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f44c000c410 tx=0x7f44c0001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44c77fe700 1 -- 172.21.15.50:0/892311926 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c00052d0 con 0x7f44d006a4c0 2023-11-28T11:55:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44c77fe700 1 -- 172.21.15.50:0/892311926 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c0005430 con 0x7f44d006a4c0 2023-11-28T11:55:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44cf59e700 1 -- 172.21.15.50:0/892311926 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d00b1eb0 con 0x7f44d006a4c0 2023-11-28T11:55:51.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44c77fe700 1 -- 172.21.15.50:0/892311926 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c00055a0 con 0x7f44d006a4c0 2023-11-28T11:55:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44cf59e700 1 -- 172.21.15.50:0/892311926 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d00b4380 con 0x7f44d006a4c0 2023-11-28T11:55:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.666+0000 7f44cf59e700 1 -- 172.21.15.50:0/892311926 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d00b60e0 con 0x7f44d006a4c0 2023-11-28T11:55:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.670+0000 7f44c77fe700 1 -- 172.21.15.50:0/892311926 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f44c0019030 con 0x7f44d006a4c0 2023-11-28T11:55:51.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.670+0000 7f44c77fe700 1 --2- 172.21.15.50:0/892311926 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f44b4064ee0 0x7f44b4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:51.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.670+0000 7f44c77fe700 1 -- 172.21.15.50:0/892311926 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f44c0080e10 con 0x7f44d006a4c0 2023-11-28T11:55:51.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.670+0000 7f44c5d9b700 1 --2- 172.21.15.50:0/892311926 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f44b4064ee0 0x7f44b4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:51.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.670+0000 7f44c5d9b700 1 --2- 172.21.15.50:0/892311926 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f44b4064ee0 0x7f44b4067390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f44d01f4d30 tx=0x7f44b8007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:51.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.682+0000 7f44c77fe700 1 -- 172.21.15.50:0/892311926 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f44c004f170 con 0x7f44d006a4c0 2023-11-28T11:55:51.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.846+0000 7f44cf59e700 1 -- 172.21.15.50:0/892311926 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f44d0072500 con 0x7f44d006a4c0 2023-11-28T11:55:51.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.858+0000 7f44c77fe700 1 -- 172.21.15.50:0/892311926 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f44c0052790 con 0x7f44d006a4c0 2023-11-28T11:55:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.858+0000 7f44cf59e700 1 -- 172.21.15.50:0/892311926 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f44b4064ee0 msgr2=0x7f44b4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:51.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.858+0000 7f44cf59e700 1 --2- 172.21.15.50:0/892311926 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f44b4064ee0 0x7f44b4067390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f44d01f4d30 tx=0x7f44b8007de0 comp rx=0 tx=0).stop 2023-11-28T11:55:51.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.858+0000 7f44cf59e700 1 -- 172.21.15.50:0/892311926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44d006a4c0 msgr2=0x7f44d00c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:51.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.858+0000 7f44cf59e700 1 --2- 172.21.15.50:0/892311926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44d006a4c0 0x7f44d00c7bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f44c000c410 tx=0x7f44c0001e70 comp rx=0 tx=0).stop 2023-11-28T11:55:51.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.858+0000 7f44cf59e700 1 -- 172.21.15.50:0/892311926 shutdown_connections 2023-11-28T11:55:51.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.858+0000 7f44cf59e700 1 --2- 172.21.15.50:0/892311926 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f44b4064ee0 0x7f44b4067390 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:51.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.858+0000 7f44cf59e700 1 --2- 172.21.15.50:0/892311926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d00cf7f0 0x7f44d014a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:51.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.858+0000 7f44cf59e700 1 --2- 172.21.15.50:0/892311926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d00b1ae0 0x7f44d015c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:51.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.858+0000 7f44cf59e700 1 --2- 172.21.15.50:0/892311926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44d006a4c0 0x7f44d00c7bb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:51.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.858+0000 7f44cf59e700 1 -- 172.21.15.50:0/892311926 >> 172.21.15.50:0/892311926 conn(0x7f44d009bbd0 msgr2=0x7f44d015bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:51.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.858+0000 7f44cf59e700 1 -- 172.21.15.50:0/892311926 shutdown_connections 2023-11-28T11:55:51.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:51.858+0000 7f44cf59e700 1 -- 172.21.15.50:0/892311926 wait complete. 2023-11-28T11:55:51.877 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:55:51.878 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:55:51.899 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:55:51.919 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:55:51.919 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:55:51.919 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:55:51.928 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349436k,nr_inodes=4087359,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20953 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276116k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:55:51.928 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:55:51.928 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:55:51.936 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17871 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:55:51.936 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:55:51.936 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:55:51.943 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349436k,nr_inodes=4087359,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20953 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276116k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:55:51.943 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:55:51.943 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:55:51.985 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17871 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:55:51.985 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T11:55:51.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:55:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd5522ee700 1 Processor -- start 2023-11-28T11:55:52.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd5522ee700 1 -- start start 2023-11-28T11:55:52.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd5522ee700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd54c06a330 0x7fd54c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:52.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd5522ee700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd54c0d2780 0x7fd54c0d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:52.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd5522ee700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c0cf070 con 0x7fd54c0b1ca0 2023-11-28T11:55:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd5522ee700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54c0d3160 con 0x7fd54c0d2780 2023-11-28T11:55:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd5522ee700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0b2070 con 0x7fd54c06a330 2023-11-28T11:55:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd5512ec700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd54c0b1ca0 0x7fd54c0cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57030/0 (socket says 172.21.15.50:57030) 2023-11-28T11:55:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd5512ec700 1 -- 172.21.15.50:0/3624126447 learned_addr learned my addr 172.21.15.50:0/3624126447 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd550aeb700 1 --2- 172.21.15.50:0/3624126447 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd54c06a330 0x7fd54c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:52.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd551aed700 1 --2- 172.21.15.50:0/3624126447 >> v2:172.21.15.192:3300/0 conn(0x7fd54c0d2780 0x7fd54c0d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd543fff700 1 -- 172.21.15.50:0/3624126447 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025687168 0 0) 0x7fd54c0cf070 con 0x7fd54c0b1ca0 2023-11-28T11:55:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd543fff700 1 -- 172.21.15.50:0/3624126447 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5340035d0 con 0x7fd54c0b1ca0 2023-11-28T11:55:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd550aeb700 1 -- 172.21.15.50:0/3624126447 >> v2:172.21.15.192:3300/0 conn(0x7fd54c0d2780 msgr2=0x7fd54c0d2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:52.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd550aeb700 1 --2- 172.21.15.50:0/3624126447 >> v2:172.21.15.192:3300/0 conn(0x7fd54c0d2780 0x7fd54c0d2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd550aeb700 1 -- 172.21.15.50:0/3624126447 >> v1:172.21.15.50:6789/0 conn(0x7fd54c0b1ca0 legacy=0x7fd54c0cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd550aeb700 1 -- 172.21.15.50:0/3624126447 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c06a8a0 con 0x7fd54c06a330 2023-11-28T11:55:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd550aeb700 1 --2- 172.21.15.50:0/3624126447 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd54c06a330 0x7fd54c0b6250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd544009d90 tx=0x7fd54400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5509b3f58be6034a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd543fff700 1 -- 172.21.15.50:0/3624126447 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54400e070 con 0x7fd54c06a330 2023-11-28T11:55:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd543fff700 1 -- 172.21.15.50:0/3624126447 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54400bb20 con 0x7fd54c06a330 2023-11-28T11:55:52.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.106+0000 7fd543fff700 1 -- 172.21.15.50:0/3624126447 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54400be90 con 0x7fd54c06a330 2023-11-28T11:55:52.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd5522ee700 1 -- 172.21.15.50:0/3624126447 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd54c06a330 msgr2=0x7fd54c0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:52.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd5522ee700 1 --2- 172.21.15.50:0/3624126447 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd54c06a330 0x7fd54c0b6250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd544009d90 tx=0x7fd54400b330 comp rx=0 tx=0).stop 2023-11-28T11:55:52.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd5522ee700 1 -- 172.21.15.50:0/3624126447 shutdown_connections 2023-11-28T11:55:52.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd5522ee700 1 --2- 172.21.15.50:0/3624126447 >> v2:172.21.15.192:3300/0 conn(0x7fd54c0d2780 0x7fd54c0d2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:52.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd5522ee700 1 --2- 172.21.15.50:0/3624126447 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd54c06a330 0x7fd54c0b6250 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd5522ee700 1 -- 172.21.15.50:0/3624126447 >> 172.21.15.50:0/3624126447 conn(0x7fd54c0b5740 msgr2=0x7fd54c0b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd5522ee700 1 -- 172.21.15.50:0/3624126447 shutdown_connections 2023-11-28T11:55:52.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd5522ee700 1 -- 172.21.15.50:0/3624126447 wait complete. 2023-11-28T11:55:52.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd5522ee700 1 Processor -- start 2023-11-28T11:55:52.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd5522ee700 1 -- start start 2023-11-28T11:55:52.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd5522ee700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd54c06a330 0x7fd54c152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:52.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd5522ee700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd54c0b1ca0 0x7fd54c0c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:52.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd5522ee700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd54c0d2780 0x7fd54c0b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:52.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd5522ee700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0b36f0 con 0x7fd54c0d2780 2023-11-28T11:55:52.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd5522ee700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c1f1740 con 0x7fd54c0b1ca0 2023-11-28T11:55:52.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd5522ee700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0b2650 con 0x7fd54c06a330 2023-11-28T11:55:52.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd551aed700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd54c0d2780 0x7fd54c0b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd551aed700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd54c0d2780 0x7fd54c0b7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36382/0 (socket says 172.21.15.50:36382) 2023-11-28T11:55:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd551aed700 1 -- 172.21.15.50:0/2849487847 learned_addr learned my addr 172.21.15.50:0/2849487847 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd550aeb700 1 --2- 172.21.15.50:0/2849487847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd54c0b1ca0 0x7fd54c0c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:52.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.110+0000 7fd5512ec700 1 --2- 172.21.15.50:0/2849487847 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd54c06a330 0x7fd54c152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:52.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.114+0000 7fd551aed700 1 -- 172.21.15.50:0/2849487847 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd54c06a330 msgr2=0x7fd54c152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:52.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.114+0000 7fd551aed700 1 --2- 172.21.15.50:0/2849487847 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd54c06a330 0x7fd54c152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:52.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.114+0000 7fd551aed700 1 -- 172.21.15.50:0/2849487847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd54c0b1ca0 msgr2=0x7fd54c0c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:52.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.114+0000 7fd551aed700 1 --2- 172.21.15.50:0/2849487847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd54c0b1ca0 0x7fd54c0c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:52.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.114+0000 7fd551aed700 1 -- 172.21.15.50:0/2849487847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd544009a70 con 0x7fd54c0d2780 2023-11-28T11:55:52.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.114+0000 7fd551aed700 1 --2- 172.21.15.50:0/2849487847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd54c0d2780 0x7fd54c0b7790 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00eb60 tx=0x7fd53c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:52.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.114+0000 7fd541ffb700 1 -- 172.21.15.50:0/2849487847 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c009740 con 0x7fd54c0d2780 2023-11-28T11:55:52.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.114+0000 7fd541ffb700 1 -- 172.21.15.50:0/2849487847 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c009e00 con 0x7fd54c0d2780 2023-11-28T11:55:52.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.114+0000 7fd5522ee700 1 -- 172.21.15.50:0/2849487847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54c06ae60 con 0x7fd54c0d2780 2023-11-28T11:55:52.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.114+0000 7fd541ffb700 1 -- 172.21.15.50:0/2849487847 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00ca70 con 0x7fd54c0d2780 2023-11-28T11:55:52.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.114+0000 7fd5522ee700 1 -- 172.21.15.50:0/2849487847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54c06ab80 con 0x7fd54c0d2780 2023-11-28T11:55:52.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.114+0000 7fd541ffb700 1 -- 172.21.15.50:0/2849487847 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd53c019030 con 0x7fd54c0d2780 2023-11-28T11:55:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.114+0000 7fd5522ee700 1 -- 172.21.15.50:0/2849487847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54c06b140 con 0x7fd54c0d2780 2023-11-28T11:55:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.114+0000 7fd541ffb700 1 --2- 172.21.15.50:0/2849487847 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd538064ee0 0x7fd538067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.114+0000 7fd541ffb700 1 -- 172.21.15.50:0/2849487847 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fd53c081c20 con 0x7fd54c0d2780 2023-11-28T11:55:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.118+0000 7fd5512ec700 1 --2- 172.21.15.50:0/2849487847 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd538064ee0 0x7fd538067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.118+0000 7fd5512ec700 1 --2- 172.21.15.50:0/2849487847 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd538064ee0 0x7fd538067390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd548007fd0 tx=0x7fd548009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:52.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.122+0000 7fd541ffb700 1 -- 172.21.15.50:0/2849487847 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd53c04fe30 con 0x7fd54c0d2780 2023-11-28T11:55:52.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.318+0000 7fd5522ee700 1 -- 172.21.15.50:0/2849487847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd54c072c20 con 0x7fd54c0d2780 2023-11-28T11:55:52.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.318+0000 7fd541ffb700 1 -- 172.21.15.50:0/2849487847 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fd53c017de0 con 0x7fd54c0d2780 2023-11-28T11:55:52.321 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:52.321 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5150,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2392153383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2392153383},{"type":"v1","addr":"172.21.15.192:6837","nonce":2392153383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5515,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3694451276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3694451276},{"type":"v1","addr":"172.21.15.192:6835","nonce":3694451276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2782289763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2782289763},{"type":"v1","addr":"172.21.15.50:6833","nonce":2782289763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3926244593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3926244593},{"type":"v1","addr":"172.21.15.50:6835","nonce":3926244593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-11-28T11:55:52.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.318+0000 7fd5522ee700 1 -- 172.21.15.50:0/2849487847 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd538064ee0 msgr2=0x7fd538067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:52.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.318+0000 7fd5522ee700 1 --2- 172.21.15.50:0/2849487847 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd538064ee0 0x7fd538067390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd548007fd0 tx=0x7fd548009040 comp rx=0 tx=0).stop 2023-11-28T11:55:52.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.318+0000 7fd5522ee700 1 -- 172.21.15.50:0/2849487847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd54c0d2780 msgr2=0x7fd54c0b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:52.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.318+0000 7fd5522ee700 1 --2- 172.21.15.50:0/2849487847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd54c0d2780 0x7fd54c0b7790 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00eb60 tx=0x7fd53c00ee70 comp rx=0 tx=0).stop 2023-11-28T11:55:52.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.322+0000 7fd5522ee700 1 -- 172.21.15.50:0/2849487847 shutdown_connections 2023-11-28T11:55:52.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.322+0000 7fd5522ee700 1 --2- 172.21.15.50:0/2849487847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd54c0d2780 0x7fd54c0b7790 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:52.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.322+0000 7fd5522ee700 1 --2- 172.21.15.50:0/2849487847 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd538064ee0 0x7fd538067390 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:52.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.322+0000 7fd5522ee700 1 --2- 172.21.15.50:0/2849487847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd54c0b1ca0 0x7fd54c0c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:52.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.322+0000 7fd5522ee700 1 --2- 172.21.15.50:0/2849487847 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd54c06a330 0x7fd54c152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:52.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.322+0000 7fd5522ee700 1 -- 172.21.15.50:0/2849487847 >> 172.21.15.50:0/2849487847 conn(0x7fd54c0b5740 msgr2=0x7fd54c15bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:52.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.322+0000 7fd5522ee700 1 -- 172.21.15.50:0/2849487847 shutdown_connections 2023-11-28T11:55:52.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.322+0000 7fd5522ee700 1 -- 172.21.15.50:0/2849487847 wait complete. 2023-11-28T11:55:52.325 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 19 2023-11-28T11:55:52.337 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T11:55:52.337 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T11:55:52.338 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T11:55:52.338 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:55:52.338 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T11:55:52.338 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T11:55:52.338 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T11:55:52.338 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:55:52.339 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T11:55:52.339 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T11:55:52.339 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T11:55:52.339 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:55:52.339 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T11:55:52.339 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T11:55:52.339 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T11:55:52.339 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:55:52.351 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T11:55:52.352 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T11:55:52.354 INFO:tasks.ceph.mds.a:Started 2023-11-28T11:55:52.354 DEBUG:teuthology.parallel:result is None 2023-11-28T11:55:52.355 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T11:55:52.355 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T11:55:52.356 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T11:55:52.356 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T11:55:52.357 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T11:55:52.357 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T11:55:52.358 INFO:tasks.ceph.mds.d:Started 2023-11-28T11:55:52.359 DEBUG:teuthology.parallel:result is None 2023-11-28T11:55:52.360 INFO:tasks.ceph.mds.c:Started 2023-11-28T11:55:52.360 DEBUG:teuthology.parallel:result is None 2023-11-28T11:55:52.360 INFO:tasks.ceph.mds.b:Started 2023-11-28T11:55:52.361 DEBUG:teuthology.parallel:result is None 2023-11-28T11:55:52.361 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T11:55:52.426 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-11-28T11:55:52.426 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-11-28T11:55:52.442 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-11-28T11:55:52.446 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-11-28T11:55:52.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.474+0000 7f7e3d7fe700 1 Processor -- start 2023-11-28T11:55:52.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.474+0000 7f7e3d7fe700 1 -- start start 2023-11-28T11:55:52.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e3d7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7e38152bb0 0x7f7e3815caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:52.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e3d7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e380b3030 0x7f7e3806cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:52.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e3d7fe700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e38152f80 con 0x7f7e3806c640 2023-11-28T11:55:52.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e3d7fe700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3806d020 con 0x7f7e38152bb0 2023-11-28T11:55:52.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e3d7fe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3815cfe0 con 0x7f7e380b3030 2023-11-28T11:55:52.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e377fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7e3806c640 0x7f7e380706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57054/0 (socket says 172.21.15.50:57054) 2023-11-28T11:55:52.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e377fe700 1 -- 172.21.15.50:0/1621283348 learned_addr learned my addr 172.21.15.50:0/1621283348 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:52.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e37fff700 1 --2- 172.21.15.50:0/1621283348 >> v2:172.21.15.192:3300/0 conn(0x7f7e38152bb0 0x7f7e3815caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:52.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e3cffd700 1 --2- 172.21.15.50:0/1621283348 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e380b3030 0x7f7e3806cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:52.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e36ffd700 1 -- 172.21.15.50:0/1621283348 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721672596 0 0) 0x7f7e38152f80 con 0x7f7e3806c640 2023-11-28T11:55:52.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e36ffd700 1 -- 172.21.15.50:0/1621283348 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e200035d0 con 0x7f7e3806c640 2023-11-28T11:55:52.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e37fff700 1 -- 172.21.15.50:0/1621283348 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e380b3030 msgr2=0x7f7e3806cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:52.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e37fff700 1 --2- 172.21.15.50:0/1621283348 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e380b3030 0x7f7e3806cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:52.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e37fff700 1 -- 172.21.15.50:0/1621283348 >> v1:172.21.15.50:6789/0 conn(0x7f7e3806c640 legacy=0x7f7e380706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:52.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e37fff700 1 -- 172.21.15.50:0/1621283348 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e38159a30 con 0x7f7e38152bb0 2023-11-28T11:55:52.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e37fff700 1 --2- 172.21.15.50:0/1621283348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e38152bb0 0x7f7e3815caa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009850 tx=0x7f7e28009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fee07ae28bcf6c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:52.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e36ffd700 1 -- 172.21.15.50:0/1621283348 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28011830 con 0x7f7e38152bb0 2023-11-28T11:55:52.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e36ffd700 1 -- 172.21.15.50:0/1621283348 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e28011990 con 0x7f7e38152bb0 2023-11-28T11:55:52.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.478+0000 7f7e36ffd700 1 -- 172.21.15.50:0/1621283348 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28011d40 con 0x7f7e38152bb0 2023-11-28T11:55:52.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.482+0000 7f7e3d7fe700 1 -- 172.21.15.50:0/1621283348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e38152bb0 msgr2=0x7f7e3815caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:52.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.482+0000 7f7e3d7fe700 1 --2- 172.21.15.50:0/1621283348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e38152bb0 0x7f7e3815caa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009850 tx=0x7f7e28009b60 comp rx=0 tx=0).stop 2023-11-28T11:55:52.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.482+0000 7f7e3d7fe700 1 -- 172.21.15.50:0/1621283348 shutdown_connections 2023-11-28T11:55:52.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.482+0000 7f7e3d7fe700 1 --2- 172.21.15.50:0/1621283348 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e380b3030 0x7f7e3806cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:52.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.482+0000 7f7e3d7fe700 1 --2- 172.21.15.50:0/1621283348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e38152bb0 0x7f7e3815caa0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:52.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.482+0000 7f7e3d7fe700 1 -- 172.21.15.50:0/1621283348 >> 172.21.15.50:0/1621283348 conn(0x7f7e3806e000 msgr2=0x7f7e380b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:52.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.482+0000 7f7e3d7fe700 1 -- 172.21.15.50:0/1621283348 shutdown_connections 2023-11-28T11:55:52.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.482+0000 7f7e3d7fe700 1 -- 172.21.15.50:0/1621283348 wait complete. 2023-11-28T11:55:52.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.482+0000 7f7e3d7fe700 1 Processor -- start 2023-11-28T11:55:52.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.482+0000 7f7e3d7fe700 1 -- start start 2023-11-28T11:55:52.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.482+0000 7f7e3d7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3806c640 0x7f7e38151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:52.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.482+0000 7f7e3d7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e380b3030 0x7f7e38144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:52.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.482+0000 7f7e3d7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e38152bb0 0x7f7e38144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:52.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.482+0000 7f7e3d7fe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e38150ff0 con 0x7f7e380b3030 2023-11-28T11:55:52.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.482+0000 7f7e3d7fe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e38144ff0 con 0x7f7e3806c640 2023-11-28T11:55:52.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.482+0000 7f7e3d7fe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e381452d0 con 0x7f7e38152bb0 2023-11-28T11:55:52.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.482+0000 7f7e377fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e380b3030 0x7f7e38144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:52.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.486+0000 7f7e377fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e380b3030 0x7f7e38144410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36414/0 (socket says 172.21.15.50:36414) 2023-11-28T11:55:52.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.486+0000 7f7e377fe700 1 -- 172.21.15.50:0/431434506 learned_addr learned my addr 172.21.15.50:0/431434506 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:52.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.486+0000 7f7e37fff700 1 --2- 172.21.15.50:0/431434506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3806c640 0x7f7e38151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:52.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.486+0000 7f7e3cffd700 1 --2- 172.21.15.50:0/431434506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e38152bb0 0x7f7e38144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:52.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.486+0000 7f7e377fe700 1 -- 172.21.15.50:0/431434506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e38152bb0 msgr2=0x7f7e38144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:52.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.486+0000 7f7e377fe700 1 --2- 172.21.15.50:0/431434506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e38152bb0 0x7f7e38144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:52.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.486+0000 7f7e377fe700 1 -- 172.21.15.50:0/431434506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3806c640 msgr2=0x7f7e38151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:52.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.486+0000 7f7e377fe700 1 --2- 172.21.15.50:0/431434506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3806c640 0x7f7e38151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:52.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.486+0000 7f7e377fe700 1 -- 172.21.15.50:0/431434506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e280094b0 con 0x7f7e380b3030 2023-11-28T11:55:52.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.486+0000 7f7e37fff700 1 --2- 172.21.15.50:0/431434506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3806c640 0x7f7e38151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:52.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.486+0000 7f7e377fe700 1 --2- 172.21.15.50:0/431434506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e380b3030 0x7f7e38144410 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00c4d0 tx=0x7f7e2c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:52.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.486+0000 7f7e34ff9700 1 -- 172.21.15.50:0/431434506 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c005d90 con 0x7f7e380b3030 2023-11-28T11:55:52.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.486+0000 7f7e34ff9700 1 -- 172.21.15.50:0/431434506 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2c0070d0 con 0x7f7e380b3030 2023-11-28T11:55:52.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.486+0000 7f7e3d7fe700 1 -- 172.21.15.50:0/431434506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e38159190 con 0x7f7e380b3030 2023-11-28T11:55:52.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.486+0000 7f7e34ff9700 1 -- 172.21.15.50:0/431434506 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c007480 con 0x7f7e380b3030 2023-11-28T11:55:52.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.486+0000 7f7e3d7fe700 1 -- 172.21.15.50:0/431434506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e38158eb0 con 0x7f7e380b3030 2023-11-28T11:55:52.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.486+0000 7f7e3d7fe700 1 -- 172.21.15.50:0/431434506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e38159470 con 0x7f7e380b3030 2023-11-28T11:55:52.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.490+0000 7f7e34ff9700 1 -- 172.21.15.50:0/431434506 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7e2c019030 con 0x7f7e380b3030 2023-11-28T11:55:52.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.490+0000 7f7e34ff9700 1 --2- 172.21.15.50:0/431434506 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7e24064ee0 0x7f7e24067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:52.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.490+0000 7f7e34ff9700 1 -- 172.21.15.50:0/431434506 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f7e2c081030 con 0x7f7e380b3030 2023-11-28T11:55:52.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.490+0000 7f7e37fff700 1 --2- 172.21.15.50:0/431434506 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7e24064ee0 0x7f7e24067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:52.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.490+0000 7f7e37fff700 1 --2- 172.21.15.50:0/431434506 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7e24064ee0 0x7f7e24067390 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7e280090b0 tx=0x7f7e28008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:52.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.494+0000 7f7e34ff9700 1 -- 172.21.15.50:0/431434506 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7e2c04f310 con 0x7f7e380b3030 2023-11-28T11:55:52.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:52.670+0000 7f7e3d7fe700 1 -- 172.21.15.50:0/431434506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7e38072c20 con 0x7f7e380b3030 2023-11-28T11:55:53.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.522+0000 7f7e34ff9700 1 -- 172.21.15.50:0/431434506 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v50) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7e2c052930 con 0x7f7e380b3030 2023-11-28T11:55:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.526+0000 7f7e3d7fe700 1 -- 172.21.15.50:0/431434506 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7e24064ee0 msgr2=0x7f7e24067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.526+0000 7f7e3d7fe700 1 --2- 172.21.15.50:0/431434506 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7e24064ee0 0x7f7e24067390 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7e280090b0 tx=0x7f7e28008030 comp rx=0 tx=0).stop 2023-11-28T11:55:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.526+0000 7f7e3d7fe700 1 -- 172.21.15.50:0/431434506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e380b3030 msgr2=0x7f7e38144410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:53.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.526+0000 7f7e3d7fe700 1 --2- 172.21.15.50:0/431434506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e380b3030 0x7f7e38144410 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00c4d0 tx=0x7f7e2c00c7e0 comp rx=0 tx=0).stop 2023-11-28T11:55:53.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.526+0000 7f7e3d7fe700 1 -- 172.21.15.50:0/431434506 shutdown_connections 2023-11-28T11:55:53.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.526+0000 7f7e3d7fe700 1 --2- 172.21.15.50:0/431434506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e38152bb0 0x7f7e38144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:53.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.526+0000 7f7e3d7fe700 1 --2- 172.21.15.50:0/431434506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e380b3030 0x7f7e38144410 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:53.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.526+0000 7f7e3d7fe700 1 --2- 172.21.15.50:0/431434506 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7e24064ee0 0x7f7e24067390 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:53.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.526+0000 7f7e3d7fe700 1 --2- 172.21.15.50:0/431434506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3806c640 0x7f7e38151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:53.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.526+0000 7f7e3d7fe700 1 -- 172.21.15.50:0/431434506 >> 172.21.15.50:0/431434506 conn(0x7f7e3806e000 msgr2=0x7f7e380b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:53.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.526+0000 7f7e3d7fe700 1 -- 172.21.15.50:0/431434506 shutdown_connections 2023-11-28T11:55:53.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.526+0000 7f7e3d7fe700 1 -- 172.21.15.50:0/431434506 wait complete. 2023-11-28T11:55:53.533 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-11-28T11:55:53.548 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T11:55:53.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.662+0000 7fcb7661f700 1 Processor -- start 2023-11-28T11:55:53.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.662+0000 7fcb7661f700 1 -- start start 2023-11-28T11:55:53.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.662+0000 7fcb7661f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb701584c0 0x7fcb700cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:53.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.662+0000 7fcb7661f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb7006ace0 0x7fcb700b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:53.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.662+0000 7fcb7661f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb700b3c60 con 0x7fcb700b32e0 2023-11-28T11:55:53.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.662+0000 7fcb7661f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7006dbd0 con 0x7fcb701584c0 2023-11-28T11:55:53.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.662+0000 7fcb7661f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700cd0f0 con 0x7fcb7006ace0 2023-11-28T11:55:53.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.662+0000 7fcb74e1c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcb700b32e0 0x7fcb7006bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57066/0 (socket says 172.21.15.50:57066) 2023-11-28T11:55:53.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.662+0000 7fcb74e1c700 1 -- 172.21.15.50:0/860552829 learned_addr learned my addr 172.21.15.50:0/860552829 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:53.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.662+0000 7fcb7561d700 1 --2- 172.21.15.50:0/860552829 >> v2:172.21.15.50:3300/0 conn(0x7fcb701584c0 0x7fcb700cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:53.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.662+0000 7fcb75e1e700 1 --2- 172.21.15.50:0/860552829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb7006ace0 0x7fcb700b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:53.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.662+0000 7fcb67fff700 1 -- 172.21.15.50:0/860552829 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067197276 0 0) 0x7fcb700b3c60 con 0x7fcb700b32e0 2023-11-28T11:55:53.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.662+0000 7fcb67fff700 1 -- 172.21.15.50:0/860552829 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb5c0035d0 con 0x7fcb700b32e0 2023-11-28T11:55:53.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.662+0000 7fcb7561d700 1 -- 172.21.15.50:0/860552829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb7006ace0 msgr2=0x7fcb700b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:53.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.662+0000 7fcb7561d700 1 --2- 172.21.15.50:0/860552829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb7006ace0 0x7fcb700b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:53.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.662+0000 7fcb7561d700 1 -- 172.21.15.50:0/860552829 >> v1:172.21.15.50:6789/0 conn(0x7fcb700b32e0 legacy=0x7fcb7006bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:53.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.662+0000 7fcb67fff700 1 -- 172.21.15.50:0/860552829 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 260296637 0 0) 0x7fcb5c0035d0 con 0x7fcb700b32e0 2023-11-28T11:55:53.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.666+0000 7fcb7561d700 1 -- 172.21.15.50:0/860552829 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb700cd3d0 con 0x7fcb701584c0 2023-11-28T11:55:53.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.666+0000 7fcb75e1e700 1 --2- 172.21.15.50:0/860552829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb7006ace0 0x7fcb700b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:53.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.666+0000 7fcb7561d700 1 --2- 172.21.15.50:0/860552829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb701584c0 0x7fcb700cb6f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009850 tx=0x7fcb60009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59af81943c0bd505 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:53.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.666+0000 7fcb67fff700 1 -- 172.21.15.50:0/860552829 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c0019f0 con 0x7fcb701584c0 2023-11-28T11:55:53.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.666+0000 7fcb67fff700 1 -- 172.21.15.50:0/860552829 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb60004030 con 0x7fcb701584c0 2023-11-28T11:55:53.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.666+0000 7fcb67fff700 1 -- 172.21.15.50:0/860552829 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb600043e0 con 0x7fcb701584c0 2023-11-28T11:55:53.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.666+0000 7fcb7661f700 1 -- 172.21.15.50:0/860552829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb701584c0 msgr2=0x7fcb700cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:53.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.666+0000 7fcb7661f700 1 --2- 172.21.15.50:0/860552829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb701584c0 0x7fcb700cb6f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009850 tx=0x7fcb60009b60 comp rx=0 tx=0).stop 2023-11-28T11:55:53.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.666+0000 7fcb7661f700 1 -- 172.21.15.50:0/860552829 shutdown_connections 2023-11-28T11:55:53.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.666+0000 7fcb7661f700 1 --2- 172.21.15.50:0/860552829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb7006ace0 0x7fcb700b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:53.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.666+0000 7fcb7661f700 1 --2- 172.21.15.50:0/860552829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb701584c0 0x7fcb700cb6f0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:53.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.666+0000 7fcb7661f700 1 -- 172.21.15.50:0/860552829 >> 172.21.15.50:0/860552829 conn(0x7fcb700ce3e0 msgr2=0x7fcb700ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:53.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.666+0000 7fcb7661f700 1 -- 172.21.15.50:0/860552829 shutdown_connections 2023-11-28T11:55:53.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.666+0000 7fcb7661f700 1 -- 172.21.15.50:0/860552829 wait complete. 2023-11-28T11:55:53.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.666+0000 7fcb7661f700 1 Processor -- start 2023-11-28T11:55:53.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.666+0000 7fcb7661f700 1 -- start start 2023-11-28T11:55:53.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb7661f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb7006ace0 0x7fcb700c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:53.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb7661f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb700b32e0 0x7fcb701493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:53.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb7661f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb701e0a30 0x7fcb701e0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:53.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb7661f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb701e1410 con 0x7fcb701e0a30 2023-11-28T11:55:53.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb7661f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb701e2960 con 0x7fcb7006ace0 2023-11-28T11:55:53.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb7661f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb70149900 con 0x7fcb700b32e0 2023-11-28T11:55:53.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb75e1e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb701e0a30 0x7fcb701e0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:53.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb75e1e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb701e0a30 0x7fcb701e0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36432/0 (socket says 172.21.15.50:36432) 2023-11-28T11:55:53.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb75e1e700 1 -- 172.21.15.50:0/2484538599 learned_addr learned my addr 172.21.15.50:0/2484538599 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:53.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb74e1c700 1 --2- 172.21.15.50:0/2484538599 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb700b32e0 0x7fcb701493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb7561d700 1 --2- 172.21.15.50:0/2484538599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb7006ace0 0x7fcb700c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb75e1e700 1 -- 172.21.15.50:0/2484538599 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb700b32e0 msgr2=0x7fcb701493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb75e1e700 1 --2- 172.21.15.50:0/2484538599 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb700b32e0 0x7fcb701493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb75e1e700 1 -- 172.21.15.50:0/2484538599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb7006ace0 msgr2=0x7fcb700c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb75e1e700 1 --2- 172.21.15.50:0/2484538599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb7006ace0 0x7fcb700c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb75e1e700 1 -- 172.21.15.50:0/2484538599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb680094b0 con 0x7fcb701e0a30 2023-11-28T11:55:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb75e1e700 1 --2- 172.21.15.50:0/2484538599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb701e0a30 0x7fcb701e0ed0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800eb60 tx=0x7fcb6800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb65ffb700 1 -- 172.21.15.50:0/2484538599 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb680097b0 con 0x7fcb701e0a30 2023-11-28T11:55:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb65ffb700 1 -- 172.21.15.50:0/2484538599 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb68009e70 con 0x7fcb701e0a30 2023-11-28T11:55:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb7661f700 1 -- 172.21.15.50:0/2484538599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb600094b0 con 0x7fcb701e0a30 2023-11-28T11:55:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb65ffb700 1 -- 172.21.15.50:0/2484538599 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb68004220 con 0x7fcb701e0a30 2023-11-28T11:55:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.670+0000 7fcb7661f700 1 -- 172.21.15.50:0/2484538599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb700cd990 con 0x7fcb701e0a30 2023-11-28T11:55:53.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.674+0000 7fcb7661f700 1 -- 172.21.15.50:0/2484538599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb700cd6b0 con 0x7fcb701e0a30 2023-11-28T11:55:53.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.674+0000 7fcb65ffb700 1 -- 172.21.15.50:0/2484538599 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcb680043a0 con 0x7fcb701e0a30 2023-11-28T11:55:53.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.674+0000 7fcb65ffb700 1 --2- 172.21.15.50:0/2484538599 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcb54064f10 0x7fcb540673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.674+0000 7fcb65ffb700 1 -- 172.21.15.50:0/2484538599 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fcb68081a40 con 0x7fcb701e0a30 2023-11-28T11:55:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.674+0000 7fcb7561d700 1 --2- 172.21.15.50:0/2484538599 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcb54064f10 0x7fcb540673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.674+0000 7fcb7561d700 1 --2- 172.21.15.50:0/2484538599 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcb54064f10 0x7fcb540673c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcb7006f4a0 tx=0x7fcb60008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:53.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.682+0000 7fcb65ffb700 1 -- 172.21.15.50:0/2484538599 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcb6804fdf0 con 0x7fcb701e0a30 2023-11-28T11:55:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.902+0000 7fcb7661f700 1 -- 172.21.15.50:0/2484538599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcb700cdc70 con 0x7fcb701e0a30 2023-11-28T11:55:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.902+0000 7fcb65ffb700 1 -- 172.21.15.50:0/2484538599 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5298 (secure 0 0 0) 0x7fcb68053410 con 0x7fcb701e0a30 2023-11-28T11:55:53.907 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:53.907 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:55:53.908 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-11-28T11:55:53.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.908 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-11-28T11:55:53.908 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlxEENEhAA6uZF6YtncUs7dCDzIg5HbQ==", 2023-11-28T11:55:53.908 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.909 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:55:53.909 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-11-28T11:55:53.909 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-11-28T11:55:53.909 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:55:53.909 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.910 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-11-28T11:55:53.910 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlI0OKHBAADvJfgEbXc9Afy6aG4gVoXA==", 2023-11-28T11:55:53.910 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.910 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:55:53.911 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-11-28T11:55:53.911 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-11-28T11:55:53.911 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:55:53.911 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.912 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-11-28T11:55:53.912 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVl6ny0FRAAQgysr6oovp/2rDO2QIMXzw==", 2023-11-28T11:55:53.912 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.912 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:55:53.912 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-11-28T11:55:53.912 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-11-28T11:55:53.912 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:55:53.912 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.913 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-11-28T11:55:53.913 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlWutSIBAALVMWVV7ccbh3GllfVc1p3Q==", 2023-11-28T11:55:53.913 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.913 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:55:53.913 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-11-28T11:55:53.913 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-11-28T11:55:53.913 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:55:53.914 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.914 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-11-28T11:55:53.914 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCG1GVl1DHxHBAAMp735odHBA/poSyyfvSYpQ==", 2023-11-28T11:55:53.914 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.914 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:55:53.914 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:55:53.914 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:55:53.914 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.915 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-11-28T11:55:53.915 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCJ1GVlxoqwIBAAnUjVFlMfRBksZ6XYz47T9Q==", 2023-11-28T11:55:53.915 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.915 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:55:53.915 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:55:53.915 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:55:53.915 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.916 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-11-28T11:55:53.916 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCM1GVlRf7iKBAAxyR/SK4psHpRinUXgEFWVQ==", 2023-11-28T11:55:53.916 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.916 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:55:53.916 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:55:53.916 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:55:53.916 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.916 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-11-28T11:55:53.916 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCP1GVlsV/wKxAAvVIJRCRq4uLf16aZE9Y7vw==", 2023-11-28T11:55:53.916 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.917 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:55:53.917 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:55:53.917 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:55:53.917 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.917 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-11-28T11:55:53.917 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCV1GVlTQT5DhAAx8BnPWKTw75FEfwY4QW1eg==", 2023-11-28T11:55:53.918 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.918 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:55:53.918 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:55:53.918 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:55:53.918 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.918 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-11-28T11:55:53.918 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCY1GVlYiehJBAA9fB7aokSkcuqUIrdCT4AVQ==", 2023-11-28T11:55:53.918 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.918 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:55:53.918 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:55:53.919 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:55:53.919 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.919 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-11-28T11:55:53.919 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCb1GVlx8AcKRAAyyFUzBGKYgqFZTCjrzWfTQ==", 2023-11-28T11:55:53.919 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.919 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:55:53.919 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:55:53.921 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:55:53.921 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.921 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-11-28T11:55:53.921 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCe1GVl8dJlLRAA3CbH6oyPSGBufsdUzrNqqg==", 2023-11-28T11:55:53.922 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.922 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:55:53.922 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:55:53.922 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:55:53.922 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.922 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-11-28T11:55:53.922 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlGwP8IxAAH+0SIBXHi15FUfxG3kL6CQ==", 2023-11-28T11:55:53.922 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.923 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:55:53.923 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-11-28T11:55:53.923 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-28T11:55:53.923 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.923 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-11-28T11:55:53.923 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlBPqBLRAA5NUjqXl9G+lXnEItcBKO0Q==", 2023-11-28T11:55:53.923 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.924 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:55:53.924 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-11-28T11:55:53.924 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-11-28T11:55:53.924 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-11-28T11:55:53.924 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.924 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-11-28T11:55:53.924 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlXn7/KRAAEPpLgrFMHsa7/ok0jPzaAw==", 2023-11-28T11:55:53.924 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.925 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:55:53.925 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-11-28T11:55:53.925 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-11-28T11:55:53.925 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-11-28T11:55:53.925 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.925 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-11-28T11:55:53.925 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVly52uMBAAkzwG3hsY3hpSoc6tEbzs/w==", 2023-11-28T11:55:53.925 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.925 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:55:53.925 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-11-28T11:55:53.926 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-11-28T11:55:53.926 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-11-28T11:55:53.926 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.926 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-11-28T11:55:53.926 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCE1GVlpGE5ORAAfnfy5U/jVTM4qlLvSzOG1A==", 2023-11-28T11:55:53.926 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.926 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-11-28T11:55:53.926 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-11-28T11:55:53.926 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-11-28T11:55:53.927 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:55:53.927 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.927 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-11-28T11:55:53.927 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlGibYDRAAkIMRzwJqRzmiXvmizp2vBA==", 2023-11-28T11:55:53.927 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.927 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-11-28T11:55:53.927 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-11-28T11:55:53.927 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:55:53.927 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:53.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:53.928 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-11-28T11:55:53.928 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlkx3HChAAps/lgazBLgFHSJJI81Zstg==", 2023-11-28T11:55:53.928 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:55:53.928 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-11-28T11:55:53.928 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-11-28T11:55:53.928 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:55:53.928 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.928 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:53.928 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-11-28T11:55:53.928 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:55:53.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.906+0000 7fcb7661f700 1 -- 172.21.15.50:0/2484538599 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcb54064f10 msgr2=0x7fcb540673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:53.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.906+0000 7fcb7661f700 1 --2- 172.21.15.50:0/2484538599 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcb54064f10 0x7fcb540673c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcb7006f4a0 tx=0x7fcb60008030 comp rx=0 tx=0).stop 2023-11-28T11:55:53.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.906+0000 7fcb7661f700 1 -- 172.21.15.50:0/2484538599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb701e0a30 msgr2=0x7fcb701e0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:53.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.906+0000 7fcb7661f700 1 --2- 172.21.15.50:0/2484538599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb701e0a30 0x7fcb701e0ed0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800eb60 tx=0x7fcb6800ee70 comp rx=0 tx=0).stop 2023-11-28T11:55:53.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.906+0000 7fcb7661f700 1 -- 172.21.15.50:0/2484538599 shutdown_connections 2023-11-28T11:55:53.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.906+0000 7fcb7661f700 1 --2- 172.21.15.50:0/2484538599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb701e0a30 0x7fcb701e0ed0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:53.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.906+0000 7fcb7661f700 1 --2- 172.21.15.50:0/2484538599 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb700b32e0 0x7fcb701493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:53.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.906+0000 7fcb7661f700 1 --2- 172.21.15.50:0/2484538599 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcb54064f10 0x7fcb540673c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:53.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.906+0000 7fcb7661f700 1 --2- 172.21.15.50:0/2484538599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb7006ace0 0x7fcb700c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:53.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.906+0000 7fcb7661f700 1 -- 172.21.15.50:0/2484538599 >> 172.21.15.50:0/2484538599 conn(0x7fcb700ce3e0 msgr2=0x7fcb70157180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:53.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.906+0000 7fcb7661f700 1 -- 172.21.15.50:0/2484538599 shutdown_connections 2023-11-28T11:55:53.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:53.906+0000 7fcb7661f700 1 -- 172.21.15.50:0/2484538599 wait complete. 2023-11-28T11:55:53.931 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:55:54.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa96bfff700 1 Processor -- start 2023-11-28T11:55:54.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa96bfff700 1 -- start start 2023-11-28T11:55:54.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa96bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa96c0b1ca0 0x7fa96c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa96bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa96c0d2780 0x7fa96c0d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa96bfff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96c0cf070 con 0x7fa96c06a330 2023-11-28T11:55:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa96bfff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96c0d3140 con 0x7fa96c0b1ca0 2023-11-28T11:55:54.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa96bfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c0b2070 con 0x7fa96c0d2780 2023-11-28T11:55:54.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa96b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa96c0d2780 0x7fa96c0d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa96affd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa96c0b1ca0 0x7fa96c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa96a7fc700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fa96c06a330 0x7fa96c0cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:51958/0 (socket says 172.21.15.50:51958) 2023-11-28T11:55:54.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa96a7fc700 1 -- 172.21.15.50:0/514674084 learned_addr learned my addr 172.21.15.50:0/514674084 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:54.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa96affd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa96c0b1ca0 0x7fa96c0b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:60814/0 (socket says 172.21.15.50:60814) 2023-11-28T11:55:54.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa96b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa96c0d2780 0x7fa96c0d2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:43460/0 (socket says 172.21.15.50:43460) 2023-11-28T11:55:54.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa96affd700 1 -- 172.21.15.50:0/514674084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa96c0d2780 msgr2=0x7fa96c0d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:54.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa96affd700 1 --2- 172.21.15.50:0/514674084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa96c0d2780 0x7fa96c0d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa96affd700 1 -- 172.21.15.50:0/514674084 >> v1:172.21.15.192:6789/0 conn(0x7fa96c06a330 legacy=0x7fa96c0cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa96affd700 1 -- 172.21.15.50:0/514674084 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c06a8a0 con 0x7fa96c0b1ca0 2023-11-28T11:55:54.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.042+0000 7fa969ffb700 1 -- 172.21.15.50:0/514674084 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036449129 0 0) 0x7fa96c0cf070 con 0x7fa96c06a330 2023-11-28T11:55:54.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.046+0000 7fa96affd700 1 --2- 172.21.15.50:0/514674084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa96c0b1ca0 0x7fa96c0b6250 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009d90 tx=0x7fa95c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bfbbf8e89cc3cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.046+0000 7fa969ffb700 1 -- 172.21.15.50:0/514674084 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c00e070 con 0x7fa96c0b1ca0 2023-11-28T11:55:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.046+0000 7fa969ffb700 1 -- 172.21.15.50:0/514674084 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95c00bb20 con 0x7fa96c0b1ca0 2023-11-28T11:55:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.046+0000 7fa969ffb700 1 -- 172.21.15.50:0/514674084 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c012430 con 0x7fa96c0b1ca0 2023-11-28T11:55:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.046+0000 7fa96bfff700 1 -- 172.21.15.50:0/514674084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa96c0b1ca0 msgr2=0x7fa96c0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.046+0000 7fa96bfff700 1 --2- 172.21.15.50:0/514674084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa96c0b1ca0 0x7fa96c0b6250 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009d90 tx=0x7fa95c00b330 comp rx=0 tx=0).stop 2023-11-28T11:55:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.046+0000 7fa96bfff700 1 -- 172.21.15.50:0/514674084 shutdown_connections 2023-11-28T11:55:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.046+0000 7fa96bfff700 1 --2- 172.21.15.50:0/514674084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa96c0d2780 0x7fa96c0d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.046+0000 7fa96bfff700 1 --2- 172.21.15.50:0/514674084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa96c0b1ca0 0x7fa96c0b6250 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.046+0000 7fa96bfff700 1 -- 172.21.15.50:0/514674084 >> 172.21.15.50:0/514674084 conn(0x7fa96c0b5740 msgr2=0x7fa96c0b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:54.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.046+0000 7fa96bfff700 1 -- 172.21.15.50:0/514674084 shutdown_connections 2023-11-28T11:55:54.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.046+0000 7fa96bfff700 1 -- 172.21.15.50:0/514674084 wait complete. 2023-11-28T11:55:54.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.046+0000 7fa96bfff700 1 Processor -- start 2023-11-28T11:55:54.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.046+0000 7fa96bfff700 1 -- start start 2023-11-28T11:55:54.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa96c06a330 0x7fa96c0c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa96c0b1ca0 0x7fa96c0caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96c0d2780 0x7fa96c0c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c0c7a20 con 0x7fa96c0d2780 2023-11-28T11:55:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96bfff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c0cb430 con 0x7fa96c0b1ca0 2023-11-28T11:55:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96bfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c0cb6d0 con 0x7fa96c06a330 2023-11-28T11:55:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96c0d2780 0x7fa96c0c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96affd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa96c06a330 0x7fa96c0c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96a7fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa96c0b1ca0 0x7fa96c0caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96c0d2780 0x7fa96c0c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36446/0 (socket says 172.21.15.50:36446) 2023-11-28T11:55:54.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96b7fe700 1 -- 172.21.15.50:0/3194981259 learned_addr learned my addr 172.21.15.50:0/3194981259 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:54.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96b7fe700 1 -- 172.21.15.50:0/3194981259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa96c06a330 msgr2=0x7fa96c0c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96b7fe700 1 --2- 172.21.15.50:0/3194981259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa96c06a330 0x7fa96c0c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96b7fe700 1 -- 172.21.15.50:0/3194981259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa96c0b1ca0 msgr2=0x7fa96c0caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96b7fe700 1 --2- 172.21.15.50:0/3194981259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa96c0b1ca0 0x7fa96c0caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96b7fe700 1 -- 172.21.15.50:0/3194981259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95c009a70 con 0x7fa96c0d2780 2023-11-28T11:55:54.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96a7fc700 1 --2- 172.21.15.50:0/3194981259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa96c0b1ca0 0x7fa96c0caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:54.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96b7fe700 1 --2- 172.21.15.50:0/3194981259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96c0d2780 0x7fa96c0c82d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa96400e7f0 tx=0x7fa96400eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:54.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa9637fe700 1 -- 172.21.15.50:0/3194981259 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9640095c0 con 0x7fa96c0d2780 2023-11-28T11:55:54.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa9637fe700 1 -- 172.21.15.50:0/3194981259 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa964013680 con 0x7fa96c0d2780 2023-11-28T11:55:54.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96bfff700 1 -- 172.21.15.50:0/3194981259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96c06ae60 con 0x7fa96c0d2780 2023-11-28T11:55:54.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa9637fe700 1 -- 172.21.15.50:0/3194981259 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa964013a10 con 0x7fa96c0d2780 2023-11-28T11:55:54.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.050+0000 7fa96bfff700 1 -- 172.21.15.50:0/3194981259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96c06ab80 con 0x7fa96c0d2780 2023-11-28T11:55:54.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.054+0000 7fa96bfff700 1 -- 172.21.15.50:0/3194981259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa96c06b140 con 0x7fa96c0d2780 2023-11-28T11:55:54.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.054+0000 7fa9637fe700 1 -- 172.21.15.50:0/3194981259 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa964019030 con 0x7fa96c0d2780 2023-11-28T11:55:54.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.054+0000 7fa9637fe700 1 --2- 172.21.15.50:0/3194981259 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa94c064ee0 0x7fa94c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.054+0000 7fa9637fe700 1 -- 172.21.15.50:0/3194981259 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa9640818f0 con 0x7fa96c0d2780 2023-11-28T11:55:54.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.054+0000 7fa96affd700 1 --2- 172.21.15.50:0/3194981259 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa94c064ee0 0x7fa94c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.054+0000 7fa96affd700 1 --2- 172.21.15.50:0/3194981259 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa94c064ee0 0x7fa94c067390 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa95c014040 tx=0x7fa95c011000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:54.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.062+0000 7fa9637fe700 1 -- 172.21.15.50:0/3194981259 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa96404fca0 con 0x7fa96c0d2780 2023-11-28T11:55:54.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.226+0000 7fa96bfff700 1 -- 172.21.15.50:0/3194981259 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa96c072c20 con 0x7fa96c0d2780 2023-11-28T11:55:54.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.226+0000 7fa9637fe700 1 -- 172.21.15.50:0/3194981259 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+14318 (secure 0 0 0) 0x7fa9640532c0 con 0x7fa96c0d2780 2023-11-28T11:55:54.231 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:54.231 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":50,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:55:53.510101+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:55:54.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.230+0000 7fa96bfff700 1 -- 172.21.15.50:0/3194981259 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa94c064ee0 msgr2=0x7fa94c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.230+0000 7fa96bfff700 1 --2- 172.21.15.50:0/3194981259 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa94c064ee0 0x7fa94c067390 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa95c014040 tx=0x7fa95c011000 comp rx=0 tx=0).stop 2023-11-28T11:55:54.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.230+0000 7fa96bfff700 1 -- 172.21.15.50:0/3194981259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96c0d2780 msgr2=0x7fa96c0c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.230+0000 7fa96bfff700 1 --2- 172.21.15.50:0/3194981259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96c0d2780 0x7fa96c0c82d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa96400e7f0 tx=0x7fa96400eb00 comp rx=0 tx=0).stop 2023-11-28T11:55:54.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.230+0000 7fa96bfff700 1 -- 172.21.15.50:0/3194981259 shutdown_connections 2023-11-28T11:55:54.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.230+0000 7fa96bfff700 1 --2- 172.21.15.50:0/3194981259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa96c0d2780 0x7fa96c0c82d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.230+0000 7fa96bfff700 1 --2- 172.21.15.50:0/3194981259 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa94c064ee0 0x7fa94c067390 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.230+0000 7fa96bfff700 1 --2- 172.21.15.50:0/3194981259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa96c0b1ca0 0x7fa96c0caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.230+0000 7fa96bfff700 1 --2- 172.21.15.50:0/3194981259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa96c06a330 0x7fa96c0c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.230+0000 7fa96bfff700 1 -- 172.21.15.50:0/3194981259 >> 172.21.15.50:0/3194981259 conn(0x7fa96c0b5740 msgr2=0x7fa96c159630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:54.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.234+0000 7fa96bfff700 1 -- 172.21.15.50:0/3194981259 shutdown_connections 2023-11-28T11:55:54.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.234+0000 7fa96bfff700 1 -- 172.21.15.50:0/3194981259 wait complete. 2023-11-28T11:55:54.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:55:54.251 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:55:54.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.370+0000 7ff84ffff700 1 Processor -- start 2023-11-28T11:55:54.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.370+0000 7ff84ffff700 1 -- start start 2023-11-28T11:55:54.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff85006a6e0 0x7ff85006aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff8500cb5a0 0x7ff85006e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84ffff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85015a3a0 con 0x7ff8500cbaf0 2023-11-28T11:55:54.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84ffff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85006aff0 con 0x7ff8500cb5a0 2023-11-28T11:55:54.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84ffff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500ca430 con 0x7ff85006a6e0 2023-11-28T11:55:54.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84effd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff85006a6e0 0x7ff85006aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff8500cb5a0 0x7ff85006e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84e7fc700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ff8500cbaf0 0x7ff85006e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:51968/0 (socket says 172.21.15.50:51968) 2023-11-28T11:55:54.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84e7fc700 1 -- 172.21.15.50:0/1628113248 learned_addr learned my addr 172.21.15.50:0/1628113248 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:54.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84dffb700 1 -- 172.21.15.50:0/1628113248 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427526564 0 0) 0x7ff838001160 con 0x7ff8500cbaf0 2023-11-28T11:55:54.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84dffb700 1 -- 172.21.15.50:0/1628113248 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff83c0035d0 con 0x7ff8500cbaf0 2023-11-28T11:55:54.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84f7fe700 1 -- 172.21.15.50:0/1628113248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff85006a6e0 msgr2=0x7ff85006aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:54.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84f7fe700 1 --2- 172.21.15.50:0/1628113248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff85006a6e0 0x7ff85006aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84f7fe700 1 -- 172.21.15.50:0/1628113248 >> v1:172.21.15.192:6789/0 conn(0x7ff8500cbaf0 legacy=0x7ff85006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84f7fe700 1 -- 172.21.15.50:0/1628113248 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8500ca710 con 0x7ff8500cb5a0 2023-11-28T11:55:54.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84f7fe700 1 --2- 172.21.15.50:0/1628113248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8500cb5a0 0x7ff85006e710 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff848009d90 tx=0x7ff84800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e97f7a2d3a6219a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:54.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84dffb700 1 -- 172.21.15.50:0/1628113248 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84800e070 con 0x7ff8500cb5a0 2023-11-28T11:55:54.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84dffb700 1 -- 172.21.15.50:0/1628113248 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84800bb20 con 0x7ff8500cb5a0 2023-11-28T11:55:54.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84dffb700 1 -- 172.21.15.50:0/1628113248 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84800be90 con 0x7ff8500cb5a0 2023-11-28T11:55:54.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84ffff700 1 -- 172.21.15.50:0/1628113248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8500cb5a0 msgr2=0x7ff85006e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84ffff700 1 --2- 172.21.15.50:0/1628113248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8500cb5a0 0x7ff85006e710 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff848009d90 tx=0x7ff84800b330 comp rx=0 tx=0).stop 2023-11-28T11:55:54.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84ffff700 1 -- 172.21.15.50:0/1628113248 shutdown_connections 2023-11-28T11:55:54.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84ffff700 1 --2- 172.21.15.50:0/1628113248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8500cb5a0 0x7ff85006e710 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84ffff700 1 --2- 172.21.15.50:0/1628113248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff85006a6e0 0x7ff85006aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84ffff700 1 -- 172.21.15.50:0/1628113248 >> 172.21.15.50:0/1628113248 conn(0x7ff8500d0240 msgr2=0x7ff8500cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:54.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84ffff700 1 -- 172.21.15.50:0/1628113248 shutdown_connections 2023-11-28T11:55:54.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.374+0000 7ff84ffff700 1 -- 172.21.15.50:0/1628113248 wait complete. 2023-11-28T11:55:54.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84ffff700 1 Processor -- start 2023-11-28T11:55:54.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84ffff700 1 -- start start 2023-11-28T11:55:54.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff85006a6e0 0x7ff8500afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8500cb5a0 0x7ff8500c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8500cbaf0 0x7ff8500c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84ffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8501f3ca0 con 0x7ff8500cbaf0 2023-11-28T11:55:54.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84ffff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8501f0710 con 0x7ff8500cb5a0 2023-11-28T11:55:54.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84ffff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8501f2f00 con 0x7ff85006a6e0 2023-11-28T11:55:54.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8500cbaf0 0x7ff8500c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8500cbaf0 0x7ff8500c90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36452/0 (socket says 172.21.15.50:36452) 2023-11-28T11:55:54.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84f7fe700 1 -- 172.21.15.50:0/3750725216 learned_addr learned my addr 172.21.15.50:0/3750725216 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:54.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84effd700 1 --2- 172.21.15.50:0/3750725216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff85006a6e0 0x7ff8500afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84e7fc700 1 --2- 172.21.15.50:0/3750725216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8500cb5a0 0x7ff8500c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84f7fe700 1 -- 172.21.15.50:0/3750725216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff85006a6e0 msgr2=0x7ff8500afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84f7fe700 1 --2- 172.21.15.50:0/3750725216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff85006a6e0 0x7ff8500afc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84f7fe700 1 -- 172.21.15.50:0/3750725216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8500cb5a0 msgr2=0x7ff8500c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84f7fe700 1 --2- 172.21.15.50:0/3750725216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8500cb5a0 0x7ff8500c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84f7fe700 1 -- 172.21.15.50:0/3750725216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff848009a70 con 0x7ff8500cbaf0 2023-11-28T11:55:54.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84f7fe700 1 --2- 172.21.15.50:0/3750725216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8500cbaf0 0x7ff8500c90e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff848014040 tx=0x7ff848004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:54.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff847fff700 1 -- 172.21.15.50:0/3750725216 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848007000 con 0x7ff8500cbaf0 2023-11-28T11:55:54.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff847fff700 1 -- 172.21.15.50:0/3750725216 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff848012650 con 0x7ff8500cbaf0 2023-11-28T11:55:54.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84ffff700 1 -- 172.21.15.50:0/3750725216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8500cacd0 con 0x7ff8500cbaf0 2023-11-28T11:55:54.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff847fff700 1 -- 172.21.15.50:0/3750725216 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848012a00 con 0x7ff8500cbaf0 2023-11-28T11:55:54.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.378+0000 7ff84ffff700 1 -- 172.21.15.50:0/3750725216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8500ca9f0 con 0x7ff8500cbaf0 2023-11-28T11:55:54.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.382+0000 7ff84ffff700 1 -- 172.21.15.50:0/3750725216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8500cafb0 con 0x7ff8500cbaf0 2023-11-28T11:55:54.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.382+0000 7ff847fff700 1 -- 172.21.15.50:0/3750725216 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff848012b60 con 0x7ff8500cbaf0 2023-11-28T11:55:54.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.382+0000 7ff847fff700 1 --2- 172.21.15.50:0/3750725216 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff830064ee0 0x7ff830067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.382+0000 7ff847fff700 1 -- 172.21.15.50:0/3750725216 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff848083e60 con 0x7ff8500cbaf0 2023-11-28T11:55:54.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.382+0000 7ff84effd700 1 --2- 172.21.15.50:0/3750725216 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff830064ee0 0x7ff830067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.382+0000 7ff84effd700 1 --2- 172.21.15.50:0/3750725216 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff830064ee0 0x7ff830067390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff840009b50 tx=0x7ff840009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.390+0000 7ff847fff700 1 -- 172.21.15.50:0/3750725216 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff8480521b0 con 0x7ff8500cbaf0 2023-11-28T11:55:54.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.554+0000 7ff84ffff700 1 -- 172.21.15.50:0/3750725216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff850072c20 con 0x7ff8500cbaf0 2023-11-28T11:55:54.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.554+0000 7ff847fff700 1 -- 172.21.15.50:0/3750725216 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff8480557d0 con 0x7ff8500cbaf0 2023-11-28T11:55:54.558 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:55:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.554+0000 7ff84ffff700 1 -- 172.21.15.50:0/3750725216 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff830064ee0 msgr2=0x7ff830067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.554+0000 7ff84ffff700 1 --2- 172.21.15.50:0/3750725216 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff830064ee0 0x7ff830067390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff840009b50 tx=0x7ff840009240 comp rx=0 tx=0).stop 2023-11-28T11:55:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.554+0000 7ff84ffff700 1 -- 172.21.15.50:0/3750725216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8500cbaf0 msgr2=0x7ff8500c90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.554+0000 7ff84ffff700 1 --2- 172.21.15.50:0/3750725216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8500cbaf0 0x7ff8500c90e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff848014040 tx=0x7ff848004af0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.554+0000 7ff84ffff700 1 -- 172.21.15.50:0/3750725216 shutdown_connections 2023-11-28T11:55:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.554+0000 7ff84ffff700 1 --2- 172.21.15.50:0/3750725216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8500cbaf0 0x7ff8500c90e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.554+0000 7ff84ffff700 1 --2- 172.21.15.50:0/3750725216 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff830064ee0 0x7ff830067390 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.554+0000 7ff84ffff700 1 --2- 172.21.15.50:0/3750725216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8500cb5a0 0x7ff8500c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.554+0000 7ff84ffff700 1 --2- 172.21.15.50:0/3750725216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff85006a6e0 0x7ff8500afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.554+0000 7ff84ffff700 1 -- 172.21.15.50:0/3750725216 >> 172.21.15.50:0/3750725216 conn(0x7ff8500d0240 msgr2=0x7ff85006f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:54.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.554+0000 7ff84ffff700 1 -- 172.21.15.50:0/3750725216 shutdown_connections 2023-11-28T11:55:54.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.554+0000 7ff84ffff700 1 -- 172.21.15.50:0/3750725216 wait complete. 2023-11-28T11:55:54.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:55:54.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.686+0000 7f5f2f59e700 1 Processor -- start 2023-11-28T11:55:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2f59e700 1 -- start start 2023-11-28T11:55:54.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f3015a3e0 0x7f5f300ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2f59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5f300b2d30 0x7f5f30069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2f59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3009c0e0 con 0x7f5f300cc2f0 2023-11-28T11:55:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2f59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f300b13e0 con 0x7f5f300b2d30 2023-11-28T11:55:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f300b16c0 con 0x7f5f3015a3e0 2023-11-28T11:55:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2ed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5f300b2d30 0x7f5f30069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2ed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5f300b2d30 0x7f5f30069c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36468/0 (socket says 172.21.15.50:36468) 2023-11-28T11:55:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2e59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5f300cc2f0 0x7f5f300cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57076/0 (socket says 172.21.15.50:57076) 2023-11-28T11:55:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2ed9d700 1 -- 172.21.15.50:0/2049578248 learned_addr learned my addr 172.21.15.50:0/2049578248 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2dd9b700 1 --2- 172.21.15.50:0/2049578248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f3015a3e0 0x7f5f300ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2ed9d700 1 -- 172.21.15.50:0/2049578248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f3015a3e0 msgr2=0x7f5f300ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2d59a700 1 -- 172.21.15.50:0/2049578248 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523866876 0 0) 0x7f5f3009c0e0 con 0x7f5f300cc2f0 2023-11-28T11:55:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2ed9d700 1 --2- 172.21.15.50:0/2049578248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f3015a3e0 0x7f5f300ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2ed9d700 1 -- 172.21.15.50:0/2049578248 >> v1:172.21.15.50:6789/0 conn(0x7f5f300cc2f0 legacy=0x7f5f300cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2ed9d700 1 -- 172.21.15.50:0/2049578248 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f300b19a0 con 0x7f5f300b2d30 2023-11-28T11:55:54.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2dd9b700 1 --2- 172.21.15.50:0/2049578248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f3015a3e0 0x7f5f300ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:55:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2ed9d700 1 --2- 172.21.15.50:0/2049578248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f300b2d30 0x7f5f30069c40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009910 tx=0x7f5f28009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea527827ef7f38e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2d59a700 1 -- 172.21.15.50:0/2049578248 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2800ba60 con 0x7f5f300b2d30 2023-11-28T11:55:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2d59a700 1 -- 172.21.15.50:0/2049578248 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2800bbc0 con 0x7f5f300b2d30 2023-11-28T11:55:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2d59a700 1 -- 172.21.15.50:0/2049578248 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28009e60 con 0x7f5f300b2d30 2023-11-28T11:55:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2f59e700 1 -- 172.21.15.50:0/2049578248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f300b2d30 msgr2=0x7f5f30069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2f59e700 1 --2- 172.21.15.50:0/2049578248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f300b2d30 0x7f5f30069c40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009910 tx=0x7f5f28009c20 comp rx=0 tx=0).stop 2023-11-28T11:55:54.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2f59e700 1 -- 172.21.15.50:0/2049578248 shutdown_connections 2023-11-28T11:55:54.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2f59e700 1 --2- 172.21.15.50:0/2049578248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f300b2d30 0x7f5f30069c40 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2f59e700 1 --2- 172.21.15.50:0/2049578248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f3015a3e0 0x7f5f300ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2f59e700 1 -- 172.21.15.50:0/2049578248 >> 172.21.15.50:0/2049578248 conn(0x7f5f300cae70 msgr2=0x7f5f300cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:54.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2f59e700 1 -- 172.21.15.50:0/2049578248 shutdown_connections 2023-11-28T11:55:54.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.690+0000 7f5f2f59e700 1 -- 172.21.15.50:0/2049578248 wait complete. 2023-11-28T11:55:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2f59e700 1 Processor -- start 2023-11-28T11:55:54.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2f59e700 1 -- start start 2023-11-28T11:55:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f300b2d30 0x7f5f300c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f300cc2f0 0x7f5f300ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f3015a3e0 0x7f5f3014a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f301539a0 con 0x7f5f3015a3e0 2023-11-28T11:55:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2f59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f300c6380 con 0x7f5f300cc2f0 2023-11-28T11:55:54.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3009a4e0 con 0x7f5f300b2d30 2023-11-28T11:55:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f3015a3e0 0x7f5f3014a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2ed9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f3015a3e0 0x7f5f3014a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36478/0 (socket says 172.21.15.50:36478) 2023-11-28T11:55:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2ed9d700 1 -- 172.21.15.50:0/2431624031 learned_addr learned my addr 172.21.15.50:0/2431624031 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2dd9b700 1 --2- 172.21.15.50:0/2431624031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f300cc2f0 0x7f5f300ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2ed9d700 1 -- 172.21.15.50:0/2431624031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f300b2d30 msgr2=0x7f5f300c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2e59c700 1 --2- 172.21.15.50:0/2431624031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f300b2d30 0x7f5f300c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2ed9d700 1 --2- 172.21.15.50:0/2431624031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f300b2d30 0x7f5f300c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2ed9d700 1 -- 172.21.15.50:0/2431624031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f300cc2f0 msgr2=0x7f5f300ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2ed9d700 1 --2- 172.21.15.50:0/2431624031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f300cc2f0 0x7f5f300ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2ed9d700 1 -- 172.21.15.50:0/2431624031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f28009570 con 0x7f5f3015a3e0 2023-11-28T11:55:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2dd9b700 1 --2- 172.21.15.50:0/2431624031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f300cc2f0 0x7f5f300ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:55:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2e59c700 1 --2- 172.21.15.50:0/2431624031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f300b2d30 0x7f5f300c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:55:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2ed9d700 1 --2- 172.21.15.50:0/2431624031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f3015a3e0 0x7f5f3014a220 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009150 tx=0x7f5f28004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f26ffd700 1 -- 172.21.15.50:0/2431624031 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f280036c0 con 0x7f5f3015a3e0 2023-11-28T11:55:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f26ffd700 1 -- 172.21.15.50:0/2431624031 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2801e070 con 0x7f5f3015a3e0 2023-11-28T11:55:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2f59e700 1 -- 172.21.15.50:0/2431624031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3006a180 con 0x7f5f3015a3e0 2023-11-28T11:55:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f26ffd700 1 -- 172.21.15.50:0/2431624031 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28003a60 con 0x7f5f3015a3e0 2023-11-28T11:55:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.694+0000 7f5f2f59e700 1 -- 172.21.15.50:0/2431624031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f300b1c80 con 0x7f5f3015a3e0 2023-11-28T11:55:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.698+0000 7f5f2f59e700 1 -- 172.21.15.50:0/2431624031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3006a310 con 0x7f5f3015a3e0 2023-11-28T11:55:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.698+0000 7f5f26ffd700 1 -- 172.21.15.50:0/2431624031 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5f2800f050 con 0x7f5f3015a3e0 2023-11-28T11:55:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.698+0000 7f5f26ffd700 1 --2- 172.21.15.50:0/2431624031 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5f10064ee0 0x7f5f10067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:54.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.698+0000 7f5f26ffd700 1 -- 172.21.15.50:0/2431624031 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5f28020070 con 0x7f5f3015a3e0 2023-11-28T11:55:54.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.698+0000 7f5f2e59c700 1 --2- 172.21.15.50:0/2431624031 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5f10064ee0 0x7f5f10067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:54.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.698+0000 7f5f2e59c700 1 --2- 172.21.15.50:0/2431624031 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5f10064ee0 0x7f5f10067390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5f200012e0 tx=0x7f5f20009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:54.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.706+0000 7f5f26ffd700 1 -- 172.21.15.50:0/2431624031 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5f280516a0 con 0x7f5f3015a3e0 2023-11-28T11:55:54.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.874+0000 7f5f2f59e700 1 -- 172.21.15.50:0/2431624031 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f30072500 con 0x7f5f3015a3e0 2023-11-28T11:55:54.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.874+0000 7f5f26ffd700 1 -- 172.21.15.50:0/2431624031 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f2802a0a0 con 0x7f5f3015a3e0 2023-11-28T11:55:54.878 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:55:54.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.878+0000 7f5f2f59e700 1 -- 172.21.15.50:0/2431624031 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5f10064ee0 msgr2=0x7f5f10067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.878+0000 7f5f2f59e700 1 --2- 172.21.15.50:0/2431624031 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5f10064ee0 0x7f5f10067390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5f200012e0 tx=0x7f5f20009040 comp rx=0 tx=0).stop 2023-11-28T11:55:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.878+0000 7f5f2f59e700 1 -- 172.21.15.50:0/2431624031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f3015a3e0 msgr2=0x7f5f3014a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.878+0000 7f5f2f59e700 1 --2- 172.21.15.50:0/2431624031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f3015a3e0 0x7f5f3014a220 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009150 tx=0x7f5f28004770 comp rx=0 tx=0).stop 2023-11-28T11:55:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.878+0000 7f5f2f59e700 1 -- 172.21.15.50:0/2431624031 shutdown_connections 2023-11-28T11:55:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.878+0000 7f5f2f59e700 1 --2- 172.21.15.50:0/2431624031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f3015a3e0 0x7f5f3014a220 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.878+0000 7f5f2f59e700 1 --2- 172.21.15.50:0/2431624031 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5f10064ee0 0x7f5f10067390 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.878+0000 7f5f2f59e700 1 --2- 172.21.15.50:0/2431624031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f300cc2f0 0x7f5f300ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.878+0000 7f5f2f59e700 1 --2- 172.21.15.50:0/2431624031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f300b2d30 0x7f5f300c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.878+0000 7f5f2f59e700 1 -- 172.21.15.50:0/2431624031 >> 172.21.15.50:0/2431624031 conn(0x7f5f300cae70 msgr2=0x7f5f301589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.878+0000 7f5f2f59e700 1 -- 172.21.15.50:0/2431624031 shutdown_connections 2023-11-28T11:55:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:54.878+0000 7f5f2f59e700 1 -- 172.21.15.50:0/2431624031 wait complete. 2023-11-28T11:55:54.898 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T11:55:55.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.010+0000 7fef550cc700 1 Processor -- start 2023-11-28T11:55:55.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.010+0000 7fef550cc700 1 -- start start 2023-11-28T11:55:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.010+0000 7fef550cc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef50152bb0 0x7fef5015caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.010+0000 7fef550cc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef500b3030 0x7fef5006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.010+0000 7fef550cc700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef50152f80 con 0x7fef5006c640 2023-11-28T11:55:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.010+0000 7fef550cc700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5006cff0 con 0x7fef500b3030 2023-11-28T11:55:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.010+0000 7fef550cc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5015cfe0 con 0x7fef50152bb0 2023-11-28T11:55:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.010+0000 7fef4f7fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fef5006c640 0x7fef500706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:51976/0 (socket says 172.21.15.50:51976) 2023-11-28T11:55:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.010+0000 7fef4f7fe700 1 -- 172.21.15.50:0/3181538009 learned_addr learned my addr 172.21.15.50:0/3181538009 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.010+0000 7fef4ffff700 1 --2- 172.21.15.50:0/3181538009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef50152bb0 0x7fef5015caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.010+0000 7fef548cb700 1 --2- 172.21.15.50:0/3181538009 >> v2:172.21.15.192:3300/0 conn(0x7fef500b3030 0x7fef5006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.010+0000 7fef4ffff700 1 -- 172.21.15.50:0/3181538009 >> v2:172.21.15.192:3300/0 conn(0x7fef500b3030 msgr2=0x7fef5006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.010+0000 7fef4ffff700 1 --2- 172.21.15.50:0/3181538009 >> v2:172.21.15.192:3300/0 conn(0x7fef500b3030 0x7fef5006cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.014+0000 7fef4ffff700 1 -- 172.21.15.50:0/3181538009 >> v1:172.21.15.192:6789/0 conn(0x7fef5006c640 legacy=0x7fef500706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.010+0000 7fef4effd700 1 -- 172.21.15.50:0/3181538009 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851929260 0 0) 0x7fef50152f80 con 0x7fef5006c640 2023-11-28T11:55:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.014+0000 7fef4ffff700 1 -- 172.21.15.50:0/3181538009 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50159a30 con 0x7fef50152bb0 2023-11-28T11:55:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.014+0000 7fef4ffff700 1 --2- 172.21.15.50:0/3181538009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef50152bb0 0x7fef5015caa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef4000a9f0 tx=0x7fef4000ad00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=235db036aa417ad4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.014+0000 7fef4effd700 1 -- 172.21.15.50:0/3181538009 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4000cb70 con 0x7fef50152bb0 2023-11-28T11:55:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.014+0000 7fef4effd700 1 -- 172.21.15.50:0/3181538009 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4000ccd0 con 0x7fef50152bb0 2023-11-28T11:55:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.014+0000 7fef4effd700 1 -- 172.21.15.50:0/3181538009 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4000f690 con 0x7fef50152bb0 2023-11-28T11:55:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.014+0000 7fef550cc700 1 -- 172.21.15.50:0/3181538009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef50152bb0 msgr2=0x7fef5015caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.014+0000 7fef550cc700 1 --2- 172.21.15.50:0/3181538009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef50152bb0 0x7fef5015caa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef4000a9f0 tx=0x7fef4000ad00 comp rx=0 tx=0).stop 2023-11-28T11:55:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.014+0000 7fef550cc700 1 -- 172.21.15.50:0/3181538009 shutdown_connections 2023-11-28T11:55:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.014+0000 7fef550cc700 1 --2- 172.21.15.50:0/3181538009 >> v2:172.21.15.192:3300/0 conn(0x7fef500b3030 0x7fef5006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.014+0000 7fef550cc700 1 --2- 172.21.15.50:0/3181538009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef50152bb0 0x7fef5015caa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.014+0000 7fef550cc700 1 -- 172.21.15.50:0/3181538009 >> 172.21.15.50:0/3181538009 conn(0x7fef5006e000 msgr2=0x7fef500b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.014+0000 7fef550cc700 1 -- 172.21.15.50:0/3181538009 shutdown_connections 2023-11-28T11:55:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.014+0000 7fef550cc700 1 -- 172.21.15.50:0/3181538009 wait complete. 2023-11-28T11:55:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.014+0000 7fef550cc700 1 Processor -- start 2023-11-28T11:55:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.014+0000 7fef550cc700 1 -- start start 2023-11-28T11:55:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef550cc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef5006c640 0x7fef501f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef550cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef500b3030 0x7fef5014e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef550cc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef50152bb0 0x7fef50157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef550cc700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef500c7430 con 0x7fef500b3030 2023-11-28T11:55:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef550cc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef501f2c70 con 0x7fef5006c640 2023-11-28T11:55:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef550cc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5014ef00 con 0x7fef50152bb0 2023-11-28T11:55:55.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef4ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef5006c640 0x7fef501f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:55.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef4f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef500b3030 0x7fef5014e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:55.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef4ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef5006c640 0x7fef501f2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:60870/0 (socket says 172.21.15.50:60870) 2023-11-28T11:55:55.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef4ffff700 1 -- 172.21.15.50:0/2216438696 learned_addr learned my addr 172.21.15.50:0/2216438696 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:55.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef548cb700 1 --2- 172.21.15.50:0/2216438696 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef50152bb0 0x7fef50157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:55.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef4ffff700 1 -- 172.21.15.50:0/2216438696 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef50152bb0 msgr2=0x7fef50157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:55.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef4ffff700 1 --2- 172.21.15.50:0/2216438696 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef50152bb0 0x7fef50157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:55.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef4ffff700 1 -- 172.21.15.50:0/2216438696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef500b3030 msgr2=0x7fef5014e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:55.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef4ffff700 1 --2- 172.21.15.50:0/2216438696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef500b3030 0x7fef5014e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:55.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef4ffff700 1 -- 172.21.15.50:0/2216438696 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4000a650 con 0x7fef5006c640 2023-11-28T11:55:55.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef4f7fe700 1 --2- 172.21.15.50:0/2216438696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef500b3030 0x7fef5014e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:55.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef4ffff700 1 --2- 172.21.15.50:0/2216438696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef5006c640 0x7fef501f2730 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fef4000c4d0 tx=0x7fef40004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:55.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef4cff9700 1 -- 172.21.15.50:0/2216438696 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4000ae30 con 0x7fef5006c640 2023-11-28T11:55:55.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef4cff9700 1 -- 172.21.15.50:0/2216438696 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef40004050 con 0x7fef5006c640 2023-11-28T11:55:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef550cc700 1 -- 172.21.15.50:0/2216438696 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef50159190 con 0x7fef5006c640 2023-11-28T11:55:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef4cff9700 1 -- 172.21.15.50:0/2216438696 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40004400 con 0x7fef5006c640 2023-11-28T11:55:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.018+0000 7fef550cc700 1 -- 172.21.15.50:0/2216438696 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef50158eb0 con 0x7fef5006c640 2023-11-28T11:55:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.022+0000 7fef550cc700 1 -- 172.21.15.50:0/2216438696 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef50159470 con 0x7fef5006c640 2023-11-28T11:55:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.022+0000 7fef4cff9700 1 -- 172.21.15.50:0/2216438696 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fef4000e070 con 0x7fef5006c640 2023-11-28T11:55:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.022+0000 7fef4cff9700 1 --2- 172.21.15.50:0/2216438696 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef3c064ee0 0x7fef3c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.022+0000 7fef4cff9700 1 -- 172.21.15.50:0/2216438696 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fef40013070 con 0x7fef5006c640 2023-11-28T11:55:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.022+0000 7fef4f7fe700 1 --2- 172.21.15.50:0/2216438696 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef3c064ee0 0x7fef3c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.022+0000 7fef4f7fe700 1 --2- 172.21.15.50:0/2216438696 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef3c064ee0 0x7fef3c067390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fef501ef8a0 tx=0x7fef44007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:55.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.034+0000 7fef4cff9700 1 -- 172.21.15.50:0/2216438696 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fef40051f20 con 0x7fef5006c640 2023-11-28T11:55:55.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.198+0000 7fef550cc700 1 -- 172.21.15.50:0/2216438696 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fef500c8a50 con 0x7fef5006c640 2023-11-28T11:55:55.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.198+0000 7fef4cff9700 1 -- 172.21.15.50:0/2216438696 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) v1 ==== 84+0+126 (secure 0 0 0) 0x7fef40055540 con 0x7fef5006c640 2023-11-28T11:55:55.202 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:55.202 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-11-28T11:55:55.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:55.203 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-11-28T11:55:55.203 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2023-11-28T11:55:55.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:55:55.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:55:55.203 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2023-11-28T11:55:55.203 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-11-28T11:55:55.203 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:55:55.203 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-11-28T11:55:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.202+0000 7fef550cc700 1 -- 172.21.15.50:0/2216438696 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef3c064ee0 msgr2=0x7fef3c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.202+0000 7fef550cc700 1 --2- 172.21.15.50:0/2216438696 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef3c064ee0 0x7fef3c067390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fef501ef8a0 tx=0x7fef44007e90 comp rx=0 tx=0).stop 2023-11-28T11:55:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.202+0000 7fef550cc700 1 -- 172.21.15.50:0/2216438696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef5006c640 msgr2=0x7fef501f2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.202+0000 7fef550cc700 1 --2- 172.21.15.50:0/2216438696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef5006c640 0x7fef501f2730 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fef4000c4d0 tx=0x7fef40004770 comp rx=0 tx=0).stop 2023-11-28T11:55:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.202+0000 7fef550cc700 1 -- 172.21.15.50:0/2216438696 shutdown_connections 2023-11-28T11:55:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.202+0000 7fef550cc700 1 --2- 172.21.15.50:0/2216438696 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef50152bb0 0x7fef50157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.202+0000 7fef550cc700 1 --2- 172.21.15.50:0/2216438696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef500b3030 0x7fef5014e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.202+0000 7fef550cc700 1 --2- 172.21.15.50:0/2216438696 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fef3c064ee0 0x7fef3c067390 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.202+0000 7fef550cc700 1 --2- 172.21.15.50:0/2216438696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef5006c640 0x7fef501f2730 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.202+0000 7fef550cc700 1 -- 172.21.15.50:0/2216438696 >> 172.21.15.50:0/2216438696 conn(0x7fef5006e000 msgr2=0x7fef5006b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.202+0000 7fef550cc700 1 -- 172.21.15.50:0/2216438696 shutdown_connections 2023-11-28T11:55:55.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.202+0000 7fef550cc700 1 -- 172.21.15.50:0/2216438696 wait complete. 2023-11-28T11:55:55.222 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T11:55:55.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T11:55:55.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.342+0000 7f7cc359e700 1 Processor -- start 2023-11-28T11:55:55.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.346+0000 7f7cc359e700 1 -- start start 2023-11-28T11:55:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.346+0000 7f7cc359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7cc40cf7f0 0x7f7cc406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.346+0000 7f7cc359e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc406a9c0 con 0x7f7cc406a4c0 2023-11-28T11:55:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.346+0000 7f7cc359e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc406aca0 con 0x7f7cc40b1ae0 2023-11-28T11:55:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.346+0000 7f7cc359e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc40d0ab0 con 0x7f7cc40cf7f0 2023-11-28T11:55:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.346+0000 7f7cc1d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7cc406a4c0 0x7f7cc40cf0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57088/0 (socket says 172.21.15.50:57088) 2023-11-28T11:55:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.346+0000 7f7cc2d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7cc40cf7f0 0x7f7cc406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.346+0000 7f7cc1d9b700 1 -- 172.21.15.50:0/224912220 learned_addr learned my addr 172.21.15.50:0/224912220 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:55.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.346+0000 7f7cc159a700 1 -- 172.21.15.50:0/224912220 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810921707 0 0) 0x7f7cc406a9c0 con 0x7f7cc406a4c0 2023-11-28T11:55:55.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.346+0000 7f7cc159a700 1 -- 172.21.15.50:0/224912220 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cac0035d0 con 0x7f7cc406a4c0 2023-11-28T11:55:55.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.346+0000 7f7cc2d9d700 1 -- 172.21.15.50:0/224912220 >> v1:172.21.15.192:6789/0 conn(0x7f7cc40b1ae0 legacy=0x7f7cc40d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:55.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.346+0000 7f7cc2d9d700 1 -- 172.21.15.50:0/224912220 >> v1:172.21.15.50:6789/0 conn(0x7f7cc406a4c0 legacy=0x7f7cc40cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:55.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.346+0000 7f7cc2d9d700 1 -- 172.21.15.50:0/224912220 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc406af80 con 0x7f7cc40cf7f0 2023-11-28T11:55:55.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.346+0000 7f7cc2d9d700 1 --2- 172.21.15.50:0/224912220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cc40cf7f0 0x7f7cc406d8e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc009d90 tx=0x7f7cbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0771da676c7963 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:55.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.346+0000 7f7cc159a700 1 -- 172.21.15.50:0/224912220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc00e070 con 0x7f7cc40cf7f0 2023-11-28T11:55:55.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.346+0000 7f7cc159a700 1 -- 172.21.15.50:0/224912220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc00bb20 con 0x7f7cc40cf7f0 2023-11-28T11:55:55.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.346+0000 7f7cc159a700 1 -- 172.21.15.50:0/224912220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc012430 con 0x7f7cc40cf7f0 2023-11-28T11:55:55.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.350+0000 7f7cc359e700 1 -- 172.21.15.50:0/224912220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cc40cf7f0 msgr2=0x7f7cc406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:55.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.350+0000 7f7cc359e700 1 --2- 172.21.15.50:0/224912220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cc40cf7f0 0x7f7cc406d8e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc009d90 tx=0x7f7cbc00b330 comp rx=0 tx=0).stop 2023-11-28T11:55:55.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.350+0000 7f7cc359e700 1 -- 172.21.15.50:0/224912220 shutdown_connections 2023-11-28T11:55:55.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.350+0000 7f7cc359e700 1 --2- 172.21.15.50:0/224912220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cc40cf7f0 0x7f7cc406d8e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:55.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.350+0000 7f7cc359e700 1 -- 172.21.15.50:0/224912220 >> 172.21.15.50:0/224912220 conn(0x7f7cc409bbd0 msgr2=0x7f7cc40b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:55.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.350+0000 7f7cc359e700 1 -- 172.21.15.50:0/224912220 shutdown_connections 2023-11-28T11:55:55.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.350+0000 7f7cc359e700 1 -- 172.21.15.50:0/224912220 wait complete. 2023-11-28T11:55:55.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.350+0000 7f7cc359e700 1 Processor -- start 2023-11-28T11:55:55.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.350+0000 7f7cc359e700 1 -- start start 2023-11-28T11:55:55.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.350+0000 7f7cc359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cc406a4c0 0x7f7cc40c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:55.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.350+0000 7f7cc359e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cc40b1ae0 0x7f7cc41525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:55.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.350+0000 7f7cc359e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cc40cf7f0 0x7f7cc415d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:55.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.350+0000 7f7cc359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc40c89e0 con 0x7f7cc406a4c0 2023-11-28T11:55:55.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.350+0000 7f7cc359e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc40c7d60 con 0x7f7cc40b1ae0 2023-11-28T11:55:55.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.350+0000 7f7cc359e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc40c8040 con 0x7f7cc40cf7f0 2023-11-28T11:55:55.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cc259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cc406a4c0 0x7f7cc40c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:55.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cc2d9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cc40cf7f0 0x7f7cc415d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:55.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cc259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cc406a4c0 0x7f7cc40c76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36492/0 (socket says 172.21.15.50:36492) 2023-11-28T11:55:55.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cc259c700 1 -- 172.21.15.50:0/4085903270 learned_addr learned my addr 172.21.15.50:0/4085903270 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:55.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cc1d9b700 1 --2- 172.21.15.50:0/4085903270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cc40b1ae0 0x7f7cc41525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:55.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cc2d9d700 1 -- 172.21.15.50:0/4085903270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cc40b1ae0 msgr2=0x7f7cc41525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:55.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cc2d9d700 1 --2- 172.21.15.50:0/4085903270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cc40b1ae0 0x7f7cc41525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:55.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cc2d9d700 1 -- 172.21.15.50:0/4085903270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cc406a4c0 msgr2=0x7f7cc40c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:55.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cc2d9d700 1 --2- 172.21.15.50:0/4085903270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cc406a4c0 0x7f7cc40c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:55.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cc2d9d700 1 -- 172.21.15.50:0/4085903270 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cbc009a70 con 0x7f7cc40cf7f0 2023-11-28T11:55:55.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cc2d9d700 1 --2- 172.21.15.50:0/4085903270 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cc40cf7f0 0x7f7cc415d9b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc016000 tx=0x7f7cbc004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:55.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cb2ffd700 1 -- 172.21.15.50:0/4085903270 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc012430 con 0x7f7cc40cf7f0 2023-11-28T11:55:55.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cc359e700 1 -- 172.21.15.50:0/4085903270 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc40b1eb0 con 0x7f7cc40cf7f0 2023-11-28T11:55:55.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cb2ffd700 1 -- 172.21.15.50:0/4085903270 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc020070 con 0x7f7cc40cf7f0 2023-11-28T11:55:55.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cb2ffd700 1 -- 172.21.15.50:0/4085903270 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc004280 con 0x7f7cc40cf7f0 2023-11-28T11:55:55.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cc359e700 1 -- 172.21.15.50:0/4085903270 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc40b4380 con 0x7f7cc40cf7f0 2023-11-28T11:55:55.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cc359e700 1 -- 172.21.15.50:0/4085903270 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc40b60e0 con 0x7f7cc40cf7f0 2023-11-28T11:55:55.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.354+0000 7f7cb2ffd700 1 -- 172.21.15.50:0/4085903270 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7cbc02e070 con 0x7f7cc40cf7f0 2023-11-28T11:55:55.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.358+0000 7f7cb2ffd700 1 --2- 172.21.15.50:0/4085903270 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7ca4064f10 0x7f7ca40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:55.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.358+0000 7f7cb2ffd700 1 -- 172.21.15.50:0/4085903270 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7cbc022070 con 0x7f7cc40cf7f0 2023-11-28T11:55:55.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.358+0000 7f7cc259c700 1 --2- 172.21.15.50:0/4085903270 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7ca4064f10 0x7f7ca40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:55.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.358+0000 7f7cc259c700 1 --2- 172.21.15.50:0/4085903270 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7ca4064f10 0x7f7ca40673c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40018a0 tx=0x7f7cb4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.370+0000 7f7cb2ffd700 1 -- 172.21.15.50:0/4085903270 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7cbc051c10 con 0x7f7cc40cf7f0 2023-11-28T11:55:55.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:55.530+0000 7f7cc359e700 1 -- 172.21.15.50:0/4085903270 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7cc40c8b20 con 0x7f7cc40cf7f0 2023-11-28T11:55:56.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.550+0000 7f7cb2ffd700 1 -- 172.21.15.50:0/4085903270 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v51) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7cc40c8b20 con 0x7f7cc40cf7f0 2023-11-28T11:55:56.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.558+0000 7f7cc359e700 1 -- 172.21.15.50:0/4085903270 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7ca4064f10 msgr2=0x7f7ca40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:56.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.558+0000 7f7cc359e700 1 --2- 172.21.15.50:0/4085903270 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7ca4064f10 0x7f7ca40673c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40018a0 tx=0x7f7cb4009040 comp rx=0 tx=0).stop 2023-11-28T11:55:56.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.558+0000 7f7cc359e700 1 -- 172.21.15.50:0/4085903270 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cc40cf7f0 msgr2=0x7f7cc415d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:56.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.558+0000 7f7cc359e700 1 --2- 172.21.15.50:0/4085903270 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cc40cf7f0 0x7f7cc415d9b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc016000 tx=0x7f7cbc004af0 comp rx=0 tx=0).stop 2023-11-28T11:55:56.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.558+0000 7f7cc359e700 1 -- 172.21.15.50:0/4085903270 shutdown_connections 2023-11-28T11:55:56.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.558+0000 7f7cc359e700 1 --2- 172.21.15.50:0/4085903270 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cc40cf7f0 0x7f7cc415d9b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:56.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.558+0000 7f7cc359e700 1 --2- 172.21.15.50:0/4085903270 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7ca4064f10 0x7f7ca40673c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:56.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.558+0000 7f7cc359e700 1 --2- 172.21.15.50:0/4085903270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cc40b1ae0 0x7f7cc41525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:56.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.558+0000 7f7cc359e700 1 --2- 172.21.15.50:0/4085903270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7cc406a4c0 0x7f7cc40c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:56.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.558+0000 7f7cc359e700 1 -- 172.21.15.50:0/4085903270 >> 172.21.15.50:0/4085903270 conn(0x7f7cc409bbd0 msgr2=0x7f7cc415bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:56.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.558+0000 7f7cc359e700 1 -- 172.21.15.50:0/4085903270 shutdown_connections 2023-11-28T11:55:56.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.558+0000 7f7cc359e700 1 -- 172.21.15.50:0/4085903270 wait complete. 2023-11-28T11:55:56.563 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-11-28T11:55:56.575 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T11:55:56.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f0573fff700 1 Processor -- start 2023-11-28T11:55:56.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f0573fff700 1 -- start start 2023-11-28T11:55:56.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f0573fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05740b1ae0 0x7f057406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:56.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f0573fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f057406a4c0 0x7f05740d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:56.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f0573fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057406a9c0 con 0x7f05740cf0e0 2023-11-28T11:55:56.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f0573fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057406aca0 con 0x7f057406a4c0 2023-11-28T11:55:56.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f0573fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057406af80 con 0x7f05740b1ae0 2023-11-28T11:55:56.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f0572ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05740b1ae0 0x7f057406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:56.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f05727fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f057406a4c0 0x7f05740d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:56.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f05737fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f05740cf0e0 0x7f05740b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:51998/0 (socket says 172.21.15.50:51998) 2023-11-28T11:55:56.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f05737fe700 1 -- 172.21.15.50:0/228279761 learned_addr learned my addr 172.21.15.50:0/228279761 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:56.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f0571ffb700 1 -- 172.21.15.50:0/228279761 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077308243 0 0) 0x7f057406a9c0 con 0x7f05740cf0e0 2023-11-28T11:55:56.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f0571ffb700 1 -- 172.21.15.50:0/228279761 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05600035d0 con 0x7f05740cf0e0 2023-11-28T11:55:56.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f05727fc700 1 -- 172.21.15.50:0/228279761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05740b1ae0 msgr2=0x7f057406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:56.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f05727fc700 1 --2- 172.21.15.50:0/228279761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05740b1ae0 0x7f057406d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:56.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f05727fc700 1 -- 172.21.15.50:0/228279761 >> v1:172.21.15.192:6789/0 conn(0x7f05740cf0e0 legacy=0x7f05740b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:56.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f05727fc700 1 -- 172.21.15.50:0/228279761 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05740b4380 con 0x7f057406a4c0 2023-11-28T11:55:56.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.698+0000 7f05727fc700 1 --2- 172.21.15.50:0/228279761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f057406a4c0 0x7f05740d03a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f055c009850 tx=0x7f055c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f7bc79490ea6906 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:56.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.702+0000 7f0571ffb700 1 -- 172.21.15.50:0/228279761 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c011830 con 0x7f057406a4c0 2023-11-28T11:55:56.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.702+0000 7f0571ffb700 1 -- 172.21.15.50:0/228279761 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c011990 con 0x7f057406a4c0 2023-11-28T11:55:56.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.702+0000 7f0571ffb700 1 -- 172.21.15.50:0/228279761 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c011d00 con 0x7f057406a4c0 2023-11-28T11:55:56.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.702+0000 7f0573fff700 1 -- 172.21.15.50:0/228279761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f057406a4c0 msgr2=0x7f05740d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:56.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.702+0000 7f0573fff700 1 --2- 172.21.15.50:0/228279761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f057406a4c0 0x7f05740d03a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f055c009850 tx=0x7f055c009b60 comp rx=0 tx=0).stop 2023-11-28T11:55:56.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.702+0000 7f0573fff700 1 -- 172.21.15.50:0/228279761 shutdown_connections 2023-11-28T11:55:56.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.702+0000 7f0573fff700 1 --2- 172.21.15.50:0/228279761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f057406a4c0 0x7f05740d03a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:56.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.702+0000 7f0573fff700 1 --2- 172.21.15.50:0/228279761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05740b1ae0 0x7f057406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:56.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.702+0000 7f0573fff700 1 -- 172.21.15.50:0/228279761 >> 172.21.15.50:0/228279761 conn(0x7f057409bbd0 msgr2=0x7f05740b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:56.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.702+0000 7f0573fff700 1 -- 172.21.15.50:0/228279761 shutdown_connections 2023-11-28T11:55:56.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.702+0000 7f0573fff700 1 -- 172.21.15.50:0/228279761 wait complete. 2023-11-28T11:55:56.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.702+0000 7f0573fff700 1 Processor -- start 2023-11-28T11:55:56.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.702+0000 7f0573fff700 1 -- start start 2023-11-28T11:55:56.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f0573fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f057406a4c0 0x7f057415f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:56.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f0573fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05740b1ae0 0x7f05740d2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:56.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f0573fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05740cf0e0 0x7f05740d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:56.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f0573fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05740c73b0 con 0x7f05740b1ae0 2023-11-28T11:55:56.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f0573fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05740c7620 con 0x7f057406a4c0 2023-11-28T11:55:56.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f0573fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05740c7900 con 0x7f05740cf0e0 2023-11-28T11:55:56.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f05727fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05740b1ae0 0x7f05740d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:56.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f0572ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f057406a4c0 0x7f057415f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:56.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f05737fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05740cf0e0 0x7f05740d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:56.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f0572ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f057406a4c0 0x7f057415f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:60898/0 (socket says 172.21.15.50:60898) 2023-11-28T11:55:56.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f0572ffd700 1 -- 172.21.15.50:0/3972414270 learned_addr learned my addr 172.21.15.50:0/3972414270 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f0572ffd700 1 -- 172.21.15.50:0/3972414270 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05740cf0e0 msgr2=0x7f05740d2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f0572ffd700 1 --2- 172.21.15.50:0/3972414270 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05740cf0e0 0x7f05740d2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f0572ffd700 1 -- 172.21.15.50:0/3972414270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05740b1ae0 msgr2=0x7f05740d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f0572ffd700 1 --2- 172.21.15.50:0/3972414270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05740b1ae0 0x7f05740d2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f0572ffd700 1 -- 172.21.15.50:0/3972414270 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c0094b0 con 0x7f057406a4c0 2023-11-28T11:55:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f05727fc700 1 --2- 172.21.15.50:0/3972414270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05740b1ae0 0x7f05740d2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:55:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f0572ffd700 1 --2- 172.21.15.50:0/3972414270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f057406a4c0 0x7f057415f5d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f056400e840 tx=0x7f056400eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f056b7fe700 1 -- 172.21.15.50:0/3972414270 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640095a0 con 0x7f057406a4c0 2023-11-28T11:55:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f056b7fe700 1 -- 172.21.15.50:0/3972414270 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0564013680 con 0x7f057406a4c0 2023-11-28T11:55:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f056b7fe700 1 -- 172.21.15.50:0/3972414270 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640139f0 con 0x7f057406a4c0 2023-11-28T11:55:56.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f0573fff700 1 -- 172.21.15.50:0/3972414270 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05740b60e0 con 0x7f057406a4c0 2023-11-28T11:55:56.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.706+0000 7f0573fff700 1 -- 172.21.15.50:0/3972414270 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05740b1eb0 con 0x7f057406a4c0 2023-11-28T11:55:56.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.710+0000 7f0573fff700 1 -- 172.21.15.50:0/3972414270 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05740d08e0 con 0x7f057406a4c0 2023-11-28T11:55:56.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.710+0000 7f056b7fe700 1 -- 172.21.15.50:0/3972414270 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0564019030 con 0x7f057406a4c0 2023-11-28T11:55:56.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.710+0000 7f056b7fe700 1 --2- 172.21.15.50:0/3972414270 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0554064ee0 0x7f0554067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:56.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.710+0000 7f056b7fe700 1 -- 172.21.15.50:0/3972414270 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f0564081b90 con 0x7f057406a4c0 2023-11-28T11:55:56.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.710+0000 7f05727fc700 1 --2- 172.21.15.50:0/3972414270 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0554064ee0 0x7f0554067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:56.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.714+0000 7f05727fc700 1 --2- 172.21.15.50:0/3972414270 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0554064ee0 0x7f0554067390 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f057406a8f0 tx=0x7f055c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:56.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.722+0000 7f056b7fe700 1 -- 172.21.15.50:0/3972414270 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f056404fd50 con 0x7f057406a4c0 2023-11-28T11:55:56.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:56.886+0000 7f0573fff700 1 -- 172.21.15.50:0/3972414270 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f05740c7760 con 0x7f057406a4c0 2023-11-28T11:55:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.566+0000 7f056b7fe700 1 -- 172.21.15.50:0/3972414270 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v52) v1 ==== 170+0+0 (secure 0 0 0) 0x7f05740c7760 con 0x7f057406a4c0 2023-11-28T11:55:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.586+0000 7f0573fff700 1 -- 172.21.15.50:0/3972414270 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0554064ee0 msgr2=0x7f0554067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.586+0000 7f0573fff700 1 --2- 172.21.15.50:0/3972414270 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0554064ee0 0x7f0554067390 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f057406a8f0 tx=0x7f055c01c040 comp rx=0 tx=0).stop 2023-11-28T11:55:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.586+0000 7f0573fff700 1 -- 172.21.15.50:0/3972414270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f057406a4c0 msgr2=0x7f057415f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.586+0000 7f0573fff700 1 --2- 172.21.15.50:0/3972414270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f057406a4c0 0x7f057415f5d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f056400e840 tx=0x7f056400eb50 comp rx=0 tx=0).stop 2023-11-28T11:55:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.586+0000 7f0573fff700 1 -- 172.21.15.50:0/3972414270 shutdown_connections 2023-11-28T11:55:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.586+0000 7f0573fff700 1 --2- 172.21.15.50:0/3972414270 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05740cf0e0 0x7f05740d2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.586+0000 7f0573fff700 1 --2- 172.21.15.50:0/3972414270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05740b1ae0 0x7f05740d2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.586+0000 7f0573fff700 1 --2- 172.21.15.50:0/3972414270 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0554064ee0 0x7f0554067390 secure :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f057406a8f0 tx=0x7f055c01c040 comp rx=0 tx=0).stop 2023-11-28T11:55:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.586+0000 7f0573fff700 1 --2- 172.21.15.50:0/3972414270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f057406a4c0 0x7f057415f5d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.586+0000 7f0573fff700 1 -- 172.21.15.50:0/3972414270 >> 172.21.15.50:0/3972414270 conn(0x7f057409bbd0 msgr2=0x7f05740cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.586+0000 7f0573fff700 1 -- 172.21.15.50:0/3972414270 shutdown_connections 2023-11-28T11:55:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.586+0000 7f0573fff700 1 -- 172.21.15.50:0/3972414270 wait complete. 2023-11-28T11:55:57.595 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-11-28T11:55:57.603 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T11:55:57.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.714+0000 7fbe37018700 1 Processor -- start 2023-11-28T11:55:57.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.714+0000 7fbe37018700 1 -- start start 2023-11-28T11:55:57.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe37018700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe30158850 0x7fbe300c9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:57.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe37018700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbe300cd3a0 0x7fbe300ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:57.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe37018700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe3006a4d0 con 0x7fbe30158480 2023-11-28T11:55:57.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe37018700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe300cc490 con 0x7fbe300cd3a0 2023-11-28T11:55:57.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe37018700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3006a720 con 0x7fbe30158850 2023-11-28T11:55:57.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe36817700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbe300cd3a0 0x7fbe300ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:57.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe36817700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbe300cd3a0 0x7fbe300ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36522/0 (socket says 172.21.15.50:36522) 2023-11-28T11:55:57.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe36817700 1 -- 172.21.15.50:0/3201256218 learned_addr learned my addr 172.21.15.50:0/3201256218 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:57.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe35815700 1 --2- 172.21.15.50:0/3201256218 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe30158850 0x7fbe300c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:57.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe36817700 1 -- 172.21.15.50:0/3201256218 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe30158850 msgr2=0x7fbe300c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:57.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe36817700 1 --2- 172.21.15.50:0/3201256218 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe30158850 0x7fbe300c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:57.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe36817700 1 -- 172.21.15.50:0/3201256218 >> v1:172.21.15.192:6789/0 conn(0x7fbe30158480 legacy=0x7fbe300cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:57.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe36817700 1 -- 172.21.15.50:0/3201256218 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3006aa00 con 0x7fbe300cd3a0 2023-11-28T11:55:57.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe36817700 1 --2- 172.21.15.50:0/3201256218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe300cd3a0 0x7fbe300ceca0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800d150 tx=0x7fbe2800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49d5b63fb44017c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:57.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe35014700 1 -- 172.21.15.50:0/3201256218 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28010070 con 0x7fbe300cd3a0 2023-11-28T11:55:57.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe35014700 1 -- 172.21.15.50:0/3201256218 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2800ddc0 con 0x7fbe300cd3a0 2023-11-28T11:55:57.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe35014700 1 -- 172.21.15.50:0/3201256218 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2800b310 con 0x7fbe300cd3a0 2023-11-28T11:55:57.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe37018700 1 -- 172.21.15.50:0/3201256218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe300cd3a0 msgr2=0x7fbe300ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:57.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe37018700 1 --2- 172.21.15.50:0/3201256218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe300cd3a0 0x7fbe300ceca0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800d150 tx=0x7fbe2800d460 comp rx=0 tx=0).stop 2023-11-28T11:55:57.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe37018700 1 -- 172.21.15.50:0/3201256218 shutdown_connections 2023-11-28T11:55:57.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe37018700 1 --2- 172.21.15.50:0/3201256218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe300cd3a0 0x7fbe300ceca0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:57.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe37018700 1 --2- 172.21.15.50:0/3201256218 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe30158850 0x7fbe300c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:57.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.718+0000 7fbe37018700 1 -- 172.21.15.50:0/3201256218 >> 172.21.15.50:0/3201256218 conn(0x7fbe3006c660 msgr2=0x7fbe3006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:57.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.722+0000 7fbe37018700 1 -- 172.21.15.50:0/3201256218 shutdown_connections 2023-11-28T11:55:57.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.722+0000 7fbe37018700 1 -- 172.21.15.50:0/3201256218 wait complete. 2023-11-28T11:55:57.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.722+0000 7fbe37018700 1 Processor -- start 2023-11-28T11:55:57.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.722+0000 7fbe37018700 1 -- start start 2023-11-28T11:55:57.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.722+0000 7fbe37018700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe300cd3a0 0x7fbe3014fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:57.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.722+0000 7fbe37018700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe30158480 0x7fbe300c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:57.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.722+0000 7fbe37018700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe30158850 0x7fbe300c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:57.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.722+0000 7fbe37018700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe300c3e70 con 0x7fbe30158850 2023-11-28T11:55:57.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.722+0000 7fbe37018700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe300c3260 con 0x7fbe300cd3a0 2023-11-28T11:55:57.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.722+0000 7fbe37018700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe300c3540 con 0x7fbe30158480 2023-11-28T11:55:57.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.722+0000 7fbe36817700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe30158850 0x7fbe300c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.722+0000 7fbe36817700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe30158850 0x7fbe300c4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36530/0 (socket says 172.21.15.50:36530) 2023-11-28T11:55:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.722+0000 7fbe36817700 1 -- 172.21.15.50:0/3263172032 learned_addr learned my addr 172.21.15.50:0/3263172032 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.722+0000 7fbe36016700 1 --2- 172.21.15.50:0/3263172032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe300cd3a0 0x7fbe3014fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.726+0000 7fbe35815700 1 --2- 172.21.15.50:0/3263172032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe30158480 0x7fbe300c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.726+0000 7fbe36817700 1 -- 172.21.15.50:0/3263172032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe30158480 msgr2=0x7fbe300c28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.726+0000 7fbe36817700 1 --2- 172.21.15.50:0/3263172032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe30158480 0x7fbe300c28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.726+0000 7fbe36817700 1 -- 172.21.15.50:0/3263172032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe300cd3a0 msgr2=0x7fbe3014fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.726+0000 7fbe36817700 1 --2- 172.21.15.50:0/3263172032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe300cd3a0 0x7fbe3014fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.726+0000 7fbe36817700 1 -- 172.21.15.50:0/3263172032 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2800bd40 con 0x7fbe30158850 2023-11-28T11:55:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.726+0000 7fbe36817700 1 --2- 172.21.15.50:0/3263172032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe30158850 0x7fbe300c4300 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fbe300cc940 tx=0x7fbe28004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.726+0000 7fbe26ffd700 1 -- 172.21.15.50:0/3263172032 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2800bbc0 con 0x7fbe30158850 2023-11-28T11:55:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.726+0000 7fbe26ffd700 1 -- 172.21.15.50:0/3263172032 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2800b4c0 con 0x7fbe30158850 2023-11-28T11:55:57.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.726+0000 7fbe37018700 1 -- 172.21.15.50:0/3263172032 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe300c9950 con 0x7fbe30158850 2023-11-28T11:55:57.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.726+0000 7fbe26ffd700 1 -- 172.21.15.50:0/3263172032 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2800ae70 con 0x7fbe30158850 2023-11-28T11:55:57.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.726+0000 7fbe37018700 1 -- 172.21.15.50:0/3263172032 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3006ace0 con 0x7fbe30158850 2023-11-28T11:55:57.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.726+0000 7fbe37018700 1 -- 172.21.15.50:0/3263172032 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe300cf1e0 con 0x7fbe30158850 2023-11-28T11:55:57.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.730+0000 7fbe26ffd700 1 -- 172.21.15.50:0/3263172032 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbe2802e070 con 0x7fbe30158850 2023-11-28T11:55:57.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.730+0000 7fbe26ffd700 1 --2- 172.21.15.50:0/3263172032 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbe14064f10 0x7fbe140673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:57.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.730+0000 7fbe26ffd700 1 -- 172.21.15.50:0/3263172032 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6282+0+0 (secure 0 0 0) 0x7fbe280858e0 con 0x7fbe30158850 2023-11-28T11:55:57.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.730+0000 7fbe36016700 1 --2- 172.21.15.50:0/3263172032 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbe14064f10 0x7fbe140673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:57.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.730+0000 7fbe36016700 1 --2- 172.21.15.50:0/3263172032 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbe14064f10 0x7fbe140673c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c000fb0 tx=0x7fbe2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:57.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.738+0000 7fbe26ffd700 1 -- 172.21.15.50:0/3263172032 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbe280539a0 con 0x7fbe30158850 2023-11-28T11:55:57.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.942+0000 7fbe37018700 1 -- 172.21.15.50:0/3263172032 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbe30072c20 con 0x7fbe30158850 2023-11-28T11:55:57.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.954+0000 7fbe26ffd700 1 -- 172.21.15.50:0/3263172032 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbe28056fc0 con 0x7fbe30158850 2023-11-28T11:55:57.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.970+0000 7fbe37018700 1 -- 172.21.15.50:0/3263172032 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbe14064f10 msgr2=0x7fbe140673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:57.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.970+0000 7fbe37018700 1 --2- 172.21.15.50:0/3263172032 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbe14064f10 0x7fbe140673c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c000fb0 tx=0x7fbe2c009040 comp rx=0 tx=0).stop 2023-11-28T11:55:57.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.970+0000 7fbe37018700 1 -- 172.21.15.50:0/3263172032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe30158850 msgr2=0x7fbe300c4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:57.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.970+0000 7fbe37018700 1 --2- 172.21.15.50:0/3263172032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe30158850 0x7fbe300c4300 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fbe300cc940 tx=0x7fbe28004af0 comp rx=0 tx=0).stop 2023-11-28T11:55:57.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.974+0000 7fbe37018700 1 -- 172.21.15.50:0/3263172032 shutdown_connections 2023-11-28T11:55:57.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.974+0000 7fbe37018700 1 --2- 172.21.15.50:0/3263172032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe30158850 0x7fbe300c4300 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:57.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.974+0000 7fbe37018700 1 --2- 172.21.15.50:0/3263172032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe30158480 0x7fbe300c28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:57.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.974+0000 7fbe37018700 1 --2- 172.21.15.50:0/3263172032 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbe14064f10 0x7fbe140673c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:57.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.974+0000 7fbe37018700 1 --2- 172.21.15.50:0/3263172032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe300cd3a0 0x7fbe3014fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:57.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.974+0000 7fbe37018700 1 -- 172.21.15.50:0/3263172032 >> 172.21.15.50:0/3263172032 conn(0x7fbe3006c660 msgr2=0x7fbe3006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:57.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.974+0000 7fbe37018700 1 -- 172.21.15.50:0/3263172032 shutdown_connections 2023-11-28T11:55:57.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:57.974+0000 7fbe37018700 1 -- 172.21.15.50:0/3263172032 wait complete. 2023-11-28T11:55:57.991 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 8 and data pool 9 2023-11-28T11:55:57.997 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:55:58.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.094+0000 7f1ef527f700 1 Processor -- start 2023-11-28T11:55:58.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.094+0000 7f1ef527f700 1 -- start start 2023-11-28T11:55:58.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.094+0000 7f1ef527f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ef00b1ca0 0x7f1ef00b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:58.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.094+0000 7f1ef527f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ef00d2780 0x7f1ef00d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:58.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.094+0000 7f1ef527f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef00cf070 con 0x7f1ef006a330 2023-11-28T11:55:58.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.094+0000 7f1ef527f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef00d3140 con 0x7f1ef00d2780 2023-11-28T11:55:58.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.094+0000 7f1ef527f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef00b2070 con 0x7f1ef00b1ca0 2023-11-28T11:55:58.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.094+0000 7f1ef4a7e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ef00d2780 0x7f1ef00d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:58.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1eef7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1ef006a330 0x7f1ef00cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57104/0 (socket says 172.21.15.50:57104) 2023-11-28T11:55:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1eef7fe700 1 -- 172.21.15.50:0/3663076173 learned_addr learned my addr 172.21.15.50:0/3663076173 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1eeffff700 1 --2- 172.21.15.50:0/3663076173 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ef00b1ca0 0x7f1ef00b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1ef4a7e700 1 -- 172.21.15.50:0/3663076173 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ef00b1ca0 msgr2=0x7f1ef00b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1ef4a7e700 1 --2- 172.21.15.50:0/3663076173 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ef00b1ca0 0x7f1ef00b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1ef4a7e700 1 -- 172.21.15.50:0/3663076173 >> v1:172.21.15.50:6789/0 conn(0x7f1ef006a330 legacy=0x7f1ef00cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1ef4a7e700 1 -- 172.21.15.50:0/3663076173 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef006a8a0 con 0x7f1ef00d2780 2023-11-28T11:55:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1eeeffd700 1 -- 172.21.15.50:0/3663076173 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283382482 0 0) 0x7f1ef00cf070 con 0x7f1ef006a330 2023-11-28T11:55:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1ef4a7e700 1 --2- 172.21.15.50:0/3663076173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef00d2780 0x7f1ef00d2c00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009d90 tx=0x7f1ee800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6440c84d213afc56 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1eeeffd700 1 -- 172.21.15.50:0/3663076173 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee800e070 con 0x7f1ef00d2780 2023-11-28T11:55:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1eeeffd700 1 -- 172.21.15.50:0/3663076173 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee800bb20 con 0x7f1ef00d2780 2023-11-28T11:55:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1eeeffd700 1 -- 172.21.15.50:0/3663076173 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8012430 con 0x7f1ef00d2780 2023-11-28T11:55:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1ef527f700 1 -- 172.21.15.50:0/3663076173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef00d2780 msgr2=0x7f1ef00d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1ef527f700 1 --2- 172.21.15.50:0/3663076173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef00d2780 0x7f1ef00d2c00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009d90 tx=0x7f1ee800b330 comp rx=0 tx=0).stop 2023-11-28T11:55:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1ef527f700 1 -- 172.21.15.50:0/3663076173 shutdown_connections 2023-11-28T11:55:58.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1ef527f700 1 --2- 172.21.15.50:0/3663076173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef00d2780 0x7f1ef00d2c00 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1ef527f700 1 --2- 172.21.15.50:0/3663076173 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ef00b1ca0 0x7f1ef00b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1ef527f700 1 -- 172.21.15.50:0/3663076173 >> 172.21.15.50:0/3663076173 conn(0x7f1ef00b5740 msgr2=0x7f1ef00b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:58.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1ef527f700 1 -- 172.21.15.50:0/3663076173 shutdown_connections 2023-11-28T11:55:58.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.098+0000 7f1ef527f700 1 -- 172.21.15.50:0/3663076173 wait complete. 2023-11-28T11:55:58.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef527f700 1 Processor -- start 2023-11-28T11:55:58.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef527f700 1 -- start start 2023-11-28T11:55:58.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef527f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ef006a330 0x7f1ef00c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:58.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef527f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ef00b1ca0 0x7f1ef00cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:58.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef527f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef00d2780 0x7f1ef00b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:58.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef527f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef00c8d70 con 0x7f1ef00d2780 2023-11-28T11:55:58.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef527f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef00b4240 con 0x7f1ef00b1ca0 2023-11-28T11:55:58.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef527f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef00d1060 con 0x7f1ef006a330 2023-11-28T11:55:58.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef4a7e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef00d2780 0x7f1ef00b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:58.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef4a7e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef00d2780 0x7f1ef00b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36546/0 (socket says 172.21.15.50:36546) 2023-11-28T11:55:58.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef4a7e700 1 -- 172.21.15.50:0/2890813134 learned_addr learned my addr 172.21.15.50:0/2890813134 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:58.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1eeffff700 1 --2- 172.21.15.50:0/2890813134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ef006a330 0x7f1ef00c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:58.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1eef7fe700 1 --2- 172.21.15.50:0/2890813134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ef00b1ca0 0x7f1ef00cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:58.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef4a7e700 1 -- 172.21.15.50:0/2890813134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ef006a330 msgr2=0x7f1ef00c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:58.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef4a7e700 1 --2- 172.21.15.50:0/2890813134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ef006a330 0x7f1ef00c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef4a7e700 1 -- 172.21.15.50:0/2890813134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ef00b1ca0 msgr2=0x7f1ef00cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:58.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef4a7e700 1 --2- 172.21.15.50:0/2890813134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ef00b1ca0 0x7f1ef00cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef4a7e700 1 -- 172.21.15.50:0/2890813134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee8009a70 con 0x7f1ef00d2780 2023-11-28T11:55:58.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1eef7fe700 1 --2- 172.21.15.50:0/2890813134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ef00b1ca0 0x7f1ef00cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:58.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef4a7e700 1 --2- 172.21.15.50:0/2890813134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef00d2780 0x7f1ef00b4530 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00b53e0 tx=0x7f1ee8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:58.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1eecff9700 1 -- 172.21.15.50:0/2890813134 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8012430 con 0x7f1ef00d2780 2023-11-28T11:55:58.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1eecff9700 1 -- 172.21.15.50:0/2890813134 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee8020070 con 0x7f1ef00d2780 2023-11-28T11:55:58.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1eecff9700 1 -- 172.21.15.50:0/2890813134 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8004280 con 0x7f1ef00d2780 2023-11-28T11:55:58.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef527f700 1 -- 172.21.15.50:0/2890813134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef006ae60 con 0x7f1ef00d2780 2023-11-28T11:55:58.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.102+0000 7f1ef527f700 1 -- 172.21.15.50:0/2890813134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef006ab80 con 0x7f1ef00d2780 2023-11-28T11:55:58.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.106+0000 7f1ef527f700 1 -- 172.21.15.50:0/2890813134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef006b140 con 0x7f1ef00d2780 2023-11-28T11:55:58.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.106+0000 7f1eecff9700 1 -- 172.21.15.50:0/2890813134 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1ee802e070 con 0x7f1ef00d2780 2023-11-28T11:55:58.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.106+0000 7f1eecff9700 1 --2- 172.21.15.50:0/2890813134 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1edc064ee0 0x7f1edc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:58.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.106+0000 7f1eecff9700 1 -- 172.21.15.50:0/2890813134 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1ee8022070 con 0x7f1ef00d2780 2023-11-28T11:55:58.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.106+0000 7f1eeffff700 1 --2- 172.21.15.50:0/2890813134 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1edc064ee0 0x7f1edc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:58.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.110+0000 7f1eeffff700 1 --2- 172.21.15.50:0/2890813134 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1edc064ee0 0x7f1edc067390 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009b50 tx=0x7f1ee4009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:58.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.110+0000 7f1eecff9700 1 -- 172.21.15.50:0/2890813134 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1ee8052350 con 0x7f1ef00d2780 2023-11-28T11:55:58.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.274+0000 7f1ef527f700 1 -- 172.21.15.50:0/2890813134 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ef00d1550 con 0x7f1ef00d2780 2023-11-28T11:55:58.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.278+0000 7f1eecff9700 1 -- 172.21.15.50:0/2890813134 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18039 (secure 0 0 0) 0x7f1ee8055970 con 0x7f1ef00d2780 2023-11-28T11:55:58.279 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:58.280 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":53,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:55:57.945427+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:55:55.575648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T11:55:56.934531+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:55:58.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.278+0000 7f1ef527f700 1 -- 172.21.15.50:0/2890813134 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1edc064ee0 msgr2=0x7f1edc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.278+0000 7f1ef527f700 1 --2- 172.21.15.50:0/2890813134 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1edc064ee0 0x7f1edc067390 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009b50 tx=0x7f1ee4009240 comp rx=0 tx=0).stop 2023-11-28T11:55:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.278+0000 7f1ef527f700 1 -- 172.21.15.50:0/2890813134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef00d2780 msgr2=0x7f1ef00b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.278+0000 7f1ef527f700 1 --2- 172.21.15.50:0/2890813134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef00d2780 0x7f1ef00b4530 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00b53e0 tx=0x7f1ee8004af0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.278+0000 7f1ef527f700 1 -- 172.21.15.50:0/2890813134 shutdown_connections 2023-11-28T11:55:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.278+0000 7f1ef527f700 1 --2- 172.21.15.50:0/2890813134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ef00d2780 0x7f1ef00b4530 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.278+0000 7f1ef527f700 1 --2- 172.21.15.50:0/2890813134 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1edc064ee0 0x7f1edc067390 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.278+0000 7f1ef527f700 1 --2- 172.21.15.50:0/2890813134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ef00b1ca0 0x7f1ef00cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.278+0000 7f1ef527f700 1 --2- 172.21.15.50:0/2890813134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ef006a330 0x7f1ef00c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.278+0000 7f1ef527f700 1 -- 172.21.15.50:0/2890813134 >> 172.21.15.50:0/2890813134 conn(0x7f1ef00b5740 msgr2=0x7f1ef00d1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.278+0000 7f1ef527f700 1 -- 172.21.15.50:0/2890813134 shutdown_connections 2023-11-28T11:55:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.278+0000 7f1ef527f700 1 -- 172.21.15.50:0/2890813134 wait complete. 2023-11-28T11:55:58.295 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:55:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.414+0000 7f426a578700 1 Processor -- start 2023-11-28T11:55:58.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.414+0000 7f426a578700 1 -- start start 2023-11-28T11:55:58.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.414+0000 7f426a578700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4264158fc0 0x7f42640b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:58.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.414+0000 7f426a578700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f42640ce770 0x7f426406bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:58.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.414+0000 7f426a578700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42640b1bf0 con 0x7f42640b17a0 2023-11-28T11:55:58.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.414+0000 7f426a578700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4264159390 con 0x7f42640ce770 2023-11-28T11:55:58.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.414+0000 7f426a578700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426415d700 con 0x7f4264158fc0 2023-11-28T11:55:58.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.414+0000 7f42637fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f42640b17a0 0x7f42640ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57114/0 (socket says 172.21.15.50:57114) 2023-11-28T11:55:58.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.414+0000 7f42637fe700 1 -- 172.21.15.50:0/3903443836 learned_addr learned my addr 172.21.15.50:0/3903443836 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:58.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.414+0000 7f4268b15700 1 --2- 172.21.15.50:0/3903443836 >> v2:172.21.15.50:3300/0 conn(0x7f42640ce770 0x7f426406bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:58.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.414+0000 7f4263fff700 1 --2- 172.21.15.50:0/3903443836 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4264158fc0 0x7f42640b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:58.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.414+0000 7f4262ffd700 1 -- 172.21.15.50:0/3903443836 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576424584 0 0) 0x7f425c001490 con 0x7f42640b17a0 2023-11-28T11:55:58.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.414+0000 7f4262ffd700 1 -- 172.21.15.50:0/3903443836 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42500035d0 con 0x7f42640b17a0 2023-11-28T11:55:58.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.414+0000 7f4268b15700 1 -- 172.21.15.50:0/3903443836 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4264158fc0 msgr2=0x7f42640b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:55:58.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.414+0000 7f4268b15700 1 --2- 172.21.15.50:0/3903443836 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4264158fc0 0x7f42640b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.414+0000 7f4268b15700 1 -- 172.21.15.50:0/3903443836 >> v1:172.21.15.50:6789/0 conn(0x7f42640b17a0 legacy=0x7f42640ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:58.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.414+0000 7f4268b15700 1 -- 172.21.15.50:0/3903443836 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42640cebf0 con 0x7f42640ce770 2023-11-28T11:55:58.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.418+0000 7f4268b15700 1 --2- 172.21.15.50:0/3903443836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42640ce770 0x7f426406bb10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4254009850 tx=0x7f4254009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a58c8a00c56481d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:58.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.418+0000 7f4262ffd700 1 -- 172.21.15.50:0/3903443836 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4254011830 con 0x7f42640ce770 2023-11-28T11:55:58.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.418+0000 7f4262ffd700 1 -- 172.21.15.50:0/3903443836 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4254011990 con 0x7f42640ce770 2023-11-28T11:55:58.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.418+0000 7f4262ffd700 1 -- 172.21.15.50:0/3903443836 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4254011d40 con 0x7f42640ce770 2023-11-28T11:55:58.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.418+0000 7f426a578700 1 -- 172.21.15.50:0/3903443836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42640ce770 msgr2=0x7f426406bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:58.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.418+0000 7f426a578700 1 --2- 172.21.15.50:0/3903443836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42640ce770 0x7f426406bb10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4254009850 tx=0x7f4254009b60 comp rx=0 tx=0).stop 2023-11-28T11:55:58.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.418+0000 7f426a578700 1 -- 172.21.15.50:0/3903443836 shutdown_connections 2023-11-28T11:55:58.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.418+0000 7f426a578700 1 --2- 172.21.15.50:0/3903443836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42640ce770 0x7f426406bb10 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.418+0000 7f426a578700 1 --2- 172.21.15.50:0/3903443836 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4264158fc0 0x7f42640b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.418+0000 7f426a578700 1 -- 172.21.15.50:0/3903443836 >> 172.21.15.50:0/3903443836 conn(0x7f42640cc260 msgr2=0x7f42640cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:58.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.418+0000 7f426a578700 1 -- 172.21.15.50:0/3903443836 shutdown_connections 2023-11-28T11:55:58.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.418+0000 7f426a578700 1 -- 172.21.15.50:0/3903443836 wait complete. 2023-11-28T11:55:58.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f426a578700 1 Processor -- start 2023-11-28T11:55:58.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f426a578700 1 -- start start 2023-11-28T11:55:58.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f426a578700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42640b17a0 0x7f42641f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:58.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f426a578700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42640ce770 0x7f42640b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:58.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f426a578700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4264158fc0 0x7f42640ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:58.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f426a578700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4264159c00 con 0x7f42640b17a0 2023-11-28T11:55:58.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f426a578700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4264159ee0 con 0x7f42640ce770 2023-11-28T11:55:58.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f426a578700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426415a1c0 con 0x7f4264158fc0 2023-11-28T11:55:58.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f4263fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42640b17a0 0x7f42641f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:58.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f4263fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42640b17a0 0x7f42641f3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36554/0 (socket says 172.21.15.50:36554) 2023-11-28T11:55:58.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f4263fff700 1 -- 172.21.15.50:0/1798226596 learned_addr learned my addr 172.21.15.50:0/1798226596 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:58.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f42637fe700 1 --2- 172.21.15.50:0/1798226596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42640ce770 0x7f42640b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:58.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f4268b15700 1 --2- 172.21.15.50:0/1798226596 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4264158fc0 0x7f42640ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:58.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f4263fff700 1 -- 172.21.15.50:0/1798226596 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4264158fc0 msgr2=0x7f42640ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:58.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f4263fff700 1 --2- 172.21.15.50:0/1798226596 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4264158fc0 0x7f42640ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f4263fff700 1 -- 172.21.15.50:0/1798226596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42640ce770 msgr2=0x7f42640b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:58.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f4263fff700 1 --2- 172.21.15.50:0/1798226596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42640ce770 0x7f42640b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f4263fff700 1 -- 172.21.15.50:0/1798226596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42540094b0 con 0x7f42640b17a0 2023-11-28T11:55:58.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f42637fe700 1 --2- 172.21.15.50:0/1798226596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42640ce770 0x7f42640b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:55:58.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.422+0000 7f4263fff700 1 --2- 172.21.15.50:0/1798226596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42640b17a0 0x7f42641f3110 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f424c00e9d0 tx=0x7f424c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:58.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.426+0000 7f4260ff9700 1 -- 172.21.15.50:0/1798226596 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c009720 con 0x7f42640b17a0 2023-11-28T11:55:58.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.426+0000 7f4260ff9700 1 -- 172.21.15.50:0/1798226596 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c00c850 con 0x7f42640b17a0 2023-11-28T11:55:58.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.426+0000 7f4260ff9700 1 -- 172.21.15.50:0/1798226596 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c00cbc0 con 0x7f42640b17a0 2023-11-28T11:55:58.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.426+0000 7f426a578700 1 -- 172.21.15.50:0/1798226596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426415cdd0 con 0x7f42640b17a0 2023-11-28T11:55:58.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.426+0000 7f426a578700 1 -- 172.21.15.50:0/1798226596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426415caf0 con 0x7f42640b17a0 2023-11-28T11:55:58.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.426+0000 7f426a578700 1 -- 172.21.15.50:0/1798226596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426415d0b0 con 0x7f42640b17a0 2023-11-28T11:55:58.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.426+0000 7f4260ff9700 1 -- 172.21.15.50:0/1798226596 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f424c019030 con 0x7f42640b17a0 2023-11-28T11:55:58.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.430+0000 7f4260ff9700 1 --2- 172.21.15.50:0/1798226596 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4244064ee0 0x7f4244067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:58.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.430+0000 7f4260ff9700 1 -- 172.21.15.50:0/1798226596 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f424c082080 con 0x7f42640b17a0 2023-11-28T11:55:58.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.430+0000 7f42637fe700 1 --2- 172.21.15.50:0/1798226596 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4244064ee0 0x7f4244067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:58.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.430+0000 7f42637fe700 1 --2- 172.21.15.50:0/1798226596 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4244064ee0 0x7f4244067390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f42640b36e0 tx=0x7f425c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:58.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.434+0000 7f4260ff9700 1 -- 172.21.15.50:0/1798226596 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f424c050060 con 0x7f42640b17a0 2023-11-28T11:55:58.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.602+0000 7f426a578700 1 -- 172.21.15.50:0/1798226596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42640b15a0 con 0x7f42640b17a0 2023-11-28T11:55:58.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.606+0000 7f4260ff9700 1 -- 172.21.15.50:0/1798226596 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18039 (secure 0 0 0) 0x7f424c053680 con 0x7f42640b17a0 2023-11-28T11:55:58.607 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:55:58.608 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":53,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:55:57.945427+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:55:55.575648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T11:55:56.934531+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:55:58.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.606+0000 7f426a578700 1 -- 172.21.15.50:0/1798226596 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4244064ee0 msgr2=0x7f4244067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.606+0000 7f426a578700 1 --2- 172.21.15.50:0/1798226596 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4244064ee0 0x7f4244067390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f42640b36e0 tx=0x7f425c009040 comp rx=0 tx=0).stop 2023-11-28T11:55:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.606+0000 7f426a578700 1 -- 172.21.15.50:0/1798226596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42640b17a0 msgr2=0x7f42641f3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.606+0000 7f426a578700 1 --2- 172.21.15.50:0/1798226596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42640b17a0 0x7f42641f3110 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f424c00e9d0 tx=0x7f424c00ed90 comp rx=0 tx=0).stop 2023-11-28T11:55:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.606+0000 7f426a578700 1 -- 172.21.15.50:0/1798226596 shutdown_connections 2023-11-28T11:55:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.606+0000 7f426a578700 1 --2- 172.21.15.50:0/1798226596 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4264158fc0 0x7f42640ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.606+0000 7f426a578700 1 --2- 172.21.15.50:0/1798226596 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4244064ee0 0x7f4244067390 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.606+0000 7f426a578700 1 --2- 172.21.15.50:0/1798226596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42640ce770 0x7f42640b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.606+0000 7f426a578700 1 --2- 172.21.15.50:0/1798226596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42640b17a0 0x7f42641f3110 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.606+0000 7f426a578700 1 -- 172.21.15.50:0/1798226596 >> 172.21.15.50:0/1798226596 conn(0x7f42640cc260 msgr2=0x7f4264154b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.606+0000 7f426a578700 1 -- 172.21.15.50:0/1798226596 shutdown_connections 2023-11-28T11:55:58.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.606+0000 7f426a578700 1 -- 172.21.15.50:0/1798226596 wait complete. 2023-11-28T11:55:58.630 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T11:55:58.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.750+0000 7f6bbaf4d700 1 Processor -- start 2023-11-28T11:55:58.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.750+0000 7f6bbaf4d700 1 -- start start 2023-11-28T11:55:58.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.750+0000 7f6bbaf4d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bb40ae040 0x7f6bb406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.750+0000 7f6bbaf4d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb40c99d0 con 0x7f6bb40ce860 2023-11-28T11:55:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.750+0000 7f6bbaf4d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb40cae00 con 0x7f6bb40cb6f0 2023-11-28T11:55:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.750+0000 7f6bbaf4d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40c9430 con 0x7f6bb40ae040 2023-11-28T11:55:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.750+0000 7f6bb974a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6bb40ce860 0x7f6bb4069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57126/0 (socket says 172.21.15.50:57126) 2023-11-28T11:55:58.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.750+0000 7f6bb974a700 1 -- 172.21.15.50:0/2404003894 learned_addr learned my addr 172.21.15.50:0/2404003894 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:55:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bb9f4b700 1 --2- 172.21.15.50:0/2404003894 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bb40ae040 0x7f6bb406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bb8f49700 1 -- 172.21.15.50:0/2404003894 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086907238 0 0) 0x7f6bb40c99d0 con 0x7f6bb40ce860 2023-11-28T11:55:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bb8f49700 1 -- 172.21.15.50:0/2404003894 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ba00035d0 con 0x7f6bb40ce860 2023-11-28T11:55:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bb8f49700 1 -- 172.21.15.50:0/2404003894 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059146372 0 0) 0x7f6bb40cae00 con 0x7f6bb40cb6f0 2023-11-28T11:55:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bb9f4b700 1 -- 172.21.15.50:0/2404003894 >> v1:172.21.15.192:6789/0 conn(0x7f6bb40cb6f0 legacy=0x7f6bb40cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:58.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bb9f4b700 1 -- 172.21.15.50:0/2404003894 >> v1:172.21.15.50:6789/0 conn(0x7f6bb40ce860 legacy=0x7f6bb4069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bb9f4b700 1 -- 172.21.15.50:0/2404003894 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb40c96f0 con 0x7f6bb40ae040 2023-11-28T11:55:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bb9f4b700 1 --2- 172.21.15.50:0/2404003894 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bb40ae040 0x7f6bb406cdd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009880 tx=0x7f6ba4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=676a2ef7babbec5d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bb8f49700 1 -- 172.21.15.50:0/2404003894 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4011830 con 0x7f6bb40ae040 2023-11-28T11:55:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bb8f49700 1 -- 172.21.15.50:0/2404003894 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba4011990 con 0x7f6bb40ae040 2023-11-28T11:55:58.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bb8f49700 1 -- 172.21.15.50:0/2404003894 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4011d20 con 0x7f6bb40ae040 2023-11-28T11:55:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bbaf4d700 1 -- 172.21.15.50:0/2404003894 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bb40ae040 msgr2=0x7f6bb406cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bbaf4d700 1 --2- 172.21.15.50:0/2404003894 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bb40ae040 0x7f6bb406cdd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009880 tx=0x7f6ba4009b90 comp rx=0 tx=0).stop 2023-11-28T11:55:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bbaf4d700 1 -- 172.21.15.50:0/2404003894 shutdown_connections 2023-11-28T11:55:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bbaf4d700 1 --2- 172.21.15.50:0/2404003894 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bb40ae040 0x7f6bb406cdd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bbaf4d700 1 -- 172.21.15.50:0/2404003894 >> 172.21.15.50:0/2404003894 conn(0x7f6bb40b0990 msgr2=0x7f6bb40b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bbaf4d700 1 -- 172.21.15.50:0/2404003894 shutdown_connections 2023-11-28T11:55:58.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.754+0000 7f6bbaf4d700 1 -- 172.21.15.50:0/2404003894 wait complete. 2023-11-28T11:55:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bbaf4d700 1 Processor -- start 2023-11-28T11:55:58.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bbaf4d700 1 -- start start 2023-11-28T11:55:58.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bbaf4d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bb40ae040 0x7f6bb414ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bbaf4d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bb40cb6f0 0x7f6bb40ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bbaf4d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bb40ce860 0x7f6bb40abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bbaf4d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40b5d50 con 0x7f6bb40ae040 2023-11-28T11:55:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bbaf4d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb414de00 con 0x7f6bb40ce860 2023-11-28T11:55:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bb9f4b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bb40ae040 0x7f6bb414ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bbaf4d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb414d540 con 0x7f6bb40cb6f0 2023-11-28T11:55:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bb9f4b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bb40ae040 0x7f6bb414ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36570/0 (socket says 172.21.15.50:36570) 2023-11-28T11:55:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bb9f4b700 1 -- 172.21.15.50:0/752376429 learned_addr learned my addr 172.21.15.50:0/752376429 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:55:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bb974a700 1 --2- 172.21.15.50:0/752376429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bb40cb6f0 0x7f6bb40ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bba74c700 1 --2- 172.21.15.50:0/752376429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bb40ce860 0x7f6bb40abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bb9f4b700 1 -- 172.21.15.50:0/752376429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bb40cb6f0 msgr2=0x7f6bb40ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bb9f4b700 1 --2- 172.21.15.50:0/752376429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bb40cb6f0 0x7f6bb40ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bb9f4b700 1 -- 172.21.15.50:0/752376429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bb40ce860 msgr2=0x7f6bb40abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:58.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bb9f4b700 1 --2- 172.21.15.50:0/752376429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bb40ce860 0x7f6bb40abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:58.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bb9f4b700 1 -- 172.21.15.50:0/752376429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40094b0 con 0x7f6bb40ae040 2023-11-28T11:55:58.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bb9f4b700 1 --2- 172.21.15.50:0/752376429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bb40ae040 0x7f6bb414ce10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40097d0 tx=0x7f6ba4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:58.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6baa7fc700 1 -- 172.21.15.50:0/752376429 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4019a80 con 0x7f6bb40ae040 2023-11-28T11:55:58.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6baa7fc700 1 -- 172.21.15.50:0/752376429 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba401e070 con 0x7f6bb40ae040 2023-11-28T11:55:58.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bbaf4d700 1 -- 172.21.15.50:0/752376429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb40cb380 con 0x7f6bb40ae040 2023-11-28T11:55:58.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6baa7fc700 1 -- 172.21.15.50:0/752376429 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4019e20 con 0x7f6bb40ae040 2023-11-28T11:55:58.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.758+0000 7f6bbaf4d700 1 -- 172.21.15.50:0/752376429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb40cb0a0 con 0x7f6bb40ae040 2023-11-28T11:55:58.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.762+0000 7f6bbaf4d700 1 -- 172.21.15.50:0/752376429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb40ae410 con 0x7f6bb40ae040 2023-11-28T11:55:58.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.762+0000 7f6baa7fc700 1 -- 172.21.15.50:0/752376429 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6ba400f050 con 0x7f6bb40ae040 2023-11-28T11:55:58.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.762+0000 7f6baa7fc700 1 --2- 172.21.15.50:0/752376429 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6b98064ee0 0x7f6b98067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:55:58.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.762+0000 7f6baa7fc700 1 -- 172.21.15.50:0/752376429 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6ba40830a0 con 0x7f6bb40ae040 2023-11-28T11:55:58.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.762+0000 7f6bb974a700 1 --2- 172.21.15.50:0/752376429 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6b98064ee0 0x7f6b98067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:55:58.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.766+0000 7f6bb974a700 1 --2- 172.21.15.50:0/752376429 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6b98064ee0 0x7f6b98067390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4153bb0 tx=0x7f6bb0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:55:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.770+0000 7f6baa7fc700 1 -- 172.21.15.50:0/752376429 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6ba4051100 con 0x7f6bb40ae040 2023-11-28T11:55:58.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:58.970+0000 7f6bbaf4d700 1 -- 172.21.15.50:0/752376429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6bb4072500 con 0x7f6bb40ae040 2023-11-28T11:55:59.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:59.966+0000 7f6baa7fc700 1 -- 172.21.15.50:0/752376429 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6ba4054720 con 0x7f6bb40ae040 2023-11-28T11:55:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:59.970+0000 7f6bbaf4d700 1 -- 172.21.15.50:0/752376429 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6b98064ee0 msgr2=0x7f6b98067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:59.970+0000 7f6bbaf4d700 1 --2- 172.21.15.50:0/752376429 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6b98064ee0 0x7f6b98067390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4153bb0 tx=0x7f6bb0009040 comp rx=0 tx=0).stop 2023-11-28T11:55:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:59.970+0000 7f6bbaf4d700 1 -- 172.21.15.50:0/752376429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bb40ae040 msgr2=0x7f6bb414ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:55:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:59.970+0000 7f6bbaf4d700 1 --2- 172.21.15.50:0/752376429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bb40ae040 0x7f6bb414ce10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40097d0 tx=0x7f6ba4004770 comp rx=0 tx=0).stop 2023-11-28T11:55:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:59.970+0000 7f6bbaf4d700 1 -- 172.21.15.50:0/752376429 shutdown_connections 2023-11-28T11:55:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:59.970+0000 7f6bbaf4d700 1 --2- 172.21.15.50:0/752376429 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6b98064ee0 0x7f6b98067390 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:59.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:59.970+0000 7f6bbaf4d700 1 --2- 172.21.15.50:0/752376429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bb40ce860 0x7f6bb40abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:59.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:59.970+0000 7f6bbaf4d700 1 --2- 172.21.15.50:0/752376429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bb40cb6f0 0x7f6bb40ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:59.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:59.970+0000 7f6bbaf4d700 1 --2- 172.21.15.50:0/752376429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bb40ae040 0x7f6bb414ce10 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:55:59.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:59.970+0000 7f6bbaf4d700 1 -- 172.21.15.50:0/752376429 >> 172.21.15.50:0/752376429 conn(0x7f6bb40b0990 msgr2=0x7f6bb406c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:55:59.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:59.970+0000 7f6bbaf4d700 1 -- 172.21.15.50:0/752376429 shutdown_connections 2023-11-28T11:55:59.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:55:59.970+0000 7f6bbaf4d700 1 -- 172.21.15.50:0/752376429 wait complete. 2023-11-28T11:55:59.990 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T11:55:59.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T11:56:00.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.114+0000 7f2ea31d7700 1 Processor -- start 2023-11-28T11:56:00.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.114+0000 7f2ea31d7700 1 -- start start 2023-11-28T11:56:00.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea31d7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e940dd280 0x7f2e94050760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:00.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea31d7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2e940dfb70 0x7f2e94036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:00.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea31d7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e94052bf0 con 0x7f2e94036cb0 2023-11-28T11:56:00.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea31d7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e940dd650 con 0x7f2e940dfb70 2023-11-28T11:56:00.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea31d7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e94037130 con 0x7f2e940dd280 2023-11-28T11:56:00.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea19d4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2e940dfb70 0x7f2e94036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea29d6700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2e94036cb0 0x7f2e940e3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:52020/0 (socket says 172.21.15.50:52020) 2023-11-28T11:56:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea29d6700 1 -- 172.21.15.50:0/1562406735 learned_addr learned my addr 172.21.15.50:0/1562406735 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea21d5700 1 --2- 172.21.15.50:0/1562406735 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e940dd280 0x7f2e94050760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea19d4700 1 -- 172.21.15.50:0/1562406735 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e940dd280 msgr2=0x7f2e94050760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea19d4700 1 --2- 172.21.15.50:0/1562406735 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e940dd280 0x7f2e94050760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea19d4700 1 -- 172.21.15.50:0/1562406735 >> v1:172.21.15.192:6789/0 conn(0x7f2e94036cb0 legacy=0x7f2e940e3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea11d3700 1 -- 172.21.15.50:0/1562406735 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606802309 0 0) 0x7f2e94052bf0 con 0x7f2e94036cb0 2023-11-28T11:56:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea19d4700 1 -- 172.21.15.50:0/1562406735 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e940528c0 con 0x7f2e940dfb70 2023-11-28T11:56:00.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea19d4700 1 --2- 172.21.15.50:0/1562406735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e940dfb70 0x7f2e94036770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009850 tx=0x7f2e90009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93fee26235883b53 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:00.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea11d3700 1 -- 172.21.15.50:0/1562406735 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90011830 con 0x7f2e940dfb70 2023-11-28T11:56:00.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea11d3700 1 -- 172.21.15.50:0/1562406735 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e90011990 con 0x7f2e940dfb70 2023-11-28T11:56:00.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea11d3700 1 -- 172.21.15.50:0/1562406735 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90011d40 con 0x7f2e940dfb70 2023-11-28T11:56:00.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea31d7700 1 -- 172.21.15.50:0/1562406735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e940dfb70 msgr2=0x7f2e94036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:00.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea31d7700 1 --2- 172.21.15.50:0/1562406735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e940dfb70 0x7f2e94036770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009850 tx=0x7f2e90009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:00.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea31d7700 1 -- 172.21.15.50:0/1562406735 shutdown_connections 2023-11-28T11:56:00.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea31d7700 1 --2- 172.21.15.50:0/1562406735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e940dfb70 0x7f2e94036770 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:00.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea31d7700 1 --2- 172.21.15.50:0/1562406735 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e940dd280 0x7f2e94050760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:00.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea31d7700 1 -- 172.21.15.50:0/1562406735 >> 172.21.15.50:0/1562406735 conn(0x7f2e94051770 msgr2=0x7f2e94051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea31d7700 1 -- 172.21.15.50:0/1562406735 shutdown_connections 2023-11-28T11:56:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.118+0000 7f2ea31d7700 1 -- 172.21.15.50:0/1562406735 wait complete. 2023-11-28T11:56:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea31d7700 1 Processor -- start 2023-11-28T11:56:00.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea31d7700 1 -- start start 2023-11-28T11:56:00.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea31d7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e94036cb0 0x7f2e94175810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:00.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea31d7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e940dd280 0x7f2e94049230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:00.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea31d7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e940dfb70 0x7f2e940d7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:00.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea31d7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e940d0a80 con 0x7f2e940dd280 2023-11-28T11:56:00.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea31d7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9404a900 con 0x7f2e94036cb0 2023-11-28T11:56:00.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea31d7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e94049cf0 con 0x7f2e940dfb70 2023-11-28T11:56:00.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea19d4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e940dd280 0x7f2e94049230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:00.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea21d5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e94036cb0 0x7f2e94175810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:00.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea19d4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e940dd280 0x7f2e94049230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36574/0 (socket says 172.21.15.50:36574) 2023-11-28T11:56:00.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea19d4700 1 -- 172.21.15.50:0/236497312 learned_addr learned my addr 172.21.15.50:0/236497312 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:00.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea29d6700 1 --2- 172.21.15.50:0/236497312 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e940dfb70 0x7f2e940d7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:00.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea19d4700 1 -- 172.21.15.50:0/236497312 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e940dfb70 msgr2=0x7f2e940d7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:00.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea19d4700 1 --2- 172.21.15.50:0/236497312 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e940dfb70 0x7f2e940d7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:00.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea19d4700 1 -- 172.21.15.50:0/236497312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e94036cb0 msgr2=0x7f2e94175810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:00.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea19d4700 1 --2- 172.21.15.50:0/236497312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e94036cb0 0x7f2e94175810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:00.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea19d4700 1 -- 172.21.15.50:0/236497312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e900094b0 con 0x7f2e940dd280 2023-11-28T11:56:00.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.122+0000 7f2ea19d4700 1 --2- 172.21.15.50:0/236497312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e940dd280 0x7f2e94049230 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f2e900090b0 tx=0x7f2e90004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:00.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.126+0000 7f2e8effd700 1 -- 172.21.15.50:0/236497312 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e900036c0 con 0x7f2e940dd280 2023-11-28T11:56:00.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.126+0000 7f2e8effd700 1 -- 172.21.15.50:0/236497312 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9001f070 con 0x7f2e940dd280 2023-11-28T11:56:00.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.126+0000 7f2e8effd700 1 -- 172.21.15.50:0/236497312 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90003a60 con 0x7f2e940dd280 2023-11-28T11:56:00.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.126+0000 7f2ea31d7700 1 -- 172.21.15.50:0/236497312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e940e0710 con 0x7f2e940dd280 2023-11-28T11:56:00.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.126+0000 7f2ea31d7700 1 -- 172.21.15.50:0/236497312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e940e0430 con 0x7f2e940dd280 2023-11-28T11:56:00.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.126+0000 7f2ea31d7700 1 -- 172.21.15.50:0/236497312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e940e09f0 con 0x7f2e940dd280 2023-11-28T11:56:00.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.126+0000 7f2e8effd700 1 -- 172.21.15.50:0/236497312 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2e9000f050 con 0x7f2e940dd280 2023-11-28T11:56:00.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.126+0000 7f2e8effd700 1 --2- 172.21.15.50:0/236497312 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2e80064ee0 0x7f2e80067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:00.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.126+0000 7f2e8effd700 1 -- 172.21.15.50:0/236497312 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2e90021070 con 0x7f2e940dd280 2023-11-28T11:56:00.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.130+0000 7f2ea21d5700 1 --2- 172.21.15.50:0/236497312 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2e80064ee0 0x7f2e80067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:00.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.130+0000 7f2ea21d5700 1 --2- 172.21.15.50:0/236497312 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2e80064ee0 0x7f2e80067390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009b50 tx=0x7f2e98009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:00.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.138+0000 7f2e8effd700 1 -- 172.21.15.50:0/236497312 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2e90051a80 con 0x7f2e940dd280 2023-11-28T11:56:00.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.338+0000 7f2ea31d7700 1 -- 172.21.15.50:0/236497312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2e940055e0 con 0x7f2e940dd280 2023-11-28T11:56:00.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.974+0000 7f2e8effd700 1 -- 172.21.15.50:0/236497312 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2e940055e0 con 0x7f2e940dd280 2023-11-28T11:56:00.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.978+0000 7f2ea31d7700 1 -- 172.21.15.50:0/236497312 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2e80064ee0 msgr2=0x7f2e80067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:00.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.978+0000 7f2ea31d7700 1 --2- 172.21.15.50:0/236497312 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2e80064ee0 0x7f2e80067390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009b50 tx=0x7f2e98009240 comp rx=0 tx=0).stop 2023-11-28T11:56:00.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.978+0000 7f2ea31d7700 1 -- 172.21.15.50:0/236497312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e940dd280 msgr2=0x7f2e94049230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:00.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.978+0000 7f2ea31d7700 1 --2- 172.21.15.50:0/236497312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e940dd280 0x7f2e94049230 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f2e900090b0 tx=0x7f2e90004770 comp rx=0 tx=0).stop 2023-11-28T11:56:00.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.978+0000 7f2ea31d7700 1 -- 172.21.15.50:0/236497312 shutdown_connections 2023-11-28T11:56:00.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.978+0000 7f2ea31d7700 1 --2- 172.21.15.50:0/236497312 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e940dfb70 0x7f2e940d7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:00.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.978+0000 7f2ea31d7700 1 --2- 172.21.15.50:0/236497312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e940dd280 0x7f2e94049230 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:00.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.978+0000 7f2ea31d7700 1 --2- 172.21.15.50:0/236497312 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2e80064ee0 0x7f2e80067390 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:00.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.978+0000 7f2ea31d7700 1 --2- 172.21.15.50:0/236497312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e94036cb0 0x7f2e94175810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:00.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.978+0000 7f2ea31d7700 1 -- 172.21.15.50:0/236497312 >> 172.21.15.50:0/236497312 conn(0x7f2e94051770 msgr2=0x7f2e940ddc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:00.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.978+0000 7f2ea31d7700 1 -- 172.21.15.50:0/236497312 shutdown_connections 2023-11-28T11:56:00.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:00.978+0000 7f2ea31d7700 1 -- 172.21.15.50:0/236497312 wait complete. 2023-11-28T11:56:00.998 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T11:56:00.999 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:56:01.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.118+0000 7f0fa8960700 1 Processor -- start 2023-11-28T11:56:01.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.118+0000 7f0fa8960700 1 -- start start 2023-11-28T11:56:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa8960700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0fa406d7d0 0x7f0fa406a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa8960700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fa40b4c10 0x7f0fa40cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa8960700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa406dc70 con 0x7f0fa40cf050 2023-11-28T11:56:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa8960700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa406aa70 con 0x7f0fa406d7d0 2023-11-28T11:56:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa8960700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa415c6d0 con 0x7f0fa40b4c10 2023-11-28T11:56:01.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa2d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0fa40cf050 0x7f0fa40cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57128/0 (socket says 172.21.15.50:57128) 2023-11-28T11:56:01.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa2d9d700 1 -- 172.21.15.50:0/3500536754 learned_addr learned my addr 172.21.15.50:0/3500536754 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:01.125 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa259c700 1 --2- 172.21.15.50:0/3500536754 >> v2:172.21.15.50:3300/0 conn(0x7f0fa406d7d0 0x7f0fa406a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa359e700 1 --2- 172.21.15.50:0/3500536754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fa40b4c10 0x7f0fa40cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa1d9b700 1 -- 172.21.15.50:0/3500536754 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480588601 0 0) 0x7f0f94001490 con 0x7f0fa40cf050 2023-11-28T11:56:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa1d9b700 1 -- 172.21.15.50:0/3500536754 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f8c0035d0 con 0x7f0fa40cf050 2023-11-28T11:56:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa259c700 1 -- 172.21.15.50:0/3500536754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fa40b4c10 msgr2=0x7f0fa40cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa259c700 1 --2- 172.21.15.50:0/3500536754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fa40b4c10 0x7f0fa40cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa259c700 1 -- 172.21.15.50:0/3500536754 >> v1:172.21.15.50:6789/0 conn(0x7f0fa40cf050 legacy=0x7f0fa40cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa259c700 1 -- 172.21.15.50:0/3500536754 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa406ac60 con 0x7f0fa406d7d0 2023-11-28T11:56:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa359e700 1 --2- 172.21.15.50:0/3500536754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fa40b4c10 0x7f0fa40cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:01.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa259c700 1 --2- 172.21.15.50:0/3500536754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fa406d7d0 0x7f0fa406a530 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009850 tx=0x7f0f98009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cce22dd0f6f34cb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:01.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa1d9b700 1 -- 172.21.15.50:0/3500536754 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98011830 con 0x7f0fa406d7d0 2023-11-28T11:56:01.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa1d9b700 1 -- 172.21.15.50:0/3500536754 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f98011990 con 0x7f0fa406d7d0 2023-11-28T11:56:01.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa1d9b700 1 -- 172.21.15.50:0/3500536754 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98011d40 con 0x7f0fa406d7d0 2023-11-28T11:56:01.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa8960700 1 -- 172.21.15.50:0/3500536754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fa406d7d0 msgr2=0x7f0fa406a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:01.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa8960700 1 --2- 172.21.15.50:0/3500536754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fa406d7d0 0x7f0fa406a530 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009850 tx=0x7f0f98009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:01.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa8960700 1 -- 172.21.15.50:0/3500536754 shutdown_connections 2023-11-28T11:56:01.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa8960700 1 --2- 172.21.15.50:0/3500536754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fa40b4c10 0x7f0fa40cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa8960700 1 --2- 172.21.15.50:0/3500536754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fa406d7d0 0x7f0fa406a530 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa8960700 1 -- 172.21.15.50:0/3500536754 >> 172.21.15.50:0/3500536754 conn(0x7f0fa409bb30 msgr2=0x7f0fa40b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:01.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa8960700 1 -- 172.21.15.50:0/3500536754 shutdown_connections 2023-11-28T11:56:01.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.122+0000 7f0fa8960700 1 -- 172.21.15.50:0/3500536754 wait complete. 2023-11-28T11:56:01.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.126+0000 7f0fa8960700 1 Processor -- start 2023-11-28T11:56:01.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.126+0000 7f0fa8960700 1 -- start start 2023-11-28T11:56:01.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa8960700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fa406d7d0 0x7f0fa41f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa8960700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fa40b4c10 0x7f0fa40c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa8960700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fa40cf050 0x7f0fa41f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa8960700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40c77d0 con 0x7f0fa40cf050 2023-11-28T11:56:01.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa8960700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40c7ab0 con 0x7f0fa40b4c10 2023-11-28T11:56:01.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa8960700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40c7d90 con 0x7f0fa406d7d0 2023-11-28T11:56:01.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fa40cf050 0x7f0fa41f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fa40cf050 0x7f0fa41f1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36592/0 (socket says 172.21.15.50:36592) 2023-11-28T11:56:01.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa359e700 1 -- 172.21.15.50:0/3376893368 learned_addr learned my addr 172.21.15.50:0/3376893368 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:01.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa2d9d700 1 --2- 172.21.15.50:0/3376893368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fa406d7d0 0x7f0fa41f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa259c700 1 --2- 172.21.15.50:0/3376893368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fa40b4c10 0x7f0fa40c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa359e700 1 -- 172.21.15.50:0/3376893368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fa406d7d0 msgr2=0x7f0fa41f47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:01.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa359e700 1 --2- 172.21.15.50:0/3376893368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fa406d7d0 0x7f0fa41f47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa359e700 1 -- 172.21.15.50:0/3376893368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fa40b4c10 msgr2=0x7f0fa40c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:01.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa359e700 1 --2- 172.21.15.50:0/3376893368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fa40b4c10 0x7f0fa40c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa359e700 1 -- 172.21.15.50:0/3376893368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f980094b0 con 0x7f0fa40cf050 2023-11-28T11:56:01.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa359e700 1 --2- 172.21.15.50:0/3376893368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fa40cf050 0x7f0fa41f1a00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00e810 tx=0x7f0f9c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:01.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0f8b7fe700 1 -- 172.21.15.50:0/3376893368 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c00c070 con 0x7f0fa40cf050 2023-11-28T11:56:01.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0f8b7fe700 1 -- 172.21.15.50:0/3376893368 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c004020 con 0x7f0fa40cf050 2023-11-28T11:56:01.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa8960700 1 -- 172.21.15.50:0/3376893368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa40b4410 con 0x7f0fa40cf050 2023-11-28T11:56:01.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0f8b7fe700 1 -- 172.21.15.50:0/3376893368 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0043b0 con 0x7f0fa40cf050 2023-11-28T11:56:01.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.130+0000 7f0fa8960700 1 -- 172.21.15.50:0/3376893368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa406af40 con 0x7f0fa40cf050 2023-11-28T11:56:01.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.134+0000 7f0fa8960700 1 -- 172.21.15.50:0/3376893368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa40b46f0 con 0x7f0fa40cf050 2023-11-28T11:56:01.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.134+0000 7f0f8b7fe700 1 -- 172.21.15.50:0/3376893368 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0f9c0036c0 con 0x7f0fa40cf050 2023-11-28T11:56:01.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.134+0000 7f0f8b7fe700 1 --2- 172.21.15.50:0/3376893368 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0f90064ee0 0x7f0f90067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.134+0000 7f0f8b7fe700 1 -- 172.21.15.50:0/3376893368 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0f9c081c90 con 0x7f0fa40cf050 2023-11-28T11:56:01.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.134+0000 7f0fa2d9d700 1 --2- 172.21.15.50:0/3376893368 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0f90064ee0 0x7f0f90067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.134+0000 7f0fa2d9d700 1 --2- 172.21.15.50:0/3376893368 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0f90064ee0 0x7f0f90067390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0f940015f0 tx=0x7f0f94001a00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:01.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.142+0000 7f0f8b7fe700 1 -- 172.21.15.50:0/3376893368 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0f9c04fba0 con 0x7f0fa40cf050 2023-11-28T11:56:01.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.334+0000 7f0fa8960700 1 -- 172.21.15.50:0/3376893368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fa4072500 con 0x7f0fa40cf050 2023-11-28T11:56:01.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.334+0000 7f0f8b7fe700 1 -- 172.21.15.50:0/3376893368 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f0f9c0531c0 con 0x7f0fa40cf050 2023-11-28T11:56:01.339 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:01.339 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2341737190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2341737190},{"type":"v1","addr":"172.21.15.50:6835","nonce":2341737190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5546,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/192527628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":192527628},{"type":"v1","addr":"172.21.15.192:6835","nonce":192527628}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5549,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2304989740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2304989740},{"type":"v1","addr":"172.21.15.192:6837","nonce":2304989740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:55:57.946191+0000","modified":"2023-11-28T11:56:00.964614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6057":{"gid":6057,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/1163863991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1163863991},{"type":"v1","addr":"172.21.15.50:6834","nonce":1163863991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:56:01.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.338+0000 7f0fa8960700 1 -- 172.21.15.50:0/3376893368 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0f90064ee0 msgr2=0x7f0f90067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:01.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.338+0000 7f0fa8960700 1 --2- 172.21.15.50:0/3376893368 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0f90064ee0 0x7f0f90067390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0f940015f0 tx=0x7f0f94001a00 comp rx=0 tx=0).stop 2023-11-28T11:56:01.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.338+0000 7f0fa8960700 1 -- 172.21.15.50:0/3376893368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fa40cf050 msgr2=0x7f0fa41f1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:01.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.338+0000 7f0fa8960700 1 --2- 172.21.15.50:0/3376893368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fa40cf050 0x7f0fa41f1a00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00e810 tx=0x7f0f9c00eb20 comp rx=0 tx=0).stop 2023-11-28T11:56:01.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.338+0000 7f0fa8960700 1 -- 172.21.15.50:0/3376893368 shutdown_connections 2023-11-28T11:56:01.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.338+0000 7f0fa8960700 1 --2- 172.21.15.50:0/3376893368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fa40cf050 0x7f0fa41f1a00 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.338+0000 7f0fa8960700 1 --2- 172.21.15.50:0/3376893368 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0f90064ee0 0x7f0f90067390 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.338+0000 7f0fa8960700 1 --2- 172.21.15.50:0/3376893368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fa40b4c10 0x7f0fa40c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.338+0000 7f0fa8960700 1 --2- 172.21.15.50:0/3376893368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fa406d7d0 0x7f0fa41f47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.338+0000 7f0fa8960700 1 -- 172.21.15.50:0/3376893368 >> 172.21.15.50:0/3376893368 conn(0x7f0fa409bb30 msgr2=0x7f0fa4069dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:01.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.338+0000 7f0fa8960700 1 -- 172.21.15.50:0/3376893368 shutdown_connections 2023-11-28T11:56:01.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.338+0000 7f0fa8960700 1 -- 172.21.15.50:0/3376893368 wait complete. 2023-11-28T11:56:01.343 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2023-11-28T11:56:01.358 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:01.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76ff59e700 1 Processor -- start 2023-11-28T11:56:01.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76ff59e700 1 -- start start 2023-11-28T11:56:01.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76ff59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7700069c40 0x7f77000cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76ff59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f77000cb2a0 0x7f77000c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76ff59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770006ace0 con 0x7f7700159e70 2023-11-28T11:56:01.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76ff59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77000cb720 con 0x7f77000cb2a0 2023-11-28T11:56:01.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76ff59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770006a0d0 con 0x7f7700069c40 2023-11-28T11:56:01.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76fe59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7700159e70 0x7f770006c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57136/0 (socket says 172.21.15.50:57136) 2023-11-28T11:56:01.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76fe59c700 1 -- 172.21.15.50:0/3971206274 learned_addr learned my addr 172.21.15.50:0/3971206274 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:01.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76fdd9b700 1 --2- 172.21.15.50:0/3971206274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7700069c40 0x7f77000cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76fed9d700 1 --2- 172.21.15.50:0/3971206274 >> v2:172.21.15.192:3300/0 conn(0x7f77000cb2a0 0x7f77000c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76fd59a700 1 -- 172.21.15.50:0/3971206274 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579399076 0 0) 0x7f770006ace0 con 0x7f7700159e70 2023-11-28T11:56:01.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76fd59a700 1 -- 172.21.15.50:0/3971206274 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76e80035d0 con 0x7f7700159e70 2023-11-28T11:56:01.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76fdd9b700 1 -- 172.21.15.50:0/3971206274 >> v2:172.21.15.192:3300/0 conn(0x7f77000cb2a0 msgr2=0x7f77000c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76fdd9b700 1 --2- 172.21.15.50:0/3971206274 >> v2:172.21.15.192:3300/0 conn(0x7f77000cb2a0 0x7f77000c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76fdd9b700 1 -- 172.21.15.50:0/3971206274 >> v1:172.21.15.50:6789/0 conn(0x7f7700159e70 legacy=0x7f770006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76fdd9b700 1 -- 172.21.15.50:0/3971206274 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770006a3b0 con 0x7f7700069c40 2023-11-28T11:56:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.474+0000 7f76fdd9b700 1 --2- 172.21.15.50:0/3971206274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7700069c40 0x7f77000cad60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009d90 tx=0x7f76f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce2742a9ae7a2a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76fd59a700 1 -- 172.21.15.50:0/3971206274 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f000e070 con 0x7f7700069c40 2023-11-28T11:56:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76fd59a700 1 -- 172.21.15.50:0/3971206274 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f000bb20 con 0x7f7700069c40 2023-11-28T11:56:01.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76fd59a700 1 -- 172.21.15.50:0/3971206274 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0012430 con 0x7f7700069c40 2023-11-28T11:56:01.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76ff59e700 1 -- 172.21.15.50:0/3971206274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7700069c40 msgr2=0x7f77000cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:01.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76ff59e700 1 --2- 172.21.15.50:0/3971206274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7700069c40 0x7f77000cad60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009d90 tx=0x7f76f000b330 comp rx=0 tx=0).stop 2023-11-28T11:56:01.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76ff59e700 1 -- 172.21.15.50:0/3971206274 shutdown_connections 2023-11-28T11:56:01.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76ff59e700 1 --2- 172.21.15.50:0/3971206274 >> v2:172.21.15.192:3300/0 conn(0x7f77000cb2a0 0x7f77000c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76ff59e700 1 --2- 172.21.15.50:0/3971206274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7700069c40 0x7f77000cad60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76ff59e700 1 -- 172.21.15.50:0/3971206274 >> 172.21.15.50:0/3971206274 conn(0x7f77000ce3e0 msgr2=0x7f77000ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:01.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76ff59e700 1 -- 172.21.15.50:0/3971206274 shutdown_connections 2023-11-28T11:56:01.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76ff59e700 1 -- 172.21.15.50:0/3971206274 wait complete. 2023-11-28T11:56:01.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76ff59e700 1 Processor -- start 2023-11-28T11:56:01.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76ff59e700 1 -- start start 2023-11-28T11:56:01.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76ff59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7700069c40 0x7f77000c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76ff59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77000cb2a0 0x7f77001f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76ff59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7700159e70 0x7f77000c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76ff59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7700158a60 con 0x7f7700069c40 2023-11-28T11:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76ff59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77001f12c0 con 0x7f77000cb2a0 2023-11-28T11:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.478+0000 7f76ff59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77000cc4c0 con 0x7f7700159e70 2023-11-28T11:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76fe59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7700069c40 0x7f77000c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76fdd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77000cb2a0 0x7f77001f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76fdd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77000cb2a0 0x7f77001f0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:60988/0 (socket says 172.21.15.50:60988) 2023-11-28T11:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76fdd9b700 1 -- 172.21.15.50:0/2365331986 learned_addr learned my addr 172.21.15.50:0/2365331986 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76fe59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7700069c40 0x7f77000c22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36608/0 (socket says 172.21.15.50:36608) 2023-11-28T11:56:01.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76fed9d700 1 --2- 172.21.15.50:0/2365331986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7700159e70 0x7f77000c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76fe59c700 1 -- 172.21.15.50:0/2365331986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7700159e70 msgr2=0x7f77000c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:01.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76fe59c700 1 --2- 172.21.15.50:0/2365331986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7700159e70 0x7f77000c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76fe59c700 1 -- 172.21.15.50:0/2365331986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77000cb2a0 msgr2=0x7f77001f0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:01.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76fe59c700 1 --2- 172.21.15.50:0/2365331986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77000cb2a0 0x7f77001f0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76fe59c700 1 -- 172.21.15.50:0/2365331986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f0009a70 con 0x7f7700069c40 2023-11-28T11:56:01.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76fe59c700 1 --2- 172.21.15.50:0/2365331986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7700069c40 0x7f77000c22b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f76f400c410 tx=0x7f76f400c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:01.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76eeffd700 1 -- 172.21.15.50:0/2365331986 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4005d90 con 0x7f7700069c40 2023-11-28T11:56:01.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76eeffd700 1 -- 172.21.15.50:0/2365331986 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f400ce20 con 0x7f7700069c40 2023-11-28T11:56:01.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76ff59e700 1 -- 172.21.15.50:0/2365331986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770006a970 con 0x7f7700069c40 2023-11-28T11:56:01.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76eeffd700 1 -- 172.21.15.50:0/2365331986 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f40072d0 con 0x7f7700069c40 2023-11-28T11:56:01.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76ff59e700 1 -- 172.21.15.50:0/2365331986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770006a690 con 0x7f7700069c40 2023-11-28T11:56:01.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.482+0000 7f76ff59e700 1 -- 172.21.15.50:0/2365331986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770006d0b0 con 0x7f7700069c40 2023-11-28T11:56:01.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.486+0000 7f76eeffd700 1 -- 172.21.15.50:0/2365331986 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f76f4019030 con 0x7f7700069c40 2023-11-28T11:56:01.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.486+0000 7f76eeffd700 1 --2- 172.21.15.50:0/2365331986 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f76e0064f10 0x7f76e00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.486+0000 7f76eeffd700 1 -- 172.21.15.50:0/2365331986 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f76f4081270 con 0x7f7700069c40 2023-11-28T11:56:01.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.486+0000 7f76fdd9b700 1 --2- 172.21.15.50:0/2365331986 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f76e0064f10 0x7f76e00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.486+0000 7f76fdd9b700 1 --2- 172.21.15.50:0/2365331986 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f76e0064f10 0x7f76e00673c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7700153220 tx=0x7f76f0011000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:01.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.490+0000 7f76eeffd700 1 -- 172.21.15.50:0/2365331986 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f76f404f1e0 con 0x7f7700069c40 2023-11-28T11:56:01.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.654+0000 7f76ff59e700 1 -- 172.21.15.50:0/2365331986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7700072500 con 0x7f7700069c40 2023-11-28T11:56:01.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.654+0000 7f76eeffd700 1 -- 172.21.15.50:0/2365331986 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18026 (secure 0 0 0) 0x7f76f4052800 con 0x7f7700069c40 2023-11-28T11:56:01.658 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:01.659 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":54,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:55:58.950592+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:55:55.575648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T11:55:56.934531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:01.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.658+0000 7f76ff59e700 1 -- 172.21.15.50:0/2365331986 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f76e0064f10 msgr2=0x7f76e00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:01.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.658+0000 7f76ff59e700 1 --2- 172.21.15.50:0/2365331986 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f76e0064f10 0x7f76e00673c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7700153220 tx=0x7f76f0011000 comp rx=0 tx=0).stop 2023-11-28T11:56:01.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.658+0000 7f76ff59e700 1 -- 172.21.15.50:0/2365331986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7700069c40 msgr2=0x7f77000c22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:01.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.658+0000 7f76ff59e700 1 --2- 172.21.15.50:0/2365331986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7700069c40 0x7f77000c22b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f76f400c410 tx=0x7f76f400c720 comp rx=0 tx=0).stop 2023-11-28T11:56:01.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.658+0000 7f76ff59e700 1 -- 172.21.15.50:0/2365331986 shutdown_connections 2023-11-28T11:56:01.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.658+0000 7f76ff59e700 1 --2- 172.21.15.50:0/2365331986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7700159e70 0x7f77000c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.658+0000 7f76ff59e700 1 --2- 172.21.15.50:0/2365331986 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f76e0064f10 0x7f76e00673c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.658+0000 7f76ff59e700 1 --2- 172.21.15.50:0/2365331986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77000cb2a0 0x7f77001f0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.658+0000 7f76ff59e700 1 --2- 172.21.15.50:0/2365331986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7700069c40 0x7f77000c22b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.658+0000 7f76ff59e700 1 -- 172.21.15.50:0/2365331986 >> 172.21.15.50:0/2365331986 conn(0x7f77000ce3e0 msgr2=0x7f77000ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:01.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.658+0000 7f76ff59e700 1 -- 172.21.15.50:0/2365331986 shutdown_connections 2023-11-28T11:56:01.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.658+0000 7f76ff59e700 1 -- 172.21.15.50:0/2365331986 wait complete. 2023-11-28T11:56:01.674 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T11:56:01.674 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:56:01.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc345ff4700 1 Processor -- start 2023-11-28T11:56:01.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc345ff4700 1 -- start start 2023-11-28T11:56:01.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc345ff4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc340159e70 0x7fc34006c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc345ff4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc340069c40 0x7fc3400cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc345ff4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc34006cee0 0x7fc3400cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc345ff4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34006ace0 con 0x7fc34006cee0 2023-11-28T11:56:01.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc345ff4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34006a0d0 con 0x7fc340159e70 2023-11-28T11:56:01.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc345ff4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34006a3b0 con 0x7fc340069c40 2023-11-28T11:56:01.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc3457f3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc34006cee0 0x7fc3400cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc3457f3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc34006cee0 0x7fc3400cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58954/0 (socket says 172.21.15.50:58954) 2023-11-28T11:56:01.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc3457f3700 1 -- 172.21.15.50:0/2977439509 learned_addr learned my addr 172.21.15.50:0/2977439509 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:01.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc33ffff700 1 --2- 172.21.15.50:0/2977439509 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc340069c40 0x7fc3400cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc344ff2700 1 --2- 172.21.15.50:0/2977439509 >> v2:172.21.15.192:3300/0 conn(0x7fc340159e70 0x7fc34006c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc3457f3700 1 -- 172.21.15.50:0/2977439509 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc340069c40 msgr2=0x7fc3400cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:01.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc3457f3700 1 --2- 172.21.15.50:0/2977439509 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc340069c40 0x7fc3400cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc3457f3700 1 -- 172.21.15.50:0/2977439509 >> v2:172.21.15.192:3300/0 conn(0x7fc340159e70 msgr2=0x7fc34006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:01.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc3457f3700 1 --2- 172.21.15.50:0/2977439509 >> v2:172.21.15.192:3300/0 conn(0x7fc340159e70 0x7fc34006c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.786+0000 7fc3457f3700 1 -- 172.21.15.50:0/2977439509 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34006a690 con 0x7fc34006cee0 2023-11-28T11:56:01.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.790+0000 7fc3457f3700 1 --2- 172.21.15.50:0/2977439509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc34006cee0 0x7fc3400cb2a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc3400ce2a0 tx=0x7fc33800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abba804c1397d85 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:01.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.790+0000 7fc33f7fe700 1 -- 172.21.15.50:0/2977439509 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33800e070 con 0x7fc34006cee0 2023-11-28T11:56:01.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.790+0000 7fc33f7fe700 1 -- 172.21.15.50:0/2977439509 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33800b910 con 0x7fc34006cee0 2023-11-28T11:56:01.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.790+0000 7fc33f7fe700 1 -- 172.21.15.50:0/2977439509 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33800bcc0 con 0x7fc34006cee0 2023-11-28T11:56:01.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.790+0000 7fc345ff4700 1 -- 172.21.15.50:0/2977439509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc34006cee0 msgr2=0x7fc3400cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:01.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.790+0000 7fc345ff4700 1 --2- 172.21.15.50:0/2977439509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc34006cee0 0x7fc3400cb2a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc3400ce2a0 tx=0x7fc33800b330 comp rx=0 tx=0).stop 2023-11-28T11:56:01.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.790+0000 7fc345ff4700 1 -- 172.21.15.50:0/2977439509 shutdown_connections 2023-11-28T11:56:01.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.790+0000 7fc345ff4700 1 --2- 172.21.15.50:0/2977439509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc34006cee0 0x7fc3400cb2a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.790+0000 7fc345ff4700 1 --2- 172.21.15.50:0/2977439509 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc340069c40 0x7fc3400cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.790+0000 7fc345ff4700 1 --2- 172.21.15.50:0/2977439509 >> v2:172.21.15.192:3300/0 conn(0x7fc340159e70 0x7fc34006c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.790+0000 7fc345ff4700 1 -- 172.21.15.50:0/2977439509 >> 172.21.15.50:0/2977439509 conn(0x7fc3400ce3e0 msgr2=0x7fc3400ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:01.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.790+0000 7fc345ff4700 1 -- 172.21.15.50:0/2977439509 shutdown_connections 2023-11-28T11:56:01.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.790+0000 7fc345ff4700 1 -- 172.21.15.50:0/2977439509 wait complete. 2023-11-28T11:56:01.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.790+0000 7fc345ff4700 1 Processor -- start 2023-11-28T11:56:01.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.790+0000 7fc345ff4700 1 -- start start 2023-11-28T11:56:01.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc345ff4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc340069c40 0x7fc3400c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc345ff4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc34006cee0 0x7fc3400979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc345ff4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc340159e70 0x7fc34015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc345ff4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34015bda0 con 0x7fc340159e70 2023-11-28T11:56:01.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc345ff4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc340097ee0 con 0x7fc340069c40 2023-11-28T11:56:01.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc345ff4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34015c5e0 con 0x7fc34006cee0 2023-11-28T11:56:01.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc3457f3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc340159e70 0x7fc34015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc344ff2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc340069c40 0x7fc3400c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc344ff2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc340069c40 0x7fc3400c48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:59442/0 (socket says 172.21.15.50:59442) 2023-11-28T11:56:01.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc33ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc34006cee0 0x7fc3400979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc344ff2700 1 -- 172.21.15.50:0/1056014876 learned_addr learned my addr 172.21.15.50:0/1056014876 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:01.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc3457f3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc340159e70 0x7fc34015ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58964/0 (socket says 172.21.15.50:58964) 2023-11-28T11:56:01.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc3457f3700 1 -- 172.21.15.50:0/1056014876 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc34006cee0 msgr2=0x7fc3400979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:01.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc3457f3700 1 --2- 172.21.15.50:0/1056014876 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc34006cee0 0x7fc3400979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc3457f3700 1 -- 172.21.15.50:0/1056014876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc340069c40 msgr2=0x7fc3400c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:01.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc3457f3700 1 --2- 172.21.15.50:0/1056014876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc340069c40 0x7fc3400c48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:01.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc3457f3700 1 -- 172.21.15.50:0/1056014876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc338009b30 con 0x7fc340159e70 2023-11-28T11:56:01.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc3457f3700 1 --2- 172.21.15.50:0/1056014876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc340159e70 0x7fc34015ca70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc338015000 tx=0x7fc338004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:01.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc33d7fa700 1 -- 172.21.15.50:0/1056014876 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3380099b0 con 0x7fc340159e70 2023-11-28T11:56:01.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc33d7fa700 1 -- 172.21.15.50:0/1056014876 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33800ce80 con 0x7fc340159e70 2023-11-28T11:56:01.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc345ff4700 1 -- 172.21.15.50:0/1056014876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34015a240 con 0x7fc340159e70 2023-11-28T11:56:01.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc33d7fa700 1 -- 172.21.15.50:0/1056014876 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338004490 con 0x7fc340159e70 2023-11-28T11:56:01.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc345ff4700 1 -- 172.21.15.50:0/1056014876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34006a970 con 0x7fc340159e70 2023-11-28T11:56:01.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.794+0000 7fc345ff4700 1 -- 172.21.15.50:0/1056014876 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3400b32e0 con 0x7fc340159e70 2023-11-28T11:56:01.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.798+0000 7fc33d7fa700 1 -- 172.21.15.50:0/1056014876 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc3380045f0 con 0x7fc340159e70 2023-11-28T11:56:01.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.798+0000 7fc33d7fa700 1 --2- 172.21.15.50:0/1056014876 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc324064f10 0x7fc3240673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:01.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.798+0000 7fc33d7fa700 1 -- 172.21.15.50:0/1056014876 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc338083420 con 0x7fc340159e70 2023-11-28T11:56:01.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.798+0000 7fc344ff2700 1 --2- 172.21.15.50:0/1056014876 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc324064f10 0x7fc3240673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:01.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.798+0000 7fc344ff2700 1 --2- 172.21.15.50:0/1056014876 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc324064f10 0x7fc3240673c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc334009b90 tx=0x7fc334009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:01.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.806+0000 7fc33d7fa700 1 -- 172.21.15.50:0/1056014876 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc338051400 con 0x7fc340159e70 2023-11-28T11:56:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.974+0000 7fc345ff4700 1 -- 172.21.15.50:0/1056014876 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc34015c770 con 0x7fc324064f10 2023-11-28T11:56:01.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.990+0000 7fc33d7fa700 1 -- 172.21.15.50:0/1056014876 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310250 (secure 0 0 0) 0x7fc34015c770 con 0x7fc324064f10 2023-11-28T11:56:01.999 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.998+0000 7fc345ff4700 1 -- 172.21.15.50:0/1056014876 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc324064f10 msgr2=0x7fc3240673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.998+0000 7fc345ff4700 1 --2- 172.21.15.50:0/1056014876 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc324064f10 0x7fc3240673c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc334009b90 tx=0x7fc334009240 comp rx=0 tx=0).stop 2023-11-28T11:56:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.998+0000 7fc345ff4700 1 -- 172.21.15.50:0/1056014876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc340159e70 msgr2=0x7fc34015ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.998+0000 7fc345ff4700 1 --2- 172.21.15.50:0/1056014876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc340159e70 0x7fc34015ca70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc338015000 tx=0x7fc338004af0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.998+0000 7fc345ff4700 1 -- 172.21.15.50:0/1056014876 shutdown_connections 2023-11-28T11:56:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.998+0000 7fc345ff4700 1 --2- 172.21.15.50:0/1056014876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc340159e70 0x7fc34015ca70 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.998+0000 7fc345ff4700 1 --2- 172.21.15.50:0/1056014876 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc34006cee0 0x7fc3400979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.998+0000 7fc345ff4700 1 --2- 172.21.15.50:0/1056014876 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc324064f10 0x7fc3240673c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.998+0000 7fc345ff4700 1 --2- 172.21.15.50:0/1056014876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc340069c40 0x7fc3400c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.998+0000 7fc345ff4700 1 -- 172.21.15.50:0/1056014876 >> 172.21.15.50:0/1056014876 conn(0x7fc3400ce3e0 msgr2=0x7fc3400acd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.998+0000 7fc345ff4700 1 -- 172.21.15.50:0/1056014876 shutdown_connections 2023-11-28T11:56:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:01.998+0000 7fc345ff4700 1 -- 172.21.15.50:0/1056014876 wait complete. 2023-11-28T11:56:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:56:02.016 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2023-11-28T11:56:00.919204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":88184,"kb_used_data":6136,"kb_used_omap":0,"kb_used_meta":81984,"kb_avail":754886536,"statfs":{"total":773094113280,"available":773003812864,"internally_reserved":0,"allocated":6283264,"data_stored":3516788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":83951616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.373291"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.984299+0000","last_change":"2023-11-28T11:55:57.978343+0000","last_active":"2023-11-28T11:55:57.984299+0000","last_peered":"2023-11-28T11:55:57.984299+0000","last_clean":"2023-11-28T11:55:57.984299+0000","last_became_active":"2023-11-28T11:55:57.977910+0000","last_became_peered":"2023-11-28T11:55:57.977910+0000","last_unstale":"2023-11-28T11:55:57.984299+0000","last_undegraded":"2023-11-28T11:55:57.984299+0000","last_fullsized":"2023-11-28T11:55:57.984299+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:28:26.492234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983703+0000","last_change":"2023-11-28T11:55:57.977064+0000","last_active":"2023-11-28T11:55:57.983703+0000","last_peered":"2023-11-28T11:55:57.983703+0000","last_clean":"2023-11-28T11:55:57.983703+0000","last_became_active":"2023-11-28T11:55:57.976754+0000","last_became_peered":"2023-11-28T11:55:57.976754+0000","last_unstale":"2023-11-28T11:55:57.983703+0000","last_undegraded":"2023-11-28T11:55:57.983703+0000","last_fullsized":"2023-11-28T11:55:57.983703+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:18:58.484183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992794+0000","last_change":"2023-11-28T11:55:57.986144+0000","last_active":"2023-11-28T11:55:57.992794+0000","last_peered":"2023-11-28T11:55:57.992794+0000","last_clean":"2023-11-28T11:55:57.992794+0000","last_became_active":"2023-11-28T11:55:57.984229+0000","last_became_peered":"2023-11-28T11:55:57.984229+0000","last_unstale":"2023-11-28T11:55:57.992794+0000","last_undegraded":"2023-11-28T11:55:57.992794+0000","last_fullsized":"2023-11-28T11:55:57.992794+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:23.466999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.976061+0000","last_change":"2023-11-28T11:55:57.964807+0000","last_active":"2023-11-28T11:55:57.976061+0000","last_peered":"2023-11-28T11:55:57.976061+0000","last_clean":"2023-11-28T11:55:57.976061+0000","last_became_active":"2023-11-28T11:55:57.964527+0000","last_became_peered":"2023-11-28T11:55:57.964527+0000","last_unstale":"2023-11-28T11:55:57.976061+0000","last_undegraded":"2023-11-28T11:55:57.976061+0000","last_fullsized":"2023-11-28T11:55:57.976061+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:31:31.666003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.979743+0000","last_change":"2023-11-28T11:55:57.975364+0000","last_active":"2023-11-28T11:55:57.979743+0000","last_peered":"2023-11-28T11:55:57.979743+0000","last_clean":"2023-11-28T11:55:57.979743+0000","last_became_active":"2023-11-28T11:55:57.975098+0000","last_became_peered":"2023-11-28T11:55:57.975098+0000","last_unstale":"2023-11-28T11:55:57.979743+0000","last_undegraded":"2023-11-28T11:55:57.979743+0000","last_fullsized":"2023-11-28T11:55:57.979743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:57:34.006505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.981512+0000","last_change":"2023-11-28T11:55:57.969195+0000","last_active":"2023-11-28T11:55:57.981512+0000","last_peered":"2023-11-28T11:55:57.981512+0000","last_clean":"2023-11-28T11:55:57.981512+0000","last_became_active":"2023-11-28T11:55:57.968865+0000","last_became_peered":"2023-11-28T11:55:57.968865+0000","last_unstale":"2023-11-28T11:55:57.981512+0000","last_undegraded":"2023-11-28T11:55:57.981512+0000","last_fullsized":"2023-11-28T11:55:57.981512+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:04:24.734981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.977620+0000","last_change":"2023-11-28T11:55:57.973526+0000","last_active":"2023-11-28T11:55:57.977620+0000","last_peered":"2023-11-28T11:55:57.977620+0000","last_clean":"2023-11-28T11:55:57.977620+0000","last_became_active":"2023-11-28T11:55:57.972847+0000","last_became_peered":"2023-11-28T11:55:57.972847+0000","last_unstale":"2023-11-28T11:55:57.977620+0000","last_undegraded":"2023-11-28T11:55:57.977620+0000","last_fullsized":"2023-11-28T11:55:57.977620+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:44:53.094068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.977302+0000","last_change":"2023-11-28T11:55:57.971492+0000","last_active":"2023-11-28T11:55:57.977302+0000","last_peered":"2023-11-28T11:55:57.977302+0000","last_clean":"2023-11-28T11:55:57.977302+0000","last_became_active":"2023-11-28T11:55:57.971221+0000","last_became_peered":"2023-11-28T11:55:57.971221+0000","last_unstale":"2023-11-28T11:55:57.977302+0000","last_undegraded":"2023-11-28T11:55:57.977302+0000","last_fullsized":"2023-11-28T11:55:57.977302+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:56:17.271102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.974508+0000","last_change":"2023-11-28T11:55:57.967864+0000","last_active":"2023-11-28T11:55:57.974508+0000","last_peered":"2023-11-28T11:55:57.974508+0000","last_clean":"2023-11-28T11:55:57.974508+0000","last_became_active":"2023-11-28T11:55:57.967594+0000","last_became_peered":"2023-11-28T11:55:57.967594+0000","last_unstale":"2023-11-28T11:55:57.974508+0000","last_undegraded":"2023-11-28T11:55:57.974508+0000","last_fullsized":"2023-11-28T11:55:57.974508+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:54.194184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.980406+0000","last_change":"2023-11-28T11:55:57.966647+0000","last_active":"2023-11-28T11:55:57.980406+0000","last_peered":"2023-11-28T11:55:57.980406+0000","last_clean":"2023-11-28T11:55:57.980406+0000","last_became_active":"2023-11-28T11:55:57.966365+0000","last_became_peered":"2023-11-28T11:55:57.966365+0000","last_unstale":"2023-11-28T11:55:57.980406+0000","last_undegraded":"2023-11-28T11:55:57.980406+0000","last_fullsized":"2023-11-28T11:55:57.980406+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:35.555644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983023+0000","last_change":"2023-11-28T11:55:57.977834+0000","last_active":"2023-11-28T11:55:57.983023+0000","last_peered":"2023-11-28T11:55:57.983023+0000","last_clean":"2023-11-28T11:55:57.983023+0000","last_became_active":"2023-11-28T11:55:57.977171+0000","last_became_peered":"2023-11-28T11:55:57.977171+0000","last_unstale":"2023-11-28T11:55:57.983023+0000","last_undegraded":"2023-11-28T11:55:57.983023+0000","last_fullsized":"2023-11-28T11:55:57.983023+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:31:45.396246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.981593+0000","last_change":"2023-11-28T11:55:57.976844+0000","last_active":"2023-11-28T11:55:57.981593+0000","last_peered":"2023-11-28T11:55:57.981593+0000","last_clean":"2023-11-28T11:55:57.981593+0000","last_became_active":"2023-11-28T11:55:57.976336+0000","last_became_peered":"2023-11-28T11:55:57.976336+0000","last_unstale":"2023-11-28T11:55:57.981593+0000","last_undegraded":"2023-11-28T11:55:57.981593+0000","last_fullsized":"2023-11-28T11:55:57.981593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:14.625192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T11:55:58.966433+0000","last_change":"2023-11-28T11:55:57.970021+0000","last_active":"2023-11-28T11:55:58.966433+0000","last_peered":"2023-11-28T11:55:58.966433+0000","last_clean":"2023-11-28T11:55:58.966433+0000","last_became_active":"2023-11-28T11:55:57.969732+0000","last_became_peered":"2023-11-28T11:55:57.969732+0000","last_unstale":"2023-11-28T11:55:58.966433+0000","last_undegraded":"2023-11-28T11:55:58.966433+0000","last_fullsized":"2023-11-28T11:55:58.966433+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:48.817054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.974607+0000","last_change":"2023-11-28T11:55:57.969130+0000","last_active":"2023-11-28T11:55:57.974607+0000","last_peered":"2023-11-28T11:55:57.974607+0000","last_clean":"2023-11-28T11:55:57.974607+0000","last_became_active":"2023-11-28T11:55:57.968801+0000","last_became_peered":"2023-11-28T11:55:57.968801+0000","last_unstale":"2023-11-28T11:55:57.974607+0000","last_undegraded":"2023-11-28T11:55:57.974607+0000","last_fullsized":"2023-11-28T11:55:57.974607+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:20:11.533358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.977740+0000","last_change":"2023-11-28T11:55:57.974095+0000","last_active":"2023-11-28T11:55:57.977740+0000","last_peered":"2023-11-28T11:55:57.977740+0000","last_clean":"2023-11-28T11:55:57.977740+0000","last_became_active":"2023-11-28T11:55:57.973785+0000","last_became_peered":"2023-11-28T11:55:57.973785+0000","last_unstale":"2023-11-28T11:55:57.977740+0000","last_undegraded":"2023-11-28T11:55:57.977740+0000","last_fullsized":"2023-11-28T11:55:57.977740+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:03.621202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.981781+0000","last_change":"2023-11-28T11:55:57.969861+0000","last_active":"2023-11-28T11:55:57.981781+0000","last_peered":"2023-11-28T11:55:57.981781+0000","last_clean":"2023-11-28T11:55:57.981781+0000","last_became_active":"2023-11-28T11:55:57.969586+0000","last_became_peered":"2023-11-28T11:55:57.969586+0000","last_unstale":"2023-11-28T11:55:57.981781+0000","last_undegraded":"2023-11-28T11:55:57.981781+0000","last_fullsized":"2023-11-28T11:55:57.981781+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:38:09.692259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.980828+0000","last_change":"2023-11-28T11:55:57.973918+0000","last_active":"2023-11-28T11:55:57.980828+0000","last_peered":"2023-11-28T11:55:57.980828+0000","last_clean":"2023-11-28T11:55:57.980828+0000","last_became_active":"2023-11-28T11:55:57.973629+0000","last_became_peered":"2023-11-28T11:55:57.973629+0000","last_unstale":"2023-11-28T11:55:57.980828+0000","last_undegraded":"2023-11-28T11:55:57.980828+0000","last_fullsized":"2023-11-28T11:55:57.980828+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:51.617300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992570+0000","last_change":"2023-11-28T11:55:57.985011+0000","last_active":"2023-11-28T11:55:57.992570+0000","last_peered":"2023-11-28T11:55:57.992570+0000","last_clean":"2023-11-28T11:55:57.992570+0000","last_became_active":"2023-11-28T11:55:57.984524+0000","last_became_peered":"2023-11-28T11:55:57.984524+0000","last_unstale":"2023-11-28T11:55:57.992570+0000","last_undegraded":"2023-11-28T11:55:57.992570+0000","last_fullsized":"2023-11-28T11:55:57.992570+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:52:11.998343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992630+0000","last_change":"2023-11-28T11:55:57.978055+0000","last_active":"2023-11-28T11:55:57.992630+0000","last_peered":"2023-11-28T11:55:57.992630+0000","last_clean":"2023-11-28T11:55:57.992630+0000","last_became_active":"2023-11-28T11:55:57.977674+0000","last_became_peered":"2023-11-28T11:55:57.977674+0000","last_unstale":"2023-11-28T11:55:57.992630+0000","last_undegraded":"2023-11-28T11:55:57.992630+0000","last_fullsized":"2023-11-28T11:55:57.992630+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:23.036588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.984246+0000","last_change":"2023-11-28T11:55:57.983210+0000","last_active":"2023-11-28T11:55:57.984246+0000","last_peered":"2023-11-28T11:55:57.984246+0000","last_clean":"2023-11-28T11:55:57.984246+0000","last_became_active":"2023-11-28T11:55:57.982955+0000","last_became_peered":"2023-11-28T11:55:57.982955+0000","last_unstale":"2023-11-28T11:55:57.984246+0000","last_undegraded":"2023-11-28T11:55:57.984246+0000","last_fullsized":"2023-11-28T11:55:57.984246+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:16:00.940345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992754+0000","last_change":"2023-11-28T11:55:57.986069+0000","last_active":"2023-11-28T11:55:57.992754+0000","last_peered":"2023-11-28T11:55:57.992754+0000","last_clean":"2023-11-28T11:55:57.992754+0000","last_became_active":"2023-11-28T11:55:57.984479+0000","last_became_peered":"2023-11-28T11:55:57.984479+0000","last_unstale":"2023-11-28T11:55:57.992754+0000","last_undegraded":"2023-11-28T11:55:57.992754+0000","last_fullsized":"2023-11-28T11:55:57.992754+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:14.625192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983668+0000","last_change":"2023-11-28T11:55:57.976732+0000","last_active":"2023-11-28T11:55:57.983668+0000","last_peered":"2023-11-28T11:55:57.983668+0000","last_clean":"2023-11-28T11:55:57.983668+0000","last_became_active":"2023-11-28T11:55:57.974317+0000","last_became_peered":"2023-11-28T11:55:57.974317+0000","last_unstale":"2023-11-28T11:55:57.983668+0000","last_undegraded":"2023-11-28T11:55:57.983668+0000","last_fullsized":"2023-11-28T11:55:57.983668+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:53:09.051255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992614+0000","last_change":"2023-11-28T11:55:57.985528+0000","last_active":"2023-11-28T11:55:57.992614+0000","last_peered":"2023-11-28T11:55:57.992614+0000","last_clean":"2023-11-28T11:55:57.992614+0000","last_became_active":"2023-11-28T11:55:57.984224+0000","last_became_peered":"2023-11-28T11:55:57.984224+0000","last_unstale":"2023-11-28T11:55:57.992614+0000","last_undegraded":"2023-11-28T11:55:57.992614+0000","last_fullsized":"2023-11-28T11:55:57.992614+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:23.029304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T11:55:58.965459+0000","last_change":"2023-11-28T11:55:57.964863+0000","last_active":"2023-11-28T11:55:58.965459+0000","last_peered":"2023-11-28T11:55:58.965459+0000","last_clean":"2023-11-28T11:55:58.965459+0000","last_became_active":"2023-11-28T11:55:57.964575+0000","last_became_peered":"2023-11-28T11:55:57.964575+0000","last_unstale":"2023-11-28T11:55:58.965459+0000","last_undegraded":"2023-11-28T11:55:58.965459+0000","last_fullsized":"2023-11-28T11:55:58.965459+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:53:43.871686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.984278+0000","last_change":"2023-11-28T11:55:57.977213+0000","last_active":"2023-11-28T11:55:57.984278+0000","last_peered":"2023-11-28T11:55:57.984278+0000","last_clean":"2023-11-28T11:55:57.984278+0000","last_became_active":"2023-11-28T11:55:57.976953+0000","last_became_peered":"2023-11-28T11:55:57.976953+0000","last_unstale":"2023-11-28T11:55:57.984278+0000","last_undegraded":"2023-11-28T11:55:57.984278+0000","last_fullsized":"2023-11-28T11:55:57.984278+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:21:23.262133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.976155+0000","last_change":"2023-11-28T11:55:57.967597+0000","last_active":"2023-11-28T11:55:57.976155+0000","last_peered":"2023-11-28T11:55:57.976155+0000","last_clean":"2023-11-28T11:55:57.976155+0000","last_became_active":"2023-11-28T11:55:57.967281+0000","last_became_peered":"2023-11-28T11:55:57.967281+0000","last_unstale":"2023-11-28T11:55:57.976155+0000","last_undegraded":"2023-11-28T11:55:57.976155+0000","last_fullsized":"2023-11-28T11:55:57.976155+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:23.029304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990013+0000","last_change":"2023-11-28T11:55:57.981637+0000","last_active":"2023-11-28T11:55:57.990013+0000","last_peered":"2023-11-28T11:55:57.990013+0000","last_clean":"2023-11-28T11:55:57.990013+0000","last_became_active":"2023-11-28T11:55:57.976008+0000","last_became_peered":"2023-11-28T11:55:57.976008+0000","last_unstale":"2023-11-28T11:55:57.990013+0000","last_undegraded":"2023-11-28T11:55:57.990013+0000","last_fullsized":"2023-11-28T11:55:57.990013+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:53:09.051255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.979768+0000","last_change":"2023-11-28T11:55:57.975247+0000","last_active":"2023-11-28T11:55:57.979768+0000","last_peered":"2023-11-28T11:55:57.979768+0000","last_clean":"2023-11-28T11:55:57.979768+0000","last_became_active":"2023-11-28T11:55:57.974910+0000","last_became_peered":"2023-11-28T11:55:57.974910+0000","last_unstale":"2023-11-28T11:55:57.979768+0000","last_undegraded":"2023-11-28T11:55:57.979768+0000","last_fullsized":"2023-11-28T11:55:57.979768+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:02:03.225787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983927+0000","last_change":"2023-11-28T11:55:57.979134+0000","last_active":"2023-11-28T11:55:57.983927+0000","last_peered":"2023-11-28T11:55:57.983927+0000","last_clean":"2023-11-28T11:55:57.983927+0000","last_became_active":"2023-11-28T11:55:57.977572+0000","last_became_peered":"2023-11-28T11:55:57.977572+0000","last_unstale":"2023-11-28T11:55:57.983927+0000","last_undegraded":"2023-11-28T11:55:57.983927+0000","last_fullsized":"2023-11-28T11:55:57.983927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:45:32.160561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992752+0000","last_change":"2023-11-28T11:55:57.985951+0000","last_active":"2023-11-28T11:55:57.992752+0000","last_peered":"2023-11-28T11:55:57.992752+0000","last_clean":"2023-11-28T11:55:57.992752+0000","last_became_active":"2023-11-28T11:55:57.984239+0000","last_became_peered":"2023-11-28T11:55:57.984239+0000","last_unstale":"2023-11-28T11:55:57.992752+0000","last_undegraded":"2023-11-28T11:55:57.992752+0000","last_fullsized":"2023-11-28T11:55:57.992752+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:40:15.671518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.984136+0000","last_change":"2023-11-28T11:55:57.975797+0000","last_active":"2023-11-28T11:55:57.984136+0000","last_peered":"2023-11-28T11:55:57.984136+0000","last_clean":"2023-11-28T11:55:57.984136+0000","last_became_active":"2023-11-28T11:55:57.975551+0000","last_became_peered":"2023-11-28T11:55:57.975551+0000","last_unstale":"2023-11-28T11:55:57.984136+0000","last_undegraded":"2023-11-28T11:55:57.984136+0000","last_fullsized":"2023-11-28T11:55:57.984136+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:54:55.680272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.987857+0000","last_change":"2023-11-28T11:55:57.973887+0000","last_active":"2023-11-28T11:55:57.987857+0000","last_peered":"2023-11-28T11:55:57.987857+0000","last_clean":"2023-11-28T11:55:57.987857+0000","last_became_active":"2023-11-28T11:55:57.973616+0000","last_became_peered":"2023-11-28T11:55:57.973616+0000","last_unstale":"2023-11-28T11:55:57.987857+0000","last_undegraded":"2023-11-28T11:55:57.987857+0000","last_fullsized":"2023-11-28T11:55:57.987857+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:52.818875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.993664+0000","last_change":"2023-11-28T11:55:57.992798+0000","last_active":"2023-11-28T11:55:57.993664+0000","last_peered":"2023-11-28T11:55:57.993664+0000","last_clean":"2023-11-28T11:55:57.993664+0000","last_became_active":"2023-11-28T11:55:57.992430+0000","last_became_peered":"2023-11-28T11:55:57.992430+0000","last_unstale":"2023-11-28T11:55:57.993664+0000","last_undegraded":"2023-11-28T11:55:57.993664+0000","last_fullsized":"2023-11-28T11:55:57.993664+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:59.707185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.991919+0000","last_change":"2023-11-28T11:55:57.583178+0000","last_active":"2023-11-28T11:55:57.991919+0000","last_peered":"2023-11-28T11:55:57.991919+0000","last_clean":"2023-11-28T11:55:57.991919+0000","last_became_active":"2023-11-28T11:55:57.582802+0000","last_became_peered":"2023-11-28T11:55:57.582802+0000","last_unstale":"2023-11-28T11:55:57.991919+0000","last_undegraded":"2023-11-28T11:55:57.991919+0000","last_fullsized":"2023-11-28T11:55:57.991919+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:22.454676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.988432+0000","last_change":"2023-11-28T11:55:57.986502+0000","last_active":"2023-11-28T11:55:57.988432+0000","last_peered":"2023-11-28T11:55:57.988432+0000","last_clean":"2023-11-28T11:55:57.988432+0000","last_became_active":"2023-11-28T11:55:57.986271+0000","last_became_peered":"2023-11-28T11:55:57.986271+0000","last_unstale":"2023-11-28T11:55:57.988432+0000","last_undegraded":"2023-11-28T11:55:57.988432+0000","last_fullsized":"2023-11-28T11:55:57.988432+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:09:05.746025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992226+0000","last_change":"2023-11-28T11:55:57.581844+0000","last_active":"2023-11-28T11:55:57.992226+0000","last_peered":"2023-11-28T11:55:57.992226+0000","last_clean":"2023-11-28T11:55:57.992226+0000","last_became_active":"2023-11-28T11:55:57.581546+0000","last_became_peered":"2023-11-28T11:55:57.581546+0000","last_unstale":"2023-11-28T11:55:57.992226+0000","last_undegraded":"2023-11-28T11:55:57.992226+0000","last_fullsized":"2023-11-28T11:55:57.992226+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:29:41.491976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990428+0000","last_change":"2023-11-28T11:55:57.986634+0000","last_active":"2023-11-28T11:55:57.990428+0000","last_peered":"2023-11-28T11:55:57.990428+0000","last_clean":"2023-11-28T11:55:57.990428+0000","last_became_active":"2023-11-28T11:55:57.986153+0000","last_became_peered":"2023-11-28T11:55:57.986153+0000","last_unstale":"2023-11-28T11:55:57.990428+0000","last_undegraded":"2023-11-28T11:55:57.990428+0000","last_fullsized":"2023-11-28T11:55:57.990428+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:26:57.416314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990143+0000","last_change":"2023-11-28T11:55:57.588871+0000","last_active":"2023-11-28T11:55:57.990143+0000","last_peered":"2023-11-28T11:55:57.990143+0000","last_clean":"2023-11-28T11:55:57.990143+0000","last_became_active":"2023-11-28T11:55:57.588541+0000","last_became_peered":"2023-11-28T11:55:57.588541+0000","last_unstale":"2023-11-28T11:55:57.990143+0000","last_undegraded":"2023-11-28T11:55:57.990143+0000","last_fullsized":"2023-11-28T11:55:57.990143+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:16:48.994643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.988024+0000","last_change":"2023-11-28T11:55:57.981433+0000","last_active":"2023-11-28T11:55:57.988024+0000","last_peered":"2023-11-28T11:55:57.988024+0000","last_clean":"2023-11-28T11:55:57.988024+0000","last_became_active":"2023-11-28T11:55:57.975774+0000","last_became_peered":"2023-11-28T11:55:57.975774+0000","last_unstale":"2023-11-28T11:55:57.988024+0000","last_undegraded":"2023-11-28T11:55:57.988024+0000","last_fullsized":"2023-11-28T11:55:57.988024+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:16:00.940345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.991270+0000","last_change":"2023-11-28T11:55:57.581661+0000","last_active":"2023-11-28T11:55:57.991270+0000","last_peered":"2023-11-28T11:55:57.991270+0000","last_clean":"2023-11-28T11:55:57.991270+0000","last_became_active":"2023-11-28T11:55:57.581392+0000","last_became_peered":"2023-11-28T11:55:57.581392+0000","last_unstale":"2023-11-28T11:55:57.991270+0000","last_undegraded":"2023-11-28T11:55:57.991270+0000","last_fullsized":"2023-11-28T11:55:57.991270+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:37.491304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983649+0000","last_change":"2023-11-28T11:55:57.976671+0000","last_active":"2023-11-28T11:55:57.983649+0000","last_peered":"2023-11-28T11:55:57.983649+0000","last_clean":"2023-11-28T11:55:57.983649+0000","last_became_active":"2023-11-28T11:55:57.974006+0000","last_became_peered":"2023-11-28T11:55:57.974006+0000","last_unstale":"2023-11-28T11:55:57.983649+0000","last_undegraded":"2023-11-28T11:55:57.983649+0000","last_fullsized":"2023-11-28T11:55:57.983649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:53:56.360940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.977562+0000","last_change":"2023-11-28T11:55:57.585235+0000","last_active":"2023-11-28T11:55:57.977562+0000","last_peered":"2023-11-28T11:55:57.977562+0000","last_clean":"2023-11-28T11:55:57.977562+0000","last_became_active":"2023-11-28T11:55:57.585002+0000","last_became_peered":"2023-11-28T11:55:57.585002+0000","last_unstale":"2023-11-28T11:55:57.977562+0000","last_undegraded":"2023-11-28T11:55:57.977562+0000","last_fullsized":"2023-11-28T11:55:57.977562+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:17:49.646408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.984705+0000","last_change":"2023-11-28T11:55:57.983554+0000","last_active":"2023-11-28T11:55:57.984705+0000","last_peered":"2023-11-28T11:55:57.984705+0000","last_clean":"2023-11-28T11:55:57.984705+0000","last_became_active":"2023-11-28T11:55:57.983308+0000","last_became_peered":"2023-11-28T11:55:57.983308+0000","last_unstale":"2023-11-28T11:55:57.984705+0000","last_undegraded":"2023-11-28T11:55:57.984705+0000","last_fullsized":"2023-11-28T11:55:57.984705+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:04:24.734981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990054+0000","last_change":"2023-11-28T11:55:57.591427+0000","last_active":"2023-11-28T11:55:57.990054+0000","last_peered":"2023-11-28T11:55:57.990054+0000","last_clean":"2023-11-28T11:55:57.990054+0000","last_became_active":"2023-11-28T11:55:57.589134+0000","last_became_peered":"2023-11-28T11:55:57.589134+0000","last_unstale":"2023-11-28T11:55:57.990054+0000","last_undegraded":"2023-11-28T11:55:57.990054+0000","last_fullsized":"2023-11-28T11:55:57.990054+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:37:53.077283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T11:55:58.965902+0000","last_change":"2023-11-28T11:55:57.977283+0000","last_active":"2023-11-28T11:55:58.965902+0000","last_peered":"2023-11-28T11:55:58.965902+0000","last_clean":"2023-11-28T11:55:58.965902+0000","last_became_active":"2023-11-28T11:55:57.976938+0000","last_became_peered":"2023-11-28T11:55:57.976938+0000","last_unstale":"2023-11-28T11:55:58.965902+0000","last_undegraded":"2023-11-28T11:55:58.965902+0000","last_fullsized":"2023-11-28T11:55:58.965902+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:35.555644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.958661+0000","last_change":"2023-11-28T11:55:57.579320+0000","last_active":"2023-11-28T11:55:57.958661+0000","last_peered":"2023-11-28T11:55:57.958661+0000","last_clean":"2023-11-28T11:55:57.958661+0000","last_became_active":"2023-11-28T11:55:57.579013+0000","last_became_peered":"2023-11-28T11:55:57.579013+0000","last_unstale":"2023-11-28T11:55:57.958661+0000","last_undegraded":"2023-11-28T11:55:57.958661+0000","last_fullsized":"2023-11-28T11:55:57.958661+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:08.980448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983826+0000","last_change":"2023-11-28T11:55:57.974370+0000","last_active":"2023-11-28T11:55:57.983826+0000","last_peered":"2023-11-28T11:55:57.983826+0000","last_clean":"2023-11-28T11:55:57.983826+0000","last_became_active":"2023-11-28T11:55:57.973845+0000","last_became_peered":"2023-11-28T11:55:57.973845+0000","last_unstale":"2023-11-28T11:55:57.983826+0000","last_undegraded":"2023-11-28T11:55:57.983826+0000","last_fullsized":"2023-11-28T11:55:57.983826+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:48:45.775683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.962943+0000","last_change":"2023-11-28T11:55:57.583964+0000","last_active":"2023-11-28T11:55:57.962943+0000","last_peered":"2023-11-28T11:55:57.962943+0000","last_clean":"2023-11-28T11:55:57.962943+0000","last_became_active":"2023-11-28T11:55:57.583618+0000","last_became_peered":"2023-11-28T11:55:57.583618+0000","last_unstale":"2023-11-28T11:55:57.962943+0000","last_undegraded":"2023-11-28T11:55:57.962943+0000","last_fullsized":"2023-11-28T11:55:57.962943+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:13.612869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.977758+0000","last_change":"2023-11-28T11:55:57.973858+0000","last_active":"2023-11-28T11:55:57.977758+0000","last_peered":"2023-11-28T11:55:57.977758+0000","last_clean":"2023-11-28T11:55:57.977758+0000","last_became_active":"2023-11-28T11:55:57.973524+0000","last_became_peered":"2023-11-28T11:55:57.973524+0000","last_unstale":"2023-11-28T11:55:57.977758+0000","last_undegraded":"2023-11-28T11:55:57.977758+0000","last_fullsized":"2023-11-28T11:55:57.977758+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:10:33.329953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.974127+0000","last_change":"2023-11-28T11:55:57.591265+0000","last_active":"2023-11-28T11:55:57.974127+0000","last_peered":"2023-11-28T11:55:57.974127+0000","last_clean":"2023-11-28T11:55:57.974127+0000","last_became_active":"2023-11-28T11:55:57.590928+0000","last_became_peered":"2023-11-28T11:55:57.590928+0000","last_unstale":"2023-11-28T11:55:57.974127+0000","last_undegraded":"2023-11-28T11:55:57.974127+0000","last_fullsized":"2023-11-28T11:55:57.974127+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:47.804731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992567+0000","last_change":"2023-11-28T11:55:57.984850+0000","last_active":"2023-11-28T11:55:57.992567+0000","last_peered":"2023-11-28T11:55:57.992567+0000","last_clean":"2023-11-28T11:55:57.992567+0000","last_became_active":"2023-11-28T11:55:57.984504+0000","last_became_peered":"2023-11-28T11:55:57.984504+0000","last_unstale":"2023-11-28T11:55:57.992567+0000","last_undegraded":"2023-11-28T11:55:57.992567+0000","last_fullsized":"2023-11-28T11:55:57.992567+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:18:02.126425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.966304+0000","last_change":"2023-11-28T11:55:57.587436+0000","last_active":"2023-11-28T11:55:57.966304+0000","last_peered":"2023-11-28T11:55:57.966304+0000","last_clean":"2023-11-28T11:55:57.966304+0000","last_became_active":"2023-11-28T11:55:57.587152+0000","last_became_peered":"2023-11-28T11:55:57.587152+0000","last_unstale":"2023-11-28T11:55:57.966304+0000","last_undegraded":"2023-11-28T11:55:57.966304+0000","last_fullsized":"2023-11-28T11:55:57.966304+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:17:49.646408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.980521+0000","last_change":"2023-11-28T11:55:57.969081+0000","last_active":"2023-11-28T11:55:57.980521+0000","last_peered":"2023-11-28T11:55:57.980521+0000","last_clean":"2023-11-28T11:55:57.980521+0000","last_became_active":"2023-11-28T11:55:57.968829+0000","last_became_peered":"2023-11-28T11:55:57.968829+0000","last_unstale":"2023-11-28T11:55:57.980521+0000","last_undegraded":"2023-11-28T11:55:57.980521+0000","last_fullsized":"2023-11-28T11:55:57.980521+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:59:23.112088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990692+0000","last_change":"2023-11-28T11:55:57.589153+0000","last_active":"2023-11-28T11:55:57.990692+0000","last_peered":"2023-11-28T11:55:57.990692+0000","last_clean":"2023-11-28T11:55:57.990692+0000","last_became_active":"2023-11-28T11:55:57.588899+0000","last_became_peered":"2023-11-28T11:55:57.588899+0000","last_unstale":"2023-11-28T11:55:57.990692+0000","last_undegraded":"2023-11-28T11:55:57.990692+0000","last_fullsized":"2023-11-28T11:55:57.990692+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:17:00.617357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992837+0000","last_change":"2023-11-28T11:55:57.986753+0000","last_active":"2023-11-28T11:55:57.992837+0000","last_peered":"2023-11-28T11:55:57.992837+0000","last_clean":"2023-11-28T11:55:57.992837+0000","last_became_active":"2023-11-28T11:55:57.986489+0000","last_became_peered":"2023-11-28T11:55:57.986489+0000","last_unstale":"2023-11-28T11:55:57.992837+0000","last_undegraded":"2023-11-28T11:55:57.992837+0000","last_fullsized":"2023-11-28T11:55:57.992837+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:33:05.657951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990610+0000","last_change":"2023-11-28T11:55:57.588605+0000","last_active":"2023-11-28T11:55:57.990610+0000","last_peered":"2023-11-28T11:55:57.990610+0000","last_clean":"2023-11-28T11:55:57.990610+0000","last_became_active":"2023-11-28T11:55:57.588246+0000","last_became_peered":"2023-11-28T11:55:57.588246+0000","last_unstale":"2023-11-28T11:55:57.990610+0000","last_undegraded":"2023-11-28T11:55:57.990610+0000","last_fullsized":"2023-11-28T11:55:57.990610+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:22.016981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.979803+0000","last_change":"2023-11-28T11:55:57.975104+0000","last_active":"2023-11-28T11:55:57.979803+0000","last_peered":"2023-11-28T11:55:57.979803+0000","last_clean":"2023-11-28T11:55:57.979803+0000","last_became_active":"2023-11-28T11:55:57.973277+0000","last_became_peered":"2023-11-28T11:55:57.973277+0000","last_unstale":"2023-11-28T11:55:57.979803+0000","last_undegraded":"2023-11-28T11:55:57.979803+0000","last_fullsized":"2023-11-28T11:55:57.979803+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:52:11.998343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.984604+0000","last_change":"2023-11-28T11:55:57.587428+0000","last_active":"2023-11-28T11:55:57.984604+0000","last_peered":"2023-11-28T11:55:57.984604+0000","last_clean":"2023-11-28T11:55:57.984604+0000","last_became_active":"2023-11-28T11:55:57.587140+0000","last_became_peered":"2023-11-28T11:55:57.587140+0000","last_unstale":"2023-11-28T11:55:57.984604+0000","last_undegraded":"2023-11-28T11:55:57.984604+0000","last_fullsized":"2023-11-28T11:55:57.984604+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:13.612869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992649+0000","last_change":"2023-11-28T11:55:57.985595+0000","last_active":"2023-11-28T11:55:57.992649+0000","last_peered":"2023-11-28T11:55:57.992649+0000","last_clean":"2023-11-28T11:55:57.992649+0000","last_became_active":"2023-11-28T11:55:57.984808+0000","last_became_peered":"2023-11-28T11:55:57.984808+0000","last_unstale":"2023-11-28T11:55:57.992649+0000","last_undegraded":"2023-11-28T11:55:57.992649+0000","last_fullsized":"2023-11-28T11:55:57.992649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:14:25.093644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T11:55:58.966135+0000","last_change":"2023-11-28T11:55:57.579618+0000","last_active":"2023-11-28T11:55:58.966135+0000","last_peered":"2023-11-28T11:55:58.966135+0000","last_clean":"2023-11-28T11:55:58.966135+0000","last_became_active":"2023-11-28T11:55:57.579318+0000","last_became_peered":"2023-11-28T11:55:57.579318+0000","last_unstale":"2023-11-28T11:55:58.966135+0000","last_undegraded":"2023-11-28T11:55:58.966135+0000","last_fullsized":"2023-11-28T11:55:58.966135+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:37.059723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.978622+0000","last_change":"2023-11-28T11:55:57.977373+0000","last_active":"2023-11-28T11:55:57.978622+0000","last_peered":"2023-11-28T11:55:57.978622+0000","last_clean":"2023-11-28T11:55:57.978622+0000","last_became_active":"2023-11-28T11:55:57.977070+0000","last_became_peered":"2023-11-28T11:55:57.977070+0000","last_unstale":"2023-11-28T11:55:57.978622+0000","last_undegraded":"2023-11-28T11:55:57.978622+0000","last_fullsized":"2023-11-28T11:55:57.978622+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:42.078272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.958815+0000","last_change":"2023-11-28T11:55:57.580183+0000","last_active":"2023-11-28T11:55:57.958815+0000","last_peered":"2023-11-28T11:55:57.958815+0000","last_clean":"2023-11-28T11:55:57.958815+0000","last_became_active":"2023-11-28T11:55:57.579928+0000","last_became_peered":"2023-11-28T11:55:57.579928+0000","last_unstale":"2023-11-28T11:55:57.958815+0000","last_undegraded":"2023-11-28T11:55:57.958815+0000","last_fullsized":"2023-11-28T11:55:57.958815+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:42:02.333732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992852+0000","last_change":"2023-11-28T11:55:57.987138+0000","last_active":"2023-11-28T11:55:57.992852+0000","last_peered":"2023-11-28T11:55:57.992852+0000","last_clean":"2023-11-28T11:55:57.992852+0000","last_became_active":"2023-11-28T11:55:57.985477+0000","last_became_peered":"2023-11-28T11:55:57.985477+0000","last_unstale":"2023-11-28T11:55:57.992852+0000","last_undegraded":"2023-11-28T11:55:57.992852+0000","last_fullsized":"2023-11-28T11:55:57.992852+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:17:50.658731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.991006+0000","last_change":"2023-11-28T11:55:57.589900+0000","last_active":"2023-11-28T11:55:57.991006+0000","last_peered":"2023-11-28T11:55:57.991006+0000","last_clean":"2023-11-28T11:55:57.991006+0000","last_became_active":"2023-11-28T11:55:57.589588+0000","last_became_peered":"2023-11-28T11:55:57.589588+0000","last_unstale":"2023-11-28T11:55:57.991006+0000","last_undegraded":"2023-11-28T11:55:57.991006+0000","last_fullsized":"2023-11-28T11:55:57.991006+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:53:42.859363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.975930+0000","last_change":"2023-11-28T11:55:57.966444+0000","last_active":"2023-11-28T11:55:57.975930+0000","last_peered":"2023-11-28T11:55:57.975930+0000","last_clean":"2023-11-28T11:55:57.975930+0000","last_became_active":"2023-11-28T11:55:57.966177+0000","last_became_peered":"2023-11-28T11:55:57.966177+0000","last_unstale":"2023-11-28T11:55:57.975930+0000","last_undegraded":"2023-11-28T11:55:57.975930+0000","last_fullsized":"2023-11-28T11:55:57.975930+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:57.203195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.980732+0000","last_change":"2023-11-28T11:55:57.582824+0000","last_active":"2023-11-28T11:55:57.980732+0000","last_peered":"2023-11-28T11:55:57.980732+0000","last_clean":"2023-11-28T11:55:57.980732+0000","last_became_active":"2023-11-28T11:55:57.582521+0000","last_became_peered":"2023-11-28T11:55:57.582521+0000","last_unstale":"2023-11-28T11:55:57.980732+0000","last_undegraded":"2023-11-28T11:55:57.980732+0000","last_fullsized":"2023-11-28T11:55:57.980732+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:57:32.994182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990152+0000","last_change":"2023-11-28T11:55:57.984688+0000","last_active":"2023-11-28T11:55:57.990152+0000","last_peered":"2023-11-28T11:55:57.990152+0000","last_clean":"2023-11-28T11:55:57.990152+0000","last_became_active":"2023-11-28T11:55:57.984372+0000","last_became_peered":"2023-11-28T11:55:57.984372+0000","last_unstale":"2023-11-28T11:55:57.990152+0000","last_undegraded":"2023-11-28T11:55:57.990152+0000","last_fullsized":"2023-11-28T11:55:57.990152+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:16:50.006966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.962702+0000","last_change":"2023-11-28T11:55:57.589281+0000","last_active":"2023-11-28T11:55:57.962702+0000","last_peered":"2023-11-28T11:55:57.962702+0000","last_clean":"2023-11-28T11:55:57.962702+0000","last_became_active":"2023-11-28T11:55:57.588782+0000","last_became_peered":"2023-11-28T11:55:57.588782+0000","last_unstale":"2023-11-28T11:55:57.962702+0000","last_undegraded":"2023-11-28T11:55:57.962702+0000","last_fullsized":"2023-11-28T11:55:57.962702+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:21.923714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983133+0000","last_change":"2023-11-28T11:55:57.974706+0000","last_active":"2023-11-28T11:55:57.983133+0000","last_peered":"2023-11-28T11:55:57.983133+0000","last_clean":"2023-11-28T11:55:57.983133+0000","last_became_active":"2023-11-28T11:55:57.974492+0000","last_became_peered":"2023-11-28T11:55:57.974492+0000","last_unstale":"2023-11-28T11:55:57.983133+0000","last_undegraded":"2023-11-28T11:55:57.983133+0000","last_fullsized":"2023-11-28T11:55:57.983133+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:44:16.253501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T11:55:58.966088+0000","last_change":"2023-11-28T11:55:57.579378+0000","last_active":"2023-11-28T11:55:58.966088+0000","last_peered":"2023-11-28T11:55:58.966088+0000","last_clean":"2023-11-28T11:55:58.966088+0000","last_became_active":"2023-11-28T11:55:57.579085+0000","last_became_peered":"2023-11-28T11:55:57.579085+0000","last_unstale":"2023-11-28T11:55:58.966088+0000","last_undegraded":"2023-11-28T11:55:58.966088+0000","last_fullsized":"2023-11-28T11:55:58.966088+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:05.501938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.988004+0000","last_change":"2023-11-28T11:55:57.981226+0000","last_active":"2023-11-28T11:55:57.988004+0000","last_peered":"2023-11-28T11:55:57.988004+0000","last_clean":"2023-11-28T11:55:57.988004+0000","last_became_active":"2023-11-28T11:55:57.975468+0000","last_became_peered":"2023-11-28T11:55:57.975468+0000","last_unstale":"2023-11-28T11:55:57.988004+0000","last_undegraded":"2023-11-28T11:55:57.988004+0000","last_fullsized":"2023-11-28T11:55:57.988004+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:20:11.533358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.958791+0000","last_change":"2023-11-28T11:55:57.579352+0000","last_active":"2023-11-28T11:55:57.958791+0000","last_peered":"2023-11-28T11:55:57.958791+0000","last_clean":"2023-11-28T11:55:57.958791+0000","last_became_active":"2023-11-28T11:55:57.579106+0000","last_became_peered":"2023-11-28T11:55:57.579106+0000","last_unstale":"2023-11-28T11:55:57.958791+0000","last_undegraded":"2023-11-28T11:55:57.958791+0000","last_fullsized":"2023-11-28T11:55:57.958791+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:06:25.989783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983799+0000","last_change":"2023-11-28T11:55:57.977276+0000","last_active":"2023-11-28T11:55:57.983799+0000","last_peered":"2023-11-28T11:55:57.983799+0000","last_clean":"2023-11-28T11:55:57.983799+0000","last_became_active":"2023-11-28T11:55:57.977013+0000","last_became_peered":"2023-11-28T11:55:57.977013+0000","last_unstale":"2023-11-28T11:55:57.983799+0000","last_undegraded":"2023-11-28T11:55:57.983799+0000","last_fullsized":"2023-11-28T11:55:57.983799+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:26:57.416314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.955052+0000","last_change":"2023-11-28T11:55:57.578505+0000","last_active":"2023-11-28T11:55:57.955052+0000","last_peered":"2023-11-28T11:55:57.955052+0000","last_clean":"2023-11-28T11:55:57.955052+0000","last_became_active":"2023-11-28T11:55:57.578238+0000","last_became_peered":"2023-11-28T11:55:57.578238+0000","last_unstale":"2023-11-28T11:55:57.955052+0000","last_undegraded":"2023-11-28T11:55:57.955052+0000","last_fullsized":"2023-11-28T11:55:57.955052+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:21:22.249810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992703+0000","last_change":"2023-11-28T11:55:57.985804+0000","last_active":"2023-11-28T11:55:57.992703+0000","last_peered":"2023-11-28T11:55:57.992703+0000","last_clean":"2023-11-28T11:55:57.992703+0000","last_became_active":"2023-11-28T11:55:57.985139+0000","last_became_peered":"2023-11-28T11:55:57.985139+0000","last_unstale":"2023-11-28T11:55:57.992703+0000","last_undegraded":"2023-11-28T11:55:57.992703+0000","last_fullsized":"2023-11-28T11:55:57.992703+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:29:42.504299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.963152+0000","last_change":"2023-11-28T11:55:57.590600+0000","last_active":"2023-11-28T11:55:57.963152+0000","last_peered":"2023-11-28T11:55:57.963152+0000","last_clean":"2023-11-28T11:55:57.963152+0000","last_became_active":"2023-11-28T11:55:57.590365+0000","last_became_peered":"2023-11-28T11:55:57.590365+0000","last_unstale":"2023-11-28T11:55:57.963152+0000","last_undegraded":"2023-11-28T11:55:57.963152+0000","last_fullsized":"2023-11-28T11:55:57.963152+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:22.454676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.980477+0000","last_change":"2023-11-28T11:55:57.967156+0000","last_active":"2023-11-28T11:55:57.980477+0000","last_peered":"2023-11-28T11:55:57.980477+0000","last_clean":"2023-11-28T11:55:57.980477+0000","last_became_active":"2023-11-28T11:55:57.966196+0000","last_became_peered":"2023-11-28T11:55:57.966196+0000","last_unstale":"2023-11-28T11:55:57.980477+0000","last_undegraded":"2023-11-28T11:55:57.980477+0000","last_fullsized":"2023-11-28T11:55:57.980477+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:45:54.920171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.954849+0000","last_change":"2023-11-28T11:55:57.589456+0000","last_active":"2023-11-28T11:55:57.954849+0000","last_peered":"2023-11-28T11:55:57.954849+0000","last_clean":"2023-11-28T11:55:57.954849+0000","last_became_active":"2023-11-28T11:55:57.589192+0000","last_became_peered":"2023-11-28T11:55:57.589192+0000","last_unstale":"2023-11-28T11:55:57.954849+0000","last_undegraded":"2023-11-28T11:55:57.954849+0000","last_fullsized":"2023-11-28T11:55:57.954849+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:28:25.479911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983844+0000","last_change":"2023-11-28T11:55:57.974186+0000","last_active":"2023-11-28T11:55:57.983844+0000","last_peered":"2023-11-28T11:55:57.983844+0000","last_clean":"2023-11-28T11:55:57.983844+0000","last_became_active":"2023-11-28T11:55:57.973418+0000","last_became_peered":"2023-11-28T11:55:57.973418+0000","last_unstale":"2023-11-28T11:55:57.983844+0000","last_undegraded":"2023-11-28T11:55:57.983844+0000","last_fullsized":"2023-11-28T11:55:57.983844+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:57:36.314516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.966110+0000","last_change":"2023-11-28T11:55:57.581810+0000","last_active":"2023-11-28T11:55:57.966110+0000","last_peered":"2023-11-28T11:55:57.966110+0000","last_clean":"2023-11-28T11:55:57.966110+0000","last_became_active":"2023-11-28T11:55:57.581481+0000","last_became_peered":"2023-11-28T11:55:57.581481+0000","last_unstale":"2023-11-28T11:55:57.966110+0000","last_undegraded":"2023-11-28T11:55:57.966110+0000","last_fullsized":"2023-11-28T11:55:57.966110+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:33:04.645628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.981617+0000","last_change":"2023-11-28T11:55:57.976022+0000","last_active":"2023-11-28T11:55:57.981617+0000","last_peered":"2023-11-28T11:55:57.981617+0000","last_clean":"2023-11-28T11:55:57.981617+0000","last_became_active":"2023-11-28T11:55:57.975684+0000","last_became_peered":"2023-11-28T11:55:57.975684+0000","last_unstale":"2023-11-28T11:55:57.981617+0000","last_undegraded":"2023-11-28T11:55:57.981617+0000","last_fullsized":"2023-11-28T11:55:57.981617+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:05:10.878530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990145+0000","last_change":"2023-11-28T11:55:57.590888+0000","last_active":"2023-11-28T11:55:57.990145+0000","last_peered":"2023-11-28T11:55:57.990145+0000","last_clean":"2023-11-28T11:55:57.990145+0000","last_became_active":"2023-11-28T11:55:57.589178+0000","last_became_peered":"2023-11-28T11:55:57.589178+0000","last_unstale":"2023-11-28T11:55:57.990145+0000","last_undegraded":"2023-11-28T11:55:57.990145+0000","last_fullsized":"2023-11-28T11:55:57.990145+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:56.190872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.958147+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:55:57.958147+0000","last_peered":"2023-11-28T11:55:57.958147+0000","last_clean":"2023-11-28T11:55:57.958147+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:55:57.958147+0000","last_undegraded":"2023-11-28T11:55:57.958147+0000","last_fullsized":"2023-11-28T11:55:57.958147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992546+0000","last_change":"2023-11-28T11:55:57.984806+0000","last_active":"2023-11-28T11:55:57.992546+0000","last_peered":"2023-11-28T11:55:57.992546+0000","last_clean":"2023-11-28T11:55:57.992546+0000","last_became_active":"2023-11-28T11:55:57.984131+0000","last_became_peered":"2023-11-28T11:55:57.984131+0000","last_unstale":"2023-11-28T11:55:57.992546+0000","last_undegraded":"2023-11-28T11:55:57.992546+0000","last_fullsized":"2023-11-28T11:55:57.992546+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:14:32.291268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.984489+0000","last_change":"2023-11-28T11:55:57.586719+0000","last_active":"2023-11-28T11:55:57.984489+0000","last_peered":"2023-11-28T11:55:57.984489+0000","last_clean":"2023-11-28T11:55:57.984489+0000","last_became_active":"2023-11-28T11:55:57.586408+0000","last_became_peered":"2023-11-28T11:55:57.586408+0000","last_unstale":"2023-11-28T11:55:57.984489+0000","last_undegraded":"2023-11-28T11:55:57.984489+0000","last_fullsized":"2023-11-28T11:55:57.984489+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:14:24.081321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.958421+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:55:57.958421+0000","last_peered":"2023-11-28T11:55:57.958421+0000","last_clean":"2023-11-28T11:55:57.958421+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:55:57.958421+0000","last_undegraded":"2023-11-28T11:55:57.958421+0000","last_fullsized":"2023-11-28T11:55:57.958421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992861+0000","last_change":"2023-11-28T11:55:57.986810+0000","last_active":"2023-11-28T11:55:57.992861+0000","last_peered":"2023-11-28T11:55:57.992861+0000","last_clean":"2023-11-28T11:55:57.992861+0000","last_became_active":"2023-11-28T11:55:57.986543+0000","last_became_peered":"2023-11-28T11:55:57.986543+0000","last_unstale":"2023-11-28T11:55:57.992861+0000","last_undegraded":"2023-11-28T11:55:57.992861+0000","last_fullsized":"2023-11-28T11:55:57.992861+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:23.797838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.962925+0000","last_change":"2023-11-28T11:55:57.588862+0000","last_active":"2023-11-28T11:55:57.962925+0000","last_peered":"2023-11-28T11:55:57.962925+0000","last_clean":"2023-11-28T11:55:57.962925+0000","last_became_active":"2023-11-28T11:55:57.588564+0000","last_became_peered":"2023-11-28T11:55:57.588564+0000","last_unstale":"2023-11-28T11:55:57.962925+0000","last_undegraded":"2023-11-28T11:55:57.962925+0000","last_fullsized":"2023-11-28T11:55:57.962925+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:31:30.653680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":46,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.573019+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:55:57.573019+0000","last_peered":"2023-11-28T11:55:57.573019+0000","last_clean":"2023-11-28T11:55:57.573019+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:55:57.573019+0000","last_undegraded":"2023-11-28T11:55:57.573019+0000","last_fullsized":"2023-11-28T11:55:57.573019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983614+0000","last_change":"2023-11-28T11:55:57.976374+0000","last_active":"2023-11-28T11:55:57.983614+0000","last_peered":"2023-11-28T11:55:57.983614+0000","last_clean":"2023-11-28T11:55:57.983614+0000","last_became_active":"2023-11-28T11:55:57.976102+0000","last_became_peered":"2023-11-28T11:55:57.976102+0000","last_unstale":"2023-11-28T11:55:57.983614+0000","last_undegraded":"2023-11-28T11:55:57.983614+0000","last_fullsized":"2023-11-28T11:55:57.983614+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:33:03.900201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990753+0000","last_change":"2023-11-28T11:55:57.580878+0000","last_active":"2023-11-28T11:55:57.990753+0000","last_peered":"2023-11-28T11:55:57.990753+0000","last_clean":"2023-11-28T11:55:57.990753+0000","last_became_active":"2023-11-28T11:55:57.580547+0000","last_became_peered":"2023-11-28T11:55:57.580547+0000","last_unstale":"2023-11-28T11:55:57.990753+0000","last_undegraded":"2023-11-28T11:55:57.990753+0000","last_fullsized":"2023-11-28T11:55:57.990753+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:40:14.659195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":42,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.579824+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:55:57.579824+0000","last_peered":"2023-11-28T11:55:57.579824+0000","last_clean":"2023-11-28T11:55:57.579824+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:55:57.579824+0000","last_undegraded":"2023-11-28T11:55:57.579824+0000","last_fullsized":"2023-11-28T11:55:57.579824+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.988040+0000","last_change":"2023-11-28T11:55:57.981314+0000","last_active":"2023-11-28T11:55:57.988040+0000","last_peered":"2023-11-28T11:55:57.988040+0000","last_clean":"2023-11-28T11:55:57.988040+0000","last_became_active":"2023-11-28T11:55:57.976041+0000","last_became_peered":"2023-11-28T11:55:57.976041+0000","last_unstale":"2023-11-28T11:55:57.988040+0000","last_undegraded":"2023-11-28T11:55:57.988040+0000","last_fullsized":"2023-11-28T11:55:57.988040+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:18:58.484183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.954977+0000","last_change":"2023-11-28T11:55:57.585936+0000","last_active":"2023-11-28T11:55:57.954977+0000","last_peered":"2023-11-28T11:55:57.954977+0000","last_clean":"2023-11-28T11:55:57.954977+0000","last_became_active":"2023-11-28T11:55:57.585574+0000","last_became_peered":"2023-11-28T11:55:57.585574+0000","last_unstale":"2023-11-28T11:55:57.954977+0000","last_undegraded":"2023-11-28T11:55:57.954977+0000","last_fullsized":"2023-11-28T11:55:57.954977+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:54:54.667949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":192,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.579507+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:55:57.579507+0000","last_peered":"2023-11-28T11:55:57.579507+0000","last_clean":"2023-11-28T11:55:57.579507+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:55:57.579507+0000","last_undegraded":"2023-11-28T11:55:57.579507+0000","last_fullsized":"2023-11-28T11:55:57.579507+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":41,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.563970+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:55:57.563970+0000","last_peered":"2023-11-28T11:55:57.563970+0000","last_clean":"2023-11-28T11:55:57.563970+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:55:57.563970+0000","last_undegraded":"2023-11-28T11:55:57.563970+0000","last_fullsized":"2023-11-28T11:55:57.563970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.979681+0000","last_change":"2023-11-28T11:55:57.973332+0000","last_active":"2023-11-28T11:55:57.979681+0000","last_peered":"2023-11-28T11:55:57.979681+0000","last_clean":"2023-11-28T11:55:57.979681+0000","last_became_active":"2023-11-28T11:55:57.973017+0000","last_became_peered":"2023-11-28T11:55:57.973017+0000","last_unstale":"2023-11-28T11:55:57.979681+0000","last_undegraded":"2023-11-28T11:55:57.979681+0000","last_fullsized":"2023-11-28T11:55:57.979681+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:23.466999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983665+0000","last_change":"2023-11-28T11:55:57.583444+0000","last_active":"2023-11-28T11:55:57.983665+0000","last_peered":"2023-11-28T11:55:57.983665+0000","last_clean":"2023-11-28T11:55:57.983665+0000","last_became_active":"2023-11-28T11:55:57.583153+0000","last_became_peered":"2023-11-28T11:55:57.583153+0000","last_unstale":"2023-11-28T11:55:57.983665+0000","last_undegraded":"2023-11-28T11:55:57.983665+0000","last_fullsized":"2023-11-28T11:55:57.983665+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:14:31.278945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":43,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.579540+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:55:57.579540+0000","last_peered":"2023-11-28T11:55:57.579540+0000","last_clean":"2023-11-28T11:55:57.579540+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:55:57.579540+0000","last_undegraded":"2023-11-28T11:55:57.579540+0000","last_fullsized":"2023-11-28T11:55:57.579540+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990379+0000","last_change":"2023-11-28T11:55:57.986231+0000","last_active":"2023-11-28T11:55:57.990379+0000","last_peered":"2023-11-28T11:55:57.990379+0000","last_clean":"2023-11-28T11:55:57.990379+0000","last_became_active":"2023-11-28T11:55:57.985934+0000","last_became_peered":"2023-11-28T11:55:57.985934+0000","last_unstale":"2023-11-28T11:55:57.990379+0000","last_undegraded":"2023-11-28T11:55:57.990379+0000","last_fullsized":"2023-11-28T11:55:57.990379+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:48:45.775683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.958172+0000","last_change":"2023-11-28T11:55:57.582891+0000","last_active":"2023-11-28T11:55:57.958172+0000","last_peered":"2023-11-28T11:55:57.958172+0000","last_clean":"2023-11-28T11:55:57.958172+0000","last_became_active":"2023-11-28T11:55:57.582649+0000","last_became_peered":"2023-11-28T11:55:57.582649+0000","last_unstale":"2023-11-28T11:55:57.958172+0000","last_undegraded":"2023-11-28T11:55:57.958172+0000","last_fullsized":"2023-11-28T11:55:57.958172+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:16:36.618619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":48,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.570314+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:55:57.570314+0000","last_peered":"2023-11-28T11:55:57.570314+0000","last_clean":"2023-11-28T11:55:57.570314+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:55:57.570314+0000","last_undegraded":"2023-11-28T11:55:57.570314+0000","last_fullsized":"2023-11-28T11:55:57.570314+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983960+0000","last_change":"2023-11-28T11:55:57.980015+0000","last_active":"2023-11-28T11:55:57.983960+0000","last_peered":"2023-11-28T11:55:57.983960+0000","last_clean":"2023-11-28T11:55:57.983960+0000","last_became_active":"2023-11-28T11:55:57.977136+0000","last_became_peered":"2023-11-28T11:55:57.977136+0000","last_unstale":"2023-11-28T11:55:57.983960+0000","last_undegraded":"2023-11-28T11:55:57.983960+0000","last_fullsized":"2023-11-28T11:55:57.983960+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:59.707185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T11:55:58.966348+0000","last_change":"2023-11-28T11:55:57.571227+0000","last_active":"2023-11-28T11:55:58.966348+0000","last_peered":"2023-11-28T11:55:58.966348+0000","last_clean":"2023-11-28T11:55:58.966348+0000","last_became_active":"2023-11-28T11:55:57.570940+0000","last_became_peered":"2023-11-28T11:55:57.570940+0000","last_unstale":"2023-11-28T11:55:58.966348+0000","last_undegraded":"2023-11-28T11:55:58.966348+0000","last_fullsized":"2023-11-28T11:55:58.966348+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:59:22.099765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.579646+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:55:57.579646+0000","last_peered":"2023-11-28T11:55:57.579646+0000","last_clean":"2023-11-28T11:55:57.579646+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:55:57.579646+0000","last_undegraded":"2023-11-28T11:55:57.579646+0000","last_fullsized":"2023-11-28T11:55:57.579646+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10296,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361544,"statfs":{"total":96636764160,"available":96626221056,"internally_reserved":0,"allocated":1228800,"data_stored":881459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.90900000000000003,"15min":0.91800000000000004},"min":{"1min":0.54300000000000004,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.268,"5min":1.413,"15min":1.413},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96899999999999997,"15min":0.96999999999999997},"min":{"1min":0.59799999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.1699999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.84199999999999997,"15min":0.83299999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81599999999999995,"15min":0.81999999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.78600000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81599999999999995,"15min":0.80800000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.91900000000000004,"15min":0.92100000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1140000000000001,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.22}]},{"osd":3,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.86199999999999999,"15min":0.85299999999999998},"min":{"1min":0.65200000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":1.615},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0009999999999999,"15min":1.0089999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1919999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.665}]},{"osd":4,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.86499999999999999,"15min":0.871},"min":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.109,"5min":1.2,"15min":1.2},"last":1.264},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.012,"15min":1.018},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3480000000000001,"5min":1.621,"15min":1.621},"last":1.3}]},{"osd":5,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.67400000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.2589999999999999,"5min":1.387,"15min":1.387},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.081,"15min":1.091},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.329,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.4630000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0880000000000001,"15min":1.0940000000000001},"min":{"1min":0.84099999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.746},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.111,"15min":1.1140000000000001},"min":{"1min":0.83199999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4119999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.7110000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9132,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362708,"statfs":{"total":96636764160,"available":96627412992,"internally_reserved":0,"allocated":626688,"data_stored":290931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.89700000000000002,"15min":0.90600000000000003},"min":{"1min":0.61899999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3440000000000001,"5min":1.625,"15min":1.625},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.095,"5min":1.498,"15min":1.498},"last":0.54800000000000004}]},{"osd":1,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.84999999999999998,"15min":0.85999999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.099,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.012},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.97699999999999998,"15min":0.98799999999999999},"min":{"1min":0.56100000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1419999999999999,"5min":1.444,"15min":1.444},"last":0.88900000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95999999999999996,"15min":0.96299999999999997},"min":{"1min":0.64300000000000002,"5min":0.62,"15min":0.62},"max":{"1min":1.196,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.89200000000000002,"15min":0.89900000000000002},"min":{"1min":0.59399999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.107,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89600000000000002,"15min":0.88500000000000001},"min":{"1min":0.72499999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.86099999999999999,"15min":0.85599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.121,"5min":1.161,"15min":1.161},"last":0.66900000000000004}]},{"osd":4,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.94599999999999995,"15min":0.95299999999999996},"min":{"1min":0.59499999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.272,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.745},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0029999999999999,"15min":1.01},"min":{"1min":0.65100000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.248,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.97999999999999998}]},{"osd":5,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.0089999999999999,"15min":1.0269999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1970000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.131,"15min":1.141},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4199999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.0489999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.079,"15min":1.0840000000000001},"min":{"1min":0.67800000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.206,"5min":1.575,"15min":1.575},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0449999999999999,"15min":1.0549999999999999},"min":{"1min":0.73699999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1910000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.91800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9208,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362632,"statfs":{"total":96636764160,"available":96627335168,"internally_reserved":0,"allocated":638976,"data_stored":292553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1259999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85499999999999998,"15min":0.85899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.165,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.157}]},{"osd":1,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.64500000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0620000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90300000000000002,"15min":0.91700000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1240000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.0529999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.84399999999999997,"15min":0.83599999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":1.012},{"interface":"front","average":{"1min":0.872,"5min":0.83799999999999997,"15min":0.83199999999999996},"min":{"1min":0.66500000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1259999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.129}]},{"osd":3,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1180000000000001,"5min":1.212,"15min":1.212},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.98399999999999999,"15min":0.98799999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.319,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.79000000000000004}]},{"osd":4,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.179,"5min":1.968,"15min":1.968},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.0309999999999999,"15min":1.0429999999999999},"min":{"1min":0.67800000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1259999999999999,"5min":1.581,"15min":1.581},"last":1.2609999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0069999999999999,"15min":1.01},"min":{"1min":0.64000000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.268,"5min":1.482,"15min":1.482},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.002,"15min":1.004},"min":{"1min":0.72599999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2210000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.2130000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0680000000000001,"15min":1.0740000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1819999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.097,"15min":1.0960000000000001},"min":{"1min":0.81100000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.234}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9340,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362500,"statfs":{"total":96636764160,"available":96627200000,"internally_reserved":0,"allocated":643072,"data_stored":293465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.84099999999999997,"15min":0.84499999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.83899999999999997,"15min":0.84599999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.98699999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85899999999999999,"15min":0.86099999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.93000000000000005,"15min":0.94599999999999995},"min":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.081,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.81100000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.67700000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.167,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.96299999999999997,"15min":0.97599999999999998},"min":{"1min":0.57199999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2090000000000001,"5min":1.528,"15min":1.528},"last":0.69799999999999995}]},{"osd":3,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.93400000000000005,"15min":0.94099999999999995},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.2609999999999999,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.052,"15min":1.0680000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.165,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.054}]},{"osd":5,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.98899999999999999,"15min":0.99299999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3149999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.034,"15min":1.046},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.208,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.161}]},{"osd":6,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.073,"15min":1.0860000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.294,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.151,"15min":1.159},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3799999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.085}]},{"osd":7,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1379999999999999,"15min":1.159},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2549999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.226},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1870000000000001,"15min":1.198},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.331,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.2}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9268,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362572,"statfs":{"total":96636764160,"available":96627273728,"internally_reserved":0,"allocated":634880,"data_stored":290987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.39000000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.095,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69699999999999995,"15min":0.70099999999999996},"min":{"1min":0.46500000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.91600000000000004,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.63300000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.45400000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.96799999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.746,"15min":0.751},"min":{"1min":0.499,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0629999999999999,"5min":1.764,"15min":1.764},"last":0.77500000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.48699999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.069,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.84899999999999998,"15min":0.86699999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96299999999999997,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.55600000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0229999999999999,"15min":1.0269999999999999},"min":{"1min":0.72899999999999998,"5min":0.505,"15min":0.505},"max":{"1min":1.518,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.751},{"interface":"front","average":{"1min":1.044,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.80900000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.6559999999999999,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":0.73799999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0820000000000001,"15min":1.1000000000000001},"min":{"1min":0.82399999999999995,"5min":0.626,"15min":0.626},"max":{"1min":1.4239999999999999,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.095},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.139,"15min":1.151},"min":{"1min":0.73299999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.419,"5min":2.266,"15min":2.266},"last":1.1259999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1060000000000001,"15min":1.1160000000000001},"min":{"1min":0.72799999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.5209999999999999,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.026,"5min":1.1000000000000001,"15min":1.1120000000000001},"min":{"1min":0.74299999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3220000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.0349999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.147,"15min":1.1579999999999999},"min":{"1min":0.78300000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5840000000000001,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1699999999999999,"15min":1.173},"min":{"1min":0.95699999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.7410000000000001,"5min":2.117,"15min":2.117},"last":1.0660000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13172,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":12544,"kb_avail":94358668,"statfs":{"total":96636764160,"available":96623276032,"internally_reserved":0,"allocated":634880,"data_stored":290987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12845056},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.48499999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81000000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76200000000000001,"15min":0.77000000000000002},"min":{"1min":0.51800000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0209999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.85899999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.442,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.98999999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.85899999999999999,"15min":0.871},"min":{"1min":0.51400000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.268,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.97099999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0920000000000001,"5min":1.254,"15min":1.254},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.84299999999999997,"15min":0.82799999999999996},"min":{"1min":0.66900000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2110000000000001,"5min":1.968,"15min":1.968},"last":1.123}]},{"osd":4,"last update":"Tue Nov 28 11:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0429999999999999,"15min":1.048},"min":{"1min":0.66700000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.234,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.222},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0649999999999999,"15min":1.0820000000000001},"min":{"1min":0.80000000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.4410000000000001,"5min":2.181,"15min":2.181},"last":1.0609999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.98999999999999999,"15min":0.98499999999999999},"min":{"1min":0.75600000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.3819999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1379999999999999,"15min":1.143},"min":{"1min":0.84499999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.405,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.3320000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1739999999999999,"15min":1.1879999999999999},"min":{"1min":0.81799999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.538,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.026},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1439999999999999,"15min":1.1479999999999999},"min":{"1min":0.82499999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.391,"5min":1.867,"15min":1.867},"last":1.087}]},{"osd":7,"last update":"Tue Nov 28 11:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.179,"15min":1.1890000000000001},"min":{"1min":0.77500000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.581,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1499999999999999,"15min":1.149},"min":{"1min":0.92200000000000004,"5min":0.748,"15min":0.748},"max":{"1min":1.4630000000000001,"5min":1.675,"15min":1.675},"last":1.194}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14328,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":13120,"kb_avail":94357512,"statfs":{"total":96636764160,"available":96622092288,"internally_reserved":0,"allocated":1228800,"data_stored":882375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13434880},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.90400000000000003,"5min":1.387,"15min":1.387},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69099999999999995,"15min":0.68500000000000005},"min":{"1min":0.46100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.57099999999999995}]},{"osd":2,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.46400000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79000000000000004,"15min":0.79200000000000004},"min":{"1min":0.46000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.1439999999999999,"5min":1.175,"15min":1.175},"last":0.83099999999999996}]},{"osd":3,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.85999999999999999,"15min":0.87},"min":{"1min":0.52900000000000003,"5min":0.317,"15min":0.317},"max":{"1min":1.1100000000000001,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.51100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.78700000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.91500000000000004,"15min":0.91000000000000003},"min":{"1min":0.73399999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2689999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":1,"5min":1.0669999999999999,"15min":1.0780000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3740000000000001,"5min":2.29,"15min":2.29},"last":1.127}]},{"osd":5,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.018,"15min":1.0189999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.998,"5min":1.038,"15min":1.044},"min":{"1min":0.79100000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1379999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.2030000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0609999999999999,"15min":1.0549999999999999},"min":{"1min":0.72099999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.87},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.075,"15min":1.081},"min":{"1min":0.88800000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3460000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":1.069}]},{"osd":7,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.2,"15min":1.2110000000000001},"min":{"1min":0.90100000000000002,"5min":0.747,"15min":0.747},"max":{"1min":1.5249999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1080000000000001,"15min":1.1040000000000001},"min":{"1min":0.81499999999999995,"5min":0.629,"15min":0.629},"max":{"1min":1.635,"5min":1.647,"15min":1.647},"last":1.159}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13440,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":12800,"kb_avail":94358400,"statfs":{"total":96636764160,"available":96623001600,"internally_reserved":0,"allocated":647168,"data_stored":294031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13107200},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.66800000000000004,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95299999999999996,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.016,"5min":1.091,"15min":1.091},"last":0.73399999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90500000000000003,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.45500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.91600000000000004,"15min":0.92700000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0680000000000001,"5min":1.96,"15min":1.96},"last":0.86299999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.72499999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.996,"5min":1.1000000000000001,"15min":1.1180000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.2010000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.94399999999999995}]},{"osd":5,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0640000000000001,"15min":1.0720000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2509999999999999,"5min":1.649,"15min":1.649},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.0029999999999999,"15min":1.0069999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2110000000000001,"5min":1.339,"15min":1.339},"last":0.89500000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.177,"15min":1.1899999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.536,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.133,"15min":1.139},"min":{"1min":0.80400000000000005,"5min":0.749,"15min":0.749},"max":{"1min":1.2909999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.161}]},{"osd":7,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.155,"15min":1.161},"min":{"1min":0.84499999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.3169999999999999,"5min":1.486,"15min":1.486},"last":1.042},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0800000000000001,"15min":1.0780000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.2470000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.0880000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:56:02.022 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:56:02.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.134+0000 7f991e0bf700 1 Processor -- start 2023-11-28T11:56:02.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.134+0000 7f991e0bf700 1 -- start start 2023-11-28T11:56:02.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.134+0000 7f991e0bf700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f99181584c0 0x7f99180b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.134+0000 7f991e0bf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f991806c390 0x7f9918163090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.134+0000 7f991e0bf700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99180b3c60 con 0x7f99180b3820 2023-11-28T11:56:02.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.134+0000 7f991e0bf700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991806dbd0 con 0x7f99181584c0 2023-11-28T11:56:02.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.134+0000 7f991e0bf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99180cbe20 con 0x7f991806c390 2023-11-28T11:56:02.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.134+0000 7f991c8bc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f99180b3820 0x7f991806bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33606/0 (socket says 172.21.15.50:33606) 2023-11-28T11:56:02.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.134+0000 7f991c8bc700 1 -- 172.21.15.50:0/2815431733 learned_addr learned my addr 172.21.15.50:0/2815431733 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:02.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.134+0000 7f991d0bd700 1 --2- 172.21.15.50:0/2815431733 >> v2:172.21.15.192:3300/0 conn(0x7f99181584c0 0x7f99180b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.134+0000 7f991d8be700 1 --2- 172.21.15.50:0/2815431733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f991806c390 0x7f9918163090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.134+0000 7f990ffff700 1 -- 172.21.15.50:0/2815431733 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604148311 0 0) 0x7f99180b3c60 con 0x7f99180b3820 2023-11-28T11:56:02.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.134+0000 7f990ffff700 1 -- 172.21.15.50:0/2815431733 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99040035d0 con 0x7f99180b3820 2023-11-28T11:56:02.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f991d8be700 1 -- 172.21.15.50:0/2815431733 >> v2:172.21.15.192:3300/0 conn(0x7f99181584c0 msgr2=0x7f99180b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:02.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f991d8be700 1 --2- 172.21.15.50:0/2815431733 >> v2:172.21.15.192:3300/0 conn(0x7f99181584c0 0x7f99180b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f991d8be700 1 -- 172.21.15.50:0/2815431733 >> v1:172.21.15.50:6789/0 conn(0x7f99180b3820 legacy=0x7f991806bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:02.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f991d8be700 1 -- 172.21.15.50:0/2815431733 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99180cd0f0 con 0x7f991806c390 2023-11-28T11:56:02.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f991d0bd700 1 --2- 172.21.15.50:0/2815431733 >> v2:172.21.15.192:3300/0 conn(0x7f99181584c0 0x7f99180b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f991d8be700 1 --2- 172.21.15.50:0/2815431733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f991806c390 0x7f9918163090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f99180cbf60 tx=0x7f9910009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dcf94c0b720d78e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f990ffff700 1 -- 172.21.15.50:0/2815431733 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910004220 con 0x7f991806c390 2023-11-28T11:56:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f990ffff700 1 -- 172.21.15.50:0/2815431733 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910004380 con 0x7f991806c390 2023-11-28T11:56:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f990ffff700 1 -- 172.21.15.50:0/2815431733 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99100036c0 con 0x7f991806c390 2023-11-28T11:56:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f991e0bf700 1 -- 172.21.15.50:0/2815431733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f991806c390 msgr2=0x7f9918163090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f991e0bf700 1 --2- 172.21.15.50:0/2815431733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f991806c390 0x7f9918163090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f99180cbf60 tx=0x7f9910009b30 comp rx=0 tx=0).stop 2023-11-28T11:56:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f991e0bf700 1 -- 172.21.15.50:0/2815431733 shutdown_connections 2023-11-28T11:56:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f991e0bf700 1 --2- 172.21.15.50:0/2815431733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f991806c390 0x7f9918163090 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f991e0bf700 1 --2- 172.21.15.50:0/2815431733 >> v2:172.21.15.192:3300/0 conn(0x7f99181584c0 0x7f99180b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f991e0bf700 1 -- 172.21.15.50:0/2815431733 >> 172.21.15.50:0/2815431733 conn(0x7f99180ce3e0 msgr2=0x7f99180ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:02.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f991e0bf700 1 -- 172.21.15.50:0/2815431733 shutdown_connections 2023-11-28T11:56:02.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f991e0bf700 1 -- 172.21.15.50:0/2815431733 wait complete. 2023-11-28T11:56:02.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f991e0bf700 1 Processor -- start 2023-11-28T11:56:02.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.138+0000 7f991e0bf700 1 -- start start 2023-11-28T11:56:02.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991e0bf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f991806c390 0x7f9918157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991e0bf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99180b3820 0x7f99180afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991e0bf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99181584c0 0x7f99180c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991e0bf700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99180c6860 con 0x7f991806c390 2023-11-28T11:56:02.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991e0bf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9918157980 con 0x7f99180b3820 2023-11-28T11:56:02.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991e0bf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99181e4bd0 con 0x7f99181584c0 2023-11-28T11:56:02.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991d0bd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f991806c390 0x7f9918157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991d0bd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f991806c390 0x7f9918157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58972/0 (socket says 172.21.15.50:58972) 2023-11-28T11:56:02.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991d0bd700 1 -- 172.21.15.50:0/998085552 learned_addr learned my addr 172.21.15.50:0/998085552 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:02.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991c8bc700 1 --2- 172.21.15.50:0/998085552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99180b3820 0x7f99180afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991d8be700 1 --2- 172.21.15.50:0/998085552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99181584c0 0x7f99180c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991d0bd700 1 -- 172.21.15.50:0/998085552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99181584c0 msgr2=0x7f99180c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:02.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991d0bd700 1 --2- 172.21.15.50:0/998085552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99181584c0 0x7f99180c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991d0bd700 1 -- 172.21.15.50:0/998085552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99180b3820 msgr2=0x7f99180afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:02.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991d0bd700 1 --2- 172.21.15.50:0/998085552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99180b3820 0x7f99180afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991d0bd700 1 -- 172.21.15.50:0/998085552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99080094b0 con 0x7f991806c390 2023-11-28T11:56:02.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991c8bc700 1 --2- 172.21.15.50:0/998085552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99180b3820 0x7f99180afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:02.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991d0bd700 1 --2- 172.21.15.50:0/998085552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f991806c390 0x7f9918157080 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f990800ebe0 tx=0x7f9908009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:02.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f990dffb700 1 -- 172.21.15.50:0/998085552 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800c8b0 con 0x7f991806c390 2023-11-28T11:56:02.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f990dffb700 1 -- 172.21.15.50:0/998085552 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990800ca10 con 0x7f991806c390 2023-11-28T11:56:02.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991e0bf700 1 -- 172.21.15.50:0/998085552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99100094b0 con 0x7f991806c390 2023-11-28T11:56:02.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f990dffb700 1 -- 172.21.15.50:0/998085552 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800cda0 con 0x7f991806c390 2023-11-28T11:56:02.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991e0bf700 1 -- 172.21.15.50:0/998085552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99180cd6b0 con 0x7f991806c390 2023-11-28T11:56:02.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.142+0000 7f991e0bf700 1 -- 172.21.15.50:0/998085552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99180cd3d0 con 0x7f991806c390 2023-11-28T11:56:02.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.146+0000 7f990dffb700 1 -- 172.21.15.50:0/998085552 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9908019030 con 0x7f991806c390 2023-11-28T11:56:02.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.146+0000 7f990dffb700 1 --2- 172.21.15.50:0/998085552 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f98fc064ee0 0x7f98fc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.146+0000 7f990dffb700 1 -- 172.21.15.50:0/998085552 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9908082100 con 0x7f991806c390 2023-11-28T11:56:02.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.146+0000 7f991c8bc700 1 --2- 172.21.15.50:0/998085552 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f98fc064ee0 0x7f98fc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.146+0000 7f991c8bc700 1 --2- 172.21.15.50:0/998085552 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f98fc064ee0 0x7f98fc067390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f99181f48f0 tx=0x7f9914009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:02.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.154+0000 7f990dffb700 1 -- 172.21.15.50:0/998085552 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9908050070 con 0x7f991806c390 2023-11-28T11:56:02.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.314+0000 7f991e0bf700 1 -- 172.21.15.50:0/998085552 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99180c6310 con 0x7f98fc064ee0 2023-11-28T11:56:02.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.334+0000 7f990dffb700 1 -- 172.21.15.50:0/998085552 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310250 (secure 0 0 0) 0x7f99180c6310 con 0x7f98fc064ee0 2023-11-28T11:56:02.338 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:02.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.338+0000 7f991e0bf700 1 -- 172.21.15.50:0/998085552 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f98fc064ee0 msgr2=0x7f98fc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:02.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.338+0000 7f991e0bf700 1 --2- 172.21.15.50:0/998085552 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f98fc064ee0 0x7f98fc067390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f99181f48f0 tx=0x7f9914009040 comp rx=0 tx=0).stop 2023-11-28T11:56:02.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.338+0000 7f991e0bf700 1 -- 172.21.15.50:0/998085552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f991806c390 msgr2=0x7f9918157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:02.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.338+0000 7f991e0bf700 1 --2- 172.21.15.50:0/998085552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f991806c390 0x7f9918157080 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f990800ebe0 tx=0x7f9908009e30 comp rx=0 tx=0).stop 2023-11-28T11:56:02.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.338+0000 7f991e0bf700 1 -- 172.21.15.50:0/998085552 shutdown_connections 2023-11-28T11:56:02.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.338+0000 7f991e0bf700 1 --2- 172.21.15.50:0/998085552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99181584c0 0x7f99180c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.338+0000 7f991e0bf700 1 --2- 172.21.15.50:0/998085552 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f98fc064ee0 0x7f98fc067390 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.338+0000 7f991e0bf700 1 --2- 172.21.15.50:0/998085552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99180b3820 0x7f99180afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.338+0000 7f991e0bf700 1 --2- 172.21.15.50:0/998085552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f991806c390 0x7f9918157080 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.338+0000 7f991e0bf700 1 -- 172.21.15.50:0/998085552 >> 172.21.15.50:0/998085552 conn(0x7f99180ce3e0 msgr2=0x7f991806fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.338+0000 7f991e0bf700 1 -- 172.21.15.50:0/998085552 shutdown_connections 2023-11-28T11:56:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.338+0000 7f991e0bf700 1 -- 172.21.15.50:0/998085552 wait complete. 2023-11-28T11:56:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:56:02.355 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2023-11-28T11:56:00.919204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":88184,"kb_used_data":6136,"kb_used_omap":0,"kb_used_meta":81984,"kb_avail":754886536,"statfs":{"total":773094113280,"available":773003812864,"internally_reserved":0,"allocated":6283264,"data_stored":3516788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":83951616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.373291"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.984299+0000","last_change":"2023-11-28T11:55:57.978343+0000","last_active":"2023-11-28T11:55:57.984299+0000","last_peered":"2023-11-28T11:55:57.984299+0000","last_clean":"2023-11-28T11:55:57.984299+0000","last_became_active":"2023-11-28T11:55:57.977910+0000","last_became_peered":"2023-11-28T11:55:57.977910+0000","last_unstale":"2023-11-28T11:55:57.984299+0000","last_undegraded":"2023-11-28T11:55:57.984299+0000","last_fullsized":"2023-11-28T11:55:57.984299+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:28:26.492234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983703+0000","last_change":"2023-11-28T11:55:57.977064+0000","last_active":"2023-11-28T11:55:57.983703+0000","last_peered":"2023-11-28T11:55:57.983703+0000","last_clean":"2023-11-28T11:55:57.983703+0000","last_became_active":"2023-11-28T11:55:57.976754+0000","last_became_peered":"2023-11-28T11:55:57.976754+0000","last_unstale":"2023-11-28T11:55:57.983703+0000","last_undegraded":"2023-11-28T11:55:57.983703+0000","last_fullsized":"2023-11-28T11:55:57.983703+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:18:58.484183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992794+0000","last_change":"2023-11-28T11:55:57.986144+0000","last_active":"2023-11-28T11:55:57.992794+0000","last_peered":"2023-11-28T11:55:57.992794+0000","last_clean":"2023-11-28T11:55:57.992794+0000","last_became_active":"2023-11-28T11:55:57.984229+0000","last_became_peered":"2023-11-28T11:55:57.984229+0000","last_unstale":"2023-11-28T11:55:57.992794+0000","last_undegraded":"2023-11-28T11:55:57.992794+0000","last_fullsized":"2023-11-28T11:55:57.992794+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:23.466999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.976061+0000","last_change":"2023-11-28T11:55:57.964807+0000","last_active":"2023-11-28T11:55:57.976061+0000","last_peered":"2023-11-28T11:55:57.976061+0000","last_clean":"2023-11-28T11:55:57.976061+0000","last_became_active":"2023-11-28T11:55:57.964527+0000","last_became_peered":"2023-11-28T11:55:57.964527+0000","last_unstale":"2023-11-28T11:55:57.976061+0000","last_undegraded":"2023-11-28T11:55:57.976061+0000","last_fullsized":"2023-11-28T11:55:57.976061+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:31:31.666003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.979743+0000","last_change":"2023-11-28T11:55:57.975364+0000","last_active":"2023-11-28T11:55:57.979743+0000","last_peered":"2023-11-28T11:55:57.979743+0000","last_clean":"2023-11-28T11:55:57.979743+0000","last_became_active":"2023-11-28T11:55:57.975098+0000","last_became_peered":"2023-11-28T11:55:57.975098+0000","last_unstale":"2023-11-28T11:55:57.979743+0000","last_undegraded":"2023-11-28T11:55:57.979743+0000","last_fullsized":"2023-11-28T11:55:57.979743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:57:34.006505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.981512+0000","last_change":"2023-11-28T11:55:57.969195+0000","last_active":"2023-11-28T11:55:57.981512+0000","last_peered":"2023-11-28T11:55:57.981512+0000","last_clean":"2023-11-28T11:55:57.981512+0000","last_became_active":"2023-11-28T11:55:57.968865+0000","last_became_peered":"2023-11-28T11:55:57.968865+0000","last_unstale":"2023-11-28T11:55:57.981512+0000","last_undegraded":"2023-11-28T11:55:57.981512+0000","last_fullsized":"2023-11-28T11:55:57.981512+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:04:24.734981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.977620+0000","last_change":"2023-11-28T11:55:57.973526+0000","last_active":"2023-11-28T11:55:57.977620+0000","last_peered":"2023-11-28T11:55:57.977620+0000","last_clean":"2023-11-28T11:55:57.977620+0000","last_became_active":"2023-11-28T11:55:57.972847+0000","last_became_peered":"2023-11-28T11:55:57.972847+0000","last_unstale":"2023-11-28T11:55:57.977620+0000","last_undegraded":"2023-11-28T11:55:57.977620+0000","last_fullsized":"2023-11-28T11:55:57.977620+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:44:53.094068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.977302+0000","last_change":"2023-11-28T11:55:57.971492+0000","last_active":"2023-11-28T11:55:57.977302+0000","last_peered":"2023-11-28T11:55:57.977302+0000","last_clean":"2023-11-28T11:55:57.977302+0000","last_became_active":"2023-11-28T11:55:57.971221+0000","last_became_peered":"2023-11-28T11:55:57.971221+0000","last_unstale":"2023-11-28T11:55:57.977302+0000","last_undegraded":"2023-11-28T11:55:57.977302+0000","last_fullsized":"2023-11-28T11:55:57.977302+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:56:17.271102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.974508+0000","last_change":"2023-11-28T11:55:57.967864+0000","last_active":"2023-11-28T11:55:57.974508+0000","last_peered":"2023-11-28T11:55:57.974508+0000","last_clean":"2023-11-28T11:55:57.974508+0000","last_became_active":"2023-11-28T11:55:57.967594+0000","last_became_peered":"2023-11-28T11:55:57.967594+0000","last_unstale":"2023-11-28T11:55:57.974508+0000","last_undegraded":"2023-11-28T11:55:57.974508+0000","last_fullsized":"2023-11-28T11:55:57.974508+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:20:54.194184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.980406+0000","last_change":"2023-11-28T11:55:57.966647+0000","last_active":"2023-11-28T11:55:57.980406+0000","last_peered":"2023-11-28T11:55:57.980406+0000","last_clean":"2023-11-28T11:55:57.980406+0000","last_became_active":"2023-11-28T11:55:57.966365+0000","last_became_peered":"2023-11-28T11:55:57.966365+0000","last_unstale":"2023-11-28T11:55:57.980406+0000","last_undegraded":"2023-11-28T11:55:57.980406+0000","last_fullsized":"2023-11-28T11:55:57.980406+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:35.555644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983023+0000","last_change":"2023-11-28T11:55:57.977834+0000","last_active":"2023-11-28T11:55:57.983023+0000","last_peered":"2023-11-28T11:55:57.983023+0000","last_clean":"2023-11-28T11:55:57.983023+0000","last_became_active":"2023-11-28T11:55:57.977171+0000","last_became_peered":"2023-11-28T11:55:57.977171+0000","last_unstale":"2023-11-28T11:55:57.983023+0000","last_undegraded":"2023-11-28T11:55:57.983023+0000","last_fullsized":"2023-11-28T11:55:57.983023+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:31:45.396246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.981593+0000","last_change":"2023-11-28T11:55:57.976844+0000","last_active":"2023-11-28T11:55:57.981593+0000","last_peered":"2023-11-28T11:55:57.981593+0000","last_clean":"2023-11-28T11:55:57.981593+0000","last_became_active":"2023-11-28T11:55:57.976336+0000","last_became_peered":"2023-11-28T11:55:57.976336+0000","last_unstale":"2023-11-28T11:55:57.981593+0000","last_undegraded":"2023-11-28T11:55:57.981593+0000","last_fullsized":"2023-11-28T11:55:57.981593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:14.625192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T11:55:58.966433+0000","last_change":"2023-11-28T11:55:57.970021+0000","last_active":"2023-11-28T11:55:58.966433+0000","last_peered":"2023-11-28T11:55:58.966433+0000","last_clean":"2023-11-28T11:55:58.966433+0000","last_became_active":"2023-11-28T11:55:57.969732+0000","last_became_peered":"2023-11-28T11:55:57.969732+0000","last_unstale":"2023-11-28T11:55:58.966433+0000","last_undegraded":"2023-11-28T11:55:58.966433+0000","last_fullsized":"2023-11-28T11:55:58.966433+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:48.817054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.974607+0000","last_change":"2023-11-28T11:55:57.969130+0000","last_active":"2023-11-28T11:55:57.974607+0000","last_peered":"2023-11-28T11:55:57.974607+0000","last_clean":"2023-11-28T11:55:57.974607+0000","last_became_active":"2023-11-28T11:55:57.968801+0000","last_became_peered":"2023-11-28T11:55:57.968801+0000","last_unstale":"2023-11-28T11:55:57.974607+0000","last_undegraded":"2023-11-28T11:55:57.974607+0000","last_fullsized":"2023-11-28T11:55:57.974607+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:20:11.533358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.977740+0000","last_change":"2023-11-28T11:55:57.974095+0000","last_active":"2023-11-28T11:55:57.977740+0000","last_peered":"2023-11-28T11:55:57.977740+0000","last_clean":"2023-11-28T11:55:57.977740+0000","last_became_active":"2023-11-28T11:55:57.973785+0000","last_became_peered":"2023-11-28T11:55:57.973785+0000","last_unstale":"2023-11-28T11:55:57.977740+0000","last_undegraded":"2023-11-28T11:55:57.977740+0000","last_fullsized":"2023-11-28T11:55:57.977740+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:03.621202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.981781+0000","last_change":"2023-11-28T11:55:57.969861+0000","last_active":"2023-11-28T11:55:57.981781+0000","last_peered":"2023-11-28T11:55:57.981781+0000","last_clean":"2023-11-28T11:55:57.981781+0000","last_became_active":"2023-11-28T11:55:57.969586+0000","last_became_peered":"2023-11-28T11:55:57.969586+0000","last_unstale":"2023-11-28T11:55:57.981781+0000","last_undegraded":"2023-11-28T11:55:57.981781+0000","last_fullsized":"2023-11-28T11:55:57.981781+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:38:09.692259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.980828+0000","last_change":"2023-11-28T11:55:57.973918+0000","last_active":"2023-11-28T11:55:57.980828+0000","last_peered":"2023-11-28T11:55:57.980828+0000","last_clean":"2023-11-28T11:55:57.980828+0000","last_became_active":"2023-11-28T11:55:57.973629+0000","last_became_peered":"2023-11-28T11:55:57.973629+0000","last_unstale":"2023-11-28T11:55:57.980828+0000","last_undegraded":"2023-11-28T11:55:57.980828+0000","last_fullsized":"2023-11-28T11:55:57.980828+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:51.617300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992570+0000","last_change":"2023-11-28T11:55:57.985011+0000","last_active":"2023-11-28T11:55:57.992570+0000","last_peered":"2023-11-28T11:55:57.992570+0000","last_clean":"2023-11-28T11:55:57.992570+0000","last_became_active":"2023-11-28T11:55:57.984524+0000","last_became_peered":"2023-11-28T11:55:57.984524+0000","last_unstale":"2023-11-28T11:55:57.992570+0000","last_undegraded":"2023-11-28T11:55:57.992570+0000","last_fullsized":"2023-11-28T11:55:57.992570+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:52:11.998343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992630+0000","last_change":"2023-11-28T11:55:57.978055+0000","last_active":"2023-11-28T11:55:57.992630+0000","last_peered":"2023-11-28T11:55:57.992630+0000","last_clean":"2023-11-28T11:55:57.992630+0000","last_became_active":"2023-11-28T11:55:57.977674+0000","last_became_peered":"2023-11-28T11:55:57.977674+0000","last_unstale":"2023-11-28T11:55:57.992630+0000","last_undegraded":"2023-11-28T11:55:57.992630+0000","last_fullsized":"2023-11-28T11:55:57.992630+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:23.036588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.984246+0000","last_change":"2023-11-28T11:55:57.983210+0000","last_active":"2023-11-28T11:55:57.984246+0000","last_peered":"2023-11-28T11:55:57.984246+0000","last_clean":"2023-11-28T11:55:57.984246+0000","last_became_active":"2023-11-28T11:55:57.982955+0000","last_became_peered":"2023-11-28T11:55:57.982955+0000","last_unstale":"2023-11-28T11:55:57.984246+0000","last_undegraded":"2023-11-28T11:55:57.984246+0000","last_fullsized":"2023-11-28T11:55:57.984246+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:16:00.940345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992754+0000","last_change":"2023-11-28T11:55:57.986069+0000","last_active":"2023-11-28T11:55:57.992754+0000","last_peered":"2023-11-28T11:55:57.992754+0000","last_clean":"2023-11-28T11:55:57.992754+0000","last_became_active":"2023-11-28T11:55:57.984479+0000","last_became_peered":"2023-11-28T11:55:57.984479+0000","last_unstale":"2023-11-28T11:55:57.992754+0000","last_undegraded":"2023-11-28T11:55:57.992754+0000","last_fullsized":"2023-11-28T11:55:57.992754+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:14.625192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983668+0000","last_change":"2023-11-28T11:55:57.976732+0000","last_active":"2023-11-28T11:55:57.983668+0000","last_peered":"2023-11-28T11:55:57.983668+0000","last_clean":"2023-11-28T11:55:57.983668+0000","last_became_active":"2023-11-28T11:55:57.974317+0000","last_became_peered":"2023-11-28T11:55:57.974317+0000","last_unstale":"2023-11-28T11:55:57.983668+0000","last_undegraded":"2023-11-28T11:55:57.983668+0000","last_fullsized":"2023-11-28T11:55:57.983668+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:53:09.051255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992614+0000","last_change":"2023-11-28T11:55:57.985528+0000","last_active":"2023-11-28T11:55:57.992614+0000","last_peered":"2023-11-28T11:55:57.992614+0000","last_clean":"2023-11-28T11:55:57.992614+0000","last_became_active":"2023-11-28T11:55:57.984224+0000","last_became_peered":"2023-11-28T11:55:57.984224+0000","last_unstale":"2023-11-28T11:55:57.992614+0000","last_undegraded":"2023-11-28T11:55:57.992614+0000","last_fullsized":"2023-11-28T11:55:57.992614+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:23.029304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T11:55:58.965459+0000","last_change":"2023-11-28T11:55:57.964863+0000","last_active":"2023-11-28T11:55:58.965459+0000","last_peered":"2023-11-28T11:55:58.965459+0000","last_clean":"2023-11-28T11:55:58.965459+0000","last_became_active":"2023-11-28T11:55:57.964575+0000","last_became_peered":"2023-11-28T11:55:57.964575+0000","last_unstale":"2023-11-28T11:55:58.965459+0000","last_undegraded":"2023-11-28T11:55:58.965459+0000","last_fullsized":"2023-11-28T11:55:58.965459+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:53:43.871686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.984278+0000","last_change":"2023-11-28T11:55:57.977213+0000","last_active":"2023-11-28T11:55:57.984278+0000","last_peered":"2023-11-28T11:55:57.984278+0000","last_clean":"2023-11-28T11:55:57.984278+0000","last_became_active":"2023-11-28T11:55:57.976953+0000","last_became_peered":"2023-11-28T11:55:57.976953+0000","last_unstale":"2023-11-28T11:55:57.984278+0000","last_undegraded":"2023-11-28T11:55:57.984278+0000","last_fullsized":"2023-11-28T11:55:57.984278+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:21:23.262133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.976155+0000","last_change":"2023-11-28T11:55:57.967597+0000","last_active":"2023-11-28T11:55:57.976155+0000","last_peered":"2023-11-28T11:55:57.976155+0000","last_clean":"2023-11-28T11:55:57.976155+0000","last_became_active":"2023-11-28T11:55:57.967281+0000","last_became_peered":"2023-11-28T11:55:57.967281+0000","last_unstale":"2023-11-28T11:55:57.976155+0000","last_undegraded":"2023-11-28T11:55:57.976155+0000","last_fullsized":"2023-11-28T11:55:57.976155+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:23.029304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990013+0000","last_change":"2023-11-28T11:55:57.981637+0000","last_active":"2023-11-28T11:55:57.990013+0000","last_peered":"2023-11-28T11:55:57.990013+0000","last_clean":"2023-11-28T11:55:57.990013+0000","last_became_active":"2023-11-28T11:55:57.976008+0000","last_became_peered":"2023-11-28T11:55:57.976008+0000","last_unstale":"2023-11-28T11:55:57.990013+0000","last_undegraded":"2023-11-28T11:55:57.990013+0000","last_fullsized":"2023-11-28T11:55:57.990013+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:53:09.051255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.979768+0000","last_change":"2023-11-28T11:55:57.975247+0000","last_active":"2023-11-28T11:55:57.979768+0000","last_peered":"2023-11-28T11:55:57.979768+0000","last_clean":"2023-11-28T11:55:57.979768+0000","last_became_active":"2023-11-28T11:55:57.974910+0000","last_became_peered":"2023-11-28T11:55:57.974910+0000","last_unstale":"2023-11-28T11:55:57.979768+0000","last_undegraded":"2023-11-28T11:55:57.979768+0000","last_fullsized":"2023-11-28T11:55:57.979768+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:02:03.225787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983927+0000","last_change":"2023-11-28T11:55:57.979134+0000","last_active":"2023-11-28T11:55:57.983927+0000","last_peered":"2023-11-28T11:55:57.983927+0000","last_clean":"2023-11-28T11:55:57.983927+0000","last_became_active":"2023-11-28T11:55:57.977572+0000","last_became_peered":"2023-11-28T11:55:57.977572+0000","last_unstale":"2023-11-28T11:55:57.983927+0000","last_undegraded":"2023-11-28T11:55:57.983927+0000","last_fullsized":"2023-11-28T11:55:57.983927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:45:32.160561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992752+0000","last_change":"2023-11-28T11:55:57.985951+0000","last_active":"2023-11-28T11:55:57.992752+0000","last_peered":"2023-11-28T11:55:57.992752+0000","last_clean":"2023-11-28T11:55:57.992752+0000","last_became_active":"2023-11-28T11:55:57.984239+0000","last_became_peered":"2023-11-28T11:55:57.984239+0000","last_unstale":"2023-11-28T11:55:57.992752+0000","last_undegraded":"2023-11-28T11:55:57.992752+0000","last_fullsized":"2023-11-28T11:55:57.992752+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:40:15.671518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.984136+0000","last_change":"2023-11-28T11:55:57.975797+0000","last_active":"2023-11-28T11:55:57.984136+0000","last_peered":"2023-11-28T11:55:57.984136+0000","last_clean":"2023-11-28T11:55:57.984136+0000","last_became_active":"2023-11-28T11:55:57.975551+0000","last_became_peered":"2023-11-28T11:55:57.975551+0000","last_unstale":"2023-11-28T11:55:57.984136+0000","last_undegraded":"2023-11-28T11:55:57.984136+0000","last_fullsized":"2023-11-28T11:55:57.984136+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:54:55.680272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.987857+0000","last_change":"2023-11-28T11:55:57.973887+0000","last_active":"2023-11-28T11:55:57.987857+0000","last_peered":"2023-11-28T11:55:57.987857+0000","last_clean":"2023-11-28T11:55:57.987857+0000","last_became_active":"2023-11-28T11:55:57.973616+0000","last_became_peered":"2023-11-28T11:55:57.973616+0000","last_unstale":"2023-11-28T11:55:57.987857+0000","last_undegraded":"2023-11-28T11:55:57.987857+0000","last_fullsized":"2023-11-28T11:55:57.987857+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:52.818875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.993664+0000","last_change":"2023-11-28T11:55:57.992798+0000","last_active":"2023-11-28T11:55:57.993664+0000","last_peered":"2023-11-28T11:55:57.993664+0000","last_clean":"2023-11-28T11:55:57.993664+0000","last_became_active":"2023-11-28T11:55:57.992430+0000","last_became_peered":"2023-11-28T11:55:57.992430+0000","last_unstale":"2023-11-28T11:55:57.993664+0000","last_undegraded":"2023-11-28T11:55:57.993664+0000","last_fullsized":"2023-11-28T11:55:57.993664+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:59.707185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.991919+0000","last_change":"2023-11-28T11:55:57.583178+0000","last_active":"2023-11-28T11:55:57.991919+0000","last_peered":"2023-11-28T11:55:57.991919+0000","last_clean":"2023-11-28T11:55:57.991919+0000","last_became_active":"2023-11-28T11:55:57.582802+0000","last_became_peered":"2023-11-28T11:55:57.582802+0000","last_unstale":"2023-11-28T11:55:57.991919+0000","last_undegraded":"2023-11-28T11:55:57.991919+0000","last_fullsized":"2023-11-28T11:55:57.991919+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:22.454676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.988432+0000","last_change":"2023-11-28T11:55:57.986502+0000","last_active":"2023-11-28T11:55:57.988432+0000","last_peered":"2023-11-28T11:55:57.988432+0000","last_clean":"2023-11-28T11:55:57.988432+0000","last_became_active":"2023-11-28T11:55:57.986271+0000","last_became_peered":"2023-11-28T11:55:57.986271+0000","last_unstale":"2023-11-28T11:55:57.988432+0000","last_undegraded":"2023-11-28T11:55:57.988432+0000","last_fullsized":"2023-11-28T11:55:57.988432+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:09:05.746025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992226+0000","last_change":"2023-11-28T11:55:57.581844+0000","last_active":"2023-11-28T11:55:57.992226+0000","last_peered":"2023-11-28T11:55:57.992226+0000","last_clean":"2023-11-28T11:55:57.992226+0000","last_became_active":"2023-11-28T11:55:57.581546+0000","last_became_peered":"2023-11-28T11:55:57.581546+0000","last_unstale":"2023-11-28T11:55:57.992226+0000","last_undegraded":"2023-11-28T11:55:57.992226+0000","last_fullsized":"2023-11-28T11:55:57.992226+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:29:41.491976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990428+0000","last_change":"2023-11-28T11:55:57.986634+0000","last_active":"2023-11-28T11:55:57.990428+0000","last_peered":"2023-11-28T11:55:57.990428+0000","last_clean":"2023-11-28T11:55:57.990428+0000","last_became_active":"2023-11-28T11:55:57.986153+0000","last_became_peered":"2023-11-28T11:55:57.986153+0000","last_unstale":"2023-11-28T11:55:57.990428+0000","last_undegraded":"2023-11-28T11:55:57.990428+0000","last_fullsized":"2023-11-28T11:55:57.990428+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:26:57.416314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990143+0000","last_change":"2023-11-28T11:55:57.588871+0000","last_active":"2023-11-28T11:55:57.990143+0000","last_peered":"2023-11-28T11:55:57.990143+0000","last_clean":"2023-11-28T11:55:57.990143+0000","last_became_active":"2023-11-28T11:55:57.588541+0000","last_became_peered":"2023-11-28T11:55:57.588541+0000","last_unstale":"2023-11-28T11:55:57.990143+0000","last_undegraded":"2023-11-28T11:55:57.990143+0000","last_fullsized":"2023-11-28T11:55:57.990143+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:16:48.994643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.988024+0000","last_change":"2023-11-28T11:55:57.981433+0000","last_active":"2023-11-28T11:55:57.988024+0000","last_peered":"2023-11-28T11:55:57.988024+0000","last_clean":"2023-11-28T11:55:57.988024+0000","last_became_active":"2023-11-28T11:55:57.975774+0000","last_became_peered":"2023-11-28T11:55:57.975774+0000","last_unstale":"2023-11-28T11:55:57.988024+0000","last_undegraded":"2023-11-28T11:55:57.988024+0000","last_fullsized":"2023-11-28T11:55:57.988024+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:16:00.940345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.991270+0000","last_change":"2023-11-28T11:55:57.581661+0000","last_active":"2023-11-28T11:55:57.991270+0000","last_peered":"2023-11-28T11:55:57.991270+0000","last_clean":"2023-11-28T11:55:57.991270+0000","last_became_active":"2023-11-28T11:55:57.581392+0000","last_became_peered":"2023-11-28T11:55:57.581392+0000","last_unstale":"2023-11-28T11:55:57.991270+0000","last_undegraded":"2023-11-28T11:55:57.991270+0000","last_fullsized":"2023-11-28T11:55:57.991270+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:37.491304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983649+0000","last_change":"2023-11-28T11:55:57.976671+0000","last_active":"2023-11-28T11:55:57.983649+0000","last_peered":"2023-11-28T11:55:57.983649+0000","last_clean":"2023-11-28T11:55:57.983649+0000","last_became_active":"2023-11-28T11:55:57.974006+0000","last_became_peered":"2023-11-28T11:55:57.974006+0000","last_unstale":"2023-11-28T11:55:57.983649+0000","last_undegraded":"2023-11-28T11:55:57.983649+0000","last_fullsized":"2023-11-28T11:55:57.983649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:53:56.360940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.977562+0000","last_change":"2023-11-28T11:55:57.585235+0000","last_active":"2023-11-28T11:55:57.977562+0000","last_peered":"2023-11-28T11:55:57.977562+0000","last_clean":"2023-11-28T11:55:57.977562+0000","last_became_active":"2023-11-28T11:55:57.585002+0000","last_became_peered":"2023-11-28T11:55:57.585002+0000","last_unstale":"2023-11-28T11:55:57.977562+0000","last_undegraded":"2023-11-28T11:55:57.977562+0000","last_fullsized":"2023-11-28T11:55:57.977562+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:17:49.646408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.984705+0000","last_change":"2023-11-28T11:55:57.983554+0000","last_active":"2023-11-28T11:55:57.984705+0000","last_peered":"2023-11-28T11:55:57.984705+0000","last_clean":"2023-11-28T11:55:57.984705+0000","last_became_active":"2023-11-28T11:55:57.983308+0000","last_became_peered":"2023-11-28T11:55:57.983308+0000","last_unstale":"2023-11-28T11:55:57.984705+0000","last_undegraded":"2023-11-28T11:55:57.984705+0000","last_fullsized":"2023-11-28T11:55:57.984705+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:04:24.734981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990054+0000","last_change":"2023-11-28T11:55:57.591427+0000","last_active":"2023-11-28T11:55:57.990054+0000","last_peered":"2023-11-28T11:55:57.990054+0000","last_clean":"2023-11-28T11:55:57.990054+0000","last_became_active":"2023-11-28T11:55:57.589134+0000","last_became_peered":"2023-11-28T11:55:57.589134+0000","last_unstale":"2023-11-28T11:55:57.990054+0000","last_undegraded":"2023-11-28T11:55:57.990054+0000","last_fullsized":"2023-11-28T11:55:57.990054+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:37:53.077283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T11:55:58.965902+0000","last_change":"2023-11-28T11:55:57.977283+0000","last_active":"2023-11-28T11:55:58.965902+0000","last_peered":"2023-11-28T11:55:58.965902+0000","last_clean":"2023-11-28T11:55:58.965902+0000","last_became_active":"2023-11-28T11:55:57.976938+0000","last_became_peered":"2023-11-28T11:55:57.976938+0000","last_unstale":"2023-11-28T11:55:58.965902+0000","last_undegraded":"2023-11-28T11:55:58.965902+0000","last_fullsized":"2023-11-28T11:55:58.965902+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:35.555644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.958661+0000","last_change":"2023-11-28T11:55:57.579320+0000","last_active":"2023-11-28T11:55:57.958661+0000","last_peered":"2023-11-28T11:55:57.958661+0000","last_clean":"2023-11-28T11:55:57.958661+0000","last_became_active":"2023-11-28T11:55:57.579013+0000","last_became_peered":"2023-11-28T11:55:57.579013+0000","last_unstale":"2023-11-28T11:55:57.958661+0000","last_undegraded":"2023-11-28T11:55:57.958661+0000","last_fullsized":"2023-11-28T11:55:57.958661+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:34:08.980448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983826+0000","last_change":"2023-11-28T11:55:57.974370+0000","last_active":"2023-11-28T11:55:57.983826+0000","last_peered":"2023-11-28T11:55:57.983826+0000","last_clean":"2023-11-28T11:55:57.983826+0000","last_became_active":"2023-11-28T11:55:57.973845+0000","last_became_peered":"2023-11-28T11:55:57.973845+0000","last_unstale":"2023-11-28T11:55:57.983826+0000","last_undegraded":"2023-11-28T11:55:57.983826+0000","last_fullsized":"2023-11-28T11:55:57.983826+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:48:45.775683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.962943+0000","last_change":"2023-11-28T11:55:57.583964+0000","last_active":"2023-11-28T11:55:57.962943+0000","last_peered":"2023-11-28T11:55:57.962943+0000","last_clean":"2023-11-28T11:55:57.962943+0000","last_became_active":"2023-11-28T11:55:57.583618+0000","last_became_peered":"2023-11-28T11:55:57.583618+0000","last_unstale":"2023-11-28T11:55:57.962943+0000","last_undegraded":"2023-11-28T11:55:57.962943+0000","last_fullsized":"2023-11-28T11:55:57.962943+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:13.612869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.977758+0000","last_change":"2023-11-28T11:55:57.973858+0000","last_active":"2023-11-28T11:55:57.977758+0000","last_peered":"2023-11-28T11:55:57.977758+0000","last_clean":"2023-11-28T11:55:57.977758+0000","last_became_active":"2023-11-28T11:55:57.973524+0000","last_became_peered":"2023-11-28T11:55:57.973524+0000","last_unstale":"2023-11-28T11:55:57.977758+0000","last_undegraded":"2023-11-28T11:55:57.977758+0000","last_fullsized":"2023-11-28T11:55:57.977758+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:10:33.329953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.974127+0000","last_change":"2023-11-28T11:55:57.591265+0000","last_active":"2023-11-28T11:55:57.974127+0000","last_peered":"2023-11-28T11:55:57.974127+0000","last_clean":"2023-11-28T11:55:57.974127+0000","last_became_active":"2023-11-28T11:55:57.590928+0000","last_became_peered":"2023-11-28T11:55:57.590928+0000","last_unstale":"2023-11-28T11:55:57.974127+0000","last_undegraded":"2023-11-28T11:55:57.974127+0000","last_fullsized":"2023-11-28T11:55:57.974127+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:00:47.804731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992567+0000","last_change":"2023-11-28T11:55:57.984850+0000","last_active":"2023-11-28T11:55:57.992567+0000","last_peered":"2023-11-28T11:55:57.992567+0000","last_clean":"2023-11-28T11:55:57.992567+0000","last_became_active":"2023-11-28T11:55:57.984504+0000","last_became_peered":"2023-11-28T11:55:57.984504+0000","last_unstale":"2023-11-28T11:55:57.992567+0000","last_undegraded":"2023-11-28T11:55:57.992567+0000","last_fullsized":"2023-11-28T11:55:57.992567+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:18:02.126425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.966304+0000","last_change":"2023-11-28T11:55:57.587436+0000","last_active":"2023-11-28T11:55:57.966304+0000","last_peered":"2023-11-28T11:55:57.966304+0000","last_clean":"2023-11-28T11:55:57.966304+0000","last_became_active":"2023-11-28T11:55:57.587152+0000","last_became_peered":"2023-11-28T11:55:57.587152+0000","last_unstale":"2023-11-28T11:55:57.966304+0000","last_undegraded":"2023-11-28T11:55:57.966304+0000","last_fullsized":"2023-11-28T11:55:57.966304+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:17:49.646408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.980521+0000","last_change":"2023-11-28T11:55:57.969081+0000","last_active":"2023-11-28T11:55:57.980521+0000","last_peered":"2023-11-28T11:55:57.980521+0000","last_clean":"2023-11-28T11:55:57.980521+0000","last_became_active":"2023-11-28T11:55:57.968829+0000","last_became_peered":"2023-11-28T11:55:57.968829+0000","last_unstale":"2023-11-28T11:55:57.980521+0000","last_undegraded":"2023-11-28T11:55:57.980521+0000","last_fullsized":"2023-11-28T11:55:57.980521+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:59:23.112088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990692+0000","last_change":"2023-11-28T11:55:57.589153+0000","last_active":"2023-11-28T11:55:57.990692+0000","last_peered":"2023-11-28T11:55:57.990692+0000","last_clean":"2023-11-28T11:55:57.990692+0000","last_became_active":"2023-11-28T11:55:57.588899+0000","last_became_peered":"2023-11-28T11:55:57.588899+0000","last_unstale":"2023-11-28T11:55:57.990692+0000","last_undegraded":"2023-11-28T11:55:57.990692+0000","last_fullsized":"2023-11-28T11:55:57.990692+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:17:00.617357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992837+0000","last_change":"2023-11-28T11:55:57.986753+0000","last_active":"2023-11-28T11:55:57.992837+0000","last_peered":"2023-11-28T11:55:57.992837+0000","last_clean":"2023-11-28T11:55:57.992837+0000","last_became_active":"2023-11-28T11:55:57.986489+0000","last_became_peered":"2023-11-28T11:55:57.986489+0000","last_unstale":"2023-11-28T11:55:57.992837+0000","last_undegraded":"2023-11-28T11:55:57.992837+0000","last_fullsized":"2023-11-28T11:55:57.992837+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:33:05.657951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990610+0000","last_change":"2023-11-28T11:55:57.588605+0000","last_active":"2023-11-28T11:55:57.990610+0000","last_peered":"2023-11-28T11:55:57.990610+0000","last_clean":"2023-11-28T11:55:57.990610+0000","last_became_active":"2023-11-28T11:55:57.588246+0000","last_became_peered":"2023-11-28T11:55:57.588246+0000","last_unstale":"2023-11-28T11:55:57.990610+0000","last_undegraded":"2023-11-28T11:55:57.990610+0000","last_fullsized":"2023-11-28T11:55:57.990610+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:22.016981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.979803+0000","last_change":"2023-11-28T11:55:57.975104+0000","last_active":"2023-11-28T11:55:57.979803+0000","last_peered":"2023-11-28T11:55:57.979803+0000","last_clean":"2023-11-28T11:55:57.979803+0000","last_became_active":"2023-11-28T11:55:57.973277+0000","last_became_peered":"2023-11-28T11:55:57.973277+0000","last_unstale":"2023-11-28T11:55:57.979803+0000","last_undegraded":"2023-11-28T11:55:57.979803+0000","last_fullsized":"2023-11-28T11:55:57.979803+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:52:11.998343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.984604+0000","last_change":"2023-11-28T11:55:57.587428+0000","last_active":"2023-11-28T11:55:57.984604+0000","last_peered":"2023-11-28T11:55:57.984604+0000","last_clean":"2023-11-28T11:55:57.984604+0000","last_became_active":"2023-11-28T11:55:57.587140+0000","last_became_peered":"2023-11-28T11:55:57.587140+0000","last_unstale":"2023-11-28T11:55:57.984604+0000","last_undegraded":"2023-11-28T11:55:57.984604+0000","last_fullsized":"2023-11-28T11:55:57.984604+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:13.612869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992649+0000","last_change":"2023-11-28T11:55:57.985595+0000","last_active":"2023-11-28T11:55:57.992649+0000","last_peered":"2023-11-28T11:55:57.992649+0000","last_clean":"2023-11-28T11:55:57.992649+0000","last_became_active":"2023-11-28T11:55:57.984808+0000","last_became_peered":"2023-11-28T11:55:57.984808+0000","last_unstale":"2023-11-28T11:55:57.992649+0000","last_undegraded":"2023-11-28T11:55:57.992649+0000","last_fullsized":"2023-11-28T11:55:57.992649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:14:25.093644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T11:55:58.966135+0000","last_change":"2023-11-28T11:55:57.579618+0000","last_active":"2023-11-28T11:55:58.966135+0000","last_peered":"2023-11-28T11:55:58.966135+0000","last_clean":"2023-11-28T11:55:58.966135+0000","last_became_active":"2023-11-28T11:55:57.579318+0000","last_became_peered":"2023-11-28T11:55:57.579318+0000","last_unstale":"2023-11-28T11:55:58.966135+0000","last_undegraded":"2023-11-28T11:55:58.966135+0000","last_fullsized":"2023-11-28T11:55:58.966135+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:37.059723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.978622+0000","last_change":"2023-11-28T11:55:57.977373+0000","last_active":"2023-11-28T11:55:57.978622+0000","last_peered":"2023-11-28T11:55:57.978622+0000","last_clean":"2023-11-28T11:55:57.978622+0000","last_became_active":"2023-11-28T11:55:57.977070+0000","last_became_peered":"2023-11-28T11:55:57.977070+0000","last_unstale":"2023-11-28T11:55:57.978622+0000","last_undegraded":"2023-11-28T11:55:57.978622+0000","last_fullsized":"2023-11-28T11:55:57.978622+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:09:42.078272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.958815+0000","last_change":"2023-11-28T11:55:57.580183+0000","last_active":"2023-11-28T11:55:57.958815+0000","last_peered":"2023-11-28T11:55:57.958815+0000","last_clean":"2023-11-28T11:55:57.958815+0000","last_became_active":"2023-11-28T11:55:57.579928+0000","last_became_peered":"2023-11-28T11:55:57.579928+0000","last_unstale":"2023-11-28T11:55:57.958815+0000","last_undegraded":"2023-11-28T11:55:57.958815+0000","last_fullsized":"2023-11-28T11:55:57.958815+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:42:02.333732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992852+0000","last_change":"2023-11-28T11:55:57.987138+0000","last_active":"2023-11-28T11:55:57.992852+0000","last_peered":"2023-11-28T11:55:57.992852+0000","last_clean":"2023-11-28T11:55:57.992852+0000","last_became_active":"2023-11-28T11:55:57.985477+0000","last_became_peered":"2023-11-28T11:55:57.985477+0000","last_unstale":"2023-11-28T11:55:57.992852+0000","last_undegraded":"2023-11-28T11:55:57.992852+0000","last_fullsized":"2023-11-28T11:55:57.992852+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:17:50.658731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.991006+0000","last_change":"2023-11-28T11:55:57.589900+0000","last_active":"2023-11-28T11:55:57.991006+0000","last_peered":"2023-11-28T11:55:57.991006+0000","last_clean":"2023-11-28T11:55:57.991006+0000","last_became_active":"2023-11-28T11:55:57.589588+0000","last_became_peered":"2023-11-28T11:55:57.589588+0000","last_unstale":"2023-11-28T11:55:57.991006+0000","last_undegraded":"2023-11-28T11:55:57.991006+0000","last_fullsized":"2023-11-28T11:55:57.991006+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:53:42.859363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.975930+0000","last_change":"2023-11-28T11:55:57.966444+0000","last_active":"2023-11-28T11:55:57.975930+0000","last_peered":"2023-11-28T11:55:57.975930+0000","last_clean":"2023-11-28T11:55:57.975930+0000","last_became_active":"2023-11-28T11:55:57.966177+0000","last_became_peered":"2023-11-28T11:55:57.966177+0000","last_unstale":"2023-11-28T11:55:57.975930+0000","last_undegraded":"2023-11-28T11:55:57.975930+0000","last_fullsized":"2023-11-28T11:55:57.975930+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:57.203195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.980732+0000","last_change":"2023-11-28T11:55:57.582824+0000","last_active":"2023-11-28T11:55:57.980732+0000","last_peered":"2023-11-28T11:55:57.980732+0000","last_clean":"2023-11-28T11:55:57.980732+0000","last_became_active":"2023-11-28T11:55:57.582521+0000","last_became_peered":"2023-11-28T11:55:57.582521+0000","last_unstale":"2023-11-28T11:55:57.980732+0000","last_undegraded":"2023-11-28T11:55:57.980732+0000","last_fullsized":"2023-11-28T11:55:57.980732+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T11:57:32.994182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990152+0000","last_change":"2023-11-28T11:55:57.984688+0000","last_active":"2023-11-28T11:55:57.990152+0000","last_peered":"2023-11-28T11:55:57.990152+0000","last_clean":"2023-11-28T11:55:57.990152+0000","last_became_active":"2023-11-28T11:55:57.984372+0000","last_became_peered":"2023-11-28T11:55:57.984372+0000","last_unstale":"2023-11-28T11:55:57.990152+0000","last_undegraded":"2023-11-28T11:55:57.990152+0000","last_fullsized":"2023-11-28T11:55:57.990152+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:16:50.006966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.962702+0000","last_change":"2023-11-28T11:55:57.589281+0000","last_active":"2023-11-28T11:55:57.962702+0000","last_peered":"2023-11-28T11:55:57.962702+0000","last_clean":"2023-11-28T11:55:57.962702+0000","last_became_active":"2023-11-28T11:55:57.588782+0000","last_became_peered":"2023-11-28T11:55:57.588782+0000","last_unstale":"2023-11-28T11:55:57.962702+0000","last_undegraded":"2023-11-28T11:55:57.962702+0000","last_fullsized":"2023-11-28T11:55:57.962702+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:21.923714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983133+0000","last_change":"2023-11-28T11:55:57.974706+0000","last_active":"2023-11-28T11:55:57.983133+0000","last_peered":"2023-11-28T11:55:57.983133+0000","last_clean":"2023-11-28T11:55:57.983133+0000","last_became_active":"2023-11-28T11:55:57.974492+0000","last_became_peered":"2023-11-28T11:55:57.974492+0000","last_unstale":"2023-11-28T11:55:57.983133+0000","last_undegraded":"2023-11-28T11:55:57.983133+0000","last_fullsized":"2023-11-28T11:55:57.983133+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:44:16.253501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T11:55:58.966088+0000","last_change":"2023-11-28T11:55:57.579378+0000","last_active":"2023-11-28T11:55:58.966088+0000","last_peered":"2023-11-28T11:55:58.966088+0000","last_clean":"2023-11-28T11:55:58.966088+0000","last_became_active":"2023-11-28T11:55:57.579085+0000","last_became_peered":"2023-11-28T11:55:57.579085+0000","last_unstale":"2023-11-28T11:55:58.966088+0000","last_undegraded":"2023-11-28T11:55:58.966088+0000","last_fullsized":"2023-11-28T11:55:58.966088+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:05.501938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.988004+0000","last_change":"2023-11-28T11:55:57.981226+0000","last_active":"2023-11-28T11:55:57.988004+0000","last_peered":"2023-11-28T11:55:57.988004+0000","last_clean":"2023-11-28T11:55:57.988004+0000","last_became_active":"2023-11-28T11:55:57.975468+0000","last_became_peered":"2023-11-28T11:55:57.975468+0000","last_unstale":"2023-11-28T11:55:57.988004+0000","last_undegraded":"2023-11-28T11:55:57.988004+0000","last_fullsized":"2023-11-28T11:55:57.988004+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:20:11.533358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.958791+0000","last_change":"2023-11-28T11:55:57.579352+0000","last_active":"2023-11-28T11:55:57.958791+0000","last_peered":"2023-11-28T11:55:57.958791+0000","last_clean":"2023-11-28T11:55:57.958791+0000","last_became_active":"2023-11-28T11:55:57.579106+0000","last_became_peered":"2023-11-28T11:55:57.579106+0000","last_unstale":"2023-11-28T11:55:57.958791+0000","last_undegraded":"2023-11-28T11:55:57.958791+0000","last_fullsized":"2023-11-28T11:55:57.958791+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:06:25.989783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983799+0000","last_change":"2023-11-28T11:55:57.977276+0000","last_active":"2023-11-28T11:55:57.983799+0000","last_peered":"2023-11-28T11:55:57.983799+0000","last_clean":"2023-11-28T11:55:57.983799+0000","last_became_active":"2023-11-28T11:55:57.977013+0000","last_became_peered":"2023-11-28T11:55:57.977013+0000","last_unstale":"2023-11-28T11:55:57.983799+0000","last_undegraded":"2023-11-28T11:55:57.983799+0000","last_fullsized":"2023-11-28T11:55:57.983799+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:26:57.416314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.955052+0000","last_change":"2023-11-28T11:55:57.578505+0000","last_active":"2023-11-28T11:55:57.955052+0000","last_peered":"2023-11-28T11:55:57.955052+0000","last_clean":"2023-11-28T11:55:57.955052+0000","last_became_active":"2023-11-28T11:55:57.578238+0000","last_became_peered":"2023-11-28T11:55:57.578238+0000","last_unstale":"2023-11-28T11:55:57.955052+0000","last_undegraded":"2023-11-28T11:55:57.955052+0000","last_fullsized":"2023-11-28T11:55:57.955052+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:21:22.249810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992703+0000","last_change":"2023-11-28T11:55:57.985804+0000","last_active":"2023-11-28T11:55:57.992703+0000","last_peered":"2023-11-28T11:55:57.992703+0000","last_clean":"2023-11-28T11:55:57.992703+0000","last_became_active":"2023-11-28T11:55:57.985139+0000","last_became_peered":"2023-11-28T11:55:57.985139+0000","last_unstale":"2023-11-28T11:55:57.992703+0000","last_undegraded":"2023-11-28T11:55:57.992703+0000","last_fullsized":"2023-11-28T11:55:57.992703+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:29:42.504299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.963152+0000","last_change":"2023-11-28T11:55:57.590600+0000","last_active":"2023-11-28T11:55:57.963152+0000","last_peered":"2023-11-28T11:55:57.963152+0000","last_clean":"2023-11-28T11:55:57.963152+0000","last_became_active":"2023-11-28T11:55:57.590365+0000","last_became_peered":"2023-11-28T11:55:57.590365+0000","last_unstale":"2023-11-28T11:55:57.963152+0000","last_undegraded":"2023-11-28T11:55:57.963152+0000","last_fullsized":"2023-11-28T11:55:57.963152+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:22.454676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.980477+0000","last_change":"2023-11-28T11:55:57.967156+0000","last_active":"2023-11-28T11:55:57.980477+0000","last_peered":"2023-11-28T11:55:57.980477+0000","last_clean":"2023-11-28T11:55:57.980477+0000","last_became_active":"2023-11-28T11:55:57.966196+0000","last_became_peered":"2023-11-28T11:55:57.966196+0000","last_unstale":"2023-11-28T11:55:57.980477+0000","last_undegraded":"2023-11-28T11:55:57.980477+0000","last_fullsized":"2023-11-28T11:55:57.980477+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:45:54.920171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.954849+0000","last_change":"2023-11-28T11:55:57.589456+0000","last_active":"2023-11-28T11:55:57.954849+0000","last_peered":"2023-11-28T11:55:57.954849+0000","last_clean":"2023-11-28T11:55:57.954849+0000","last_became_active":"2023-11-28T11:55:57.589192+0000","last_became_peered":"2023-11-28T11:55:57.589192+0000","last_unstale":"2023-11-28T11:55:57.954849+0000","last_undegraded":"2023-11-28T11:55:57.954849+0000","last_fullsized":"2023-11-28T11:55:57.954849+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:28:25.479911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983844+0000","last_change":"2023-11-28T11:55:57.974186+0000","last_active":"2023-11-28T11:55:57.983844+0000","last_peered":"2023-11-28T11:55:57.983844+0000","last_clean":"2023-11-28T11:55:57.983844+0000","last_became_active":"2023-11-28T11:55:57.973418+0000","last_became_peered":"2023-11-28T11:55:57.973418+0000","last_unstale":"2023-11-28T11:55:57.983844+0000","last_undegraded":"2023-11-28T11:55:57.983844+0000","last_fullsized":"2023-11-28T11:55:57.983844+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:57:36.314516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.966110+0000","last_change":"2023-11-28T11:55:57.581810+0000","last_active":"2023-11-28T11:55:57.966110+0000","last_peered":"2023-11-28T11:55:57.966110+0000","last_clean":"2023-11-28T11:55:57.966110+0000","last_became_active":"2023-11-28T11:55:57.581481+0000","last_became_peered":"2023-11-28T11:55:57.581481+0000","last_unstale":"2023-11-28T11:55:57.966110+0000","last_undegraded":"2023-11-28T11:55:57.966110+0000","last_fullsized":"2023-11-28T11:55:57.966110+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:33:04.645628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.981617+0000","last_change":"2023-11-28T11:55:57.976022+0000","last_active":"2023-11-28T11:55:57.981617+0000","last_peered":"2023-11-28T11:55:57.981617+0000","last_clean":"2023-11-28T11:55:57.981617+0000","last_became_active":"2023-11-28T11:55:57.975684+0000","last_became_peered":"2023-11-28T11:55:57.975684+0000","last_unstale":"2023-11-28T11:55:57.981617+0000","last_undegraded":"2023-11-28T11:55:57.981617+0000","last_fullsized":"2023-11-28T11:55:57.981617+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:05:10.878530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990145+0000","last_change":"2023-11-28T11:55:57.590888+0000","last_active":"2023-11-28T11:55:57.990145+0000","last_peered":"2023-11-28T11:55:57.990145+0000","last_clean":"2023-11-28T11:55:57.990145+0000","last_became_active":"2023-11-28T11:55:57.589178+0000","last_became_peered":"2023-11-28T11:55:57.589178+0000","last_unstale":"2023-11-28T11:55:57.990145+0000","last_undegraded":"2023-11-28T11:55:57.990145+0000","last_fullsized":"2023-11-28T11:55:57.990145+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:56.190872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.958147+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:55:57.958147+0000","last_peered":"2023-11-28T11:55:57.958147+0000","last_clean":"2023-11-28T11:55:57.958147+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:55:57.958147+0000","last_undegraded":"2023-11-28T11:55:57.958147+0000","last_fullsized":"2023-11-28T11:55:57.958147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992546+0000","last_change":"2023-11-28T11:55:57.984806+0000","last_active":"2023-11-28T11:55:57.992546+0000","last_peered":"2023-11-28T11:55:57.992546+0000","last_clean":"2023-11-28T11:55:57.992546+0000","last_became_active":"2023-11-28T11:55:57.984131+0000","last_became_peered":"2023-11-28T11:55:57.984131+0000","last_unstale":"2023-11-28T11:55:57.992546+0000","last_undegraded":"2023-11-28T11:55:57.992546+0000","last_fullsized":"2023-11-28T11:55:57.992546+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:14:32.291268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.984489+0000","last_change":"2023-11-28T11:55:57.586719+0000","last_active":"2023-11-28T11:55:57.984489+0000","last_peered":"2023-11-28T11:55:57.984489+0000","last_clean":"2023-11-28T11:55:57.984489+0000","last_became_active":"2023-11-28T11:55:57.586408+0000","last_became_peered":"2023-11-28T11:55:57.586408+0000","last_unstale":"2023-11-28T11:55:57.984489+0000","last_undegraded":"2023-11-28T11:55:57.984489+0000","last_fullsized":"2023-11-28T11:55:57.984489+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:14:24.081321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.958421+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:55:57.958421+0000","last_peered":"2023-11-28T11:55:57.958421+0000","last_clean":"2023-11-28T11:55:57.958421+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:55:57.958421+0000","last_undegraded":"2023-11-28T11:55:57.958421+0000","last_fullsized":"2023-11-28T11:55:57.958421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.992861+0000","last_change":"2023-11-28T11:55:57.986810+0000","last_active":"2023-11-28T11:55:57.992861+0000","last_peered":"2023-11-28T11:55:57.992861+0000","last_clean":"2023-11-28T11:55:57.992861+0000","last_became_active":"2023-11-28T11:55:57.986543+0000","last_became_peered":"2023-11-28T11:55:57.986543+0000","last_unstale":"2023-11-28T11:55:57.992861+0000","last_undegraded":"2023-11-28T11:55:57.992861+0000","last_fullsized":"2023-11-28T11:55:57.992861+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:23.797838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.962925+0000","last_change":"2023-11-28T11:55:57.588862+0000","last_active":"2023-11-28T11:55:57.962925+0000","last_peered":"2023-11-28T11:55:57.962925+0000","last_clean":"2023-11-28T11:55:57.962925+0000","last_became_active":"2023-11-28T11:55:57.588564+0000","last_became_peered":"2023-11-28T11:55:57.588564+0000","last_unstale":"2023-11-28T11:55:57.962925+0000","last_undegraded":"2023-11-28T11:55:57.962925+0000","last_fullsized":"2023-11-28T11:55:57.962925+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:31:30.653680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":46,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.573019+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:55:57.573019+0000","last_peered":"2023-11-28T11:55:57.573019+0000","last_clean":"2023-11-28T11:55:57.573019+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:55:57.573019+0000","last_undegraded":"2023-11-28T11:55:57.573019+0000","last_fullsized":"2023-11-28T11:55:57.573019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983614+0000","last_change":"2023-11-28T11:55:57.976374+0000","last_active":"2023-11-28T11:55:57.983614+0000","last_peered":"2023-11-28T11:55:57.983614+0000","last_clean":"2023-11-28T11:55:57.983614+0000","last_became_active":"2023-11-28T11:55:57.976102+0000","last_became_peered":"2023-11-28T11:55:57.976102+0000","last_unstale":"2023-11-28T11:55:57.983614+0000","last_undegraded":"2023-11-28T11:55:57.983614+0000","last_fullsized":"2023-11-28T11:55:57.983614+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:33:03.900201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990753+0000","last_change":"2023-11-28T11:55:57.580878+0000","last_active":"2023-11-28T11:55:57.990753+0000","last_peered":"2023-11-28T11:55:57.990753+0000","last_clean":"2023-11-28T11:55:57.990753+0000","last_became_active":"2023-11-28T11:55:57.580547+0000","last_became_peered":"2023-11-28T11:55:57.580547+0000","last_unstale":"2023-11-28T11:55:57.990753+0000","last_undegraded":"2023-11-28T11:55:57.990753+0000","last_fullsized":"2023-11-28T11:55:57.990753+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:40:14.659195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":42,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.579824+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:55:57.579824+0000","last_peered":"2023-11-28T11:55:57.579824+0000","last_clean":"2023-11-28T11:55:57.579824+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:55:57.579824+0000","last_undegraded":"2023-11-28T11:55:57.579824+0000","last_fullsized":"2023-11-28T11:55:57.579824+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.988040+0000","last_change":"2023-11-28T11:55:57.981314+0000","last_active":"2023-11-28T11:55:57.988040+0000","last_peered":"2023-11-28T11:55:57.988040+0000","last_clean":"2023-11-28T11:55:57.988040+0000","last_became_active":"2023-11-28T11:55:57.976041+0000","last_became_peered":"2023-11-28T11:55:57.976041+0000","last_unstale":"2023-11-28T11:55:57.988040+0000","last_undegraded":"2023-11-28T11:55:57.988040+0000","last_fullsized":"2023-11-28T11:55:57.988040+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:18:58.484183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.954977+0000","last_change":"2023-11-28T11:55:57.585936+0000","last_active":"2023-11-28T11:55:57.954977+0000","last_peered":"2023-11-28T11:55:57.954977+0000","last_clean":"2023-11-28T11:55:57.954977+0000","last_became_active":"2023-11-28T11:55:57.585574+0000","last_became_peered":"2023-11-28T11:55:57.585574+0000","last_unstale":"2023-11-28T11:55:57.954977+0000","last_undegraded":"2023-11-28T11:55:57.954977+0000","last_fullsized":"2023-11-28T11:55:57.954977+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:54:54.667949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":192,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.579507+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:55:57.579507+0000","last_peered":"2023-11-28T11:55:57.579507+0000","last_clean":"2023-11-28T11:55:57.579507+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:55:57.579507+0000","last_undegraded":"2023-11-28T11:55:57.579507+0000","last_fullsized":"2023-11-28T11:55:57.579507+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":41,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.563970+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:55:57.563970+0000","last_peered":"2023-11-28T11:55:57.563970+0000","last_clean":"2023-11-28T11:55:57.563970+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:55:57.563970+0000","last_undegraded":"2023-11-28T11:55:57.563970+0000","last_fullsized":"2023-11-28T11:55:57.563970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.979681+0000","last_change":"2023-11-28T11:55:57.973332+0000","last_active":"2023-11-28T11:55:57.979681+0000","last_peered":"2023-11-28T11:55:57.979681+0000","last_clean":"2023-11-28T11:55:57.979681+0000","last_became_active":"2023-11-28T11:55:57.973017+0000","last_became_peered":"2023-11-28T11:55:57.973017+0000","last_unstale":"2023-11-28T11:55:57.979681+0000","last_undegraded":"2023-11-28T11:55:57.979681+0000","last_fullsized":"2023-11-28T11:55:57.979681+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:23.466999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983665+0000","last_change":"2023-11-28T11:55:57.583444+0000","last_active":"2023-11-28T11:55:57.983665+0000","last_peered":"2023-11-28T11:55:57.983665+0000","last_clean":"2023-11-28T11:55:57.983665+0000","last_became_active":"2023-11-28T11:55:57.583153+0000","last_became_peered":"2023-11-28T11:55:57.583153+0000","last_unstale":"2023-11-28T11:55:57.983665+0000","last_undegraded":"2023-11-28T11:55:57.983665+0000","last_fullsized":"2023-11-28T11:55:57.983665+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:14:31.278945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":43,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.579540+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:55:57.579540+0000","last_peered":"2023-11-28T11:55:57.579540+0000","last_clean":"2023-11-28T11:55:57.579540+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:55:57.579540+0000","last_undegraded":"2023-11-28T11:55:57.579540+0000","last_fullsized":"2023-11-28T11:55:57.579540+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.990379+0000","last_change":"2023-11-28T11:55:57.986231+0000","last_active":"2023-11-28T11:55:57.990379+0000","last_peered":"2023-11-28T11:55:57.990379+0000","last_clean":"2023-11-28T11:55:57.990379+0000","last_became_active":"2023-11-28T11:55:57.985934+0000","last_became_peered":"2023-11-28T11:55:57.985934+0000","last_unstale":"2023-11-28T11:55:57.990379+0000","last_undegraded":"2023-11-28T11:55:57.990379+0000","last_fullsized":"2023-11-28T11:55:57.990379+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:48:45.775683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.958172+0000","last_change":"2023-11-28T11:55:57.582891+0000","last_active":"2023-11-28T11:55:57.958172+0000","last_peered":"2023-11-28T11:55:57.958172+0000","last_clean":"2023-11-28T11:55:57.958172+0000","last_became_active":"2023-11-28T11:55:57.582649+0000","last_became_peered":"2023-11-28T11:55:57.582649+0000","last_unstale":"2023-11-28T11:55:57.958172+0000","last_undegraded":"2023-11-28T11:55:57.958172+0000","last_fullsized":"2023-11-28T11:55:57.958172+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:16:36.618619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":48,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.570314+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:55:57.570314+0000","last_peered":"2023-11-28T11:55:57.570314+0000","last_clean":"2023-11-28T11:55:57.570314+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:55:57.570314+0000","last_undegraded":"2023-11-28T11:55:57.570314+0000","last_fullsized":"2023-11-28T11:55:57.570314+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.983960+0000","last_change":"2023-11-28T11:55:57.980015+0000","last_active":"2023-11-28T11:55:57.983960+0000","last_peered":"2023-11-28T11:55:57.983960+0000","last_clean":"2023-11-28T11:55:57.983960+0000","last_became_active":"2023-11-28T11:55:57.977136+0000","last_became_peered":"2023-11-28T11:55:57.977136+0000","last_unstale":"2023-11-28T11:55:57.983960+0000","last_undegraded":"2023-11-28T11:55:57.983960+0000","last_fullsized":"2023-11-28T11:55:57.983960+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:57.547021+0000","last_clean_scrub_stamp":"2023-11-28T11:55:57.547021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:59.707185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-28T11:55:58.966348+0000","last_change":"2023-11-28T11:55:57.571227+0000","last_active":"2023-11-28T11:55:58.966348+0000","last_peered":"2023-11-28T11:55:58.966348+0000","last_clean":"2023-11-28T11:55:58.966348+0000","last_became_active":"2023-11-28T11:55:57.570940+0000","last_became_peered":"2023-11-28T11:55:57.570940+0000","last_unstale":"2023-11-28T11:55:58.966348+0000","last_undegraded":"2023-11-28T11:55:58.966348+0000","last_fullsized":"2023-11-28T11:55:58.966348+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:55:56.534697+0000","last_clean_scrub_stamp":"2023-11-28T11:55:56.534697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:59:22.099765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T11:55:57.579646+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:55:57.579646+0000","last_peered":"2023-11-28T11:55:57.579646+0000","last_clean":"2023-11-28T11:55:57.579646+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:55:57.579646+0000","last_undegraded":"2023-11-28T11:55:57.579646+0000","last_fullsized":"2023-11-28T11:55:57.579646+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10296,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361544,"statfs":{"total":96636764160,"available":96626221056,"internally_reserved":0,"allocated":1228800,"data_stored":881459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.90900000000000003,"15min":0.91800000000000004},"min":{"1min":0.54300000000000004,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.268,"5min":1.413,"15min":1.413},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96899999999999997,"15min":0.96999999999999997},"min":{"1min":0.59799999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.1699999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.84199999999999997,"15min":0.83299999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81599999999999995,"15min":0.81999999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.78600000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81599999999999995,"15min":0.80800000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.91900000000000004,"15min":0.92100000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1140000000000001,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.22}]},{"osd":3,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.86199999999999999,"15min":0.85299999999999998},"min":{"1min":0.65200000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":1.615},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0009999999999999,"15min":1.0089999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1919999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.665}]},{"osd":4,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.86499999999999999,"15min":0.871},"min":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.109,"5min":1.2,"15min":1.2},"last":1.264},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.012,"15min":1.018},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3480000000000001,"5min":1.621,"15min":1.621},"last":1.3}]},{"osd":5,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.67400000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.2589999999999999,"5min":1.387,"15min":1.387},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.081,"15min":1.091},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.329,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.4630000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0880000000000001,"15min":1.0940000000000001},"min":{"1min":0.84099999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.746},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.111,"15min":1.1140000000000001},"min":{"1min":0.83199999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4119999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.7110000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9132,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362708,"statfs":{"total":96636764160,"available":96627412992,"internally_reserved":0,"allocated":626688,"data_stored":290931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.89700000000000002,"15min":0.90600000000000003},"min":{"1min":0.61899999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3440000000000001,"5min":1.625,"15min":1.625},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.095,"5min":1.498,"15min":1.498},"last":0.54800000000000004}]},{"osd":1,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.84999999999999998,"15min":0.85999999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.099,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.012},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.97699999999999998,"15min":0.98799999999999999},"min":{"1min":0.56100000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1419999999999999,"5min":1.444,"15min":1.444},"last":0.88900000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95999999999999996,"15min":0.96299999999999997},"min":{"1min":0.64300000000000002,"5min":0.62,"15min":0.62},"max":{"1min":1.196,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.89200000000000002,"15min":0.89900000000000002},"min":{"1min":0.59399999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.107,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89600000000000002,"15min":0.88500000000000001},"min":{"1min":0.72499999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.86099999999999999,"15min":0.85599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.121,"5min":1.161,"15min":1.161},"last":0.66900000000000004}]},{"osd":4,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.94599999999999995,"15min":0.95299999999999996},"min":{"1min":0.59499999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.272,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.745},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0029999999999999,"15min":1.01},"min":{"1min":0.65100000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.248,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.97999999999999998}]},{"osd":5,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.0089999999999999,"15min":1.0269999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1970000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.131,"15min":1.141},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4199999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.0489999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.079,"15min":1.0840000000000001},"min":{"1min":0.67800000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.206,"5min":1.575,"15min":1.575},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0449999999999999,"15min":1.0549999999999999},"min":{"1min":0.73699999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1910000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.91800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9208,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362632,"statfs":{"total":96636764160,"available":96627335168,"internally_reserved":0,"allocated":638976,"data_stored":292553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1259999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85499999999999998,"15min":0.85899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.165,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.157}]},{"osd":1,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.64500000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0620000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90300000000000002,"15min":0.91700000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1240000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.0529999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.84399999999999997,"15min":0.83599999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":1.012},{"interface":"front","average":{"1min":0.872,"5min":0.83799999999999997,"15min":0.83199999999999996},"min":{"1min":0.66500000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1259999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.129}]},{"osd":3,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1180000000000001,"5min":1.212,"15min":1.212},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.98399999999999999,"15min":0.98799999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.319,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.79000000000000004}]},{"osd":4,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.179,"5min":1.968,"15min":1.968},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.0309999999999999,"15min":1.0429999999999999},"min":{"1min":0.67800000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1259999999999999,"5min":1.581,"15min":1.581},"last":1.2609999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0069999999999999,"15min":1.01},"min":{"1min":0.64000000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.268,"5min":1.482,"15min":1.482},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.002,"15min":1.004},"min":{"1min":0.72599999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2210000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.2130000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0680000000000001,"15min":1.0740000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1819999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.097,"15min":1.0960000000000001},"min":{"1min":0.81100000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.234}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9340,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362500,"statfs":{"total":96636764160,"available":96627200000,"internally_reserved":0,"allocated":643072,"data_stored":293465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.84099999999999997,"15min":0.84499999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.83899999999999997,"15min":0.84599999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.98699999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85899999999999999,"15min":0.86099999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.93000000000000005,"15min":0.94599999999999995},"min":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.081,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.81100000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.67700000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.167,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.96299999999999997,"15min":0.97599999999999998},"min":{"1min":0.57199999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2090000000000001,"5min":1.528,"15min":1.528},"last":0.69799999999999995}]},{"osd":3,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.93400000000000005,"15min":0.94099999999999995},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.2609999999999999,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.052,"15min":1.0680000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.165,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.054}]},{"osd":5,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.98899999999999999,"15min":0.99299999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3149999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.034,"15min":1.046},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.208,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.161}]},{"osd":6,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.073,"15min":1.0860000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.294,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.151,"15min":1.159},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3799999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.085}]},{"osd":7,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1379999999999999,"15min":1.159},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2549999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.226},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1870000000000001,"15min":1.198},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.331,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.2}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9268,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362572,"statfs":{"total":96636764160,"available":96627273728,"internally_reserved":0,"allocated":634880,"data_stored":290987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.39000000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.095,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69699999999999995,"15min":0.70099999999999996},"min":{"1min":0.46500000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.91600000000000004,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.63300000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.45400000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.96799999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.746,"15min":0.751},"min":{"1min":0.499,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0629999999999999,"5min":1.764,"15min":1.764},"last":0.77500000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.48699999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.069,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.84899999999999998,"15min":0.86699999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96299999999999997,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.55600000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0229999999999999,"15min":1.0269999999999999},"min":{"1min":0.72899999999999998,"5min":0.505,"15min":0.505},"max":{"1min":1.518,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.751},{"interface":"front","average":{"1min":1.044,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.80900000000000005,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.6559999999999999,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":0.73799999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0820000000000001,"15min":1.1000000000000001},"min":{"1min":0.82399999999999995,"5min":0.626,"15min":0.626},"max":{"1min":1.4239999999999999,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.095},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.139,"15min":1.151},"min":{"1min":0.73299999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.419,"5min":2.266,"15min":2.266},"last":1.1259999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1060000000000001,"15min":1.1160000000000001},"min":{"1min":0.72799999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.5209999999999999,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.026,"5min":1.1000000000000001,"15min":1.1120000000000001},"min":{"1min":0.74299999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3220000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.0349999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.147,"15min":1.1579999999999999},"min":{"1min":0.78300000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5840000000000001,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1699999999999999,"15min":1.173},"min":{"1min":0.95699999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.7410000000000001,"5min":2.117,"15min":2.117},"last":1.0660000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13172,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":12544,"kb_avail":94358668,"statfs":{"total":96636764160,"available":96623276032,"internally_reserved":0,"allocated":634880,"data_stored":290987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12845056},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.48499999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81000000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76200000000000001,"15min":0.77000000000000002},"min":{"1min":0.51800000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0209999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.85899999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.442,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.98999999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.85899999999999999,"15min":0.871},"min":{"1min":0.51400000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.268,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.97099999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0920000000000001,"5min":1.254,"15min":1.254},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.84299999999999997,"15min":0.82799999999999996},"min":{"1min":0.66900000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2110000000000001,"5min":1.968,"15min":1.968},"last":1.123}]},{"osd":4,"last update":"Tue Nov 28 11:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0429999999999999,"15min":1.048},"min":{"1min":0.66700000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.234,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.222},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0649999999999999,"15min":1.0820000000000001},"min":{"1min":0.80000000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.4410000000000001,"5min":2.181,"15min":2.181},"last":1.0609999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.98999999999999999,"15min":0.98499999999999999},"min":{"1min":0.75600000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.3819999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1379999999999999,"15min":1.143},"min":{"1min":0.84499999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.405,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.3320000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1739999999999999,"15min":1.1879999999999999},"min":{"1min":0.81799999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.538,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.026},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1439999999999999,"15min":1.1479999999999999},"min":{"1min":0.82499999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.391,"5min":1.867,"15min":1.867},"last":1.087}]},{"osd":7,"last update":"Tue Nov 28 11:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.179,"15min":1.1890000000000001},"min":{"1min":0.77500000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.581,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1499999999999999,"15min":1.149},"min":{"1min":0.92200000000000004,"5min":0.748,"15min":0.748},"max":{"1min":1.4630000000000001,"5min":1.675,"15min":1.675},"last":1.194}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14328,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":13120,"kb_avail":94357512,"statfs":{"total":96636764160,"available":96622092288,"internally_reserved":0,"allocated":1228800,"data_stored":882375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13434880},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.90400000000000003,"5min":1.387,"15min":1.387},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69099999999999995,"15min":0.68500000000000005},"min":{"1min":0.46100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.57099999999999995}]},{"osd":2,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.46400000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79000000000000004,"15min":0.79200000000000004},"min":{"1min":0.46000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.1439999999999999,"5min":1.175,"15min":1.175},"last":0.83099999999999996}]},{"osd":3,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.85999999999999999,"15min":0.87},"min":{"1min":0.52900000000000003,"5min":0.317,"15min":0.317},"max":{"1min":1.1100000000000001,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.51100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.78700000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.91500000000000004,"15min":0.91000000000000003},"min":{"1min":0.73399999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2689999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":1,"5min":1.0669999999999999,"15min":1.0780000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3740000000000001,"5min":2.29,"15min":2.29},"last":1.127}]},{"osd":5,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.018,"15min":1.0189999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.998,"5min":1.038,"15min":1.044},"min":{"1min":0.79100000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1379999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.2030000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0609999999999999,"15min":1.0549999999999999},"min":{"1min":0.72099999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.87},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.075,"15min":1.081},"min":{"1min":0.88800000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3460000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":1.069}]},{"osd":7,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.2,"15min":1.2110000000000001},"min":{"1min":0.90100000000000002,"5min":0.747,"15min":0.747},"max":{"1min":1.5249999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1080000000000001,"15min":1.1040000000000001},"min":{"1min":0.81499999999999995,"5min":0.629,"15min":0.629},"max":{"1min":1.635,"5min":1.647,"15min":1.647},"last":1.159}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13440,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":12800,"kb_avail":94358400,"statfs":{"total":96636764160,"available":96623001600,"internally_reserved":0,"allocated":647168,"data_stored":294031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13107200},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.66800000000000004,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95299999999999996,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.016,"5min":1.091,"15min":1.091},"last":0.73399999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90500000000000003,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.45500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.91600000000000004,"15min":0.92700000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0680000000000001,"5min":1.96,"15min":1.96},"last":0.86299999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.72499999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.996,"5min":1.1000000000000001,"15min":1.1180000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.2010000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.94399999999999995}]},{"osd":5,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0640000000000001,"15min":1.0720000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2509999999999999,"5min":1.649,"15min":1.649},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.0029999999999999,"15min":1.0069999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2110000000000001,"5min":1.339,"15min":1.339},"last":0.89500000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.177,"15min":1.1899999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.536,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.133,"15min":1.139},"min":{"1min":0.80400000000000005,"5min":0.749,"15min":0.749},"max":{"1min":1.2909999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.161}]},{"osd":7,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.155,"15min":1.161},"min":{"1min":0.84499999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.3169999999999999,"5min":1.486,"15min":1.486},"last":1.042},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0800000000000001,"15min":1.0780000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.2470000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.0880000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:56:02.360 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T11:56:02.361 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-28T11:56:02.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f368bfff700 1 Processor -- start 2023-11-28T11:56:02.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f368bfff700 1 -- start start 2023-11-28T11:56:02.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f368bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f368c0c8a50 0x7f368c06d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f368bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f368c0c8eb0 0x7f368c06d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f368bfff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368c06bfb0 con 0x7f368c0ad840 2023-11-28T11:56:02.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f368bfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368c06c290 con 0x7f368c0c8a50 2023-11-28T11:56:02.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f368bfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368c06c570 con 0x7f368c0c8eb0 2023-11-28T11:56:02.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f368a7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f368c0c8a50 0x7f368c06d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f368b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f368c0c8eb0 0x7f368c06d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f368a7fc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f368c0c8a50 0x7f368c06d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58986/0 (socket says 172.21.15.50:58986) 2023-11-28T11:56:02.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f368affd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f368c0ad840 0x7f368c0cdb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:35960/0 (socket says 172.21.15.50:35960) 2023-11-28T11:56:02.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f368a7fc700 1 -- 172.21.15.50:0/885907386 learned_addr learned my addr 172.21.15.50:0/885907386 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f368a7fc700 1 -- 172.21.15.50:0/885907386 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f368c0c8eb0 msgr2=0x7f368c06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f368a7fc700 1 --2- 172.21.15.50:0/885907386 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f368c0c8eb0 0x7f368c06d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f3689ffb700 1 -- 172.21.15.50:0/885907386 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2867050389 0 0) 0x7f368c06bfb0 con 0x7f368c0ad840 2023-11-28T11:56:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f368a7fc700 1 -- 172.21.15.50:0/885907386 >> v1:172.21.15.192:6789/0 conn(0x7f368c0ad840 legacy=0x7f368c0cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f368a7fc700 1 -- 172.21.15.50:0/885907386 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c06c850 con 0x7f368c0c8a50 2023-11-28T11:56:02.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f368a7fc700 1 --2- 172.21.15.50:0/885907386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f368c0c8a50 0x7f368c06d050 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f368000aab0 tx=0x7f368000adc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8079c679747ae7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:02.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f3689ffb700 1 -- 172.21.15.50:0/885907386 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368000cb70 con 0x7f368c0c8a50 2023-11-28T11:56:02.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f3689ffb700 1 -- 172.21.15.50:0/885907386 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368000ccd0 con 0x7f368c0c8a50 2023-11-28T11:56:02.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.486+0000 7f3689ffb700 1 -- 172.21.15.50:0/885907386 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680018620 con 0x7f368c0c8a50 2023-11-28T11:56:02.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.490+0000 7f368bfff700 1 -- 172.21.15.50:0/885907386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f368c0c8a50 msgr2=0x7f368c06d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:02.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.490+0000 7f368bfff700 1 --2- 172.21.15.50:0/885907386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f368c0c8a50 0x7f368c06d050 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f368000aab0 tx=0x7f368000adc0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.490+0000 7f368bfff700 1 -- 172.21.15.50:0/885907386 shutdown_connections 2023-11-28T11:56:02.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.490+0000 7f368bfff700 1 --2- 172.21.15.50:0/885907386 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f368c0c8eb0 0x7f368c06d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.490+0000 7f368bfff700 1 --2- 172.21.15.50:0/885907386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f368c0c8a50 0x7f368c06d050 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.490+0000 7f368bfff700 1 -- 172.21.15.50:0/885907386 >> 172.21.15.50:0/885907386 conn(0x7f368c0ce400 msgr2=0x7f368c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:02.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.490+0000 7f368bfff700 1 -- 172.21.15.50:0/885907386 shutdown_connections 2023-11-28T11:56:02.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.490+0000 7f368bfff700 1 -- 172.21.15.50:0/885907386 wait complete. 2023-11-28T11:56:02.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368bfff700 1 Processor -- start 2023-11-28T11:56:02.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368bfff700 1 -- start start 2023-11-28T11:56:02.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f368c0ad840 0x7f368c0ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f368c0c8a50 0x7f368c097600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f368c0c8eb0 0x7f368c0ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c071150 con 0x7f368c0c8eb0 2023-11-28T11:56:02.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368bfff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c154b20 con 0x7f368c0ad840 2023-11-28T11:56:02.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368bfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368c154e00 con 0x7f368c0c8a50 2023-11-28T11:56:02.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f368c0c8eb0 0x7f368c0ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f368c0c8eb0 0x7f368c0ac930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58998/0 (socket says 172.21.15.50:58998) 2023-11-28T11:56:02.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368b7fe700 1 -- 172.21.15.50:0/4107890503 learned_addr learned my addr 172.21.15.50:0/4107890503 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:02.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368affd700 1 --2- 172.21.15.50:0/4107890503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f368c0ad840 0x7f368c0ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368a7fc700 1 --2- 172.21.15.50:0/4107890503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f368c0c8a50 0x7f368c097600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368b7fe700 1 -- 172.21.15.50:0/4107890503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f368c0c8a50 msgr2=0x7f368c097600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:02.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368b7fe700 1 --2- 172.21.15.50:0/4107890503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f368c0c8a50 0x7f368c097600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368b7fe700 1 -- 172.21.15.50:0/4107890503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f368c0ad840 msgr2=0x7f368c0ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:02.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368b7fe700 1 --2- 172.21.15.50:0/4107890503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f368c0ad840 0x7f368c0ab150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368b7fe700 1 -- 172.21.15.50:0/4107890503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368000a710 con 0x7f368c0c8eb0 2023-11-28T11:56:02.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368b7fe700 1 --2- 172.21.15.50:0/4107890503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f368c0c8eb0 0x7f368c0ac930 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f368400efc0 tx=0x7f368400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:02.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f36737fe700 1 -- 172.21.15.50:0/4107890503 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368400cad0 con 0x7f368c0c8eb0 2023-11-28T11:56:02.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f36737fe700 1 -- 172.21.15.50:0/4107890503 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368400f040 con 0x7f368c0c8eb0 2023-11-28T11:56:02.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f36737fe700 1 -- 172.21.15.50:0/4107890503 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368400ce70 con 0x7f368c0c8eb0 2023-11-28T11:56:02.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368bfff700 1 -- 172.21.15.50:0/4107890503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368c0adc10 con 0x7f368c0c8eb0 2023-11-28T11:56:02.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.494+0000 7f368bfff700 1 -- 172.21.15.50:0/4107890503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368c06cb30 con 0x7f368c0c8eb0 2023-11-28T11:56:02.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.498+0000 7f368bfff700 1 -- 172.21.15.50:0/4107890503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368c06bc80 con 0x7f368c0c8eb0 2023-11-28T11:56:02.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.498+0000 7f36737fe700 1 -- 172.21.15.50:0/4107890503 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3684014480 con 0x7f368c0c8eb0 2023-11-28T11:56:02.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.498+0000 7f36737fe700 1 --2- 172.21.15.50:0/4107890503 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3678064f10 0x7f36780673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.498+0000 7f36737fe700 1 -- 172.21.15.50:0/4107890503 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3684082960 con 0x7f368c0c8eb0 2023-11-28T11:56:02.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.498+0000 7f368affd700 1 --2- 172.21.15.50:0/4107890503 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3678064f10 0x7f36780673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.498+0000 7f368affd700 1 --2- 172.21.15.50:0/4107890503 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3678064f10 0x7f36780673c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f367c000f60 tx=0x7f367c004a70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.510+0000 7f36737fe700 1 -- 172.21.15.50:0/4107890503 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3684050870 con 0x7f368c0c8eb0 2023-11-28T11:56:02.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.734+0000 7f368bfff700 1 -- 172.21.15.50:0/4107890503 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f368c06a0e0 con 0x7f368c0c8eb0 2023-11-28T11:56:02.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.742+0000 7f36737fe700 1 -- 172.21.15.50:0/4107890503 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7f3684053e90 con 0x7f368c0c8eb0 2023-11-28T11:56:02.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.746+0000 7f368bfff700 1 -- 172.21.15.50:0/4107890503 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3678064f10 msgr2=0x7f36780673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:02.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.746+0000 7f368bfff700 1 --2- 172.21.15.50:0/4107890503 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3678064f10 0x7f36780673c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f367c000f60 tx=0x7f367c004a70 comp rx=0 tx=0).stop 2023-11-28T11:56:02.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.746+0000 7f368bfff700 1 -- 172.21.15.50:0/4107890503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f368c0c8eb0 msgr2=0x7f368c0ac930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:02.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.746+0000 7f368bfff700 1 --2- 172.21.15.50:0/4107890503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f368c0c8eb0 0x7f368c0ac930 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f368400efc0 tx=0x7f368400c0c0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.746+0000 7f368bfff700 1 -- 172.21.15.50:0/4107890503 shutdown_connections 2023-11-28T11:56:02.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.746+0000 7f368bfff700 1 --2- 172.21.15.50:0/4107890503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f368c0c8eb0 0x7f368c0ac930 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.746+0000 7f368bfff700 1 --2- 172.21.15.50:0/4107890503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f368c0c8a50 0x7f368c097600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.746+0000 7f368bfff700 1 --2- 172.21.15.50:0/4107890503 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3678064f10 0x7f36780673c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.746+0000 7f368bfff700 1 --2- 172.21.15.50:0/4107890503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f368c0ad840 0x7f368c0ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.746+0000 7f368bfff700 1 -- 172.21.15.50:0/4107890503 >> 172.21.15.50:0/4107890503 conn(0x7f368c0ce400 msgr2=0x7f368c1570a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:02.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.746+0000 7f368bfff700 1 -- 172.21.15.50:0/4107890503 shutdown_connections 2023-11-28T11:56:02.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.746+0000 7f368bfff700 1 -- 172.21.15.50:0/4107890503 wait complete. 2023-11-28T11:56:02.749 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-11-28T11:56:02.765 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:56:02.868 INFO:tasks.ceph.mds.a.smithi050.stderr:2023-11-28T11:56:02.866+0000 7f432aa8b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:56:02.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.874+0000 7f6ca3fff700 1 Processor -- start 2023-11-28T11:56:02.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.874+0000 7f6ca3fff700 1 -- start start 2023-11-28T11:56:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca3fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ca415d650 0x7f6ca40ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca3fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6ca40cc020 0x7f6ca40cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6ca41594f0 0x7f6ca4159970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca3fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca40cc9b0 con 0x7f6ca41594f0 2023-11-28T11:56:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca3fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca40cd720 con 0x7f6ca40cc020 2023-11-28T11:56:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca3fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca40cd990 con 0x7f6ca415d650 2023-11-28T11:56:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6ca41594f0 0x7f6ca4159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6ca41594f0 0x7f6ca4159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59010/0 (socket says 172.21.15.50:59010) 2023-11-28T11:56:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca37fe700 1 -- 172.21.15.50:0/4257753679 learned_addr learned my addr 172.21.15.50:0/4257753679 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca27fc700 1 --2- 172.21.15.50:0/4257753679 >> v2:172.21.15.192:3300/0 conn(0x7f6ca40cc020 0x7f6ca40cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca2ffd700 1 --2- 172.21.15.50:0/4257753679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ca415d650 0x7f6ca40ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca37fe700 1 -- 172.21.15.50:0/4257753679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ca415d650 msgr2=0x7f6ca40ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca37fe700 1 --2- 172.21.15.50:0/4257753679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ca415d650 0x7f6ca40ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca37fe700 1 -- 172.21.15.50:0/4257753679 >> v2:172.21.15.192:3300/0 conn(0x7f6ca40cc020 msgr2=0x7f6ca40cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca37fe700 1 --2- 172.21.15.50:0/4257753679 >> v2:172.21.15.192:3300/0 conn(0x7f6ca40cc020 0x7f6ca40cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca37fe700 1 -- 172.21.15.50:0/4257753679 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca40cdc70 con 0x7f6ca41594f0 2023-11-28T11:56:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca27fc700 1 --2- 172.21.15.50:0/4257753679 >> v2:172.21.15.192:3300/0 conn(0x7f6ca40cc020 0x7f6ca40cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:02.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca2ffd700 1 --2- 172.21.15.50:0/4257753679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ca415d650 0x7f6ca40ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:02.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca37fe700 1 --2- 172.21.15.50:0/4257753679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca41594f0 0x7f6ca4159970 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4070ba0 tx=0x7f6c9c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f795b4352eb804 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca1ffb700 1 -- 172.21.15.50:0/4257753679 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c00b8a0 con 0x7f6ca41594f0 2023-11-28T11:56:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca1ffb700 1 -- 172.21.15.50:0/4257753679 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c00ba00 con 0x7f6ca41594f0 2023-11-28T11:56:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.878+0000 7f6ca1ffb700 1 -- 172.21.15.50:0/4257753679 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c00bd90 con 0x7f6ca41594f0 2023-11-28T11:56:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.882+0000 7f6ca3fff700 1 -- 172.21.15.50:0/4257753679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca41594f0 msgr2=0x7f6ca4159970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.882+0000 7f6ca3fff700 1 --2- 172.21.15.50:0/4257753679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca41594f0 0x7f6ca4159970 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4070ba0 tx=0x7f6c9c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.882+0000 7f6ca3fff700 1 -- 172.21.15.50:0/4257753679 shutdown_connections 2023-11-28T11:56:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.882+0000 7f6ca3fff700 1 --2- 172.21.15.50:0/4257753679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca41594f0 0x7f6ca4159970 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.882+0000 7f6ca3fff700 1 --2- 172.21.15.50:0/4257753679 >> v2:172.21.15.192:3300/0 conn(0x7f6ca40cc020 0x7f6ca40cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.882+0000 7f6ca3fff700 1 --2- 172.21.15.50:0/4257753679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ca415d650 0x7f6ca40ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.882+0000 7f6ca3fff700 1 -- 172.21.15.50:0/4257753679 >> 172.21.15.50:0/4257753679 conn(0x7f6ca406ec40 msgr2=0x7f6ca40b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.882+0000 7f6ca3fff700 1 -- 172.21.15.50:0/4257753679 shutdown_connections 2023-11-28T11:56:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.882+0000 7f6ca3fff700 1 -- 172.21.15.50:0/4257753679 wait complete. 2023-11-28T11:56:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca3fff700 1 Processor -- start 2023-11-28T11:56:02.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca3fff700 1 -- start start 2023-11-28T11:56:02.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca40cc020 0x7f6ca41f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca3fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ca41594f0 0x7f6ca41ecef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ca415d650 0x7f6ca406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca3fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca41ed430 con 0x7f6ca40cc020 2023-11-28T11:56:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca3fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca406aa10 con 0x7f6ca415d650 2023-11-28T11:56:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca3fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca40b4da0 con 0x7f6ca41594f0 2023-11-28T11:56:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca40cc020 0x7f6ca41f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca40cc020 0x7f6ca41f3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59022/0 (socket says 172.21.15.50:59022) 2023-11-28T11:56:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca2ffd700 1 -- 172.21.15.50:0/323886454 learned_addr learned my addr 172.21.15.50:0/323886454 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca37fe700 1 --2- 172.21.15.50:0/323886454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ca415d650 0x7f6ca406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca27fc700 1 --2- 172.21.15.50:0/323886454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ca41594f0 0x7f6ca41ecef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca2ffd700 1 -- 172.21.15.50:0/323886454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ca41594f0 msgr2=0x7f6ca41ecef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:02.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca2ffd700 1 --2- 172.21.15.50:0/323886454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ca41594f0 0x7f6ca41ecef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca2ffd700 1 -- 172.21.15.50:0/323886454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ca415d650 msgr2=0x7f6ca406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:02.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca2ffd700 1 --2- 172.21.15.50:0/323886454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ca415d650 0x7f6ca406a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:02.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca2ffd700 1 -- 172.21.15.50:0/323886454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c009570 con 0x7f6ca40cc020 2023-11-28T11:56:02.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca2ffd700 1 --2- 172.21.15.50:0/323886454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca40cc020 0x7f6ca41f3a10 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009fc0 tx=0x7f6c9400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:02.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6c8b7fe700 1 -- 172.21.15.50:0/323886454 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9400dde0 con 0x7f6ca40cc020 2023-11-28T11:56:02.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6c8b7fe700 1 -- 172.21.15.50:0/323886454 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9400f040 con 0x7f6ca40cc020 2023-11-28T11:56:02.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6c8b7fe700 1 -- 172.21.15.50:0/323886454 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94003c80 con 0x7f6ca40cc020 2023-11-28T11:56:02.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca3fff700 1 -- 172.21.15.50:0/323886454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca415a250 con 0x7f6ca40cc020 2023-11-28T11:56:02.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.886+0000 7f6ca3fff700 1 -- 172.21.15.50:0/323886454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca40cdf50 con 0x7f6ca40cc020 2023-11-28T11:56:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.890+0000 7f6ca3fff700 1 -- 172.21.15.50:0/323886454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca4159eb0 con 0x7f6ca40cc020 2023-11-28T11:56:02.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.890+0000 7f6c8b7fe700 1 -- 172.21.15.50:0/323886454 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6c9401c030 con 0x7f6ca40cc020 2023-11-28T11:56:02.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.890+0000 7f6c8b7fe700 1 --2- 172.21.15.50:0/323886454 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6c90064ee0 0x7f6c90067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.890+0000 7f6c8b7fe700 1 -- 172.21.15.50:0/323886454 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6c94082800 con 0x7f6ca40cc020 2023-11-28T11:56:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.890+0000 7f6ca27fc700 1 --2- 172.21.15.50:0/323886454 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6c90064ee0 0x7f6c90067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:02.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.890+0000 7f6ca27fc700 1 --2- 172.21.15.50:0/323886454 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6c90064ee0 0x7f6c90067390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6ca415b010 tx=0x7f6c98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:02.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:02.898+0000 7f6c8b7fe700 1 -- 172.21.15.50:0/323886454 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6c94050820 con 0x7f6ca40cc020 2023-11-28T11:56:03.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.098+0000 7f6ca3fff700 1 -- 172.21.15.50:0/323886454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ca4072c20 con 0x7f6ca40cc020 2023-11-28T11:56:03.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.098+0000 7f6c8b7fe700 1 -- 172.21.15.50:0/323886454 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f6c94053e40 con 0x7f6ca40cc020 2023-11-28T11:56:03.100 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:03.101 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2341737190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2341737190},{"type":"v1","addr":"172.21.15.50:6835","nonce":2341737190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5546,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/192527628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":192527628},{"type":"v1","addr":"172.21.15.192:6835","nonce":192527628}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5549,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2304989740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2304989740},{"type":"v1","addr":"172.21.15.192:6837","nonce":2304989740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:55:57.946191+0000","modified":"2023-11-28T11:56:00.964614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6057":{"gid":6057,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/1163863991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1163863991},{"type":"v1","addr":"172.21.15.50:6834","nonce":1163863991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:56:03.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.098+0000 7f6ca3fff700 1 -- 172.21.15.50:0/323886454 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6c90064ee0 msgr2=0x7f6c90067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:03.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.098+0000 7f6ca3fff700 1 --2- 172.21.15.50:0/323886454 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6c90064ee0 0x7f6c90067390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6ca415b010 tx=0x7f6c98008040 comp rx=0 tx=0).stop 2023-11-28T11:56:03.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.098+0000 7f6ca3fff700 1 -- 172.21.15.50:0/323886454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca40cc020 msgr2=0x7f6ca41f3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:03.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.098+0000 7f6ca3fff700 1 --2- 172.21.15.50:0/323886454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca40cc020 0x7f6ca41f3a10 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009fc0 tx=0x7f6c9400d3b0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.098+0000 7f6ca3fff700 1 -- 172.21.15.50:0/323886454 shutdown_connections 2023-11-28T11:56:03.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.098+0000 7f6ca3fff700 1 --2- 172.21.15.50:0/323886454 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6c90064ee0 0x7f6c90067390 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.098+0000 7f6ca3fff700 1 --2- 172.21.15.50:0/323886454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ca415d650 0x7f6ca406a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.098+0000 7f6ca3fff700 1 --2- 172.21.15.50:0/323886454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ca41594f0 0x7f6ca41ecef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.098+0000 7f6ca3fff700 1 --2- 172.21.15.50:0/323886454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ca40cc020 0x7f6ca41f3a10 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.098+0000 7f6ca3fff700 1 -- 172.21.15.50:0/323886454 >> 172.21.15.50:0/323886454 conn(0x7f6ca406ec40 msgr2=0x7f6ca415c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:03.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.102+0000 7f6ca3fff700 1 -- 172.21.15.50:0/323886454 shutdown_connections 2023-11-28T11:56:03.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.102+0000 7f6ca3fff700 1 -- 172.21.15.50:0/323886454 wait complete. 2023-11-28T11:56:03.104 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2023-11-28T11:56:03.518 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T11:55:57.946191+0000', 'modified': '2023-11-28T11:56:00.964614+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6057}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6057': {'gid': 6057, 'name': 'a', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6834/1163863991', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6833', 'nonce': 1163863991}, {'type': 'v1', 'addr': '172.21.15.50:6834', 'nonce': 1163863991}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T11:56:03.518 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T11:56:03.518 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T11:56:03.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.642+0000 7f29e3fcb700 1 Processor -- start 2023-11-28T11:56:03.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.642+0000 7f29e3fcb700 1 -- start start 2023-11-28T11:56:03.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.642+0000 7f29e3fcb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29dc0cd5e0 0x7f29dc071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.642+0000 7f29e3fcb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29dc069c40 0x7f29dc0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.642+0000 7f29e3fcb700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc0cc420 con 0x7f29dc160680 2023-11-28T11:56:03.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.642+0000 7f29e3fcb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29dc0cc6c0 con 0x7f29dc069c40 2023-11-28T11:56:03.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.642+0000 7f29e3fcb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0cc9a0 con 0x7f29dc0cd5e0 2023-11-28T11:56:03.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e2568700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29dc069c40 0x7f29dc0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e2568700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29dc069c40 0x7f29dc0c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59028/0 (socket says 172.21.15.50:59028) 2023-11-28T11:56:03.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e2568700 1 -- 172.21.15.50:0/308210510 learned_addr learned my addr 172.21.15.50:0/308210510 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:03.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e1d67700 1 --1- 172.21.15.50:0/308210510 >> v1:172.21.15.50:6789/0 conn(0x7f29dc160680 0x7f29dc0cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33616/0 (socket says 172.21.15.50:33616) 2023-11-28T11:56:03.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e1566700 1 --2- 172.21.15.50:0/308210510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29dc0cd5e0 0x7f29dc071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e2568700 1 -- 172.21.15.50:0/308210510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29dc0cd5e0 msgr2=0x7f29dc071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:03.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e2568700 1 --2- 172.21.15.50:0/308210510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29dc0cd5e0 0x7f29dc071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e2568700 1 -- 172.21.15.50:0/308210510 >> v1:172.21.15.50:6789/0 conn(0x7f29dc160680 legacy=0x7f29dc0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:03.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e2568700 1 -- 172.21.15.50:0/308210510 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc0705c0 con 0x7f29dc069c40 2023-11-28T11:56:03.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e2568700 1 --2- 172.21.15.50:0/308210510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc069c40 0x7f29dc0c9ce0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f29d4009910 tx=0x7f29d4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57363471f2b628c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:03.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e0d65700 1 -- 172.21.15.50:0/308210510 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4011830 con 0x7f29dc069c40 2023-11-28T11:56:03.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e0d65700 1 -- 172.21.15.50:0/308210510 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d4011990 con 0x7f29dc069c40 2023-11-28T11:56:03.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e0d65700 1 -- 172.21.15.50:0/308210510 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4011d40 con 0x7f29dc069c40 2023-11-28T11:56:03.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e3fcb700 1 -- 172.21.15.50:0/308210510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc069c40 msgr2=0x7f29dc0c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:03.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e3fcb700 1 --2- 172.21.15.50:0/308210510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc069c40 0x7f29dc0c9ce0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f29d4009910 tx=0x7f29d4009c20 comp rx=0 tx=0).stop 2023-11-28T11:56:03.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e3fcb700 1 -- 172.21.15.50:0/308210510 shutdown_connections 2023-11-28T11:56:03.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e3fcb700 1 --2- 172.21.15.50:0/308210510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc069c40 0x7f29dc0c9ce0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e3fcb700 1 --2- 172.21.15.50:0/308210510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29dc0cd5e0 0x7f29dc071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e3fcb700 1 -- 172.21.15.50:0/308210510 >> 172.21.15.50:0/308210510 conn(0x7f29dc06caf0 msgr2=0x7f29dc0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:03.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e3fcb700 1 -- 172.21.15.50:0/308210510 shutdown_connections 2023-11-28T11:56:03.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.646+0000 7f29e3fcb700 1 -- 172.21.15.50:0/308210510 wait complete. 2023-11-28T11:56:03.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e3fcb700 1 Processor -- start 2023-11-28T11:56:03.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e3fcb700 1 -- start start 2023-11-28T11:56:03.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e3fcb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc069c40 0x7f29dc156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e3fcb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29dc0cd5e0 0x7f29dc0b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e3fcb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29dc160680 0x7f29dc0b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e3fcb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0b29f0 con 0x7f29dc069c40 2023-11-28T11:56:03.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e3fcb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0b2cd0 con 0x7f29dc0cd5e0 2023-11-28T11:56:03.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e3fcb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0b2fb0 con 0x7f29dc160680 2023-11-28T11:56:03.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e1d67700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc069c40 0x7f29dc156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e1d67700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc069c40 0x7f29dc156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59036/0 (socket says 172.21.15.50:59036) 2023-11-28T11:56:03.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e1d67700 1 -- 172.21.15.50:0/860683465 learned_addr learned my addr 172.21.15.50:0/860683465 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:03.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e1566700 1 --2- 172.21.15.50:0/860683465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29dc0cd5e0 0x7f29dc0b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e2568700 1 --2- 172.21.15.50:0/860683465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29dc160680 0x7f29dc0b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e1d67700 1 -- 172.21.15.50:0/860683465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29dc160680 msgr2=0x7f29dc0b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:03.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e1d67700 1 --2- 172.21.15.50:0/860683465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29dc160680 0x7f29dc0b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e1d67700 1 -- 172.21.15.50:0/860683465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29dc0cd5e0 msgr2=0x7f29dc0b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:03.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e1d67700 1 --2- 172.21.15.50:0/860683465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29dc0cd5e0 0x7f29dc0b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e1d67700 1 -- 172.21.15.50:0/860683465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d4009570 con 0x7f29dc069c40 2023-11-28T11:56:03.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e2568700 1 --2- 172.21.15.50:0/860683465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29dc160680 0x7f29dc0b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:03.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e1d67700 1 --2- 172.21.15.50:0/860683465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc069c40 0x7f29dc156fa0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f29d000c4d0 tx=0x7f29d000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:03.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29ce7fc700 1 -- 172.21.15.50:0/860683465 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0005cd0 con 0x7f29dc069c40 2023-11-28T11:56:03.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29ce7fc700 1 -- 172.21.15.50:0/860683465 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d0005e30 con 0x7f29dc069c40 2023-11-28T11:56:03.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e3fcb700 1 -- 172.21.15.50:0/860683465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29dc0c9750 con 0x7f29dc069c40 2023-11-28T11:56:03.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29ce7fc700 1 -- 172.21.15.50:0/860683465 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d00072d0 con 0x7f29dc069c40 2023-11-28T11:56:03.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.650+0000 7f29e3fcb700 1 -- 172.21.15.50:0/860683465 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29dc071940 con 0x7f29dc069c40 2023-11-28T11:56:03.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.654+0000 7f29ce7fc700 1 -- 172.21.15.50:0/860683465 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f29d0019030 con 0x7f29dc069c40 2023-11-28T11:56:03.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.654+0000 7f29ce7fc700 1 --2- 172.21.15.50:0/860683465 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f29c0064ee0 0x7f29c0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.654+0000 7f29ce7fc700 1 -- 172.21.15.50:0/860683465 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f29d0081290 con 0x7f29dc069c40 2023-11-28T11:56:03.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.654+0000 7f29e1566700 1 --2- 172.21.15.50:0/860683465 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f29c0064ee0 0x7f29c0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.654+0000 7f29e1566700 1 --2- 172.21.15.50:0/860683465 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f29c0064ee0 0x7f29c0067390 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f29dc159a90 tx=0x7f29d800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:03.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e724b740 1 Processor -- start 2023-11-28T11:56:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e724b740 1 -- start start 2023-11-28T11:56:03.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e724b740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xe75ae0 0x1125e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e724b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75710 0x1126340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e724b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xec0790 0x1126880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e724b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xfe4ae0 con 0xec0790 2023-11-28T11:56:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e724b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x1054bd0 con 0xe75710 2023-11-28T11:56:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e724b740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x104ded0 con 0xe75ae0 2023-11-28T11:56:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e2568700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xec0790 0x1126880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e1566700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75710 0x1126340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e1d67700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xe75ae0 0x1125e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e1566700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75710 0x1126340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:59510/0 (socket says 172.21.15.50:59510) 2023-11-28T11:56:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e1d67700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xe75ae0 0x1125e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:47350/0 (socket says 172.21.15.50:47350) 2023-11-28T11:56:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e2568700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xec0790 0x1126880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59050/0 (socket says 172.21.15.50:59050) 2023-11-28T11:56:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e1566700 1 -- 172.21.15.50:0/3853577609 learned_addr learned my addr 172.21.15.50:0/3853577609 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e2568700 1 -- 172.21.15.50:0/3853577609 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xe75ae0 msgr2=0x1125e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e2568700 1 --2- 172.21.15.50:0/3853577609 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xe75ae0 0x1125e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e2568700 1 -- 172.21.15.50:0/3853577609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75710 msgr2=0x1126340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e2568700 1 --2- 172.21.15.50:0/3853577609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75710 0x1126340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.658+0000 7f29e2568700 1 -- 172.21.15.50:0/3853577609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1073cc0 con 0xec0790 2023-11-28T11:56:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e2568700 1 --2- 172.21.15.50:0/3853577609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xec0790 0x1126880 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f29dc06e500 tx=0x7f29d4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b81bf9e98b6755 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:03.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29bf7fe700 1 -- 172.21.15.50:0/3853577609 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4011830 con 0xec0790 2023-11-28T11:56:03.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29bf7fe700 1 -- 172.21.15.50:0/3853577609 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d4011b00 con 0xec0790 2023-11-28T11:56:03.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29bf7fe700 1 -- 172.21.15.50:0/3853577609 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4004040 con 0xec0790 2023-11-28T11:56:03.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 1 -- 172.21.15.50:0/3853577609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xec0790 msgr2=0x1126880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:03.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 1 --2- 172.21.15.50:0/3853577609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xec0790 0x1126880 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f29dc06e500 tx=0x7f29d4010000 comp rx=0 tx=0).stop 2023-11-28T11:56:03.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 1 -- 172.21.15.50:0/3853577609 shutdown_connections 2023-11-28T11:56:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 1 --2- 172.21.15.50:0/3853577609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xec0790 0x1126880 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 1 --2- 172.21.15.50:0/3853577609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75710 0x1126340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 1 --2- 172.21.15.50:0/3853577609 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xe75ae0 0x1125e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 1 -- 172.21.15.50:0/3853577609 >> 172.21.15.50:0/3853577609 conn(0xe75eb0 msgr2=0x110e700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 1 -- 172.21.15.50:0/3853577609 shutdown_connections 2023-11-28T11:56:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 1 -- 172.21.15.50:0/3853577609 wait complete. 2023-11-28T11:56:03.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 1 -- start start 2023-11-28T11:56:03.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 1 Processor -- start 2023-11-28T11:56:03.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xe75710 0x10e5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe75ae0 0x110dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xec0790 0x110e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xefab20 con 0xe75ae0 2023-11-28T11:56:03.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x10e5cc0 con 0xec0790 2023-11-28T11:56:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x10e3940 con 0xe75710 2023-11-28T11:56:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e724b740 10 client.0 _ll_register_callbacks cb 0x10aa0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:56:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e1566700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe75ae0 0x110dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e1566700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe75ae0 0x110dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59066/0 (socket says 172.21.15.50:59066) 2023-11-28T11:56:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e1566700 1 -- 172.21.15.50:0/3880864159 learned_addr learned my addr 172.21.15.50:0/3880864159 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:03.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e2568700 1 --2- 172.21.15.50:0/3880864159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xec0790 0x110e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e1d67700 1 --2- 172.21.15.50:0/3880864159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xe75710 0x10e5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e1566700 1 -- 172.21.15.50:0/3880864159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xe75710 msgr2=0x10e5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:03.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e1566700 1 --2- 172.21.15.50:0/3880864159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xe75710 0x10e5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e1566700 1 -- 172.21.15.50:0/3880864159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xec0790 msgr2=0x110e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:03.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e1566700 1 --2- 172.21.15.50:0/3880864159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xec0790 0x110e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.662+0000 7f29e1566700 1 -- 172.21.15.50:0/3880864159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29dc0705c0 con 0xe75ae0 2023-11-28T11:56:03.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e1566700 1 --2- 172.21.15.50:0/3880864159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe75ae0 0x110dc40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f29d8007300 tx=0x7f29d8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14ae662b38e56bb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:03.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29bcff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:56:03.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29bcff9700 1 -- 172.21.15.50:0/3880864159 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d8017710 con 0xe75ae0 2023-11-28T11:56:03.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29bcff9700 1 -- 172.21.15.50:0/3880864159 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f29d8017870 con 0xe75ae0 2023-11-28T11:56:03.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 1 -- 172.21.15.50:0/3880864159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1046f50 con 0xe75ae0 2023-11-28T11:56:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29bcff9700 1 -- 172.21.15.50:0/3880864159 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29d8017a30 con 0xe75ae0 2023-11-28T11:56:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 10 client.6204 fetch_fsmap learned FSMap version 25 2023-11-28T11:56:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 1 -- 172.21.15.50:0/3880864159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0xec19e0 con 0xe75ae0 2023-11-28T11:56:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29bcff9700 1 -- 172.21.15.50:0/3880864159 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1046f50 con 0xe75ae0 2023-11-28T11:56:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29bcff9700 1 -- 172.21.15.50:0/3880864159 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f29d8017b90 con 0xe75ae0 2023-11-28T11:56:03.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 10 client.6204 fetch_fsmap finished waiting for FSMap version 25 2023-11-28T11:56:03.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 10 client.6204 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T11:56:03.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 20 client.6204 populate_metadata read hostname 'smithi050' 2023-11-28T11:56:03.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 1 --2- 172.21.15.50:0/3880864159 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x10e8d50 0x10e3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 4 client.6204 mds_command: new command op to 6057 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:56:03.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 1 -- 172.21.15.50:0/3880864159 --> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1046c70 con 0x10e8d50 2023-11-28T11:56:03.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e1d67700 1 --2- 172.21.15.50:0/3880864159 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x10e8d50 0x10e3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e1d67700 1 --2- 172.21.15.50:0/3880864159 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x10e8d50 0x10e3050 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa08f8c2dde7426 server_cookie=7720c85eb6044ae7 in_seq=0 out_seq=0 2023-11-28T11:56:03.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29bcff9700 10 client.6204 ms_handle_connect on v2:172.21.15.50:6833/1163863991 2023-11-28T11:56:03.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29bcff9700 1 -- 172.21.15.50:0/3880864159 <== mds.0 v2:172.21.15.50:6833/1163863991 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1046c70 con 0x10e8d50 2023-11-28T11:56:03.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29bcff9700 10 client.6204 handle_command_reply: tid=0 2023-11-28T11:56:03.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 1 client.6204 shutdown 2023-11-28T11:56:03.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 1 -- 172.21.15.50:0/3880864159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe75ae0 msgr2=0x110dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:03.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 1 --2- 172.21.15.50:0/3880864159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe75ae0 0x110dc40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f29d8007300 tx=0x7f29d8004af0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 1 -- 172.21.15.50:0/3880864159 shutdown_connections 2023-11-28T11:56:03.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 1 --2- 172.21.15.50:0/3880864159 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x10e8d50 0x10e3050 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 1 --2- 172.21.15.50:0/3880864159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xec0790 0x110e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 1 --2- 172.21.15.50:0/3880864159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe75ae0 0x110dc40 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 1 --2- 172.21.15.50:0/3880864159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xe75710 0x10e5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29bcff9700 0 client.6204 ms_handle_reset on v2:172.21.15.50:6833/1163863991 2023-11-28T11:56:03.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 1 -- 172.21.15.50:0/3880864159 >> 172.21.15.50:0/3880864159 conn(0xe75eb0 msgr2=0x110e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:03.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 1 -- 172.21.15.50:0/3880864159 shutdown_connections 2023-11-28T11:56:03.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 1 -- 172.21.15.50:0/3880864159 wait complete. 2023-11-28T11:56:03.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.666+0000 7f29e724b740 20 client.6204 trim_cache size 0 max 16384 2023-11-28T11:56:03.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e724b740 1 Processor -- start 2023-11-28T11:56:03.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e724b740 1 -- start start 2023-11-28T11:56:03.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e724b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe75710 0x10e7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e724b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75ae0 0x10e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e724b740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xec0790 0x1126b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e724b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x104b6e0 con 0xe75710 2023-11-28T11:56:03.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e724b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x1023de0 con 0xe75ae0 2023-11-28T11:56:03.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e724b740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1049840 con 0xec0790 2023-11-28T11:56:03.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e1d67700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe75710 0x10e7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e1d67700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe75710 0x10e7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59072/0 (socket says 172.21.15.50:59072) 2023-11-28T11:56:03.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e1d67700 1 -- 172.21.15.50:0/70782743 learned_addr learned my addr 172.21.15.50:0/70782743 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:03.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e1566700 1 --2- 172.21.15.50:0/70782743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75ae0 0x10e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e2568700 1 --2- 172.21.15.50:0/70782743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xec0790 0x1126b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e1d67700 1 -- 172.21.15.50:0/70782743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xec0790 msgr2=0x1126b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:03.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e1d67700 1 --2- 172.21.15.50:0/70782743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xec0790 0x1126b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e1d67700 1 -- 172.21.15.50:0/70782743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75ae0 msgr2=0x10e7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:03.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e1d67700 1 --2- 172.21.15.50:0/70782743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75ae0 0x10e7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e1d67700 1 -- 172.21.15.50:0/70782743 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10148a0 con 0xe75710 2023-11-28T11:56:03.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.690+0000 7f29e1566700 1 --2- 172.21.15.50:0/70782743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75ae0 0x10e7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:03.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.694+0000 7f29e1d67700 1 --2- 172.21.15.50:0/70782743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe75710 0x10e7870 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f29d00070a0 tx=0x7f29d0081040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e64c065f794825f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:03.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.694+0000 7f29bffff700 1 -- 172.21.15.50:0/70782743 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d007f270 con 0xe75710 2023-11-28T11:56:03.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.694+0000 7f29bffff700 1 -- 172.21.15.50:0/70782743 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d007f3d0 con 0xe75710 2023-11-28T11:56:03.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.694+0000 7f29bffff700 1 -- 172.21.15.50:0/70782743 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d005acc0 con 0xe75710 2023-11-28T11:56:03.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.694+0000 7f29e724b740 1 -- 172.21.15.50:0/70782743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe75710 msgr2=0x10e7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:03.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.694+0000 7f29e724b740 1 --2- 172.21.15.50:0/70782743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe75710 0x10e7870 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f29d00070a0 tx=0x7f29d0081040 comp rx=0 tx=0).stop 2023-11-28T11:56:03.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.694+0000 7f29e724b740 1 -- 172.21.15.50:0/70782743 shutdown_connections 2023-11-28T11:56:03.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.694+0000 7f29e724b740 1 --2- 172.21.15.50:0/70782743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xec0790 0x1126b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.694+0000 7f29e724b740 1 --2- 172.21.15.50:0/70782743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75ae0 0x10e7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.694+0000 7f29e724b740 1 --2- 172.21.15.50:0/70782743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xe75710 0x10e7870 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.694+0000 7f29e724b740 1 -- 172.21.15.50:0/70782743 >> 172.21.15.50:0/70782743 conn(0xe75eb0 msgr2=0x10f3890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:03.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.694+0000 7f29e724b740 1 -- 172.21.15.50:0/70782743 shutdown_connections 2023-11-28T11:56:03.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.694+0000 7f29e724b740 1 -- 172.21.15.50:0/70782743 wait complete. 2023-11-28T11:56:03.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.694+0000 7f29e724b740 1 -- start start 2023-11-28T11:56:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.694+0000 7f29e724b740 1 Processor -- start 2023-11-28T11:56:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e724b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75710 0x1127390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e724b740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xe75ae0 0x118b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e724b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xec0790 0x118bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e724b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x104cd60 con 0xec0790 2023-11-28T11:56:03.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e724b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x1055e60 con 0xe75710 2023-11-28T11:56:03.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e724b740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1050a30 con 0xe75ae0 2023-11-28T11:56:03.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e2568700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xec0790 0x118bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e724b740 10 client.0 _ll_register_callbacks cb 0xffa2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:56:03.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e2568700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xec0790 0x118bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59084/0 (socket says 172.21.15.50:59084) 2023-11-28T11:56:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e2568700 1 -- 172.21.15.50:0/4264525083 learned_addr learned my addr 172.21.15.50:0/4264525083 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e1566700 1 --2- 172.21.15.50:0/4264525083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xe75ae0 0x118b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e1d67700 1 --2- 172.21.15.50:0/4264525083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75710 0x1127390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e2568700 1 -- 172.21.15.50:0/4264525083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xe75ae0 msgr2=0x118b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e2568700 1 --2- 172.21.15.50:0/4264525083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xe75ae0 0x118b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e2568700 1 -- 172.21.15.50:0/4264525083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75710 msgr2=0x1127390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:03.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e2568700 1 --2- 172.21.15.50:0/4264525083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75710 0x1127390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e2568700 1 -- 172.21.15.50:0/4264525083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29dc071940 con 0xec0790 2023-11-28T11:56:03.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e1d67700 1 --2- 172.21.15.50:0/4264525083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75710 0x1127390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:03.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29bcff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:56:03.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e2568700 1 --2- 172.21.15.50:0/4264525083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xec0790 0x118bc60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f29d4013000 tx=0x7f29d40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954bb6b2e662cd6d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:03.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29bcff9700 1 -- 172.21.15.50:0/4264525083 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d402b070 con 0xec0790 2023-11-28T11:56:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29bcff9700 1 -- 172.21.15.50:0/4264525083 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f29d4004240 con 0xec0790 2023-11-28T11:56:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e724b740 1 -- 172.21.15.50:0/4264525083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f29d4011b00 con 0xec0790 2023-11-28T11:56:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29bcff9700 1 -- 172.21.15.50:0/4264525083 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29d4006b10 con 0xec0790 2023-11-28T11:56:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e724b740 10 client.6210 fetch_fsmap learned FSMap version 25 2023-11-28T11:56:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29e724b740 1 -- 172.21.15.50:0/4264525083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0xffa380 con 0xec0790 2023-11-28T11:56:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.698+0000 7f29bcff9700 1 -- 172.21.15.50:0/4264525083 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d4011b00 con 0xec0790 2023-11-28T11:56:03.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29bcff9700 1 -- 172.21.15.50:0/4264525083 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f29d4004400 con 0xec0790 2023-11-28T11:56:03.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 10 client.6210 fetch_fsmap finished waiting for FSMap version 25 2023-11-28T11:56:03.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 10 client.6210 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T11:56:03.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 20 client.6210 populate_metadata read hostname 'smithi050' 2023-11-28T11:56:03.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 1 --2- 172.21.15.50:0/4264525083 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x11429d0 0x1142da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 4 client.6210 mds_command: new command op to 6057 tid=0[{"prefix": "status"}] 2023-11-28T11:56:03.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 1 -- 172.21.15.50:0/4264525083 --> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] -- command(tid 0: {"prefix": "status"}) v1 -- 0xef2260 con 0x11429d0 2023-11-28T11:56:03.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e1d67700 1 --2- 172.21.15.50:0/4264525083 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x11429d0 0x1142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29bcff9700 10 client.6210 ms_handle_connect on v2:172.21.15.50:6833/1163863991 2023-11-28T11:56:03.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e1d67700 1 --2- 172.21.15.50:0/4264525083 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x11429d0 0x1142da0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=115b6e4ccddf9cb7 server_cookie=6e04a3caad29b121 in_seq=0 out_seq=0 2023-11-28T11:56:03.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29bcff9700 1 -- 172.21.15.50:0/4264525083 <== mds.0 v2:172.21.15.50:6833/1163863991 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0xef2260 con 0x11429d0 2023-11-28T11:56:03.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29bcff9700 10 client.6210 handle_command_reply: tid=0 2023-11-28T11:56:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 1 client.6210 shutdown 2023-11-28T11:56:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 1 -- 172.21.15.50:0/4264525083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xec0790 msgr2=0x118bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 1 --2- 172.21.15.50:0/4264525083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xec0790 0x118bc60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f29d4013000 tx=0x7f29d40047e0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 1 -- 172.21.15.50:0/4264525083 shutdown_connections 2023-11-28T11:56:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 1 --2- 172.21.15.50:0/4264525083 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x11429d0 0x1142da0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 1 --2- 172.21.15.50:0/4264525083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xec0790 0x118bc60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 1 --2- 172.21.15.50:0/4264525083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xe75ae0 0x118b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 1 --2- 172.21.15.50:0/4264525083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xe75710 0x1127390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29bcff9700 0 client.6210 ms_handle_reset on v2:172.21.15.50:6833/1163863991 2023-11-28T11:56:03.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 1 -- 172.21.15.50:0/4264525083 >> 172.21.15.50:0/4264525083 conn(0xe75eb0 msgr2=0x10e76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:03.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 1 -- 172.21.15.50:0/4264525083 shutdown_connections 2023-11-28T11:56:03.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 1 -- 172.21.15.50:0/4264525083 wait complete. 2023-11-28T11:56:03.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e724b740 20 client.6210 trim_cache size 0 max 16384 2023-11-28T11:56:03.720 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:56:03.720 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "cfe07b6e-9334-49cb-bc97-5dba7caa4ff8", 2023-11-28T11:56:03.720 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-11-28T11:56:03.721 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6057, 2023-11-28T11:56:03.721 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-11-28T11:56:03.721 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-11-28T11:56:03.721 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-11-28T11:56:03.721 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 5.7554894479999996, 2023-11-28T11:56:03.721 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 25, 2023-11-28T11:56:03.722 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 54, 2023-11-28T11:56:03.722 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 54, 2023-11-28T11:56:03.722 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 11.276623047999999 2023-11-28T11:56:03.722 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:56:03.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e3fcb700 1 -- 172.21.15.50:0/860683465 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f29c0064ee0 msgr2=0x7f29c0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:03.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e3fcb700 1 --2- 172.21.15.50:0/860683465 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f29c0064ee0 0x7f29c0067390 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f29dc159a90 tx=0x7f29d800b040 comp rx=0 tx=0).stop 2023-11-28T11:56:03.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e3fcb700 1 -- 172.21.15.50:0/860683465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc069c40 msgr2=0x7f29dc156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:03.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e3fcb700 1 --2- 172.21.15.50:0/860683465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc069c40 0x7f29dc156fa0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f29d000c4d0 tx=0x7f29d000c890 comp rx=0 tx=0).stop 2023-11-28T11:56:03.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e3fcb700 1 -- 172.21.15.50:0/860683465 shutdown_connections 2023-11-28T11:56:03.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e3fcb700 1 --2- 172.21.15.50:0/860683465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29dc160680 0x7f29dc0b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e3fcb700 1 --2- 172.21.15.50:0/860683465 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f29c0064ee0 0x7f29c0067390 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e3fcb700 1 --2- 172.21.15.50:0/860683465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29dc0cd5e0 0x7f29dc0b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e3fcb700 1 --2- 172.21.15.50:0/860683465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29dc069c40 0x7f29dc156fa0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e3fcb700 1 -- 172.21.15.50:0/860683465 >> 172.21.15.50:0/860683465 conn(0x7f29dc06caf0 msgr2=0x7f29dc0c4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:03.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e3fcb700 1 -- 172.21.15.50:0/860683465 shutdown_connections 2023-11-28T11:56:03.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.702+0000 7f29e3fcb700 1 -- 172.21.15.50:0/860683465 wait complete. 2023-11-28T11:56:03.727 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:56:03.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.846+0000 7f08d24ae700 1 Processor -- start 2023-11-28T11:56:03.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.846+0000 7f08d24ae700 1 -- start start 2023-11-28T11:56:03.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d24ae700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08cc06d7d0 0x7f08cc06a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d24ae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08cc0b4c10 0x7f08cc0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d24ae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08cc06dc40 con 0x7f08cc0cf050 2023-11-28T11:56:03.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d24ae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08cc06aa70 con 0x7f08cc0b4c10 2023-11-28T11:56:03.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d24ae700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc15c6d0 con 0x7f08cc06d7d0 2023-11-28T11:56:03.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d14ac700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f08cc0cf050 0x7f08cc0cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33620/0 (socket says 172.21.15.50:33620) 2023-11-28T11:56:03.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d1cad700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08cc0b4c10 0x7f08cc0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d14ac700 1 -- 172.21.15.50:0/866573244 learned_addr learned my addr 172.21.15.50:0/866573244 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:03.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d0cab700 1 --2- 172.21.15.50:0/866573244 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08cc06d7d0 0x7f08cc06a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d1cad700 1 -- 172.21.15.50:0/866573244 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08cc06d7d0 msgr2=0x7f08cc06a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:03.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d1cad700 1 --2- 172.21.15.50:0/866573244 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08cc06d7d0 0x7f08cc06a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d1cad700 1 -- 172.21.15.50:0/866573244 >> v1:172.21.15.50:6789/0 conn(0x7f08cc0cf050 legacy=0x7f08cc0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:03.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08bffff700 1 -- 172.21.15.50:0/866573244 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082916020 0 0) 0x7f08cc06dc40 con 0x7f08cc0cf050 2023-11-28T11:56:03.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d1cad700 1 -- 172.21.15.50:0/866573244 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc06ac60 con 0x7f08cc0b4c10 2023-11-28T11:56:03.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d1cad700 1 --2- 172.21.15.50:0/866573244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08cc0b4c10 0x7f08cc0cce20 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009d90 tx=0x7f08c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaca7ff27e05d692 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08bffff700 1 -- 172.21.15.50:0/866573244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c400e070 con 0x7f08cc0b4c10 2023-11-28T11:56:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08bffff700 1 -- 172.21.15.50:0/866573244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c400bb20 con 0x7f08cc0b4c10 2023-11-28T11:56:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08bffff700 1 -- 172.21.15.50:0/866573244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4012430 con 0x7f08cc0b4c10 2023-11-28T11:56:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d24ae700 1 -- 172.21.15.50:0/866573244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08cc0b4c10 msgr2=0x7f08cc0cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d24ae700 1 --2- 172.21.15.50:0/866573244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08cc0b4c10 0x7f08cc0cce20 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009d90 tx=0x7f08c400b330 comp rx=0 tx=0).stop 2023-11-28T11:56:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d24ae700 1 -- 172.21.15.50:0/866573244 shutdown_connections 2023-11-28T11:56:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d24ae700 1 --2- 172.21.15.50:0/866573244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08cc0b4c10 0x7f08cc0cce20 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d24ae700 1 --2- 172.21.15.50:0/866573244 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08cc06d7d0 0x7f08cc06a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d24ae700 1 -- 172.21.15.50:0/866573244 >> 172.21.15.50:0/866573244 conn(0x7f08cc09bb30 msgr2=0x7f08cc0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d24ae700 1 -- 172.21.15.50:0/866573244 shutdown_connections 2023-11-28T11:56:03.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.850+0000 7f08d24ae700 1 -- 172.21.15.50:0/866573244 wait complete. 2023-11-28T11:56:03.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d24ae700 1 Processor -- start 2023-11-28T11:56:03.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d24ae700 1 -- start start 2023-11-28T11:56:03.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d24ae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08cc06d7d0 0x7f08cc09cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d24ae700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08cc0b4c10 0x7f08cc15daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d24ae700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08cc0cf050 0x7f08cc159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d24ae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc15e920 con 0x7f08cc06d7d0 2023-11-28T11:56:03.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d24ae700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc15e360 con 0x7f08cc0b4c10 2023-11-28T11:56:03.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d24ae700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc15e640 con 0x7f08cc0cf050 2023-11-28T11:56:03.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d14ac700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08cc06d7d0 0x7f08cc09cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d0cab700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08cc0b4c10 0x7f08cc15daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d14ac700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08cc06d7d0 0x7f08cc09cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59104/0 (socket says 172.21.15.50:59104) 2023-11-28T11:56:03.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d1cad700 1 --2- 172.21.15.50:0/4089099446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08cc0cf050 0x7f08cc159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d14ac700 1 -- 172.21.15.50:0/4089099446 learned_addr learned my addr 172.21.15.50:0/4089099446 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:03.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d0cab700 1 -- 172.21.15.50:0/4089099446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08cc0cf050 msgr2=0x7f08cc159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:03.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d0cab700 1 --2- 172.21.15.50:0/4089099446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08cc0cf050 0x7f08cc159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d0cab700 1 -- 172.21.15.50:0/4089099446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08cc06d7d0 msgr2=0x7f08cc09cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d0cab700 1 --2- 172.21.15.50:0/4089099446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08cc06d7d0 0x7f08cc09cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d0cab700 1 -- 172.21.15.50:0/4089099446 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c4009a70 con 0x7f08cc0b4c10 2023-11-28T11:56:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d0cab700 1 --2- 172.21.15.50:0/4089099446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08cc0b4c10 0x7f08cc15daa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f08c000e900 tx=0x7f08c000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08bdffb700 1 -- 172.21.15.50:0/4089099446 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0013680 con 0x7f08cc0b4c10 2023-11-28T11:56:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08bdffb700 1 -- 172.21.15.50:0/4089099446 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c00137e0 con 0x7f08cc0b4c10 2023-11-28T11:56:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d24ae700 1 -- 172.21.15.50:0/4089099446 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08cc0b4410 con 0x7f08cc0b4c10 2023-11-28T11:56:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08bdffb700 1 -- 172.21.15.50:0/4089099446 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0013b50 con 0x7f08cc0b4c10 2023-11-28T11:56:03.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.854+0000 7f08d24ae700 1 -- 172.21.15.50:0/4089099446 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08cc06af40 con 0x7f08cc0b4c10 2023-11-28T11:56:03.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.858+0000 7f08d24ae700 1 -- 172.21.15.50:0/4089099446 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08cc0b46f0 con 0x7f08cc0b4c10 2023-11-28T11:56:03.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.858+0000 7f08bdffb700 1 -- 172.21.15.50:0/4089099446 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f08c0019030 con 0x7f08cc0b4c10 2023-11-28T11:56:03.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.858+0000 7f08bdffb700 1 --2- 172.21.15.50:0/4089099446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f08b0064f30 0x7f08b00673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:03.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.858+0000 7f08bdffb700 1 -- 172.21.15.50:0/4089099446 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f08c0082190 con 0x7f08cc0b4c10 2023-11-28T11:56:03.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.858+0000 7f08d14ac700 1 --2- 172.21.15.50:0/4089099446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f08b0064f30 0x7f08b00673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:03.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.858+0000 7f08d14ac700 1 --2- 172.21.15.50:0/4089099446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f08b0064f30 0x7f08b00673e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f08c8000f60 tx=0x7f08c8007f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:03.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:03.866+0000 7f08bdffb700 1 -- 172.21.15.50:0/4089099446 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f08c0050180 con 0x7f08cc0b4c10 2023-11-28T11:56:04.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:04.074+0000 7f08d24ae700 1 -- 172.21.15.50:0/4089099446 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f08cc072500 con 0x7f08cc0b4c10 2023-11-28T11:56:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:04.074+0000 7f08bdffb700 1 -- 172.21.15.50:0/4089099446 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f08c0023300 con 0x7f08cc0b4c10 2023-11-28T11:56:04.077 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T11:56:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:04.078+0000 7f08d24ae700 1 -- 172.21.15.50:0/4089099446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f08b0064f30 msgr2=0x7f08b00673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:04.078+0000 7f08d24ae700 1 --2- 172.21.15.50:0/4089099446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f08b0064f30 0x7f08b00673e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f08c8000f60 tx=0x7f08c8007f50 comp rx=0 tx=0).stop 2023-11-28T11:56:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:04.078+0000 7f08d24ae700 1 -- 172.21.15.50:0/4089099446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08cc0b4c10 msgr2=0x7f08cc15daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:04.078+0000 7f08d24ae700 1 --2- 172.21.15.50:0/4089099446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08cc0b4c10 0x7f08cc15daa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f08c000e900 tx=0x7f08c000ec10 comp rx=0 tx=0).stop 2023-11-28T11:56:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:04.078+0000 7f08d24ae700 1 -- 172.21.15.50:0/4089099446 shutdown_connections 2023-11-28T11:56:04.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:04.078+0000 7f08d24ae700 1 --2- 172.21.15.50:0/4089099446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08cc0cf050 0x7f08cc159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:04.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:04.078+0000 7f08d24ae700 1 --2- 172.21.15.50:0/4089099446 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f08b0064f30 0x7f08b00673e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:04.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:04.078+0000 7f08d24ae700 1 --2- 172.21.15.50:0/4089099446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08cc0b4c10 0x7f08cc15daa0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:04.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:04.078+0000 7f08d24ae700 1 --2- 172.21.15.50:0/4089099446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08cc06d7d0 0x7f08cc09cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:04.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:04.078+0000 7f08d24ae700 1 -- 172.21.15.50:0/4089099446 >> 172.21.15.50:0/4089099446 conn(0x7f08cc09bb30 msgr2=0x7f08cc15bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:04.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:04.078+0000 7f08d24ae700 1 -- 172.21.15.50:0/4089099446 shutdown_connections 2023-11-28T11:56:04.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:04.078+0000 7f08d24ae700 1 -- 172.21.15.50:0/4089099446 wait complete. 2023-11-28T11:56:04.095 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:56:04.095 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:56:04.096 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-11-28T11:56:04.096 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T11:56:04.096 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T11:56:04.096 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:56:04.096 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T11:56:04.096 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:56:04.097 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:56:04.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:04.097 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-11-28T11:56:04.103 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:56:04.104 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:56:04.104 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:56:04.104 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:04.104 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-11-28T11:56:04.104 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:04.104 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:56:04.104 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:56:04.104 INFO:teuthology.orchestra.run.smithi050.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:56:04.105 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:56:04.105 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T11:56:04.105 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42428sec preferred_lft 42428sec 2023-11-28T11:56:04.105 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-11-28T11:56:04.105 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:04.105 INFO:teuthology.orchestra.run.smithi050.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:56:04.105 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:56:04.105 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:56:04.106 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:56:04.106 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T11:56:04.106 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:5d:90:5e:15 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:56:04.106 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T11:56:04.106 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:04.106 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:56:04.106 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether da:3b:9e:d1:db:b2 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:56:04.106 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T11:56:04.106 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:04.107 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::8086:d1ff:fed7:f4c8/64 scope link 2023-11-28T11:56:04.107 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:04.107 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:56:04.108 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether da:3b:9e:d1:db:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T11:56:04.108 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d83b:9eff:fed1:dbb2/64 scope link 2023-11-28T11:56:04.108 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:04.108 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:56:04.108 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether fa:16:94:5d:56:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T11:56:04.108 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f816:94ff:fe5d:5673/64 scope link 2023-11-28T11:56:04.109 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:04.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:04.109 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:56:04.123 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-11-28T11:56:04.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:04.125 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-11-28T11:56:04.176 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-11-28T11:56:04.176 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:56:04.176 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T11:56:04.176 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T11:56:04.176 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T11:56:04.176 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:56:04.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:04.177 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-11-28T11:56:04.177 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-11-28T11:56:04.177 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T11:56:04.177 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T11:56:04.177 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T11:56:04.177 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-11-28T11:56:04.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:04.217 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-11-28T11:56:04.224 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T11:56:04.224 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T11:56:04.224 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:56:04.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:04.224 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-11-28T11:56:04.283 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T11:56:04.283 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:56:04.284 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T11:56:04.288 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:56:04.288 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:56:04.289 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:56:04.293 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:56:04.310 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:56:04.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:56:04.320 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:56:04.321 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:56:04.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:04.322 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:56:04.369 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T11:56:04.369 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-28T11:56:04.371 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:56:04.398 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:56:04.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:56:04.452 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:56:04.452 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:56:04.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:04.453 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:56:04.477 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:2023-11-28T11:56:04.466+0000 7fe3dc0ed640 -1 init, newargv = 0x55a5cd686970 newargc=15 2023-11-28T11:56:04.477 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[49706]: starting ceph client 2023-11-28T11:56:04.478 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[49706]: starting fuse 2023-11-28T11:56:05.577 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:56:05.600 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:56:05.600 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:56:05.659 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:56:05.660 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:56:05.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:05.661 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:56:05.668 INFO:teuthology.orchestra.run.smithi050.stdout:52 2023-11-28T11:56:05.668 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-28T11:56:05.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:56:05.669 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-11-28T11:56:05.669 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-11-28T11:56:05.669 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-11-28T11:56:05.669 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-11-28T11:56:05.669 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:56:05.669 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-11-28T11:56:05.669 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T11:56:05.669 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-11-28T11:56:05.669 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T11:56:05.669 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:56:05.669 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-11-28T11:56:05.669 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-11-28T11:56:05.669 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-11-28T11:56:05.669 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-11-28T11:56:05.670 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:56:05.670 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-11-28T11:56:05.670 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T11:56:05.670 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T11:56:05.670 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T11:56:05.670 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-11-28T11:56:05.670 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-11-28T11:56:05.670 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-11-28T11:56:05.670 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T11:56:05.670 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:56:05.670 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.0")) 2023-11-28T11:56:05.670 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-11-28T11:56:05.754 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.0.49706.asok 2023-11-28T11:56:05.938 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49706.asok 2023-11-28T11:56:05.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:05.939 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49706.asok status 2023-11-28T11:56:06.045 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:56:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-11-28T11:56:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T11:56:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T11:56:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "0", 2023-11-28T11:56:06.045 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-11-28T11:56:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T11:56:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "49706", 2023-11-28T11:56:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-11-28T11:56:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-11-28T11:56:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-11-28T11:56:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6225, 2023-11-28T11:56:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-11-28T11:56:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-11-28T11:56:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-11-28T11:56:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 6225 2023-11-28T11:56:06.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-11-28T11:56:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-11-28T11:56:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:56:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 477071032 2023-11-28T11:56:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-11-28T11:56:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-11-28T11:56:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:56:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 477071032 2023-11-28T11:56:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:06.047 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.6225 192.168.0.1:0/477071032", 2023-11-28T11:56:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/477071032", 2023-11-28T11:56:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-11-28T11:56:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 25, 2023-11-28T11:56:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 54, 2023-11-28T11:56:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-11-28T11:56:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-11-28T11:56:06.048 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-11-28T11:56:06.048 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:56:06.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:06.056 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-11-28T11:56:06.056 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T11:56:06.061 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-11-28T11:56:06.062 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T11:56:06.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:06.062 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:56:06.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:06.074 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2023-11-28T11:56:06.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:06.092 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2023-11-28T11:56:06.106 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:56:06.106 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-11-28T11:56:06.106 DEBUG:teuthology.orchestra.run.smithi050:> import stat 2023-11-28T11:56:06.106 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:56:06.106 DEBUG:teuthology.orchestra.run.smithi050:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2023-11-28T11:56:06.106 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-11-28T11:56:06.220 INFO:teuthology.orchestra.run.smithi050.stdout:1099511627777 2023-11-28T11:56:06.233 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:56:06.236 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:56:06.408 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:56:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e81c59700 1 Processor -- start 2023-11-28T11:56:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e81c59700 1 -- start start 2023-11-28T11:56:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e81c59700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5e7c0ad490 0x7f5e7c0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e81c59700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7c0cd8f0 con 0x7f5e7c0cb460 2023-11-28T11:56:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e81c59700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7c06dc60 con 0x7f5e7c158e60 2023-11-28T11:56:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e81c59700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7c0add00 con 0x7f5e7c0ad490 2023-11-28T11:56:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e7bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5e7c0cb460 0x7f5e7c06c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33628/0 (socket says 172.21.15.50:33628) 2023-11-28T11:56:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e7bfff700 1 -- 172.21.15.50:0/1313119614 learned_addr learned my addr 172.21.15.50:0/1313119614 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e81458700 1 --2- 172.21.15.50:0/1313119614 >> v2:172.21.15.192:3300/0 conn(0x7f5e7c0ad490 0x7f5e7c0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:06.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e7b7fe700 1 -- 172.21.15.50:0/1313119614 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372175905 0 0) 0x7f5e7c0cd8f0 con 0x7f5e7c0cb460 2023-11-28T11:56:06.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e7b7fe700 1 -- 172.21.15.50:0/1313119614 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e640035d0 con 0x7f5e7c0cb460 2023-11-28T11:56:06.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e81458700 1 -- 172.21.15.50:0/1313119614 >> v1:172.21.15.192:6789/0 conn(0x7f5e7c158e60 legacy=0x7f5e7c0cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:06.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e81458700 1 -- 172.21.15.50:0/1313119614 >> v1:172.21.15.50:6789/0 conn(0x7f5e7c0cb460 legacy=0x7f5e7c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:06.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e81458700 1 -- 172.21.15.50:0/1313119614 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c0cde90 con 0x7f5e7c0ad490 2023-11-28T11:56:06.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e81458700 1 --2- 172.21.15.50:0/1313119614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e7c0ad490 0x7f5e7c0c8a30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009d90 tx=0x7f5e7400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e4a58f9ed075fa4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:06.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e7b7fe700 1 -- 172.21.15.50:0/1313119614 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7400e070 con 0x7f5e7c0ad490 2023-11-28T11:56:06.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e7b7fe700 1 -- 172.21.15.50:0/1313119614 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7400bb20 con 0x7f5e7c0ad490 2023-11-28T11:56:06.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e7b7fe700 1 -- 172.21.15.50:0/1313119614 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7400be90 con 0x7f5e7c0ad490 2023-11-28T11:56:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e81c59700 1 -- 172.21.15.50:0/1313119614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e7c0ad490 msgr2=0x7f5e7c0c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.530+0000 7f5e81c59700 1 --2- 172.21.15.50:0/1313119614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e7c0ad490 0x7f5e7c0c8a30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009d90 tx=0x7f5e7400b330 comp rx=0 tx=0).stop 2023-11-28T11:56:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.534+0000 7f5e81c59700 1 -- 172.21.15.50:0/1313119614 shutdown_connections 2023-11-28T11:56:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.534+0000 7f5e81c59700 1 --2- 172.21.15.50:0/1313119614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e7c0ad490 0x7f5e7c0c8a30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.534+0000 7f5e81c59700 1 -- 172.21.15.50:0/1313119614 >> 172.21.15.50:0/1313119614 conn(0x7f5e7c0ce3e0 msgr2=0x7f5e7c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.534+0000 7f5e81c59700 1 -- 172.21.15.50:0/1313119614 shutdown_connections 2023-11-28T11:56:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.534+0000 7f5e81c59700 1 -- 172.21.15.50:0/1313119614 wait complete. 2023-11-28T11:56:06.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.534+0000 7f5e81c59700 1 Processor -- start 2023-11-28T11:56:06.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.534+0000 7f5e81c59700 1 -- start start 2023-11-28T11:56:06.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e81c59700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e7c0ad490 0x7f5e7c0c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:06.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e81c59700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e7c0cb460 0x7f5e7c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:06.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e81c59700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e7c158e60 0x7f5e7c165e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:06.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e81c59700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c14bef0 con 0x7f5e7c0ad490 2023-11-28T11:56:06.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e81c59700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c14fb40 con 0x7f5e7c0cb460 2023-11-28T11:56:06.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e81c59700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c14fe20 con 0x7f5e7c158e60 2023-11-28T11:56:06.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e80c57700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e7c0ad490 0x7f5e7c0c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:06.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e80c57700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e7c0ad490 0x7f5e7c0c1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59112/0 (socket says 172.21.15.50:59112) 2023-11-28T11:56:06.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e80c57700 1 -- 172.21.15.50:0/3185696927 learned_addr learned my addr 172.21.15.50:0/3185696927 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:06.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e7bfff700 1 --2- 172.21.15.50:0/3185696927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e7c0cb460 0x7f5e7c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:06.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e81458700 1 --2- 172.21.15.50:0/3185696927 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e7c158e60 0x7f5e7c165e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:06.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e80c57700 1 -- 172.21.15.50:0/3185696927 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e7c158e60 msgr2=0x7f5e7c165e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:06.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e80c57700 1 --2- 172.21.15.50:0/3185696927 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e7c158e60 0x7f5e7c165e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:06.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e80c57700 1 -- 172.21.15.50:0/3185696927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e7c0cb460 msgr2=0x7f5e7c071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:06.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e80c57700 1 --2- 172.21.15.50:0/3185696927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e7c0cb460 0x7f5e7c071190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:06.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e80c57700 1 -- 172.21.15.50:0/3185696927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e74009a70 con 0x7f5e7c0ad490 2023-11-28T11:56:06.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e80c57700 1 --2- 172.21.15.50:0/3185696927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e7c0ad490 0x7f5e7c0c1d40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5e7000c410 tx=0x7f5e7000c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:06.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e797fa700 1 -- 172.21.15.50:0/3185696927 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e700052d0 con 0x7f5e7c0ad490 2023-11-28T11:56:06.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e797fa700 1 -- 172.21.15.50:0/3185696927 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e70005430 con 0x7f5e7c0ad490 2023-11-28T11:56:06.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e81c59700 1 -- 172.21.15.50:0/3185696927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7c06d6a0 con 0x7f5e7c0ad490 2023-11-28T11:56:06.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e797fa700 1 -- 172.21.15.50:0/3185696927 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e700055a0 con 0x7f5e7c0ad490 2023-11-28T11:56:06.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.538+0000 7f5e81c59700 1 -- 172.21.15.50:0/3185696927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7c159230 con 0x7f5e7c0ad490 2023-11-28T11:56:06.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.542+0000 7f5e81c59700 1 -- 172.21.15.50:0/3185696927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7c06d980 con 0x7f5e7c0ad490 2023-11-28T11:56:06.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.542+0000 7f5e797fa700 1 -- 172.21.15.50:0/3185696927 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5e70010050 con 0x7f5e7c0ad490 2023-11-28T11:56:06.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.542+0000 7f5e797fa700 1 --2- 172.21.15.50:0/3185696927 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5e68064ee0 0x7f5e68067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:06.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.542+0000 7f5e797fa700 1 -- 172.21.15.50:0/3185696927 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5e70080fc0 con 0x7f5e7c0ad490 2023-11-28T11:56:06.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.542+0000 7f5e7bfff700 1 --2- 172.21.15.50:0/3185696927 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5e68064ee0 0x7f5e68067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:06.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.542+0000 7f5e7bfff700 1 --2- 172.21.15.50:0/3185696927 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5e68064ee0 0x7f5e68067390 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c0abc10 tx=0x7f5e6c007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:06.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.550+0000 7f5e797fa700 1 -- 172.21.15.50:0/3185696927 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5e70049400 con 0x7f5e7c0ad490 2023-11-28T11:56:06.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.750+0000 7f5e81c59700 1 -- 172.21.15.50:0/3185696927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e7c150340 con 0x7f5e7c0ad490 2023-11-28T11:56:06.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.754+0000 7f5e797fa700 1 -- 172.21.15.50:0/3185696927 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f5e7004efc0 con 0x7f5e7c0ad490 2023-11-28T11:56:06.755 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:06.755 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2341737190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2341737190},{"type":"v1","addr":"172.21.15.50:6835","nonce":2341737190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5546,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/192527628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":192527628},{"type":"v1","addr":"172.21.15.192:6835","nonce":192527628}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5549,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2304989740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2304989740},{"type":"v1","addr":"172.21.15.192:6837","nonce":2304989740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:55:57.946191+0000","modified":"2023-11-28T11:56:00.964614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6057":{"gid":6057,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/1163863991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1163863991},{"type":"v1","addr":"172.21.15.50:6834","nonce":1163863991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:56:06.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.754+0000 7f5e81c59700 1 -- 172.21.15.50:0/3185696927 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5e68064ee0 msgr2=0x7f5e68067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:06.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.754+0000 7f5e81c59700 1 --2- 172.21.15.50:0/3185696927 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5e68064ee0 0x7f5e68067390 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c0abc10 tx=0x7f5e6c007de0 comp rx=0 tx=0).stop 2023-11-28T11:56:06.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.754+0000 7f5e81c59700 1 -- 172.21.15.50:0/3185696927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e7c0ad490 msgr2=0x7f5e7c0c1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:06.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.754+0000 7f5e81c59700 1 --2- 172.21.15.50:0/3185696927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e7c0ad490 0x7f5e7c0c1d40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5e7000c410 tx=0x7f5e7000c720 comp rx=0 tx=0).stop 2023-11-28T11:56:06.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.754+0000 7f5e81c59700 1 -- 172.21.15.50:0/3185696927 shutdown_connections 2023-11-28T11:56:06.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.754+0000 7f5e81c59700 1 --2- 172.21.15.50:0/3185696927 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e7c158e60 0x7f5e7c165e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:06.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.754+0000 7f5e81c59700 1 --2- 172.21.15.50:0/3185696927 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5e68064ee0 0x7f5e68067390 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:06.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.754+0000 7f5e81c59700 1 --2- 172.21.15.50:0/3185696927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e7c0cb460 0x7f5e7c071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:06.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.754+0000 7f5e81c59700 1 --2- 172.21.15.50:0/3185696927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e7c0ad490 0x7f5e7c0c1d40 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:06.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.754+0000 7f5e81c59700 1 -- 172.21.15.50:0/3185696927 >> 172.21.15.50:0/3185696927 conn(0x7f5e7c0ce3e0 msgr2=0x7f5e7c069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:06.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.754+0000 7f5e81c59700 1 -- 172.21.15.50:0/3185696927 shutdown_connections 2023-11-28T11:56:06.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.754+0000 7f5e81c59700 1 -- 172.21.15.50:0/3185696927 wait complete. 2023-11-28T11:56:06.759 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2023-11-28T11:56:06.775 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-11-28T11:56:06.912 INFO:teuthology.orchestra.run.smithi050.stdout:{"message":"","return_code":0} 2023-11-28T11:56:06.912 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T11:56:06.913 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-28T11:56:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.950+0000 7f54f4c3d140 1 Processor -- start 2023-11-28T11:56:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.950+0000 7f54f4c3d140 1 -- start start 2023-11-28T11:56:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.950+0000 7f54f4c3d140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55caa5f986c0 0x55caa60286a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.950+0000 7f54f4c3d140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55caa6040580 0x55caa6026bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.950+0000 7f54f4c3d140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55caa6040950 0x55caa5fb45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.950+0000 7f54f4c3d140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caa5e90240 con 0x55caa6040580 2023-11-28T11:56:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.950+0000 7f54f4c3d140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caa6028be0 con 0x55caa6040950 2023-11-28T11:56:06.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.950+0000 7f54f4c3d140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55caa602a000 con 0x55caa5f986c0 2023-11-28T11:56:06.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.950+0000 7f54f1f71700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55caa6040580 0x55caa6026bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:06.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.950+0000 7f54f1f71700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55caa6040580 0x55caa6026bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59128/0 (socket says 172.21.15.50:59128) 2023-11-28T11:56:06.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.950+0000 7f54f1f71700 1 -- 172.21.15.50:0/439670522 learned_addr learned my addr 172.21.15.50:0/439670522 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:06.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.950+0000 7f54f2f73700 1 --2- 172.21.15.50:0/439670522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55caa6040950 0x55caa5fb45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:06.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.950+0000 7f54f2772700 1 --2- 172.21.15.50:0/439670522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55caa5f986c0 0x55caa60286a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:06.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f1f71700 1 -- 172.21.15.50:0/439670522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55caa5f986c0 msgr2=0x55caa60286a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:06.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f1f71700 1 --2- 172.21.15.50:0/439670522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55caa5f986c0 0x55caa60286a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:06.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f1f71700 1 -- 172.21.15.50:0/439670522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55caa6040950 msgr2=0x55caa5fb45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:06.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f1f71700 1 --2- 172.21.15.50:0/439670522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55caa6040950 0x55caa5fb45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:06.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f1f71700 1 -- 172.21.15.50:0/439670522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc00a100 con 0x55caa6040580 2023-11-28T11:56:06.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f1f71700 1 --2- 172.21.15.50:0/439670522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55caa6040580 0x55caa6026bd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00a950 tx=0x7f54dc005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b9e7e8556a5f30 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:06.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f0f6f700 1 -- 172.21.15.50:0/439670522 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc012660 con 0x55caa6040580 2023-11-28T11:56:06.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f0f6f700 1 -- 172.21.15.50:0/439670522 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc0127c0 con 0x55caa6040580 2023-11-28T11:56:06.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f0f6f700 1 -- 172.21.15.50:0/439670522 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc012b30 con 0x55caa6040580 2023-11-28T11:56:06.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f4c3d140 1 -- 172.21.15.50:0/439670522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55caa6040580 msgr2=0x55caa6026bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:06.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f4c3d140 1 --2- 172.21.15.50:0/439670522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55caa6040580 0x55caa6026bd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00a950 tx=0x7f54dc005d80 comp rx=0 tx=0).stop 2023-11-28T11:56:06.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f4c3d140 1 -- 172.21.15.50:0/439670522 shutdown_connections 2023-11-28T11:56:06.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f4c3d140 1 --2- 172.21.15.50:0/439670522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55caa6040950 0x55caa5fb45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:06.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f4c3d140 1 --2- 172.21.15.50:0/439670522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55caa6040580 0x55caa6026bd0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:06.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f4c3d140 1 --2- 172.21.15.50:0/439670522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55caa5f986c0 0x55caa60286a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:06.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f4c3d140 1 -- 172.21.15.50:0/439670522 >> 172.21.15.50:0/439670522 conn(0x55caa5f972b0 msgr2=0x55caa5f692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:06.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f4c3d140 1 -- 172.21.15.50:0/439670522 shutdown_connections 2023-11-28T11:56:06.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f4c3d140 1 -- 172.21.15.50:0/439670522 wait complete. 2023-11-28T11:56:06.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f4c3d140 1 Processor -- start 2023-11-28T11:56:06.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.954+0000 7f54f4c3d140 1 -- start start 2023-11-28T11:56:06.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f4c3d140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55caa5f986c0 0x55caa60d59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:06.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f4c3d140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55caa6040580 0x55caa6027600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:06.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f4c3d140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55caa6040950 0x55caa5fafd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:06.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f4c3d140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caa60d5f30 con 0x55caa6040950 2023-11-28T11:56:06.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f4c3d140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caa5fae120 con 0x55caa5f986c0 2023-11-28T11:56:06.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f4c3d140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55caa5fae3c0 con 0x55caa6040580 2023-11-28T11:56:06.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f2f73700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55caa6040950 0x55caa5fafd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:06.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f2772700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55caa5f986c0 0x55caa60d59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:06.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f1f71700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55caa6040580 0x55caa6027600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:06.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f2f73700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55caa6040950 0x55caa5fafd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59138/0 (socket says 172.21.15.50:59138) 2023-11-28T11:56:06.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f2f73700 1 -- 172.21.15.50:0/1888529824 learned_addr learned my addr 172.21.15.50:0/1888529824 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:06.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f2f73700 1 -- 172.21.15.50:0/1888529824 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55caa6040580 msgr2=0x55caa6027600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:06.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f2f73700 1 --2- 172.21.15.50:0/1888529824 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55caa6040580 0x55caa6027600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:06.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f2f73700 1 -- 172.21.15.50:0/1888529824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55caa5f986c0 msgr2=0x55caa60d59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:06.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f2f73700 1 --2- 172.21.15.50:0/1888529824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55caa5f986c0 0x55caa60d59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:06.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f2f73700 1 -- 172.21.15.50:0/1888529824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc00a580 con 0x55caa6040950 2023-11-28T11:56:06.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f2f73700 1 --2- 172.21.15.50:0/1888529824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55caa6040950 0x55caa5fafd00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f54e400af90 tx=0x7f54e4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:06.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54eb7fe700 1 -- 172.21.15.50:0/1888529824 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e4008690 con 0x55caa6040950 2023-11-28T11:56:06.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54eb7fe700 1 -- 172.21.15.50:0/1888529824 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e4020070 con 0x55caa6040950 2023-11-28T11:56:06.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f4c3d140 1 -- 172.21.15.50:0/1888529824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55caa5e9b8b0 con 0x55caa6040950 2023-11-28T11:56:06.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54eb7fe700 1 -- 172.21.15.50:0/1888529824 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e401cab0 con 0x55caa6040950 2023-11-28T11:56:06.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.958+0000 7f54f4c3d140 1 -- 172.21.15.50:0/1888529824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e4005de0 con 0x55caa6040950 2023-11-28T11:56:06.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.962+0000 7f54eb7fe700 1 -- 172.21.15.50:0/1888529824 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f54e401cc10 con 0x55caa6040950 2023-11-28T11:56:06.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.962+0000 7f54eb7fe700 1 --2- 172.21.15.50:0/1888529824 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f54d4063810 0x7f54d4065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:06.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.962+0000 7f54eb7fe700 1 -- 172.21.15.50:0/1888529824 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f54e4082520 con 0x55caa6040950 2023-11-28T11:56:06.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.962+0000 7f54f2772700 1 --2- 172.21.15.50:0/1888529824 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f54d4063810 0x7f54d4065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:06.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.962+0000 7f54f4c3d140 1 --2- 172.21.15.50:0/1888529824 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x55caa6027b40 0x55caa6025ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:06.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.962+0000 7f54f4c3d140 1 -- 172.21.15.50:0/1888529824 --> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54) v8 -- 0x55caa5faeda0 con 0x55caa6027b40 2023-11-28T11:56:06.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.962+0000 7f54f1f71700 1 --2- 172.21.15.50:0/1888529824 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x55caa6027b40 0x55caa6025ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:06.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.962+0000 7f54f2772700 1 --2- 172.21.15.50:0/1888529824 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f54d4063810 0x7f54d4065cc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f54ec000c00 tx=0x7f54ec001740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:06.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.962+0000 7f54f1f71700 1 --2- 172.21.15.50:0/1888529824 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x55caa6027b40 0x55caa6025ee0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:06.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.966+0000 7f54f1f71700 1 -- 172.21.15.50:0/1888529824 <== osd.5 v2:172.21.15.192:6802/36817 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f54dc019070 con 0x55caa6027b40 2023-11-28T11:56:06.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.966+0000 7f54f4c3d140 1 -- 172.21.15.50:0/1888529824 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x55caa6027b40 msgr2=0x55caa6025ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:06.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.966+0000 7f54f4c3d140 1 --2- 172.21.15.50:0/1888529824 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x55caa6027b40 0x55caa6025ee0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:06.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.966+0000 7f54f4c3d140 1 -- 172.21.15.50:0/1888529824 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f54d4063810 msgr2=0x7f54d4065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:06.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.966+0000 7f54f4c3d140 1 --2- 172.21.15.50:0/1888529824 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f54d4063810 0x7f54d4065cc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f54ec000c00 tx=0x7f54ec001740 comp rx=0 tx=0).stop 2023-11-28T11:56:06.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.966+0000 7f54f4c3d140 1 -- 172.21.15.50:0/1888529824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55caa6040950 msgr2=0x55caa5fafd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:06.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.966+0000 7f54f4c3d140 1 --2- 172.21.15.50:0/1888529824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55caa6040950 0x55caa5fafd00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f54e400af90 tx=0x7f54e4002fb0 comp rx=0 tx=0).stop 2023-11-28T11:56:06.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.966+0000 7f54f2f73700 1 -- 172.21.15.50:0/1888529824 reap_dead start 2023-11-28T11:56:06.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.966+0000 7f54f4c3d140 1 -- 172.21.15.50:0/1888529824 shutdown_connections 2023-11-28T11:56:06.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.966+0000 7f54f4c3d140 1 -- 172.21.15.50:0/1888529824 >> 172.21.15.50:0/1888529824 conn(0x55caa5f972b0 msgr2=0x55caa6040d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:06.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.966+0000 7f54f4c3d140 1 -- 172.21.15.50:0/1888529824 shutdown_connections 2023-11-28T11:56:06.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:06.966+0000 7f54f4c3d140 1 -- 172.21.15.50:0/1888529824 wait complete. 2023-11-28T11:56:06.972 INFO:teuthology.orchestra.run.smithi050.stdout:Yalphaparent_a 2023-11-28T11:56:06.973 DEBUG:teuthology.orchestra.run.smithi050:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-28T11:56:07.030 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:56:07.030 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511627777, 2023-11-28T11:56:07.030 INFO:teuthology.orchestra.run.smithi050.stdout: "ancestors": [ 2023-11-28T11:56:07.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: "dirino": 1099511627776, 2023-11-28T11:56:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: "dname": "alpha", 2023-11-28T11:56:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 2 2023-11-28T11:56:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: "dirino": 1, 2023-11-28T11:56:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: "dname": "parent_a", 2023-11-28T11:56:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 4 2023-11-28T11:56:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-11-28T11:56:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 9, 2023-11-28T11:56:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: "old_pools": [] 2023-11-28T11:56:07.031 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:56:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:07.033 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2023-11-28T11:56:07.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.066+0000 7f1989fc3140 1 Processor -- start 2023-11-28T11:56:07.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.066+0000 7f1989fc3140 1 -- start start 2023-11-28T11:56:07.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f1989fc3140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1974002440 0x561e36926310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f1989fc3140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561e36849f10 0x561e3684d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f1989fc3140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e3684a2e0 0x561e3684da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f1989fc3140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e367df180 con 0x561e3684a2e0 2023-11-28T11:56:07.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f1989fc3140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e36772240 con 0x7f1974002440 2023-11-28T11:56:07.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f1989fc3140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e36894410 con 0x561e36849f10 2023-11-28T11:56:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f1987af8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1974002440 0x561e36926310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f19882f9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e3684a2e0 0x561e3684da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f1987af8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1974002440 0x561e36926310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:59616/0 (socket says 172.21.15.50:59616) 2023-11-28T11:56:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f1987af8700 1 -- 172.21.15.50:0/3088859595 learned_addr learned my addr 172.21.15.50:0/3088859595 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f19872f7700 1 --2- 172.21.15.50:0/3088859595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561e36849f10 0x561e3684d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f1987af8700 1 -- 172.21.15.50:0/3088859595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561e36849f10 msgr2=0x561e3684d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f1987af8700 1 --2- 172.21.15.50:0/3088859595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561e36849f10 0x561e3684d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f1987af8700 1 -- 172.21.15.50:0/3088859595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e3684a2e0 msgr2=0x561e3684da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f1987af8700 1 --2- 172.21.15.50:0/3088859595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e3684a2e0 0x561e3684da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f1987af8700 1 -- 172.21.15.50:0/3088859595 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e3678a5d0 con 0x7f1974002440 2023-11-28T11:56:07.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f19882f9700 1 --2- 172.21.15.50:0/3088859595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e3684a2e0 0x561e3684da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:07.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f1987af8700 1 --2- 172.21.15.50:0/3088859595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1974002440 0x561e36926310 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f197800b3c0 tx=0x7f1978009000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c285326a635cfc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f19862f5700 1 -- 172.21.15.50:0/3088859595 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978006390 con 0x7f1974002440 2023-11-28T11:56:07.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f19862f5700 1 -- 172.21.15.50:0/3088859595 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1978001db0 con 0x7f1974002440 2023-11-28T11:56:07.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.070+0000 7f19862f5700 1 -- 172.21.15.50:0/3088859595 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978001950 con 0x7f1974002440 2023-11-28T11:56:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1989fc3140 1 -- 172.21.15.50:0/3088859595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1974002440 msgr2=0x561e36926310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1989fc3140 1 --2- 172.21.15.50:0/3088859595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1974002440 0x561e36926310 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f197800b3c0 tx=0x7f1978009000 comp rx=0 tx=0).stop 2023-11-28T11:56:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1989fc3140 1 -- 172.21.15.50:0/3088859595 shutdown_connections 2023-11-28T11:56:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1989fc3140 1 --2- 172.21.15.50:0/3088859595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e3684a2e0 0x561e3684da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1989fc3140 1 --2- 172.21.15.50:0/3088859595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561e36849f10 0x561e3684d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1989fc3140 1 --2- 172.21.15.50:0/3088859595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1974002440 0x561e36926310 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1989fc3140 1 -- 172.21.15.50:0/3088859595 >> 172.21.15.50:0/3088859595 conn(0x561e36849b40 msgr2=0x561e3684e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1989fc3140 1 -- 172.21.15.50:0/3088859595 shutdown_connections 2023-11-28T11:56:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1989fc3140 1 -- 172.21.15.50:0/3088859595 wait complete. 2023-11-28T11:56:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1989fc3140 1 Processor -- start 2023-11-28T11:56:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1989fc3140 1 -- start start 2023-11-28T11:56:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1989fc3140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e36849f10 0x561e3688c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1989fc3140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e3684a2e0 0x561e369b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1989fc3140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1974002440 0x561e3684d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1989fc3140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e369b1ff0 con 0x561e36849f10 2023-11-28T11:56:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1989fc3140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e369b21f0 con 0x561e3684a2e0 2023-11-28T11:56:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1989fc3140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e3688cde0 con 0x7f1974002440 2023-11-28T11:56:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1987af8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e36849f10 0x561e3688c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1987af8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e36849f10 0x561e3688c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59180/0 (socket says 172.21.15.50:59180) 2023-11-28T11:56:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1987af8700 1 -- 172.21.15.50:0/345991865 learned_addr learned my addr 172.21.15.50:0/345991865 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f19872f7700 1 --2- 172.21.15.50:0/345991865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e3684a2e0 0x561e369b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f19882f9700 1 --2- 172.21.15.50:0/345991865 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1974002440 0x561e3684d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1987af8700 1 -- 172.21.15.50:0/345991865 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1974002440 msgr2=0x561e3684d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1987af8700 1 --2- 172.21.15.50:0/345991865 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1974002440 0x561e3684d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1987af8700 1 -- 172.21.15.50:0/345991865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e3684a2e0 msgr2=0x561e369b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1987af8700 1 --2- 172.21.15.50:0/345991865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e3684a2e0 0x561e369b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1987af8700 1 -- 172.21.15.50:0/345991865 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1980009410 con 0x561e36849f10 2023-11-28T11:56:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.074+0000 7f1987af8700 1 --2- 172.21.15.50:0/345991865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e36849f10 0x561e3688c570 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1978014040 tx=0x7f1978001c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.078+0000 7f19852f3700 1 -- 172.21.15.50:0/345991865 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978006400 con 0x561e36849f10 2023-11-28T11:56:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.078+0000 7f19852f3700 1 -- 172.21.15.50:0/345991865 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197800b430 con 0x561e36849f10 2023-11-28T11:56:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.078+0000 7f1989fc3140 1 -- 172.21.15.50:0/345991865 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1974001e10 con 0x561e36849f10 2023-11-28T11:56:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.078+0000 7f19852f3700 1 -- 172.21.15.50:0/345991865 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197800ba80 con 0x561e36849f10 2023-11-28T11:56:07.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.078+0000 7f1989fc3140 1 -- 172.21.15.50:0/345991865 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e3687bbb0 con 0x561e36849f10 2023-11-28T11:56:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.078+0000 7f19852f3700 1 -- 172.21.15.50:0/345991865 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f197800f070 con 0x561e36849f10 2023-11-28T11:56:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.078+0000 7f19852f3700 1 --2- 172.21.15.50:0/345991865 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1968063810 0x7f1968065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.078+0000 7f19852f3700 1 -- 172.21.15.50:0/345991865 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1978082a60 con 0x561e36849f10 2023-11-28T11:56:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.078+0000 7f1989fc3140 1 --2- 172.21.15.50:0/345991865 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x561e3684da60 0x561e369c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.078+0000 7f19872f7700 1 --2- 172.21.15.50:0/345991865 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1968063810 0x7f1968065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.078+0000 7f1989fc3140 1 -- 172.21.15.50:0/345991865 --> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54) v8 -- 0x561e369bda10 con 0x561e3684da60 2023-11-28T11:56:07.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.082+0000 7f19882f9700 1 --2- 172.21.15.50:0/345991865 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x561e3684da60 0x561e369c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.082+0000 7f19872f7700 1 --2- 172.21.15.50:0/345991865 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1968063810 0x7f1968065cc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f19700010e0 tx=0x7f1970003900 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.082+0000 7f19882f9700 1 --2- 172.21.15.50:0/345991865 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x561e3684da60 0x561e369c8ab0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.086+0000 7f19882f9700 1 -- 172.21.15.50:0/345991865 <== osd.5 v2:172.21.15.192:6802/36817 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v54'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f1980012040 con 0x561e3684da60 2023-11-28T11:56:07.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.086+0000 7f1989fc3140 1 -- 172.21.15.50:0/345991865 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x561e3684da60 msgr2=0x561e369c8ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.086+0000 7f1989fc3140 1 --2- 172.21.15.50:0/345991865 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x561e3684da60 0x561e369c8ab0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.086+0000 7f1989fc3140 1 -- 172.21.15.50:0/345991865 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1968063810 msgr2=0x7f1968065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.086+0000 7f1989fc3140 1 --2- 172.21.15.50:0/345991865 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1968063810 0x7f1968065cc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f19700010e0 tx=0x7f1970003900 comp rx=0 tx=0).stop 2023-11-28T11:56:07.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.086+0000 7f1989fc3140 1 -- 172.21.15.50:0/345991865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e36849f10 msgr2=0x561e3688c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.086+0000 7f1989fc3140 1 --2- 172.21.15.50:0/345991865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e36849f10 0x561e3688c570 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1978014040 tx=0x7f1978001c30 comp rx=0 tx=0).stop 2023-11-28T11:56:07.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.086+0000 7f19882f9700 1 -- 172.21.15.50:0/345991865 reap_dead start 2023-11-28T11:56:07.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.086+0000 7f1989fc3140 1 -- 172.21.15.50:0/345991865 shutdown_connections 2023-11-28T11:56:07.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.086+0000 7f1989fc3140 1 -- 172.21.15.50:0/345991865 >> 172.21.15.50:0/345991865 conn(0x561e36849b40 msgr2=0x561e36924ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:07.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.086+0000 7f1989fc3140 1 -- 172.21.15.50:0/345991865 shutdown_connections 2023-11-28T11:56:07.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.086+0000 7f1989fc3140 1 -- 172.21.15.50:0/345991865 wait complete. 2023-11-28T11:56:07.091 DEBUG:teuthology.orchestra.run.smithi050:> sudo daemon-helper kill ceph --cluster ceph -w 2023-11-28T11:56:07.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2023-11-28T11:56:07.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.258+0000 7f0d9ffff700 1 Processor -- start 2023-11-28T11:56:07.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.258+0000 7f0d9ffff700 1 -- start start 2023-11-28T11:56:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.258+0000 7f0d9ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0da0159fa0 0x7f0da00b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.258+0000 7f0d9ffff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da015a370 con 0x7f0da00cd710 2023-11-28T11:56:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.258+0000 7f0d9ffff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da00cff70 con 0x7f0da00b1300 2023-11-28T11:56:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.258+0000 7f0d9ffff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da00d0250 con 0x7f0da0159fa0 2023-11-28T11:56:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.258+0000 7f0d9f7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0da00cd710 0x7f0da00b0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33640/0 (socket says 172.21.15.50:33640) 2023-11-28T11:56:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.258+0000 7f0d9f7fe700 1 -- 172.21.15.50:0/3918900272 learned_addr learned my addr 172.21.15.50:0/3918900272 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.258+0000 7f0d9effd700 1 --2- 172.21.15.50:0/3918900272 >> v2:172.21.15.192:3300/0 conn(0x7f0da0159fa0 0x7f0da00b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.258+0000 7f0d9e7fc700 1 -- 172.21.15.50:0/3918900272 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461505532 0 0) 0x7f0da015a370 con 0x7f0da00cd710 2023-11-28T11:56:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.258+0000 7f0d9e7fc700 1 -- 172.21.15.50:0/3918900272 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d8c0035d0 con 0x7f0da00cd710 2023-11-28T11:56:07.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.262+0000 7f0d9e7fc700 1 -- 172.21.15.50:0/3918900272 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084882360 0 0) 0x7f0da00cff70 con 0x7f0da00b1300 2023-11-28T11:56:07.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.262+0000 7f0d9e7fc700 1 -- 172.21.15.50:0/3918900272 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0da015a370 con 0x7f0da00b1300 2023-11-28T11:56:07.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.262+0000 7f0d9effd700 1 -- 172.21.15.50:0/3918900272 >> v1:172.21.15.192:6789/0 conn(0x7f0da00b1300 legacy=0x7f0da00cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.262+0000 7f0d9effd700 1 -- 172.21.15.50:0/3918900272 >> v1:172.21.15.50:6789/0 conn(0x7f0da00cd710 legacy=0x7f0da00b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.262+0000 7f0d9effd700 1 -- 172.21.15.50:0/3918900272 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da00afaa0 con 0x7f0da0159fa0 2023-11-28T11:56:07.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.262+0000 7f0d9effd700 1 --2- 172.21.15.50:0/3918900272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0da0159fa0 0x7f0da00b34a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009850 tx=0x7f0d90009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb5106b91be0b20c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.262+0000 7f0d9e7fc700 1 -- 172.21.15.50:0/3918900272 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90011830 con 0x7f0da0159fa0 2023-11-28T11:56:07.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.262+0000 7f0d9e7fc700 1 -- 172.21.15.50:0/3918900272 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d90011990 con 0x7f0da0159fa0 2023-11-28T11:56:07.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.262+0000 7f0d9e7fc700 1 -- 172.21.15.50:0/3918900272 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90011d00 con 0x7f0da0159fa0 2023-11-28T11:56:07.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.262+0000 7f0d9ffff700 1 -- 172.21.15.50:0/3918900272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0da0159fa0 msgr2=0x7f0da00b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.262+0000 7f0d9ffff700 1 --2- 172.21.15.50:0/3918900272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0da0159fa0 0x7f0da00b34a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009850 tx=0x7f0d90009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:07.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.262+0000 7f0d9ffff700 1 -- 172.21.15.50:0/3918900272 shutdown_connections 2023-11-28T11:56:07.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.262+0000 7f0d9ffff700 1 --2- 172.21.15.50:0/3918900272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0da0159fa0 0x7f0da00b34a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.262+0000 7f0d9ffff700 1 -- 172.21.15.50:0/3918900272 >> 172.21.15.50:0/3918900272 conn(0x7f0da00b2180 msgr2=0x7f0da00b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:07.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.262+0000 7f0d9ffff700 1 -- 172.21.15.50:0/3918900272 shutdown_connections 2023-11-28T11:56:07.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.262+0000 7f0d9ffff700 1 -- 172.21.15.50:0/3918900272 wait complete. 2023-11-28T11:56:07.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9ffff700 1 Processor -- start 2023-11-28T11:56:07.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9ffff700 1 -- start start 2023-11-28T11:56:07.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da00b1300 0x7f0da00c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0da00cd710 0x7f0da00c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0da0159fa0 0x7f0da01ef840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9ffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da00c4a40 con 0x7f0da00b1300 2023-11-28T11:56:07.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9ffff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da00c4760 con 0x7f0da0159fa0 2023-11-28T11:56:07.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9ffff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da0156c50 con 0x7f0da00cd710 2023-11-28T11:56:07.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da00b1300 0x7f0da00c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da00b1300 0x7f0da00c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59184/0 (socket says 172.21.15.50:59184) 2023-11-28T11:56:07.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9effd700 1 -- 172.21.15.50:0/3452078867 learned_addr learned my addr 172.21.15.50:0/3452078867 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:07.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9f7fe700 1 --2- 172.21.15.50:0/3452078867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0da0159fa0 0x7f0da01ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d97fff700 1 --2- 172.21.15.50:0/3452078867 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0da00cd710 0x7f0da00c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9effd700 1 -- 172.21.15.50:0/3452078867 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0da00cd710 msgr2=0x7f0da00c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9effd700 1 --2- 172.21.15.50:0/3452078867 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0da00cd710 0x7f0da00c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9effd700 1 -- 172.21.15.50:0/3452078867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0da0159fa0 msgr2=0x7f0da01ef840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9effd700 1 --2- 172.21.15.50:0/3452078867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0da0159fa0 0x7f0da01ef840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9effd700 1 -- 172.21.15.50:0/3452078867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d900094b0 con 0x7f0da00b1300 2023-11-28T11:56:07.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9f7fe700 1 --2- 172.21.15.50:0/3452078867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0da0159fa0 0x7f0da01ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:07.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d97fff700 1 --2- 172.21.15.50:0/3452078867 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0da00cd710 0x7f0da00c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:07.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.266+0000 7f0d9effd700 1 --2- 172.21.15.50:0/3452078867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da00b1300 0x7f0da00c4180 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009ba0 tx=0x7f0d90004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.270+0000 7f0d977fe700 1 -- 172.21.15.50:0/3452078867 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90004610 con 0x7f0da00b1300 2023-11-28T11:56:07.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.270+0000 7f0d977fe700 1 -- 172.21.15.50:0/3452078867 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9001e070 con 0x7f0da00b1300 2023-11-28T11:56:07.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.270+0000 7f0d9ffff700 1 -- 172.21.15.50:0/3452078867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da00b0060 con 0x7f0da00b1300 2023-11-28T11:56:07.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.270+0000 7f0d977fe700 1 -- 172.21.15.50:0/3452078867 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90003900 con 0x7f0da00b1300 2023-11-28T11:56:07.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.270+0000 7f0d9ffff700 1 -- 172.21.15.50:0/3452078867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da00afd80 con 0x7f0da00b1300 2023-11-28T11:56:07.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.270+0000 7f0d977fe700 1 -- 172.21.15.50:0/3452078867 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0d9000f050 con 0x7f0da00b1300 2023-11-28T11:56:07.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.270+0000 7f0d977fe700 1 --2- 172.21.15.50:0/3452078867 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0d80064ee0 0x7f0d80067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.270+0000 7f0d977fe700 1 -- 172.21.15.50:0/3452078867 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0d90083070 con 0x7f0da00b1300 2023-11-28T11:56:07.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.270+0000 7f0d97fff700 1 --2- 172.21.15.50:0/3452078867 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0d80064ee0 0x7f0d80067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0d97fff700 1 --2- 172.21.15.50:0/3452078867 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0d80064ee0 0x7f0d80067390 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0da00c4120 tx=0x7f0d88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0da86a0740 1 Processor -- start 2023-11-28T11:56:07.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0da86a0740 1 -- start start 2023-11-28T11:56:07.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f6a6d274700 1 Processor -- start 2023-11-28T11:56:07.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f6a6d274700 1 -- start start 2023-11-28T11:56:07.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f6a6d274700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6a6815e480 0x7f6a6815af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f6a6d274700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a6806e460 0x7f6a68070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f6a6d274700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6815de50 con 0x7f6a6806e000 2023-11-28T11:56:07.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f6a6d274700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6813d3e0 con 0x7f6a6815e480 2023-11-28T11:56:07.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f6a6d274700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6815b4a0 con 0x7f6a6806e460 2023-11-28T11:56:07.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0da86a0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x21e8d80 0x2496d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0da86a0740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e89b0 0x249fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0da86a0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2233a30 0x24a0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0da86a0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x2357c80 con 0x2233a30 2023-11-28T11:56:07.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0da86a0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x23c7d60 con 0x21e8d80 2023-11-28T11:56:07.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0da86a0740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x23c1060 con 0x21e89b0 2023-11-28T11:56:07.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0d9f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2233a30 0x24a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0d9f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2233a30 0x24a0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59190/0 (socket says 172.21.15.50:59190) 2023-11-28T11:56:07.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0d9f7fe700 1 -- 172.21.15.50:0/1479615910 learned_addr learned my addr 172.21.15.50:0/1479615910 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:07.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0d97fff700 1 --2- 172.21.15.50:0/1479615910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e89b0 0x249fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0d9effd700 1 --2- 172.21.15.50:0/1479615910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x21e8d80 0x2496d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f6a6ca73700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a6806e460 0x7f6a68070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f6a6ca73700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a6806e460 0x7f6a68070ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:47482/0 (socket says 172.21.15.50:47482) 2023-11-28T11:56:07.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f6a6ca73700 1 -- 172.21.15.50:0/3583192075 learned_addr learned my addr 172.21.15.50:0/3583192075 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:07.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f6a67fff700 1 --2- 172.21.15.50:0/3583192075 >> v2:172.21.15.192:3300/0 conn(0x7f6a6815e480 0x7f6a6815af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0d9f7fe700 1 -- 172.21.15.50:0/1479615910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e89b0 msgr2=0x249fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0d9f7fe700 1 --2- 172.21.15.50:0/1479615910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e89b0 0x249fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0d9f7fe700 1 -- 172.21.15.50:0/1479615910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x21e8d80 msgr2=0x2496d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0d9f7fe700 1 --2- 172.21.15.50:0/1479615910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x21e8d80 0x2496d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0d9f7fe700 1 -- 172.21.15.50:0/1479615910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23e64e0 con 0x2233a30 2023-11-28T11:56:07.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0d97fff700 1 --2- 172.21.15.50:0/1479615910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e89b0 0x249fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:07.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0d9effd700 1 --2- 172.21.15.50:0/1479615910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x21e8d80 0x2496d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:07.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f6a6ca73700 1 -- 172.21.15.50:0/3583192075 >> v2:172.21.15.192:3300/0 conn(0x7f6a6815e480 msgr2=0x7f6a6815af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f6a6ca73700 1 --2- 172.21.15.50:0/3583192075 >> v2:172.21.15.192:3300/0 conn(0x7f6a6815e480 0x7f6a6815af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f6a6ca73700 1 -- 172.21.15.50:0/3583192075 >> v1:172.21.15.192:6789/0 conn(0x7f6a6806e000 legacy=0x7f6a680708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0d9f7fe700 1 --2- 172.21.15.50:0/1479615910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2233a30 0x24a0340 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0d98002180 tx=0x7f0d980021b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54917c0ee4bfba5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f6a6ca73700 1 -- 172.21.15.50:0/3583192075 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a680cec30 con 0x7f6a6806e460 2023-11-28T11:56:07.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0d94ff9700 1 -- 172.21.15.50:0/1479615910 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9800ea30 con 0x2233a30 2023-11-28T11:56:07.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0d94ff9700 1 -- 172.21.15.50:0/1479615910 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9800eb90 con 0x2233a30 2023-11-28T11:56:07.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.274+0000 7f0d94ff9700 1 -- 172.21.15.50:0/1479615910 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d98014480 con 0x2233a30 2023-11-28T11:56:07.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f6a6ca73700 1 --2- 172.21.15.50:0/3583192075 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a6806e460 0x7f6a68070ff0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6a60009e50 tx=0x7f6a6000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b95e289fc4046995 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f6a66ffd700 1 -- 172.21.15.50:0/3583192075 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6000e070 con 0x7f6a6806e460 2023-11-28T11:56:07.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f6a66ffd700 1 -- 172.21.15.50:0/3583192075 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6000b910 con 0x7f6a6806e460 2023-11-28T11:56:07.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f6a66ffd700 1 -- 172.21.15.50:0/3583192075 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6000bcc0 con 0x7f6a6806e460 2023-11-28T11:56:07.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f6a6d274700 1 -- 172.21.15.50:0/3583192075 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a6806e460 msgr2=0x7f6a68070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f6a6d274700 1 --2- 172.21.15.50:0/3583192075 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a6806e460 0x7f6a68070ff0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6a60009e50 tx=0x7f6a6000b330 comp rx=0 tx=0).stop 2023-11-28T11:56:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 1 -- 172.21.15.50:0/1479615910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2233a30 msgr2=0x24a0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 1 --2- 172.21.15.50:0/1479615910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2233a30 0x24a0340 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0d98002180 tx=0x7f0d980021b0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 1 -- 172.21.15.50:0/1479615910 shutdown_connections 2023-11-28T11:56:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f6a6d274700 1 -- 172.21.15.50:0/3583192075 shutdown_connections 2023-11-28T11:56:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f6a6d274700 1 --2- 172.21.15.50:0/3583192075 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a6806e460 0x7f6a68070ff0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f6a6d274700 1 --2- 172.21.15.50:0/3583192075 >> v2:172.21.15.192:3300/0 conn(0x7f6a6815e480 0x7f6a6815af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f6a6d274700 1 -- 172.21.15.50:0/3583192075 >> 172.21.15.50:0/3583192075 conn(0x7f6a680ceee0 msgr2=0x7f6a680cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:07.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 1 --2- 172.21.15.50:0/1479615910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2233a30 0x24a0340 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 1 --2- 172.21.15.50:0/1479615910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e89b0 0x249fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 1 --2- 172.21.15.50:0/1479615910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x21e8d80 0x2496d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 1 -- 172.21.15.50:0/1479615910 >> 172.21.15.50:0/1479615910 conn(0x21e9150 msgr2=0x2481350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:07.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 1 -- 172.21.15.50:0/1479615910 shutdown_connections 2023-11-28T11:56:07.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 1 -- 172.21.15.50:0/1479615910 wait complete. 2023-11-28T11:56:07.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f6a6d274700 1 -- 172.21.15.50:0/3583192075 shutdown_connections 2023-11-28T11:56:07.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f6a6d274700 1 -- 172.21.15.50:0/3583192075 wait complete. 2023-11-28T11:56:07.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 1 -- start start 2023-11-28T11:56:07.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 1 Processor -- start 2023-11-28T11:56:07.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f6a6d274700 1 Processor -- start 2023-11-28T11:56:07.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f6a6d274700 1 -- start start 2023-11-28T11:56:07.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x21e89b0 0x2479c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e8d80 0x247a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x2233a30 0x247a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x226ddc0 con 0x21e89b0 2023-11-28T11:56:07.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x2496a90 con 0x2233a30 2023-11-28T11:56:07.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x24a57a0 con 0x21e8d80 2023-11-28T11:56:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0da86a0740 10 client.0 _ll_register_callbacks cb 0x241cb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:56:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0d9effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x21e89b0 0x2479c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0d9effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x21e89b0 0x2479c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59192/0 (socket says 172.21.15.50:59192) 2023-11-28T11:56:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.278+0000 7f0d9effd700 1 -- 172.21.15.50:0/1384787583 learned_addr learned my addr 172.21.15.50:0/1384787583 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d97fff700 1 --2- 172.21.15.50:0/1384787583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e8d80 0x247a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d9f7fe700 1 --2- 172.21.15.50:0/1384787583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x2233a30 0x247a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a6d274700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a6806e000 0x7f6a681407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a6d274700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a6806e460 0x7f6a681574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a6d274700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a6815e480 0x7f6a681281e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d9effd700 1 -- 172.21.15.50:0/1384787583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e8d80 msgr2=0x247a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d9effd700 1 --2- 172.21.15.50:0/1384787583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e8d80 0x247a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d9effd700 1 -- 172.21.15.50:0/1384787583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x2233a30 msgr2=0x247a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d9effd700 1 --2- 172.21.15.50:0/1384787583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x2233a30 0x247a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d9effd700 1 -- 172.21.15.50:0/1384787583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9800f040 con 0x21e89b0 2023-11-28T11:56:07.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a6d274700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a68142190 con 0x7f6a6806e000 2023-11-28T11:56:07.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a6d274700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a680b3e70 con 0x7f6a6806e460 2023-11-28T11:56:07.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a6d274700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a680b3b90 con 0x7f6a6815e480 2023-11-28T11:56:07.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a67fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a6806e000 0x7f6a681407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a67fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a6806e000 0x7f6a681407c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59202/0 (socket says 172.21.15.50:59202) 2023-11-28T11:56:07.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a67fff700 1 -- 172.21.15.50:0/107908266 learned_addr learned my addr 172.21.15.50:0/107908266 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:07.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d9effd700 1 --2- 172.21.15.50:0/1384787583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x21e89b0 0x2479c80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0d9002cf90 tx=0x7f0d9005ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6276be21b99fc76d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d7dffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:56:07.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a677fe700 1 --2- 172.21.15.50:0/107908266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a6806e460 0x7f6a681574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a6ca73700 1 --2- 172.21.15.50:0/107908266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a6815e480 0x7f6a681281e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d7dffb700 1 -- 172.21.15.50:0/1384787583 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9006d070 con 0x21e89b0 2023-11-28T11:56:07.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d7dffb700 1 -- 172.21.15.50:0/1384787583 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0d9005c820 con 0x21e89b0 2023-11-28T11:56:07.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 1 -- 172.21.15.50:0/1384787583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x23ba0e0 con 0x21e89b0 2023-11-28T11:56:07.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a67fff700 1 -- 172.21.15.50:0/107908266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a6815e480 msgr2=0x7f6a681281e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a67fff700 1 --2- 172.21.15.50:0/107908266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a6815e480 0x7f6a681281e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a67fff700 1 -- 172.21.15.50:0/107908266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a6806e460 msgr2=0x7f6a681574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a67fff700 1 --2- 172.21.15.50:0/107908266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a6806e460 0x7f6a681574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a67fff700 1 -- 172.21.15.50:0/107908266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a60009b30 con 0x7f6a6806e000 2023-11-28T11:56:07.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a67fff700 1 --2- 172.21.15.50:0/107908266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a6806e000 0x7f6a681407c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800e840 tx=0x7f6a5800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d7dffb700 1 -- 172.21.15.50:0/1384787583 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d9005c9e0 con 0x21e89b0 2023-11-28T11:56:07.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 10 client.6261 fetch_fsmap learned FSMap version 25 2023-11-28T11:56:07.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 1 -- 172.21.15.50:0/1384787583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x2234c80 con 0x21e89b0 2023-11-28T11:56:07.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a64ff9700 1 -- 172.21.15.50:0/107908266 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a580095a0 con 0x7f6a6806e000 2023-11-28T11:56:07.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a64ff9700 1 -- 172.21.15.50:0/107908266 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a58013680 con 0x7f6a6806e000 2023-11-28T11:56:07.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a64ff9700 1 -- 172.21.15.50:0/107908266 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a580139f0 con 0x7f6a6806e000 2023-11-28T11:56:07.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a6d274700 1 -- 172.21.15.50:0/107908266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6813fc20 con 0x7f6a6806e000 2023-11-28T11:56:07.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d7dffb700 1 -- 172.21.15.50:0/1384787583 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x23ba0e0 con 0x21e89b0 2023-11-28T11:56:07.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a6d274700 1 -- 172.21.15.50:0/107908266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6813d640 con 0x7f6a6806e000 2023-11-28T11:56:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d7dffb700 1 -- 172.21.15.50:0/1384787583 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f0d90058b80 con 0x21e89b0 2023-11-28T11:56:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 10 client.6261 fetch_fsmap finished waiting for FSMap version 25 2023-11-28T11:56:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 10 client.6261 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-11-28T11:56:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 20 client.6261 populate_metadata read hostname 'smithi050' 2023-11-28T11:56:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 1 --2- 172.21.15.50:0/1384787583 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x24af9d0 0x24b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 4 client.6261 mds_command: new command op to 6057 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:56:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 1 -- 172.21.15.50:0/1384787583 --> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x23b9e00 con 0x24af9d0 2023-11-28T11:56:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d97fff700 1 --2- 172.21.15.50:0/1384787583 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x24af9d0 0x24b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a6d274700 1 -- 172.21.15.50:0/107908266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f6a6813ff00 con 0x7f6a6806e000 2023-11-28T11:56:07.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d7dffb700 10 client.6261 ms_handle_connect on v2:172.21.15.50:6833/1163863991 2023-11-28T11:56:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d97fff700 1 --2- 172.21.15.50:0/1384787583 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x24af9d0 0x24b1db0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=badc3e93b7b29fa5 server_cookie=4c30cd94ff5000d2 in_seq=0 out_seq=0 2023-11-28T11:56:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d7dffb700 1 -- 172.21.15.50:0/1384787583 <== mds.0 v2:172.21.15.50:6833/1163863991 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x23b9e00 con 0x24af9d0 2023-11-28T11:56:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d7dffb700 10 client.6261 handle_command_reply: tid=0 2023-11-28T11:56:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 1 client.6261 shutdown 2023-11-28T11:56:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 1 -- 172.21.15.50:0/1384787583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x21e89b0 msgr2=0x2479c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 1 --2- 172.21.15.50:0/1384787583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x21e89b0 0x2479c80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0d9002cf90 tx=0x7f0d9005ccb0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 1 -- 172.21.15.50:0/1384787583 shutdown_connections 2023-11-28T11:56:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 1 --2- 172.21.15.50:0/1384787583 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x24af9d0 0x24b1db0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 1 --2- 172.21.15.50:0/1384787583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x2233a30 0x247a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 1 --2- 172.21.15.50:0/1384787583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e8d80 0x247a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 1 --2- 172.21.15.50:0/1384787583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x21e89b0 0x2479c80 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f6a64ff9700 1 -- 172.21.15.50:0/107908266 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6a58019030 con 0x7f6a6806e000 2023-11-28T11:56:07.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 1 -- 172.21.15.50:0/1384787583 >> 172.21.15.50:0/1384787583 conn(0x21e9150 msgr2=0x246a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:07.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0d7dffb700 0 client.6261 ms_handle_reset on v2:172.21.15.50:6833/1163863991 2023-11-28T11:56:07.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 1 -- 172.21.15.50:0/1384787583 shutdown_connections 2023-11-28T11:56:07.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.282+0000 7f0da86a0740 1 -- 172.21.15.50:0/1384787583 wait complete. 2023-11-28T11:56:07.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.286+0000 7f0da86a0740 20 client.6261 trim_cache size 0 max 16384 2023-11-28T11:56:07.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.286+0000 7f6a64ff9700 1 --2- 172.21.15.50:0/107908266 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6a54064ee0 0x7f6a54067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.286+0000 7f6a64ff9700 1 -- 172.21.15.50:0/107908266 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6a58082010 con 0x7f6a6806e000 2023-11-28T11:56:07.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.286+0000 7f6a64ff9700 1 -- 172.21.15.50:0/107908266 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+502 (secure 0 0 0) 0x7f6a58082490 con 0x7f6a6806e000 2023-11-28T11:56:07.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.286+0000 7f6a677fe700 1 --2- 172.21.15.50:0/107908266 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6a54064ee0 0x7f6a54067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.286+0000 7f6a677fe700 1 --2- 172.21.15.50:0/107908266 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6a54064ee0 0x7f6a54067390 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6a680b0230 tx=0x7f6a5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.290+0000 7f6a6d274700 1 -- 172.21.15.50:0/107908266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f6a68067230 con 0x7f6a6806e000 2023-11-28T11:56:07.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0da86a0740 1 Processor -- start 2023-11-28T11:56:07.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0da86a0740 1 -- start start 2023-11-28T11:56:07.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0da86a0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x21e89b0 0x249ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0da86a0740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e8d80 0x24b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0da86a0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2233a30 0x24b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0da86a0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x23c3bc0 con 0x2233a30 2023-11-28T11:56:07.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0da86a0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x2394f60 con 0x21e89b0 2023-11-28T11:56:07.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0da86a0740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x23890e0 con 0x21e8d80 2023-11-28T11:56:07.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0d9f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2233a30 0x24b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0d9f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2233a30 0x24b6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59216/0 (socket says 172.21.15.50:59216) 2023-11-28T11:56:07.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0d9f7fe700 1 -- 172.21.15.50:0/3248579645 learned_addr learned my addr 172.21.15.50:0/3248579645 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:07.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0d9effd700 1 --2- 172.21.15.50:0/3248579645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x21e89b0 0x249ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0d97fff700 1 --2- 172.21.15.50:0/3248579645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e8d80 0x24b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0d9f7fe700 1 -- 172.21.15.50:0/3248579645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e8d80 msgr2=0x24b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0d9f7fe700 1 --2- 172.21.15.50:0/3248579645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e8d80 0x24b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0d9f7fe700 1 -- 172.21.15.50:0/3248579645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x21e89b0 msgr2=0x249ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0d9f7fe700 1 --2- 172.21.15.50:0/3248579645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x21e89b0 0x249ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0d9f7fe700 1 -- 172.21.15.50:0/3248579645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da00b07e0 con 0x2233a30 2023-11-28T11:56:07.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0d9f7fe700 1 --2- 172.21.15.50:0/3248579645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2233a30 0x24b6150 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009010 tx=0x7f0d9800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e67ac94574a4e74 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0d957fa700 1 -- 172.21.15.50:0/3248579645 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9800b040 con 0x2233a30 2023-11-28T11:56:07.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0d957fa700 1 -- 172.21.15.50:0/3248579645 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d98001c70 con 0x2233a30 2023-11-28T11:56:07.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0d957fa700 1 -- 172.21.15.50:0/3248579645 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d980018f0 con 0x2233a30 2023-11-28T11:56:07.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0da86a0740 1 -- 172.21.15.50:0/3248579645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2233a30 msgr2=0x24b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0da86a0740 1 --2- 172.21.15.50:0/3248579645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2233a30 0x24b6150 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009010 tx=0x7f0d9800c000 comp rx=0 tx=0).stop 2023-11-28T11:56:07.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0da86a0740 1 -- 172.21.15.50:0/3248579645 shutdown_connections 2023-11-28T11:56:07.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0da86a0740 1 --2- 172.21.15.50:0/3248579645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x2233a30 0x24b6150 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0da86a0740 1 --2- 172.21.15.50:0/3248579645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e8d80 0x24b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0da86a0740 1 --2- 172.21.15.50:0/3248579645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x21e89b0 0x249ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0da86a0740 1 -- 172.21.15.50:0/3248579645 >> 172.21.15.50:0/3248579645 conn(0x21e9150 msgr2=0x249e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:07.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0da86a0740 1 -- 172.21.15.50:0/3248579645 shutdown_connections 2023-11-28T11:56:07.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.302+0000 7f0da86a0740 1 -- 172.21.15.50:0/3248579645 wait complete. 2023-11-28T11:56:07.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0da86a0740 1 -- start start 2023-11-28T11:56:07.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0da86a0740 1 Processor -- start 2023-11-28T11:56:07.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0da86a0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x21e89b0 0x2495c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0da86a0740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e8d80 0x24faf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0da86a0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x2233a30 0x24fb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0da86a0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x24a3d90 con 0x21e89b0 2023-11-28T11:56:07.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0da86a0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x2496590 con 0x2233a30 2023-11-28T11:56:07.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0da86a0740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x24930b0 con 0x21e8d80 2023-11-28T11:56:07.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0d9effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x21e89b0 0x2495c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0da86a0740 10 client.0 _ll_register_callbacks cb 0x23e7910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:56:07.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0d9effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x21e89b0 0x2495c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59232/0 (socket says 172.21.15.50:59232) 2023-11-28T11:56:07.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0d9effd700 1 -- 172.21.15.50:0/2152577118 learned_addr learned my addr 172.21.15.50:0/2152577118 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:07.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0d9f7fe700 1 --2- 172.21.15.50:0/2152577118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x2233a30 0x24fb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0d97fff700 1 --2- 172.21.15.50:0/2152577118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e8d80 0x24faf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0d9effd700 1 -- 172.21.15.50:0/2152577118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e8d80 msgr2=0x24faf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0d9effd700 1 --2- 172.21.15.50:0/2152577118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e8d80 0x24faf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0d9effd700 1 -- 172.21.15.50:0/2152577118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x2233a30 msgr2=0x24fb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0d9effd700 1 --2- 172.21.15.50:0/2152577118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x2233a30 0x24fb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0d9effd700 1 -- 172.21.15.50:0/2152577118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x23e64e0 con 0x21e89b0 2023-11-28T11:56:07.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0d9effd700 1 --2- 172.21.15.50:0/2152577118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x21e89b0 0x2495c30 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0d90054b50 tx=0x7f0d90056000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516739475a2ad4c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.306+0000 7f0d7dffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:56:07.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0d7dffb700 1 -- 172.21.15.50:0/2152577118 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90081400 con 0x21e89b0 2023-11-28T11:56:07.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0d7dffb700 1 -- 172.21.15.50:0/2152577118 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0d90050d60 con 0x21e89b0 2023-11-28T11:56:07.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 1 -- 172.21.15.50:0/2152577118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d9800eb90 con 0x21e89b0 2023-11-28T11:56:07.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0d7dffb700 1 -- 172.21.15.50:0/2152577118 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d90081170 con 0x21e89b0 2023-11-28T11:56:07.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 10 client.6270 fetch_fsmap learned FSMap version 25 2023-11-28T11:56:07.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 1 -- 172.21.15.50:0/2152577118 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x236dbb0 con 0x21e89b0 2023-11-28T11:56:07.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0d7dffb700 1 -- 172.21.15.50:0/2152577118 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9800eb90 con 0x21e89b0 2023-11-28T11:56:07.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0d7dffb700 1 -- 172.21.15.50:0/2152577118 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f0d9007b020 con 0x21e89b0 2023-11-28T11:56:07.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 10 client.6270 fetch_fsmap finished waiting for FSMap version 25 2023-11-28T11:56:07.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 10 client.6270 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-11-28T11:56:07.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 20 client.6270 populate_metadata read hostname 'smithi050' 2023-11-28T11:56:07.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 1 --2- 172.21.15.50:0/2152577118 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x24fb9c0 0x24a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 4 client.6270 mds_command: new command op to 6057 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-11-28T11:56:07.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 1 -- 172.21.15.50:0/2152577118 --> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x2265500 con 0x24fb9c0 2023-11-28T11:56:07.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0d97fff700 1 --2- 172.21.15.50:0/2152577118 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x24fb9c0 0x24a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0d97fff700 1 --2- 172.21.15.50:0/2152577118 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x24fb9c0 0x24a2c70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b18bc977da8367ff server_cookie=b002a7d43ca8c103 in_seq=0 out_seq=0 2023-11-28T11:56:07.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0d7dffb700 10 client.6270 ms_handle_connect on v2:172.21.15.50:6833/1163863991 2023-11-28T11:56:07.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0d7dffb700 1 -- 172.21.15.50:0/2152577118 <== mds.0 v2:172.21.15.50:6833/1163863991 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x2265500 con 0x24fb9c0 2023-11-28T11:56:07.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0d7dffb700 10 client.6270 handle_command_reply: tid=0 2023-11-28T11:56:07.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 1 client.6270 shutdown 2023-11-28T11:56:07.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 1 -- 172.21.15.50:0/2152577118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x21e89b0 msgr2=0x2495c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 1 --2- 172.21.15.50:0/2152577118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x21e89b0 0x2495c30 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0d90054b50 tx=0x7f0d90056000 comp rx=0 tx=0).stop 2023-11-28T11:56:07.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 1 -- 172.21.15.50:0/2152577118 shutdown_connections 2023-11-28T11:56:07.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 1 --2- 172.21.15.50:0/2152577118 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x24fb9c0 0x24a2c70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0d7dffb700 0 client.6270 ms_handle_reset on v2:172.21.15.50:6833/1163863991 2023-11-28T11:56:07.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 1 --2- 172.21.15.50:0/2152577118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x2233a30 0x24fb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 1 --2- 172.21.15.50:0/2152577118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x21e8d80 0x24faf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 1 --2- 172.21.15.50:0/2152577118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x21e89b0 0x2495c30 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 1 -- 172.21.15.50:0/2152577118 >> 172.21.15.50:0/2152577118 conn(0x21e9150 msgr2=0x2497250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:07.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 1 -- 172.21.15.50:0/2152577118 shutdown_connections 2023-11-28T11:56:07.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 1 -- 172.21.15.50:0/2152577118 wait complete. 2023-11-28T11:56:07.318 INFO:tasks.ceph.mds.a.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f4327284700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6225=0-4194304@1} caps={6225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6225 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x56284e08fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T11:56:07.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.310+0000 7f0da86a0740 20 client.6270 trim_cache size 0 max 16384 2023-11-28T11:56:07.319 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:56:07.319 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2023-11-28T11:56:07.319 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "e89cad7d-1609-47c5-b17e-fe3642f79681", 2023-11-28T11:56:07.319 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2023-11-28T11:56:07.319 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:56:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.314+0000 7f0d9ffff700 1 -- 172.21.15.50:0/3452078867 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0d80064ee0 msgr2=0x7f0d80067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.314+0000 7f0d9ffff700 1 --2- 172.21.15.50:0/3452078867 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0d80064ee0 0x7f0d80067390 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0da00c4120 tx=0x7f0d88009040 comp rx=0 tx=0).stop 2023-11-28T11:56:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.314+0000 7f0d9ffff700 1 -- 172.21.15.50:0/3452078867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da00b1300 msgr2=0x7f0da00c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.314+0000 7f0d9ffff700 1 --2- 172.21.15.50:0/3452078867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da00b1300 0x7f0da00c4180 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009ba0 tx=0x7f0d90004770 comp rx=0 tx=0).stop 2023-11-28T11:56:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.314+0000 7f0d9ffff700 1 -- 172.21.15.50:0/3452078867 shutdown_connections 2023-11-28T11:56:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.314+0000 7f0d9ffff700 1 --2- 172.21.15.50:0/3452078867 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0d80064ee0 0x7f0d80067390 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.314+0000 7f0d9ffff700 1 --2- 172.21.15.50:0/3452078867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0da0159fa0 0x7f0da01ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.314+0000 7f0d9ffff700 1 --2- 172.21.15.50:0/3452078867 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0da00cd710 0x7f0da00c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.314+0000 7f0d9ffff700 1 --2- 172.21.15.50:0/3452078867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0da00b1300 0x7f0da00c4180 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.314+0000 7f0d9ffff700 1 -- 172.21.15.50:0/3452078867 >> 172.21.15.50:0/3452078867 conn(0x7f0da00b2180 msgr2=0x7f0da00cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:07.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.314+0000 7f0d9ffff700 1 -- 172.21.15.50:0/3452078867 shutdown_connections 2023-11-28T11:56:07.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.314+0000 7f0d9ffff700 1 -- 172.21.15.50:0/3452078867 wait complete. 2023-11-28T11:56:07.332 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-11-28T11:56:07.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.446+0000 7faa6c88f700 1 Processor -- start 2023-11-28T11:56:07.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.446+0000 7faa6c88f700 1 -- start start 2023-11-28T11:56:07.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa6c88f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa680b8240 0x7faa680cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa6c88f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa680d0460 con 0x7faa680d1e30 2023-11-28T11:56:07.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa6c88f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa680d2380 con 0x7faa6806ce60 2023-11-28T11:56:07.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa6c88f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa680b86c0 con 0x7faa680b8240 2023-11-28T11:56:07.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa5ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faa680d1e30 0x7faa680cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33644/0 (socket says 172.21.15.50:33644) 2023-11-28T11:56:07.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa5ffff700 1 -- 172.21.15.50:0/3551770854 learned_addr learned my addr 172.21.15.50:0/3551770854 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:07.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa67fff700 1 --2- 172.21.15.50:0/3551770854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa680b8240 0x7faa680cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 -- 172.21.15.50:0/3551770854 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060478860 0 0) 0x7faa680d0460 con 0x7faa680d1e30 2023-11-28T11:56:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 -- 172.21.15.50:0/3551770854 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa540035d0 con 0x7faa680d1e30 2023-11-28T11:56:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 -- 172.21.15.50:0/3551770854 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341102246 0 0) 0x7faa680d2380 con 0x7faa6806ce60 2023-11-28T11:56:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 -- 172.21.15.50:0/3551770854 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa680d0460 con 0x7faa6806ce60 2023-11-28T11:56:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 -- 172.21.15.50:0/3551770854 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1492437202 0 0) 0x7faa540035d0 con 0x7faa680d1e30 2023-11-28T11:56:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 -- 172.21.15.50:0/3551770854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa680b8240 msgr2=0x7faa680cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 --2- 172.21.15.50:0/3551770854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa680b8240 0x7faa680cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 -- 172.21.15.50:0/3551770854 >> v1:172.21.15.192:6789/0 conn(0x7faa6806ce60 legacy=0x7faa6806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 -- 172.21.15.50:0/3551770854 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa680d2f00 con 0x7faa680d1e30 2023-11-28T11:56:07.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 -- 172.21.15.50:0/3551770854 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7faa500015f0 con 0x7faa680d1e30 2023-11-28T11:56:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 -- 172.21.15.50:0/3551770854 >> v1:172.21.15.50:6789/0 conn(0x7faa680d1e30 legacy=0x7faa680cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 --2- 172.21.15.50:0/3551770854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa54003be0 0x7faa54003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 --2- 172.21.15.50:0/3551770854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa54004870 0x7faa54004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 --2- 172.21.15.50:0/3551770854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa680b8240 0x7faa54005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 -- 172.21.15.50:0/3551770854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa680b86c0 con 0x7faa54003be0 2023-11-28T11:56:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 -- 172.21.15.50:0/3551770854 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5400bae0 con 0x7faa54004870 2023-11-28T11:56:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 -- 172.21.15.50:0/3551770854 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5400bca0 con 0x7faa680b8240 2023-11-28T11:56:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa677fe700 1 --2- 172.21.15.50:0/3551770854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa54003be0 0x7faa54003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa5ffff700 1 --2- 172.21.15.50:0/3551770854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa54004870 0x7faa54004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa67fff700 1 --2- 172.21.15.50:0/3551770854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa680b8240 0x7faa54005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa677fe700 1 -- 172.21.15.50:0/3551770854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa680b8240 msgr2=0x7faa54005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa677fe700 1 --2- 172.21.15.50:0/3551770854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa680b8240 0x7faa54005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa677fe700 1 -- 172.21.15.50:0/3551770854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa54004870 msgr2=0x7faa54004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa677fe700 1 --2- 172.21.15.50:0/3551770854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa54004870 0x7faa54004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa677fe700 1 -- 172.21.15.50:0/3551770854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa540035d0 con 0x7faa54003be0 2023-11-28T11:56:07.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa5ffff700 1 --2- 172.21.15.50:0/3551770854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa54004870 0x7faa54004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:07.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa677fe700 1 --2- 172.21.15.50:0/3551770854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa54003be0 0x7faa54003fd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7faa58007fd0 tx=0x7faa540058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2dd3398c55bae6c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 -- 172.21.15.50:0/3551770854 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58001450 con 0x7faa54003be0 2023-11-28T11:56:07.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 -- 172.21.15.50:0/3551770854 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa580052f0 con 0x7faa54003be0 2023-11-28T11:56:07.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.450+0000 7faa66ffd700 1 -- 172.21.15.50:0/3551770854 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58001d60 con 0x7faa54003be0 2023-11-28T11:56:07.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.454+0000 7faa6c88f700 1 -- 172.21.15.50:0/3551770854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa54003be0 msgr2=0x7faa54003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.454+0000 7faa6c88f700 1 --2- 172.21.15.50:0/3551770854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa54003be0 0x7faa54003fd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7faa58007fd0 tx=0x7faa540058a0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.454+0000 7faa67fff700 1 -- 172.21.15.50:0/3551770854 reap_dead start 2023-11-28T11:56:07.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.454+0000 7faa6c88f700 1 -- 172.21.15.50:0/3551770854 shutdown_connections 2023-11-28T11:56:07.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.454+0000 7faa6c88f700 1 -- 172.21.15.50:0/3551770854 >> 172.21.15.50:0/3551770854 conn(0x7faa6809bbd0 msgr2=0x7faa680b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:07.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.454+0000 7faa6c88f700 1 -- 172.21.15.50:0/3551770854 shutdown_connections 2023-11-28T11:56:07.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.454+0000 7faa6c88f700 1 -- 172.21.15.50:0/3551770854 wait complete. 2023-11-28T11:56:07.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.454+0000 7faa6c88f700 1 Processor -- start 2023-11-28T11:56:07.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.454+0000 7faa6c88f700 1 -- start start 2023-11-28T11:56:07.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa6c88f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa54003be0 0x7faa6814be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa6c88f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa680c8500 0x7faa680c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa6c88f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa680b0740 0x7faa680b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa6c88f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa680b1120 con 0x7faa680c8500 2023-11-28T11:56:07.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa6c88f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6814c390 con 0x7faa54003be0 2023-11-28T11:56:07.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa6c88f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa680c6b70 con 0x7faa680b0740 2023-11-28T11:56:07.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa5ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa680c8500 0x7faa680c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa5ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa680c8500 0x7faa680c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59242/0 (socket says 172.21.15.50:59242) 2023-11-28T11:56:07.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa5ffff700 1 -- 172.21.15.50:0/2647379955 learned_addr learned my addr 172.21.15.50:0/2647379955 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa67fff700 1 --2- 172.21.15.50:0/2647379955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa680b0740 0x7faa680b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa677fe700 1 --2- 172.21.15.50:0/2647379955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa54003be0 0x7faa6814be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa5ffff700 1 -- 172.21.15.50:0/2647379955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa680b0740 msgr2=0x7faa680b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa5ffff700 1 --2- 172.21.15.50:0/2647379955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa680b0740 0x7faa680b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa5ffff700 1 -- 172.21.15.50:0/2647379955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa54003be0 msgr2=0x7faa6814be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa5ffff700 1 --2- 172.21.15.50:0/2647379955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa54003be0 0x7faa6814be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa5ffff700 1 -- 172.21.15.50:0/2647379955 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa680d25d0 con 0x7faa680c8500 2023-11-28T11:56:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa677fe700 1 --2- 172.21.15.50:0/2647379955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa54003be0 0x7faa6814be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa5ffff700 1 --2- 172.21.15.50:0/2647379955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa680c8500 0x7faa680c8970 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7faa50007600 tx=0x7faa50007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa64ff9700 1 -- 172.21.15.50:0/2647379955 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50004e10 con 0x7faa680c8500 2023-11-28T11:56:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa64ff9700 1 -- 172.21.15.50:0/2647379955 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5000f870 con 0x7faa680c8500 2023-11-28T11:56:07.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa64ff9700 1 -- 172.21.15.50:0/2647379955 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5000fbe0 con 0x7faa680c8500 2023-11-28T11:56:07.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa6c88f700 1 -- 172.21.15.50:0/2647379955 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6815c700 con 0x7faa680c8500 2023-11-28T11:56:07.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.458+0000 7faa6c88f700 1 -- 172.21.15.50:0/2647379955 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa680d28b0 con 0x7faa680c8500 2023-11-28T11:56:07.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa64ff9700 1 -- 172.21.15.50:0/2647379955 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faa5000fd40 con 0x7faa680c8500 2023-11-28T11:56:07.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa64ff9700 1 --2- 172.21.15.50:0/2647379955 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa48064ee0 0x7faa48067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa64ff9700 1 -- 172.21.15.50:0/2647379955 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7faa500821d0 con 0x7faa680c8500 2023-11-28T11:56:07.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa677fe700 1 --2- 172.21.15.50:0/2647379955 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa48064ee0 0x7faa48067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa70d71740 1 Processor -- start 2023-11-28T11:56:07.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa70d71740 1 -- start start 2023-11-28T11:56:07.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa677fe700 1 --2- 172.21.15.50:0/2647379955 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa48064ee0 0x7faa48067390 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faa58015040 tx=0x7faa5800a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa70d71740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fac10 0x1bb1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa70d71740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fa840 0x1bb2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa70d71740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x19458c0 0x1bae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa70d71740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a69d20 con 0x19458c0 2023-11-28T11:56:07.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa70d71740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ad9d60 con 0x18fac10 2023-11-28T11:56:07.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa70d71740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ad3060 con 0x18fa840 2023-11-28T11:56:07.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa67fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x19458c0 0x1bae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa67fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x19458c0 0x1bae6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59258/0 (socket says 172.21.15.50:59258) 2023-11-28T11:56:07.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa67fff700 1 -- 172.21.15.50:0/681133761 learned_addr learned my addr 172.21.15.50:0/681133761 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:07.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa677fe700 1 --2- 172.21.15.50:0/681133761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fac10 0x1bb1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa5ffff700 1 --2- 172.21.15.50:0/681133761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fa840 0x1bb2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa67fff700 1 -- 172.21.15.50:0/681133761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fa840 msgr2=0x1bb2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa67fff700 1 --2- 172.21.15.50:0/681133761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fa840 0x1bb2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa67fff700 1 -- 172.21.15.50:0/681133761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fac10 msgr2=0x1bb1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa67fff700 1 --2- 172.21.15.50:0/681133761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fac10 0x1bb1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa67fff700 1 -- 172.21.15.50:0/681133761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1af90a0 con 0x19458c0 2023-11-28T11:56:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.462+0000 7faa5ffff700 1 --2- 172.21.15.50:0/681133761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fa840 0x1bb2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:07.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa67fff700 1 --2- 172.21.15.50:0/681133761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x19458c0 0x1bae6a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7faa680d2200 tx=0x7faa60009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255e4d608edb6906 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa5d7fa700 1 -- 172.21.15.50:0/681133761 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6000e040 con 0x19458c0 2023-11-28T11:56:07.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa5d7fa700 1 -- 172.21.15.50:0/681133761 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6000f040 con 0x19458c0 2023-11-28T11:56:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa5d7fa700 1 -- 172.21.15.50:0/681133761 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6001e840 con 0x19458c0 2023-11-28T11:56:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 1 -- 172.21.15.50:0/681133761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x19458c0 msgr2=0x1bae6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 1 --2- 172.21.15.50:0/681133761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x19458c0 0x1bae6a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7faa680d2200 tx=0x7faa60009750 comp rx=0 tx=0).stop 2023-11-28T11:56:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 1 -- 172.21.15.50:0/681133761 shutdown_connections 2023-11-28T11:56:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 1 --2- 172.21.15.50:0/681133761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x19458c0 0x1bae6a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 1 --2- 172.21.15.50:0/681133761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fa840 0x1bb2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 1 --2- 172.21.15.50:0/681133761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fac10 0x1bb1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 1 -- 172.21.15.50:0/681133761 >> 172.21.15.50:0/681133761 conn(0x18fafe0 msgr2=0x1b93d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 1 -- 172.21.15.50:0/681133761 shutdown_connections 2023-11-28T11:56:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 1 -- 172.21.15.50:0/681133761 wait complete. 2023-11-28T11:56:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 1 -- start start 2023-11-28T11:56:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 1 Processor -- start 2023-11-28T11:56:07.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fa840 0x1b750d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fac10 0x1b75ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x19458c0 0x1b8f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x197fc50 con 0x19458c0 2023-11-28T11:56:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b75ff0 con 0x18fac10 2023-11-28T11:56:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b8fa40 con 0x18fa840 2023-11-28T11:56:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa70d71740 10 client.0 _ll_register_callbacks cb 0x1acc9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:56:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa67fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x19458c0 0x1b8f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa67fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x19458c0 0x1b8f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59264/0 (socket says 172.21.15.50:59264) 2023-11-28T11:56:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa67fff700 1 -- 172.21.15.50:0/353523418 learned_addr learned my addr 172.21.15.50:0/353523418 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa677fe700 1 --2- 172.21.15.50:0/353523418 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fa840 0x1b750d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.466+0000 7faa5ffff700 1 --2- 172.21.15.50:0/353523418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fac10 0x1b75ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa67fff700 1 -- 172.21.15.50:0/353523418 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fa840 msgr2=0x1b750d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa67fff700 1 --2- 172.21.15.50:0/353523418 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fa840 0x1b750d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa67fff700 1 -- 172.21.15.50:0/353523418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fac10 msgr2=0x1b75ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa67fff700 1 --2- 172.21.15.50:0/353523418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fac10 0x1b75ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa67fff700 1 -- 172.21.15.50:0/353523418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa60009df0 con 0x19458c0 2023-11-28T11:56:07.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa67fff700 1 --2- 172.21.15.50:0/353523418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x19458c0 0x1b8f250 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7faa6000b010 tx=0x7faa60004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2091c5dc029630c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa467fc700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:56:07.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa467fc700 1 -- 172.21.15.50:0/353523418 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6000e040 con 0x19458c0 2023-11-28T11:56:07.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa467fc700 1 -- 172.21.15.50:0/353523418 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7faa6001a070 con 0x19458c0 2023-11-28T11:56:07.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 1 -- 172.21.15.50:0/353523418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1acc0e0 con 0x19458c0 2023-11-28T11:56:07.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa467fc700 1 -- 172.21.15.50:0/353523418 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa60007000 con 0x19458c0 2023-11-28T11:56:07.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 10 client.6282 fetch_fsmap learned FSMap version 25 2023-11-28T11:56:07.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 1 -- 172.21.15.50:0/353523418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x1946b10 con 0x19458c0 2023-11-28T11:56:07.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa467fc700 1 -- 172.21.15.50:0/353523418 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1acc0e0 con 0x19458c0 2023-11-28T11:56:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa467fc700 1 -- 172.21.15.50:0/353523418 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7faa60030350 con 0x19458c0 2023-11-28T11:56:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 10 client.6282 fetch_fsmap finished waiting for FSMap version 25 2023-11-28T11:56:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 10 client.6282 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-11-28T11:56:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 20 client.6282 populate_metadata read hostname 'smithi050' 2023-11-28T11:56:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 1 --2- 172.21.15.50:0/353523418 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x1b91540 0x1b91940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 4 client.6282 mds_command: new command op to 6057 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:56:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 1 -- 172.21.15.50:0/353523418 --> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1acbe00 con 0x1b91540 2023-11-28T11:56:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa677fe700 1 --2- 172.21.15.50:0/353523418 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x1b91540 0x1b91940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa467fc700 10 client.6282 ms_handle_connect on v2:172.21.15.50:6833/1163863991 2023-11-28T11:56:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa677fe700 1 --2- 172.21.15.50:0/353523418 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x1b91540 0x1b91940 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e91300b818e166b server_cookie=fb6bf56d6bcfce2f in_seq=0 out_seq=0 2023-11-28T11:56:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa467fc700 1 -- 172.21.15.50:0/353523418 <== mds.0 v2:172.21.15.50:6833/1163863991 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1acbe00 con 0x1b91540 2023-11-28T11:56:07.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa467fc700 10 client.6282 handle_command_reply: tid=0 2023-11-28T11:56:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 1 client.6282 shutdown 2023-11-28T11:56:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 1 -- 172.21.15.50:0/353523418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x19458c0 msgr2=0x1b8f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 1 --2- 172.21.15.50:0/353523418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x19458c0 0x1b8f250 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7faa6000b010 tx=0x7faa60004af0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 1 -- 172.21.15.50:0/353523418 shutdown_connections 2023-11-28T11:56:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 1 --2- 172.21.15.50:0/353523418 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x1b91540 0x1b91940 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 1 --2- 172.21.15.50:0/353523418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x19458c0 0x1b8f250 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 1 --2- 172.21.15.50:0/353523418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fac10 0x1b75ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 1 --2- 172.21.15.50:0/353523418 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fa840 0x1b750d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa467fc700 0 client.6282 ms_handle_reset on v2:172.21.15.50:6833/1163863991 2023-11-28T11:56:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 1 -- 172.21.15.50:0/353523418 >> 172.21.15.50:0/353523418 conn(0x18fafe0 msgr2=0x1b8a760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 1 -- 172.21.15.50:0/353523418 shutdown_connections 2023-11-28T11:56:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.470+0000 7faa70d71740 1 -- 172.21.15.50:0/353523418 wait complete. 2023-11-28T11:56:07.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.474+0000 7faa70d71740 20 client.6282 trim_cache size 0 max 16384 2023-11-28T11:56:07.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa70d71740 1 Processor -- start 2023-11-28T11:56:07.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa70d71740 1 -- start start 2023-11-28T11:56:07.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa70d71740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fafe0 0x1ba9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa70d71740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fa840 0x1ba95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa70d71740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x18fac10 0x1ba9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa70d71740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a95140 con 0x18fac10 2023-11-28T11:56:07.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa70d71740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a8b3d0 con 0x18fa840 2023-11-28T11:56:07.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa70d71740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ad1ef0 con 0x18fafe0 2023-11-28T11:56:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa67fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x18fac10 0x1ba9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa67fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x18fac10 0x1ba9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59266/0 (socket says 172.21.15.50:59266) 2023-11-28T11:56:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa67fff700 1 -- 172.21.15.50:0/3495561102 learned_addr learned my addr 172.21.15.50:0/3495561102 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa5ffff700 1 --2- 172.21.15.50:0/3495561102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fa840 0x1ba95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa677fe700 1 --2- 172.21.15.50:0/3495561102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fafe0 0x1ba9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa67fff700 1 -- 172.21.15.50:0/3495561102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fafe0 msgr2=0x1ba9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa67fff700 1 --2- 172.21.15.50:0/3495561102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fafe0 0x1ba9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa67fff700 1 -- 172.21.15.50:0/3495561102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fa840 msgr2=0x1ba95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa67fff700 1 --2- 172.21.15.50:0/3495561102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fa840 0x1ba95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa67fff700 1 -- 172.21.15.50:0/3495561102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa680d17e0 con 0x18fac10 2023-11-28T11:56:07.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.490+0000 7faa67fff700 1 --2- 172.21.15.50:0/3495561102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x18fac10 0x1ba9ae0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7faa60014a70 tx=0x7faa60025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec8640991218e50 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.494+0000 7faa5dffb700 1 -- 172.21.15.50:0/3495561102 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6001ea30 con 0x18fac10 2023-11-28T11:56:07.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.494+0000 7faa5dffb700 1 -- 172.21.15.50:0/3495561102 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa60030aa0 con 0x18fac10 2023-11-28T11:56:07.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.494+0000 7faa5dffb700 1 -- 172.21.15.50:0/3495561102 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60003c80 con 0x18fac10 2023-11-28T11:56:07.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.494+0000 7faa70d71740 1 -- 172.21.15.50:0/3495561102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x18fac10 msgr2=0x1ba9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.494+0000 7faa70d71740 1 --2- 172.21.15.50:0/3495561102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x18fac10 0x1ba9ae0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7faa60014a70 tx=0x7faa60025000 comp rx=0 tx=0).stop 2023-11-28T11:56:07.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.494+0000 7faa70d71740 1 -- 172.21.15.50:0/3495561102 shutdown_connections 2023-11-28T11:56:07.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.494+0000 7faa70d71740 1 --2- 172.21.15.50:0/3495561102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x18fac10 0x1ba9ae0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.494+0000 7faa70d71740 1 --2- 172.21.15.50:0/3495561102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fa840 0x1ba95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.494+0000 7faa70d71740 1 --2- 172.21.15.50:0/3495561102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fafe0 0x1ba9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.494+0000 7faa70d71740 1 -- 172.21.15.50:0/3495561102 >> 172.21.15.50:0/3495561102 conn(0x1b75c20 msgr2=0x1b787b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:07.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.494+0000 7faa70d71740 1 -- 172.21.15.50:0/3495561102 shutdown_connections 2023-11-28T11:56:07.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.494+0000 7faa70d71740 1 -- 172.21.15.50:0/3495561102 wait complete. 2023-11-28T11:56:07.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.494+0000 7faa70d71740 1 -- start start 2023-11-28T11:56:07.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.494+0000 7faa70d71740 1 Processor -- start 2023-11-28T11:56:07.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa70d71740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x18fa840 0x1b8c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa70d71740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fac10 0x1c0d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa70d71740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fafe0 0x1b8ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa70d71740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ace9d0 con 0x18fa840 2023-11-28T11:56:07.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa70d71740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aa8f70 con 0x18fafe0 2023-11-28T11:56:07.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa70d71740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b90670 con 0x18fac10 2023-11-28T11:56:07.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa70d71740 10 client.0 _ll_register_callbacks cb 0x7faa60009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:56:07.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x18fa840 0x1b8c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa677fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x18fa840 0x1b8c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59268/0 (socket says 172.21.15.50:59268) 2023-11-28T11:56:07.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa677fe700 1 -- 172.21.15.50:0/1373208964 learned_addr learned my addr 172.21.15.50:0/1373208964 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:07.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa67fff700 1 --2- 172.21.15.50:0/1373208964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fafe0 0x1b8ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa5ffff700 1 --2- 172.21.15.50:0/1373208964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fac10 0x1c0d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa677fe700 1 -- 172.21.15.50:0/1373208964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fac10 msgr2=0x1c0d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa677fe700 1 --2- 172.21.15.50:0/1373208964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fac10 0x1c0d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa677fe700 1 -- 172.21.15.50:0/1373208964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fafe0 msgr2=0x1b8ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:07.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa677fe700 1 --2- 172.21.15.50:0/1373208964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fafe0 0x1b8ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa677fe700 1 -- 172.21.15.50:0/1373208964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1946b10 con 0x18fa840 2023-11-28T11:56:07.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa677fe700 1 --2- 172.21.15.50:0/1373208964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x18fa840 0x1b8c1d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7faa540047f0 tx=0x7faa5800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51b00690b068fe6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:07.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa467fc700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:56:07.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa467fc700 1 -- 172.21.15.50:0/1373208964 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58006c90 con 0x18fa840 2023-11-28T11:56:07.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa467fc700 1 -- 172.21.15.50:0/1373208964 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7faa58032040 con 0x18fa840 2023-11-28T11:56:07.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa70d71740 1 -- 172.21.15.50:0/1373208964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa6000f040 con 0x18fa840 2023-11-28T11:56:07.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa467fc700 1 -- 172.21.15.50:0/1373208964 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa58006df0 con 0x18fa840 2023-11-28T11:56:07.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa70d71740 10 client.6288 fetch_fsmap learned FSMap version 25 2023-11-28T11:56:07.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa70d71740 1 -- 172.21.15.50:0/1373208964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x1a7faf0 con 0x18fa840 2023-11-28T11:56:07.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa467fc700 1 -- 172.21.15.50:0/1373208964 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6000f040 con 0x18fa840 2023-11-28T11:56:07.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa467fc700 1 -- 172.21.15.50:0/1373208964 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7faa580346d0 con 0x18fa840 2023-11-28T11:56:07.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa70d71740 10 client.6288 fetch_fsmap finished waiting for FSMap version 25 2023-11-28T11:56:07.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa70d71740 10 client.6288 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-11-28T11:56:07.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa70d71740 20 client.6288 populate_metadata read hostname 'smithi050' 2023-11-28T11:56:07.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa70d71740 1 --2- 172.21.15.50:0/1373208964 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x19458c0 0x1b8b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa70d71740 4 client.6288 mds_command: new command op to 6057 tid=0[{"prefix": "scrub status"}] 2023-11-28T11:56:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa70d71740 1 -- 172.21.15.50:0/1373208964 --> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1977390 con 0x19458c0 2023-11-28T11:56:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.498+0000 7faa5ffff700 1 --2- 172.21.15.50:0/1373208964 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x19458c0 0x1b8b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa467fc700 10 client.6288 ms_handle_connect on v2:172.21.15.50:6833/1163863991 2023-11-28T11:56:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa5ffff700 1 --2- 172.21.15.50:0/1373208964 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x19458c0 0x1b8b2b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=942f6e559b2e08c2 server_cookie=ba9b12694b421b99 in_seq=0 out_seq=0 2023-11-28T11:56:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa467fc700 1 -- 172.21.15.50:0/1373208964 <== mds.0 v2:172.21.15.50:6833/1163863991 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x1977390 con 0x19458c0 2023-11-28T11:56:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa467fc700 10 client.6288 handle_command_reply: tid=0 2023-11-28T11:56:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa70d71740 1 client.6288 shutdown 2023-11-28T11:56:07.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa70d71740 1 -- 172.21.15.50:0/1373208964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x18fa840 msgr2=0x1b8c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa70d71740 1 --2- 172.21.15.50:0/1373208964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x18fa840 0x1b8c1d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7faa540047f0 tx=0x7faa5800f000 comp rx=0 tx=0).stop 2023-11-28T11:56:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa70d71740 1 -- 172.21.15.50:0/1373208964 shutdown_connections 2023-11-28T11:56:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa70d71740 1 --2- 172.21.15.50:0/1373208964 >> [v2:172.21.15.50:6833/1163863991,v1:172.21.15.50:6834/1163863991] conn(0x19458c0 0x1b8b2b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa70d71740 1 --2- 172.21.15.50:0/1373208964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x18fafe0 0x1b8ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa70d71740 1 --2- 172.21.15.50:0/1373208964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x18fac10 0x1c0d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa467fc700 0 client.6288 ms_handle_reset on v2:172.21.15.50:6833/1163863991 2023-11-28T11:56:07.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa70d71740 1 --2- 172.21.15.50:0/1373208964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x18fa840 0x1b8c1d0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa70d71740 1 -- 172.21.15.50:0/1373208964 >> 172.21.15.50:0/1373208964 conn(0x1b75c20 msgr2=0x1b73f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:07.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa70d71740 1 -- 172.21.15.50:0/1373208964 shutdown_connections 2023-11-28T11:56:07.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa70d71740 1 -- 172.21.15.50:0/1373208964 wait complete. 2023-11-28T11:56:07.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa70d71740 20 client.6288 trim_cache size 0 max 16384 2023-11-28T11:56:07.513 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:56:07.513 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2023-11-28T11:56:07.513 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2023-11-28T11:56:07.514 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:56:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa6c88f700 1 -- 172.21.15.50:0/2647379955 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa48064ee0 msgr2=0x7faa48067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa6c88f700 1 --2- 172.21.15.50:0/2647379955 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa48064ee0 0x7faa48067390 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faa58015040 tx=0x7faa5800a000 comp rx=0 tx=0).stop 2023-11-28T11:56:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa6c88f700 1 -- 172.21.15.50:0/2647379955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa680c8500 msgr2=0x7faa680c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa6c88f700 1 --2- 172.21.15.50:0/2647379955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa680c8500 0x7faa680c8970 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7faa50007600 tx=0x7faa50007910 comp rx=0 tx=0).stop 2023-11-28T11:56:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa6c88f700 1 -- 172.21.15.50:0/2647379955 shutdown_connections 2023-11-28T11:56:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa6c88f700 1 --2- 172.21.15.50:0/2647379955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa680b0740 0x7faa680b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa6c88f700 1 --2- 172.21.15.50:0/2647379955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa680c8500 0x7faa680c8970 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa6c88f700 1 --2- 172.21.15.50:0/2647379955 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa48064ee0 0x7faa48067390 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa6c88f700 1 --2- 172.21.15.50:0/2647379955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa54003be0 0x7faa6814be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:07.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa6c88f700 1 -- 172.21.15.50:0/2647379955 >> 172.21.15.50:0/2647379955 conn(0x7faa6809bbd0 msgr2=0x7faa680b7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:07.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa6c88f700 1 -- 172.21.15.50:0/2647379955 shutdown_connections 2023-11-28T11:56:07.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:07.502+0000 7faa6c88f700 1 -- 172.21.15.50:0/2647379955 wait complete. 2023-11-28T11:56:07.522 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-28T11:56:07.623 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-11-28T11:56:08.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:08.006+0000 7f6a64ff9700 1 -- 172.21.15.50:0/107908266 <== mon.0 v2:172.21.15.50:3300/0 7 ==== log(6 entries from seq 1 at 2023-11-28T11:56:07.314473+0000) v1 ==== 1078+0+0 (secure 0 0 0) 0x7f6a5805bdc0 con 0x7f6a6806e000 2023-11-28T11:56:08.010 INFO:teuthology.orchestra.run.smithi050.stdout: cluster: 2023-11-28T11:56:08.010 INFO:teuthology.orchestra.run.smithi050.stdout: id: cfe07b6e-9334-49cb-bc97-5dba7caa4ff8 2023-11-28T11:56:08.010 INFO:teuthology.orchestra.run.smithi050.stdout: health: HEALTH_OK 2023-11-28T11:56:08.011 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:08.011 INFO:teuthology.orchestra.run.smithi050.stdout: services: 2023-11-28T11:56:08.011 INFO:teuthology.orchestra.run.smithi050.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2023-11-28T11:56:08.011 INFO:teuthology.orchestra.run.smithi050.stdout: mgr: x(active, since 2m), standbys: y 2023-11-28T11:56:08.011 INFO:teuthology.orchestra.run.smithi050.stdout: mds: 1/1 daemons up, 3 standby 2023-11-28T11:56:08.012 INFO:teuthology.orchestra.run.smithi050.stdout: osd: 8 osds: 8 up (since 2m), 8 in (since 2m) 2023-11-28T11:56:08.012 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:08.012 INFO:teuthology.orchestra.run.smithi050.stdout: data: 2023-11-28T11:56:08.012 INFO:teuthology.orchestra.run.smithi050.stdout: volumes: 1/1 healthy 2023-11-28T11:56:08.012 INFO:teuthology.orchestra.run.smithi050.stdout: pools: 4 pools, 105 pgs 2023-11-28T11:56:08.012 INFO:teuthology.orchestra.run.smithi050.stdout: objects: 24 objects, 579 KiB 2023-11-28T11:56:08.013 INFO:teuthology.orchestra.run.smithi050.stdout: usage: 86 MiB used, 720 GiB / 720 GiB avail 2023-11-28T11:56:08.013 INFO:teuthology.orchestra.run.smithi050.stdout: pgs: 105 active+clean 2023-11-28T11:56:08.013 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:08.013 INFO:teuthology.orchestra.run.smithi050.stdout: io: 2023-11-28T11:56:08.013 INFO:teuthology.orchestra.run.smithi050.stdout: client: 1.6 KiB/s wr, 0 op/s rd, 5 op/s wr 2023-11-28T11:56:08.013 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:08.013 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:08.013 INFO:teuthology.orchestra.run.smithi050.stdout:2023-11-28T11:56:07.314473+0000 mds.a [INF] scrub queued for path: / 2023-11-28T11:56:08.014 INFO:teuthology.orchestra.run.smithi050.stdout:2023-11-28T11:56:07.314478+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2023-11-28T11:56:08.014 INFO:teuthology.orchestra.run.smithi050.stdout:2023-11-28T11:56:07.314486+0000 mds.a [INF] scrub summary: active paths [/] 2023-11-28T11:56:08.014 INFO:teuthology.orchestra.run.smithi050.stdout:2023-11-28T11:56:07.315998+0000 mds.a [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2023-11-28T11:56:08.014 INFO:teuthology.orchestra.run.smithi050.stdout:2023-11-28T11:56:07.316015+0000 mds.a [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2023-11-28T11:56:08.014 INFO:teuthology.orchestra.run.smithi050.stdout:2023-11-28T11:56:07.316743+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2023-11-28T11:56:09.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:09.018+0000 7f6a64ff9700 1 -- 172.21.15.50:0/107908266 <== mon.0 v2:172.21.15.50:3300/0 8 ==== log(1 entries from seq 7 at 2023-11-28T11:56:07.432689+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7f6a58051e70 con 0x7f6a6806e000 2023-11-28T11:56:09.022 INFO:teuthology.orchestra.run.smithi050.stdout:2023-11-28T11:56:07.432689+0000 mds.a [INF] scrub summary: idle 2023-11-28T11:56:22.641 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:56:22.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0edae1d700 1 Processor -- start 2023-11-28T11:56:22.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0edae1d700 1 -- start start 2023-11-28T11:56:22.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0edae1d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ed40b1ca0 0x7f0ed40b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:22.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0edae1d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ed406a330 0x7f0ed40cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:22.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0edae1d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0ed40d2780 0x7f0ed40d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:22.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0edae1d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed40d3140 con 0x7f0ed406a330 2023-11-28T11:56:22.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0edae1d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed40cf070 con 0x7f0ed40d2780 2023-11-28T11:56:22.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0edae1d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed40b2070 con 0x7f0ed40b1ca0 2023-11-28T11:56:22.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0ed961a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ed406a330 0x7f0ed40cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:22.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0ed961a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ed406a330 0x7f0ed40cce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44016/0 (socket says 172.21.15.50:44016) 2023-11-28T11:56:22.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0ed961a700 1 -- 172.21.15.50:0/1036811027 learned_addr learned my addr 172.21.15.50:0/1036811027 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:22.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0eda61c700 1 --2- 172.21.15.50:0/1036811027 >> v2:172.21.15.192:3300/0 conn(0x7f0ed40d2780 0x7f0ed40d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:22.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0ed9e1b700 1 --2- 172.21.15.50:0/1036811027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ed40b1ca0 0x7f0ed40b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:22.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0eda61c700 1 -- 172.21.15.50:0/1036811027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ed40b1ca0 msgr2=0x7f0ed40b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:22.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0eda61c700 1 --2- 172.21.15.50:0/1036811027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ed40b1ca0 0x7f0ed40b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:22.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0eda61c700 1 -- 172.21.15.50:0/1036811027 >> v2:172.21.15.50:3300/0 conn(0x7f0ed406a330 msgr2=0x7f0ed40cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:22.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0eda61c700 1 --2- 172.21.15.50:0/1036811027 >> v2:172.21.15.50:3300/0 conn(0x7f0ed406a330 0x7f0ed40cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:22.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0eda61c700 1 -- 172.21.15.50:0/1036811027 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed406a8a0 con 0x7f0ed40d2780 2023-11-28T11:56:22.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.761+0000 7f0ed961a700 1 --2- 172.21.15.50:0/1036811027 >> v2:172.21.15.50:3300/0 conn(0x7f0ed406a330 0x7f0ed40cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:22.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0eda61c700 1 --2- 172.21.15.50:0/1036811027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed40d2780 0x7f0ed40d2c00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4066120 tx=0x7f0ecc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3347dfc49a7345 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:22.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0ed8e19700 1 -- 172.21.15.50:0/1036811027 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc00e070 con 0x7f0ed40d2780 2023-11-28T11:56:22.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0ed8e19700 1 -- 172.21.15.50:0/1036811027 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc00bb20 con 0x7f0ed40d2780 2023-11-28T11:56:22.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0ed8e19700 1 -- 172.21.15.50:0/1036811027 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc012430 con 0x7f0ed40d2780 2023-11-28T11:56:22.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0edae1d700 1 -- 172.21.15.50:0/1036811027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed40d2780 msgr2=0x7f0ed40d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:22.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0edae1d700 1 --2- 172.21.15.50:0/1036811027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed40d2780 0x7f0ed40d2c00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4066120 tx=0x7f0ecc00b330 comp rx=0 tx=0).stop 2023-11-28T11:56:22.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0edae1d700 1 -- 172.21.15.50:0/1036811027 shutdown_connections 2023-11-28T11:56:22.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0edae1d700 1 --2- 172.21.15.50:0/1036811027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed40d2780 0x7f0ed40d2c00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:22.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0edae1d700 1 --2- 172.21.15.50:0/1036811027 >> v2:172.21.15.50:3300/0 conn(0x7f0ed406a330 0x7f0ed40cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:22.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0edae1d700 1 --2- 172.21.15.50:0/1036811027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ed40b1ca0 0x7f0ed40b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:22.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0edae1d700 1 -- 172.21.15.50:0/1036811027 >> 172.21.15.50:0/1036811027 conn(0x7f0ed40b5740 msgr2=0x7f0ed40b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:22.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0edae1d700 1 -- 172.21.15.50:0/1036811027 shutdown_connections 2023-11-28T11:56:22.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0edae1d700 1 -- 172.21.15.50:0/1036811027 wait complete. 2023-11-28T11:56:22.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0edae1d700 1 Processor -- start 2023-11-28T11:56:22.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0edae1d700 1 -- start start 2023-11-28T11:56:22.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0edae1d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ed406a330 0x7f0ed415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:22.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0edae1d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed40b1ca0 0x7f0ed4151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:22.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0edae1d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed40d2780 0x7f0ed40c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:22.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0edae1d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed4152350 con 0x7f0ed40d2780 2023-11-28T11:56:22.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0edae1d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed41f34b0 con 0x7f0ed40b1ca0 2023-11-28T11:56:22.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0edae1d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed41f3790 con 0x7f0ed406a330 2023-11-28T11:56:22.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0eda61c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed40d2780 0x7f0ed40c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:22.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0eda61c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed40d2780 0x7f0ed40c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44032/0 (socket says 172.21.15.50:44032) 2023-11-28T11:56:22.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.765+0000 7f0eda61c700 1 -- 172.21.15.50:0/3913705290 learned_addr learned my addr 172.21.15.50:0/3913705290 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:22.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.769+0000 7f0ed961a700 1 --2- 172.21.15.50:0/3913705290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed40b1ca0 0x7f0ed4151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:22.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.769+0000 7f0ed9e1b700 1 --2- 172.21.15.50:0/3913705290 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ed406a330 0x7f0ed415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:22.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.769+0000 7f0eda61c700 1 -- 172.21.15.50:0/3913705290 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ed406a330 msgr2=0x7f0ed415c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:22.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.769+0000 7f0eda61c700 1 --2- 172.21.15.50:0/3913705290 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ed406a330 0x7f0ed415c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:22.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.769+0000 7f0eda61c700 1 -- 172.21.15.50:0/3913705290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed40b1ca0 msgr2=0x7f0ed4151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:22.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.769+0000 7f0eda61c700 1 --2- 172.21.15.50:0/3913705290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed40b1ca0 0x7f0ed4151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:22.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.769+0000 7f0eda61c700 1 -- 172.21.15.50:0/3913705290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec8009570 con 0x7f0ed40d2780 2023-11-28T11:56:22.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.769+0000 7f0eda61c700 1 --2- 172.21.15.50:0/3913705290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed40d2780 0x7f0ed40c8380 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc014040 tx=0x7f0ecc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:22.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.769+0000 7f0ec67fc700 1 -- 172.21.15.50:0/3913705290 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc0048b0 con 0x7f0ed40d2780 2023-11-28T11:56:22.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.769+0000 7f0edae1d700 1 -- 172.21.15.50:0/3913705290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ecc009a70 con 0x7f0ed40d2780 2023-11-28T11:56:22.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.769+0000 7f0ec67fc700 1 -- 172.21.15.50:0/3913705290 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc020070 con 0x7f0ed40d2780 2023-11-28T11:56:22.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.769+0000 7f0ec67fc700 1 -- 172.21.15.50:0/3913705290 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc0276c0 con 0x7f0ed40d2780 2023-11-28T11:56:22.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.769+0000 7f0edae1d700 1 -- 172.21.15.50:0/3913705290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed406ae60 con 0x7f0ed40d2780 2023-11-28T11:56:22.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.769+0000 7f0edae1d700 1 -- 172.21.15.50:0/3913705290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed406ab80 con 0x7f0ed40d2780 2023-11-28T11:56:22.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.773+0000 7f0ec67fc700 1 -- 172.21.15.50:0/3913705290 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0ecc02e070 con 0x7f0ed40d2780 2023-11-28T11:56:22.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.773+0000 7f0ec67fc700 1 --2- 172.21.15.50:0/3913705290 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0eb8064ee0 0x7f0eb8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:22.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.773+0000 7f0ec67fc700 1 -- 172.21.15.50:0/3913705290 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0ecc022070 con 0x7f0ed40d2780 2023-11-28T11:56:22.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.773+0000 7f0ed9e1b700 1 --2- 172.21.15.50:0/3913705290 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0eb8064ee0 0x7f0eb8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:22.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.773+0000 7f0ed9e1b700 1 --2- 172.21.15.50:0/3913705290 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0eb8064ee0 0x7f0eb8067390 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009b50 tx=0x7f0ed0009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:22.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.777+0000 7f0ec67fc700 1 -- 172.21.15.50:0/3913705290 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0ecc051b60 con 0x7f0ed40d2780 2023-11-28T11:56:22.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.981+0000 7f0edae1d700 1 -- 172.21.15.50:0/3913705290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ed406b140 con 0x7f0ed40d2780 2023-11-28T11:56:22.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.981+0000 7f0ec67fc700 1 -- 172.21.15.50:0/3913705290 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f0ecc02c090 con 0x7f0ed40d2780 2023-11-28T11:56:22.984 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:22.984 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2341737190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2341737190},{"type":"v1","addr":"172.21.15.50:6835","nonce":2341737190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5546,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/192527628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":192527628},{"type":"v1","addr":"172.21.15.192:6835","nonce":192527628}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5549,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2304989740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2304989740},{"type":"v1","addr":"172.21.15.192:6837","nonce":2304989740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:55:57.946191+0000","modified":"2023-11-28T11:56:00.964614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6057":{"gid":6057,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/1163863991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1163863991},{"type":"v1","addr":"172.21.15.50:6834","nonce":1163863991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:56:22.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.981+0000 7f0edae1d700 1 -- 172.21.15.50:0/3913705290 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0eb8064ee0 msgr2=0x7f0eb8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:22.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.981+0000 7f0edae1d700 1 --2- 172.21.15.50:0/3913705290 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0eb8064ee0 0x7f0eb8067390 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009b50 tx=0x7f0ed0009240 comp rx=0 tx=0).stop 2023-11-28T11:56:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.981+0000 7f0edae1d700 1 -- 172.21.15.50:0/3913705290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed40d2780 msgr2=0x7f0ed40c8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.981+0000 7f0edae1d700 1 --2- 172.21.15.50:0/3913705290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed40d2780 0x7f0ed40c8380 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc014040 tx=0x7f0ecc004af0 comp rx=0 tx=0).stop 2023-11-28T11:56:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.981+0000 7f0edae1d700 1 -- 172.21.15.50:0/3913705290 shutdown_connections 2023-11-28T11:56:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.981+0000 7f0edae1d700 1 --2- 172.21.15.50:0/3913705290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ed40d2780 0x7f0ed40c8380 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.981+0000 7f0edae1d700 1 --2- 172.21.15.50:0/3913705290 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0eb8064ee0 0x7f0eb8067390 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.981+0000 7f0edae1d700 1 --2- 172.21.15.50:0/3913705290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed40b1ca0 0x7f0ed4151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.981+0000 7f0edae1d700 1 --2- 172.21.15.50:0/3913705290 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ed406a330 0x7f0ed415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.981+0000 7f0edae1d700 1 -- 172.21.15.50:0/3913705290 >> 172.21.15.50:0/3913705290 conn(0x7f0ed40b5740 msgr2=0x7f0ed40ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.981+0000 7f0edae1d700 1 -- 172.21.15.50:0/3913705290 shutdown_connections 2023-11-28T11:56:22.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:22.981+0000 7f0edae1d700 1 -- 172.21.15.50:0/3913705290 wait complete. 2023-11-28T11:56:22.988 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2023-11-28T11:56:22.999 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-11-28T11:56:23.132 INFO:teuthology.orchestra.run.smithi050.stdout:{"message":"","return_code":0} 2023-11-28T11:56:23.132 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T11:56:23.132 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-28T11:56:23.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b3b2c140 1 Processor -- start 2023-11-28T11:56:23.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b3b2c140 1 -- start start 2023-11-28T11:56:23.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b3b2c140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acea1b9610 0x55acea313f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b3b2c140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acea28c5b0 0x55acea1e2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b3b2c140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acea28d6d0 0x55acea1ff940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b3b2c140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acea0dc240 con 0x55acea28d6d0 2023-11-28T11:56:23.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b3b2c140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acea1b91d0 con 0x55acea1b9610 2023-11-28T11:56:23.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b3b2c140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55acea2008d0 con 0x55acea28c5b0 2023-11-28T11:56:23.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b1e62700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acea28d6d0 0x55acea1ff940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b1e62700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acea28d6d0 0x55acea1ff940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44054/0 (socket says 172.21.15.50:44054) 2023-11-28T11:56:23.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b1e62700 1 -- 172.21.15.50:0/774251982 learned_addr learned my addr 172.21.15.50:0/774251982 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:23.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b1661700 1 --2- 172.21.15.50:0/774251982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acea1b9610 0x55acea313f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b0e60700 1 --2- 172.21.15.50:0/774251982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acea28c5b0 0x55acea1e2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b1e62700 1 -- 172.21.15.50:0/774251982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acea28c5b0 msgr2=0x55acea1e2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:23.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b1e62700 1 --2- 172.21.15.50:0/774251982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acea28c5b0 0x55acea1e2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b1e62700 1 -- 172.21.15.50:0/774251982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acea1b9610 msgr2=0x55acea313f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:23.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b1e62700 1 --2- 172.21.15.50:0/774251982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acea1b9610 0x55acea313f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b1e62700 1 -- 172.21.15.50:0/774251982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a4005d20 con 0x55acea28d6d0 2023-11-28T11:56:23.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b1e62700 1 --2- 172.21.15.50:0/774251982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acea28d6d0 0x55acea1ff940 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f629c0098d0 tx=0x7f629c005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab406dd3790734b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:23.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62ab7fe700 1 -- 172.21.15.50:0/774251982 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c00f040 con 0x55acea28d6d0 2023-11-28T11:56:23.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62ab7fe700 1 -- 172.21.15.50:0/774251982 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c0089b0 con 0x55acea28d6d0 2023-11-28T11:56:23.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62ab7fe700 1 -- 172.21.15.50:0/774251982 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c008d60 con 0x55acea28d6d0 2023-11-28T11:56:23.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b3b2c140 1 -- 172.21.15.50:0/774251982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acea28d6d0 msgr2=0x55acea1ff940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b3b2c140 1 --2- 172.21.15.50:0/774251982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acea28d6d0 0x55acea1ff940 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f629c0098d0 tx=0x7f629c005a00 comp rx=0 tx=0).stop 2023-11-28T11:56:23.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b3b2c140 1 -- 172.21.15.50:0/774251982 shutdown_connections 2023-11-28T11:56:23.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b3b2c140 1 --2- 172.21.15.50:0/774251982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acea28d6d0 0x55acea1ff940 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b3b2c140 1 --2- 172.21.15.50:0/774251982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acea28c5b0 0x55acea1e2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b3b2c140 1 --2- 172.21.15.50:0/774251982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acea1b9610 0x55acea313f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.165+0000 7f62b3b2c140 1 -- 172.21.15.50:0/774251982 >> 172.21.15.50:0/774251982 conn(0x55acea1e3dc0 msgr2=0x55acea1ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:23.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b3b2c140 1 -- 172.21.15.50:0/774251982 shutdown_connections 2023-11-28T11:56:23.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b3b2c140 1 -- 172.21.15.50:0/774251982 wait complete. 2023-11-28T11:56:23.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b3b2c140 1 Processor -- start 2023-11-28T11:56:23.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b3b2c140 1 -- start start 2023-11-28T11:56:23.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b3b2c140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acea1b9610 0x55acea3176d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b3b2c140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acea28c5b0 0x55acea286e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b3b2c140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acea28d6d0 0x55acea28b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b3b2c140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acea317f10 con 0x55acea28d6d0 2023-11-28T11:56:23.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b3b2c140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acea3181b0 con 0x55acea28c5b0 2023-11-28T11:56:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b3b2c140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55acea2888c0 con 0x55acea1b9610 2023-11-28T11:56:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b1e62700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acea28d6d0 0x55acea28b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b0e60700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acea28c5b0 0x55acea286e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b0e60700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acea28c5b0 0x55acea286e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:45962/0 (socket says 172.21.15.50:45962) 2023-11-28T11:56:23.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b0e60700 1 -- 172.21.15.50:0/2211942118 learned_addr learned my addr 172.21.15.50:0/2211942118 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:23.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b1661700 1 --2- 172.21.15.50:0/2211942118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acea1b9610 0x55acea3176d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b0e60700 1 -- 172.21.15.50:0/2211942118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acea1b9610 msgr2=0x55acea3176d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b0e60700 1 --2- 172.21.15.50:0/2211942118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acea1b9610 0x55acea3176d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b0e60700 1 -- 172.21.15.50:0/2211942118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acea28d6d0 msgr2=0x55acea28b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b0e60700 1 --2- 172.21.15.50:0/2211942118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acea28d6d0 0x55acea28b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b0e60700 1 -- 172.21.15.50:0/2211942118 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c009550 con 0x55acea28c5b0 2023-11-28T11:56:23.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b1e62700 1 --2- 172.21.15.50:0/2211942118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acea28d6d0 0x55acea28b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:23.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b0e60700 1 --2- 172.21.15.50:0/2211942118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acea28c5b0 0x55acea286e80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f62ac003f10 tx=0x7f62ac0017b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:23.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62aa7fc700 1 -- 172.21.15.50:0/2211942118 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac006e10 con 0x55acea28c5b0 2023-11-28T11:56:23.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62aa7fc700 1 -- 172.21.15.50:0/2211942118 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac001fe0 con 0x55acea28c5b0 2023-11-28T11:56:23.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b3b2c140 1 -- 172.21.15.50:0/2211942118 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55acea0f4390 con 0x55acea28c5b0 2023-11-28T11:56:23.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62aa7fc700 1 -- 172.21.15.50:0/2211942118 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0125f0 con 0x55acea28c5b0 2023-11-28T11:56:23.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.169+0000 7f62b3b2c140 1 -- 172.21.15.50:0/2211942118 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55acea0e78b0 con 0x55acea28c5b0 2023-11-28T11:56:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.173+0000 7f62aa7fc700 1 -- 172.21.15.50:0/2211942118 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f62ac012750 con 0x55acea28c5b0 2023-11-28T11:56:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.173+0000 7f62aa7fc700 1 --2- 172.21.15.50:0/2211942118 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6298063810 0x7f6298065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.173+0000 7f62aa7fc700 1 -- 172.21.15.50:0/2211942118 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f62ac080b10 con 0x55acea28c5b0 2023-11-28T11:56:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.173+0000 7f62b1661700 1 --2- 172.21.15.50:0/2211942118 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6298063810 0x7f6298065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.173+0000 7f62b3b2c140 1 --2- 172.21.15.50:0/2211942118 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x55acea2003f0 0x55acea289510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.173+0000 7f62b3b2c140 1 -- 172.21.15.50:0/2211942118 --> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54) v8 -- 0x55acea289a50 con 0x55acea2003f0 2023-11-28T11:56:23.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.173+0000 7f62b1e62700 1 --2- 172.21.15.50:0/2211942118 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x55acea2003f0 0x55acea289510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.177+0000 7f62b1661700 1 --2- 172.21.15.50:0/2211942118 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6298063810 0x7f6298065cc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f62a4005c20 tx=0x7f62a400f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:23.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.177+0000 7f62b1e62700 1 --2- 172.21.15.50:0/2211942118 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x55acea2003f0 0x55acea289510 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:23.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.177+0000 7f62b1e62700 1 -- 172.21.15.50:0/2211942118 <== osd.5 v2:172.21.15.192:6802/36817 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f629c019020 con 0x55acea2003f0 2023-11-28T11:56:23.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.177+0000 7f62b3b2c140 1 -- 172.21.15.50:0/2211942118 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x55acea2003f0 msgr2=0x55acea289510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.177+0000 7f62b3b2c140 1 --2- 172.21.15.50:0/2211942118 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x55acea2003f0 0x55acea289510 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.177+0000 7f62b3b2c140 1 -- 172.21.15.50:0/2211942118 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6298063810 msgr2=0x7f6298065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.177+0000 7f62b3b2c140 1 --2- 172.21.15.50:0/2211942118 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6298063810 0x7f6298065cc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f62a4005c20 tx=0x7f62a400f000 comp rx=0 tx=0).stop 2023-11-28T11:56:23.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.177+0000 7f62b3b2c140 1 -- 172.21.15.50:0/2211942118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acea28c5b0 msgr2=0x55acea286e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.177+0000 7f62b3b2c140 1 --2- 172.21.15.50:0/2211942118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acea28c5b0 0x55acea286e80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f62ac003f10 tx=0x7f62ac0017b0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.177+0000 7f62b1e62700 1 -- 172.21.15.50:0/2211942118 reap_dead start 2023-11-28T11:56:23.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.177+0000 7f62b3b2c140 1 -- 172.21.15.50:0/2211942118 shutdown_connections 2023-11-28T11:56:23.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.177+0000 7f62b3b2c140 1 -- 172.21.15.50:0/2211942118 >> 172.21.15.50:0/2211942118 conn(0x55acea1e3dc0 msgr2=0x55acea1fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:23.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.177+0000 7f62b3b2c140 1 -- 172.21.15.50:0/2211942118 shutdown_connections 2023-11-28T11:56:23.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.177+0000 7f62b3b2c140 1 -- 172.21.15.50:0/2211942118 wait complete. 2023-11-28T11:56:23.187 INFO:teuthology.orchestra.run.smithi050.stdout:Yalphaparent_a 2023-11-28T11:56:23.187 DEBUG:teuthology.orchestra.run.smithi050:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-28T11:56:23.244 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:56:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511627777, 2023-11-28T11:56:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "ancestors": [ 2023-11-28T11:56:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "dirino": 1099511627776, 2023-11-28T11:56:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "dname": "alpha", 2023-11-28T11:56:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 4 2023-11-28T11:56:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "dirino": 1, 2023-11-28T11:56:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "dname": "parent_a", 2023-11-28T11:56:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 7 2023-11-28T11:56:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-11-28T11:56:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 9, 2023-11-28T11:56:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: "old_pools": [] 2023-11-28T11:56:23.246 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:56:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:23.247 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:56:23.247 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:56:23.268 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:56:23.288 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:56:23.288 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:56:23.288 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:56:23.318 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:23.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.429+0000 7f4d8ef71700 1 Processor -- start 2023-11-28T11:56:23.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.429+0000 7f4d8ef71700 1 -- start start 2023-11-28T11:56:23.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.433+0000 7f4d8ef71700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d8815a050 0x7f4d880ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.433+0000 7f4d8ef71700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d8806cac0 0x7f4d8815d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.433+0000 7f4d8ef71700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d881599a0 con 0x7f4d8815cc20 2023-11-28T11:56:23.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.433+0000 7f4d8ef71700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d88153bb0 con 0x7f4d8815a050 2023-11-28T11:56:23.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.433+0000 7f4d8ef71700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d880cdae0 con 0x7f4d8806cac0 2023-11-28T11:56:23.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.433+0000 7f4d8cd0d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d8815a050 0x7f4d880ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.433+0000 7f4d8cd0d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d8815a050 0x7f4d880ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44082/0 (socket says 172.21.15.50:44082) 2023-11-28T11:56:23.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.433+0000 7f4d8cd0d700 1 -- 172.21.15.50:0/4012986178 learned_addr learned my addr 172.21.15.50:0/4012986178 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:23.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.433+0000 7f4d8d50e700 1 --2- 172.21.15.50:0/4012986178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d8806cac0 0x7f4d8815d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.433+0000 7f4d8cd0d700 1 -- 172.21.15.50:0/4012986178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d8806cac0 msgr2=0x7f4d8815d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:23.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.433+0000 7f4d8cd0d700 1 --2- 172.21.15.50:0/4012986178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d8806cac0 0x7f4d8815d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.433+0000 7f4d8cd0d700 1 -- 172.21.15.50:0/4012986178 >> v1:172.21.15.192:6789/0 conn(0x7f4d8815cc20 legacy=0x7f4d8806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.433+0000 7f4d8cd0d700 1 -- 172.21.15.50:0/4012986178 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8815d790 con 0x7f4d8815a050 2023-11-28T11:56:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.433+0000 7f4d8cd0d700 1 --2- 172.21.15.50:0/4012986178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8815a050 0x7f4d880ce580 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009910 tx=0x7f4d84009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c10704b4637d93c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.433+0000 7f4d7f7fe700 1 -- 172.21.15.50:0/4012986178 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84011830 con 0x7f4d8815a050 2023-11-28T11:56:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.433+0000 7f4d7f7fe700 1 -- 172.21.15.50:0/4012986178 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d84011990 con 0x7f4d8815a050 2023-11-28T11:56:23.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.433+0000 7f4d7f7fe700 1 -- 172.21.15.50:0/4012986178 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84011d40 con 0x7f4d8815a050 2023-11-28T11:56:23.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.437+0000 7f4d8ef71700 1 -- 172.21.15.50:0/4012986178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8815a050 msgr2=0x7f4d880ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.437+0000 7f4d8ef71700 1 --2- 172.21.15.50:0/4012986178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8815a050 0x7f4d880ce580 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009910 tx=0x7f4d84009c20 comp rx=0 tx=0).stop 2023-11-28T11:56:23.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.437+0000 7f4d8ef71700 1 -- 172.21.15.50:0/4012986178 shutdown_connections 2023-11-28T11:56:23.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.437+0000 7f4d8ef71700 1 --2- 172.21.15.50:0/4012986178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d8806cac0 0x7f4d8815d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.437+0000 7f4d8ef71700 1 --2- 172.21.15.50:0/4012986178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8815a050 0x7f4d880ce580 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.437+0000 7f4d8ef71700 1 -- 172.21.15.50:0/4012986178 >> 172.21.15.50:0/4012986178 conn(0x7f4d880b0a90 msgr2=0x7f4d880b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.437+0000 7f4d8ef71700 1 -- 172.21.15.50:0/4012986178 shutdown_connections 2023-11-28T11:56:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.437+0000 7f4d8ef71700 1 -- 172.21.15.50:0/4012986178 wait complete. 2023-11-28T11:56:23.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.437+0000 7f4d8ef71700 1 Processor -- start 2023-11-28T11:56:23.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.437+0000 7f4d8ef71700 1 -- start start 2023-11-28T11:56:23.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d8ef71700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d8806cac0 0x7f4d880b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d8ef71700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8815a050 0x7f4d880b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d8ef71700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d8815cc20 0x7f4d88145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d8ef71700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d88150ce0 con 0x7f4d8815a050 2023-11-28T11:56:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d8ef71700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d880b4e40 con 0x7f4d8806cac0 2023-11-28T11:56:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d8ef71700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d880b3860 con 0x7f4d8815cc20 2023-11-28T11:56:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d7ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8815a050 0x7f4d880b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d7ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8815a050 0x7f4d880b4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44086/0 (socket says 172.21.15.50:44086) 2023-11-28T11:56:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d7ffff700 1 -- 172.21.15.50:0/1460818066 learned_addr learned my addr 172.21.15.50:0/1460818066 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d8cd0d700 1 --2- 172.21.15.50:0/1460818066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d8806cac0 0x7f4d880b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d8d50e700 1 --2- 172.21.15.50:0/1460818066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d8815cc20 0x7f4d88145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d7ffff700 1 -- 172.21.15.50:0/1460818066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d8815cc20 msgr2=0x7f4d88145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d7ffff700 1 --2- 172.21.15.50:0/1460818066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d8815cc20 0x7f4d88145c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d7ffff700 1 -- 172.21.15.50:0/1460818066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d8806cac0 msgr2=0x7f4d880b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d7ffff700 1 --2- 172.21.15.50:0/1460818066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d8806cac0 0x7f4d880b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d7ffff700 1 -- 172.21.15.50:0/1460818066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d84009570 con 0x7f4d8815a050 2023-11-28T11:56:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d8cd0d700 1 --2- 172.21.15.50:0/1460818066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d8806cac0 0x7f4d880b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d7ffff700 1 --2- 172.21.15.50:0/1460818066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8815a050 0x7f4d880b4900 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800c500 tx=0x7f4d7800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d7d7fa700 1 -- 172.21.15.50:0/1460818066 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d780052d0 con 0x7f4d8815a050 2023-11-28T11:56:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d7d7fa700 1 -- 172.21.15.50:0/1460818066 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d78005430 con 0x7f4d8815a050 2023-11-28T11:56:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d8ef71700 1 -- 172.21.15.50:0/1460818066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d880cdda0 con 0x7f4d8815a050 2023-11-28T11:56:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d7d7fa700 1 -- 172.21.15.50:0/1460818066 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d780055a0 con 0x7f4d8815a050 2023-11-28T11:56:23.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.441+0000 7f4d8ef71700 1 -- 172.21.15.50:0/1460818066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8815da70 con 0x7f4d8815a050 2023-11-28T11:56:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.445+0000 7f4d8ef71700 1 -- 172.21.15.50:0/1460818066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d880ce080 con 0x7f4d8815a050 2023-11-28T11:56:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.445+0000 7f4d7d7fa700 1 -- 172.21.15.50:0/1460818066 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4d78019030 con 0x7f4d8815a050 2023-11-28T11:56:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.445+0000 7f4d7d7fa700 1 --2- 172.21.15.50:0/1460818066 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4d74064ee0 0x7f4d74067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.445+0000 7f4d7d7fa700 1 -- 172.21.15.50:0/1460818066 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4d780813e0 con 0x7f4d8815a050 2023-11-28T11:56:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.445+0000 7f4d8cd0d700 1 --2- 172.21.15.50:0/1460818066 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4d74064ee0 0x7f4d74067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.449+0000 7f4d8cd0d700 1 --2- 172.21.15.50:0/1460818066 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4d74064ee0 0x7f4d74067390 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4d84000c00 tx=0x7f4d84008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.453+0000 7f4d7d7fa700 1 -- 172.21.15.50:0/1460818066 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4d7804f350 con 0x7f4d8815a050 2023-11-28T11:56:23.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.613+0000 7f4d8ef71700 1 -- 172.21.15.50:0/1460818066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d88072c20 con 0x7f4d8815a050 2023-11-28T11:56:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.617+0000 7f4d7d7fa700 1 -- 172.21.15.50:0/1460818066 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18026 (secure 0 0 0) 0x7f4d78052970 con 0x7f4d8815a050 2023-11-28T11:56:23.620 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:23.620 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":54,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:55:58.950592+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:55:55.575648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T11:55:56.934531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:23.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.617+0000 7f4d8ef71700 1 -- 172.21.15.50:0/1460818066 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4d74064ee0 msgr2=0x7f4d74067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.617+0000 7f4d8ef71700 1 --2- 172.21.15.50:0/1460818066 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4d74064ee0 0x7f4d74067390 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4d84000c00 tx=0x7f4d84008030 comp rx=0 tx=0).stop 2023-11-28T11:56:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.617+0000 7f4d8ef71700 1 -- 172.21.15.50:0/1460818066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8815a050 msgr2=0x7f4d880b4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.617+0000 7f4d8ef71700 1 --2- 172.21.15.50:0/1460818066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8815a050 0x7f4d880b4900 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800c500 tx=0x7f4d7800c8c0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.617+0000 7f4d8ef71700 1 -- 172.21.15.50:0/1460818066 shutdown_connections 2023-11-28T11:56:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.617+0000 7f4d8ef71700 1 --2- 172.21.15.50:0/1460818066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d8815cc20 0x7f4d88145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.617+0000 7f4d8ef71700 1 --2- 172.21.15.50:0/1460818066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d8815a050 0x7f4d880b4900 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.617+0000 7f4d8ef71700 1 --2- 172.21.15.50:0/1460818066 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4d74064ee0 0x7f4d74067390 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.617+0000 7f4d8ef71700 1 --2- 172.21.15.50:0/1460818066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d8806cac0 0x7f4d880b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.617+0000 7f4d8ef71700 1 -- 172.21.15.50:0/1460818066 >> 172.21.15.50:0/1460818066 conn(0x7f4d880b0a90 msgr2=0x7f4d8806a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.617+0000 7f4d8ef71700 1 -- 172.21.15.50:0/1460818066 shutdown_connections 2023-11-28T11:56:23.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.617+0000 7f4d8ef71700 1 -- 172.21.15.50:0/1460818066 wait complete. 2023-11-28T11:56:23.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:55:55.575648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:55:56.934531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:56:23.635 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:56:23.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.753+0000 7fcd21f6c700 1 Processor -- start 2023-11-28T11:56:23.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.753+0000 7fcd21f6c700 1 -- start start 2023-11-28T11:56:23.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd21f6c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcd140e29f0 0x7fcd14055490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd21f6c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd14007360 con 0x7fcd14038560 2023-11-28T11:56:23.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd21f6c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd14053f70 con 0x7fcd1403b330 2023-11-28T11:56:23.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd21f6c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd140e2dc0 con 0x7fcd140e29f0 2023-11-28T11:56:23.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd1bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcd14038560 0x7fcd1403ac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40312/0 (socket says 172.21.15.50:40312) 2023-11-28T11:56:23.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd1bfff700 1 -- 172.21.15.50:0/1853764209 learned_addr learned my addr 172.21.15.50:0/1853764209 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:23.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd20f6a700 1 --2- 172.21.15.50:0/1853764209 >> v2:172.21.15.192:3300/0 conn(0x7fcd140e29f0 0x7fcd14055490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd1b7fe700 1 -- 172.21.15.50:0/1853764209 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490663926 0 0) 0x7fcd14007360 con 0x7fcd14038560 2023-11-28T11:56:23.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd1b7fe700 1 -- 172.21.15.50:0/1853764209 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd0c0035d0 con 0x7fcd14038560 2023-11-28T11:56:23.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd20f6a700 1 -- 172.21.15.50:0/1853764209 >> v1:172.21.15.192:6789/0 conn(0x7fcd1403b330 legacy=0x7fcd14057210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd20f6a700 1 -- 172.21.15.50:0/1853764209 >> v1:172.21.15.50:6789/0 conn(0x7fcd14038560 legacy=0x7fcd1403ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd20f6a700 1 -- 172.21.15.50:0/1853764209 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd14006dc0 con 0x7fcd140e29f0 2023-11-28T11:56:23.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd20f6a700 1 --2- 172.21.15.50:0/1853764209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd140e29f0 0x7fcd14055490 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009850 tx=0x7fcd08009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=533ab21a181c257c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:23.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd1b7fe700 1 -- 172.21.15.50:0/1853764209 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08011830 con 0x7fcd140e29f0 2023-11-28T11:56:23.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd1b7fe700 1 -- 172.21.15.50:0/1853764209 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd08011990 con 0x7fcd140e29f0 2023-11-28T11:56:23.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd1b7fe700 1 -- 172.21.15.50:0/1853764209 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08011d40 con 0x7fcd140e29f0 2023-11-28T11:56:23.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd21f6c700 1 -- 172.21.15.50:0/1853764209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd140e29f0 msgr2=0x7fcd14055490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd21f6c700 1 --2- 172.21.15.50:0/1853764209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd140e29f0 0x7fcd14055490 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009850 tx=0x7fcd08009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:23.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd21f6c700 1 -- 172.21.15.50:0/1853764209 shutdown_connections 2023-11-28T11:56:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd21f6c700 1 --2- 172.21.15.50:0/1853764209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd140e29f0 0x7fcd14055490 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd21f6c700 1 -- 172.21.15.50:0/1853764209 >> 172.21.15.50:0/1853764209 conn(0x7fcd14055c20 msgr2=0x7fcd14056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd21f6c700 1 -- 172.21.15.50:0/1853764209 shutdown_connections 2023-11-28T11:56:23.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.757+0000 7fcd21f6c700 1 -- 172.21.15.50:0/1853764209 wait complete. 2023-11-28T11:56:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd21f6c700 1 Processor -- start 2023-11-28T11:56:23.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd21f6c700 1 -- start start 2023-11-28T11:56:23.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd21f6c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd14038560 0x7fcd1417c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd21f6c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd1403b330 0x7fcd14177a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd21f6c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd140e29f0 0x7fcd14050d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd21f6c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140e0e90 con 0x7fcd14038560 2023-11-28T11:56:23.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd21f6c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140e6dc0 con 0x7fcd1403b330 2023-11-28T11:56:23.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd21f6c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1417c600 con 0x7fcd140e29f0 2023-11-28T11:56:23.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd20f6a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd14038560 0x7fcd1417c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd20f6a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd14038560 0x7fcd1417c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44098/0 (socket says 172.21.15.50:44098) 2023-11-28T11:56:23.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd20f6a700 1 -- 172.21.15.50:0/1941014426 learned_addr learned my addr 172.21.15.50:0/1941014426 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:23.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd1bfff700 1 --2- 172.21.15.50:0/1941014426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd1403b330 0x7fcd14177a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd2176b700 1 --2- 172.21.15.50:0/1941014426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd140e29f0 0x7fcd14050d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd20f6a700 1 -- 172.21.15.50:0/1941014426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd140e29f0 msgr2=0x7fcd14050d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd20f6a700 1 --2- 172.21.15.50:0/1941014426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd140e29f0 0x7fcd14050d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd20f6a700 1 -- 172.21.15.50:0/1941014426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd1403b330 msgr2=0x7fcd14177a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd20f6a700 1 --2- 172.21.15.50:0/1941014426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd1403b330 0x7fcd14177a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd20f6a700 1 -- 172.21.15.50:0/1941014426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd080094b0 con 0x7fcd14038560 2023-11-28T11:56:23.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.761+0000 7fcd20f6a700 1 --2- 172.21.15.50:0/1941014426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd14038560 0x7fcd1417c0c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcd08014040 tx=0x7fcd08004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:23.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.765+0000 7fcd197fa700 1 -- 172.21.15.50:0/1941014426 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08004610 con 0x7fcd14038560 2023-11-28T11:56:23.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.765+0000 7fcd197fa700 1 -- 172.21.15.50:0/1941014426 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0801e070 con 0x7fcd14038560 2023-11-28T11:56:23.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.765+0000 7fcd21f6c700 1 -- 172.21.15.50:0/1941014426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd14053920 con 0x7fcd14038560 2023-11-28T11:56:23.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.765+0000 7fcd197fa700 1 -- 172.21.15.50:0/1941014426 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08003900 con 0x7fcd14038560 2023-11-28T11:56:23.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.765+0000 7fcd21f6c700 1 -- 172.21.15.50:0/1941014426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd14007080 con 0x7fcd14038560 2023-11-28T11:56:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.765+0000 7fcd197fa700 1 -- 172.21.15.50:0/1941014426 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcd0800f050 con 0x7fcd14038560 2023-11-28T11:56:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.765+0000 7fcd21f6c700 1 -- 172.21.15.50:0/1941014426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd14053c00 con 0x7fcd14038560 2023-11-28T11:56:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.765+0000 7fcd197fa700 1 --2- 172.21.15.50:0/1941014426 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcd00064f10 0x7fcd000673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:23.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.765+0000 7fcd197fa700 1 -- 172.21.15.50:0/1941014426 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcd08020070 con 0x7fcd14038560 2023-11-28T11:56:23.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.765+0000 7fcd1bfff700 1 --2- 172.21.15.50:0/1941014426 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcd00064f10 0x7fcd000673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:23.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.769+0000 7fcd1bfff700 1 --2- 172.21.15.50:0/1941014426 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcd00064f10 0x7fcd000673c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcd14054580 tx=0x7fcd10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:23.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.773+0000 7fcd197fa700 1 -- 172.21.15.50:0/1941014426 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcd08051430 con 0x7fcd14038560 2023-11-28T11:56:23.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.937+0000 7fcd21f6c700 1 -- 172.21.15.50:0/1941014426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcd14005570 con 0x7fcd14038560 2023-11-28T11:56:23.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.937+0000 7fcd197fa700 1 -- 172.21.15.50:0/1941014426 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v54) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcd08054a50 con 0x7fcd14038560 2023-11-28T11:56:23.942 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:56:23.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.941+0000 7fcd21f6c700 1 -- 172.21.15.50:0/1941014426 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcd00064f10 msgr2=0x7fcd000673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.941+0000 7fcd21f6c700 1 --2- 172.21.15.50:0/1941014426 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcd00064f10 0x7fcd000673c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcd14054580 tx=0x7fcd10009040 comp rx=0 tx=0).stop 2023-11-28T11:56:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.941+0000 7fcd21f6c700 1 -- 172.21.15.50:0/1941014426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd14038560 msgr2=0x7fcd1417c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.941+0000 7fcd21f6c700 1 --2- 172.21.15.50:0/1941014426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd14038560 0x7fcd1417c0c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcd08014040 tx=0x7fcd08004770 comp rx=0 tx=0).stop 2023-11-28T11:56:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.941+0000 7fcd21f6c700 1 -- 172.21.15.50:0/1941014426 shutdown_connections 2023-11-28T11:56:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.941+0000 7fcd21f6c700 1 --2- 172.21.15.50:0/1941014426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd140e29f0 0x7fcd14050d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.941+0000 7fcd21f6c700 1 --2- 172.21.15.50:0/1941014426 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcd00064f10 0x7fcd000673c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.941+0000 7fcd21f6c700 1 --2- 172.21.15.50:0/1941014426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd1403b330 0x7fcd14177a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.941+0000 7fcd21f6c700 1 --2- 172.21.15.50:0/1941014426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd14038560 0x7fcd1417c0c0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.941+0000 7fcd21f6c700 1 -- 172.21.15.50:0/1941014426 >> 172.21.15.50:0/1941014426 conn(0x7fcd14055c20 msgr2=0x7fcd14057210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.941+0000 7fcd21f6c700 1 -- 172.21.15.50:0/1941014426 shutdown_connections 2023-11-28T11:56:23.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:23.941+0000 7fcd21f6c700 1 -- 172.21.15.50:0/1941014426 wait complete. 2023-11-28T11:56:23.961 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:56:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f3396050700 1 Processor -- start 2023-11-28T11:56:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f3396050700 1 -- start start 2023-11-28T11:56:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f3396050700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f339006a4c0 0x7f339006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f3396050700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33900cf0e0 0x7f33900cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f3396050700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33900cfa80 con 0x7f33900b1ae0 2023-11-28T11:56:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f3396050700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33900d0ab0 con 0x7f339006a4c0 2023-11-28T11:56:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f3396050700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339006a9c0 con 0x7f33900cf0e0 2023-11-28T11:56:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f339484d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f339006a4c0 0x7f339006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f339504e700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f33900b1ae0 0x7f33900d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40314/0 (socket says 172.21.15.50:40314) 2023-11-28T11:56:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f339484d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f339006a4c0 0x7f339006d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44108/0 (socket says 172.21.15.50:44108) 2023-11-28T11:56:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f339504e700 1 -- 172.21.15.50:0/3169496737 learned_addr learned my addr 172.21.15.50:0/3169496737 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f339484d700 1 -- 172.21.15.50:0/3169496737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33900cf0e0 msgr2=0x7f33900cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f339584f700 1 --2- 172.21.15.50:0/3169496737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33900cf0e0 0x7f33900cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f339484d700 1 --2- 172.21.15.50:0/3169496737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33900cf0e0 0x7f33900cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f339484d700 1 -- 172.21.15.50:0/3169496737 >> v1:172.21.15.50:6789/0 conn(0x7f33900b1ae0 legacy=0x7f33900d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f339484d700 1 -- 172.21.15.50:0/3169496737 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339006aca0 con 0x7f339006a4c0 2023-11-28T11:56:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f3387fff700 1 -- 172.21.15.50:0/3169496737 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549209519 0 0) 0x7f33900cfa80 con 0x7f33900b1ae0 2023-11-28T11:56:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.081+0000 7f339584f700 1 --2- 172.21.15.50:0/3169496737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33900cf0e0 0x7f33900cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.085+0000 7f339484d700 1 --2- 172.21.15.50:0/3169496737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f339006a4c0 0x7f339006d8e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f338c009850 tx=0x7f338c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698d3a7cc7c25200 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.085+0000 7f3387fff700 1 -- 172.21.15.50:0/3169496737 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c011830 con 0x7f339006a4c0 2023-11-28T11:56:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.085+0000 7f3387fff700 1 -- 172.21.15.50:0/3169496737 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c011990 con 0x7f339006a4c0 2023-11-28T11:56:24.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.085+0000 7f3387fff700 1 -- 172.21.15.50:0/3169496737 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c011d20 con 0x7f339006a4c0 2023-11-28T11:56:24.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.085+0000 7f3396050700 1 -- 172.21.15.50:0/3169496737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f339006a4c0 msgr2=0x7f339006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.085+0000 7f3396050700 1 --2- 172.21.15.50:0/3169496737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f339006a4c0 0x7f339006d8e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f338c009850 tx=0x7f338c009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.085+0000 7f3396050700 1 -- 172.21.15.50:0/3169496737 shutdown_connections 2023-11-28T11:56:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.085+0000 7f3396050700 1 --2- 172.21.15.50:0/3169496737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33900cf0e0 0x7f33900cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.085+0000 7f3396050700 1 --2- 172.21.15.50:0/3169496737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f339006a4c0 0x7f339006d8e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.085+0000 7f3396050700 1 -- 172.21.15.50:0/3169496737 >> 172.21.15.50:0/3169496737 conn(0x7f339009bbd0 msgr2=0x7f33900b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.085+0000 7f3396050700 1 -- 172.21.15.50:0/3169496737 shutdown_connections 2023-11-28T11:56:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.085+0000 7f3396050700 1 -- 172.21.15.50:0/3169496737 wait complete. 2023-11-28T11:56:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f3396050700 1 Processor -- start 2023-11-28T11:56:24.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f3396050700 1 -- start start 2023-11-28T11:56:24.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f3396050700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f339006a4c0 0x7f339014dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f3396050700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33900b1ae0 0x7f33900d1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f3396050700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33900cf0e0 0x7f33900d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f3396050700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339009d1c0 con 0x7f339006a4c0 2023-11-28T11:56:24.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f3396050700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339014bf70 con 0x7f33900b1ae0 2023-11-28T11:56:24.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f3396050700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339014b640 con 0x7f33900cf0e0 2023-11-28T11:56:24.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f339504e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f339006a4c0 0x7f339014dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f339504e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f339006a4c0 0x7f339014dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44118/0 (socket says 172.21.15.50:44118) 2023-11-28T11:56:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f339504e700 1 -- 172.21.15.50:0/3914672980 learned_addr learned my addr 172.21.15.50:0/3914672980 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f339584f700 1 --2- 172.21.15.50:0/3914672980 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33900cf0e0 0x7f33900d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f339504e700 1 -- 172.21.15.50:0/3914672980 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33900cf0e0 msgr2=0x7f33900d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f339484d700 1 --2- 172.21.15.50:0/3914672980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33900b1ae0 0x7f33900d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f339504e700 1 --2- 172.21.15.50:0/3914672980 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33900cf0e0 0x7f33900d1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f339504e700 1 -- 172.21.15.50:0/3914672980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33900b1ae0 msgr2=0x7f33900d1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f339504e700 1 --2- 172.21.15.50:0/3914672980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33900b1ae0 0x7f33900d1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f339504e700 1 -- 172.21.15.50:0/3914672980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c0094b0 con 0x7f339006a4c0 2023-11-28T11:56:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f339484d700 1 --2- 172.21.15.50:0/3914672980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33900b1ae0 0x7f33900d1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f339504e700 1 --2- 172.21.15.50:0/3914672980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f339006a4c0 0x7f339014dd70 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f338000c4e0 tx=0x7f338000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:24.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f3385ffb700 1 -- 172.21.15.50:0/3914672980 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380004ca0 con 0x7f339006a4c0 2023-11-28T11:56:24.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f3385ffb700 1 -- 172.21.15.50:0/3914672980 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380004e20 con 0x7f339006a4c0 2023-11-28T11:56:24.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f3396050700 1 -- 172.21.15.50:0/3914672980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33900b4380 con 0x7f339006a4c0 2023-11-28T11:56:24.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f3385ffb700 1 -- 172.21.15.50:0/3914672980 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380007310 con 0x7f339006a4c0 2023-11-28T11:56:24.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.089+0000 7f3396050700 1 -- 172.21.15.50:0/3914672980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339006af80 con 0x7f339006a4c0 2023-11-28T11:56:24.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.093+0000 7f3396050700 1 -- 172.21.15.50:0/3914672980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33900b1eb0 con 0x7f339006a4c0 2023-11-28T11:56:24.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.093+0000 7f3385ffb700 1 -- 172.21.15.50:0/3914672980 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f338001a020 con 0x7f339006a4c0 2023-11-28T11:56:24.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.093+0000 7f3385ffb700 1 --2- 172.21.15.50:0/3914672980 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3374064ee0 0x7f3374067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.093+0000 7f3385ffb700 1 -- 172.21.15.50:0/3914672980 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3380081c90 con 0x7f339006a4c0 2023-11-28T11:56:24.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.093+0000 7f339484d700 1 --2- 172.21.15.50:0/3914672980 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3374064ee0 0x7f3374067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.093+0000 7f339484d700 1 --2- 172.21.15.50:0/3914672980 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3374064ee0 0x7f3374067390 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f338c0090b0 tx=0x7f338c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:24.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.101+0000 7f3385ffb700 1 -- 172.21.15.50:0/3914672980 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f338004fc00 con 0x7f339006a4c0 2023-11-28T11:56:24.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.261+0000 7f3396050700 1 -- 172.21.15.50:0/3914672980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3390072500 con 0x7f339006a4c0 2023-11-28T11:56:24.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.265+0000 7f3385ffb700 1 -- 172.21.15.50:0/3914672980 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3380053220 con 0x7f339006a4c0 2023-11-28T11:56:24.269 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:56:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.265+0000 7f3396050700 1 -- 172.21.15.50:0/3914672980 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3374064ee0 msgr2=0x7f3374067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.265+0000 7f3396050700 1 --2- 172.21.15.50:0/3914672980 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3374064ee0 0x7f3374067390 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f338c0090b0 tx=0x7f338c008030 comp rx=0 tx=0).stop 2023-11-28T11:56:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.265+0000 7f3396050700 1 -- 172.21.15.50:0/3914672980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f339006a4c0 msgr2=0x7f339014dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.265+0000 7f3396050700 1 --2- 172.21.15.50:0/3914672980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f339006a4c0 0x7f339014dd70 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f338000c4e0 tx=0x7f338000c8a0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.265+0000 7f3396050700 1 -- 172.21.15.50:0/3914672980 shutdown_connections 2023-11-28T11:56:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.265+0000 7f3396050700 1 --2- 172.21.15.50:0/3914672980 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33900cf0e0 0x7f33900d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.265+0000 7f3396050700 1 --2- 172.21.15.50:0/3914672980 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3374064ee0 0x7f3374067390 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.265+0000 7f3396050700 1 --2- 172.21.15.50:0/3914672980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33900b1ae0 0x7f33900d1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.265+0000 7f3396050700 1 --2- 172.21.15.50:0/3914672980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f339006a4c0 0x7f339014dd70 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.265+0000 7f3396050700 1 -- 172.21.15.50:0/3914672980 >> 172.21.15.50:0/3914672980 conn(0x7f339009bbd0 msgr2=0x7f339015bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:24.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.265+0000 7f3396050700 1 -- 172.21.15.50:0/3914672980 shutdown_connections 2023-11-28T11:56:24.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.265+0000 7f3396050700 1 -- 172.21.15.50:0/3914672980 wait complete. 2023-11-28T11:56:24.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:56:24.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.401+0000 7f432bfff700 1 Processor -- start 2023-11-28T11:56:24.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.401+0000 7f432bfff700 1 -- start start 2023-11-28T11:56:24.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.401+0000 7f432bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f432c06af20 0x7f432c0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.401+0000 7f432bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f432c06cc50 0x7f432c0cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.401+0000 7f432bfff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432c06dc40 con 0x7f432c0b5ec0 2023-11-28T11:56:24.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.401+0000 7f432bfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432c06b2f0 con 0x7f432c06af20 2023-11-28T11:56:24.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.401+0000 7f432bfff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432c06d0c0 con 0x7f432c06cc50 2023-11-28T11:56:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f432c06af20 0x7f432c0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432affd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f432c06af20 0x7f432c0cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44120/0 (socket says 172.21.15.50:44120) 2023-11-28T11:56:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432a7fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f432c06cc50 0x7f432c0cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432affd700 1 -- 172.21.15.50:0/2278949480 learned_addr learned my addr 172.21.15.50:0/2278949480 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432affd700 1 -- 172.21.15.50:0/2278949480 >> v2:172.21.15.192:3300/0 conn(0x7f432c06cc50 msgr2=0x7f432c0cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:24.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432affd700 1 --2- 172.21.15.50:0/2278949480 >> v2:172.21.15.192:3300/0 conn(0x7f432c06cc50 0x7f432c0cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432affd700 1 -- 172.21.15.50:0/2278949480 >> v1:172.21.15.192:6789/0 conn(0x7f432c0b5ec0 legacy=0x7f432c0b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432affd700 1 -- 172.21.15.50:0/2278949480 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c06d3a0 con 0x7f432c06af20 2023-11-28T11:56:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432a7fc700 1 --2- 172.21.15.50:0/2278949480 >> v2:172.21.15.192:3300/0 conn(0x7f432c06cc50 0x7f432c0cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:24.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432affd700 1 --2- 172.21.15.50:0/2278949480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c06af20 0x7f432c0cce20 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f432c08cf80 tx=0x7f4314009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f83a30478a6f78 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f4329ffb700 1 -- 172.21.15.50:0/2278949480 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314011830 con 0x7f432c06af20 2023-11-28T11:56:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f4329ffb700 1 -- 172.21.15.50:0/2278949480 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4314011990 con 0x7f432c06af20 2023-11-28T11:56:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f4329ffb700 1 -- 172.21.15.50:0/2278949480 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314011d20 con 0x7f432c06af20 2023-11-28T11:56:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432bfff700 1 -- 172.21.15.50:0/2278949480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c06af20 msgr2=0x7f432c0cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432bfff700 1 --2- 172.21.15.50:0/2278949480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c06af20 0x7f432c0cce20 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f432c08cf80 tx=0x7f4314009bf0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432bfff700 1 -- 172.21.15.50:0/2278949480 shutdown_connections 2023-11-28T11:56:24.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432bfff700 1 --2- 172.21.15.50:0/2278949480 >> v2:172.21.15.192:3300/0 conn(0x7f432c06cc50 0x7f432c0cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432bfff700 1 --2- 172.21.15.50:0/2278949480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c06af20 0x7f432c0cce20 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432bfff700 1 -- 172.21.15.50:0/2278949480 >> 172.21.15.50:0/2278949480 conn(0x7f432c09bb30 msgr2=0x7f432c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:24.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432bfff700 1 -- 172.21.15.50:0/2278949480 shutdown_connections 2023-11-28T11:56:24.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.405+0000 7f432bfff700 1 -- 172.21.15.50:0/2278949480 wait complete. 2023-11-28T11:56:24.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432bfff700 1 Processor -- start 2023-11-28T11:56:24.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432bfff700 1 -- start start 2023-11-28T11:56:24.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f432c06af20 0x7f432c149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c06cc50 0x7f432c14f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f432c0b5ec0 0x7f432c14b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c0d18e0 con 0x7f432c06cc50 2023-11-28T11:56:24.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432bfff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c0c8cd0 con 0x7f432c06af20 2023-11-28T11:56:24.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432bfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c0d1b10 con 0x7f432c0b5ec0 2023-11-28T11:56:24.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c06cc50 0x7f432c14f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c06cc50 0x7f432c14f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44136/0 (socket says 172.21.15.50:44136) 2023-11-28T11:56:24.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432a7fc700 1 -- 172.21.15.50:0/1267858859 learned_addr learned my addr 172.21.15.50:0/1267858859 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:24.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432b7fe700 1 --2- 172.21.15.50:0/1267858859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f432c0b5ec0 0x7f432c14b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432affd700 1 --2- 172.21.15.50:0/1267858859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f432c06af20 0x7f432c149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432a7fc700 1 -- 172.21.15.50:0/1267858859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f432c0b5ec0 msgr2=0x7f432c14b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432a7fc700 1 --2- 172.21.15.50:0/1267858859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f432c0b5ec0 0x7f432c14b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432a7fc700 1 -- 172.21.15.50:0/1267858859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f432c06af20 msgr2=0x7f432c149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432a7fc700 1 --2- 172.21.15.50:0/1267858859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f432c06af20 0x7f432c149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.409+0000 7f432a7fc700 1 -- 172.21.15.50:0/1267858859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431c0094b0 con 0x7f432c06cc50 2023-11-28T11:56:24.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.413+0000 7f432a7fc700 1 --2- 172.21.15.50:0/1267858859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c06cc50 0x7f432c14f260 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f431c00ebe0 tx=0x7f431c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:24.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.413+0000 7f43237fe700 1 -- 172.21.15.50:0/1267858859 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c00c850 con 0x7f432c06cc50 2023-11-28T11:56:24.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.413+0000 7f43237fe700 1 -- 172.21.15.50:0/1267858859 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431c00c9b0 con 0x7f432c06cc50 2023-11-28T11:56:24.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.413+0000 7f432bfff700 1 -- 172.21.15.50:0/1267858859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4314009570 con 0x7f432c06cc50 2023-11-28T11:56:24.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.413+0000 7f43237fe700 1 -- 172.21.15.50:0/1267858859 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c00cd40 con 0x7f432c06cc50 2023-11-28T11:56:24.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.413+0000 7f432bfff700 1 -- 172.21.15.50:0/1267858859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c06d960 con 0x7f432c06cc50 2023-11-28T11:56:24.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.413+0000 7f432bfff700 1 -- 172.21.15.50:0/1267858859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432c06d680 con 0x7f432c06cc50 2023-11-28T11:56:24.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.413+0000 7f43237fe700 1 -- 172.21.15.50:0/1267858859 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f431c023070 con 0x7f432c06cc50 2023-11-28T11:56:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.417+0000 7f43237fe700 1 --2- 172.21.15.50:0/1267858859 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f430c064f10 0x7f430c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.417+0000 7f43237fe700 1 -- 172.21.15.50:0/1267858859 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f431c0822f0 con 0x7f432c06cc50 2023-11-28T11:56:24.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.417+0000 7f432affd700 1 --2- 172.21.15.50:0/1267858859 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f430c064f10 0x7f430c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.417+0000 7f432affd700 1 --2- 172.21.15.50:0/1267858859 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f430c064f10 0x7f430c0673c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4314000c00 tx=0x7f4314008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:24.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.421+0000 7f43237fe700 1 -- 172.21.15.50:0/1267858859 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f431c0502c0 con 0x7f432c06cc50 2023-11-28T11:56:24.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.589+0000 7f432bfff700 1 -- 172.21.15.50:0/1267858859 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f432c0b1cd0 con 0x7f432c06cc50 2023-11-28T11:56:24.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.589+0000 7f43237fe700 1 -- 172.21.15.50:0/1267858859 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f431c017020 con 0x7f432c06cc50 2023-11-28T11:56:24.595 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:56:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.597+0000 7f432bfff700 1 -- 172.21.15.50:0/1267858859 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f430c064f10 msgr2=0x7f430c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.597+0000 7f432bfff700 1 --2- 172.21.15.50:0/1267858859 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f430c064f10 0x7f430c0673c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4314000c00 tx=0x7f4314008030 comp rx=0 tx=0).stop 2023-11-28T11:56:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.597+0000 7f432bfff700 1 -- 172.21.15.50:0/1267858859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c06cc50 msgr2=0x7f432c14f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.597+0000 7f432bfff700 1 --2- 172.21.15.50:0/1267858859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c06cc50 0x7f432c14f260 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f431c00ebe0 tx=0x7f431c00eef0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.597+0000 7f432bfff700 1 -- 172.21.15.50:0/1267858859 shutdown_connections 2023-11-28T11:56:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.597+0000 7f432bfff700 1 --2- 172.21.15.50:0/1267858859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f432c0b5ec0 0x7f432c14b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.597+0000 7f432bfff700 1 --2- 172.21.15.50:0/1267858859 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f432c06cc50 0x7f432c14f260 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.597+0000 7f432bfff700 1 --2- 172.21.15.50:0/1267858859 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f430c064f10 0x7f430c0673c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.597+0000 7f432bfff700 1 --2- 172.21.15.50:0/1267858859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f432c06af20 0x7f432c149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.597+0000 7f432bfff700 1 -- 172.21.15.50:0/1267858859 >> 172.21.15.50:0/1267858859 conn(0x7f432c09bb30 msgr2=0x7f432c0ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.597+0000 7f432bfff700 1 -- 172.21.15.50:0/1267858859 shutdown_connections 2023-11-28T11:56:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.597+0000 7f432bfff700 1 -- 172.21.15.50:0/1267858859 wait complete. 2023-11-28T11:56:24.616 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:56:24.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.733+0000 7fc77aa89700 1 Processor -- start 2023-11-28T11:56:24.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.733+0000 7fc77aa89700 1 -- start start 2023-11-28T11:56:24.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc77aa89700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc77409bdb0 0x7fc77415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc77aa89700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc7740cbb30 0x7fc77406bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc77aa89700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7740b2db0 con 0x7fc7740b00e0 2023-11-28T11:56:24.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc77aa89700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7740b3240 con 0x7fc77409bdb0 2023-11-28T11:56:24.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc77aa89700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77406d840 con 0x7fc7740cbb30 2023-11-28T11:56:24.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc779a87700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc7740b00e0 0x7fc77415d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40324/0 (socket says 172.21.15.50:40324) 2023-11-28T11:56:24.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc779a87700 1 -- 172.21.15.50:0/3443727041 learned_addr learned my addr 172.21.15.50:0/3443727041 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:24.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc779286700 1 --2- 172.21.15.50:0/3443727041 >> v2:172.21.15.50:3300/0 conn(0x7fc77409bdb0 0x7fc77415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc77a288700 1 --2- 172.21.15.50:0/3443727041 >> v2:172.21.15.192:3300/0 conn(0x7fc7740cbb30 0x7fc77406bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc778a85700 1 -- 172.21.15.50:0/3443727041 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195286950 0 0) 0x7fc7740b2db0 con 0x7fc7740b00e0 2023-11-28T11:56:24.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc779286700 1 -- 172.21.15.50:0/3443727041 >> v2:172.21.15.192:3300/0 conn(0x7fc7740cbb30 msgr2=0x7fc77406bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:24.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc779286700 1 --2- 172.21.15.50:0/3443727041 >> v2:172.21.15.192:3300/0 conn(0x7fc7740cbb30 0x7fc77406bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc779286700 1 -- 172.21.15.50:0/3443727041 >> v1:172.21.15.50:6789/0 conn(0x7fc7740b00e0 legacy=0x7fc77415d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc779286700 1 -- 172.21.15.50:0/3443727041 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77406d560 con 0x7fc77409bdb0 2023-11-28T11:56:24.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc779286700 1 --2- 172.21.15.50:0/3443727041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc77409bdb0 0x7fc77415d9f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc7740ce360 tx=0x7fc768009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea9cf23c217bab3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:24.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc778a85700 1 -- 172.21.15.50:0/3443727041 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768011830 con 0x7fc77409bdb0 2023-11-28T11:56:24.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc778a85700 1 -- 172.21.15.50:0/3443727041 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc768011990 con 0x7fc77409bdb0 2023-11-28T11:56:24.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc778a85700 1 -- 172.21.15.50:0/3443727041 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768011d20 con 0x7fc77409bdb0 2023-11-28T11:56:24.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc77aa89700 1 -- 172.21.15.50:0/3443727041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc77409bdb0 msgr2=0x7fc77415d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc77aa89700 1 --2- 172.21.15.50:0/3443727041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc77409bdb0 0x7fc77415d9f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc7740ce360 tx=0x7fc768009b30 comp rx=0 tx=0).stop 2023-11-28T11:56:24.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc77aa89700 1 -- 172.21.15.50:0/3443727041 shutdown_connections 2023-11-28T11:56:24.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc77aa89700 1 --2- 172.21.15.50:0/3443727041 >> v2:172.21.15.192:3300/0 conn(0x7fc7740cbb30 0x7fc77406bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc77aa89700 1 --2- 172.21.15.50:0/3443727041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc77409bdb0 0x7fc77415d9f0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc77aa89700 1 -- 172.21.15.50:0/3443727041 >> 172.21.15.50:0/3443727041 conn(0x7fc7740cae70 msgr2=0x7fc7740cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:24.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc77aa89700 1 -- 172.21.15.50:0/3443727041 shutdown_connections 2023-11-28T11:56:24.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.737+0000 7fc77aa89700 1 -- 172.21.15.50:0/3443727041 wait complete. 2023-11-28T11:56:24.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc77aa89700 1 Processor -- start 2023-11-28T11:56:24.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc77aa89700 1 -- start start 2023-11-28T11:56:24.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc77aa89700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc77409bdb0 0x7fc77415c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc77aa89700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7740b00e0 0x7fc7741543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc77aa89700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7740cbb30 0x7fc774154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc77aa89700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc774154e60 con 0x7fc7740b00e0 2023-11-28T11:56:24.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc77aa89700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7740c5640 con 0x7fc77409bdb0 2023-11-28T11:56:24.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc77aa89700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7740c5920 con 0x7fc7740cbb30 2023-11-28T11:56:24.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc779286700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7740b00e0 0x7fc7741543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc779286700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7740b00e0 0x7fc7741543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44152/0 (socket says 172.21.15.50:44152) 2023-11-28T11:56:24.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc779286700 1 -- 172.21.15.50:0/3888019538 learned_addr learned my addr 172.21.15.50:0/3888019538 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:24.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc779a87700 1 --2- 172.21.15.50:0/3888019538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc77409bdb0 0x7fc77415c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc77a288700 1 --2- 172.21.15.50:0/3888019538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7740cbb30 0x7fc774154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc779286700 1 -- 172.21.15.50:0/3888019538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7740cbb30 msgr2=0x7fc774154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc779286700 1 --2- 172.21.15.50:0/3888019538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7740cbb30 0x7fc774154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc779286700 1 -- 172.21.15.50:0/3888019538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc77409bdb0 msgr2=0x7fc77415c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc779286700 1 --2- 172.21.15.50:0/3888019538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc77409bdb0 0x7fc77415c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc779286700 1 -- 172.21.15.50:0/3888019538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7680094b0 con 0x7fc7740b00e0 2023-11-28T11:56:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc779286700 1 --2- 172.21.15.50:0/3888019538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7740b00e0 0x7fc7741543e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc7680090b0 tx=0x7fc768004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc7727fc700 1 -- 172.21.15.50:0/3888019538 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7680036c0 con 0x7fc7740b00e0 2023-11-28T11:56:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc77aa89700 1 -- 172.21.15.50:0/3888019538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7740ac3d0 con 0x7fc7740b00e0 2023-11-28T11:56:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc7727fc700 1 -- 172.21.15.50:0/3888019538 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76801f070 con 0x7fc7740b00e0 2023-11-28T11:56:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc77aa89700 1 -- 172.21.15.50:0/3888019538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7740ac0f0 con 0x7fc7740b00e0 2023-11-28T11:56:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc7727fc700 1 -- 172.21.15.50:0/3888019538 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768003a20 con 0x7fc7740b00e0 2023-11-28T11:56:24.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.741+0000 7fc77aa89700 1 -- 172.21.15.50:0/3888019538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7740cc9f0 con 0x7fc7740b00e0 2023-11-28T11:56:24.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.745+0000 7fc7727fc700 1 -- 172.21.15.50:0/3888019538 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc76802d070 con 0x7fc7740b00e0 2023-11-28T11:56:24.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.745+0000 7fc7727fc700 1 --2- 172.21.15.50:0/3888019538 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc760064f10 0x7fc7600673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:24.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.745+0000 7fc7727fc700 1 -- 172.21.15.50:0/3888019538 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc768021070 con 0x7fc7740b00e0 2023-11-28T11:56:24.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.745+0000 7fc779a87700 1 --2- 172.21.15.50:0/3888019538 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc760064f10 0x7fc7600673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:24.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.745+0000 7fc779a87700 1 --2- 172.21.15.50:0/3888019538 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc760064f10 0x7fc7600673c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc76c007fd0 tx=0x7fc76c007c20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.753+0000 7fc7727fc700 1 -- 172.21.15.50:0/3888019538 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc768051640 con 0x7fc7740b00e0 2023-11-28T11:56:24.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.917+0000 7fc77aa89700 1 -- 172.21.15.50:0/3888019538 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc774072500 con 0x7fc7740b00e0 2023-11-28T11:56:24.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.917+0000 7fc7727fc700 1 -- 172.21.15.50:0/3888019538 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc76802b0a0 con 0x7fc7740b00e0 2023-11-28T11:56:24.920 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:56:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.917+0000 7fc77aa89700 1 -- 172.21.15.50:0/3888019538 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc760064f10 msgr2=0x7fc7600673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.917+0000 7fc77aa89700 1 --2- 172.21.15.50:0/3888019538 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc760064f10 0x7fc7600673c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc76c007fd0 tx=0x7fc76c007c20 comp rx=0 tx=0).stop 2023-11-28T11:56:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.917+0000 7fc77aa89700 1 -- 172.21.15.50:0/3888019538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7740b00e0 msgr2=0x7fc7741543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:24.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.917+0000 7fc77aa89700 1 --2- 172.21.15.50:0/3888019538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7740b00e0 0x7fc7741543e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc7680090b0 tx=0x7fc768004770 comp rx=0 tx=0).stop 2023-11-28T11:56:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.917+0000 7fc77aa89700 1 -- 172.21.15.50:0/3888019538 shutdown_connections 2023-11-28T11:56:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.917+0000 7fc77aa89700 1 --2- 172.21.15.50:0/3888019538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7740cbb30 0x7fc774154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.917+0000 7fc77aa89700 1 --2- 172.21.15.50:0/3888019538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7740b00e0 0x7fc7741543e0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.917+0000 7fc77aa89700 1 --2- 172.21.15.50:0/3888019538 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc760064f10 0x7fc7600673c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.917+0000 7fc77aa89700 1 --2- 172.21.15.50:0/3888019538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc77409bdb0 0x7fc77415c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.917+0000 7fc77aa89700 1 -- 172.21.15.50:0/3888019538 >> 172.21.15.50:0/3888019538 conn(0x7fc7740cae70 msgr2=0x7fc77406c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.917+0000 7fc77aa89700 1 -- 172.21.15.50:0/3888019538 shutdown_connections 2023-11-28T11:56:24.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:24.917+0000 7fc77aa89700 1 -- 172.21.15.50:0/3888019538 wait complete. 2023-11-28T11:56:24.935 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:56:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.049+0000 7fa5ce7dd700 1 Processor -- start 2023-11-28T11:56:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.049+0000 7fa5ce7dd700 1 -- start start 2023-11-28T11:56:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.049+0000 7fa5ce7dd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5c81606b0 0x7fa5c80c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.049+0000 7fa5ce7dd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c80ceef0 0x7fa5c80c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.049+0000 7fa5ce7dd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c80cae70 con 0x7fa5c80ad610 2023-11-28T11:56:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.049+0000 7fa5ce7dd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c80cbc10 con 0x7fa5c81606b0 2023-11-28T11:56:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.049+0000 7fa5ce7dd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80cb130 con 0x7fa5c80ceef0 2023-11-28T11:56:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.049+0000 7fa5cd7db700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5c81606b0 0x7fa5c80c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.049+0000 7fa5cd7db700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa5c81606b0 0x7fa5c80c13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44154/0 (socket says 172.21.15.50:44154) 2023-11-28T11:56:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.049+0000 7fa5cd7db700 1 -- 172.21.15.50:0/1283196036 learned_addr learned my addr 172.21.15.50:0/1283196036 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.049+0000 7fa5ccfda700 1 --2- 172.21.15.50:0/1283196036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c80ceef0 0x7fa5c80c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.049+0000 7fa5cd7db700 1 -- 172.21.15.50:0/1283196036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c80ceef0 msgr2=0x7fa5c80c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.049+0000 7fa5cd7db700 1 --2- 172.21.15.50:0/1283196036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c80ceef0 0x7fa5c80c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.049+0000 7fa5cd7db700 1 -- 172.21.15.50:0/1283196036 >> v1:172.21.15.192:6789/0 conn(0x7fa5c80ad610 legacy=0x7fa5c8164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.049+0000 7fa5cd7db700 1 -- 172.21.15.50:0/1283196036 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c80cb410 con 0x7fa5c81606b0 2023-11-28T11:56:25.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5cd7db700 1 --2- 172.21.15.50:0/1283196036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c81606b0 0x7fa5c80c13b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009910 tx=0x7fa5b8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b994ac2e39185c7e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:25.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5bffff700 1 -- 172.21.15.50:0/1283196036 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8011830 con 0x7fa5c81606b0 2023-11-28T11:56:25.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5bffff700 1 -- 172.21.15.50:0/1283196036 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b8011990 con 0x7fa5c81606b0 2023-11-28T11:56:25.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5bffff700 1 -- 172.21.15.50:0/1283196036 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8011d40 con 0x7fa5c81606b0 2023-11-28T11:56:25.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5ce7dd700 1 -- 172.21.15.50:0/1283196036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c81606b0 msgr2=0x7fa5c80c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5ce7dd700 1 --2- 172.21.15.50:0/1283196036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c81606b0 0x7fa5c80c13b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009910 tx=0x7fa5b8009c20 comp rx=0 tx=0).stop 2023-11-28T11:56:25.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5ce7dd700 1 -- 172.21.15.50:0/1283196036 shutdown_connections 2023-11-28T11:56:25.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5ce7dd700 1 --2- 172.21.15.50:0/1283196036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c80ceef0 0x7fa5c80c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5ce7dd700 1 --2- 172.21.15.50:0/1283196036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c81606b0 0x7fa5c80c13b0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5ce7dd700 1 -- 172.21.15.50:0/1283196036 >> 172.21.15.50:0/1283196036 conn(0x7fa5c80ce3e0 msgr2=0x7fa5c80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:25.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5ce7dd700 1 -- 172.21.15.50:0/1283196036 shutdown_connections 2023-11-28T11:56:25.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5ce7dd700 1 -- 172.21.15.50:0/1283196036 wait complete. 2023-11-28T11:56:25.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5ce7dd700 1 Processor -- start 2023-11-28T11:56:25.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5ce7dd700 1 -- start start 2023-11-28T11:56:25.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5ce7dd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c80ad610 0x7fa5c80ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5ce7dd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5c80ceef0 0x7fa5c80af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5ce7dd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c81606b0 0x7fa5c815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5ce7dd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80afab0 con 0x7fa5c80ad610 2023-11-28T11:56:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5ce7dd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80afd90 con 0x7fa5c80ceef0 2023-11-28T11:56:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5ce7dd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80b0070 con 0x7fa5c81606b0 2023-11-28T11:56:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5cd7db700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c80ad610 0x7fa5c80ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5cd7db700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c80ad610 0x7fa5c80ac4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44162/0 (socket says 172.21.15.50:44162) 2023-11-28T11:56:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5cd7db700 1 -- 172.21.15.50:0/2049458526 learned_addr learned my addr 172.21.15.50:0/2049458526 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5cdfdc700 1 --2- 172.21.15.50:0/2049458526 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c81606b0 0x7fa5c815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.053+0000 7fa5ccfda700 1 --2- 172.21.15.50:0/2049458526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5c80ceef0 0x7fa5c80af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.057+0000 7fa5cdfdc700 1 -- 172.21.15.50:0/2049458526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5c80ceef0 msgr2=0x7fa5c80af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.057+0000 7fa5cdfdc700 1 --2- 172.21.15.50:0/2049458526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5c80ceef0 0x7fa5c80af0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.057+0000 7fa5cdfdc700 1 -- 172.21.15.50:0/2049458526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c80ad610 msgr2=0x7fa5c80ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.057+0000 7fa5cdfdc700 1 --2- 172.21.15.50:0/2049458526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c80ad610 0x7fa5c80ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.057+0000 7fa5cdfdc700 1 -- 172.21.15.50:0/2049458526 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b8009570 con 0x7fa5c81606b0 2023-11-28T11:56:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.057+0000 7fa5cd7db700 1 --2- 172.21.15.50:0/2049458526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c80ad610 0x7fa5c80ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.057+0000 7fa5cdfdc700 1 --2- 172.21.15.50:0/2049458526 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c81606b0 0x7fa5c815a1e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000cae0 tx=0x7fa5c000cdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.057+0000 7fa5bdffb700 1 -- 172.21.15.50:0/2049458526 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0003c20 con 0x7fa5c81606b0 2023-11-28T11:56:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.057+0000 7fa5bdffb700 1 -- 172.21.15.50:0/2049458526 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c0003d80 con 0x7fa5c81606b0 2023-11-28T11:56:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.057+0000 7fa5bdffb700 1 -- 172.21.15.50:0/2049458526 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c000aa20 con 0x7fa5c81606b0 2023-11-28T11:56:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.057+0000 7fa5ce7dd700 1 -- 172.21.15.50:0/2049458526 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c806ac50 con 0x7fa5c81606b0 2023-11-28T11:56:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.057+0000 7fa5ce7dd700 1 -- 172.21.15.50:0/2049458526 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c80cb6f0 con 0x7fa5c81606b0 2023-11-28T11:56:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.057+0000 7fa5ce7dd700 1 -- 172.21.15.50:0/2049458526 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c80b3680 con 0x7fa5c81606b0 2023-11-28T11:56:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.057+0000 7fa5bdffb700 1 -- 172.21.15.50:0/2049458526 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa5c0010050 con 0x7fa5c81606b0 2023-11-28T11:56:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.061+0000 7fa5bdffb700 1 --2- 172.21.15.50:0/2049458526 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa5ac064ee0 0x7fa5ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.061+0000 7fa5bdffb700 1 -- 172.21.15.50:0/2049458526 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa5c0081d40 con 0x7fa5c81606b0 2023-11-28T11:56:25.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.061+0000 7fa5cd7db700 1 --2- 172.21.15.50:0/2049458526 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa5ac064ee0 0x7fa5ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.061+0000 7fa5cd7db700 1 --2- 172.21.15.50:0/2049458526 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa5ac064ee0 0x7fa5ac067390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8000c00 tx=0x7fa5b8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:25.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.073+0000 7fa5bdffb700 1 -- 172.21.15.50:0/2049458526 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa5c004fd20 con 0x7fa5c81606b0 2023-11-28T11:56:25.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.249+0000 7fa5ce7dd700 1 -- 172.21.15.50:0/2049458526 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa5c8072500 con 0x7fa5c81606b0 2023-11-28T11:56:25.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.249+0000 7fa5bdffb700 1 -- 172.21.15.50:0/2049458526 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa5c0053340 con 0x7fa5c81606b0 2023-11-28T11:56:25.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.253+0000 7fa5ce7dd700 1 -- 172.21.15.50:0/2049458526 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa5ac064ee0 msgr2=0x7fa5ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.253+0000 7fa5ce7dd700 1 --2- 172.21.15.50:0/2049458526 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa5ac064ee0 0x7fa5ac067390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8000c00 tx=0x7fa5b8008030 comp rx=0 tx=0).stop 2023-11-28T11:56:25.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.253+0000 7fa5ce7dd700 1 -- 172.21.15.50:0/2049458526 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c81606b0 msgr2=0x7fa5c815a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.253+0000 7fa5ce7dd700 1 --2- 172.21.15.50:0/2049458526 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c81606b0 0x7fa5c815a1e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000cae0 tx=0x7fa5c000cdf0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.253+0000 7fa5ce7dd700 1 -- 172.21.15.50:0/2049458526 shutdown_connections 2023-11-28T11:56:25.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.253+0000 7fa5ce7dd700 1 --2- 172.21.15.50:0/2049458526 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c81606b0 0x7fa5c815a1e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.253+0000 7fa5ce7dd700 1 --2- 172.21.15.50:0/2049458526 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa5ac064ee0 0x7fa5ac067390 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.253+0000 7fa5ce7dd700 1 --2- 172.21.15.50:0/2049458526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5c80ceef0 0x7fa5c80af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.253+0000 7fa5ce7dd700 1 --2- 172.21.15.50:0/2049458526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5c80ad610 0x7fa5c80ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.253+0000 7fa5ce7dd700 1 -- 172.21.15.50:0/2049458526 >> 172.21.15.50:0/2049458526 conn(0x7fa5c80ce3e0 msgr2=0x7fa5c8070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:25.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.253+0000 7fa5ce7dd700 1 -- 172.21.15.50:0/2049458526 shutdown_connections 2023-11-28T11:56:25.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.253+0000 7fa5ce7dd700 1 -- 172.21.15.50:0/2049458526 wait complete. 2023-11-28T11:56:25.259 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-11-28T11:56:25.272 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-11-28T11:56:25.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:25.272 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T11:56:25.287 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[49706]: fuse finished with error 0 and tester_r 0 2023-11-28T11:56:25.289 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T11:56:25.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:25.289 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T11:56:25.419 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:56:25.419 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:56:25.427 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17871 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:56:25.427 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T11:56:25.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:25.427 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T11:56:25.476 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-28T11:56:25.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:56:25.477 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:56:25.477 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:56:25.485 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349436k,nr_inodes=4087359,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20953 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276116k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:56:25.485 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T11:56:25.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:25.485 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T11:56:25.492 INFO:teuthology.orchestra.run.smithi050.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-28T11:56:25.492 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:56:25.494 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:56:25.494 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:56:25.502 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17871 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:56:25.502 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T11:56:25.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:25.502 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T11:56:25.507 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-28T11:56:25.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:56:25.508 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:56:25.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.625+0000 7f3396128700 1 Processor -- start 2023-11-28T11:56:25.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.625+0000 7f3396128700 1 -- start start 2023-11-28T11:56:25.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3396128700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33901606b0 0x7f33900c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3396128700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f33900ad610 0x7f33900c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3396128700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33900cae70 con 0x7f33900ceef0 2023-11-28T11:56:25.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3396128700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33900cbc10 con 0x7f33901606b0 2023-11-28T11:56:25.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3396128700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33900cb130 con 0x7f33900ad610 2023-11-28T11:56:25.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3394925700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f33900ceef0 0x7f3390164040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40330/0 (socket says 172.21.15.50:40330) 2023-11-28T11:56:25.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3395126700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33901606b0 0x7f33900c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3394925700 1 -- 172.21.15.50:0/2691089758 learned_addr learned my addr 172.21.15.50:0/2691089758 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:25.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3395927700 1 --2- 172.21.15.50:0/2691089758 >> v2:172.21.15.192:3300/0 conn(0x7f33900ad610 0x7f33900c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3387fff700 1 -- 172.21.15.50:0/2691089758 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060159399 0 0) 0x7f33900cae70 con 0x7f33900ceef0 2023-11-28T11:56:25.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3387fff700 1 -- 172.21.15.50:0/2691089758 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f337c0035d0 con 0x7f33900ceef0 2023-11-28T11:56:25.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3387fff700 1 -- 172.21.15.50:0/2691089758 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 413034293 0 0) 0x7f337c0035d0 con 0x7f33900ceef0 2023-11-28T11:56:25.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3395126700 1 -- 172.21.15.50:0/2691089758 >> v2:172.21.15.192:3300/0 conn(0x7f33900ad610 msgr2=0x7f33900c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:25.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3395126700 1 --2- 172.21.15.50:0/2691089758 >> v2:172.21.15.192:3300/0 conn(0x7f33900ad610 0x7f33900c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3395126700 1 -- 172.21.15.50:0/2691089758 >> v1:172.21.15.50:6789/0 conn(0x7f33900ceef0 legacy=0x7f3390164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3395126700 1 -- 172.21.15.50:0/2691089758 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33900cb410 con 0x7f33901606b0 2023-11-28T11:56:25.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3395126700 1 --2- 172.21.15.50:0/2691089758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33901606b0 0x7f33900c13b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3390067140 tx=0x7f3380009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343ff58dd5255df1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:25.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3387fff700 1 -- 172.21.15.50:0/2691089758 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c0019f0 con 0x7f33901606b0 2023-11-28T11:56:25.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3387fff700 1 -- 172.21.15.50:0/2691089758 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380004030 con 0x7f33901606b0 2023-11-28T11:56:25.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3387fff700 1 -- 172.21.15.50:0/2691089758 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33800043c0 con 0x7f33901606b0 2023-11-28T11:56:25.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3396128700 1 -- 172.21.15.50:0/2691089758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33901606b0 msgr2=0x7f33900c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3396128700 1 --2- 172.21.15.50:0/2691089758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33901606b0 0x7f33900c13b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3390067140 tx=0x7f3380009b30 comp rx=0 tx=0).stop 2023-11-28T11:56:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3396128700 1 -- 172.21.15.50:0/2691089758 shutdown_connections 2023-11-28T11:56:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3396128700 1 --2- 172.21.15.50:0/2691089758 >> v2:172.21.15.192:3300/0 conn(0x7f33900ad610 0x7f33900c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3396128700 1 --2- 172.21.15.50:0/2691089758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33901606b0 0x7f33900c13b0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3396128700 1 -- 172.21.15.50:0/2691089758 >> 172.21.15.50:0/2691089758 conn(0x7f33900ce3e0 msgr2=0x7f33900ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3396128700 1 -- 172.21.15.50:0/2691089758 shutdown_connections 2023-11-28T11:56:25.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.629+0000 7f3396128700 1 -- 172.21.15.50:0/2691089758 wait complete. 2023-11-28T11:56:25.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.633+0000 7f3396128700 1 Processor -- start 2023-11-28T11:56:25.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.633+0000 7f3396128700 1 -- start start 2023-11-28T11:56:25.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.633+0000 7f3396128700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33900ad610 0x7f339015ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.633+0000 7f3396128700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33900ceef0 0x7f3390163030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.633+0000 7f3396128700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33901606b0 0x7f33900cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.633+0000 7f3396128700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33900c4db0 con 0x7f33900ad610 2023-11-28T11:56:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.633+0000 7f3396128700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3390162ba0 con 0x7f33900ceef0 2023-11-28T11:56:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.633+0000 7f3396128700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3390162270 con 0x7f33901606b0 2023-11-28T11:56:25.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.633+0000 7f3395126700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33900ad610 0x7f339015ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.637+0000 7f3395126700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33900ad610 0x7f339015ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44178/0 (socket says 172.21.15.50:44178) 2023-11-28T11:56:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.637+0000 7f3395126700 1 -- 172.21.15.50:0/677024645 learned_addr learned my addr 172.21.15.50:0/677024645 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.637+0000 7f3394925700 1 --2- 172.21.15.50:0/677024645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33900ceef0 0x7f3390163030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.637+0000 7f3395927700 1 --2- 172.21.15.50:0/677024645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33901606b0 0x7f33900cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.637+0000 7f3395126700 1 -- 172.21.15.50:0/677024645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33901606b0 msgr2=0x7f33900cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.637+0000 7f3395126700 1 --2- 172.21.15.50:0/677024645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33901606b0 0x7f33900cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.637+0000 7f3395126700 1 -- 172.21.15.50:0/677024645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33900ceef0 msgr2=0x7f3390163030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.637+0000 7f3395126700 1 --2- 172.21.15.50:0/677024645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33900ceef0 0x7f3390163030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.637+0000 7f3395126700 1 -- 172.21.15.50:0/677024645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33800094b0 con 0x7f33900ad610 2023-11-28T11:56:25.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.637+0000 7f3395126700 1 --2- 172.21.15.50:0/677024645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33900ad610 0x7f339015ae80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f33900ce2c0 tx=0x7f3380004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.637+0000 7f3385ffb700 1 -- 172.21.15.50:0/677024645 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380003a40 con 0x7f33900ad610 2023-11-28T11:56:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.637+0000 7f3385ffb700 1 -- 172.21.15.50:0/677024645 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338001f070 con 0x7f33900ad610 2023-11-28T11:56:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.637+0000 7f3396128700 1 -- 172.21.15.50:0/677024645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339006ac50 con 0x7f33900ad610 2023-11-28T11:56:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.637+0000 7f3385ffb700 1 -- 172.21.15.50:0/677024645 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380003dc0 con 0x7f33900ad610 2023-11-28T11:56:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.637+0000 7f3396128700 1 -- 172.21.15.50:0/677024645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33900cb6f0 con 0x7f33900ad610 2023-11-28T11:56:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.637+0000 7f3396128700 1 -- 172.21.15.50:0/677024645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33900b36c0 con 0x7f33900ad610 2023-11-28T11:56:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.637+0000 7f3385ffb700 1 -- 172.21.15.50:0/677024645 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f338002a020 con 0x7f33900ad610 2023-11-28T11:56:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.641+0000 7f3385ffb700 1 --2- 172.21.15.50:0/677024645 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3374064ee0 0x7f3374067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.641+0000 7f3385ffb700 1 -- 172.21.15.50:0/677024645 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3380083360 con 0x7f33900ad610 2023-11-28T11:56:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.641+0000 7f3394925700 1 --2- 172.21.15.50:0/677024645 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3374064ee0 0x7f3374067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.641+0000 7f3394925700 1 --2- 172.21.15.50:0/677024645 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3374064ee0 0x7f3374067390 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f339015b3c0 tx=0x7f338c002180 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:25.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.645+0000 7f3385ffb700 1 -- 172.21.15.50:0/677024645 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3380051360 con 0x7f33900ad610 2023-11-28T11:56:25.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.841+0000 7f3396128700 1 -- 172.21.15.50:0/677024645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3390072500 con 0x7f33900ad610 2023-11-28T11:56:25.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.845+0000 7f3385ffb700 1 -- 172.21.15.50:0/677024645 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f3380054980 con 0x7f33900ad610 2023-11-28T11:56:25.848 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:25.848 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2341737190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2341737190},{"type":"v1","addr":"172.21.15.50:6835","nonce":2341737190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5546,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/192527628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":192527628},{"type":"v1","addr":"172.21.15.192:6835","nonce":192527628}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5549,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2304989740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2304989740},{"type":"v1","addr":"172.21.15.192:6837","nonce":2304989740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:55:57.946191+0000","modified":"2023-11-28T11:56:00.964614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6057":{"gid":6057,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/1163863991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1163863991},{"type":"v1","addr":"172.21.15.50:6834","nonce":1163863991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:56:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.845+0000 7f3396128700 1 -- 172.21.15.50:0/677024645 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3374064ee0 msgr2=0x7f3374067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.845+0000 7f3396128700 1 --2- 172.21.15.50:0/677024645 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3374064ee0 0x7f3374067390 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f339015b3c0 tx=0x7f338c002180 comp rx=0 tx=0).stop 2023-11-28T11:56:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.845+0000 7f3396128700 1 -- 172.21.15.50:0/677024645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33900ad610 msgr2=0x7f339015ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.845+0000 7f3396128700 1 --2- 172.21.15.50:0/677024645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33900ad610 0x7f339015ae80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f33900ce2c0 tx=0x7f3380004770 comp rx=0 tx=0).stop 2023-11-28T11:56:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.845+0000 7f3396128700 1 -- 172.21.15.50:0/677024645 shutdown_connections 2023-11-28T11:56:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.845+0000 7f3396128700 1 --2- 172.21.15.50:0/677024645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33901606b0 0x7f33900cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.845+0000 7f3396128700 1 --2- 172.21.15.50:0/677024645 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3374064ee0 0x7f3374067390 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.845+0000 7f3396128700 1 --2- 172.21.15.50:0/677024645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33900ceef0 0x7f3390163030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.845+0000 7f3396128700 1 --2- 172.21.15.50:0/677024645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33900ad610 0x7f339015ae80 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.845+0000 7f3396128700 1 -- 172.21.15.50:0/677024645 >> 172.21.15.50:0/677024645 conn(0x7f33900ce3e0 msgr2=0x7f33900af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.849+0000 7f3396128700 1 -- 172.21.15.50:0/677024645 shutdown_connections 2023-11-28T11:56:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.849+0000 7f3396128700 1 -- 172.21.15.50:0/677024645 wait complete. 2023-11-28T11:56:25.852 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2023-11-28T11:56:25.863 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d9dd1700 1 Processor -- start 2023-11-28T11:56:25.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d9dd1700 1 -- start start 2023-11-28T11:56:25.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d9dd1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f22cc0e6e60 0x7f22cc04f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d9dd1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22cc0512b0 0x7f22cc036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d9dd1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc053df0 con 0x7f22cc036cb0 2023-11-28T11:56:25.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d9dd1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc037150 con 0x7f22cc0e6e60 2023-11-28T11:56:25.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d9dd1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0486b0 con 0x7f22cc0512b0 2023-11-28T11:56:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d3fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22cc0512b0 0x7f22cc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d8dcf700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f22cc0e6e60 0x7f22cc04f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d8dcf700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f22cc0e6e60 0x7f22cc04f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:46080/0 (socket says 172.21.15.50:46080) 2023-11-28T11:56:25.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d3fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22cc0512b0 0x7f22cc036770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:40684/0 (socket says 172.21.15.50:40684) 2023-11-28T11:56:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d8dcf700 1 -- 172.21.15.50:0/2784849044 learned_addr learned my addr 172.21.15.50:0/2784849044 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d3fff700 1 -- 172.21.15.50:0/2784849044 >> v2:172.21.15.192:3300/0 conn(0x7f22cc0e6e60 msgr2=0x7f22cc04f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d3fff700 1 --2- 172.21.15.50:0/2784849044 >> v2:172.21.15.192:3300/0 conn(0x7f22cc0e6e60 0x7f22cc04f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d3fff700 1 -- 172.21.15.50:0/2784849044 >> v1:172.21.15.192:6789/0 conn(0x7f22cc036cb0 legacy=0x7f22cc0060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d3fff700 1 -- 172.21.15.50:0/2784849044 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc033a80 con 0x7f22cc0512b0 2023-11-28T11:56:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d8dcf700 1 --2- 172.21.15.50:0/2784849044 >> v2:172.21.15.192:3300/0 conn(0x7f22cc0e6e60 0x7f22cc04f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:25.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d3fff700 1 --2- 172.21.15.50:0/2784849044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22cc0512b0 0x7f22cc036770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009850 tx=0x7f22c8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9097ddb3025b0e9a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:25.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d37fe700 1 -- 172.21.15.50:0/2784849044 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8011830 con 0x7f22cc0512b0 2023-11-28T11:56:25.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d37fe700 1 -- 172.21.15.50:0/2784849044 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c8011990 con 0x7f22cc0512b0 2023-11-28T11:56:25.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d37fe700 1 -- 172.21.15.50:0/2784849044 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8011d40 con 0x7f22cc0512b0 2023-11-28T11:56:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d9dd1700 1 -- 172.21.15.50:0/2784849044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22cc0512b0 msgr2=0x7f22cc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d9dd1700 1 --2- 172.21.15.50:0/2784849044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22cc0512b0 0x7f22cc036770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009850 tx=0x7f22c8009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d9dd1700 1 -- 172.21.15.50:0/2784849044 shutdown_connections 2023-11-28T11:56:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d9dd1700 1 --2- 172.21.15.50:0/2784849044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22cc0512b0 0x7f22cc036770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d9dd1700 1 --2- 172.21.15.50:0/2784849044 >> v2:172.21.15.192:3300/0 conn(0x7f22cc0e6e60 0x7f22cc04f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d9dd1700 1 -- 172.21.15.50:0/2784849044 >> 172.21.15.50:0/2784849044 conn(0x7f22cc051770 msgr2=0x7f22cc051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d9dd1700 1 -- 172.21.15.50:0/2784849044 shutdown_connections 2023-11-28T11:56:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.973+0000 7f22d9dd1700 1 -- 172.21.15.50:0/2784849044 wait complete. 2023-11-28T11:56:25.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d9dd1700 1 Processor -- start 2023-11-28T11:56:25.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d9dd1700 1 -- start start 2023-11-28T11:56:25.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d9dd1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22cc036cb0 0x7f22cc0e0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d9dd1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22cc0512b0 0x7f22cc04ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d9dd1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22cc0e6e60 0x7f22cc17cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d9dd1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0e3c20 con 0x7f22cc036cb0 2023-11-28T11:56:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d9dd1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc049870 con 0x7f22cc0512b0 2023-11-28T11:56:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d9dd1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc04a6d0 con 0x7f22cc0e6e60 2023-11-28T11:56:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d8dcf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22cc036cb0 0x7f22cc0e0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d8dcf700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22cc036cb0 0x7f22cc0e0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44188/0 (socket says 172.21.15.50:44188) 2023-11-28T11:56:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d8dcf700 1 -- 172.21.15.50:0/3912866466 learned_addr learned my addr 172.21.15.50:0/3912866466 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d95d0700 1 --2- 172.21.15.50:0/3912866466 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22cc0e6e60 0x7f22cc17cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d3fff700 1 --2- 172.21.15.50:0/3912866466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22cc0512b0 0x7f22cc04ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d8dcf700 1 -- 172.21.15.50:0/3912866466 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22cc0e6e60 msgr2=0x7f22cc17cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d8dcf700 1 --2- 172.21.15.50:0/3912866466 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22cc0e6e60 0x7f22cc17cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d8dcf700 1 -- 172.21.15.50:0/3912866466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22cc0512b0 msgr2=0x7f22cc04ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d8dcf700 1 --2- 172.21.15.50:0/3912866466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22cc0512b0 0x7f22cc04ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:25.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d8dcf700 1 -- 172.21.15.50:0/3912866466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c0009570 con 0x7f22cc036cb0 2023-11-28T11:56:25.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.977+0000 7f22d8dcf700 1 --2- 172.21.15.50:0/3912866466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22cc036cb0 0x7f22cc0e0bd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f22c000ec10 tx=0x7f22c000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.981+0000 7f22d17fa700 1 -- 172.21.15.50:0/3912866466 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c000c850 con 0x7f22cc036cb0 2023-11-28T11:56:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.981+0000 7f22d17fa700 1 -- 172.21.15.50:0/3912866466 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c000c9b0 con 0x7f22cc036cb0 2023-11-28T11:56:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.981+0000 7f22d9dd1700 1 -- 172.21.15.50:0/3912866466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c80094b0 con 0x7f22cc036cb0 2023-11-28T11:56:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.981+0000 7f22d17fa700 1 -- 172.21.15.50:0/3912866466 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c000cd20 con 0x7f22cc036cb0 2023-11-28T11:56:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.981+0000 7f22d9dd1700 1 -- 172.21.15.50:0/3912866466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc034040 con 0x7f22cc036cb0 2023-11-28T11:56:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.981+0000 7f22d9dd1700 1 -- 172.21.15.50:0/3912866466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc033d60 con 0x7f22cc036cb0 2023-11-28T11:56:25.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.981+0000 7f22d17fa700 1 -- 172.21.15.50:0/3912866466 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f22c0019030 con 0x7f22cc036cb0 2023-11-28T11:56:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.981+0000 7f22d17fa700 1 --2- 172.21.15.50:0/3912866466 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f22b8064ee0 0x7f22b8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.981+0000 7f22d17fa700 1 -- 172.21.15.50:0/3912866466 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f22c0081bb0 con 0x7f22cc036cb0 2023-11-28T11:56:25.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.981+0000 7f22d3fff700 1 --2- 172.21.15.50:0/3912866466 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f22b8064ee0 0x7f22b8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:25.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.985+0000 7f22d3fff700 1 --2- 172.21.15.50:0/3912866466 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f22b8064ee0 0x7f22b8067390 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f22c80090b0 tx=0x7f22c8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:25.993+0000 7f22d17fa700 1 -- 172.21.15.50:0/3912866466 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f22c0088080 con 0x7f22cc036cb0 2023-11-28T11:56:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.157+0000 7f22d9dd1700 1 -- 172.21.15.50:0/3912866466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22cc034320 con 0x7f22cc036cb0 2023-11-28T11:56:26.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.161+0000 7f22d17fa700 1 -- 172.21.15.50:0/3912866466 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18026 (secure 0 0 0) 0x7f22c004fc10 con 0x7f22cc036cb0 2023-11-28T11:56:26.165 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:26.165 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":54,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:55:58.950592+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:55:55.575648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T11:55:56.934531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.161+0000 7f22d9dd1700 1 -- 172.21.15.50:0/3912866466 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f22b8064ee0 msgr2=0x7f22b8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.161+0000 7f22d9dd1700 1 --2- 172.21.15.50:0/3912866466 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f22b8064ee0 0x7f22b8067390 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f22c80090b0 tx=0x7f22c8008030 comp rx=0 tx=0).stop 2023-11-28T11:56:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.161+0000 7f22d9dd1700 1 -- 172.21.15.50:0/3912866466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22cc036cb0 msgr2=0x7f22cc0e0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.161+0000 7f22d9dd1700 1 --2- 172.21.15.50:0/3912866466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22cc036cb0 0x7f22cc0e0bd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f22c000ec10 tx=0x7f22c000ef20 comp rx=0 tx=0).stop 2023-11-28T11:56:26.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.165+0000 7f22d9dd1700 1 -- 172.21.15.50:0/3912866466 shutdown_connections 2023-11-28T11:56:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.165+0000 7f22d9dd1700 1 --2- 172.21.15.50:0/3912866466 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22cc0e6e60 0x7f22cc17cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.165+0000 7f22d9dd1700 1 --2- 172.21.15.50:0/3912866466 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f22b8064ee0 0x7f22b8067390 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.165+0000 7f22d9dd1700 1 --2- 172.21.15.50:0/3912866466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22cc0512b0 0x7f22cc04ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.165+0000 7f22d9dd1700 1 --2- 172.21.15.50:0/3912866466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22cc036cb0 0x7f22cc0e0bd0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.165+0000 7f22d9dd1700 1 -- 172.21.15.50:0/3912866466 >> 172.21.15.50:0/3912866466 conn(0x7f22cc051770 msgr2=0x7f22cc0e64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.165+0000 7f22d9dd1700 1 -- 172.21.15.50:0/3912866466 shutdown_connections 2023-11-28T11:56:26.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.165+0000 7f22d9dd1700 1 -- 172.21.15.50:0/3912866466 wait complete. 2023-11-28T11:56:26.181 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:55:55.575648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:55:56.934531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:56:26.181 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:56:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.305+0000 7f39c6bb7700 1 Processor -- start 2023-11-28T11:56:26.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.305+0000 7f39c6bb7700 1 -- start start 2023-11-28T11:56:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.305+0000 7f39c6bb7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c006ce60 0x7f39c00b8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.305+0000 7f39c6bb7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f39c00cf110 0x7f39c00cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.305+0000 7f39c6bb7700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c00d0460 con 0x7f39c00d1e30 2023-11-28T11:56:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.305+0000 7f39c6bb7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c00d3390 con 0x7f39c00cf110 2023-11-28T11:56:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.305+0000 7f39c6bb7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c00d2380 con 0x7f39c006ce60 2023-11-28T11:56:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.305+0000 7f39c53b4700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f39c00d1e30 0x7f39c006d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40346/0 (socket says 172.21.15.50:40346) 2023-11-28T11:56:26.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.305+0000 7f39c53b4700 1 -- 172.21.15.50:0/3527039061 learned_addr learned my addr 172.21.15.50:0/3527039061 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.305+0000 7f39c63b6700 1 --2- 172.21.15.50:0/3527039061 >> v2:172.21.15.192:3300/0 conn(0x7f39c00cf110 0x7f39c00cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c5bb5700 1 --2- 172.21.15.50:0/3527039061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c006ce60 0x7f39c00b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c4bb3700 1 -- 172.21.15.50:0/3527039061 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518185550 0 0) 0x7f39c00d0460 con 0x7f39c00d1e30 2023-11-28T11:56:26.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c4bb3700 1 -- 172.21.15.50:0/3527039061 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39ac0035d0 con 0x7f39c00d1e30 2023-11-28T11:56:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c5bb5700 1 -- 172.21.15.50:0/3527039061 >> v2:172.21.15.192:3300/0 conn(0x7f39c00cf110 msgr2=0x7f39c00cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c5bb5700 1 --2- 172.21.15.50:0/3527039061 >> v2:172.21.15.192:3300/0 conn(0x7f39c00cf110 0x7f39c00cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c5bb5700 1 -- 172.21.15.50:0/3527039061 >> v1:172.21.15.50:6789/0 conn(0x7f39c00d1e30 legacy=0x7f39c006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c4bb3700 1 -- 172.21.15.50:0/3527039061 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2905836136 0 0) 0x7f39ac0035d0 con 0x7f39c00d1e30 2023-11-28T11:56:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c5bb5700 1 -- 172.21.15.50:0/3527039061 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c00d2f00 con 0x7f39c006ce60 2023-11-28T11:56:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c63b6700 1 --2- 172.21.15.50:0/3527039061 >> v2:172.21.15.192:3300/0 conn(0x7f39c00cf110 0x7f39c00cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:26.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c5bb5700 1 --2- 172.21.15.50:0/3527039061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c006ce60 0x7f39c00b8240 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009850 tx=0x7f39bc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35429ba97ae9756d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c4bb3700 1 -- 172.21.15.50:0/3527039061 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0001670 con 0x7f39c006ce60 2023-11-28T11:56:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c4bb3700 1 -- 172.21.15.50:0/3527039061 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc004030 con 0x7f39c006ce60 2023-11-28T11:56:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c4bb3700 1 -- 172.21.15.50:0/3527039061 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc0043a0 con 0x7f39c006ce60 2023-11-28T11:56:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c6bb7700 1 -- 172.21.15.50:0/3527039061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c006ce60 msgr2=0x7f39c00b8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c6bb7700 1 --2- 172.21.15.50:0/3527039061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c006ce60 0x7f39c00b8240 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009850 tx=0x7f39bc009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c6bb7700 1 -- 172.21.15.50:0/3527039061 shutdown_connections 2023-11-28T11:56:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c6bb7700 1 --2- 172.21.15.50:0/3527039061 >> v2:172.21.15.192:3300/0 conn(0x7f39c00cf110 0x7f39c00cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c6bb7700 1 --2- 172.21.15.50:0/3527039061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c006ce60 0x7f39c00b8240 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c6bb7700 1 -- 172.21.15.50:0/3527039061 >> 172.21.15.50:0/3527039061 conn(0x7f39c009bbd0 msgr2=0x7f39c00b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c6bb7700 1 -- 172.21.15.50:0/3527039061 shutdown_connections 2023-11-28T11:56:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.309+0000 7f39c6bb7700 1 -- 172.21.15.50:0/3527039061 wait complete. 2023-11-28T11:56:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.313+0000 7f39c6bb7700 1 Processor -- start 2023-11-28T11:56:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.313+0000 7f39c6bb7700 1 -- start start 2023-11-28T11:56:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.313+0000 7f39c6bb7700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c006ce60 0x7f39c00b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.313+0000 7f39c6bb7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c00cf110 0x7f39c01e5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.313+0000 7f39c6bb7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c00d1e30 0x7f39c0154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.313+0000 7f39c6bb7700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c01f5eb0 con 0x7f39c006ce60 2023-11-28T11:56:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.313+0000 7f39c6bb7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c01f4fe0 con 0x7f39c00d1e30 2023-11-28T11:56:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.313+0000 7f39c6bb7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c00b32c0 con 0x7f39c00cf110 2023-11-28T11:56:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.313+0000 7f39c5bb5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c006ce60 0x7f39c00b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.313+0000 7f39c5bb5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c006ce60 0x7f39c00b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44192/0 (socket says 172.21.15.50:44192) 2023-11-28T11:56:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.313+0000 7f39c5bb5700 1 -- 172.21.15.50:0/3752282331 learned_addr learned my addr 172.21.15.50:0/3752282331 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.313+0000 7f39c53b4700 1 --2- 172.21.15.50:0/3752282331 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c00cf110 0x7f39c01e5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.313+0000 7f39c63b6700 1 --2- 172.21.15.50:0/3752282331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c00d1e30 0x7f39c0154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.317+0000 7f39c5bb5700 1 -- 172.21.15.50:0/3752282331 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c00cf110 msgr2=0x7f39c01e5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.317+0000 7f39c5bb5700 1 --2- 172.21.15.50:0/3752282331 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c00cf110 0x7f39c01e5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.317+0000 7f39c5bb5700 1 -- 172.21.15.50:0/3752282331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c00d1e30 msgr2=0x7f39c0154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.317+0000 7f39c5bb5700 1 --2- 172.21.15.50:0/3752282331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c00d1e30 0x7f39c0154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.317+0000 7f39c5bb5700 1 -- 172.21.15.50:0/3752282331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b8009a70 con 0x7f39c006ce60 2023-11-28T11:56:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.317+0000 7f39c53b4700 1 --2- 172.21.15.50:0/3752282331 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c00cf110 0x7f39c01e5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.317+0000 7f39c5bb5700 1 --2- 172.21.15.50:0/3752282331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c006ce60 0x7f39c00b2d80 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0090b0 tx=0x7f39bc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.317+0000 7f39b67fc700 1 -- 172.21.15.50:0/3752282331 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc003de0 con 0x7f39c006ce60 2023-11-28T11:56:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.317+0000 7f39b67fc700 1 -- 172.21.15.50:0/3752282331 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc01f070 con 0x7f39c006ce60 2023-11-28T11:56:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.317+0000 7f39c6bb7700 1 -- 172.21.15.50:0/3752282331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39bc0094b0 con 0x7f39c006ce60 2023-11-28T11:56:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.317+0000 7f39b67fc700 1 -- 172.21.15.50:0/3752282331 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc011870 con 0x7f39c006ce60 2023-11-28T11:56:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.317+0000 7f39c6bb7700 1 -- 172.21.15.50:0/3752282331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c00d25d0 con 0x7f39c006ce60 2023-11-28T11:56:26.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.317+0000 7f39c6bb7700 1 -- 172.21.15.50:0/3752282331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c00d28b0 con 0x7f39c006ce60 2023-11-28T11:56:26.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.321+0000 7f39b67fc700 1 -- 172.21.15.50:0/3752282331 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f39bc017020 con 0x7f39c006ce60 2023-11-28T11:56:26.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.321+0000 7f39b67fc700 1 --2- 172.21.15.50:0/3752282331 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39a4064ee0 0x7f39a4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:26.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.321+0000 7f39b67fc700 1 -- 172.21.15.50:0/3752282331 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f39bc021070 con 0x7f39c006ce60 2023-11-28T11:56:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.321+0000 7f39c53b4700 1 --2- 172.21.15.50:0/3752282331 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39a4064ee0 0x7f39a4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:26.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.321+0000 7f39c53b4700 1 --2- 172.21.15.50:0/3752282331 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39a4064ee0 0x7f39a4067390 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f39b0007fd0 tx=0x7f39b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:26.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.329+0000 7f39b67fc700 1 -- 172.21.15.50:0/3752282331 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f39bc051a20 con 0x7f39c006ce60 2023-11-28T11:56:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.493+0000 7f39c6bb7700 1 -- 172.21.15.50:0/3752282331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f39c015c6e0 con 0x7f39c006ce60 2023-11-28T11:56:26.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.497+0000 7f39b67fc700 1 -- 172.21.15.50:0/3752282331 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v54) v1 ==== 92+0+10 (secure 0 0 0) 0x7f39bc02b0a0 con 0x7f39c006ce60 2023-11-28T11:56:26.500 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:56:26.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.497+0000 7f39c6bb7700 1 -- 172.21.15.50:0/3752282331 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39a4064ee0 msgr2=0x7f39a4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.497+0000 7f39c6bb7700 1 --2- 172.21.15.50:0/3752282331 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39a4064ee0 0x7f39a4067390 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f39b0007fd0 tx=0x7f39b0009040 comp rx=0 tx=0).stop 2023-11-28T11:56:26.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.497+0000 7f39c6bb7700 1 -- 172.21.15.50:0/3752282331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c006ce60 msgr2=0x7f39c00b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.497+0000 7f39c6bb7700 1 --2- 172.21.15.50:0/3752282331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c006ce60 0x7f39c00b2d80 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0090b0 tx=0x7f39bc004770 comp rx=0 tx=0).stop 2023-11-28T11:56:26.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.497+0000 7f39c6bb7700 1 -- 172.21.15.50:0/3752282331 shutdown_connections 2023-11-28T11:56:26.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.497+0000 7f39c6bb7700 1 --2- 172.21.15.50:0/3752282331 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39a4064ee0 0x7f39a4067390 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.497+0000 7f39c6bb7700 1 --2- 172.21.15.50:0/3752282331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c00d1e30 0x7f39c0154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.497+0000 7f39c6bb7700 1 --2- 172.21.15.50:0/3752282331 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c00cf110 0x7f39c01e5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.497+0000 7f39c6bb7700 1 --2- 172.21.15.50:0/3752282331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c006ce60 0x7f39c00b2d80 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.497+0000 7f39c6bb7700 1 -- 172.21.15.50:0/3752282331 >> 172.21.15.50:0/3752282331 conn(0x7f39c009bbd0 msgr2=0x7f39c00d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:26.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.497+0000 7f39c6bb7700 1 -- 172.21.15.50:0/3752282331 shutdown_connections 2023-11-28T11:56:26.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.497+0000 7f39c6bb7700 1 -- 172.21.15.50:0/3752282331 wait complete. 2023-11-28T11:56:26.515 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:56:26.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.637+0000 7f9286660700 1 Processor -- start 2023-11-28T11:56:26.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.637+0000 7f9286660700 1 -- start start 2023-11-28T11:56:26.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.637+0000 7f9286660700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9280156a70 0x7f92800c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:26.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.637+0000 7f9286660700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92800c8f00 con 0x7f92800ca4e0 2023-11-28T11:56:26.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.637+0000 7f9286660700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92800c91e0 con 0x7f9280160700 2023-11-28T11:56:26.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.637+0000 7f9286660700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92800c94c0 con 0x7f9280156a70 2023-11-28T11:56:26.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.637+0000 7f927ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9280156a70 0x7f92800c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:26.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.637+0000 7f927ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9280156a70 0x7f92800c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44194/0 (socket says 172.21.15.50:44194) 2023-11-28T11:56:26.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.637+0000 7f927ffff700 1 -- 172.21.15.50:0/177009695 learned_addr learned my addr 172.21.15.50:0/177009695 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:26.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.637+0000 7f927ffff700 1 -- 172.21.15.50:0/177009695 >> v1:172.21.15.192:6789/0 conn(0x7f9280160700 legacy=0x7f9280069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.637+0000 7f927ffff700 1 -- 172.21.15.50:0/177009695 >> v1:172.21.15.50:6789/0 conn(0x7f92800ca4e0 legacy=0x7f928015fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.637+0000 7f927ffff700 1 -- 172.21.15.50:0/177009695 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92800c97a0 con 0x7f9280156a70 2023-11-28T11:56:26.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.637+0000 7f927ffff700 1 --2- 172.21.15.50:0/177009695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9280156a70 0x7f92800c9fa0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9270009910 tx=0x7f9270009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a12c9c046ad468c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:26.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.637+0000 7f927f7fe700 1 -- 172.21.15.50:0/177009695 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927000ba60 con 0x7f9280156a70 2023-11-28T11:56:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.637+0000 7f927f7fe700 1 -- 172.21.15.50:0/177009695 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927000bbc0 con 0x7f9280156a70 2023-11-28T11:56:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.637+0000 7f927f7fe700 1 -- 172.21.15.50:0/177009695 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270009e60 con 0x7f9280156a70 2023-11-28T11:56:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9286660700 1 -- 172.21.15.50:0/177009695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9280156a70 msgr2=0x7f92800c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9286660700 1 --2- 172.21.15.50:0/177009695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9280156a70 0x7f92800c9fa0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9270009910 tx=0x7f9270009c20 comp rx=0 tx=0).stop 2023-11-28T11:56:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9286660700 1 -- 172.21.15.50:0/177009695 shutdown_connections 2023-11-28T11:56:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9286660700 1 --2- 172.21.15.50:0/177009695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9280156a70 0x7f92800c9fa0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9286660700 1 -- 172.21.15.50:0/177009695 >> 172.21.15.50:0/177009695 conn(0x7f92800cf4a0 msgr2=0x7f92800cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9286660700 1 -- 172.21.15.50:0/177009695 shutdown_connections 2023-11-28T11:56:26.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9286660700 1 -- 172.21.15.50:0/177009695 wait complete. 2023-11-28T11:56:26.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9286660700 1 Processor -- start 2023-11-28T11:56:26.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9286660700 1 -- start start 2023-11-28T11:56:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9286660700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92800ca4e0 0x7f92801f1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9286660700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9280156a70 0x7f92800c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9286660700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9280160700 0x7f928006a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9286660700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92800c2220 con 0x7f9280160700 2023-11-28T11:56:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9286660700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92800c6e60 con 0x7f92800ca4e0 2023-11-28T11:56:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9286660700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92800c7140 con 0x7f9280156a70 2023-11-28T11:56:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9284bfd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9280160700 0x7f928006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9284bfd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9280160700 0x7f928006a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44210/0 (socket says 172.21.15.50:44210) 2023-11-28T11:56:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9284bfd700 1 -- 172.21.15.50:0/2241210692 learned_addr learned my addr 172.21.15.50:0/2241210692 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f927ffff700 1 --2- 172.21.15.50:0/2241210692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92800ca4e0 0x7f92801f1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:26.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f92777fe700 1 --2- 172.21.15.50:0/2241210692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9280156a70 0x7f92800c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:26.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9284bfd700 1 -- 172.21.15.50:0/2241210692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9280156a70 msgr2=0x7f92800c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9284bfd700 1 --2- 172.21.15.50:0/2241210692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9280156a70 0x7f92800c4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9284bfd700 1 -- 172.21.15.50:0/2241210692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92800ca4e0 msgr2=0x7f92801f1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9284bfd700 1 --2- 172.21.15.50:0/2241210692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92800ca4e0 0x7f92801f1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9284bfd700 1 -- 172.21.15.50:0/2241210692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9270009570 con 0x7f9280160700 2023-11-28T11:56:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9284bfd700 1 --2- 172.21.15.50:0/2241210692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9280160700 0x7f928006a990 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f927800cbc0 tx=0x7f927800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f927d7fa700 1 -- 172.21.15.50:0/2241210692 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278003c20 con 0x7f9280160700 2023-11-28T11:56:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f927d7fa700 1 -- 172.21.15.50:0/2241210692 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9278003d80 con 0x7f9280160700 2023-11-28T11:56:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f9286660700 1 -- 172.21.15.50:0/2241210692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9280156e40 con 0x7f9280160700 2023-11-28T11:56:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.641+0000 7f927d7fa700 1 -- 172.21.15.50:0/2241210692 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927800aa20 con 0x7f9280160700 2023-11-28T11:56:26.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.645+0000 7f9286660700 1 -- 172.21.15.50:0/2241210692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92800c9a80 con 0x7f9280160700 2023-11-28T11:56:26.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.645+0000 7f9286660700 1 -- 172.21.15.50:0/2241210692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928006a350 con 0x7f9280160700 2023-11-28T11:56:26.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.645+0000 7f927d7fa700 1 -- 172.21.15.50:0/2241210692 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9278010050 con 0x7f9280160700 2023-11-28T11:56:26.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.645+0000 7f927d7fa700 1 --2- 172.21.15.50:0/2241210692 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9260064ee0 0x7f9260067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:26.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.649+0000 7f927d7fa700 1 -- 172.21.15.50:0/2241210692 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9278081da0 con 0x7f9280160700 2023-11-28T11:56:26.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.649+0000 7f927ffff700 1 --2- 172.21.15.50:0/2241210692 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9260064ee0 0x7f9260067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:26.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.649+0000 7f927ffff700 1 --2- 172.21.15.50:0/2241210692 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9260064ee0 0x7f9260067390 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9270006f80 tx=0x7f9270008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:26.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.657+0000 7f927d7fa700 1 -- 172.21.15.50:0/2241210692 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f927804fd80 con 0x7f9280160700 2023-11-28T11:56:26.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.817+0000 7f9286660700 1 -- 172.21.15.50:0/2241210692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9280072500 con 0x7f9280160700 2023-11-28T11:56:26.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.817+0000 7f927d7fa700 1 -- 172.21.15.50:0/2241210692 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92780533a0 con 0x7f9280160700 2023-11-28T11:56:26.823 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:56:26.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.821+0000 7f9286660700 1 -- 172.21.15.50:0/2241210692 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9260064ee0 msgr2=0x7f9260067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.821+0000 7f9286660700 1 --2- 172.21.15.50:0/2241210692 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9260064ee0 0x7f9260067390 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9270006f80 tx=0x7f9270008030 comp rx=0 tx=0).stop 2023-11-28T11:56:26.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.821+0000 7f9286660700 1 -- 172.21.15.50:0/2241210692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9280160700 msgr2=0x7f928006a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.821+0000 7f9286660700 1 --2- 172.21.15.50:0/2241210692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9280160700 0x7f928006a990 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f927800cbc0 tx=0x7f927800ced0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.821+0000 7f9286660700 1 -- 172.21.15.50:0/2241210692 shutdown_connections 2023-11-28T11:56:26.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.821+0000 7f9286660700 1 --2- 172.21.15.50:0/2241210692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9280160700 0x7f928006a990 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.821+0000 7f9286660700 1 --2- 172.21.15.50:0/2241210692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9280156a70 0x7f92800c4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.821+0000 7f9286660700 1 --2- 172.21.15.50:0/2241210692 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9260064ee0 0x7f9260067390 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.821+0000 7f9286660700 1 --2- 172.21.15.50:0/2241210692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92800ca4e0 0x7f92801f1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.821+0000 7f9286660700 1 -- 172.21.15.50:0/2241210692 >> 172.21.15.50:0/2241210692 conn(0x7f92800cf4a0 msgr2=0x7f92800b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:26.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.821+0000 7f9286660700 1 -- 172.21.15.50:0/2241210692 shutdown_connections 2023-11-28T11:56:26.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.821+0000 7f9286660700 1 -- 172.21.15.50:0/2241210692 wait complete. 2023-11-28T11:56:26.838 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:56:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.949+0000 7f4867273700 1 Processor -- start 2023-11-28T11:56:26.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.949+0000 7f4867273700 1 -- start start 2023-11-28T11:56:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f4867273700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f486006f010 0x7f4860161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:26.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f4867273700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48600cbaf0 0x7f4860163fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f4867273700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f486015a3a0 con 0x7f486006a6e0 2023-11-28T11:56:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f4867273700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48600ca430 con 0x7f486006f010 2023-11-28T11:56:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f4867273700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48600ca710 con 0x7f48600cbaf0 2023-11-28T11:56:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f4865a70700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f486006f010 0x7f4860161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f4866a72700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48600cbaf0 0x7f4860163fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f4865a70700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f486006f010 0x7f4860161a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:46128/0 (socket says 172.21.15.50:46128) 2023-11-28T11:56:26.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f4865a70700 1 -- 172.21.15.50:0/2815929381 learned_addr learned my addr 172.21.15.50:0/2815929381 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:26.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f4866271700 1 --1- 172.21.15.50:0/2815929381 >> v1:172.21.15.192:6789/0 conn(0x7f486006a6e0 0x7f486006aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:43086/0 (socket says 172.21.15.50:43086) 2023-11-28T11:56:26.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f4866a72700 1 -- 172.21.15.50:0/2815929381 >> v2:172.21.15.192:3300/0 conn(0x7f486006f010 msgr2=0x7f4860161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:26.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f4866a72700 1 --2- 172.21.15.50:0/2815929381 >> v2:172.21.15.192:3300/0 conn(0x7f486006f010 0x7f4860161a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f4866a72700 1 -- 172.21.15.50:0/2815929381 >> v1:172.21.15.192:6789/0 conn(0x7f486006a6e0 legacy=0x7f486006aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f486526f700 1 -- 172.21.15.50:0/2815929381 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685057501 0 0) 0x7f485c001110 con 0x7f486006a6e0 2023-11-28T11:56:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f4866a72700 1 -- 172.21.15.50:0/2815929381 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48600ca9f0 con 0x7f48600cbaf0 2023-11-28T11:56:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f4865a70700 1 --2- 172.21.15.50:0/2815929381 >> v2:172.21.15.192:3300/0 conn(0x7f486006f010 0x7f4860161a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f4866a72700 1 --2- 172.21.15.50:0/2815929381 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48600cbaf0 0x7f4860163fb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4858009d90 tx=0x7f485800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e7c96e8713ef668 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f486526f700 1 -- 172.21.15.50:0/2815929381 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485800e070 con 0x7f48600cbaf0 2023-11-28T11:56:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f486526f700 1 -- 172.21.15.50:0/2815929381 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485800bb20 con 0x7f48600cbaf0 2023-11-28T11:56:26.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.953+0000 7f486526f700 1 -- 172.21.15.50:0/2815929381 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4858012430 con 0x7f48600cbaf0 2023-11-28T11:56:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.957+0000 7f4867273700 1 -- 172.21.15.50:0/2815929381 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48600cbaf0 msgr2=0x7f4860163fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.957+0000 7f4867273700 1 --2- 172.21.15.50:0/2815929381 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48600cbaf0 0x7f4860163fb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4858009d90 tx=0x7f485800b330 comp rx=0 tx=0).stop 2023-11-28T11:56:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.957+0000 7f4867273700 1 -- 172.21.15.50:0/2815929381 shutdown_connections 2023-11-28T11:56:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.957+0000 7f4867273700 1 --2- 172.21.15.50:0/2815929381 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48600cbaf0 0x7f4860163fb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.957+0000 7f4867273700 1 --2- 172.21.15.50:0/2815929381 >> v2:172.21.15.192:3300/0 conn(0x7f486006f010 0x7f4860161a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.957+0000 7f4867273700 1 -- 172.21.15.50:0/2815929381 >> 172.21.15.50:0/2815929381 conn(0x7f48600d0240 msgr2=0x7f48600cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.957+0000 7f4867273700 1 -- 172.21.15.50:0/2815929381 shutdown_connections 2023-11-28T11:56:26.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.957+0000 7f4867273700 1 -- 172.21.15.50:0/2815929381 wait complete. 2023-11-28T11:56:26.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.957+0000 7f4867273700 1 Processor -- start 2023-11-28T11:56:26.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.957+0000 7f4867273700 1 -- start start 2023-11-28T11:56:26.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4867273700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f486006a6e0 0x7f48601f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:26.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4867273700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f486006f010 0x7f48600ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:26.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4867273700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48600cbaf0 0x7f48600ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:26.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4867273700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48600ad0b0 con 0x7f486006f010 2023-11-28T11:56:26.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4867273700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48600cdd60 con 0x7f48600cbaf0 2023-11-28T11:56:26.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4867273700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48600ce040 con 0x7f486006a6e0 2023-11-28T11:56:26.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4865a70700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f486006f010 0x7f48600ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:26.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4865a70700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f486006f010 0x7f48600ac250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44226/0 (socket says 172.21.15.50:44226) 2023-11-28T11:56:26.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4865a70700 1 -- 172.21.15.50:0/4026286264 learned_addr learned my addr 172.21.15.50:0/4026286264 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:26.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4866a72700 1 --2- 172.21.15.50:0/4026286264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48600cbaf0 0x7f48600ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:26.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4866271700 1 --2- 172.21.15.50:0/4026286264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f486006a6e0 0x7f48601f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:26.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4865a70700 1 -- 172.21.15.50:0/4026286264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f486006a6e0 msgr2=0x7f48601f12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4865a70700 1 --2- 172.21.15.50:0/4026286264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f486006a6e0 0x7f48601f12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4865a70700 1 -- 172.21.15.50:0/4026286264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48600cbaf0 msgr2=0x7f48600ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:26.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4865a70700 1 --2- 172.21.15.50:0/4026286264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48600cbaf0 0x7f48600ac790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:26.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4865a70700 1 -- 172.21.15.50:0/4026286264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4850009520 con 0x7f486006f010 2023-11-28T11:56:26.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4865a70700 1 --2- 172.21.15.50:0/4026286264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f486006f010 0x7f48600ac250 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f485000e9d0 tx=0x7f485000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:26.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4856ffd700 1 -- 172.21.15.50:0/4026286264 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000ee70 con 0x7f486006f010 2023-11-28T11:56:26.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4856ffd700 1 -- 172.21.15.50:0/4026286264 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4850005a40 con 0x7f486006f010 2023-11-28T11:56:26.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4867273700 1 -- 172.21.15.50:0/4026286264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4858009a70 con 0x7f486006f010 2023-11-28T11:56:26.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4856ffd700 1 -- 172.21.15.50:0/4026286264 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850005db0 con 0x7f486006f010 2023-11-28T11:56:26.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.961+0000 7f4867273700 1 -- 172.21.15.50:0/4026286264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48600cafb0 con 0x7f486006f010 2023-11-28T11:56:26.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.965+0000 7f4867273700 1 -- 172.21.15.50:0/4026286264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48600cacd0 con 0x7f486006f010 2023-11-28T11:56:26.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.965+0000 7f4856ffd700 1 -- 172.21.15.50:0/4026286264 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4850019070 con 0x7f486006f010 2023-11-28T11:56:26.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.965+0000 7f4856ffd700 1 --2- 172.21.15.50:0/4026286264 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4844064ee0 0x7f4844067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:26.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.965+0000 7f4856ffd700 1 -- 172.21.15.50:0/4026286264 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4850081d70 con 0x7f486006f010 2023-11-28T11:56:26.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.965+0000 7f4866271700 1 --2- 172.21.15.50:0/4026286264 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4844064ee0 0x7f4844067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:26.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.965+0000 7f4866271700 1 --2- 172.21.15.50:0/4026286264 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4844064ee0 0x7f4844067390 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f485c000f60 tx=0x7f485c007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:26.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:26.973+0000 7f4856ffd700 1 -- 172.21.15.50:0/4026286264 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f485004fd50 con 0x7f486006f010 2023-11-28T11:56:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.137+0000 7f4867273700 1 -- 172.21.15.50:0/4026286264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f48600ca070 con 0x7f486006f010 2023-11-28T11:56:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.137+0000 7f4856ffd700 1 -- 172.21.15.50:0/4026286264 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4850053370 con 0x7f486006f010 2023-11-28T11:56:27.140 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:56:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.137+0000 7f4867273700 1 -- 172.21.15.50:0/4026286264 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4844064ee0 msgr2=0x7f4844067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.137+0000 7f4867273700 1 --2- 172.21.15.50:0/4026286264 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4844064ee0 0x7f4844067390 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f485c000f60 tx=0x7f485c007e90 comp rx=0 tx=0).stop 2023-11-28T11:56:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.137+0000 7f4867273700 1 -- 172.21.15.50:0/4026286264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f486006f010 msgr2=0x7f48600ac250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.137+0000 7f4867273700 1 --2- 172.21.15.50:0/4026286264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f486006f010 0x7f48600ac250 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f485000e9d0 tx=0x7f485000ece0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.137+0000 7f4867273700 1 -- 172.21.15.50:0/4026286264 shutdown_connections 2023-11-28T11:56:27.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.137+0000 7f4867273700 1 --2- 172.21.15.50:0/4026286264 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4844064ee0 0x7f4844067390 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.137+0000 7f4867273700 1 --2- 172.21.15.50:0/4026286264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48600cbaf0 0x7f48600ac790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.137+0000 7f4867273700 1 --2- 172.21.15.50:0/4026286264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f486006f010 0x7f48600ac250 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.137+0000 7f4867273700 1 --2- 172.21.15.50:0/4026286264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f486006a6e0 0x7f48601f12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.137+0000 7f4867273700 1 -- 172.21.15.50:0/4026286264 >> 172.21.15.50:0/4026286264 conn(0x7f48600d0240 msgr2=0x7f486006aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.137+0000 7f4867273700 1 -- 172.21.15.50:0/4026286264 shutdown_connections 2023-11-28T11:56:27.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.137+0000 7f4867273700 1 -- 172.21.15.50:0/4026286264 wait complete. 2023-11-28T11:56:27.155 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:56:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.273+0000 7fd6bf59e700 1 Processor -- start 2023-11-28T11:56:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.273+0000 7fd6bf59e700 1 -- start start 2023-11-28T11:56:27.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.273+0000 7fd6bf59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd6c00c13c0 0x7fd6c00c1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:27.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.273+0000 7fd6bf59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c0160c50 con 0x7fd6c0160880 2023-11-28T11:56:27.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.273+0000 7fd6bf59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c00b3050 con 0x7fd6c01642e0 2023-11-28T11:56:27.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.273+0000 7fd6bf59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c00c1d80 con 0x7fd6c00c13c0 2023-11-28T11:56:27.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6be59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd6c0160880 0x7fd6c006aac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40360/0 (socket says 172.21.15.50:40360) 2023-11-28T11:56:27.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6be59c700 1 -- 172.21.15.50:0/1450559550 learned_addr learned my addr 172.21.15.50:0/1450559550 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:27.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6bdd9b700 1 --2- 172.21.15.50:0/1450559550 >> v2:172.21.15.192:3300/0 conn(0x7fd6c00c13c0 0x7fd6c00c1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:27.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6bd59a700 1 -- 172.21.15.50:0/1450559550 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323910461 0 0) 0x7fd6c0160c50 con 0x7fd6c0160880 2023-11-28T11:56:27.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6bd59a700 1 -- 172.21.15.50:0/1450559550 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6ac0035d0 con 0x7fd6c0160880 2023-11-28T11:56:27.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6bdd9b700 1 -- 172.21.15.50:0/1450559550 >> v1:172.21.15.192:6789/0 conn(0x7fd6c01642e0 legacy=0x7fd6c0164700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6bdd9b700 1 -- 172.21.15.50:0/1450559550 >> v1:172.21.15.50:6789/0 conn(0x7fd6c0160880 legacy=0x7fd6c006aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6bdd9b700 1 -- 172.21.15.50:0/1450559550 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c006b630 con 0x7fd6c00c13c0 2023-11-28T11:56:27.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6bdd9b700 1 --2- 172.21.15.50:0/1450559550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6c00c13c0 0x7fd6c00c1840 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8009850 tx=0x7fd6a8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b19ca0bc7d89af5d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:27.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6bd59a700 1 -- 172.21.15.50:0/1450559550 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8011830 con 0x7fd6c00c13c0 2023-11-28T11:56:27.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6bd59a700 1 -- 172.21.15.50:0/1450559550 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a8011990 con 0x7fd6c00c13c0 2023-11-28T11:56:27.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6bd59a700 1 -- 172.21.15.50:0/1450559550 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8011d00 con 0x7fd6c00c13c0 2023-11-28T11:56:27.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6bf59e700 1 -- 172.21.15.50:0/1450559550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6c00c13c0 msgr2=0x7fd6c00c1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6bf59e700 1 --2- 172.21.15.50:0/1450559550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6c00c13c0 0x7fd6c00c1840 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8009850 tx=0x7fd6a8009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:27.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6bf59e700 1 -- 172.21.15.50:0/1450559550 shutdown_connections 2023-11-28T11:56:27.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6bf59e700 1 --2- 172.21.15.50:0/1450559550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6c00c13c0 0x7fd6c00c1840 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6bf59e700 1 -- 172.21.15.50:0/1450559550 >> 172.21.15.50:0/1450559550 conn(0x7fd6c00cae70 msgr2=0x7fd6c00cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:27.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6bf59e700 1 -- 172.21.15.50:0/1450559550 shutdown_connections 2023-11-28T11:56:27.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.277+0000 7fd6bf59e700 1 -- 172.21.15.50:0/1450559550 wait complete. 2023-11-28T11:56:27.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bf59e700 1 Processor -- start 2023-11-28T11:56:27.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bf59e700 1 -- start start 2023-11-28T11:56:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bf59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6c00c13c0 0x7fd6c01550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bf59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c0160880 0x7fd6c00997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bf59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6c01642e0 0x7fd6c006bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bf59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c009ad30 con 0x7fd6c0160880 2023-11-28T11:56:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bf59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c009a1b0 con 0x7fd6c01642e0 2023-11-28T11:56:27.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bf59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c009a490 con 0x7fd6c00c13c0 2023-11-28T11:56:27.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bdd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c0160880 0x7fd6c00997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:27.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bdd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c0160880 0x7fd6c00997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44238/0 (socket says 172.21.15.50:44238) 2023-11-28T11:56:27.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bdd9b700 1 -- 172.21.15.50:0/3499586097 learned_addr learned my addr 172.21.15.50:0/3499586097 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:27.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bed9d700 1 --2- 172.21.15.50:0/3499586097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6c01642e0 0x7fd6c006bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:27.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6be59c700 1 --2- 172.21.15.50:0/3499586097 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6c00c13c0 0x7fd6c01550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:27.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bed9d700 1 -- 172.21.15.50:0/3499586097 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6c00c13c0 msgr2=0x7fd6c01550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bed9d700 1 --2- 172.21.15.50:0/3499586097 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6c00c13c0 0x7fd6c01550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bed9d700 1 -- 172.21.15.50:0/3499586097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c0160880 msgr2=0x7fd6c00997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bed9d700 1 --2- 172.21.15.50:0/3499586097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c0160880 0x7fd6c00997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bed9d700 1 -- 172.21.15.50:0/3499586097 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a80094b0 con 0x7fd6c01642e0 2023-11-28T11:56:27.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bdd9b700 1 --2- 172.21.15.50:0/3499586097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c0160880 0x7fd6c00997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:27.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bed9d700 1 --2- 172.21.15.50:0/3499586097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6c01642e0 0x7fd6c006bc60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800cae0 tx=0x7fd6b800cdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:27.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6b6ffd700 1 -- 172.21.15.50:0/3499586097 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8003c20 con 0x7fd6c01642e0 2023-11-28T11:56:27.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6b6ffd700 1 -- 172.21.15.50:0/3499586097 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b8003d80 con 0x7fd6c01642e0 2023-11-28T11:56:27.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bf59e700 1 -- 172.21.15.50:0/3499586097 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c0069fc0 con 0x7fd6c01642e0 2023-11-28T11:56:27.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6b6ffd700 1 -- 172.21.15.50:0/3499586097 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b800aa20 con 0x7fd6c01642e0 2023-11-28T11:56:27.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.281+0000 7fd6bf59e700 1 -- 172.21.15.50:0/3499586097 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c0069ce0 con 0x7fd6c01642e0 2023-11-28T11:56:27.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.285+0000 7fd6bf59e700 1 -- 172.21.15.50:0/3499586097 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c006a2a0 con 0x7fd6c01642e0 2023-11-28T11:56:27.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.285+0000 7fd6b6ffd700 1 -- 172.21.15.50:0/3499586097 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd6b8010050 con 0x7fd6c01642e0 2023-11-28T11:56:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.285+0000 7fd6b6ffd700 1 --2- 172.21.15.50:0/3499586097 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd6a0064ee0 0x7fd6a0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.285+0000 7fd6b6ffd700 1 -- 172.21.15.50:0/3499586097 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd6b8081d60 con 0x7fd6c01642e0 2023-11-28T11:56:27.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.285+0000 7fd6be59c700 1 --2- 172.21.15.50:0/3499586097 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd6a0064ee0 0x7fd6a0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:27.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.289+0000 7fd6be59c700 1 --2- 172.21.15.50:0/3499586097 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd6a0064ee0 0x7fd6a0067390 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0007fd0 tx=0x7fd6b0007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:27.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.297+0000 7fd6b6ffd700 1 -- 172.21.15.50:0/3499586097 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd6b804fd40 con 0x7fd6c01642e0 2023-11-28T11:56:27.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.461+0000 7fd6bf59e700 1 -- 172.21.15.50:0/3499586097 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6c0072500 con 0x7fd6c01642e0 2023-11-28T11:56:27.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.465+0000 7fd6b6ffd700 1 -- 172.21.15.50:0/3499586097 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd6b8053360 con 0x7fd6c01642e0 2023-11-28T11:56:27.467 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:56:27.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.465+0000 7fd6bf59e700 1 -- 172.21.15.50:0/3499586097 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd6a0064ee0 msgr2=0x7fd6a0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.465+0000 7fd6bf59e700 1 --2- 172.21.15.50:0/3499586097 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd6a0064ee0 0x7fd6a0067390 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0007fd0 tx=0x7fd6b0007de0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.465+0000 7fd6bf59e700 1 -- 172.21.15.50:0/3499586097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6c01642e0 msgr2=0x7fd6c006bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.465+0000 7fd6bf59e700 1 --2- 172.21.15.50:0/3499586097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6c01642e0 0x7fd6c006bc60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800cae0 tx=0x7fd6b800cdf0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.465+0000 7fd6bf59e700 1 -- 172.21.15.50:0/3499586097 shutdown_connections 2023-11-28T11:56:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.465+0000 7fd6bf59e700 1 --2- 172.21.15.50:0/3499586097 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd6a0064ee0 0x7fd6a0067390 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.465+0000 7fd6bf59e700 1 --2- 172.21.15.50:0/3499586097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6c01642e0 0x7fd6c006bc60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.465+0000 7fd6bf59e700 1 --2- 172.21.15.50:0/3499586097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c0160880 0x7fd6c00997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.465+0000 7fd6bf59e700 1 --2- 172.21.15.50:0/3499586097 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6c00c13c0 0x7fd6c01550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.465+0000 7fd6bf59e700 1 -- 172.21.15.50:0/3499586097 >> 172.21.15.50:0/3499586097 conn(0x7fd6c00cae70 msgr2=0x7fd6c00b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.465+0000 7fd6bf59e700 1 -- 172.21.15.50:0/3499586097 shutdown_connections 2023-11-28T11:56:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.465+0000 7fd6bf59e700 1 -- 172.21.15.50:0/3499586097 wait complete. 2023-11-28T11:56:27.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:56:27.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76c5eff700 1 Processor -- start 2023-11-28T11:56:27.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76c5eff700 1 -- start start 2023-11-28T11:56:27.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76c5eff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c00c1ac0 0x7f76c0069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:27.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76c5eff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f76c00ceef0 0x7f76c006a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:27.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76c5eff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c00cae70 con 0x7f76c01606b0 2023-11-28T11:56:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76c5eff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c00cbc10 con 0x7f76c00ceef0 2023-11-28T11:56:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76c5eff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c00cb130 con 0x7f76c00c1ac0 2023-11-28T11:56:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76c56fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f76c00ceef0 0x7f76c006a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76c56fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f76c00ceef0 0x7f76c006a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44254/0 (socket says 172.21.15.50:44254) 2023-11-28T11:56:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76c4efd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f76c01606b0 0x7f76c00c13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40364/0 (socket says 172.21.15.50:40364) 2023-11-28T11:56:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76c56fe700 1 -- 172.21.15.50:0/2423310388 learned_addr learned my addr 172.21.15.50:0/2423310388 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76bffff700 1 --2- 172.21.15.50:0/2423310388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c00c1ac0 0x7f76c0069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76c56fe700 1 -- 172.21.15.50:0/2423310388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c00c1ac0 msgr2=0x7f76c0069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76c56fe700 1 --2- 172.21.15.50:0/2423310388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c00c1ac0 0x7f76c0069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76c56fe700 1 -- 172.21.15.50:0/2423310388 >> v1:172.21.15.50:6789/0 conn(0x7f76c01606b0 legacy=0x7f76c00c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76c56fe700 1 -- 172.21.15.50:0/2423310388 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c00cb410 con 0x7f76c00ceef0 2023-11-28T11:56:27.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76bffff700 1 --2- 172.21.15.50:0/2423310388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c00c1ac0 0x7f76c0069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:27.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76c56fe700 1 --2- 172.21.15.50:0/2423310388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c00ceef0 0x7f76c006a180 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009910 tx=0x7f76b8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee73a152191e732 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:27.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.589+0000 7f76bf7fe700 1 -- 172.21.15.50:0/2423310388 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b800ba60 con 0x7f76c00ceef0 2023-11-28T11:56:27.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76bf7fe700 1 -- 172.21.15.50:0/2423310388 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b800bbc0 con 0x7f76c00ceef0 2023-11-28T11:56:27.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76bf7fe700 1 -- 172.21.15.50:0/2423310388 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b8009e60 con 0x7f76c00ceef0 2023-11-28T11:56:27.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c5eff700 1 -- 172.21.15.50:0/2423310388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c00ceef0 msgr2=0x7f76c006a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c5eff700 1 --2- 172.21.15.50:0/2423310388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c00ceef0 0x7f76c006a180 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009910 tx=0x7f76b8009c20 comp rx=0 tx=0).stop 2023-11-28T11:56:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c5eff700 1 -- 172.21.15.50:0/2423310388 shutdown_connections 2023-11-28T11:56:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c5eff700 1 --2- 172.21.15.50:0/2423310388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c00ceef0 0x7f76c006a180 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c5eff700 1 --2- 172.21.15.50:0/2423310388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c00c1ac0 0x7f76c0069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c5eff700 1 -- 172.21.15.50:0/2423310388 >> 172.21.15.50:0/2423310388 conn(0x7f76c00ce3e0 msgr2=0x7f76c00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c5eff700 1 -- 172.21.15.50:0/2423310388 shutdown_connections 2023-11-28T11:56:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c5eff700 1 -- 172.21.15.50:0/2423310388 wait complete. 2023-11-28T11:56:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c5eff700 1 Processor -- start 2023-11-28T11:56:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c5eff700 1 -- start start 2023-11-28T11:56:27.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c5eff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c00c1ac0 0x7f76c00c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:27.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c5eff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c00ceef0 0x7f76c00c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:27.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c5eff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c01606b0 0x7f76c00c2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:27.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c5eff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c00ade40 con 0x7f76c00ceef0 2023-11-28T11:56:27.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c5eff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c0159d90 con 0x7f76c01606b0 2023-11-28T11:56:27.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c5eff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c0159a60 con 0x7f76c00c1ac0 2023-11-28T11:56:27.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76bffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c00ceef0 0x7f76c00c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:27.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76bffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c00ceef0 0x7f76c00c28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44268/0 (socket says 172.21.15.50:44268) 2023-11-28T11:56:27.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76bffff700 1 -- 172.21.15.50:0/1310756343 learned_addr learned my addr 172.21.15.50:0/1310756343 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:27.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c56fe700 1 --2- 172.21.15.50:0/1310756343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c01606b0 0x7f76c00c2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:27.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.593+0000 7f76c4efd700 1 --2- 172.21.15.50:0/1310756343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c00c1ac0 0x7f76c00c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:27.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.597+0000 7f76bffff700 1 -- 172.21.15.50:0/1310756343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c00c1ac0 msgr2=0x7f76c00c1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.597+0000 7f76bffff700 1 --2- 172.21.15.50:0/1310756343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c00c1ac0 0x7f76c00c1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.597+0000 7f76bffff700 1 -- 172.21.15.50:0/1310756343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c01606b0 msgr2=0x7f76c00c2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.597+0000 7f76bffff700 1 --2- 172.21.15.50:0/1310756343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c01606b0 0x7f76c00c2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.597+0000 7f76bffff700 1 -- 172.21.15.50:0/1310756343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b8009570 con 0x7f76c00ceef0 2023-11-28T11:56:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.597+0000 7f76c4efd700 1 --2- 172.21.15.50:0/1310756343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c00c1ac0 0x7f76c00c1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.597+0000 7f76bffff700 1 --2- 172.21.15.50:0/1310756343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c00ceef0 0x7f76c00c28f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009fa0 tx=0x7f76b000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.597+0000 7f76bd7fa700 1 -- 172.21.15.50:0/1310756343 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b000de60 con 0x7f76c00ceef0 2023-11-28T11:56:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.597+0000 7f76c5eff700 1 -- 172.21.15.50:0/1310756343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c00b36c0 con 0x7f76c00ceef0 2023-11-28T11:56:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.597+0000 7f76bd7fa700 1 -- 172.21.15.50:0/1310756343 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b000f040 con 0x7f76c00ceef0 2023-11-28T11:56:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.597+0000 7f76c5eff700 1 -- 172.21.15.50:0/1310756343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c00cb6f0 con 0x7f76c00ceef0 2023-11-28T11:56:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.597+0000 7f76bd7fa700 1 -- 172.21.15.50:0/1310756343 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0003c60 con 0x7f76c00ceef0 2023-11-28T11:56:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.597+0000 7f76c5eff700 1 -- 172.21.15.50:0/1310756343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c00ad610 con 0x7f76c00ceef0 2023-11-28T11:56:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.597+0000 7f76bd7fa700 1 -- 172.21.15.50:0/1310756343 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f76b001c030 con 0x7f76c00ceef0 2023-11-28T11:56:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.601+0000 7f76bd7fa700 1 --2- 172.21.15.50:0/1310756343 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f76ac064ee0 0x7f76ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.601+0000 7f76bd7fa700 1 -- 172.21.15.50:0/1310756343 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f76b0081f20 con 0x7f76c00ceef0 2023-11-28T11:56:27.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.601+0000 7f76c4efd700 1 --2- 172.21.15.50:0/1310756343 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f76ac064ee0 0x7f76ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:27.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.601+0000 7f76c4efd700 1 --2- 172.21.15.50:0/1310756343 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f76ac064ee0 0x7f76ac067390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f76b4000f60 tx=0x7f76b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.609+0000 7f76bd7fa700 1 -- 172.21.15.50:0/1310756343 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f76b004d400 con 0x7f76c00ceef0 2023-11-28T11:56:27.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.805+0000 7f76c5eff700 1 -- 172.21.15.50:0/1310756343 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76c0072500 con 0x7f76c00ceef0 2023-11-28T11:56:27.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.809+0000 7f76bd7fa700 1 -- 172.21.15.50:0/1310756343 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f76b004ffb0 con 0x7f76c00ceef0 2023-11-28T11:56:27.812 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:27.812 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2341737190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2341737190},{"type":"v1","addr":"172.21.15.50:6835","nonce":2341737190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5546,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/192527628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":192527628},{"type":"v1","addr":"172.21.15.192:6835","nonce":192527628}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5549,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2304989740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2304989740},{"type":"v1","addr":"172.21.15.192:6837","nonce":2304989740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:55:57.946191+0000","modified":"2023-11-28T11:56:00.964614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6057":{"gid":6057,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/1163863991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1163863991},{"type":"v1","addr":"172.21.15.50:6834","nonce":1163863991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:56:27.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.809+0000 7f76c5eff700 1 -- 172.21.15.50:0/1310756343 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f76ac064ee0 msgr2=0x7f76ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.809+0000 7f76c5eff700 1 --2- 172.21.15.50:0/1310756343 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f76ac064ee0 0x7f76ac067390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f76b4000f60 tx=0x7f76b4009040 comp rx=0 tx=0).stop 2023-11-28T11:56:27.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.809+0000 7f76c5eff700 1 -- 172.21.15.50:0/1310756343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c00ceef0 msgr2=0x7f76c00c28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.809+0000 7f76c5eff700 1 --2- 172.21.15.50:0/1310756343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c00ceef0 0x7f76c00c28f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009fa0 tx=0x7f76b000d3b0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.809+0000 7f76c5eff700 1 -- 172.21.15.50:0/1310756343 shutdown_connections 2023-11-28T11:56:27.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.809+0000 7f76c5eff700 1 --2- 172.21.15.50:0/1310756343 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f76ac064ee0 0x7f76ac067390 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.809+0000 7f76c5eff700 1 --2- 172.21.15.50:0/1310756343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c01606b0 0x7f76c00c2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.809+0000 7f76c5eff700 1 --2- 172.21.15.50:0/1310756343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76c00ceef0 0x7f76c00c28f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.809+0000 7f76c5eff700 1 --2- 172.21.15.50:0/1310756343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c00c1ac0 0x7f76c00c1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.809+0000 7f76c5eff700 1 -- 172.21.15.50:0/1310756343 >> 172.21.15.50:0/1310756343 conn(0x7f76c00ce3e0 msgr2=0x7f76c00ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:27.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.809+0000 7f76c5eff700 1 -- 172.21.15.50:0/1310756343 shutdown_connections 2023-11-28T11:56:27.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.809+0000 7f76c5eff700 1 -- 172.21.15.50:0/1310756343 wait complete. 2023-11-28T11:56:27.816 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2023-11-28T11:56:27.827 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:27.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.933+0000 7fcbf90f5700 1 Processor -- start 2023-11-28T11:56:27.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.933+0000 7fcbf90f5700 1 -- start start 2023-11-28T11:56:27.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.933+0000 7fcbf90f5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcbf4158e60 0x7fcbf40c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:27.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.933+0000 7fcbf90f5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf40ad490 0x7fcbf40cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:27.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.933+0000 7fcbf90f5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf40cd8f0 con 0x7fcbf40cad50 2023-11-28T11:56:27.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.933+0000 7fcbf90f5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf40add00 con 0x7fcbf4158e60 2023-11-28T11:56:27.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.933+0000 7fcbf90f5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf40cc4f0 con 0x7fcbf40ad490 2023-11-28T11:56:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbeb7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf40ad490 0x7fcbf40cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbf3fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcbf4158e60 0x7fcbf40c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbeb7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf40ad490 0x7fcbf40cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:40750/0 (socket says 172.21.15.50:40750) 2023-11-28T11:56:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbeb7fe700 1 -- 172.21.15.50:0/777947944 learned_addr learned my addr 172.21.15.50:0/777947944 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:27.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbeb7fe700 1 -- 172.21.15.50:0/777947944 >> v2:172.21.15.192:3300/0 conn(0x7fcbf4158e60 msgr2=0x7fcbf40c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:27.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbeb7fe700 1 --2- 172.21.15.50:0/777947944 >> v2:172.21.15.192:3300/0 conn(0x7fcbf4158e60 0x7fcbf40c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbeb7fe700 1 -- 172.21.15.50:0/777947944 >> v1:172.21.15.192:6789/0 conn(0x7fcbf40cad50 legacy=0x7fcbf406c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbf37fe700 1 -- 172.21.15.50:0/777947944 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68554048 0 0) 0x7fcbf40cd8f0 con 0x7fcbf40cad50 2023-11-28T11:56:27.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbeb7fe700 1 -- 172.21.15.50:0/777947944 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf406dc60 con 0x7fcbf40ad490 2023-11-28T11:56:27.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbeb7fe700 1 --2- 172.21.15.50:0/777947944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf40ad490 0x7fcbf40cbfb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00bbe0 tx=0x7fcbdc00bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d24fcd73a136e61a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:27.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbf37fe700 1 -- 172.21.15.50:0/777947944 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc00dcf0 con 0x7fcbf40ad490 2023-11-28T11:56:27.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbf37fe700 1 -- 172.21.15.50:0/777947944 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc00de50 con 0x7fcbf40ad490 2023-11-28T11:56:27.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbf37fe700 1 -- 172.21.15.50:0/777947944 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc010690 con 0x7fcbf40ad490 2023-11-28T11:56:27.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbf90f5700 1 -- 172.21.15.50:0/777947944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf40ad490 msgr2=0x7fcbf40cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbf90f5700 1 --2- 172.21.15.50:0/777947944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf40ad490 0x7fcbf40cbfb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00bbe0 tx=0x7fcbdc00bef0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbf90f5700 1 -- 172.21.15.50:0/777947944 shutdown_connections 2023-11-28T11:56:27.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbf90f5700 1 --2- 172.21.15.50:0/777947944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf40ad490 0x7fcbf40cbfb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbf90f5700 1 --2- 172.21.15.50:0/777947944 >> v2:172.21.15.192:3300/0 conn(0x7fcbf4158e60 0x7fcbf40c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbf90f5700 1 -- 172.21.15.50:0/777947944 >> 172.21.15.50:0/777947944 conn(0x7fcbf40ce3e0 msgr2=0x7fcbf40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbf90f5700 1 -- 172.21.15.50:0/777947944 shutdown_connections 2023-11-28T11:56:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.937+0000 7fcbf90f5700 1 -- 172.21.15.50:0/777947944 wait complete. 2023-11-28T11:56:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf90f5700 1 Processor -- start 2023-11-28T11:56:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf90f5700 1 -- start start 2023-11-28T11:56:27.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf90f5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbf40ad490 0x7fcbf40c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:27.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf90f5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf40cad50 0x7fcbf40ab960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:27.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf90f5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbf4158e60 0x7fcbf41ec440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:27.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf90f5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf4071ee0 con 0x7fcbf40ad490 2023-11-28T11:56:27.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf90f5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf4071360 con 0x7fcbf4158e60 2023-11-28T11:56:27.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf90f5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf4071640 con 0x7fcbf40cad50 2023-11-28T11:56:27.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbf40ad490 0x7fcbf40c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:27.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbf40ad490 0x7fcbf40c5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44278/0 (socket says 172.21.15.50:44278) 2023-11-28T11:56:27.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf3fff700 1 -- 172.21.15.50:0/1310539920 learned_addr learned my addr 172.21.15.50:0/1310539920 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:27.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbeb7fe700 1 --2- 172.21.15.50:0/1310539920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf40cad50 0x7fcbf40ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:27.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf88f4700 1 --2- 172.21.15.50:0/1310539920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbf4158e60 0x7fcbf41ec440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:27.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf3fff700 1 -- 172.21.15.50:0/1310539920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf40cad50 msgr2=0x7fcbf40ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf3fff700 1 --2- 172.21.15.50:0/1310539920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf40cad50 0x7fcbf40ab960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf3fff700 1 -- 172.21.15.50:0/1310539920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbf4158e60 msgr2=0x7fcbf41ec440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:27.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf3fff700 1 --2- 172.21.15.50:0/1310539920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbf4158e60 0x7fcbf41ec440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:27.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf3fff700 1 -- 172.21.15.50:0/1310539920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc00b810 con 0x7fcbf40ad490 2023-11-28T11:56:27.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbeb7fe700 1 --2- 172.21.15.50:0/1310539920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf40cad50 0x7fcbf40ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:27.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf3fff700 1 --2- 172.21.15.50:0/1310539920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbf40ad490 0x7fcbf40c5ae0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400e840 tx=0x7fcbe400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:27.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf17fa700 1 -- 172.21.15.50:0/1310539920 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe40095a0 con 0x7fcbf40ad490 2023-11-28T11:56:27.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf17fa700 1 -- 172.21.15.50:0/1310539920 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe4013680 con 0x7fcbf40ad490 2023-11-28T11:56:27.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf90f5700 1 -- 172.21.15.50:0/1310539920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf4159230 con 0x7fcbf40ad490 2023-11-28T11:56:27.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf17fa700 1 -- 172.21.15.50:0/1310539920 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe40139f0 con 0x7fcbf40ad490 2023-11-28T11:56:27.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.941+0000 7fcbf90f5700 1 -- 172.21.15.50:0/1310539920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf40cde90 con 0x7fcbf40ad490 2023-11-28T11:56:27.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.945+0000 7fcbf90f5700 1 -- 172.21.15.50:0/1310539920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf406d6a0 con 0x7fcbf40ad490 2023-11-28T11:56:27.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.945+0000 7fcbf17fa700 1 -- 172.21.15.50:0/1310539920 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcbe4019030 con 0x7fcbf40ad490 2023-11-28T11:56:27.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.945+0000 7fcbf17fa700 1 --2- 172.21.15.50:0/1310539920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcbd4064ee0 0x7fcbd4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:27.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.945+0000 7fcbf17fa700 1 -- 172.21.15.50:0/1310539920 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcbe4081e70 con 0x7fcbf40ad490 2023-11-28T11:56:27.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.945+0000 7fcbeb7fe700 1 --2- 172.21.15.50:0/1310539920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcbd4064ee0 0x7fcbd4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:27.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.945+0000 7fcbeb7fe700 1 --2- 172.21.15.50:0/1310539920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcbd4064ee0 0x7fcbd4067390 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00bf30 tx=0x7fcbdc013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:27.953+0000 7fcbf17fa700 1 -- 172.21.15.50:0/1310539920 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcbe404fd60 con 0x7fcbf40ad490 2023-11-28T11:56:28.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.121+0000 7fcbf90f5700 1 -- 172.21.15.50:0/1310539920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbf4072500 con 0x7fcbf40ad490 2023-11-28T11:56:28.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.125+0000 7fcbf17fa700 1 -- 172.21.15.50:0/1310539920 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18026 (secure 0 0 0) 0x7fcbe4053380 con 0x7fcbf40ad490 2023-11-28T11:56:28.127 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:28.128 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":54,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:55:58.950592+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:55:55.575648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T11:55:56.934531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:28.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.125+0000 7fcbf90f5700 1 -- 172.21.15.50:0/1310539920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcbd4064ee0 msgr2=0x7fcbd4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:28.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.125+0000 7fcbf90f5700 1 --2- 172.21.15.50:0/1310539920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcbd4064ee0 0x7fcbd4067390 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00bf30 tx=0x7fcbdc013000 comp rx=0 tx=0).stop 2023-11-28T11:56:28.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.125+0000 7fcbf90f5700 1 -- 172.21.15.50:0/1310539920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbf40ad490 msgr2=0x7fcbf40c5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.125+0000 7fcbf90f5700 1 --2- 172.21.15.50:0/1310539920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbf40ad490 0x7fcbf40c5ae0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400e840 tx=0x7fcbe400eb50 comp rx=0 tx=0).stop 2023-11-28T11:56:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.125+0000 7fcbf90f5700 1 -- 172.21.15.50:0/1310539920 shutdown_connections 2023-11-28T11:56:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.125+0000 7fcbf90f5700 1 --2- 172.21.15.50:0/1310539920 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcbd4064ee0 0x7fcbd4067390 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.125+0000 7fcbf90f5700 1 --2- 172.21.15.50:0/1310539920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbf4158e60 0x7fcbf41ec440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.125+0000 7fcbf90f5700 1 --2- 172.21.15.50:0/1310539920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf40cad50 0x7fcbf40ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.125+0000 7fcbf90f5700 1 --2- 172.21.15.50:0/1310539920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbf40ad490 0x7fcbf40c5ae0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.125+0000 7fcbf90f5700 1 -- 172.21.15.50:0/1310539920 >> 172.21.15.50:0/1310539920 conn(0x7fcbf40ce3e0 msgr2=0x7fcbf40c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.125+0000 7fcbf90f5700 1 -- 172.21.15.50:0/1310539920 shutdown_connections 2023-11-28T11:56:28.131 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.125+0000 7fcbf90f5700 1 -- 172.21.15.50:0/1310539920 wait complete. 2023-11-28T11:56:28.143 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T11:56:28.143 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:56:28.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.257+0000 7fcbbd02f700 1 Processor -- start 2023-11-28T11:56:28.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.257+0000 7fcbbd02f700 1 -- start start 2023-11-28T11:56:28.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbbd02f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbb80706f0 0x7fcbb806ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbbd02f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcbb80b1cb0 0x7fcbb80b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbbd02f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb80b2dc0 con 0x7fcbb8158fd0 2023-11-28T11:56:28.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbbd02f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb806b070 con 0x7fcbb80b1cb0 2023-11-28T11:56:28.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbbd02f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb80b21b0 con 0x7fcbb80706f0 2023-11-28T11:56:28.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbb7fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbb80706f0 0x7fcbb806ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbaffff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fcbb8158fd0 0x7fcbb8070ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:43108/0 (socket says 172.21.15.50:43108) 2023-11-28T11:56:28.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbaffff700 1 -- 172.21.15.50:0/3526414964 learned_addr learned my addr 172.21.15.50:0/3526414964 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:28.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbbc82e700 1 --2- 172.21.15.50:0/3526414964 >> v2:172.21.15.192:3300/0 conn(0x7fcbb80b1cb0 0x7fcbb80b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbb7fff700 1 -- 172.21.15.50:0/3526414964 >> v2:172.21.15.192:3300/0 conn(0x7fcbb80b1cb0 msgr2=0x7fcbb80b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:28.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbb7fff700 1 --2- 172.21.15.50:0/3526414964 >> v2:172.21.15.192:3300/0 conn(0x7fcbb80b1cb0 0x7fcbb80b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbb7fff700 1 -- 172.21.15.50:0/3526414964 >> v1:172.21.15.192:6789/0 conn(0x7fcbb8158fd0 legacy=0x7fcbb8070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:28.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbb7fff700 1 -- 172.21.15.50:0/3526414964 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb80b2490 con 0x7fcbb80706f0 2023-11-28T11:56:28.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbb7fff700 1 --2- 172.21.15.50:0/3526414964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbb80706f0 0x7fcbb806ab30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcba8009850 tx=0x7fcba8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24df82b7888058aa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:28.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbb77fe700 1 -- 172.21.15.50:0/3526414964 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba800f8a0 con 0x7fcbb80706f0 2023-11-28T11:56:28.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbb77fe700 1 -- 172.21.15.50:0/3526414964 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba800fa00 con 0x7fcbb80706f0 2023-11-28T11:56:28.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbb77fe700 1 -- 172.21.15.50:0/3526414964 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba800fdb0 con 0x7fcbb80706f0 2023-11-28T11:56:28.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbbd02f700 1 -- 172.21.15.50:0/3526414964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbb80706f0 msgr2=0x7fcbb806ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:28.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbbd02f700 1 --2- 172.21.15.50:0/3526414964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbb80706f0 0x7fcbb806ab30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcba8009850 tx=0x7fcba8009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:28.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbbd02f700 1 -- 172.21.15.50:0/3526414964 shutdown_connections 2023-11-28T11:56:28.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbbd02f700 1 --2- 172.21.15.50:0/3526414964 >> v2:172.21.15.192:3300/0 conn(0x7fcbb80b1cb0 0x7fcbb80b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbbd02f700 1 --2- 172.21.15.50:0/3526414964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbb80706f0 0x7fcbb806ab30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbbd02f700 1 -- 172.21.15.50:0/3526414964 >> 172.21.15.50:0/3526414964 conn(0x7fcbb806e000 msgr2=0x7fcbb80b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:28.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbbd02f700 1 -- 172.21.15.50:0/3526414964 shutdown_connections 2023-11-28T11:56:28.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.261+0000 7fcbbd02f700 1 -- 172.21.15.50:0/3526414964 wait complete. 2023-11-28T11:56:28.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbbd02f700 1 Processor -- start 2023-11-28T11:56:28.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbbd02f700 1 -- start start 2023-11-28T11:56:28.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbbd02f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb80706f0 0x7fcbb815bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbbd02f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbb80b1cb0 0x7fcbb80b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbbd02f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbb8158fd0 0x7fcbb814d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbbd02f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb80b03d0 con 0x7fcbb80706f0 2023-11-28T11:56:28.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbbd02f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb80aff40 con 0x7fcbb8158fd0 2023-11-28T11:56:28.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbbd02f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb80af330 con 0x7fcbb80b1cb0 2023-11-28T11:56:28.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbb7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb80706f0 0x7fcbb815bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbb7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb80706f0 0x7fcbb815bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44284/0 (socket says 172.21.15.50:44284) 2023-11-28T11:56:28.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbb7fff700 1 -- 172.21.15.50:0/2097922612 learned_addr learned my addr 172.21.15.50:0/2097922612 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:28.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbbc82e700 1 --2- 172.21.15.50:0/2097922612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbb8158fd0 0x7fcbb814d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbaffff700 1 --2- 172.21.15.50:0/2097922612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbb80b1cb0 0x7fcbb80b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbb7fff700 1 -- 172.21.15.50:0/2097922612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbb80b1cb0 msgr2=0x7fcbb80b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:28.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbb7fff700 1 --2- 172.21.15.50:0/2097922612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbb80b1cb0 0x7fcbb80b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbb7fff700 1 -- 172.21.15.50:0/2097922612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbb8158fd0 msgr2=0x7fcbb814d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:28.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbb7fff700 1 --2- 172.21.15.50:0/2097922612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbb8158fd0 0x7fcbb814d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbb7fff700 1 -- 172.21.15.50:0/2097922612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba80094b0 con 0x7fcbb80706f0 2023-11-28T11:56:28.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.265+0000 7fcbbc82e700 1 --2- 172.21.15.50:0/2097922612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbb8158fd0 0x7fcbb814d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:28.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.269+0000 7fcbb7fff700 1 --2- 172.21.15.50:0/2097922612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb80706f0 0x7fcbb815bc10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fcba80090b0 tx=0x7fcba8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:28.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.269+0000 7fcbb57fa700 1 -- 172.21.15.50:0/2097922612 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba801e070 con 0x7fcbb80706f0 2023-11-28T11:56:28.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.269+0000 7fcbb57fa700 1 -- 172.21.15.50:0/2097922612 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba8004600 con 0x7fcbb80706f0 2023-11-28T11:56:28.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.269+0000 7fcbb57fa700 1 -- 172.21.15.50:0/2097922612 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba80038e0 con 0x7fcbb80706f0 2023-11-28T11:56:28.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.269+0000 7fcbbd02f700 1 -- 172.21.15.50:0/2097922612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb80b2a50 con 0x7fcbb80706f0 2023-11-28T11:56:28.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.269+0000 7fcbbd02f700 1 -- 172.21.15.50:0/2097922612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb80b2770 con 0x7fcbb80706f0 2023-11-28T11:56:28.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.269+0000 7fcbbd02f700 1 -- 172.21.15.50:0/2097922612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb8069ef0 con 0x7fcbb80706f0 2023-11-28T11:56:28.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.269+0000 7fcbb57fa700 1 -- 172.21.15.50:0/2097922612 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcba8003a40 con 0x7fcbb80706f0 2023-11-28T11:56:28.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.269+0000 7fcbb57fa700 1 --2- 172.21.15.50:0/2097922612 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcb98064ee0 0x7fcb98067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.269+0000 7fcbb57fa700 1 -- 172.21.15.50:0/2097922612 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcba8084dd0 con 0x7fcbb80706f0 2023-11-28T11:56:28.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.269+0000 7fcbaffff700 1 --2- 172.21.15.50:0/2097922612 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcb98064ee0 0x7fcb98067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.273+0000 7fcbaffff700 1 --2- 172.21.15.50:0/2097922612 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcb98064ee0 0x7fcb98067390 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcbb815a890 tx=0x7fcba0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.277+0000 7fcbb57fa700 1 -- 172.21.15.50:0/2097922612 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcba8052e30 con 0x7fcbb80706f0 2023-11-28T11:56:28.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.477+0000 7fcbbd02f700 1 -- 172.21.15.50:0/2097922612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbb8072c20 con 0x7fcbb80706f0 2023-11-28T11:56:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.481+0000 7fcbb57fa700 1 -- 172.21.15.50:0/2097922612 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fcba8056450 con 0x7fcbb80706f0 2023-11-28T11:56:28.483 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:28.483 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2341737190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2341737190},{"type":"v1","addr":"172.21.15.50:6835","nonce":2341737190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5546,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/192527628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":192527628},{"type":"v1","addr":"172.21.15.192:6835","nonce":192527628}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5549,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2304989740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2304989740},{"type":"v1","addr":"172.21.15.192:6837","nonce":2304989740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:55:57.946191+0000","modified":"2023-11-28T11:56:00.964614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6057":{"gid":6057,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/1163863991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1163863991},{"type":"v1","addr":"172.21.15.50:6834","nonce":1163863991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:56:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.481+0000 7fcbbd02f700 1 -- 172.21.15.50:0/2097922612 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcb98064ee0 msgr2=0x7fcb98067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.481+0000 7fcbbd02f700 1 --2- 172.21.15.50:0/2097922612 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcb98064ee0 0x7fcb98067390 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcbb815a890 tx=0x7fcba0009040 comp rx=0 tx=0).stop 2023-11-28T11:56:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.481+0000 7fcbbd02f700 1 -- 172.21.15.50:0/2097922612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb80706f0 msgr2=0x7fcbb815bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.481+0000 7fcbbd02f700 1 --2- 172.21.15.50:0/2097922612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb80706f0 0x7fcbb815bc10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fcba80090b0 tx=0x7fcba8004770 comp rx=0 tx=0).stop 2023-11-28T11:56:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.481+0000 7fcbbd02f700 1 -- 172.21.15.50:0/2097922612 shutdown_connections 2023-11-28T11:56:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.481+0000 7fcbbd02f700 1 --2- 172.21.15.50:0/2097922612 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcb98064ee0 0x7fcb98067390 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.481+0000 7fcbbd02f700 1 --2- 172.21.15.50:0/2097922612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbb8158fd0 0x7fcbb814d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.481+0000 7fcbbd02f700 1 --2- 172.21.15.50:0/2097922612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbb80b1cb0 0x7fcbb80b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.481+0000 7fcbbd02f700 1 --2- 172.21.15.50:0/2097922612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbb80706f0 0x7fcbb815bc10 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.481+0000 7fcbbd02f700 1 -- 172.21.15.50:0/2097922612 >> 172.21.15.50:0/2097922612 conn(0x7fcbb806e000 msgr2=0x7fcbb81522b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.481+0000 7fcbbd02f700 1 -- 172.21.15.50:0/2097922612 shutdown_connections 2023-11-28T11:56:28.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.481+0000 7fcbbd02f700 1 -- 172.21.15.50:0/2097922612 wait complete. 2023-11-28T11:56:28.489 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2023-11-28T11:56:28.498 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:56:28.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.609+0000 7fc5b8b1b700 1 Processor -- start 2023-11-28T11:56:28.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.609+0000 7fc5b8b1b700 1 -- start start 2023-11-28T11:56:28.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.609+0000 7fc5b8b1b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc5b4159e70 0x7fc5b406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.609+0000 7fc5b8b1b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b4069c40 0x7fc5b40cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.609+0000 7fc5b8b1b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc5b406cee0 0x7fc5b40cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.609+0000 7fc5b8b1b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b406ace0 con 0x7fc5b4159e70 2023-11-28T11:56:28.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.609+0000 7fc5b8b1b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b406a0d0 con 0x7fc5b406cee0 2023-11-28T11:56:28.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.609+0000 7fc5b8b1b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b406a3b0 con 0x7fc5b4069c40 2023-11-28T11:56:28.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc5b4159e70 0x7fc5b406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc5b4159e70 0x7fc5b406c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44294/0 (socket says 172.21.15.50:44294) 2023-11-28T11:56:28.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b2ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b4069c40 0x7fc5b40cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b37fe700 1 -- 172.21.15.50:0/1130991185 learned_addr learned my addr 172.21.15.50:0/1130991185 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:28.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b3fff700 1 --2- 172.21.15.50:0/1130991185 >> v2:172.21.15.192:3300/0 conn(0x7fc5b406cee0 0x7fc5b40cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b37fe700 1 -- 172.21.15.50:0/1130991185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b4069c40 msgr2=0x7fc5b40cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:28.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b37fe700 1 --2- 172.21.15.50:0/1130991185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b4069c40 0x7fc5b40cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b37fe700 1 -- 172.21.15.50:0/1130991185 >> v2:172.21.15.192:3300/0 conn(0x7fc5b406cee0 msgr2=0x7fc5b40cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:28.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b37fe700 1 --2- 172.21.15.50:0/1130991185 >> v2:172.21.15.192:3300/0 conn(0x7fc5b406cee0 0x7fc5b40cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b37fe700 1 -- 172.21.15.50:0/1130991185 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b406a690 con 0x7fc5b4159e70 2023-11-28T11:56:28.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b2ffd700 1 --2- 172.21.15.50:0/1130991185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b4069c40 0x7fc5b40cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:28.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b37fe700 1 --2- 172.21.15.50:0/1130991185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b4159e70 0x7fc5b406c9a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40b12c0 tx=0x7fc5a8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f118b0abd38edf29 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:28.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b27fc700 1 -- 172.21.15.50:0/1130991185 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8011830 con 0x7fc5b4159e70 2023-11-28T11:56:28.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b27fc700 1 -- 172.21.15.50:0/1130991185 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a8011990 con 0x7fc5b4159e70 2023-11-28T11:56:28.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b27fc700 1 -- 172.21.15.50:0/1130991185 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8011d20 con 0x7fc5b4159e70 2023-11-28T11:56:28.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b8b1b700 1 -- 172.21.15.50:0/1130991185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b4159e70 msgr2=0x7fc5b406c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b8b1b700 1 --2- 172.21.15.50:0/1130991185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b4159e70 0x7fc5b406c9a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40b12c0 tx=0x7fc5a8009bf0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b8b1b700 1 -- 172.21.15.50:0/1130991185 shutdown_connections 2023-11-28T11:56:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b8b1b700 1 --2- 172.21.15.50:0/1130991185 >> v2:172.21.15.192:3300/0 conn(0x7fc5b406cee0 0x7fc5b40cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b8b1b700 1 --2- 172.21.15.50:0/1130991185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b4069c40 0x7fc5b40cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b8b1b700 1 --2- 172.21.15.50:0/1130991185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b4159e70 0x7fc5b406c9a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b8b1b700 1 -- 172.21.15.50:0/1130991185 >> 172.21.15.50:0/1130991185 conn(0x7fc5b40ce3e0 msgr2=0x7fc5b40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b8b1b700 1 -- 172.21.15.50:0/1130991185 shutdown_connections 2023-11-28T11:56:28.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b8b1b700 1 -- 172.21.15.50:0/1130991185 wait complete. 2023-11-28T11:56:28.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.613+0000 7fc5b8b1b700 1 Processor -- start 2023-11-28T11:56:28.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b8b1b700 1 -- start start 2023-11-28T11:56:28.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b8b1b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b4069c40 0x7fc5b40cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b8b1b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b406cee0 0x7fc5b40cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b8b1b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b40c4510 0x7fc5b40cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b8b1b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b40adcf0 con 0x7fc5b406cee0 2023-11-28T11:56:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b8b1b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b4157be0 con 0x7fc5b4069c40 2023-11-28T11:56:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b8b1b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b40afbc0 con 0x7fc5b40c4510 2023-11-28T11:56:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b406cee0 0x7fc5b40cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b2ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b406cee0 0x7fc5b40cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44298/0 (socket says 172.21.15.50:44298) 2023-11-28T11:56:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b2ffd700 1 -- 172.21.15.50:0/2117552260 learned_addr learned my addr 172.21.15.50:0/2117552260 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b37fe700 1 --2- 172.21.15.50:0/2117552260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b4069c40 0x7fc5b40cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b3fff700 1 --2- 172.21.15.50:0/2117552260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b40c4510 0x7fc5b40cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b2ffd700 1 -- 172.21.15.50:0/2117552260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b40c4510 msgr2=0x7fc5b40cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b2ffd700 1 --2- 172.21.15.50:0/2117552260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b40c4510 0x7fc5b40cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b2ffd700 1 -- 172.21.15.50:0/2117552260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b4069c40 msgr2=0x7fc5b40cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b2ffd700 1 --2- 172.21.15.50:0/2117552260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b4069c40 0x7fc5b40cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b2ffd700 1 -- 172.21.15.50:0/2117552260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a4009a70 con 0x7fc5b406cee0 2023-11-28T11:56:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b37fe700 1 --2- 172.21.15.50:0/2117552260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b4069c40 0x7fc5b40cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b2ffd700 1 --2- 172.21.15.50:0/2117552260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b406cee0 0x7fc5b40cbfb0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400efc0 tx=0x7fc5a400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc59bfff700 1 -- 172.21.15.50:0/2117552260 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a400cdd0 con 0x7fc5b406cee0 2023-11-28T11:56:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b8b1b700 1 -- 172.21.15.50:0/2117552260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a8009570 con 0x7fc5b406cee0 2023-11-28T11:56:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc59bfff700 1 -- 172.21.15.50:0/2117552260 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a400f040 con 0x7fc5b406cee0 2023-11-28T11:56:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc5b8b1b700 1 -- 172.21.15.50:0/2117552260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b415a240 con 0x7fc5b406cee0 2023-11-28T11:56:28.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.617+0000 7fc59bfff700 1 -- 172.21.15.50:0/2117552260 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40146a0 con 0x7fc5b406cee0 2023-11-28T11:56:28.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.621+0000 7fc5b8b1b700 1 -- 172.21.15.50:0/2117552260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b406a970 con 0x7fc5b406cee0 2023-11-28T11:56:28.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.621+0000 7fc59bfff700 1 -- 172.21.15.50:0/2117552260 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc5a4014800 con 0x7fc5b406cee0 2023-11-28T11:56:28.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.621+0000 7fc59bfff700 1 --2- 172.21.15.50:0/2117552260 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc5a0064ee0 0x7fc5a0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.621+0000 7fc59bfff700 1 -- 172.21.15.50:0/2117552260 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc5a4082e10 con 0x7fc5b406cee0 2023-11-28T11:56:28.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.621+0000 7fc5b37fe700 1 --2- 172.21.15.50:0/2117552260 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc5a0064ee0 0x7fc5a0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.621+0000 7fc5b37fe700 1 --2- 172.21.15.50:0/2117552260 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc5a0064ee0 0x7fc5a0067390 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40ce270 tx=0x7fc5a8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:28.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.625+0000 7fc59bfff700 1 -- 172.21.15.50:0/2117552260 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc5a4050df0 con 0x7fc5b406cee0 2023-11-28T11:56:28.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.825+0000 7fc5b8b1b700 1 -- 172.21.15.50:0/2117552260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5b40b32e0 con 0x7fc5b406cee0 2023-11-28T11:56:28.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.825+0000 7fc59bfff700 1 -- 172.21.15.50:0/2117552260 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fc5a4054410 con 0x7fc5b406cee0 2023-11-28T11:56:28.829 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:28.829 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2341737190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2341737190},{"type":"v1","addr":"172.21.15.50:6835","nonce":2341737190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5546,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/192527628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":192527628},{"type":"v1","addr":"172.21.15.192:6835","nonce":192527628}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5549,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2304989740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2304989740},{"type":"v1","addr":"172.21.15.192:6837","nonce":2304989740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:55:57.946191+0000","modified":"2023-11-28T11:56:00.964614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6057":{"gid":6057,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6834/1163863991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":1163863991},{"type":"v1","addr":"172.21.15.50:6834","nonce":1163863991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T11:56:28.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.829+0000 7fc5b8b1b700 1 -- 172.21.15.50:0/2117552260 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc5a0064ee0 msgr2=0x7fc5a0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:28.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.829+0000 7fc5b8b1b700 1 --2- 172.21.15.50:0/2117552260 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc5a0064ee0 0x7fc5a0067390 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40ce270 tx=0x7fc5a8008030 comp rx=0 tx=0).stop 2023-11-28T11:56:28.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.829+0000 7fc5b8b1b700 1 -- 172.21.15.50:0/2117552260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b406cee0 msgr2=0x7fc5b40cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:28.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.829+0000 7fc5b8b1b700 1 --2- 172.21.15.50:0/2117552260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b406cee0 0x7fc5b40cbfb0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400efc0 tx=0x7fc5a400c3a0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.829+0000 7fc5b8b1b700 1 -- 172.21.15.50:0/2117552260 shutdown_connections 2023-11-28T11:56:28.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.829+0000 7fc5b8b1b700 1 --2- 172.21.15.50:0/2117552260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b40c4510 0x7fc5b40cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.829+0000 7fc5b8b1b700 1 --2- 172.21.15.50:0/2117552260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5b406cee0 0x7fc5b40cbfb0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.829+0000 7fc5b8b1b700 1 --2- 172.21.15.50:0/2117552260 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc5a0064ee0 0x7fc5a0067390 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.829+0000 7fc5b8b1b700 1 --2- 172.21.15.50:0/2117552260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b4069c40 0x7fc5b40cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.829+0000 7fc5b8b1b700 1 -- 172.21.15.50:0/2117552260 >> 172.21.15.50:0/2117552260 conn(0x7fc5b40ce3e0 msgr2=0x7fc5b40ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:28.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.829+0000 7fc5b8b1b700 1 -- 172.21.15.50:0/2117552260 shutdown_connections 2023-11-28T11:56:28.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.829+0000 7fc5b8b1b700 1 -- 172.21.15.50:0/2117552260 wait complete. 2023-11-28T11:56:28.835 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2023-11-28T11:56:28.844 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:28.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.949+0000 7f8d4bfff700 1 Processor -- start 2023-11-28T11:56:28.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.949+0000 7f8d4bfff700 1 -- start start 2023-11-28T11:56:28.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d4c0cf050 0x7f8d4c06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8d4c0b4c10 0x7f8d4c0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4bfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4c15c6d0 con 0x7f8d4c06a530 2023-11-28T11:56:28.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4bfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4c06a9a0 con 0x7f8d4c0b4c10 2023-11-28T11:56:28.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4bfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c06ac60 con 0x7f8d4c0cf050 2023-11-28T11:56:28.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8d4c0b4c10 0x7f8d4c0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4a7fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8d4c06a530 0x7f8d4c0cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40374/0 (socket says 172.21.15.50:40374) 2023-11-28T11:56:28.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4a7fc700 1 -- 172.21.15.50:0/97814406 learned_addr learned my addr 172.21.15.50:0/97814406 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:28.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4affd700 1 --2- 172.21.15.50:0/97814406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d4c0cf050 0x7f8d4c06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4b7fe700 1 -- 172.21.15.50:0/97814406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d4c0cf050 msgr2=0x7f8d4c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:28.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4b7fe700 1 --2- 172.21.15.50:0/97814406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d4c0cf050 0x7f8d4c06d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4b7fe700 1 -- 172.21.15.50:0/97814406 >> v1:172.21.15.50:6789/0 conn(0x7f8d4c06a530 legacy=0x7f8d4c0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:28.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d49ffb700 1 -- 172.21.15.50:0/97814406 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185044337 0 0) 0x7f8d4c15c6d0 con 0x7f8d4c06a530 2023-11-28T11:56:28.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4b7fe700 1 -- 172.21.15.50:0/97814406 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c06af40 con 0x7f8d4c0b4c10 2023-11-28T11:56:28.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4b7fe700 1 --2- 172.21.15.50:0/97814406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d4c0b4c10 0x7f8d4c0cce20 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009d90 tx=0x7f8d4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9380f2959f9bbbd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:28.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d49ffb700 1 -- 172.21.15.50:0/97814406 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4400e070 con 0x7f8d4c0b4c10 2023-11-28T11:56:28.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d49ffb700 1 -- 172.21.15.50:0/97814406 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4400bbd0 con 0x7f8d4c0b4c10 2023-11-28T11:56:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d49ffb700 1 -- 172.21.15.50:0/97814406 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44012430 con 0x7f8d4c0b4c10 2023-11-28T11:56:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4bfff700 1 -- 172.21.15.50:0/97814406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d4c0b4c10 msgr2=0x7f8d4c0cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4bfff700 1 --2- 172.21.15.50:0/97814406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d4c0b4c10 0x7f8d4c0cce20 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009d90 tx=0x7f8d4400b330 comp rx=0 tx=0).stop 2023-11-28T11:56:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4bfff700 1 -- 172.21.15.50:0/97814406 shutdown_connections 2023-11-28T11:56:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4bfff700 1 --2- 172.21.15.50:0/97814406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d4c0b4c10 0x7f8d4c0cce20 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4bfff700 1 --2- 172.21.15.50:0/97814406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d4c0cf050 0x7f8d4c06d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4bfff700 1 -- 172.21.15.50:0/97814406 >> 172.21.15.50:0/97814406 conn(0x7f8d4c09bb30 msgr2=0x7f8d4c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4bfff700 1 -- 172.21.15.50:0/97814406 shutdown_connections 2023-11-28T11:56:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.953+0000 7f8d4bfff700 1 -- 172.21.15.50:0/97814406 wait complete. 2023-11-28T11:56:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4bfff700 1 Processor -- start 2023-11-28T11:56:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4bfff700 1 -- start start 2023-11-28T11:56:28.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d4c06a530 0x7f8d4c14a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d4c0b4c10 0x7f8d4c1475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d4c0cf050 0x7f8d4c15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c15f770 con 0x7f8d4c0b4c10 2023-11-28T11:56:28.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4bfff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c15eb60 con 0x7f8d4c06a530 2023-11-28T11:56:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4bfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c15ee40 con 0x7f8d4c0cf050 2023-11-28T11:56:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d4c0b4c10 0x7f8d4c1475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d4c0b4c10 0x7f8d4c1475d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44322/0 (socket says 172.21.15.50:44322) 2023-11-28T11:56:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4a7fc700 1 -- 172.21.15.50:0/4161987826 learned_addr learned my addr 172.21.15.50:0/4161987826 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4affd700 1 --2- 172.21.15.50:0/4161987826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d4c06a530 0x7f8d4c14a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4b7fe700 1 --2- 172.21.15.50:0/4161987826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d4c0cf050 0x7f8d4c15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4a7fc700 1 -- 172.21.15.50:0/4161987826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d4c0cf050 msgr2=0x7f8d4c15aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4a7fc700 1 --2- 172.21.15.50:0/4161987826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d4c0cf050 0x7f8d4c15aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4a7fc700 1 -- 172.21.15.50:0/4161987826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d4c06a530 msgr2=0x7f8d4c14a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4a7fc700 1 --2- 172.21.15.50:0/4161987826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d4c06a530 0x7f8d4c14a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4a7fc700 1 -- 172.21.15.50:0/4161987826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d44009a70 con 0x7f8d4c0b4c10 2023-11-28T11:56:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4a7fc700 1 --2- 172.21.15.50:0/4161987826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d4c0b4c10 0x7f8d4c1475d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00c580 tx=0x7f8d3c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d337fe700 1 -- 172.21.15.50:0/4161987826 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c004ca0 con 0x7f8d4c0b4c10 2023-11-28T11:56:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d337fe700 1 -- 172.21.15.50:0/4161987826 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c004e20 con 0x7f8d4c0b4c10 2023-11-28T11:56:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4bfff700 1 -- 172.21.15.50:0/4161987826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4c0b46f0 con 0x7f8d4c0b4c10 2023-11-28T11:56:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d337fe700 1 -- 172.21.15.50:0/4161987826 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c007310 con 0x7f8d4c0b4c10 2023-11-28T11:56:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.957+0000 7f8d4bfff700 1 -- 172.21.15.50:0/4161987826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4c0b4410 con 0x7f8d4c0b4c10 2023-11-28T11:56:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.961+0000 7f8d4bfff700 1 -- 172.21.15.50:0/4161987826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4c06b220 con 0x7f8d4c0b4c10 2023-11-28T11:56:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.961+0000 7f8d337fe700 1 -- 172.21.15.50:0/4161987826 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8d3c01a020 con 0x7f8d4c0b4c10 2023-11-28T11:56:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.961+0000 7f8d337fe700 1 --2- 172.21.15.50:0/4161987826 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d38064ee0 0x7f8d38067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:28.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.961+0000 7f8d337fe700 1 -- 172.21.15.50:0/4161987826 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8d3c082330 con 0x7f8d4c0b4c10 2023-11-28T11:56:28.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.965+0000 7f8d4affd700 1 --2- 172.21.15.50:0/4161987826 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d38064ee0 0x7f8d38067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:28.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.965+0000 7f8d4affd700 1 --2- 172.21.15.50:0/4161987826 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d38064ee0 0x7f8d38067390 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000b9d0 tx=0x7f8d40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:28.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:28.965+0000 7f8d337fe700 1 -- 172.21.15.50:0/4161987826 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8d3c050320 con 0x7f8d4c0b4c10 2023-11-28T11:56:29.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.133+0000 7f8d4bfff700 1 -- 172.21.15.50:0/4161987826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d4c072500 con 0x7f8d4c0b4c10 2023-11-28T11:56:29.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.137+0000 7f8d337fe700 1 -- 172.21.15.50:0/4161987826 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18026 (secure 0 0 0) 0x7f8d3c053940 con 0x7f8d4c0b4c10 2023-11-28T11:56:29.139 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:29.139 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":54,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:55:58.950592+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:55:55.575648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T11:55:56.934531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:29.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.137+0000 7f8d4bfff700 1 -- 172.21.15.50:0/4161987826 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d38064ee0 msgr2=0x7f8d38067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:29.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.137+0000 7f8d4bfff700 1 --2- 172.21.15.50:0/4161987826 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d38064ee0 0x7f8d38067390 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000b9d0 tx=0x7f8d40008040 comp rx=0 tx=0).stop 2023-11-28T11:56:29.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.137+0000 7f8d4bfff700 1 -- 172.21.15.50:0/4161987826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d4c0b4c10 msgr2=0x7f8d4c1475d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:29.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.137+0000 7f8d4bfff700 1 --2- 172.21.15.50:0/4161987826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d4c0b4c10 0x7f8d4c1475d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00c580 tx=0x7f8d3c00c940 comp rx=0 tx=0).stop 2023-11-28T11:56:29.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.137+0000 7f8d4bfff700 1 -- 172.21.15.50:0/4161987826 shutdown_connections 2023-11-28T11:56:29.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.137+0000 7f8d4bfff700 1 --2- 172.21.15.50:0/4161987826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d4c0cf050 0x7f8d4c15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:29.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.137+0000 7f8d4bfff700 1 --2- 172.21.15.50:0/4161987826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d4c0b4c10 0x7f8d4c1475d0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:29.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.137+0000 7f8d4bfff700 1 --2- 172.21.15.50:0/4161987826 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d38064ee0 0x7f8d38067390 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:29.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.137+0000 7f8d4bfff700 1 --2- 172.21.15.50:0/4161987826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d4c06a530 0x7f8d4c14a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:29.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.137+0000 7f8d4bfff700 1 -- 172.21.15.50:0/4161987826 >> 172.21.15.50:0/4161987826 conn(0x7f8d4c09bb30 msgr2=0x7f8d4c15bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:29.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.137+0000 7f8d4bfff700 1 -- 172.21.15.50:0/4161987826 shutdown_connections 2023-11-28T11:56:29.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.137+0000 7f8d4bfff700 1 -- 172.21.15.50:0/4161987826 wait complete. 2023-11-28T11:56:29.155 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T11:56:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.265+0000 7f4946e7e700 1 Processor -- start 2023-11-28T11:56:29.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.265+0000 7f4946e7e700 1 -- start start 2023-11-28T11:56:29.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.265+0000 7f4946e7e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f494015d650 0x7f49400ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:29.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.265+0000 7f4946e7e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49400cc020 0x7f49400cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:29.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.265+0000 7f4946e7e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49400cc9b0 con 0x7f49401594f0 2023-11-28T11:56:29.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.265+0000 7f4946e7e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494015a040 con 0x7f49400cc020 2023-11-28T11:56:29.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.265+0000 7f4946e7e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49400cd720 con 0x7f494015d650 2023-11-28T11:56:29.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f494567b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49400cc020 0x7f49400cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:29.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f494667d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f49401594f0 0x7f4940159930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40386/0 (socket says 172.21.15.50:40386) 2023-11-28T11:56:29.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f494667d700 1 -- 172.21.15.50:0/912166337 learned_addr learned my addr 172.21.15.50:0/912166337 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:29.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f4945e7c700 1 --2- 172.21.15.50:0/912166337 >> v2:172.21.15.192:3300/0 conn(0x7f494015d650 0x7f49400ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:29.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f494567b700 1 -- 172.21.15.50:0/912166337 >> v2:172.21.15.192:3300/0 conn(0x7f494015d650 msgr2=0x7f49400ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:29.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f494567b700 1 --2- 172.21.15.50:0/912166337 >> v2:172.21.15.192:3300/0 conn(0x7f494015d650 0x7f49400ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:29.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f494567b700 1 -- 172.21.15.50:0/912166337 >> v1:172.21.15.50:6789/0 conn(0x7f49401594f0 legacy=0x7f4940159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:29.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f494567b700 1 -- 172.21.15.50:0/912166337 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49400cd990 con 0x7f49400cc020 2023-11-28T11:56:29.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f494567b700 1 --2- 172.21.15.50:0/912166337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49400cc020 0x7f49400cc470 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4940070d50 tx=0x7f493c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5e6eb9a3f80141 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:29.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f4944e7a700 1 -- 172.21.15.50:0/912166337 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c011830 con 0x7f49400cc020 2023-11-28T11:56:29.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f4944e7a700 1 -- 172.21.15.50:0/912166337 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c011990 con 0x7f49400cc020 2023-11-28T11:56:29.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f4944e7a700 1 -- 172.21.15.50:0/912166337 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c011d40 con 0x7f49400cc020 2023-11-28T11:56:29.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f4946e7e700 1 -- 172.21.15.50:0/912166337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49400cc020 msgr2=0x7f49400cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:29.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f4946e7e700 1 --2- 172.21.15.50:0/912166337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49400cc020 0x7f49400cc470 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4940070d50 tx=0x7f493c009b30 comp rx=0 tx=0).stop 2023-11-28T11:56:29.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f4946e7e700 1 -- 172.21.15.50:0/912166337 shutdown_connections 2023-11-28T11:56:29.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f4946e7e700 1 --2- 172.21.15.50:0/912166337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49400cc020 0x7f49400cc470 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:29.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f4946e7e700 1 --2- 172.21.15.50:0/912166337 >> v2:172.21.15.192:3300/0 conn(0x7f494015d650 0x7f49400ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:29.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f4946e7e700 1 -- 172.21.15.50:0/912166337 >> 172.21.15.50:0/912166337 conn(0x7f494006ec40 msgr2=0x7f49400b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:29.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f4946e7e700 1 -- 172.21.15.50:0/912166337 shutdown_connections 2023-11-28T11:56:29.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.269+0000 7f4946e7e700 1 -- 172.21.15.50:0/912166337 wait complete. 2023-11-28T11:56:29.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4946e7e700 1 Processor -- start 2023-11-28T11:56:29.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4946e7e700 1 -- start start 2023-11-28T11:56:29.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4946e7e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49400cc020 0x7f49400aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:29.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4946e7e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49401594f0 0x7f49400b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4946e7e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f494015d650 0x7f49400c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4946e7e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49400acfc0 con 0x7f49400cc020 2023-11-28T11:56:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4946e7e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49400b46b0 con 0x7f494015d650 2023-11-28T11:56:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4946e7e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49400b3aa0 con 0x7f49401594f0 2023-11-28T11:56:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4945e7c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49400cc020 0x7f49400aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4945e7c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49400cc020 0x7f49400aca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44328/0 (socket says 172.21.15.50:44328) 2023-11-28T11:56:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4945e7c700 1 -- 172.21.15.50:0/400122701 learned_addr learned my addr 172.21.15.50:0/400122701 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f494667d700 1 --2- 172.21.15.50:0/400122701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f494015d650 0x7f49400c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f494567b700 1 --2- 172.21.15.50:0/400122701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49401594f0 0x7f49400b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:29.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4945e7c700 1 -- 172.21.15.50:0/400122701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49401594f0 msgr2=0x7f49400b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:29.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4945e7c700 1 --2- 172.21.15.50:0/400122701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49401594f0 0x7f49400b4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:29.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4945e7c700 1 -- 172.21.15.50:0/400122701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f494015d650 msgr2=0x7f49400c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:29.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4945e7c700 1 --2- 172.21.15.50:0/400122701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f494015d650 0x7f49400c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:29.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4945e7c700 1 -- 172.21.15.50:0/400122701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c0094b0 con 0x7f49400cc020 2023-11-28T11:56:29.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f494567b700 1 --2- 172.21.15.50:0/400122701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49401594f0 0x7f49400b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:29.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4945e7c700 1 --2- 172.21.15.50:0/400122701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49400cc020 0x7f49400aca80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f493000e790 tx=0x7f493000eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:29.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f49367fc700 1 -- 172.21.15.50:0/400122701 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4930013610 con 0x7f49400cc020 2023-11-28T11:56:29.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f49367fc700 1 -- 172.21.15.50:0/400122701 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4930013770 con 0x7f49400cc020 2023-11-28T11:56:29.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4946e7e700 1 -- 172.21.15.50:0/400122701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49400cdf50 con 0x7f49400cc020 2023-11-28T11:56:29.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f49367fc700 1 -- 172.21.15.50:0/400122701 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4930013ae0 con 0x7f49400cc020 2023-11-28T11:56:29.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.273+0000 7f4946e7e700 1 -- 172.21.15.50:0/400122701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49400cdc70 con 0x7f49400cc020 2023-11-28T11:56:29.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.277+0000 7f4946e7e700 1 -- 172.21.15.50:0/400122701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494015a250 con 0x7f49400cc020 2023-11-28T11:56:29.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.277+0000 7f49367fc700 1 -- 172.21.15.50:0/400122701 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4930023070 con 0x7f49400cc020 2023-11-28T11:56:29.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.277+0000 7f49367fc700 1 --2- 172.21.15.50:0/400122701 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f492c064f10 0x7f492c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.277+0000 7f49367fc700 1 -- 172.21.15.50:0/400122701 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4930081cb0 con 0x7f49400cc020 2023-11-28T11:56:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.277+0000 7f494567b700 1 --2- 172.21.15.50:0/400122701 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f492c064f10 0x7f492c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:29.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.281+0000 7f494567b700 1 --2- 172.21.15.50:0/400122701 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f492c064f10 0x7f492c0673c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f493c0090b0 tx=0x7f493c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:29.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.285+0000 7f49367fc700 1 -- 172.21.15.50:0/400122701 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f493004fba0 con 0x7f49400cc020 2023-11-28T11:56:29.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.489+0000 7f4946e7e700 1 -- 172.21.15.50:0/400122701 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4940072c20 con 0x7f49400cc020 2023-11-28T11:56:29.857 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-11-28T11:56:29.853+0000 7f6bcfbc1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T11:56:29.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.873+0000 7f49367fc700 1 -- 172.21.15.50:0/400122701 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f49300531c0 con 0x7f49400cc020 2023-11-28T11:56:29.880 INFO:tasks.ceph.mds.a.smithi050.stderr: -3871> 2023-11-28T11:56:02.866+0000 7f432aa8b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:56:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.877+0000 7f4946e7e700 1 -- 172.21.15.50:0/400122701 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f492c064f10 msgr2=0x7f492c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.877+0000 7f4946e7e700 1 --2- 172.21.15.50:0/400122701 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f492c064f10 0x7f492c0673c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f493c0090b0 tx=0x7f493c008030 comp rx=0 tx=0).stop 2023-11-28T11:56:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.877+0000 7f4946e7e700 1 -- 172.21.15.50:0/400122701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49400cc020 msgr2=0x7f49400aca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.877+0000 7f4946e7e700 1 --2- 172.21.15.50:0/400122701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49400cc020 0x7f49400aca80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f493000e790 tx=0x7f493000eaa0 comp rx=0 tx=0).stop 2023-11-28T11:56:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.877+0000 7f4946e7e700 1 -- 172.21.15.50:0/400122701 shutdown_connections 2023-11-28T11:56:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.877+0000 7f4946e7e700 1 --2- 172.21.15.50:0/400122701 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f492c064f10 0x7f492c0673c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.877+0000 7f4946e7e700 1 --2- 172.21.15.50:0/400122701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f494015d650 0x7f49400c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.877+0000 7f4946e7e700 1 --2- 172.21.15.50:0/400122701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49401594f0 0x7f49400b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.877+0000 7f4946e7e700 1 --2- 172.21.15.50:0/400122701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49400cc020 0x7f49400aca80 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.877+0000 7f4946e7e700 1 -- 172.21.15.50:0/400122701 >> 172.21.15.50:0/400122701 conn(0x7f494006ec40 msgr2=0x7f494015a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.877+0000 7f4946e7e700 1 -- 172.21.15.50:0/400122701 shutdown_connections 2023-11-28T11:56:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:29.877+0000 7f4946e7e700 1 -- 172.21.15.50:0/400122701 wait complete. 2023-11-28T11:56:29.883 INFO:tasks.ceph.mds.a.smithi050.stderr: -2357> 2023-11-28T11:56:07.310+0000 7f4327284700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6225=0-4194304@1} caps={6225=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6225 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x56284e08fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T11:56:29.883 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T11:56:29.901 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T11:56:29.922 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-11-28T11:56:30.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fed4e8700 1 Processor -- start 2023-11-28T11:56:30.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fed4e8700 1 -- start start 2023-11-28T11:56:30.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fed4e8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8fe80d31b0 0x7f8fe80cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:30.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fed4e8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8fe80cf470 0x7f8fe80cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:30.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fed4e8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe806a7f0 con 0x7f8fe806ce60 2023-11-28T11:56:30.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fed4e8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe80d3650 con 0x7f8fe80cf470 2023-11-28T11:56:30.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fed4e8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe815c8b0 con 0x7f8fe80d31b0 2023-11-28T11:56:30.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fecce7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8fe80cf470 0x7f8fe80cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:30.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fecce7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8fe80cf470 0x7f8fe80cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44366/0 (socket says 172.21.15.50:44366) 2023-11-28T11:56:30.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fecce7700 1 -- 172.21.15.50:0/46201956 learned_addr learned my addr 172.21.15.50:0/46201956 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:30.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fe77fe700 1 --2- 172.21.15.50:0/46201956 >> v2:172.21.15.192:3300/0 conn(0x7f8fe80d31b0 0x7f8fe80cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:30.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fecce7700 1 -- 172.21.15.50:0/46201956 >> v2:172.21.15.192:3300/0 conn(0x7f8fe80d31b0 msgr2=0x7f8fe80cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:30.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fecce7700 1 --2- 172.21.15.50:0/46201956 >> v2:172.21.15.192:3300/0 conn(0x7f8fe80d31b0 0x7f8fe80cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:30.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fecce7700 1 -- 172.21.15.50:0/46201956 >> v1:172.21.15.192:6789/0 conn(0x7f8fe806ce60 legacy=0x7f8fe806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:30.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fecce7700 1 -- 172.21.15.50:0/46201956 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe806aad0 con 0x7f8fe80cf470 2023-11-28T11:56:30.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fecce7700 1 --2- 172.21.15.50:0/46201956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fe80cf470 0x7f8fe80cf8f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009e50 tx=0x7f8fe000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8083036eb0a2d8ce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:30.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fe6ffd700 1 -- 172.21.15.50:0/46201956 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe000e070 con 0x7f8fe80cf470 2023-11-28T11:56:30.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fe6ffd700 1 -- 172.21.15.50:0/46201956 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe000b980 con 0x7f8fe80cf470 2023-11-28T11:56:30.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fe6ffd700 1 -- 172.21.15.50:0/46201956 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe000bd30 con 0x7f8fe80cf470 2023-11-28T11:56:30.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fed4e8700 1 -- 172.21.15.50:0/46201956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fe80cf470 msgr2=0x7f8fe80cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:30.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fed4e8700 1 --2- 172.21.15.50:0/46201956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fe80cf470 0x7f8fe80cf8f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009e50 tx=0x7f8fe000b330 comp rx=0 tx=0).stop 2023-11-28T11:56:30.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fed4e8700 1 -- 172.21.15.50:0/46201956 shutdown_connections 2023-11-28T11:56:30.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fed4e8700 1 --2- 172.21.15.50:0/46201956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fe80cf470 0x7f8fe80cf8f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:30.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fed4e8700 1 --2- 172.21.15.50:0/46201956 >> v2:172.21.15.192:3300/0 conn(0x7f8fe80d31b0 0x7f8fe80cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:30.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fed4e8700 1 -- 172.21.15.50:0/46201956 >> 172.21.15.50:0/46201956 conn(0x7f8fe80b5760 msgr2=0x7f8fe80b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:30.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fed4e8700 1 -- 172.21.15.50:0/46201956 shutdown_connections 2023-11-28T11:56:30.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.025+0000 7f8fed4e8700 1 -- 172.21.15.50:0/46201956 wait complete. 2023-11-28T11:56:30.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fed4e8700 1 Processor -- start 2023-11-28T11:56:30.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fed4e8700 1 -- start start 2023-11-28T11:56:30.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fed4e8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fe806ce60 0x7f8fe80c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:30.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fed4e8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fe80cf470 0x7f8fe8159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:30.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fed4e8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fe80d31b0 0x7f8fe80b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:30.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fed4e8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe81f2300 con 0x7f8fe80cf470 2023-11-28T11:56:30.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fed4e8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe81f19f0 con 0x7f8fe80d31b0 2023-11-28T11:56:30.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fed4e8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe80c7260 con 0x7f8fe806ce60 2023-11-28T11:56:30.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fe77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fe80cf470 0x7f8fe8159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:30.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fe77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fe80cf470 0x7f8fe8159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44372/0 (socket says 172.21.15.50:44372) 2023-11-28T11:56:30.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fe77fe700 1 -- 172.21.15.50:0/678151319 learned_addr learned my addr 172.21.15.50:0/678151319 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:30.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fe7fff700 1 --2- 172.21.15.50:0/678151319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fe806ce60 0x7f8fe80c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:30.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fecce7700 1 --2- 172.21.15.50:0/678151319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fe80d31b0 0x7f8fe80b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:30.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fe77fe700 1 -- 172.21.15.50:0/678151319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fe806ce60 msgr2=0x7f8fe80c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:30.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fe77fe700 1 --2- 172.21.15.50:0/678151319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fe806ce60 0x7f8fe80c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:30.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fe77fe700 1 -- 172.21.15.50:0/678151319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fe80d31b0 msgr2=0x7f8fe80b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:30.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fe77fe700 1 --2- 172.21.15.50:0/678151319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fe80d31b0 0x7f8fe80b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:30.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fe77fe700 1 -- 172.21.15.50:0/678151319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe0009b30 con 0x7f8fe80cf470 2023-11-28T11:56:30.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fe77fe700 1 --2- 172.21.15.50:0/678151319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fe80cf470 0x7f8fe8159af0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00e760 tx=0x7f8fdc00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:30.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fe4ff9700 1 -- 172.21.15.50:0/678151319 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00c070 con 0x7f8fe80cf470 2023-11-28T11:56:30.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fe4ff9700 1 -- 172.21.15.50:0/678151319 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc013610 con 0x7f8fe80cf470 2023-11-28T11:56:30.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fe4ff9700 1 -- 172.21.15.50:0/678151319 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc013980 con 0x7f8fe80cf470 2023-11-28T11:56:30.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fed4e8700 1 -- 172.21.15.50:0/678151319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe806b090 con 0x7f8fe80cf470 2023-11-28T11:56:30.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.029+0000 7f8fed4e8700 1 -- 172.21.15.50:0/678151319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe806adb0 con 0x7f8fe80cf470 2023-11-28T11:56:30.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.033+0000 7f8fed4e8700 1 -- 172.21.15.50:0/678151319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe80b6470 con 0x7f8fe80cf470 2023-11-28T11:56:30.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.033+0000 7f8fe4ff9700 1 -- 172.21.15.50:0/678151319 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8fdc023070 con 0x7f8fe80cf470 2023-11-28T11:56:30.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.033+0000 7f8fe4ff9700 1 --2- 172.21.15.50:0/678151319 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8fd4064ee0 0x7f8fd4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:30.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.033+0000 7f8fe4ff9700 1 -- 172.21.15.50:0/678151319 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f8fdc081d30 con 0x7f8fe80cf470 2023-11-28T11:56:30.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.033+0000 7f8fe7fff700 1 --2- 172.21.15.50:0/678151319 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8fd4064ee0 0x7f8fd4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:30.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.037+0000 7f8fe7fff700 1 --2- 172.21.15.50:0/678151319 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8fd4064ee0 0x7f8fd4067390 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80b4620 tx=0x7f8fd8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:30.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.045+0000 7f8fe4ff9700 1 -- 172.21.15.50:0/678151319 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8fdc04fd30 con 0x7f8fe80cf470 2023-11-28T11:56:30.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.237+0000 7f8fed4e8700 1 -- 172.21.15.50:0/678151319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8fe8072c20 con 0x7f8fe80cf470 2023-11-28T11:56:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.877+0000 7f8fe4ff9700 1 -- 172.21.15.50:0/678151319 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8fdc00f040 con 0x7f8fe80cf470 2023-11-28T11:56:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.881+0000 7f8fed4e8700 1 -- 172.21.15.50:0/678151319 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8fd4064ee0 msgr2=0x7f8fd4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.881+0000 7f8fed4e8700 1 --2- 172.21.15.50:0/678151319 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8fd4064ee0 0x7f8fd4067390 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80b4620 tx=0x7f8fd8009040 comp rx=0 tx=0).stop 2023-11-28T11:56:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.881+0000 7f8fed4e8700 1 -- 172.21.15.50:0/678151319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fe80cf470 msgr2=0x7f8fe8159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.881+0000 7f8fed4e8700 1 --2- 172.21.15.50:0/678151319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fe80cf470 0x7f8fe8159af0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00e760 tx=0x7f8fdc00ea70 comp rx=0 tx=0).stop 2023-11-28T11:56:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.881+0000 7f8fed4e8700 1 -- 172.21.15.50:0/678151319 shutdown_connections 2023-11-28T11:56:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.881+0000 7f8fed4e8700 1 --2- 172.21.15.50:0/678151319 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8fd4064ee0 0x7f8fd4067390 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.881+0000 7f8fed4e8700 1 --2- 172.21.15.50:0/678151319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fe80d31b0 0x7f8fe80b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.881+0000 7f8fed4e8700 1 --2- 172.21.15.50:0/678151319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fe80cf470 0x7f8fe8159af0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.881+0000 7f8fed4e8700 1 --2- 172.21.15.50:0/678151319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fe806ce60 0x7f8fe80c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.881+0000 7f8fed4e8700 1 -- 172.21.15.50:0/678151319 >> 172.21.15.50:0/678151319 conn(0x7f8fe80b5760 msgr2=0x7f8fe815bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.881+0000 7f8fed4e8700 1 -- 172.21.15.50:0/678151319 shutdown_connections 2023-11-28T11:56:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:30.881+0000 7f8fed4e8700 1 -- 172.21.15.50:0/678151319 wait complete. 2023-11-28T11:56:30.902 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T11:56:31.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.025+0000 7f7aff010700 1 Processor -- start 2023-11-28T11:56:31.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.025+0000 7f7aff010700 1 -- start start 2023-11-28T11:56:31.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7aff010700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7af80ce750 0x7f7af806b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:31.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7aff010700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7af8070fc0 0x7f7af8071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:31.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7aff010700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af806e7e0 con 0x7f7af80cdaf0 2023-11-28T11:56:31.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7aff010700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af8071980 con 0x7f7af80ce750 2023-11-28T11:56:31.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7aff010700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af81593c0 con 0x7f7af8070fc0 2023-11-28T11:56:31.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7afe00e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7af80ce750 0x7f7af806b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:31.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7afe00e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7af80ce750 0x7f7af806b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44388/0 (socket says 172.21.15.50:44388) 2023-11-28T11:56:31.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7afd80d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7af80cdaf0 0x7f7af806ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40400/0 (socket says 172.21.15.50:40400) 2023-11-28T11:56:31.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7afe00e700 1 -- 172.21.15.50:0/4238823248 learned_addr learned my addr 172.21.15.50:0/4238823248 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:31.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7afe80f700 1 --2- 172.21.15.50:0/4238823248 >> v2:172.21.15.192:3300/0 conn(0x7f7af8070fc0 0x7f7af8071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:31.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7afe00e700 1 -- 172.21.15.50:0/4238823248 >> v2:172.21.15.192:3300/0 conn(0x7f7af8070fc0 msgr2=0x7f7af8071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:31.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7afe00e700 1 --2- 172.21.15.50:0/4238823248 >> v2:172.21.15.192:3300/0 conn(0x7f7af8070fc0 0x7f7af8071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:31.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7afe00e700 1 -- 172.21.15.50:0/4238823248 >> v1:172.21.15.50:6789/0 conn(0x7f7af80cdaf0 legacy=0x7f7af806ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:31.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7afe00e700 1 -- 172.21.15.50:0/4238823248 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af806bf30 con 0x7f7af80ce750 2023-11-28T11:56:31.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7afe80f700 1 --2- 172.21.15.50:0/4238823248 >> v2:172.21.15.192:3300/0 conn(0x7f7af8070fc0 0x7f7af8071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:31.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7afe00e700 1 --2- 172.21.15.50:0/4238823248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af80ce750 0x7f7af806b5e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7af806f880 tx=0x7f7af4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445fa4f8b5122610 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7afd00c700 1 -- 172.21.15.50:0/4238823248 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af400b8a0 con 0x7f7af80ce750 2023-11-28T11:56:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7afd00c700 1 -- 172.21.15.50:0/4238823248 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af400ba00 con 0x7f7af80ce750 2023-11-28T11:56:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.029+0000 7f7afd00c700 1 -- 172.21.15.50:0/4238823248 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af400bd90 con 0x7f7af80ce750 2023-11-28T11:56:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.033+0000 7f7aff010700 1 -- 172.21.15.50:0/4238823248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af80ce750 msgr2=0x7f7af806b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.033+0000 7f7aff010700 1 --2- 172.21.15.50:0/4238823248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af80ce750 0x7f7af806b5e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7af806f880 tx=0x7f7af4009bf0 comp rx=0 tx=0).stop 2023-11-28T11:56:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.033+0000 7f7aff010700 1 -- 172.21.15.50:0/4238823248 shutdown_connections 2023-11-28T11:56:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.033+0000 7f7aff010700 1 --2- 172.21.15.50:0/4238823248 >> v2:172.21.15.192:3300/0 conn(0x7f7af8070fc0 0x7f7af8071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.033+0000 7f7aff010700 1 --2- 172.21.15.50:0/4238823248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af80ce750 0x7f7af806b5e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.033+0000 7f7aff010700 1 -- 172.21.15.50:0/4238823248 >> 172.21.15.50:0/4238823248 conn(0x7f7af80cf5e0 msgr2=0x7f7af80cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.033+0000 7f7aff010700 1 -- 172.21.15.50:0/4238823248 shutdown_connections 2023-11-28T11:56:31.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.033+0000 7f7aff010700 1 -- 172.21.15.50:0/4238823248 wait complete. 2023-11-28T11:56:31.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.033+0000 7f7aff010700 1 Processor -- start 2023-11-28T11:56:31.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.033+0000 7f7aff010700 1 -- start start 2023-11-28T11:56:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7aff010700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8070fc0 0x7f7af81ee0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7aff010700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af80cdaf0 0x7f7af80b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7aff010700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7af80ce750 0x7f7af80b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7aff010700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af8159a00 con 0x7f7af8070fc0 2023-11-28T11:56:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7aff010700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af81ee5e0 con 0x7f7af80cdaf0 2023-11-28T11:56:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7aff010700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af815bbf0 con 0x7f7af80ce750 2023-11-28T11:56:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7afe00e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8070fc0 0x7f7af81ee0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7afe00e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8070fc0 0x7f7af81ee0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44390/0 (socket says 172.21.15.50:44390) 2023-11-28T11:56:31.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7afe00e700 1 -- 172.21.15.50:0/3648053754 learned_addr learned my addr 172.21.15.50:0/3648053754 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:31.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7afd80d700 1 --2- 172.21.15.50:0/3648053754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af80cdaf0 0x7f7af80b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:31.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7afe80f700 1 --2- 172.21.15.50:0/3648053754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7af80ce750 0x7f7af80b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:31.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7afe00e700 1 -- 172.21.15.50:0/3648053754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7af80ce750 msgr2=0x7f7af80b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:31.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7afe00e700 1 --2- 172.21.15.50:0/3648053754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7af80ce750 0x7f7af80b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:31.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7afe00e700 1 -- 172.21.15.50:0/3648053754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af80cdaf0 msgr2=0x7f7af80b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:31.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7afe00e700 1 --2- 172.21.15.50:0/3648053754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af80cdaf0 0x7f7af80b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:31.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7afe00e700 1 -- 172.21.15.50:0/3648053754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af4009570 con 0x7f7af8070fc0 2023-11-28T11:56:31.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7afe00e700 1 --2- 172.21.15.50:0/3648053754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8070fc0 0x7f7af81ee0a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f7af80d0620 tx=0x7f7af4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:31.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7aeeffd700 1 -- 172.21.15.50:0/3648053754 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af40038c0 con 0x7f7af8070fc0 2023-11-28T11:56:31.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7aeeffd700 1 -- 172.21.15.50:0/3648053754 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af401e070 con 0x7f7af8070fc0 2023-11-28T11:56:31.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7aff010700 1 -- 172.21.15.50:0/3648053754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af806c4f0 con 0x7f7af8070fc0 2023-11-28T11:56:31.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7aeeffd700 1 -- 172.21.15.50:0/3648053754 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4003c80 con 0x7f7af8070fc0 2023-11-28T11:56:31.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7aff010700 1 -- 172.21.15.50:0/3648053754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af806c210 con 0x7f7af8070fc0 2023-11-28T11:56:31.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.037+0000 7f7aff010700 1 -- 172.21.15.50:0/3648053754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af806e470 con 0x7f7af8070fc0 2023-11-28T11:56:31.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.041+0000 7f7aeeffd700 1 -- 172.21.15.50:0/3648053754 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7af400f050 con 0x7f7af8070fc0 2023-11-28T11:56:31.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.041+0000 7f7aeeffd700 1 --2- 172.21.15.50:0/3648053754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7adc064ee0 0x7f7adc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:31.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.041+0000 7f7aeeffd700 1 -- 172.21.15.50:0/3648053754 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f7af4020070 con 0x7f7af8070fc0 2023-11-28T11:56:31.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.041+0000 7f7afd80d700 1 --2- 172.21.15.50:0/3648053754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7adc064ee0 0x7f7adc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:31.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.041+0000 7f7afd80d700 1 --2- 172.21.15.50:0/3648053754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7adc064ee0 0x7f7adc067390 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7af80c4f10 tx=0x7f7ae8007d70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:31.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.049+0000 7f7aeeffd700 1 -- 172.21.15.50:0/3648053754 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7af4051850 con 0x7f7af8070fc0 2023-11-28T11:56:31.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.213+0000 7f7aff010700 1 -- 172.21.15.50:0/3648053754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7af80676e0 con 0x7f7af8070fc0 2023-11-28T11:56:31.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.889+0000 7f7aeeffd700 1 -- 172.21.15.50:0/3648053754 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7af4054e70 con 0x7f7af8070fc0 2023-11-28T11:56:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.893+0000 7f7aff010700 1 -- 172.21.15.50:0/3648053754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7adc064ee0 msgr2=0x7f7adc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.893+0000 7f7aff010700 1 --2- 172.21.15.50:0/3648053754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7adc064ee0 0x7f7adc067390 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7af80c4f10 tx=0x7f7ae8007d70 comp rx=0 tx=0).stop 2023-11-28T11:56:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.893+0000 7f7aff010700 1 -- 172.21.15.50:0/3648053754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8070fc0 msgr2=0x7f7af81ee0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:31.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.893+0000 7f7aff010700 1 --2- 172.21.15.50:0/3648053754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8070fc0 0x7f7af81ee0a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f7af80d0620 tx=0x7f7af4004770 comp rx=0 tx=0).stop 2023-11-28T11:56:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.897+0000 7f7aff010700 1 -- 172.21.15.50:0/3648053754 shutdown_connections 2023-11-28T11:56:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.897+0000 7f7aff010700 1 --2- 172.21.15.50:0/3648053754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7af80ce750 0x7f7af80b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.897+0000 7f7aff010700 1 --2- 172.21.15.50:0/3648053754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7adc064ee0 0x7f7adc067390 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.897+0000 7f7aff010700 1 --2- 172.21.15.50:0/3648053754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af80cdaf0 0x7f7af80b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.897+0000 7f7aff010700 1 --2- 172.21.15.50:0/3648053754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7af8070fc0 0x7f7af81ee0a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:31.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.897+0000 7f7aff010700 1 -- 172.21.15.50:0/3648053754 >> 172.21.15.50:0/3648053754 conn(0x7f7af80cf5e0 msgr2=0x7f7af806ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:31.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.897+0000 7f7aff010700 1 -- 172.21.15.50:0/3648053754 shutdown_connections 2023-11-28T11:56:31.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:31.897+0000 7f7aff010700 1 -- 172.21.15.50:0/3648053754 wait complete. 2023-11-28T11:56:31.900 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-11-28T11:56:31.914 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T11:56:32.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.033+0000 7ff949362700 1 Processor -- start 2023-11-28T11:56:32.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.033+0000 7ff949362700 1 -- start start 2023-11-28T11:56:32.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff949362700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9440afc40 0x7ff9440cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:32.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff949362700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94406cbb0 con 0x7ff944160500 2023-11-28T11:56:32.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff949362700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94406ce90 con 0x7ff94415c4a0 2023-11-28T11:56:32.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff949362700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440b00c0 con 0x7ff9440afc40 2023-11-28T11:56:32.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff93a7fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff944160500 0x7ff9440cef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56748/0 (socket says 172.21.15.50:56748) 2023-11-28T11:56:32.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff93a7fc700 1 -- 172.21.15.50:0/969420087 learned_addr learned my addr 172.21.15.50:0/969420087 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:32.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff9437fe700 1 --2- 172.21.15.50:0/969420087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9440afc40 0x7ff9440cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:32.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff9427fc700 1 -- 172.21.15.50:0/969420087 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772129751 0 0) 0x7ff94406cbb0 con 0x7ff944160500 2023-11-28T11:56:32.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff9427fc700 1 -- 172.21.15.50:0/969420087 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9300035d0 con 0x7ff944160500 2023-11-28T11:56:32.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff9427fc700 1 -- 172.21.15.50:0/969420087 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101305718 0 0) 0x7ff94406ce90 con 0x7ff94415c4a0 2023-11-28T11:56:32.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff9427fc700 1 -- 172.21.15.50:0/969420087 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff94406cbb0 con 0x7ff94415c4a0 2023-11-28T11:56:32.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff9427fc700 1 -- 172.21.15.50:0/969420087 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1829040219 0 0) 0x7ff9300035d0 con 0x7ff944160500 2023-11-28T11:56:32.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff9437fe700 1 -- 172.21.15.50:0/969420087 >> v1:172.21.15.192:6789/0 conn(0x7ff94415c4a0 legacy=0x7ff94415fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff9437fe700 1 -- 172.21.15.50:0/969420087 >> v1:172.21.15.50:6789/0 conn(0x7ff944160500 legacy=0x7ff9440cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff9437fe700 1 -- 172.21.15.50:0/969420087 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9440ce780 con 0x7ff9440afc40 2023-11-28T11:56:32.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff9437fe700 1 --2- 172.21.15.50:0/969420087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9440afc40 0x7ff9440cf690 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009dc0 tx=0x7ff93c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=638b657f9b3d43b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:32.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff9427fc700 1 -- 172.21.15.50:0/969420087 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c00e070 con 0x7ff9440afc40 2023-11-28T11:56:32.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff9427fc700 1 -- 172.21.15.50:0/969420087 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c003a90 con 0x7ff9440afc40 2023-11-28T11:56:32.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.037+0000 7ff9427fc700 1 -- 172.21.15.50:0/969420087 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c001670 con 0x7ff9440afc40 2023-11-28T11:56:32.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.041+0000 7ff949362700 1 -- 172.21.15.50:0/969420087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9440afc40 msgr2=0x7ff9440cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.041+0000 7ff949362700 1 --2- 172.21.15.50:0/969420087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9440afc40 0x7ff9440cf690 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009dc0 tx=0x7ff93c00b330 comp rx=0 tx=0).stop 2023-11-28T11:56:32.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.041+0000 7ff949362700 1 -- 172.21.15.50:0/969420087 shutdown_connections 2023-11-28T11:56:32.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.041+0000 7ff949362700 1 --2- 172.21.15.50:0/969420087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9440afc40 0x7ff9440cf690 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.041+0000 7ff949362700 1 -- 172.21.15.50:0/969420087 >> 172.21.15.50:0/969420087 conn(0x7ff9440cdef0 msgr2=0x7ff9440d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:32.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.041+0000 7ff949362700 1 -- 172.21.15.50:0/969420087 shutdown_connections 2023-11-28T11:56:32.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.041+0000 7ff949362700 1 -- 172.21.15.50:0/969420087 wait complete. 2023-11-28T11:56:32.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.041+0000 7ff949362700 1 Processor -- start 2023-11-28T11:56:32.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.041+0000 7ff949362700 1 -- start start 2023-11-28T11:56:32.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff949362700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9440afc40 0x7ff9440c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff949362700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff944160500 0x7ff9440b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff949362700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9440b19f0 0x7ff944154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff949362700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440b37f0 con 0x7ff944160500 2023-11-28T11:56:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff949362700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440b1060 con 0x7ff9440b19f0 2023-11-28T11:56:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff949362700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440b2020 con 0x7ff9440afc40 2023-11-28T11:56:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff93a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff944160500 0x7ff9440b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff93a7fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff944160500 0x7ff9440b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38102/0 (socket says 172.21.15.50:38102) 2023-11-28T11:56:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff93a7fc700 1 -- 172.21.15.50:0/1291706341 learned_addr learned my addr 172.21.15.50:0/1291706341 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff9437fe700 1 --2- 172.21.15.50:0/1291706341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9440b19f0 0x7ff944154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:32.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff942ffd700 1 --2- 172.21.15.50:0/1291706341 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9440afc40 0x7ff9440c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:32.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff93a7fc700 1 -- 172.21.15.50:0/1291706341 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9440afc40 msgr2=0x7ff9440c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff93a7fc700 1 --2- 172.21.15.50:0/1291706341 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9440afc40 0x7ff9440c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff93a7fc700 1 -- 172.21.15.50:0/1291706341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9440b19f0 msgr2=0x7ff944154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff93a7fc700 1 --2- 172.21.15.50:0/1291706341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9440b19f0 0x7ff944154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff93a7fc700 1 -- 172.21.15.50:0/1291706341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c009a70 con 0x7ff944160500 2023-11-28T11:56:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff9437fe700 1 --2- 172.21.15.50:0/1291706341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9440b19f0 0x7ff944154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff93a7fc700 1 --2- 172.21.15.50:0/1291706341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff944160500 0x7ff9440b14b0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0011e0 tx=0x7ff92c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff93bfff700 1 -- 172.21.15.50:0/1291706341 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c004ca0 con 0x7ff944160500 2023-11-28T11:56:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff93bfff700 1 -- 172.21.15.50:0/1291706341 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c004e00 con 0x7ff944160500 2023-11-28T11:56:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff949362700 1 -- 172.21.15.50:0/1291706341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94406d170 con 0x7ff944160500 2023-11-28T11:56:32.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff93bfff700 1 -- 172.21.15.50:0/1291706341 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c007310 con 0x7ff944160500 2023-11-28T11:56:32.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.045+0000 7ff949362700 1 -- 172.21.15.50:0/1291706341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9440cea60 con 0x7ff944160500 2023-11-28T11:56:32.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.049+0000 7ff93bfff700 1 -- 172.21.15.50:0/1291706341 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff92c01a020 con 0x7ff944160500 2023-11-28T11:56:32.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.049+0000 7ff949362700 1 -- 172.21.15.50:0/1291706341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff944160ae0 con 0x7ff944160500 2023-11-28T11:56:32.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.049+0000 7ff93bfff700 1 --2- 172.21.15.50:0/1291706341 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff924064ee0 0x7ff924067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:32.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.049+0000 7ff93bfff700 1 -- 172.21.15.50:0/1291706341 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6030+0+0 (secure 0 0 0) 0x7ff92c081970 con 0x7ff944160500 2023-11-28T11:56:32.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.049+0000 7ff942ffd700 1 --2- 172.21.15.50:0/1291706341 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff924064ee0 0x7ff924067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:32.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.053+0000 7ff942ffd700 1 --2- 172.21.15.50:0/1291706341 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff924064ee0 0x7ff924067390 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff9340011e0 tx=0x7ff934009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:32.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.057+0000 7ff93bfff700 1 -- 172.21.15.50:0/1291706341 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff92c04fb30 con 0x7ff944160500 2023-11-28T11:56:32.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.225+0000 7ff949362700 1 -- 172.21.15.50:0/1291706341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff9440b1df0 con 0x7ff944160500 2023-11-28T11:56:32.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.893+0000 7ff93bfff700 1 -- 172.21.15.50:0/1291706341 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff92c053150 con 0x7ff944160500 2023-11-28T11:56:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.897+0000 7ff949362700 1 -- 172.21.15.50:0/1291706341 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff924064ee0 msgr2=0x7ff924067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.897+0000 7ff949362700 1 --2- 172.21.15.50:0/1291706341 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff924064ee0 0x7ff924067390 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff9340011e0 tx=0x7ff934009040 comp rx=0 tx=0).stop 2023-11-28T11:56:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.897+0000 7ff949362700 1 -- 172.21.15.50:0/1291706341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff944160500 msgr2=0x7ff9440b14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.897+0000 7ff949362700 1 --2- 172.21.15.50:0/1291706341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff944160500 0x7ff9440b14b0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0011e0 tx=0x7ff92c00c9e0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.901+0000 7ff949362700 1 -- 172.21.15.50:0/1291706341 shutdown_connections 2023-11-28T11:56:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.901+0000 7ff949362700 1 --2- 172.21.15.50:0/1291706341 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff924064ee0 0x7ff924067390 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.901+0000 7ff949362700 1 --2- 172.21.15.50:0/1291706341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9440b19f0 0x7ff944154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.901+0000 7ff949362700 1 --2- 172.21.15.50:0/1291706341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff944160500 0x7ff9440b14b0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.901+0000 7ff949362700 1 --2- 172.21.15.50:0/1291706341 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9440afc40 0x7ff9440c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.901+0000 7ff949362700 1 -- 172.21.15.50:0/1291706341 >> 172.21.15.50:0/1291706341 conn(0x7ff9440cdef0 msgr2=0x7ff944156d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.901+0000 7ff949362700 1 -- 172.21.15.50:0/1291706341 shutdown_connections 2023-11-28T11:56:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:32.901+0000 7ff949362700 1 -- 172.21.15.50:0/1291706341 wait complete. 2023-11-28T11:56:32.905 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-11-28T11:56:32.920 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T11:56:33.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.033+0000 7fbc410ec700 1 Processor -- start 2023-11-28T11:56:33.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.033+0000 7fbc410ec700 1 -- start start 2023-11-28T11:56:33.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.033+0000 7fbc410ec700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbc3c0cf7f0 0x7fbc3c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:33.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.033+0000 7fbc410ec700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3c06a9c0 con 0x7fbc3c0b1ae0 2023-11-28T11:56:33.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.033+0000 7fbc410ec700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3c06aca0 con 0x7fbc3c06a4c0 2023-11-28T11:56:33.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.033+0000 7fbc410ec700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3c0d0ab0 con 0x7fbc3c0cf7f0 2023-11-28T11:56:33.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.033+0000 7fbc408eb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbc3c0cf7f0 0x7fbc3c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:33.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.033+0000 7fbc408eb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbc3c0cf7f0 0x7fbc3c06d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38110/0 (socket says 172.21.15.50:38110) 2023-11-28T11:56:33.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.033+0000 7fbc408eb700 1 -- 172.21.15.50:0/1173331618 learned_addr learned my addr 172.21.15.50:0/1173331618 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:33.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.033+0000 7fbc408eb700 1 -- 172.21.15.50:0/1173331618 >> v1:172.21.15.192:6789/0 conn(0x7fbc3c06a4c0 legacy=0x7fbc3c0cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.033+0000 7fbc408eb700 1 -- 172.21.15.50:0/1173331618 >> v1:172.21.15.50:6789/0 conn(0x7fbc3c0b1ae0 legacy=0x7fbc3c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.033+0000 7fbc408eb700 1 -- 172.21.15.50:0/1173331618 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c06af80 con 0x7fbc3c0cf7f0 2023-11-28T11:56:33.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.033+0000 7fbc3b7fe700 1 -- 172.21.15.50:0/1173331618 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743813328 0 0) 0x7fbc3c06a9c0 con 0x7fbc3c0b1ae0 2023-11-28T11:56:33.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.033+0000 7fbc408eb700 1 --2- 172.21.15.50:0/1173331618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc3c0cf7f0 0x7fbc3c06d8e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009e50 tx=0x7fbc3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9e3c4aa89a4c50 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:33.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.033+0000 7fbc3b7fe700 1 -- 172.21.15.50:0/1173331618 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400e070 con 0x7fbc3c0cf7f0 2023-11-28T11:56:33.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.033+0000 7fbc3b7fe700 1 -- 172.21.15.50:0/1173331618 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3400b9c0 con 0x7fbc3c0cf7f0 2023-11-28T11:56:33.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.033+0000 7fbc3b7fe700 1 -- 172.21.15.50:0/1173331618 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400bd70 con 0x7fbc3c0cf7f0 2023-11-28T11:56:33.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc410ec700 1 -- 172.21.15.50:0/1173331618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc3c0cf7f0 msgr2=0x7fbc3c06d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc410ec700 1 --2- 172.21.15.50:0/1173331618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc3c0cf7f0 0x7fbc3c06d8e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009e50 tx=0x7fbc3400b330 comp rx=0 tx=0).stop 2023-11-28T11:56:33.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc410ec700 1 -- 172.21.15.50:0/1173331618 shutdown_connections 2023-11-28T11:56:33.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc410ec700 1 --2- 172.21.15.50:0/1173331618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc3c0cf7f0 0x7fbc3c06d8e0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc410ec700 1 -- 172.21.15.50:0/1173331618 >> 172.21.15.50:0/1173331618 conn(0x7fbc3c09bbd0 msgr2=0x7fbc3c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:33.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc410ec700 1 -- 172.21.15.50:0/1173331618 shutdown_connections 2023-11-28T11:56:33.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc410ec700 1 -- 172.21.15.50:0/1173331618 wait complete. 2023-11-28T11:56:33.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc410ec700 1 Processor -- start 2023-11-28T11:56:33.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc410ec700 1 -- start start 2023-11-28T11:56:33.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc410ec700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc3c06a4c0 0x7fbc3c15c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:33.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc410ec700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc3c0b1ae0 0x7fbc3c158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:33.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc410ec700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc3c0cf7f0 0x7fbc3c15e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:33.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc410ec700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c15dba0 con 0x7fbc3c0b1ae0 2023-11-28T11:56:33.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc410ec700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c15cf20 con 0x7fbc3c06a4c0 2023-11-28T11:56:33.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc410ec700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c15d200 con 0x7fbc3c0cf7f0 2023-11-28T11:56:33.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc337fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc3c0b1ae0 0x7fbc3c158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:33.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc337fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc3c0b1ae0 0x7fbc3c158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38116/0 (socket says 172.21.15.50:38116) 2023-11-28T11:56:33.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc337fe700 1 -- 172.21.15.50:0/3612142953 learned_addr learned my addr 172.21.15.50:0/3612142953 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:33.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc3bfff700 1 --2- 172.21.15.50:0/3612142953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc3c06a4c0 0x7fbc3c15c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:33.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc408eb700 1 --2- 172.21.15.50:0/3612142953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc3c0cf7f0 0x7fbc3c15e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:33.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc337fe700 1 -- 172.21.15.50:0/3612142953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc3c0cf7f0 msgr2=0x7fbc3c15e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc337fe700 1 --2- 172.21.15.50:0/3612142953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc3c0cf7f0 0x7fbc3c15e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc337fe700 1 -- 172.21.15.50:0/3612142953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc3c06a4c0 msgr2=0x7fbc3c15c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc337fe700 1 --2- 172.21.15.50:0/3612142953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc3c06a4c0 0x7fbc3c15c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc337fe700 1 -- 172.21.15.50:0/3612142953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc34009b30 con 0x7fbc3c0b1ae0 2023-11-28T11:56:33.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc337fe700 1 --2- 172.21.15.50:0/3612142953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc3c0b1ae0 0x7fbc3c158f80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400c500 tx=0x7fbc2400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:33.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc397fa700 1 -- 172.21.15.50:0/3612142953 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc240052d0 con 0x7fbc3c0b1ae0 2023-11-28T11:56:33.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc397fa700 1 -- 172.21.15.50:0/3612142953 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc24005430 con 0x7fbc3c0b1ae0 2023-11-28T11:56:33.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc410ec700 1 -- 172.21.15.50:0/3612142953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3c0b1eb0 con 0x7fbc3c0b1ae0 2023-11-28T11:56:33.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc397fa700 1 -- 172.21.15.50:0/3612142953 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc240055a0 con 0x7fbc3c0b1ae0 2023-11-28T11:56:33.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.037+0000 7fbc410ec700 1 -- 172.21.15.50:0/3612142953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3c0b4380 con 0x7fbc3c0b1ae0 2023-11-28T11:56:33.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.041+0000 7fbc410ec700 1 -- 172.21.15.50:0/3612142953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3c0b60e0 con 0x7fbc3c0b1ae0 2023-11-28T11:56:33.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.041+0000 7fbc397fa700 1 -- 172.21.15.50:0/3612142953 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbc24019030 con 0x7fbc3c0b1ae0 2023-11-28T11:56:33.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.041+0000 7fbc397fa700 1 --2- 172.21.15.50:0/3612142953 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc1c064ee0 0x7fbc1c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:33.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.041+0000 7fbc397fa700 1 -- 172.21.15.50:0/3612142953 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fbc240810e0 con 0x7fbc3c0b1ae0 2023-11-28T11:56:33.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.041+0000 7fbc3bfff700 1 --2- 172.21.15.50:0/3612142953 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc1c064ee0 0x7fbc1c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:33.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.045+0000 7fbc3bfff700 1 --2- 172.21.15.50:0/3612142953 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc1c064ee0 0x7fbc1c067390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c000f60 tx=0x7fbc2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:33.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.049+0000 7fbc397fa700 1 -- 172.21.15.50:0/3612142953 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbc2404f370 con 0x7fbc3c0b1ae0 2023-11-28T11:56:33.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.213+0000 7fbc410ec700 1 -- 172.21.15.50:0/3612142953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbc3c15dce0 con 0x7fbc3c0b1ae0 2023-11-28T11:56:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.221+0000 7fbc397fa700 1 -- 172.21.15.50:0/3612142953 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbc3c15dce0 con 0x7fbc3c0b1ae0 2023-11-28T11:56:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.225+0000 7fbc410ec700 1 -- 172.21.15.50:0/3612142953 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc1c064ee0 msgr2=0x7fbc1c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.225+0000 7fbc410ec700 1 --2- 172.21.15.50:0/3612142953 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc1c064ee0 0x7fbc1c067390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c000f60 tx=0x7fbc2c009040 comp rx=0 tx=0).stop 2023-11-28T11:56:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.225+0000 7fbc410ec700 1 -- 172.21.15.50:0/3612142953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc3c0b1ae0 msgr2=0x7fbc3c158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.225+0000 7fbc410ec700 1 --2- 172.21.15.50:0/3612142953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc3c0b1ae0 0x7fbc3c158f80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400c500 tx=0x7fbc2400c8c0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.225+0000 7fbc410ec700 1 -- 172.21.15.50:0/3612142953 shutdown_connections 2023-11-28T11:56:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.225+0000 7fbc410ec700 1 --2- 172.21.15.50:0/3612142953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc3c0cf7f0 0x7fbc3c15e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.225+0000 7fbc410ec700 1 --2- 172.21.15.50:0/3612142953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc3c0b1ae0 0x7fbc3c158f80 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.225+0000 7fbc410ec700 1 --2- 172.21.15.50:0/3612142953 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc1c064ee0 0x7fbc1c067390 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.225+0000 7fbc410ec700 1 --2- 172.21.15.50:0/3612142953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc3c06a4c0 0x7fbc3c15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.225+0000 7fbc410ec700 1 -- 172.21.15.50:0/3612142953 >> 172.21.15.50:0/3612142953 conn(0x7fbc3c09bbd0 msgr2=0x7fbc3c15bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.225+0000 7fbc410ec700 1 -- 172.21.15.50:0/3612142953 shutdown_connections 2023-11-28T11:56:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.225+0000 7fbc410ec700 1 -- 172.21.15.50:0/3612142953 wait complete. 2023-11-28T11:56:33.243 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-11-28T11:56:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.357+0000 7fd27ffff700 1 Processor -- start 2023-11-28T11:56:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.357+0000 7fd27ffff700 1 -- start start 2023-11-28T11:56:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd2800cf050 0x7fd28006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd28006a530 0x7fd2800cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27ffff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28015c6d0 con 0x7fd2800b4c10 2023-11-28T11:56:33.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27ffff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28006a9d0 con 0x7fd2800cf050 2023-11-28T11:56:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27ffff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2800cf960 con 0x7fd28006a530 2023-11-28T11:56:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd2800cf050 0x7fd28006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd2800cf050 0x7fd28006d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38128/0 (socket says 172.21.15.50:38128) 2023-11-28T11:56:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27effd700 1 -- 172.21.15.50:0/892826184 learned_addr learned my addr 172.21.15.50:0/892826184 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd277fff700 1 --2- 172.21.15.50:0/892826184 >> v2:172.21.15.192:3300/0 conn(0x7fd28006a530 0x7fd2800cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27effd700 1 -- 172.21.15.50:0/892826184 >> v2:172.21.15.192:3300/0 conn(0x7fd28006a530 msgr2=0x7fd2800cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27effd700 1 --2- 172.21.15.50:0/892826184 >> v2:172.21.15.192:3300/0 conn(0x7fd28006a530 0x7fd2800cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27effd700 1 -- 172.21.15.50:0/892826184 >> v1:172.21.15.192:6789/0 conn(0x7fd2800b4c10 legacy=0x7fd2800cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27effd700 1 -- 172.21.15.50:0/892826184 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28006ac60 con 0x7fd2800cf050 2023-11-28T11:56:33.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27effd700 1 --2- 172.21.15.50:0/892826184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2800cf050 0x7fd28006d7d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd2800d38d0 tx=0x7fd270009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2fa1af23824f58 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:33.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27e7fc700 1 -- 172.21.15.50:0/892826184 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270011830 con 0x7fd2800cf050 2023-11-28T11:56:33.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27e7fc700 1 -- 172.21.15.50:0/892826184 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd270011990 con 0x7fd2800cf050 2023-11-28T11:56:33.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27e7fc700 1 -- 172.21.15.50:0/892826184 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270011d20 con 0x7fd2800cf050 2023-11-28T11:56:33.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27ffff700 1 -- 172.21.15.50:0/892826184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2800cf050 msgr2=0x7fd28006d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.361+0000 7fd27ffff700 1 --2- 172.21.15.50:0/892826184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2800cf050 0x7fd28006d7d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd2800d38d0 tx=0x7fd270009bf0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.365+0000 7fd27ffff700 1 -- 172.21.15.50:0/892826184 shutdown_connections 2023-11-28T11:56:33.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.365+0000 7fd27ffff700 1 --2- 172.21.15.50:0/892826184 >> v2:172.21.15.192:3300/0 conn(0x7fd28006a530 0x7fd2800cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.365+0000 7fd27ffff700 1 --2- 172.21.15.50:0/892826184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2800cf050 0x7fd28006d7d0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.365+0000 7fd27ffff700 1 -- 172.21.15.50:0/892826184 >> 172.21.15.50:0/892826184 conn(0x7fd28009bb30 msgr2=0x7fd2800b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:33.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.365+0000 7fd27ffff700 1 -- 172.21.15.50:0/892826184 shutdown_connections 2023-11-28T11:56:33.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.365+0000 7fd27ffff700 1 -- 172.21.15.50:0/892826184 wait complete. 2023-11-28T11:56:33.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.365+0000 7fd27ffff700 1 Processor -- start 2023-11-28T11:56:33.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.365+0000 7fd27ffff700 1 -- start start 2023-11-28T11:56:33.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd28006a530 0x7fd2801f1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:33.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2800b4c10 0x7fd280147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2800cf050 0x7fd2801494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27ffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd280147eb0 con 0x7fd2800cf050 2023-11-28T11:56:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27ffff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd280148190 con 0x7fd28006a530 2023-11-28T11:56:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27ffff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd280148470 con 0x7fd2800b4c10 2023-11-28T11:56:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2800cf050 0x7fd2801494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2800cf050 0x7fd2801494f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38134/0 (socket says 172.21.15.50:38134) 2023-11-28T11:56:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27f7fe700 1 -- 172.21.15.50:0/3966418438 learned_addr learned my addr 172.21.15.50:0/3966418438 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd277fff700 1 --2- 172.21.15.50:0/3966418438 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2800b4c10 0x7fd280147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27effd700 1 --2- 172.21.15.50:0/3966418438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd28006a530 0x7fd2801f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27f7fe700 1 -- 172.21.15.50:0/3966418438 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2800b4c10 msgr2=0x7fd280147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27f7fe700 1 --2- 172.21.15.50:0/3966418438 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2800b4c10 0x7fd280147460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27f7fe700 1 -- 172.21.15.50:0/3966418438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd28006a530 msgr2=0x7fd2801f1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27f7fe700 1 --2- 172.21.15.50:0/3966418438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd28006a530 0x7fd2801f1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27f7fe700 1 -- 172.21.15.50:0/3966418438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd270009570 con 0x7fd2800cf050 2023-11-28T11:56:33.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27f7fe700 1 --2- 172.21.15.50:0/3966418438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2800cf050 0x7fd2801494f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd27800cc50 tx=0x7fd27800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:33.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd2777fe700 1 -- 172.21.15.50:0/3966418438 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278003c20 con 0x7fd2800cf050 2023-11-28T11:56:33.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd2777fe700 1 -- 172.21.15.50:0/3966418438 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd278003d80 con 0x7fd2800cf050 2023-11-28T11:56:33.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27ffff700 1 -- 172.21.15.50:0/3966418438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2800b4410 con 0x7fd2800cf050 2023-11-28T11:56:33.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd2777fe700 1 -- 172.21.15.50:0/3966418438 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27800aab0 con 0x7fd2800cf050 2023-11-28T11:56:33.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27ffff700 1 -- 172.21.15.50:0/3966418438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28006af40 con 0x7fd2800cf050 2023-11-28T11:56:33.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.369+0000 7fd27ffff700 1 -- 172.21.15.50:0/3966418438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2800b46f0 con 0x7fd2800cf050 2023-11-28T11:56:33.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.373+0000 7fd2777fe700 1 -- 172.21.15.50:0/3966418438 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd278010050 con 0x7fd2800cf050 2023-11-28T11:56:33.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.373+0000 7fd2777fe700 1 --2- 172.21.15.50:0/3966418438 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd260064ee0 0x7fd260067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:33.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.373+0000 7fd2777fe700 1 -- 172.21.15.50:0/3966418438 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fd278081be0 con 0x7fd2800cf050 2023-11-28T11:56:33.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.373+0000 7fd27effd700 1 --2- 172.21.15.50:0/3966418438 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd260064ee0 0x7fd260067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:33.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.373+0000 7fd27effd700 1 --2- 172.21.15.50:0/3966418438 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd260064ee0 0x7fd260067390 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd270000c00 tx=0x7fd270008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:33.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.377+0000 7fd2777fe700 1 -- 172.21.15.50:0/3966418438 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd27804feb0 con 0x7fd2800cf050 2023-11-28T11:56:33.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.609+0000 7fd27ffff700 1 -- 172.21.15.50:0/3966418438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7fd280072500 con 0x7fd2800cf050 2023-11-28T11:56:33.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.913+0000 7fd2777fe700 1 -- 172.21.15.50:0/3966418438 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v169) v1 ==== 149+0+0 (secure 0 0 0) 0x7fd2780534d0 con 0x7fd2800cf050 2023-11-28T11:56:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.921+0000 7fd27ffff700 1 -- 172.21.15.50:0/3966418438 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd260064ee0 msgr2=0x7fd260067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.921+0000 7fd27ffff700 1 --2- 172.21.15.50:0/3966418438 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd260064ee0 0x7fd260067390 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd270000c00 tx=0x7fd270008030 comp rx=0 tx=0).stop 2023-11-28T11:56:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.921+0000 7fd27ffff700 1 -- 172.21.15.50:0/3966418438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2800cf050 msgr2=0x7fd2801494f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.921+0000 7fd27ffff700 1 --2- 172.21.15.50:0/3966418438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2800cf050 0x7fd2801494f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd27800cc50 tx=0x7fd27800cf60 comp rx=0 tx=0).stop 2023-11-28T11:56:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.921+0000 7fd27ffff700 1 -- 172.21.15.50:0/3966418438 shutdown_connections 2023-11-28T11:56:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.921+0000 7fd27ffff700 1 --2- 172.21.15.50:0/3966418438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2800cf050 0x7fd2801494f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.921+0000 7fd27ffff700 1 --2- 172.21.15.50:0/3966418438 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2800b4c10 0x7fd280147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.921+0000 7fd27ffff700 1 --2- 172.21.15.50:0/3966418438 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd260064ee0 0x7fd260067390 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.921+0000 7fd27ffff700 1 --2- 172.21.15.50:0/3966418438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd28006a530 0x7fd2801f1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.921+0000 7fd27ffff700 1 -- 172.21.15.50:0/3966418438 >> 172.21.15.50:0/3966418438 conn(0x7fd28009bb30 msgr2=0x7fd2800b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.921+0000 7fd27ffff700 1 -- 172.21.15.50:0/3966418438 shutdown_connections 2023-11-28T11:56:33.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:33.921+0000 7fd27ffff700 1 -- 172.21.15.50:0/3966418438 wait complete. 2023-11-28T11:56:33.941 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2023-11-28T11:56:33.941 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2023-11-28T11:56:33.941 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T11:56:33.941 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2023-11-28T11:56:34.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f3229fcd700 1 Processor -- start 2023-11-28T11:56:34.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f3229fcd700 1 -- start start 2023-11-28T11:56:34.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f3229fcd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f32241607b0 0x7f32240cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:34.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f3229fcd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32240cd000 0x7f32240cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:34.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f3229fcd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32240cc730 con 0x7f32240cc360 2023-11-28T11:56:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f3229fcd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32240d04c0 con 0x7f32240cd000 2023-11-28T11:56:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f3229fcd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32240cd9e0 con 0x7f32241607b0 2023-11-28T11:56:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f32297cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32240cd000 0x7f32240cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f32297cc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f32240cd000 0x7f32240cd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38150/0 (socket says 172.21.15.50:38150) 2023-11-28T11:56:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f32297cc700 1 -- 172.21.15.50:0/9708125 learned_addr learned my addr 172.21.15.50:0/9708125 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f3223fff700 1 --2- 172.21.15.50:0/9708125 >> v2:172.21.15.192:3300/0 conn(0x7f32241607b0 0x7f32240cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f32297cc700 1 -- 172.21.15.50:0/9708125 >> v2:172.21.15.192:3300/0 conn(0x7f32241607b0 msgr2=0x7f32240cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f32297cc700 1 --2- 172.21.15.50:0/9708125 >> v2:172.21.15.192:3300/0 conn(0x7f32241607b0 0x7f32240cfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f32297cc700 1 -- 172.21.15.50:0/9708125 >> v1:172.21.15.192:6789/0 conn(0x7f32240cc360 legacy=0x7f32240ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f32297cc700 1 -- 172.21.15.50:0/9708125 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32240b1f30 con 0x7f32240cd000 2023-11-28T11:56:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f3223fff700 1 --2- 172.21.15.50:0/9708125 >> v2:172.21.15.192:3300/0 conn(0x7f32241607b0 0x7f32240cfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:34.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f32297cc700 1 --2- 172.21.15.50:0/9708125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32240cd000 0x7f32240cd4a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3224067140 tx=0x7f321c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe54fd3e8260154 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:34.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f32237fe700 1 -- 172.21.15.50:0/9708125 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c00e070 con 0x7f32240cd000 2023-11-28T11:56:34.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f32237fe700 1 -- 172.21.15.50:0/9708125 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321c00b9c0 con 0x7f32240cd000 2023-11-28T11:56:34.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.061+0000 7f32237fe700 1 -- 172.21.15.50:0/9708125 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c00bd70 con 0x7f32240cd000 2023-11-28T11:56:34.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.065+0000 7f3229fcd700 1 -- 172.21.15.50:0/9708125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32240cd000 msgr2=0x7f32240cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:34.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.065+0000 7f3229fcd700 1 --2- 172.21.15.50:0/9708125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32240cd000 0x7f32240cd4a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3224067140 tx=0x7f321c00b330 comp rx=0 tx=0).stop 2023-11-28T11:56:34.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.065+0000 7f3229fcd700 1 -- 172.21.15.50:0/9708125 shutdown_connections 2023-11-28T11:56:34.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.065+0000 7f3229fcd700 1 --2- 172.21.15.50:0/9708125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32240cd000 0x7f32240cd4a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.065+0000 7f3229fcd700 1 --2- 172.21.15.50:0/9708125 >> v2:172.21.15.192:3300/0 conn(0x7f32241607b0 0x7f32240cfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.065+0000 7f3229fcd700 1 -- 172.21.15.50:0/9708125 >> 172.21.15.50:0/9708125 conn(0x7f32240b2140 msgr2=0x7f32240b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:34.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.065+0000 7f3229fcd700 1 -- 172.21.15.50:0/9708125 shutdown_connections 2023-11-28T11:56:34.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.065+0000 7f3229fcd700 1 -- 172.21.15.50:0/9708125 wait complete. 2023-11-28T11:56:34.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.065+0000 7f3229fcd700 1 Processor -- start 2023-11-28T11:56:34.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.065+0000 7f3229fcd700 1 -- start start 2023-11-28T11:56:34.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3229fcd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32240cc360 0x7f3224151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:34.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3229fcd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32240cd000 0x7f32240c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:34.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3229fcd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32241607b0 0x7f32240ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:34.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3229fcd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32240ca2b0 con 0x7f32240cd000 2023-11-28T11:56:34.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3229fcd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32240c9400 con 0x7f32241607b0 2023-11-28T11:56:34.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3229fcd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32240c96a0 con 0x7f32240cc360 2023-11-28T11:56:34.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3223fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32240cd000 0x7f32240c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:34.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3223fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32240cd000 0x7f32240c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38152/0 (socket says 172.21.15.50:38152) 2023-11-28T11:56:34.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3223fff700 1 -- 172.21.15.50:0/730273605 learned_addr learned my addr 172.21.15.50:0/730273605 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:34.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3228fcb700 1 --2- 172.21.15.50:0/730273605 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32240cc360 0x7f3224151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:34.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f32297cc700 1 --2- 172.21.15.50:0/730273605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32241607b0 0x7f32240ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:34.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3223fff700 1 -- 172.21.15.50:0/730273605 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32240cc360 msgr2=0x7f3224151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:34.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3223fff700 1 --2- 172.21.15.50:0/730273605 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32240cc360 0x7f3224151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3223fff700 1 -- 172.21.15.50:0/730273605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32241607b0 msgr2=0x7f32240ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:34.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3223fff700 1 --2- 172.21.15.50:0/730273605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32241607b0 0x7f32240ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3223fff700 1 -- 172.21.15.50:0/730273605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321c009b30 con 0x7f32240cd000 2023-11-28T11:56:34.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3223fff700 1 --2- 172.21.15.50:0/730273605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32240cd000 0x7f32240c6310 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f321400e810 tx=0x7f321400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:34.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f32217fa700 1 -- 172.21.15.50:0/730273605 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321400c070 con 0x7f32240cd000 2023-11-28T11:56:34.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f32217fa700 1 -- 172.21.15.50:0/730273605 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3214005c40 con 0x7f32240cd000 2023-11-28T11:56:34.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3229fcd700 1 -- 172.21.15.50:0/730273605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322415fcd0 con 0x7f32240cd000 2023-11-28T11:56:34.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f32217fa700 1 -- 172.21.15.50:0/730273605 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3214006030 con 0x7f32240cd000 2023-11-28T11:56:34.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3229fcd700 1 -- 172.21.15.50:0/730273605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32240d01e0 con 0x7f32240cd000 2023-11-28T11:56:34.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f3229fcd700 1 -- 172.21.15.50:0/730273605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322415ffb0 con 0x7f32240cd000 2023-11-28T11:56:34.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.069+0000 7f32217fa700 1 -- 172.21.15.50:0/730273605 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3214019020 con 0x7f32240cd000 2023-11-28T11:56:34.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.073+0000 7f32217fa700 1 --2- 172.21.15.50:0/730273605 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3210064f10 0x7f32100673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:34.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.073+0000 7f32217fa700 1 -- 172.21.15.50:0/730273605 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f3214081870 con 0x7f32240cd000 2023-11-28T11:56:34.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.073+0000 7f3228fcb700 1 --2- 172.21.15.50:0/730273605 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3210064f10 0x7f32100673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:34.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.073+0000 7f3228fcb700 1 --2- 172.21.15.50:0/730273605 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3210064f10 0x7f32100673c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3218000f60 tx=0x7f3218009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:34.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.085+0000 7f32217fa700 1 -- 172.21.15.50:0/730273605 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f321404fbd0 con 0x7f32240cd000 2023-11-28T11:56:34.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.309+0000 7f3229fcd700 1 -- 172.21.15.50:0/730273605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f3224072500 con 0x7f32240cd000 2023-11-28T11:56:34.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.917+0000 7f32217fa700 1 -- 172.21.15.50:0/730273605 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v170) v1 ==== 172+0+0 (secure 0 0 0) 0x7f32140531f0 con 0x7f32240cd000 2023-11-28T11:56:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.921+0000 7f3229fcd700 1 -- 172.21.15.50:0/730273605 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3210064f10 msgr2=0x7f32100673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.921+0000 7f3229fcd700 1 --2- 172.21.15.50:0/730273605 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3210064f10 0x7f32100673c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3218000f60 tx=0x7f3218009040 comp rx=0 tx=0).stop 2023-11-28T11:56:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.921+0000 7f3229fcd700 1 -- 172.21.15.50:0/730273605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32240cd000 msgr2=0x7f32240c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.921+0000 7f3229fcd700 1 --2- 172.21.15.50:0/730273605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32240cd000 0x7f32240c6310 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f321400e810 tx=0x7f321400eb20 comp rx=0 tx=0).stop 2023-11-28T11:56:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.921+0000 7f3229fcd700 1 -- 172.21.15.50:0/730273605 shutdown_connections 2023-11-28T11:56:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.921+0000 7f3229fcd700 1 --2- 172.21.15.50:0/730273605 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3210064f10 0x7f32100673c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.921+0000 7f3229fcd700 1 --2- 172.21.15.50:0/730273605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32241607b0 0x7f32240ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.921+0000 7f3229fcd700 1 --2- 172.21.15.50:0/730273605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32240cd000 0x7f32240c6310 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.921+0000 7f3229fcd700 1 --2- 172.21.15.50:0/730273605 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32240cc360 0x7f3224151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:34.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.921+0000 7f3229fcd700 1 -- 172.21.15.50:0/730273605 >> 172.21.15.50:0/730273605 conn(0x7f32240b2140 msgr2=0x7f32240b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:34.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.921+0000 7f3229fcd700 1 -- 172.21.15.50:0/730273605 shutdown_connections 2023-11-28T11:56:34.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:34.921+0000 7f3229fcd700 1 -- 172.21.15.50:0/730273605 wait complete. 2023-11-28T11:56:34.945 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T11:56:35.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.069+0000 7efe05fd6700 1 Processor -- start 2023-11-28T11:56:35.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.069+0000 7efe05fd6700 1 -- start start 2023-11-28T11:56:35.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.069+0000 7efe05fd6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efe000b1ae0 0x7efe0006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.069+0000 7efe05fd6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe000cf0e0 0x7efe000cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe05fd6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe000cfa80 con 0x7efe0006a4c0 2023-11-28T11:56:35.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe05fd6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe000d0ab0 con 0x7efe000b1ae0 2023-11-28T11:56:35.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe05fd6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0006a9c0 con 0x7efe000cf0e0 2023-11-28T11:56:35.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe04fd4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efe000b1ae0 0x7efe0006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe057d5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe000cf0e0 0x7efe000cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efdfffff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7efe0006a4c0 0x7efe000d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:41762/0 (socket says 172.21.15.50:41762) 2023-11-28T11:56:35.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efdfffff700 1 -- 172.21.15.50:0/3185921495 learned_addr learned my addr 172.21.15.50:0/3185921495 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:35.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe04fd4700 1 -- 172.21.15.50:0/3185921495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe000cf0e0 msgr2=0x7efe000cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:35.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe04fd4700 1 --2- 172.21.15.50:0/3185921495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe000cf0e0 0x7efe000cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe04fd4700 1 -- 172.21.15.50:0/3185921495 >> v1:172.21.15.192:6789/0 conn(0x7efe0006a4c0 legacy=0x7efe000d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe04fd4700 1 -- 172.21.15.50:0/3185921495 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0006aca0 con 0x7efe000b1ae0 2023-11-28T11:56:35.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe057d5700 1 --2- 172.21.15.50:0/3185921495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe000cf0e0 0x7efe000cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:35.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe04fd4700 1 --2- 172.21.15.50:0/3185921495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe000b1ae0 0x7efe0006d8e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efde8009850 tx=0x7efde8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=734f34ed5cfc93ad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efdff7fe700 1 -- 172.21.15.50:0/3185921495 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8011830 con 0x7efe000b1ae0 2023-11-28T11:56:35.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efdff7fe700 1 -- 172.21.15.50:0/3185921495 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde8011990 con 0x7efe000b1ae0 2023-11-28T11:56:35.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efdff7fe700 1 -- 172.21.15.50:0/3185921495 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8011d40 con 0x7efe000b1ae0 2023-11-28T11:56:35.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe05fd6700 1 -- 172.21.15.50:0/3185921495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe000b1ae0 msgr2=0x7efe0006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe05fd6700 1 --2- 172.21.15.50:0/3185921495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe000b1ae0 0x7efe0006d8e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efde8009850 tx=0x7efde8009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:35.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe05fd6700 1 -- 172.21.15.50:0/3185921495 shutdown_connections 2023-11-28T11:56:35.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe05fd6700 1 --2- 172.21.15.50:0/3185921495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe000cf0e0 0x7efe000cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe05fd6700 1 --2- 172.21.15.50:0/3185921495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe000b1ae0 0x7efe0006d8e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe05fd6700 1 -- 172.21.15.50:0/3185921495 >> 172.21.15.50:0/3185921495 conn(0x7efe0009bbd0 msgr2=0x7efe000b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:35.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe05fd6700 1 -- 172.21.15.50:0/3185921495 shutdown_connections 2023-11-28T11:56:35.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.073+0000 7efe05fd6700 1 -- 172.21.15.50:0/3185921495 wait complete. 2023-11-28T11:56:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe05fd6700 1 Processor -- start 2023-11-28T11:56:35.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe05fd6700 1 -- start start 2023-11-28T11:56:35.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe05fd6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe0006a4c0 0x7efe0015ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe05fd6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe000b1ae0 0x7efe00145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe05fd6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe000cf0e0 0x7efe0015d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe05fd6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe00146050 con 0x7efe0006a4c0 2023-11-28T11:56:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe05fd6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0015a9e0 con 0x7efe000b1ae0 2023-11-28T11:56:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe05fd6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe000c8b60 con 0x7efe000cf0e0 2023-11-28T11:56:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe04fd4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe0006a4c0 0x7efe0015ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe04fd4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe0006a4c0 0x7efe0015ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38156/0 (socket says 172.21.15.50:38156) 2023-11-28T11:56:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe04fd4700 1 -- 172.21.15.50:0/3019143826 learned_addr learned my addr 172.21.15.50:0/3019143826 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efdfffff700 1 --2- 172.21.15.50:0/3019143826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe000b1ae0 0x7efe00145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe057d5700 1 --2- 172.21.15.50:0/3019143826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe000cf0e0 0x7efe0015d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe04fd4700 1 -- 172.21.15.50:0/3019143826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe000cf0e0 msgr2=0x7efe0015d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe04fd4700 1 --2- 172.21.15.50:0/3019143826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe000cf0e0 0x7efe0015d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe04fd4700 1 -- 172.21.15.50:0/3019143826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe000b1ae0 msgr2=0x7efe00145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe04fd4700 1 --2- 172.21.15.50:0/3019143826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe000b1ae0 0x7efe00145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe04fd4700 1 -- 172.21.15.50:0/3019143826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf8009a70 con 0x7efe0006a4c0 2023-11-28T11:56:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efdfffff700 1 --2- 172.21.15.50:0/3019143826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe000b1ae0 0x7efe00145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.077+0000 7efe04fd4700 1 --2- 172.21.15.50:0/3019143826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe0006a4c0 0x7efe0015ac00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7efe00066b70 tx=0x7efde8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.081+0000 7efdfd7fa700 1 -- 172.21.15.50:0/3019143826 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8004470 con 0x7efe0006a4c0 2023-11-28T11:56:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.081+0000 7efe05fd6700 1 -- 172.21.15.50:0/3019143826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde80094b0 con 0x7efe0006a4c0 2023-11-28T11:56:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.081+0000 7efdfd7fa700 1 -- 172.21.15.50:0/3019143826 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde801f070 con 0x7efe0006a4c0 2023-11-28T11:56:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.081+0000 7efdfd7fa700 1 -- 172.21.15.50:0/3019143826 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8003900 con 0x7efe0006a4c0 2023-11-28T11:56:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.081+0000 7efe05fd6700 1 -- 172.21.15.50:0/3019143826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe000b4380 con 0x7efe0006a4c0 2023-11-28T11:56:35.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.081+0000 7efe05fd6700 1 -- 172.21.15.50:0/3019143826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0006af80 con 0x7efe0006a4c0 2023-11-28T11:56:35.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.081+0000 7efdfd7fa700 1 -- 172.21.15.50:0/3019143826 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efde802a020 con 0x7efe0006a4c0 2023-11-28T11:56:35.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.081+0000 7efdfd7fa700 1 --2- 172.21.15.50:0/3019143826 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efde0064ee0 0x7efde0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.081+0000 7efdfd7fa700 1 -- 172.21.15.50:0/3019143826 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7efde8083220 con 0x7efe0006a4c0 2023-11-28T11:56:35.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.085+0000 7efdfffff700 1 --2- 172.21.15.50:0/3019143826 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efde0064ee0 0x7efde0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.085+0000 7efdfffff700 1 --2- 172.21.15.50:0/3019143826 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efde0064ee0 0x7efde0067390 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7efdf0007fd0 tx=0x7efdf0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.093+0000 7efdfd7fa700 1 -- 172.21.15.50:0/3019143826 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efde8051500 con 0x7efe0006a4c0 2023-11-28T11:56:35.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.253+0000 7efe05fd6700 1 -- 172.21.15.50:0/3019143826 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7efe000b1eb0 con 0x7efe0006a4c0 2023-11-28T11:56:35.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.265+0000 7efdfd7fa700 1 -- 172.21.15.50:0/3019143826 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7efde8054b20 con 0x7efe0006a4c0 2023-11-28T11:56:35.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.265+0000 7efe05fd6700 1 -- 172.21.15.50:0/3019143826 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efde0064ee0 msgr2=0x7efde0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.265+0000 7efe05fd6700 1 --2- 172.21.15.50:0/3019143826 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efde0064ee0 0x7efde0067390 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7efdf0007fd0 tx=0x7efdf0009040 comp rx=0 tx=0).stop 2023-11-28T11:56:35.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.265+0000 7efe05fd6700 1 -- 172.21.15.50:0/3019143826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe0006a4c0 msgr2=0x7efe0015ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.265+0000 7efe05fd6700 1 --2- 172.21.15.50:0/3019143826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe0006a4c0 0x7efe0015ac00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7efe00066b70 tx=0x7efde8004770 comp rx=0 tx=0).stop 2023-11-28T11:56:35.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.265+0000 7efe05fd6700 1 -- 172.21.15.50:0/3019143826 shutdown_connections 2023-11-28T11:56:35.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.265+0000 7efe05fd6700 1 --2- 172.21.15.50:0/3019143826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe000cf0e0 0x7efe0015d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.265+0000 7efe05fd6700 1 --2- 172.21.15.50:0/3019143826 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efde0064ee0 0x7efde0067390 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.265+0000 7efe05fd6700 1 --2- 172.21.15.50:0/3019143826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe000b1ae0 0x7efe00145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.265+0000 7efe05fd6700 1 --2- 172.21.15.50:0/3019143826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe0006a4c0 0x7efe0015ac00 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.265+0000 7efe05fd6700 1 -- 172.21.15.50:0/3019143826 >> 172.21.15.50:0/3019143826 conn(0x7efe0009bbd0 msgr2=0x7efe000b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:35.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.269+0000 7efe05fd6700 1 -- 172.21.15.50:0/3019143826 shutdown_connections 2023-11-28T11:56:35.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.269+0000 7efe05fd6700 1 -- 172.21.15.50:0/3019143826 wait complete. 2023-11-28T11:56:35.286 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:56:35.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:56:35.305 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:56:35.326 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:56:35.326 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:56:35.326 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:56:35.354 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349436k,nr_inodes=4087359,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20953 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276116k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:56:35.354 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:56:35.354 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:56:35.361 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17871 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:56:35.361 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:56:35.361 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:56:35.367 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349436k,nr_inodes=4087359,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20953 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276116k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:56:35.367 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:56:35.367 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:56:35.374 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17871 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:56:35.374 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T11:56:35.374 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:56:35.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.529+0000 7fc88b4de700 1 Processor -- start 2023-11-28T11:56:35.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.529+0000 7fc88b4de700 1 -- start start 2023-11-28T11:56:35.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.529+0000 7fc88b4de700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc884158070 0x7fc88406c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.529+0000 7fc88b4de700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8840cadf0 0x7fc8840cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.529+0000 7fc88b4de700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc884158440 con 0x7fc8840ad510 2023-11-28T11:56:35.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.529+0000 7fc88b4de700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc88406b500 con 0x7fc884158070 2023-11-28T11:56:35.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.529+0000 7fc88b4de700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8840cb7b0 con 0x7fc8840cadf0 2023-11-28T11:56:35.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.529+0000 7fc88a4dc700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc884158070 0x7fc88406c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.529+0000 7fc889cdb700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc8840ad510 0x7fc88406adf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56762/0 (socket says 172.21.15.50:56762) 2023-11-28T11:56:35.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.529+0000 7fc889cdb700 1 -- 172.21.15.50:0/101551622 learned_addr learned my addr 172.21.15.50:0/101551622 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:35.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.533+0000 7fc88acdd700 1 --2- 172.21.15.50:0/101551622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8840cadf0 0x7fc8840cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.533+0000 7fc88a4dc700 1 -- 172.21.15.50:0/101551622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8840cadf0 msgr2=0x7fc8840cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:35.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.533+0000 7fc88a4dc700 1 --2- 172.21.15.50:0/101551622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8840cadf0 0x7fc8840cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.533+0000 7fc88a4dc700 1 -- 172.21.15.50:0/101551622 >> v1:172.21.15.50:6789/0 conn(0x7fc8840ad510 legacy=0x7fc88406adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.533+0000 7fc88a4dc700 1 -- 172.21.15.50:0/101551622 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88406a960 con 0x7fc884158070 2023-11-28T11:56:35.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.533+0000 7fc88a4dc700 1 --2- 172.21.15.50:0/101551622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc884158070 0x7fc88406c8d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc874009850 tx=0x7fc874009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d06ce46df886223 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.533+0000 7fc8894da700 1 -- 172.21.15.50:0/101551622 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87400f940 con 0x7fc884158070 2023-11-28T11:56:35.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.533+0000 7fc8894da700 1 -- 172.21.15.50:0/101551622 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87400faa0 con 0x7fc884158070 2023-11-28T11:56:35.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.533+0000 7fc8894da700 1 -- 172.21.15.50:0/101551622 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87400fe30 con 0x7fc884158070 2023-11-28T11:56:35.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.533+0000 7fc88b4de700 1 -- 172.21.15.50:0/101551622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc884158070 msgr2=0x7fc88406c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.533+0000 7fc88b4de700 1 --2- 172.21.15.50:0/101551622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc884158070 0x7fc88406c8d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc874009850 tx=0x7fc874009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:35.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.533+0000 7fc88b4de700 1 -- 172.21.15.50:0/101551622 shutdown_connections 2023-11-28T11:56:35.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.533+0000 7fc88b4de700 1 --2- 172.21.15.50:0/101551622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8840cadf0 0x7fc8840cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.533+0000 7fc88b4de700 1 --2- 172.21.15.50:0/101551622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc884158070 0x7fc88406c8d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.533+0000 7fc88b4de700 1 -- 172.21.15.50:0/101551622 >> 172.21.15.50:0/101551622 conn(0x7fc8840ce3e0 msgr2=0x7fc8840ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:35.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.533+0000 7fc88b4de700 1 -- 172.21.15.50:0/101551622 shutdown_connections 2023-11-28T11:56:35.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.533+0000 7fc88b4de700 1 -- 172.21.15.50:0/101551622 wait complete. 2023-11-28T11:56:35.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88b4de700 1 Processor -- start 2023-11-28T11:56:35.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88b4de700 1 -- start start 2023-11-28T11:56:35.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88b4de700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8840ad510 0x7fc884152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88b4de700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8840cadf0 0x7fc8840c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88b4de700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc884158070 0x7fc884154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88b4de700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8840c6830 con 0x7fc8840ad510 2023-11-28T11:56:35.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88b4de700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88415a690 con 0x7fc8840cadf0 2023-11-28T11:56:35.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88b4de700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8840c54b0 con 0x7fc884158070 2023-11-28T11:56:35.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88a4dc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8840ad510 0x7fc884152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88a4dc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8840ad510 0x7fc884152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38170/0 (socket says 172.21.15.50:38170) 2023-11-28T11:56:35.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88a4dc700 1 -- 172.21.15.50:0/2802751576 learned_addr learned my addr 172.21.15.50:0/2802751576 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:35.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc889cdb700 1 --2- 172.21.15.50:0/2802751576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8840cadf0 0x7fc8840c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88acdd700 1 --2- 172.21.15.50:0/2802751576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc884158070 0x7fc884154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88a4dc700 1 -- 172.21.15.50:0/2802751576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc884158070 msgr2=0x7fc884154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88a4dc700 1 --2- 172.21.15.50:0/2802751576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc884158070 0x7fc884154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88a4dc700 1 -- 172.21.15.50:0/2802751576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8840cadf0 msgr2=0x7fc8840c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88a4dc700 1 --2- 172.21.15.50:0/2802751576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8840cadf0 0x7fc8840c7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88a4dc700 1 -- 172.21.15.50:0/2802751576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8740094b0 con 0x7fc8840ad510 2023-11-28T11:56:35.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88a4dc700 1 --2- 172.21.15.50:0/2802751576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8840ad510 0x7fc884152480 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc874009fd0 tx=0x7fc874004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc87affd700 1 -- 172.21.15.50:0/2802751576 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8740036c0 con 0x7fc8840ad510 2023-11-28T11:56:35.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc87affd700 1 -- 172.21.15.50:0/2802751576 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc874003820 con 0x7fc8840ad510 2023-11-28T11:56:35.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc87affd700 1 -- 172.21.15.50:0/2802751576 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc874003bb0 con 0x7fc8840ad510 2023-11-28T11:56:35.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88b4de700 1 -- 172.21.15.50:0/2802751576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88406d190 con 0x7fc8840ad510 2023-11-28T11:56:35.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.537+0000 7fc88b4de700 1 -- 172.21.15.50:0/2802751576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88406ceb0 con 0x7fc8840ad510 2023-11-28T11:56:35.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.541+0000 7fc88b4de700 1 -- 172.21.15.50:0/2802751576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc88406d470 con 0x7fc8840ad510 2023-11-28T11:56:35.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.541+0000 7fc87affd700 1 -- 172.21.15.50:0/2802751576 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc87400e040 con 0x7fc8840ad510 2023-11-28T11:56:35.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.541+0000 7fc87affd700 1 --2- 172.21.15.50:0/2802751576 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc868064f10 0x7fc8680673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.541+0000 7fc87affd700 1 -- 172.21.15.50:0/2802751576 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fc874013070 con 0x7fc8840ad510 2023-11-28T11:56:35.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.541+0000 7fc889cdb700 1 --2- 172.21.15.50:0/2802751576 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc868064f10 0x7fc8680673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.545+0000 7fc889cdb700 1 --2- 172.21.15.50:0/2802751576 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc868064f10 0x7fc8680673c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc8841559b0 tx=0x7fc880009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.549+0000 7fc87affd700 1 -- 172.21.15.50:0/2802751576 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc8740551c0 con 0x7fc8840ad510 2023-11-28T11:56:35.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.757+0000 7fc88b4de700 1 -- 172.21.15.50:0/2802751576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc88406cc60 con 0x7fc8840ad510 2023-11-28T11:56:35.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.757+0000 7fc87affd700 1 -- 172.21.15.50:0/2802751576 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fc8740587e0 con 0x7fc8840ad510 2023-11-28T11:56:35.763 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:35.763 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2341737190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2341737190},{"type":"v1","addr":"172.21.15.50:6835","nonce":2341737190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5546,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/192527628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":192527628},{"type":"v1","addr":"172.21.15.192:6835","nonce":192527628}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5549,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2304989740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2304989740},{"type":"v1","addr":"172.21.15.192:6837","nonce":2304989740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6426,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2703430219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":2703430219},{"type":"v1","addr":"172.21.15.50:6834","nonce":2703430219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[]} 2023-11-28T11:56:35.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.761+0000 7fc88b4de700 1 -- 172.21.15.50:0/2802751576 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc868064f10 msgr2=0x7fc8680673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.761+0000 7fc88b4de700 1 --2- 172.21.15.50:0/2802751576 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc868064f10 0x7fc8680673c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc8841559b0 tx=0x7fc880009040 comp rx=0 tx=0).stop 2023-11-28T11:56:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.761+0000 7fc88b4de700 1 -- 172.21.15.50:0/2802751576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8840ad510 msgr2=0x7fc884152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.761+0000 7fc88b4de700 1 --2- 172.21.15.50:0/2802751576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8840ad510 0x7fc884152480 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc874009fd0 tx=0x7fc874004770 comp rx=0 tx=0).stop 2023-11-28T11:56:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.761+0000 7fc88b4de700 1 -- 172.21.15.50:0/2802751576 shutdown_connections 2023-11-28T11:56:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.761+0000 7fc88b4de700 1 --2- 172.21.15.50:0/2802751576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc884158070 0x7fc884154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.761+0000 7fc88b4de700 1 --2- 172.21.15.50:0/2802751576 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc868064f10 0x7fc8680673c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.761+0000 7fc88b4de700 1 --2- 172.21.15.50:0/2802751576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8840cadf0 0x7fc8840c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.761+0000 7fc88b4de700 1 --2- 172.21.15.50:0/2802751576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8840ad510 0x7fc884152480 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.761+0000 7fc88b4de700 1 -- 172.21.15.50:0/2802751576 >> 172.21.15.50:0/2802751576 conn(0x7fc8840ce3e0 msgr2=0x7fc88406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.761+0000 7fc88b4de700 1 -- 172.21.15.50:0/2802751576 shutdown_connections 2023-11-28T11:56:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.761+0000 7fc88b4de700 1 -- 172.21.15.50:0/2802751576 wait complete. 2023-11-28T11:56:35.767 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 27 2023-11-28T11:56:35.778 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T11:56:35.779 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T11:56:35.779 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T11:56:35.779 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:56:35.779 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T11:56:35.779 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T11:56:35.779 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T11:56:35.780 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:56:35.780 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T11:56:35.780 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T11:56:35.780 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T11:56:35.780 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:56:35.780 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T11:56:35.780 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T11:56:35.781 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T11:56:35.781 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T11:56:35.791 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T11:56:35.791 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T11:56:35.793 INFO:tasks.ceph.mds.c:Started 2023-11-28T11:56:35.794 DEBUG:teuthology.parallel:result is None 2023-11-28T11:56:35.794 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T11:56:35.794 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T11:56:35.797 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T11:56:35.798 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T11:56:35.799 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T11:56:35.799 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T11:56:35.800 INFO:tasks.ceph.mds.b:Started 2023-11-28T11:56:35.800 DEBUG:teuthology.parallel:result is None 2023-11-28T11:56:35.801 INFO:tasks.ceph.mds.d:Started 2023-11-28T11:56:35.801 DEBUG:teuthology.parallel:result is None 2023-11-28T11:56:35.836 INFO:tasks.ceph.mds.a:Started 2023-11-28T11:56:35.836 DEBUG:teuthology.parallel:result is None 2023-11-28T11:56:35.837 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T11:56:35.876 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-11-28T11:56:35.877 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-11-28T11:56:35.878 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-11-28T11:56:35.909 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-11-28T11:56:35.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff541cc9700 1 Processor -- start 2023-11-28T11:56:35.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff541cc9700 1 -- start start 2023-11-28T11:56:35.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff541cc9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff53c070e00 0x7ff53c159720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff541cc9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff53c13c600 0x7ff53c159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff541cc9700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53c0b1cb0 con 0x7ff53c15d460 2023-11-28T11:56:35.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff541cc9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53c0b2830 con 0x7ff53c070e00 2023-11-28T11:56:35.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff541cc9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b1f00 con 0x7ff53c13c600 2023-11-28T11:56:35.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff540cc7700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff53c15d460 0x7ff53c0706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56788/0 (socket says 172.21.15.50:56788) 2023-11-28T11:56:35.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff540cc7700 1 -- 172.21.15.50:0/1207953098 learned_addr learned my addr 172.21.15.50:0/1207953098 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:35.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 -- 172.21.15.50:0/1207953098 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1092954286 0 0) 0x7ff53c0b1cb0 con 0x7ff53c15d460 2023-11-28T11:56:35.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff5414c8700 1 --2- 172.21.15.50:0/1207953098 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff53c13c600 0x7ff53c159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53bfff700 1 --2- 172.21.15.50:0/1207953098 >> v2:172.21.15.192:3300/0 conn(0x7ff53c070e00 0x7ff53c159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 -- 172.21.15.50:0/1207953098 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff52c0057e0 con 0x7ff53c15d460 2023-11-28T11:56:35.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 -- 172.21.15.50:0/1207953098 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4103550477 0 0) 0x7ff52c0057e0 con 0x7ff53c15d460 2023-11-28T11:56:35.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 -- 172.21.15.50:0/1207953098 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff53c13c600 msgr2=0x7ff53c159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:35.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 --2- 172.21.15.50:0/1207953098 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff53c13c600 0x7ff53c159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 -- 172.21.15.50:0/1207953098 >> v2:172.21.15.192:3300/0 conn(0x7ff53c070e00 msgr2=0x7ff53c159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:35.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 --2- 172.21.15.50:0/1207953098 >> v2:172.21.15.192:3300/0 conn(0x7ff53c070e00 0x7ff53c159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 -- 172.21.15.50:0/1207953098 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c0b21e0 con 0x7ff53c15d460 2023-11-28T11:56:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 -- 172.21.15.50:0/1207953098 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7ff530001670 con 0x7ff53c15d460 2023-11-28T11:56:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53bfff700 1 --2- 172.21.15.50:0/1207953098 >> v2:172.21.15.192:3300/0 conn(0x7ff53c070e00 0x7ff53c159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 -- 172.21.15.50:0/1207953098 >> v1:172.21.15.50:6789/0 conn(0x7ff53c15d460 legacy=0x7ff53c0706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 --2- 172.21.15.50:0/1207953098 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff52c005c30 0x7ff52c006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 --2- 172.21.15.50:0/1207953098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff52c006630 0x7ff52c006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 --2- 172.21.15.50:0/1207953098 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff52c007220 0x7ff52c00dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 -- 172.21.15.50:0/1207953098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b2830 con 0x7ff52c006630 2023-11-28T11:56:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 -- 172.21.15.50:0/1207953098 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b1f00 con 0x7ff52c007220 2023-11-28T11:56:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 -- 172.21.15.50:0/1207953098 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c00e1b0 con 0x7ff52c005c30 2023-11-28T11:56:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff5414c8700 1 --2- 172.21.15.50:0/1207953098 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff53c13c600 0x7ff53c159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff540cc7700 1 --2- 172.21.15.50:0/1207953098 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff52c005c30 0x7ff52c006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53bfff700 1 --2- 172.21.15.50:0/1207953098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff52c006630 0x7ff52c006b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff5414c8700 1 --2- 172.21.15.50:0/1207953098 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff52c007220 0x7ff52c00dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53bfff700 1 -- 172.21.15.50:0/1207953098 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff52c005c30 msgr2=0x7ff52c006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53bfff700 1 --2- 172.21.15.50:0/1207953098 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff52c005c30 0x7ff52c006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53bfff700 1 -- 172.21.15.50:0/1207953098 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff52c007220 msgr2=0x7ff52c00dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53bfff700 1 --2- 172.21.15.50:0/1207953098 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff52c007220 0x7ff52c00dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53bfff700 1 -- 172.21.15.50:0/1207953098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c0057e0 con 0x7ff52c006630 2023-11-28T11:56:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53bfff700 1 --2- 172.21.15.50:0/1207953098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff52c006630 0x7ff52c006b00 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff528009940 tx=0x7ff52c007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcf749b92a625c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 -- 172.21.15.50:0/1207953098 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52800c070 con 0x7ff52c006630 2023-11-28T11:56:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 -- 172.21.15.50:0/1207953098 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff528004020 con 0x7ff52c006630 2023-11-28T11:56:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.945+0000 7ff53b7fe700 1 -- 172.21.15.50:0/1207953098 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5280043b0 con 0x7ff52c006630 2023-11-28T11:56:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.949+0000 7ff541cc9700 1 -- 172.21.15.50:0/1207953098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff52c006630 msgr2=0x7ff52c006b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.949+0000 7ff541cc9700 1 --2- 172.21.15.50:0/1207953098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff52c006630 0x7ff52c006b00 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff528009940 tx=0x7ff52c007ab0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.949+0000 7ff5414c8700 1 -- 172.21.15.50:0/1207953098 reap_dead start 2023-11-28T11:56:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.949+0000 7ff541cc9700 1 -- 172.21.15.50:0/1207953098 shutdown_connections 2023-11-28T11:56:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.949+0000 7ff541cc9700 1 -- 172.21.15.50:0/1207953098 >> 172.21.15.50:0/1207953098 conn(0x7ff53c06e000 msgr2=0x7ff53c0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.949+0000 7ff541cc9700 1 -- 172.21.15.50:0/1207953098 shutdown_connections 2023-11-28T11:56:35.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.949+0000 7ff541cc9700 1 -- 172.21.15.50:0/1207953098 wait complete. 2023-11-28T11:56:35.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.949+0000 7ff541cc9700 1 Processor -- start 2023-11-28T11:56:35.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.949+0000 7ff541cc9700 1 -- start start 2023-11-28T11:56:35.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.949+0000 7ff541cc9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff52c006630 0x7ff53c1f1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.949+0000 7ff541cc9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff53c13b700 0x7ff53c1ee630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.949+0000 7ff541cc9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53c0cd590 0x7ff53c0cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.949+0000 7ff541cc9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0cdf40 con 0x7ff53c0cd590 2023-11-28T11:56:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.949+0000 7ff541cc9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c1f19b0 con 0x7ff53c13b700 2023-11-28T11:56:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.949+0000 7ff541cc9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0afa50 con 0x7ff52c006630 2023-11-28T11:56:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff5414c8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53c0cd590 0x7ff53c0cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff5414c8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53c0cd590 0x7ff53c0cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38236/0 (socket says 172.21.15.50:38236) 2023-11-28T11:56:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff5414c8700 1 -- 172.21.15.50:0/2646352777 learned_addr learned my addr 172.21.15.50:0/2646352777 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff53bfff700 1 --2- 172.21.15.50:0/2646352777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff53c13b700 0x7ff53c1ee630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff540cc7700 1 --2- 172.21.15.50:0/2646352777 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff52c006630 0x7ff53c1f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff5414c8700 1 -- 172.21.15.50:0/2646352777 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff52c006630 msgr2=0x7ff53c1f1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff5414c8700 1 --2- 172.21.15.50:0/2646352777 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff52c006630 0x7ff53c1f1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff5414c8700 1 -- 172.21.15.50:0/2646352777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff53c13b700 msgr2=0x7ff53c1ee630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff5414c8700 1 --2- 172.21.15.50:0/2646352777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff53c13b700 0x7ff53c1ee630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:35.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff5414c8700 1 -- 172.21.15.50:0/2646352777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c15d830 con 0x7ff53c0cd590 2023-11-28T11:56:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff53bfff700 1 --2- 172.21.15.50:0/2646352777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff53c13b700 0x7ff53c1ee630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff5414c8700 1 --2- 172.21.15.50:0/2646352777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53c0cd590 0x7ff53c0cda00 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0ae870 tx=0x7ff534004810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff5397fa700 1 -- 172.21.15.50:0/2646352777 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff534007b80 con 0x7ff53c0cd590 2023-11-28T11:56:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff5397fa700 1 -- 172.21.15.50:0/2646352777 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53400f040 con 0x7ff53c0cd590 2023-11-28T11:56:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff541cc9700 1 -- 172.21.15.50:0/2646352777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53c0b24c0 con 0x7ff53c0cd590 2023-11-28T11:56:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff5397fa700 1 -- 172.21.15.50:0/2646352777 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff534015480 con 0x7ff53c0cd590 2023-11-28T11:56:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff541cc9700 1 -- 172.21.15.50:0/2646352777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53c159c60 con 0x7ff53c0cd590 2023-11-28T11:56:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff541cc9700 1 -- 172.21.15.50:0/2646352777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53c072c20 con 0x7ff53c0cd590 2023-11-28T11:56:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff5397fa700 1 -- 172.21.15.50:0/2646352777 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff5340155e0 con 0x7ff53c0cd590 2023-11-28T11:56:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.953+0000 7ff5397fa700 1 --2- 172.21.15.50:0/2646352777 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff520064ee0 0x7ff520067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.957+0000 7ff5397fa700 1 -- 172.21.15.50:0/2646352777 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5616+0+0 (secure 0 0 0) 0x7ff534082790 con 0x7ff53c0cd590 2023-11-28T11:56:35.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.957+0000 7ff540cc7700 1 --2- 172.21.15.50:0/2646352777 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff520064ee0 0x7ff520067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:35.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.957+0000 7ff540cc7700 1 --2- 172.21.15.50:0/2646352777 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff520064ee0 0x7ff520067390 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff530000c00 tx=0x7ff530008d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:35.965+0000 7ff5397fa700 1 -- 172.21.15.50:0/2646352777 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff534050af0 con 0x7ff53c0cd590 2023-11-28T11:56:36.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:36.137+0000 7ff541cc9700 1 -- 172.21.15.50:0/2646352777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff53c0cf2b0 con 0x7ff53c0cd590 2023-11-28T11:56:36.280 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:56:36.282 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:56:36.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:36.933+0000 7ff5397fa700 1 -- 172.21.15.50:0/2646352777 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff534054110 con 0x7ff53c0cd590 2023-11-28T11:56:36.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:36.937+0000 7ff541cc9700 1 -- 172.21.15.50:0/2646352777 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff520064ee0 msgr2=0x7ff520067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:36.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:36.937+0000 7ff541cc9700 1 --2- 172.21.15.50:0/2646352777 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff520064ee0 0x7ff520067390 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff530000c00 tx=0x7ff530008d30 comp rx=0 tx=0).stop 2023-11-28T11:56:36.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:36.937+0000 7ff541cc9700 1 -- 172.21.15.50:0/2646352777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53c0cd590 msgr2=0x7ff53c0cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:36.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:36.937+0000 7ff541cc9700 1 --2- 172.21.15.50:0/2646352777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53c0cd590 0x7ff53c0cda00 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0ae870 tx=0x7ff534004810 comp rx=0 tx=0).stop 2023-11-28T11:56:36.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:36.937+0000 7ff541cc9700 1 -- 172.21.15.50:0/2646352777 shutdown_connections 2023-11-28T11:56:36.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:36.937+0000 7ff541cc9700 1 --2- 172.21.15.50:0/2646352777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff53c0cd590 0x7ff53c0cda00 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:36.937+0000 7ff541cc9700 1 --2- 172.21.15.50:0/2646352777 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff520064ee0 0x7ff520067390 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:36.937+0000 7ff541cc9700 1 --2- 172.21.15.50:0/2646352777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff53c13b700 0x7ff53c1ee630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:36.937+0000 7ff541cc9700 1 --2- 172.21.15.50:0/2646352777 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff52c006630 0x7ff53c1f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:36.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:36.937+0000 7ff541cc9700 1 -- 172.21.15.50:0/2646352777 >> 172.21.15.50:0/2646352777 conn(0x7ff53c06e000 msgr2=0x7ff53c0b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:36.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:36.937+0000 7ff541cc9700 1 -- 172.21.15.50:0/2646352777 shutdown_connections 2023-11-28T11:56:36.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:36.937+0000 7ff541cc9700 1 -- 172.21.15.50:0/2646352777 wait complete. 2023-11-28T11:56:36.943 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-11-28T11:56:36.957 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T11:56:37.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8dffff700 1 Processor -- start 2023-11-28T11:56:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8dffff700 1 -- start start 2023-11-28T11:56:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8dffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e006c460 0x7ff8e0071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8dffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8e006c880 0x7ff8e00ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8dffff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e006b5e0 con 0x7ff8e0159220 2023-11-28T11:56:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8dffff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e00722c0 con 0x7ff8e006c880 2023-11-28T11:56:37.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8dffff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e00cdfb0 con 0x7ff8e006c460 2023-11-28T11:56:37.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8df7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8e006c880 0x7ff8e00ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8df7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8e006c880 0x7ff8e00ca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38244/0 (socket says 172.21.15.50:38244) 2023-11-28T11:56:37.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8df7fe700 1 -- 172.21.15.50:0/2114658443 learned_addr learned my addr 172.21.15.50:0/2114658443 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:37.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8deffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff8e0159220 0x7ff8e006bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56800/0 (socket says 172.21.15.50:56800) 2023-11-28T11:56:37.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8de7fc700 1 --2- 172.21.15.50:0/2114658443 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e006c460 0x7ff8e0071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8df7fe700 1 -- 172.21.15.50:0/2114658443 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e006c460 msgr2=0x7ff8e0071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8df7fe700 1 --2- 172.21.15.50:0/2114658443 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e006c460 0x7ff8e0071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8df7fe700 1 -- 172.21.15.50:0/2114658443 >> v1:172.21.15.50:6789/0 conn(0x7ff8e0159220 legacy=0x7ff8e006bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8df7fe700 1 -- 172.21.15.50:0/2114658443 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e00ce290 con 0x7ff8e006c880 2023-11-28T11:56:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8df7fe700 1 --2- 172.21.15.50:0/2114658443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e006c880 0x7ff8e00ca2d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009e50 tx=0x7ff8d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7664f68e635bf261 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8ddffb700 1 -- 172.21.15.50:0/2114658443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d800e070 con 0x7ff8e006c880 2023-11-28T11:56:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8ddffb700 1 -- 172.21.15.50:0/2114658443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d800b9c0 con 0x7ff8e006c880 2023-11-28T11:56:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.077+0000 7ff8ddffb700 1 -- 172.21.15.50:0/2114658443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d800bd70 con 0x7ff8e006c880 2023-11-28T11:56:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8dffff700 1 -- 172.21.15.50:0/2114658443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e006c880 msgr2=0x7ff8e00ca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8dffff700 1 --2- 172.21.15.50:0/2114658443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e006c880 0x7ff8e00ca2d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009e50 tx=0x7ff8d800b330 comp rx=0 tx=0).stop 2023-11-28T11:56:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8dffff700 1 -- 172.21.15.50:0/2114658443 shutdown_connections 2023-11-28T11:56:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8dffff700 1 --2- 172.21.15.50:0/2114658443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e006c880 0x7ff8e00ca2d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8dffff700 1 --2- 172.21.15.50:0/2114658443 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e006c460 0x7ff8e0071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8dffff700 1 -- 172.21.15.50:0/2114658443 >> 172.21.15.50:0/2114658443 conn(0x7ff8e00b1d40 msgr2=0x7ff8e00cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8dffff700 1 -- 172.21.15.50:0/2114658443 shutdown_connections 2023-11-28T11:56:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8dffff700 1 -- 172.21.15.50:0/2114658443 wait complete. 2023-11-28T11:56:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8dffff700 1 Processor -- start 2023-11-28T11:56:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8dffff700 1 -- start start 2023-11-28T11:56:37.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8dffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8e006c460 0x7ff8e01519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8dffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e006c880 0x7ff8e00b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8dffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e0159220 0x7ff8e00c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8dffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e00a7580 con 0x7ff8e0159220 2023-11-28T11:56:37.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8dffff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e00a7860 con 0x7ff8e006c460 2023-11-28T11:56:37.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8dffff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e00a7b40 con 0x7ff8e006c880 2023-11-28T11:56:37.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8df7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e0159220 0x7ff8e00c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8df7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e0159220 0x7ff8e00c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38260/0 (socket says 172.21.15.50:38260) 2023-11-28T11:56:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8df7fe700 1 -- 172.21.15.50:0/3911389092 learned_addr learned my addr 172.21.15.50:0/3911389092 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8de7fc700 1 --2- 172.21.15.50:0/3911389092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e006c880 0x7ff8e00b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.081+0000 7ff8deffd700 1 --2- 172.21.15.50:0/3911389092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8e006c460 0x7ff8e01519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.085+0000 7ff8df7fe700 1 -- 172.21.15.50:0/3911389092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e006c880 msgr2=0x7ff8e00b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.085+0000 7ff8df7fe700 1 --2- 172.21.15.50:0/3911389092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e006c880 0x7ff8e00b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.085+0000 7ff8df7fe700 1 -- 172.21.15.50:0/3911389092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8e006c460 msgr2=0x7ff8e01519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.085+0000 7ff8df7fe700 1 --2- 172.21.15.50:0/3911389092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8e006c460 0x7ff8e01519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.085+0000 7ff8df7fe700 1 -- 172.21.15.50:0/3911389092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d8009b30 con 0x7ff8e0159220 2023-11-28T11:56:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.085+0000 7ff8df7fe700 1 --2- 172.21.15.50:0/3911389092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e0159220 0x7ff8e00c8600 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8012000 tx=0x7ff8d8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.085+0000 7ff8c7fff700 1 -- 172.21.15.50:0/3911389092 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80099b0 con 0x7ff8e0159220 2023-11-28T11:56:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.085+0000 7ff8c7fff700 1 -- 172.21.15.50:0/3911389092 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d8004970 con 0x7ff8e0159220 2023-11-28T11:56:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.085+0000 7ff8dffff700 1 -- 172.21.15.50:0/3911389092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e006b830 con 0x7ff8e0159220 2023-11-28T11:56:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.085+0000 7ff8c7fff700 1 -- 172.21.15.50:0/3911389092 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d801b670 con 0x7ff8e0159220 2023-11-28T11:56:37.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.085+0000 7ff8dffff700 1 -- 172.21.15.50:0/3911389092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e00ce570 con 0x7ff8e0159220 2023-11-28T11:56:37.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.085+0000 7ff8c7fff700 1 -- 172.21.15.50:0/3911389092 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff8d8021030 con 0x7ff8e0159220 2023-11-28T11:56:37.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.085+0000 7ff8dffff700 1 -- 172.21.15.50:0/3911389092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e01595f0 con 0x7ff8e0159220 2023-11-28T11:56:37.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.085+0000 7ff8c7fff700 1 --2- 172.21.15.50:0/3911389092 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff8cc064ee0 0x7ff8cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.085+0000 7ff8c7fff700 1 -- 172.21.15.50:0/3911389092 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff8d8083060 con 0x7ff8e0159220 2023-11-28T11:56:37.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.085+0000 7ff8deffd700 1 --2- 172.21.15.50:0/3911389092 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff8cc064ee0 0x7ff8cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.089+0000 7ff8deffd700 1 --2- 172.21.15.50:0/3911389092 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff8cc064ee0 0x7ff8cc067390 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4000f60 tx=0x7ff8d4007d90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.093+0000 7ff8c7fff700 1 -- 172.21.15.50:0/3911389092 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff8d8051410 con 0x7ff8e0159220 2023-11-28T11:56:37.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.313+0000 7ff8dffff700 1 -- 172.21.15.50:0/3911389092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff8e0072500 con 0x7ff8e0159220 2023-11-28T11:56:37.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.313+0000 7ff8c7fff700 1 -- 172.21.15.50:0/3911389092 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5298 (secure 0 0 0) 0x7ff8d801f090 con 0x7ff8e0159220 2023-11-28T11:56:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:37.318 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:56:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-11-28T11:56:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-11-28T11:56:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlxEENEhAA6uZF6YtncUs7dCDzIg5HbQ==", 2023-11-28T11:56:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:56:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-11-28T11:56:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-11-28T11:56:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:56:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-11-28T11:56:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlI0OKHBAADvJfgEbXc9Afy6aG4gVoXA==", 2023-11-28T11:56:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:56:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-11-28T11:56:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-11-28T11:56:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:56:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-11-28T11:56:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVl6ny0FRAAQgysr6oovp/2rDO2QIMXzw==", 2023-11-28T11:56:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:56:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-11-28T11:56:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-11-28T11:56:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:56:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-11-28T11:56:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlWutSIBAALVMWVV7ccbh3GllfVc1p3Q==", 2023-11-28T11:56:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:56:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-11-28T11:56:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-11-28T11:56:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:56:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-11-28T11:56:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCG1GVl1DHxHBAAMp735odHBA/poSyyfvSYpQ==", 2023-11-28T11:56:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:56:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:56:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:56:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-11-28T11:56:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCJ1GVlxoqwIBAAnUjVFlMfRBksZ6XYz47T9Q==", 2023-11-28T11:56:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:56:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:56:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:56:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-11-28T11:56:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCM1GVlRf7iKBAAxyR/SK4psHpRinUXgEFWVQ==", 2023-11-28T11:56:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:56:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:56:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:56:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-11-28T11:56:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCP1GVlsV/wKxAAvVIJRCRq4uLf16aZE9Y7vw==", 2023-11-28T11:56:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:56:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:56:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:56:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-11-28T11:56:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCV1GVlTQT5DhAAx8BnPWKTw75FEfwY4QW1eg==", 2023-11-28T11:56:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:56:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:56:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:56:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-11-28T11:56:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCY1GVlYiehJBAA9fB7aokSkcuqUIrdCT4AVQ==", 2023-11-28T11:56:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:56:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:56:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:56:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-11-28T11:56:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCb1GVlx8AcKRAAyyFUzBGKYgqFZTCjrzWfTQ==", 2023-11-28T11:56:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:56:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:56:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:56:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-11-28T11:56:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCe1GVl8dJlLRAA3CbH6oyPSGBufsdUzrNqqg==", 2023-11-28T11:56:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-11-28T11:56:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-11-28T11:56:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:56:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-11-28T11:56:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlGwP8IxAAH+0SIBXHi15FUfxG3kL6CQ==", 2023-11-28T11:56:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:56:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-11-28T11:56:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-28T11:56:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-11-28T11:56:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlBPqBLRAA5NUjqXl9G+lXnEItcBKO0Q==", 2023-11-28T11:56:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:56:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-11-28T11:56:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-11-28T11:56:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-11-28T11:56:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-11-28T11:56:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlXn7/KRAAEPpLgrFMHsa7/ok0jPzaAw==", 2023-11-28T11:56:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:56:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-11-28T11:56:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-11-28T11:56:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-11-28T11:56:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.330 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-11-28T11:56:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVly52uMBAAkzwG3hsY3hpSoc6tEbzs/w==", 2023-11-28T11:56:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-11-28T11:56:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-11-28T11:56:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-11-28T11:56:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-11-28T11:56:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-11-28T11:56:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCE1GVlpGE5ORAAfnfy5U/jVTM4qlLvSzOG1A==", 2023-11-28T11:56:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-11-28T11:56:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-11-28T11:56:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-11-28T11:56:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:56:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-11-28T11:56:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlGibYDRAAkIMRzwJqRzmiXvmizp2vBA==", 2023-11-28T11:56:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-11-28T11:56:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-11-28T11:56:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:56:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-11-28T11:56:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQCF1GVlkx3HChAAps/lgazBLgFHSJJI81Zstg==", 2023-11-28T11:56:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-11-28T11:56:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-11-28T11:56:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-11-28T11:56:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-11-28T11:56:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-11-28T11:56:37.335 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:56:37.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.317+0000 7ff8dffff700 1 -- 172.21.15.50:0/3911389092 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff8cc064ee0 msgr2=0x7ff8cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.317+0000 7ff8dffff700 1 --2- 172.21.15.50:0/3911389092 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff8cc064ee0 0x7ff8cc067390 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4000f60 tx=0x7ff8d4007d90 comp rx=0 tx=0).stop 2023-11-28T11:56:37.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.317+0000 7ff8dffff700 1 -- 172.21.15.50:0/3911389092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e0159220 msgr2=0x7ff8e00c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.317+0000 7ff8dffff700 1 --2- 172.21.15.50:0/3911389092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e0159220 0x7ff8e00c8600 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8012000 tx=0x7ff8d8004af0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.317+0000 7ff8dffff700 1 -- 172.21.15.50:0/3911389092 shutdown_connections 2023-11-28T11:56:37.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.317+0000 7ff8dffff700 1 --2- 172.21.15.50:0/3911389092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e0159220 0x7ff8e00c8600 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.317+0000 7ff8dffff700 1 --2- 172.21.15.50:0/3911389092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e006c880 0x7ff8e00b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.317+0000 7ff8dffff700 1 --2- 172.21.15.50:0/3911389092 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff8cc064ee0 0x7ff8cc067390 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.317+0000 7ff8dffff700 1 --2- 172.21.15.50:0/3911389092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8e006c460 0x7ff8e01519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.317+0000 7ff8dffff700 1 -- 172.21.15.50:0/3911389092 >> 172.21.15.50:0/3911389092 conn(0x7ff8e00b1d40 msgr2=0x7ff8e0156080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:37.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.317+0000 7ff8dffff700 1 -- 172.21.15.50:0/3911389092 shutdown_connections 2023-11-28T11:56:37.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.317+0000 7ff8dffff700 1 -- 172.21.15.50:0/3911389092 wait complete. 2023-11-28T11:56:37.339 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:37.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.445+0000 7fb54b418700 1 Processor -- start 2023-11-28T11:56:37.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.445+0000 7fb54b418700 1 -- start start 2023-11-28T11:56:37.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54b418700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb5440c6bd0 0x7fb5440cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54b418700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5440cc4f0 0x7fb5440cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54b418700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb5440cc940 0x7fb5440cd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54b418700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5440b2b10 con 0x7fb5440c6bd0 2023-11-28T11:56:37.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54b418700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5440c6fa0 con 0x7fb5440cc940 2023-11-28T11:56:37.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54b418700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5440b21b0 con 0x7fb5440cc4f0 2023-11-28T11:56:37.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54a416700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb5440c6bd0 0x7fb5440cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54a416700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb5440c6bd0 0x7fb5440cace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38270/0 (socket says 172.21.15.50:38270) 2023-11-28T11:56:37.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54a416700 1 -- 172.21.15.50:0/3157386645 learned_addr learned my addr 172.21.15.50:0/3157386645 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:37.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb549c15700 1 --2- 172.21.15.50:0/3157386645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5440cc4f0 0x7fb5440cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54ac17700 1 --2- 172.21.15.50:0/3157386645 >> v2:172.21.15.192:3300/0 conn(0x7fb5440cc940 0x7fb5440cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54a416700 1 -- 172.21.15.50:0/3157386645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5440cc4f0 msgr2=0x7fb5440cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:37.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54a416700 1 --2- 172.21.15.50:0/3157386645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5440cc4f0 0x7fb5440cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54a416700 1 -- 172.21.15.50:0/3157386645 >> v2:172.21.15.192:3300/0 conn(0x7fb5440cc940 msgr2=0x7fb5440cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:37.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54a416700 1 --2- 172.21.15.50:0/3157386645 >> v2:172.21.15.192:3300/0 conn(0x7fb5440cc940 0x7fb5440cd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54a416700 1 -- 172.21.15.50:0/3157386645 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5440b2f30 con 0x7fb5440c6bd0 2023-11-28T11:56:37.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54ac17700 1 --2- 172.21.15.50:0/3157386645 >> v2:172.21.15.192:3300/0 conn(0x7fb5440cc940 0x7fb5440cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:37.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54a416700 1 --2- 172.21.15.50:0/3157386645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5440c6bd0 0x7fb5440cace0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb5440cb220 tx=0x7fb534009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2e88d3a97980e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb549414700 1 -- 172.21.15.50:0/3157386645 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb534011830 con 0x7fb5440c6bd0 2023-11-28T11:56:37.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb549414700 1 -- 172.21.15.50:0/3157386645 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb534011990 con 0x7fb5440c6bd0 2023-11-28T11:56:37.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb549414700 1 -- 172.21.15.50:0/3157386645 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb534011d20 con 0x7fb5440c6bd0 2023-11-28T11:56:37.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54b418700 1 -- 172.21.15.50:0/3157386645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5440c6bd0 msgr2=0x7fb5440cace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54b418700 1 --2- 172.21.15.50:0/3157386645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5440c6bd0 0x7fb5440cace0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb5440cb220 tx=0x7fb534009bf0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54b418700 1 -- 172.21.15.50:0/3157386645 shutdown_connections 2023-11-28T11:56:37.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54b418700 1 --2- 172.21.15.50:0/3157386645 >> v2:172.21.15.192:3300/0 conn(0x7fb5440cc940 0x7fb5440cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54b418700 1 --2- 172.21.15.50:0/3157386645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5440cc4f0 0x7fb5440cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54b418700 1 --2- 172.21.15.50:0/3157386645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5440c6bd0 0x7fb5440cace0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54b418700 1 -- 172.21.15.50:0/3157386645 >> 172.21.15.50:0/3157386645 conn(0x7fb544069c40 msgr2=0x7fb54406a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:37.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54b418700 1 -- 172.21.15.50:0/3157386645 shutdown_connections 2023-11-28T11:56:37.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.449+0000 7fb54b418700 1 -- 172.21.15.50:0/3157386645 wait complete. 2023-11-28T11:56:37.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb54b418700 1 Processor -- start 2023-11-28T11:56:37.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb54b418700 1 -- start start 2023-11-28T11:56:37.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb54b418700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5440c6bd0 0x7fb544147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb54b418700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5440cc4f0 0x7fb5440afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb54b418700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5440cc940 0x7fb5440b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb54b418700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5441459d0 con 0x7fb5440cc4f0 2023-11-28T11:56:37.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb54b418700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb544147fc0 con 0x7fb5440c6bd0 2023-11-28T11:56:37.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb54b418700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5441482a0 con 0x7fb5440cc940 2023-11-28T11:56:37.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb549c15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5440cc4f0 0x7fb5440afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb54a416700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5440c6bd0 0x7fb544147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb54ac17700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5440cc940 0x7fb5440b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb549c15700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5440cc4f0 0x7fb5440afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38280/0 (socket says 172.21.15.50:38280) 2023-11-28T11:56:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb549c15700 1 -- 172.21.15.50:0/659747565 learned_addr learned my addr 172.21.15.50:0/659747565 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb549c15700 1 -- 172.21.15.50:0/659747565 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5440cc940 msgr2=0x7fb5440b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb549c15700 1 --2- 172.21.15.50:0/659747565 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5440cc940 0x7fb5440b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb549c15700 1 -- 172.21.15.50:0/659747565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5440c6bd0 msgr2=0x7fb544147570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb549c15700 1 --2- 172.21.15.50:0/659747565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5440c6bd0 0x7fb544147570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb549c15700 1 -- 172.21.15.50:0/659747565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb534009570 con 0x7fb5440cc4f0 2023-11-28T11:56:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb54a416700 1 --2- 172.21.15.50:0/659747565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5440c6bd0 0x7fb544147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb549c15700 1 --2- 172.21.15.50:0/659747565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5440cc4f0 0x7fb5440afbc0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb54000e870 tx=0x7fb54000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb53affd700 1 -- 172.21.15.50:0/659747565 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb540009540 con 0x7fb5440cc4f0 2023-11-28T11:56:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb53affd700 1 -- 172.21.15.50:0/659747565 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb540013680 con 0x7fb5440cc4f0 2023-11-28T11:56:37.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb54b418700 1 -- 172.21.15.50:0/659747565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5440b2730 con 0x7fb5440cc4f0 2023-11-28T11:56:37.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb53affd700 1 -- 172.21.15.50:0/659747565 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb540013a10 con 0x7fb5440cc4f0 2023-11-28T11:56:37.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.453+0000 7fb54b418700 1 -- 172.21.15.50:0/659747565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5440b2450 con 0x7fb5440cc4f0 2023-11-28T11:56:37.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.457+0000 7fb54b418700 1 -- 172.21.15.50:0/659747565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5440cce20 con 0x7fb5440cc4f0 2023-11-28T11:56:37.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.457+0000 7fb53affd700 1 -- 172.21.15.50:0/659747565 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb540019030 con 0x7fb5440cc4f0 2023-11-28T11:56:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.457+0000 7fb53affd700 1 --2- 172.21.15.50:0/659747565 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb528064ee0 0x7fb528067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.457+0000 7fb53affd700 1 -- 172.21.15.50:0/659747565 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb540081a70 con 0x7fb5440cc4f0 2023-11-28T11:56:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.457+0000 7fb54a416700 1 --2- 172.21.15.50:0/659747565 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb528064ee0 0x7fb528067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.457+0000 7fb54a416700 1 --2- 172.21.15.50:0/659747565 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb528064ee0 0x7fb528067390 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb534000c00 tx=0x7fb534008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.465+0000 7fb53affd700 1 -- 172.21.15.50:0/659747565 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb54004fcb0 con 0x7fb5440cc4f0 2023-11-28T11:56:37.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.629+0000 7fb54b418700 1 -- 172.21.15.50:0/659747565 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb544072c20 con 0x7fb5440cc4f0 2023-11-28T11:56:37.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.629+0000 7fb53affd700 1 -- 172.21.15.50:0/659747565 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+14318 (secure 0 0 0) 0x7fb5400532d0 con 0x7fb5440cc4f0 2023-11-28T11:56:37.635 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:37.635 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":62,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:56:36.935079+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:37.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.633+0000 7fb54b418700 1 -- 172.21.15.50:0/659747565 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb528064ee0 msgr2=0x7fb528067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.633+0000 7fb54b418700 1 --2- 172.21.15.50:0/659747565 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb528064ee0 0x7fb528067390 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb534000c00 tx=0x7fb534008030 comp rx=0 tx=0).stop 2023-11-28T11:56:37.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.633+0000 7fb54b418700 1 -- 172.21.15.50:0/659747565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5440cc4f0 msgr2=0x7fb5440afbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.633+0000 7fb54b418700 1 --2- 172.21.15.50:0/659747565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5440cc4f0 0x7fb5440afbc0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb54000e870 tx=0x7fb54000eb80 comp rx=0 tx=0).stop 2023-11-28T11:56:37.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.633+0000 7fb54b418700 1 -- 172.21.15.50:0/659747565 shutdown_connections 2023-11-28T11:56:37.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.633+0000 7fb54b418700 1 --2- 172.21.15.50:0/659747565 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5440cc940 0x7fb5440b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.633+0000 7fb54b418700 1 --2- 172.21.15.50:0/659747565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5440cc4f0 0x7fb5440afbc0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.633+0000 7fb54b418700 1 --2- 172.21.15.50:0/659747565 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb528064ee0 0x7fb528067390 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.633+0000 7fb54b418700 1 --2- 172.21.15.50:0/659747565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5440c6bd0 0x7fb544147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.633+0000 7fb54b418700 1 -- 172.21.15.50:0/659747565 >> 172.21.15.50:0/659747565 conn(0x7fb544069c40 msgr2=0x7fb5440ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:37.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.633+0000 7fb54b418700 1 -- 172.21.15.50:0/659747565 shutdown_connections 2023-11-28T11:56:37.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.633+0000 7fb54b418700 1 -- 172.21.15.50:0/659747565 wait complete. 2023-11-28T11:56:37.655 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:56:37.655 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:56:37.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.765+0000 7febe3238700 1 Processor -- start 2023-11-28T11:56:37.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.765+0000 7febe3238700 1 -- start start 2023-11-28T11:56:37.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe3238700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7febdc06a4c0 0x7febdc06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe3238700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febdc0cf0e0 0x7febdc0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe3238700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febdc0cfa80 con 0x7febdc0b1ae0 2023-11-28T11:56:37.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe3238700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febdc0d0ab0 con 0x7febdc06a4c0 2023-11-28T11:56:37.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe3238700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febdc06a9c0 con 0x7febdc0cf0e0 2023-11-28T11:56:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe2a37700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febdc0cf0e0 0x7febdc0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe1a35700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7febdc06a4c0 0x7febdc06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe1a35700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7febdc06a4c0 0x7febdc06d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:55948/0 (socket says 172.21.15.50:55948) 2023-11-28T11:56:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe1a35700 1 -- 172.21.15.50:0/3417337964 learned_addr learned my addr 172.21.15.50:0/3417337964 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe2236700 1 --1- 172.21.15.50:0/3417337964 >> v1:172.21.15.192:6789/0 conn(0x7febdc0b1ae0 0x7febdc0d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:41772/0 (socket says 172.21.15.50:41772) 2023-11-28T11:56:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe1a35700 1 -- 172.21.15.50:0/3417337964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febdc0cf0e0 msgr2=0x7febdc0cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe1a35700 1 --2- 172.21.15.50:0/3417337964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febdc0cf0e0 0x7febdc0cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe1a35700 1 -- 172.21.15.50:0/3417337964 >> v1:172.21.15.192:6789/0 conn(0x7febdc0b1ae0 legacy=0x7febdc0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe1a35700 1 -- 172.21.15.50:0/3417337964 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc06aca0 con 0x7febdc06a4c0 2023-11-28T11:56:37.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe1a35700 1 --2- 172.21.15.50:0/3417337964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febdc06a4c0 0x7febdc06d8e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7febd8009910 tx=0x7febd8009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a10c6387e498867 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe1234700 1 -- 172.21.15.50:0/3417337964 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd8011830 con 0x7febdc06a4c0 2023-11-28T11:56:37.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe1234700 1 -- 172.21.15.50:0/3417337964 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd8011990 con 0x7febdc06a4c0 2023-11-28T11:56:37.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe1234700 1 -- 172.21.15.50:0/3417337964 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd8011d40 con 0x7febdc06a4c0 2023-11-28T11:56:37.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe3238700 1 -- 172.21.15.50:0/3417337964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febdc06a4c0 msgr2=0x7febdc06d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe3238700 1 --2- 172.21.15.50:0/3417337964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febdc06a4c0 0x7febdc06d8e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7febd8009910 tx=0x7febd8009c20 comp rx=0 tx=0).stop 2023-11-28T11:56:37.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe3238700 1 -- 172.21.15.50:0/3417337964 shutdown_connections 2023-11-28T11:56:37.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe3238700 1 --2- 172.21.15.50:0/3417337964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febdc0cf0e0 0x7febdc0cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe3238700 1 --2- 172.21.15.50:0/3417337964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febdc06a4c0 0x7febdc06d8e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe3238700 1 -- 172.21.15.50:0/3417337964 >> 172.21.15.50:0/3417337964 conn(0x7febdc09bbd0 msgr2=0x7febdc0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:37.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe3238700 1 -- 172.21.15.50:0/3417337964 shutdown_connections 2023-11-28T11:56:37.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.769+0000 7febe3238700 1 -- 172.21.15.50:0/3417337964 wait complete. 2023-11-28T11:56:37.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe3238700 1 Processor -- start 2023-11-28T11:56:37.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe3238700 1 -- start start 2023-11-28T11:56:37.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe3238700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febdc06a4c0 0x7febdc159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe3238700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febdc0b1ae0 0x7febdc0c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe3238700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febdc0cf0e0 0x7febdc0c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe3238700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc15d2c0 con 0x7febdc0cf0e0 2023-11-28T11:56:37.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe3238700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc15f3e0 con 0x7febdc0b1ae0 2023-11-28T11:56:37.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe3238700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febdc0c90b0 con 0x7febdc06a4c0 2023-11-28T11:56:37.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe2a37700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febdc0cf0e0 0x7febdc0c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe2236700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febdc06a4c0 0x7febdc159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe1a35700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febdc0b1ae0 0x7febdc0c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe2236700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febdc06a4c0 0x7febdc159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:36880/0 (socket says 172.21.15.50:36880) 2023-11-28T11:56:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe2236700 1 -- 172.21.15.50:0/103726906 learned_addr learned my addr 172.21.15.50:0/103726906 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe2a37700 1 --2- 172.21.15.50:0/103726906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febdc0cf0e0 0x7febdc0c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38282/0 (socket says 172.21.15.50:38282) 2023-11-28T11:56:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe2a37700 1 -- 172.21.15.50:0/103726906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febdc06a4c0 msgr2=0x7febdc159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe2a37700 1 --2- 172.21.15.50:0/103726906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febdc06a4c0 0x7febdc159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe2a37700 1 -- 172.21.15.50:0/103726906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febdc0b1ae0 msgr2=0x7febdc0c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe2a37700 1 --2- 172.21.15.50:0/103726906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febdc0b1ae0 0x7febdc0c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.773+0000 7febe2a37700 1 -- 172.21.15.50:0/103726906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd8009570 con 0x7febdc0cf0e0 2023-11-28T11:56:37.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.777+0000 7febe2a37700 1 --2- 172.21.15.50:0/103726906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febdc0cf0e0 0x7febdc0c7da0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7febd4009d90 tx=0x7febd400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.777+0000 7febd2ffd700 1 -- 172.21.15.50:0/103726906 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4009c00 con 0x7febdc0cf0e0 2023-11-28T11:56:37.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.777+0000 7febe3238700 1 -- 172.21.15.50:0/103726906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febdc0b4380 con 0x7febdc0cf0e0 2023-11-28T11:56:37.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.777+0000 7febd2ffd700 1 -- 172.21.15.50:0/103726906 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd400f040 con 0x7febdc0cf0e0 2023-11-28T11:56:37.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.777+0000 7febd2ffd700 1 -- 172.21.15.50:0/103726906 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4014480 con 0x7febdc0cf0e0 2023-11-28T11:56:37.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.777+0000 7febe3238700 1 -- 172.21.15.50:0/103726906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febdc06af80 con 0x7febdc0cf0e0 2023-11-28T11:56:37.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.777+0000 7febe3238700 1 -- 172.21.15.50:0/103726906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febdc0b1eb0 con 0x7febdc0cf0e0 2023-11-28T11:56:37.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.777+0000 7febd2ffd700 1 -- 172.21.15.50:0/103726906 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7febd40145e0 con 0x7febdc0cf0e0 2023-11-28T11:56:37.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.781+0000 7febd2ffd700 1 --2- 172.21.15.50:0/103726906 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7febc0064ee0 0x7febc0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:37.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.781+0000 7febd2ffd700 1 -- 172.21.15.50:0/103726906 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7febd40829e0 con 0x7febdc0cf0e0 2023-11-28T11:56:37.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.781+0000 7febe2236700 1 --2- 172.21.15.50:0/103726906 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7febc0064ee0 0x7febc0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:37.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.781+0000 7febe2236700 1 --2- 172.21.15.50:0/103726906 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7febc0064ee0 0x7febc0067390 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7febcc000f60 tx=0x7febcc001190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:37.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.785+0000 7febd2ffd700 1 -- 172.21.15.50:0/103726906 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7febd4050c20 con 0x7febdc0cf0e0 2023-11-28T11:56:37.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.945+0000 7febe3238700 1 -- 172.21.15.50:0/103726906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7febdc15d400 con 0x7febdc0cf0e0 2023-11-28T11:56:37.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.945+0000 7febd2ffd700 1 -- 172.21.15.50:0/103726906 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v62) v1 ==== 92+0+10 (secure 0 0 0) 0x7febdc15d400 con 0x7febdc0cf0e0 2023-11-28T11:56:37.948 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:56:37.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.945+0000 7febe3238700 1 -- 172.21.15.50:0/103726906 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7febc0064ee0 msgr2=0x7febc0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.945+0000 7febe3238700 1 --2- 172.21.15.50:0/103726906 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7febc0064ee0 0x7febc0067390 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7febcc000f60 tx=0x7febcc001190 comp rx=0 tx=0).stop 2023-11-28T11:56:37.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.945+0000 7febe3238700 1 -- 172.21.15.50:0/103726906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febdc0cf0e0 msgr2=0x7febdc0c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:37.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.945+0000 7febe3238700 1 --2- 172.21.15.50:0/103726906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febdc0cf0e0 0x7febdc0c7da0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7febd4009d90 tx=0x7febd400c3a0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.945+0000 7febe3238700 1 -- 172.21.15.50:0/103726906 shutdown_connections 2023-11-28T11:56:37.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.945+0000 7febe3238700 1 --2- 172.21.15.50:0/103726906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febdc0cf0e0 0x7febdc0c7da0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.945+0000 7febe3238700 1 --2- 172.21.15.50:0/103726906 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7febc0064ee0 0x7febc0067390 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.945+0000 7febe3238700 1 --2- 172.21.15.50:0/103726906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febdc0b1ae0 0x7febdc0c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.945+0000 7febe3238700 1 --2- 172.21.15.50:0/103726906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febdc06a4c0 0x7febdc159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:37.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.945+0000 7febe3238700 1 -- 172.21.15.50:0/103726906 >> 172.21.15.50:0/103726906 conn(0x7febdc09bbd0 msgr2=0x7febdc0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:37.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.945+0000 7febe3238700 1 -- 172.21.15.50:0/103726906 shutdown_connections 2023-11-28T11:56:37.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:37.945+0000 7febe3238700 1 -- 172.21.15.50:0/103726906 wait complete. 2023-11-28T11:56:37.963 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:56:38.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.069+0000 7f2c81786700 1 Processor -- start 2023-11-28T11:56:38.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.069+0000 7f2c81786700 1 -- start start 2023-11-28T11:56:38.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.073+0000 7f2c81786700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2c7c0b1ae0 0x7f2c7c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.073+0000 7f2c81786700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c7c0cf0e0 0x7f2c7c0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.073+0000 7f2c81786700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7c0cfa80 con 0x7f2c7c06a4c0 2023-11-28T11:56:38.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.073+0000 7f2c81786700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7c0d0ab0 con 0x7f2c7c0b1ae0 2023-11-28T11:56:38.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.073+0000 7f2c81786700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c06a9c0 con 0x7f2c7c0cf0e0 2023-11-28T11:56:38.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.073+0000 7f2c80f85700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c7c0cf0e0 0x7f2c7c0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.073+0000 7f2c80f85700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c7c0cf0e0 0x7f2c7c0cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:36888/0 (socket says 172.21.15.50:36888) 2023-11-28T11:56:38.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.073+0000 7f2c80f85700 1 -- 172.21.15.50:0/1607097660 learned_addr learned my addr 172.21.15.50:0/1607097660 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:38.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.073+0000 7f2c7bfff700 1 --2- 172.21.15.50:0/1607097660 >> v2:172.21.15.192:3300/0 conn(0x7f2c7c0b1ae0 0x7f2c7c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.073+0000 7f2c80f85700 1 -- 172.21.15.50:0/1607097660 >> v2:172.21.15.192:3300/0 conn(0x7f2c7c0b1ae0 msgr2=0x7f2c7c06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:38.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.073+0000 7f2c80f85700 1 --2- 172.21.15.50:0/1607097660 >> v2:172.21.15.192:3300/0 conn(0x7f2c7c0b1ae0 0x7f2c7c06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.073+0000 7f2c80f85700 1 -- 172.21.15.50:0/1607097660 >> v1:172.21.15.192:6789/0 conn(0x7f2c7c06a4c0 legacy=0x7f2c7c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.073+0000 7f2c80f85700 1 -- 172.21.15.50:0/1607097660 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c06aca0 con 0x7f2c7c0cf0e0 2023-11-28T11:56:38.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.073+0000 7f2c80f85700 1 --2- 172.21.15.50:0/1607097660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c7c0cf0e0 0x7f2c7c0cf540 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2c74009e50 tx=0x7f2c7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a714af7de1e5987 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:38.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.073+0000 7f2c7b7fe700 1 -- 172.21.15.50:0/1607097660 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7400e070 con 0x7f2c7c0cf0e0 2023-11-28T11:56:38.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.073+0000 7f2c7b7fe700 1 -- 172.21.15.50:0/1607097660 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7400b910 con 0x7f2c7c0cf0e0 2023-11-28T11:56:38.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.073+0000 7f2c7b7fe700 1 -- 172.21.15.50:0/1607097660 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7400bcc0 con 0x7f2c7c0cf0e0 2023-11-28T11:56:38.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.077+0000 7f2c81786700 1 -- 172.21.15.50:0/1607097660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c7c0cf0e0 msgr2=0x7f2c7c0cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.077+0000 7f2c81786700 1 --2- 172.21.15.50:0/1607097660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c7c0cf0e0 0x7f2c7c0cf540 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2c74009e50 tx=0x7f2c7400b330 comp rx=0 tx=0).stop 2023-11-28T11:56:38.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.077+0000 7f2c81786700 1 -- 172.21.15.50:0/1607097660 shutdown_connections 2023-11-28T11:56:38.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.077+0000 7f2c81786700 1 --2- 172.21.15.50:0/1607097660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c7c0cf0e0 0x7f2c7c0cf540 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.077+0000 7f2c81786700 1 --2- 172.21.15.50:0/1607097660 >> v2:172.21.15.192:3300/0 conn(0x7f2c7c0b1ae0 0x7f2c7c06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.077+0000 7f2c81786700 1 -- 172.21.15.50:0/1607097660 >> 172.21.15.50:0/1607097660 conn(0x7f2c7c09bbd0 msgr2=0x7f2c7c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:38.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.077+0000 7f2c81786700 1 -- 172.21.15.50:0/1607097660 shutdown_connections 2023-11-28T11:56:38.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.077+0000 7f2c81786700 1 -- 172.21.15.50:0/1607097660 wait complete. 2023-11-28T11:56:38.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.077+0000 7f2c81786700 1 Processor -- start 2023-11-28T11:56:38.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.077+0000 7f2c81786700 1 -- start start 2023-11-28T11:56:38.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.077+0000 7f2c81786700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c7c06a4c0 0x7f2c7c0b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c81786700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c7c0b1ae0 0x7f2c7c1f4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c81786700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c7c0cf0e0 0x7f2c7c1f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c81786700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c1f1cc0 con 0x7f2c7c0b1ae0 2023-11-28T11:56:38.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c81786700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c15af80 con 0x7f2c7c06a4c0 2023-11-28T11:56:38.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c81786700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c1f5940 con 0x7f2c7c0cf0e0 2023-11-28T11:56:38.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c73fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c7c0b1ae0 0x7f2c7c1f4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c73fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c7c0b1ae0 0x7f2c7c1f4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38296/0 (socket says 172.21.15.50:38296) 2023-11-28T11:56:38.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c73fff700 1 -- 172.21.15.50:0/1346753013 learned_addr learned my addr 172.21.15.50:0/1346753013 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:38.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c7bfff700 1 --2- 172.21.15.50:0/1346753013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c7c06a4c0 0x7f2c7c0b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c80f85700 1 --2- 172.21.15.50:0/1346753013 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c7c0cf0e0 0x7f2c7c1f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c73fff700 1 -- 172.21.15.50:0/1346753013 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c7c0cf0e0 msgr2=0x7f2c7c1f4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c73fff700 1 --2- 172.21.15.50:0/1346753013 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c7c0cf0e0 0x7f2c7c1f4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c73fff700 1 -- 172.21.15.50:0/1346753013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c7c06a4c0 msgr2=0x7f2c7c0b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c73fff700 1 --2- 172.21.15.50:0/1346753013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c7c06a4c0 0x7f2c7c0b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c73fff700 1 -- 172.21.15.50:0/1346753013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c74009b30 con 0x7f2c7c0b1ae0 2023-11-28T11:56:38.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c73fff700 1 --2- 172.21.15.50:0/1346753013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c7c0b1ae0 0x7f2c7c1f4a50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400c500 tx=0x7f2c6400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:38.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c797fa700 1 -- 172.21.15.50:0/1346753013 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c640052d0 con 0x7f2c7c0b1ae0 2023-11-28T11:56:38.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c797fa700 1 -- 172.21.15.50:0/1346753013 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c64005430 con 0x7f2c7c0b1ae0 2023-11-28T11:56:38.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c81786700 1 -- 172.21.15.50:0/1346753013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7c0b4380 con 0x7f2c7c0b1ae0 2023-11-28T11:56:38.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c797fa700 1 -- 172.21.15.50:0/1346753013 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c640055a0 con 0x7f2c7c0b1ae0 2023-11-28T11:56:38.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c81786700 1 -- 172.21.15.50:0/1346753013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7c06af80 con 0x7f2c7c0b1ae0 2023-11-28T11:56:38.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.081+0000 7f2c81786700 1 -- 172.21.15.50:0/1346753013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7c0b1eb0 con 0x7f2c7c0b1ae0 2023-11-28T11:56:38.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.085+0000 7f2c797fa700 1 -- 172.21.15.50:0/1346753013 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2c64019030 con 0x7f2c7c0b1ae0 2023-11-28T11:56:38.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.085+0000 7f2c797fa700 1 --2- 172.21.15.50:0/1346753013 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2c5c064ee0 0x7f2c5c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.085+0000 7f2c797fa700 1 -- 172.21.15.50:0/1346753013 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2c64080f10 con 0x7f2c7c0b1ae0 2023-11-28T11:56:38.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.085+0000 7f2c7bfff700 1 --2- 172.21.15.50:0/1346753013 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2c5c064ee0 0x7f2c5c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.085+0000 7f2c7bfff700 1 --2- 172.21.15.50:0/1346753013 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2c5c064ee0 0x7f2c5c067390 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009bf0 tx=0x7f2c6c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:38.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.089+0000 7f2c797fa700 1 -- 172.21.15.50:0/1346753013 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2c6404f2c0 con 0x7f2c7c0b1ae0 2023-11-28T11:56:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.249+0000 7f2c81786700 1 -- 172.21.15.50:0/1346753013 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c7c1f1e00 con 0x7f2c7c0b1ae0 2023-11-28T11:56:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.249+0000 7f2c797fa700 1 -- 172.21.15.50:0/1346753013 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c64017020 con 0x7f2c7c0b1ae0 2023-11-28T11:56:38.257 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:56:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.253+0000 7f2c81786700 1 -- 172.21.15.50:0/1346753013 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2c5c064ee0 msgr2=0x7f2c5c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.253+0000 7f2c81786700 1 --2- 172.21.15.50:0/1346753013 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2c5c064ee0 0x7f2c5c067390 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009bf0 tx=0x7f2c6c009240 comp rx=0 tx=0).stop 2023-11-28T11:56:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.253+0000 7f2c81786700 1 -- 172.21.15.50:0/1346753013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c7c0b1ae0 msgr2=0x7f2c7c1f4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.253+0000 7f2c81786700 1 --2- 172.21.15.50:0/1346753013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c7c0b1ae0 0x7f2c7c1f4a50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400c500 tx=0x7f2c6400c810 comp rx=0 tx=0).stop 2023-11-28T11:56:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.253+0000 7f2c81786700 1 -- 172.21.15.50:0/1346753013 shutdown_connections 2023-11-28T11:56:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.253+0000 7f2c81786700 1 --2- 172.21.15.50:0/1346753013 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c7c0cf0e0 0x7f2c7c1f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.253+0000 7f2c81786700 1 --2- 172.21.15.50:0/1346753013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c7c0b1ae0 0x7f2c7c1f4a50 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.253+0000 7f2c81786700 1 --2- 172.21.15.50:0/1346753013 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2c5c064ee0 0x7f2c5c067390 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.253+0000 7f2c81786700 1 --2- 172.21.15.50:0/1346753013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c7c06a4c0 0x7f2c7c0b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.253+0000 7f2c81786700 1 -- 172.21.15.50:0/1346753013 >> 172.21.15.50:0/1346753013 conn(0x7f2c7c09bbd0 msgr2=0x7f2c7c0b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.253+0000 7f2c81786700 1 -- 172.21.15.50:0/1346753013 shutdown_connections 2023-11-28T11:56:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.253+0000 7f2c81786700 1 -- 172.21.15.50:0/1346753013 wait complete. 2023-11-28T11:56:38.269 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T11:56:38.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.381+0000 7f5cbbfff700 1 Processor -- start 2023-11-28T11:56:38.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.381+0000 7f5cbbfff700 1 -- start start 2023-11-28T11:56:38.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.381+0000 7f5cbbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5cbc0cf050 0x7f5cbc06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.381+0000 7f5cbbfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5cbc06a530 0x7f5cbc0cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.381+0000 7f5cbbfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cbc0b4c10 0x7f5cbc0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.381+0000 7f5cbbfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cbc15c6d0 con 0x7f5cbc0cf050 2023-11-28T11:56:38.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.381+0000 7f5cbbfff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cbc06a9d0 con 0x7f5cbc06a530 2023-11-28T11:56:38.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.381+0000 7f5cbbfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc0cf960 con 0x7f5cbc0b4c10 2023-11-28T11:56:38.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.381+0000 7f5cbaffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5cbc0cf050 0x7f5cbc06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.381+0000 7f5cbaffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5cbc0cf050 0x7f5cbc06d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38302/0 (socket says 172.21.15.50:38302) 2023-11-28T11:56:38.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.381+0000 7f5cbaffd700 1 -- 172.21.15.50:0/1980334652 learned_addr learned my addr 172.21.15.50:0/1980334652 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:38.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.381+0000 7f5cba7fc700 1 --2- 172.21.15.50:0/1980334652 >> v2:172.21.15.192:3300/0 conn(0x7f5cbc06a530 0x7f5cbc0cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.381+0000 7f5cbb7fe700 1 --2- 172.21.15.50:0/1980334652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cbc0b4c10 0x7f5cbc0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cbaffd700 1 -- 172.21.15.50:0/1980334652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cbc0b4c10 msgr2=0x7f5cbc0cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:38.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cbaffd700 1 --2- 172.21.15.50:0/1980334652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cbc0b4c10 0x7f5cbc0cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cbaffd700 1 -- 172.21.15.50:0/1980334652 >> v2:172.21.15.192:3300/0 conn(0x7f5cbc06a530 msgr2=0x7f5cbc0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:38.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cbaffd700 1 --2- 172.21.15.50:0/1980334652 >> v2:172.21.15.192:3300/0 conn(0x7f5cbc06a530 0x7f5cbc0cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cbaffd700 1 -- 172.21.15.50:0/1980334652 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc06ac60 con 0x7f5cbc0cf050 2023-11-28T11:56:38.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cbb7fe700 1 --2- 172.21.15.50:0/1980334652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cbc0b4c10 0x7f5cbc0cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:38.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cbaffd700 1 --2- 172.21.15.50:0/1980334652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cbc0cf050 0x7f5cbc06d7d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc0d38d0 tx=0x7f5cac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22a0ee185c9ff9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:38.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cb9ffb700 1 -- 172.21.15.50:0/1980334652 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac011830 con 0x7f5cbc0cf050 2023-11-28T11:56:38.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cb9ffb700 1 -- 172.21.15.50:0/1980334652 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac011990 con 0x7f5cbc0cf050 2023-11-28T11:56:38.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cb9ffb700 1 -- 172.21.15.50:0/1980334652 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac011d20 con 0x7f5cbc0cf050 2023-11-28T11:56:38.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cbbfff700 1 -- 172.21.15.50:0/1980334652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cbc0cf050 msgr2=0x7f5cbc06d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cbbfff700 1 --2- 172.21.15.50:0/1980334652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cbc0cf050 0x7f5cbc06d7d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc0d38d0 tx=0x7f5cac009bf0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cbbfff700 1 -- 172.21.15.50:0/1980334652 shutdown_connections 2023-11-28T11:56:38.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cbbfff700 1 --2- 172.21.15.50:0/1980334652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cbc0b4c10 0x7f5cbc0cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cbbfff700 1 --2- 172.21.15.50:0/1980334652 >> v2:172.21.15.192:3300/0 conn(0x7f5cbc06a530 0x7f5cbc0cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cbbfff700 1 --2- 172.21.15.50:0/1980334652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cbc0cf050 0x7f5cbc06d7d0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cbbfff700 1 -- 172.21.15.50:0/1980334652 >> 172.21.15.50:0/1980334652 conn(0x7f5cbc09bb30 msgr2=0x7f5cbc0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:38.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cbbfff700 1 -- 172.21.15.50:0/1980334652 shutdown_connections 2023-11-28T11:56:38.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.385+0000 7f5cbbfff700 1 -- 172.21.15.50:0/1980334652 wait complete. 2023-11-28T11:56:38.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbbfff700 1 Processor -- start 2023-11-28T11:56:38.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbbfff700 1 -- start start 2023-11-28T11:56:38.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cbc06a530 0x7f5cbc14fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbbfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cbc0b4c10 0x7f5cbc0c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbbfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cbc0cf050 0x7f5cbc0c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbbfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc0c7ec0 con 0x7f5cbc06a530 2023-11-28T11:56:38.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbbfff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc0c81a0 con 0x7f5cbc0b4c10 2023-11-28T11:56:38.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbbfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc0c8480 con 0x7f5cbc0cf050 2023-11-28T11:56:38.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbaffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cbc06a530 0x7f5cbc14fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbaffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cbc06a530 0x7f5cbc14fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38304/0 (socket says 172.21.15.50:38304) 2023-11-28T11:56:38.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbaffd700 1 -- 172.21.15.50:0/3246207235 learned_addr learned my addr 172.21.15.50:0/3246207235 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:38.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cba7fc700 1 --2- 172.21.15.50:0/3246207235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cbc0b4c10 0x7f5cbc0c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbb7fe700 1 --2- 172.21.15.50:0/3246207235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cbc0cf050 0x7f5cbc0c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbaffd700 1 -- 172.21.15.50:0/3246207235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cbc0cf050 msgr2=0x7f5cbc0c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbaffd700 1 --2- 172.21.15.50:0/3246207235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cbc0cf050 0x7f5cbc0c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbaffd700 1 -- 172.21.15.50:0/3246207235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cbc0b4c10 msgr2=0x7f5cbc0c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbaffd700 1 --2- 172.21.15.50:0/3246207235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cbc0b4c10 0x7f5cbc0c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbaffd700 1 -- 172.21.15.50:0/3246207235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb4009a70 con 0x7f5cbc06a530 2023-11-28T11:56:38.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbaffd700 1 --2- 172.21.15.50:0/3246207235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cbc06a530 0x7f5cbc14fba0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5cac000c00 tx=0x7f5cac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:38.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cb37fe700 1 -- 172.21.15.50:0/3246207235 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac004590 con 0x7f5cbc06a530 2023-11-28T11:56:38.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cb37fe700 1 -- 172.21.15.50:0/3246207235 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac01e070 con 0x7f5cbc06a530 2023-11-28T11:56:38.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.389+0000 7f5cbbfff700 1 -- 172.21.15.50:0/3246207235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cac009570 con 0x7f5cbc06a530 2023-11-28T11:56:38.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.393+0000 7f5cb37fe700 1 -- 172.21.15.50:0/3246207235 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac003900 con 0x7f5cbc06a530 2023-11-28T11:56:38.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.393+0000 7f5cbbfff700 1 -- 172.21.15.50:0/3246207235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cbc0b4410 con 0x7f5cbc06a530 2023-11-28T11:56:38.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.393+0000 7f5cbbfff700 1 -- 172.21.15.50:0/3246207235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cbc06af40 con 0x7f5cbc06a530 2023-11-28T11:56:38.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.393+0000 7f5cb37fe700 1 -- 172.21.15.50:0/3246207235 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5cac00f050 con 0x7f5cbc06a530 2023-11-28T11:56:38.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.393+0000 7f5cb37fe700 1 --2- 172.21.15.50:0/3246207235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5c9c064ee0 0x7f5c9c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.393+0000 7f5cb37fe700 1 -- 172.21.15.50:0/3246207235 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5cac082870 con 0x7f5cbc06a530 2023-11-28T11:56:38.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.393+0000 7f5cba7fc700 1 --2- 172.21.15.50:0/3246207235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5c9c064ee0 0x7f5c9c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.397+0000 7f5cba7fc700 1 --2- 172.21.15.50:0/3246207235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5c9c064ee0 0x7f5c9c067390 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc0c6290 tx=0x7f5ca4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:38.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.401+0000 7f5cb37fe700 1 -- 172.21.15.50:0/3246207235 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5cac050ba0 con 0x7f5cbc06a530 2023-11-28T11:56:38.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.565+0000 7f5cbbfff700 1 -- 172.21.15.50:0/3246207235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5cbc0b46f0 con 0x7f5cbc06a530 2023-11-28T11:56:38.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.565+0000 7f5cb37fe700 1 -- 172.21.15.50:0/3246207235 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v62) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5cac015090 con 0x7f5cbc06a530 2023-11-28T11:56:38.570 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:38.570 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-11-28T11:56:38.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-11-28T11:56:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2023-11-28T11:56:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 2, 2023-11-28T11:56:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-11-28T11:56:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:38.571 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-11-28T11:56:38.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.569+0000 7f5cbbfff700 1 -- 172.21.15.50:0/3246207235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5c9c064ee0 msgr2=0x7f5c9c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.569+0000 7f5cbbfff700 1 --2- 172.21.15.50:0/3246207235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5c9c064ee0 0x7f5c9c067390 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc0c6290 tx=0x7f5ca4008040 comp rx=0 tx=0).stop 2023-11-28T11:56:38.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.569+0000 7f5cbbfff700 1 -- 172.21.15.50:0/3246207235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cbc06a530 msgr2=0x7f5cbc14fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.569+0000 7f5cbbfff700 1 --2- 172.21.15.50:0/3246207235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cbc06a530 0x7f5cbc14fba0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5cac000c00 tx=0x7f5cac004770 comp rx=0 tx=0).stop 2023-11-28T11:56:38.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.569+0000 7f5cbbfff700 1 -- 172.21.15.50:0/3246207235 shutdown_connections 2023-11-28T11:56:38.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.569+0000 7f5cbbfff700 1 --2- 172.21.15.50:0/3246207235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cbc0cf050 0x7f5cbc0c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.569+0000 7f5cbbfff700 1 --2- 172.21.15.50:0/3246207235 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5c9c064ee0 0x7f5c9c067390 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.569+0000 7f5cbbfff700 1 --2- 172.21.15.50:0/3246207235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cbc0b4c10 0x7f5cbc0c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.569+0000 7f5cbbfff700 1 --2- 172.21.15.50:0/3246207235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cbc06a530 0x7f5cbc14fba0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.569+0000 7f5cbbfff700 1 -- 172.21.15.50:0/3246207235 >> 172.21.15.50:0/3246207235 conn(0x7f5cbc09bb30 msgr2=0x7f5cbc06cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:38.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.569+0000 7f5cbbfff700 1 -- 172.21.15.50:0/3246207235 shutdown_connections 2023-11-28T11:56:38.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.569+0000 7f5cbbfff700 1 -- 172.21.15.50:0/3246207235 wait complete. 2023-11-28T11:56:38.585 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T11:56:38.586 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T11:56:38.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.709+0000 7f833c97e700 1 Processor -- start 2023-11-28T11:56:38.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.709+0000 7f833c97e700 1 -- start start 2023-11-28T11:56:38.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.709+0000 7f833c97e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f833815be60 0x7f83380cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.709+0000 7f833c97e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833806d560 con 0x7f83380b2a30 2023-11-28T11:56:38.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.709+0000 7f833c97e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83380b0a30 con 0x7f83380d03c0 2023-11-28T11:56:38.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.709+0000 7f833c97e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83380b12d0 con 0x7f833815be60 2023-11-28T11:56:38.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.709+0000 7f8336d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f833815be60 0x7f83380cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.709+0000 7f833759e700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f83380b2a30 0x7f833806bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56814/0 (socket says 172.21.15.50:56814) 2023-11-28T11:56:38.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.709+0000 7f833759e700 1 -- 172.21.15.50:0/1560893397 learned_addr learned my addr 172.21.15.50:0/1560893397 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:38.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.713+0000 7f8335d9b700 1 -- 172.21.15.50:0/1560893397 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534332054 0 0) 0x7f83380b0a30 con 0x7f83380d03c0 2023-11-28T11:56:38.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.713+0000 7f8335d9b700 1 -- 172.21.15.50:0/1560893397 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83200035d0 con 0x7f83380d03c0 2023-11-28T11:56:38.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.713+0000 7f8336d9d700 1 -- 172.21.15.50:0/1560893397 >> v1:172.21.15.192:6789/0 conn(0x7f83380d03c0 legacy=0x7f83380b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.713+0000 7f8336d9d700 1 -- 172.21.15.50:0/1560893397 >> v1:172.21.15.50:6789/0 conn(0x7f83380b2a30 legacy=0x7f833806bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.713+0000 7f8336d9d700 1 -- 172.21.15.50:0/1560893397 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83380b0d10 con 0x7f833815be60 2023-11-28T11:56:38.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.713+0000 7f8336d9d700 1 --2- 172.21.15.50:0/1560893397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f833815be60 0x7f83380cfe80 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8328009880 tx=0x7f8328009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84e7d14f0b5b7e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:38.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.713+0000 7f8335d9b700 1 -- 172.21.15.50:0/1560893397 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328011830 con 0x7f833815be60 2023-11-28T11:56:38.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.713+0000 7f8335d9b700 1 -- 172.21.15.50:0/1560893397 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8328011990 con 0x7f833815be60 2023-11-28T11:56:38.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.713+0000 7f8335d9b700 1 -- 172.21.15.50:0/1560893397 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328011d00 con 0x7f833815be60 2023-11-28T11:56:38.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.713+0000 7f833c97e700 1 -- 172.21.15.50:0/1560893397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f833815be60 msgr2=0x7f83380cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.713+0000 7f833c97e700 1 --2- 172.21.15.50:0/1560893397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f833815be60 0x7f83380cfe80 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8328009880 tx=0x7f8328009b90 comp rx=0 tx=0).stop 2023-11-28T11:56:38.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.713+0000 7f833c97e700 1 -- 172.21.15.50:0/1560893397 shutdown_connections 2023-11-28T11:56:38.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.713+0000 7f833c97e700 1 --2- 172.21.15.50:0/1560893397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f833815be60 0x7f83380cfe80 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.713+0000 7f833c97e700 1 -- 172.21.15.50:0/1560893397 >> 172.21.15.50:0/1560893397 conn(0x7f83380cd2b0 msgr2=0x7f83380cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:38.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.713+0000 7f833c97e700 1 -- 172.21.15.50:0/1560893397 shutdown_connections 2023-11-28T11:56:38.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.713+0000 7f833c97e700 1 -- 172.21.15.50:0/1560893397 wait complete. 2023-11-28T11:56:38.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.717+0000 7f833c97e700 1 Processor -- start 2023-11-28T11:56:38.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.717+0000 7f833c97e700 1 -- start start 2023-11-28T11:56:38.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.717+0000 7f833c97e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83380b2a30 0x7f8338152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.717+0000 7f833c97e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83380d03c0 0x7f83380ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.717+0000 7f833c97e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833815be60 0x7f83380b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.717+0000 7f833c97e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83380c9d80 con 0x7f83380d03c0 2023-11-28T11:56:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.717+0000 7f833c97e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83380c94e0 con 0x7f83380b2a30 2023-11-28T11:56:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.717+0000 7f833c97e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83380c97c0 con 0x7f833815be60 2023-11-28T11:56:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.721+0000 7f833659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83380d03c0 0x7f83380ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.721+0000 7f8336d9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83380b2a30 0x7f8338152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.721+0000 7f8336d9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83380b2a30 0x7f8338152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:55996/0 (socket says 172.21.15.50:55996) 2023-11-28T11:56:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.721+0000 7f833759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833815be60 0x7f83380b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.721+0000 7f8336d9d700 1 -- 172.21.15.50:0/851862930 learned_addr learned my addr 172.21.15.50:0/851862930 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:38.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.721+0000 7f833659c700 1 -- 172.21.15.50:0/851862930 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833815be60 msgr2=0x7f83380b57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.721+0000 7f833659c700 1 --2- 172.21.15.50:0/851862930 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833815be60 0x7f83380b57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.721+0000 7f833659c700 1 -- 172.21.15.50:0/851862930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83380b2a30 msgr2=0x7f8338152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.721+0000 7f833659c700 1 --2- 172.21.15.50:0/851862930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83380b2a30 0x7f8338152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.721+0000 7f833659c700 1 -- 172.21.15.50:0/851862930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83280094b0 con 0x7f83380d03c0 2023-11-28T11:56:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.721+0000 7f833659c700 1 --2- 172.21.15.50:0/851862930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83380d03c0 0x7f83380ca460 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f83380cae30 tx=0x7f832c00c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.721+0000 7f831f7fe700 1 -- 172.21.15.50:0/851862930 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c0052d0 con 0x7f83380d03c0 2023-11-28T11:56:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.721+0000 7f831f7fe700 1 -- 172.21.15.50:0/851862930 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832c005470 con 0x7f83380d03c0 2023-11-28T11:56:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.721+0000 7f833c97e700 1 -- 172.21.15.50:0/851862930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83380b0670 con 0x7f83380d03c0 2023-11-28T11:56:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.721+0000 7f831f7fe700 1 -- 172.21.15.50:0/851862930 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c0038e0 con 0x7f83380d03c0 2023-11-28T11:56:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.721+0000 7f833c97e700 1 -- 172.21.15.50:0/851862930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833806b760 con 0x7f83380d03c0 2023-11-28T11:56:38.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.721+0000 7f833c97e700 1 -- 172.21.15.50:0/851862930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83380b0800 con 0x7f83380d03c0 2023-11-28T11:56:38.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.725+0000 7f831f7fe700 1 -- 172.21.15.50:0/851862930 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f832c019030 con 0x7f83380d03c0 2023-11-28T11:56:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.725+0000 7f831f7fe700 1 --2- 172.21.15.50:0/851862930 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8324064ee0 0x7f8324067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:38.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.725+0000 7f831f7fe700 1 -- 172.21.15.50:0/851862930 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f832c081650 con 0x7f83380d03c0 2023-11-28T11:56:38.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.725+0000 7f8336d9d700 1 --2- 172.21.15.50:0/851862930 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8324064ee0 0x7f8324067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:38.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.725+0000 7f8336d9d700 1 --2- 172.21.15.50:0/851862930 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8324064ee0 0x7f8324067390 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f833815b1b0 tx=0x7f832801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:38.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.733+0000 7f831f7fe700 1 -- 172.21.15.50:0/851862930 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f832c04f960 con 0x7f83380d03c0 2023-11-28T11:56:38.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.897+0000 7f833c97e700 1 -- 172.21.15.50:0/851862930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f83380676e0 con 0x7f83380d03c0 2023-11-28T11:56:39.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:38.997+0000 7f831f7fe700 1 -- 172.21.15.50:0/851862930 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v63) v1 ==== 138+0+0 (secure 0 0 0) 0x7f832c052f80 con 0x7f83380d03c0 2023-11-28T11:56:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.009+0000 7f833c97e700 1 -- 172.21.15.50:0/851862930 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8324064ee0 msgr2=0x7f8324067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.009+0000 7f833c97e700 1 --2- 172.21.15.50:0/851862930 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8324064ee0 0x7f8324067390 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f833815b1b0 tx=0x7f832801c040 comp rx=0 tx=0).stop 2023-11-28T11:56:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.009+0000 7f833c97e700 1 -- 172.21.15.50:0/851862930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83380d03c0 msgr2=0x7f83380ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.009+0000 7f833c97e700 1 --2- 172.21.15.50:0/851862930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83380d03c0 0x7f83380ca460 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f83380cae30 tx=0x7f832c00c6c0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.009+0000 7f833c97e700 1 -- 172.21.15.50:0/851862930 shutdown_connections 2023-11-28T11:56:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.009+0000 7f833c97e700 1 --2- 172.21.15.50:0/851862930 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833815be60 0x7f83380b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.009+0000 7f833c97e700 1 --2- 172.21.15.50:0/851862930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83380d03c0 0x7f83380ca460 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.009+0000 7f833c97e700 1 --2- 172.21.15.50:0/851862930 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8324064ee0 0x7f8324067390 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.009+0000 7f833c97e700 1 --2- 172.21.15.50:0/851862930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83380b2a30 0x7f8338152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.009+0000 7f833c97e700 1 -- 172.21.15.50:0/851862930 >> 172.21.15.50:0/851862930 conn(0x7f83380cd2b0 msgr2=0x7f833806c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.009+0000 7f833c97e700 1 -- 172.21.15.50:0/851862930 shutdown_connections 2023-11-28T11:56:39.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.009+0000 7f833c97e700 1 -- 172.21.15.50:0/851862930 wait complete. 2023-11-28T11:56:39.015 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-11-28T11:56:39.027 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T11:56:39.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.145+0000 7f58854a0700 1 Processor -- start 2023-11-28T11:56:39.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.145+0000 7f58854a0700 1 -- start start 2023-11-28T11:56:39.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.145+0000 7f58854a0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58800b1ae0 0x7f588006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:39.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.145+0000 7f58854a0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f58800cf0e0 0x7f58800cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:39.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.145+0000 7f58854a0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58800cfa80 con 0x7f588006a4c0 2023-11-28T11:56:39.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.145+0000 7f58854a0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58800d0ab0 con 0x7f58800cf0e0 2023-11-28T11:56:39.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.145+0000 7f58854a0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588006a9c0 con 0x7f58800b1ae0 2023-11-28T11:56:39.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.145+0000 7f587f7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f588006a4c0 0x7f58800d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56828/0 (socket says 172.21.15.50:56828) 2023-11-28T11:56:39.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f587f7fe700 1 -- 172.21.15.50:0/384373469 learned_addr learned my addr 172.21.15.50:0/384373469 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:39.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f587ffff700 1 --2- 172.21.15.50:0/384373469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58800b1ae0 0x7f588006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:39.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f5884c9f700 1 --2- 172.21.15.50:0/384373469 >> v2:172.21.15.192:3300/0 conn(0x7f58800cf0e0 0x7f58800cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:39.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f587effd700 1 -- 172.21.15.50:0/384373469 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343764850 0 0) 0x7f58800cfa80 con 0x7f588006a4c0 2023-11-28T11:56:39.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f587effd700 1 -- 172.21.15.50:0/384373469 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f586c0035d0 con 0x7f588006a4c0 2023-11-28T11:56:39.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f587ffff700 1 -- 172.21.15.50:0/384373469 >> v2:172.21.15.192:3300/0 conn(0x7f58800cf0e0 msgr2=0x7f58800cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:39.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f587ffff700 1 --2- 172.21.15.50:0/384373469 >> v2:172.21.15.192:3300/0 conn(0x7f58800cf0e0 0x7f58800cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f587ffff700 1 -- 172.21.15.50:0/384373469 >> v1:172.21.15.50:6789/0 conn(0x7f588006a4c0 legacy=0x7f58800d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:39.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f587ffff700 1 -- 172.21.15.50:0/384373469 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588006aca0 con 0x7f58800b1ae0 2023-11-28T11:56:39.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f587ffff700 1 --2- 172.21.15.50:0/384373469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58800b1ae0 0x7f588006d8e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5870009850 tx=0x7f5870009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff6e56ffcc6dfe25 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:39.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f587effd700 1 -- 172.21.15.50:0/384373469 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870011830 con 0x7f58800b1ae0 2023-11-28T11:56:39.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f587effd700 1 -- 172.21.15.50:0/384373469 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5870011990 con 0x7f58800b1ae0 2023-11-28T11:56:39.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f587effd700 1 -- 172.21.15.50:0/384373469 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870011d00 con 0x7f58800b1ae0 2023-11-28T11:56:39.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f58854a0700 1 -- 172.21.15.50:0/384373469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58800b1ae0 msgr2=0x7f588006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:39.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f58854a0700 1 --2- 172.21.15.50:0/384373469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58800b1ae0 0x7f588006d8e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5870009850 tx=0x7f5870009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:39.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f58854a0700 1 -- 172.21.15.50:0/384373469 shutdown_connections 2023-11-28T11:56:39.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f58854a0700 1 --2- 172.21.15.50:0/384373469 >> v2:172.21.15.192:3300/0 conn(0x7f58800cf0e0 0x7f58800cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f58854a0700 1 --2- 172.21.15.50:0/384373469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58800b1ae0 0x7f588006d8e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f58854a0700 1 -- 172.21.15.50:0/384373469 >> 172.21.15.50:0/384373469 conn(0x7f588009bbd0 msgr2=0x7f58800b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:39.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f58854a0700 1 -- 172.21.15.50:0/384373469 shutdown_connections 2023-11-28T11:56:39.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.149+0000 7f58854a0700 1 -- 172.21.15.50:0/384373469 wait complete. 2023-11-28T11:56:39.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f58854a0700 1 Processor -- start 2023-11-28T11:56:39.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f58854a0700 1 -- start start 2023-11-28T11:56:39.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f58854a0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f588006a4c0 0x7f588015f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:39.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f58854a0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58800b1ae0 0x7f588009c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:39.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f58854a0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58800cf0e0 0x7f588015e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:39.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f58854a0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588015f9b0 con 0x7f58800b1ae0 2023-11-28T11:56:39.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f58854a0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588015d530 con 0x7f588006a4c0 2023-11-28T11:56:39.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f58854a0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588009ca80 con 0x7f58800cf0e0 2023-11-28T11:56:39.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f587f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58800b1ae0 0x7f588009c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:39.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f587f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58800b1ae0 0x7f588009c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38326/0 (socket says 172.21.15.50:38326) 2023-11-28T11:56:39.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f587f7fe700 1 -- 172.21.15.50:0/185799681 learned_addr learned my addr 172.21.15.50:0/185799681 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:39.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f5884c9f700 1 --2- 172.21.15.50:0/185799681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58800cf0e0 0x7f588015e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:39.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f587ffff700 1 --2- 172.21.15.50:0/185799681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f588006a4c0 0x7f588015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:39.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f587f7fe700 1 -- 172.21.15.50:0/185799681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58800cf0e0 msgr2=0x7f588015e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:39.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f587f7fe700 1 --2- 172.21.15.50:0/185799681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58800cf0e0 0x7f588015e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f587f7fe700 1 -- 172.21.15.50:0/185799681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f588006a4c0 msgr2=0x7f588015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:39.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f587f7fe700 1 --2- 172.21.15.50:0/185799681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f588006a4c0 0x7f588015f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:39.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f587f7fe700 1 -- 172.21.15.50:0/185799681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58700094b0 con 0x7f58800b1ae0 2023-11-28T11:56:39.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f587f7fe700 1 --2- 172.21.15.50:0/185799681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58800b1ae0 0x7f588009c540 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f586800c4d0 tx=0x7f586800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:39.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.153+0000 7f587cff9700 1 -- 172.21.15.50:0/185799681 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868005d90 con 0x7f58800b1ae0 2023-11-28T11:56:39.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.157+0000 7f58854a0700 1 -- 172.21.15.50:0/185799681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58800b4380 con 0x7f58800b1ae0 2023-11-28T11:56:39.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.157+0000 7f58854a0700 1 -- 172.21.15.50:0/185799681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588006af80 con 0x7f58800b1ae0 2023-11-28T11:56:39.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.157+0000 7f587cff9700 1 -- 172.21.15.50:0/185799681 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5868001210 con 0x7f58800b1ae0 2023-11-28T11:56:39.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.157+0000 7f587cff9700 1 -- 172.21.15.50:0/185799681 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58680072d0 con 0x7f58800b1ae0 2023-11-28T11:56:39.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.157+0000 7f58854a0700 1 -- 172.21.15.50:0/185799681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5864005310 con 0x7f58800b1ae0 2023-11-28T11:56:39.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.157+0000 7f587cff9700 1 -- 172.21.15.50:0/185799681 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5868019030 con 0x7f58800b1ae0 2023-11-28T11:56:39.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.157+0000 7f587cff9700 1 --2- 172.21.15.50:0/185799681 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5860064ee0 0x7f5860067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:39.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.157+0000 7f587cff9700 1 -- 172.21.15.50:0/185799681 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f5868081090 con 0x7f58800b1ae0 2023-11-28T11:56:39.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.157+0000 7f587ffff700 1 --2- 172.21.15.50:0/185799681 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5860064ee0 0x7f5860067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:39.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.161+0000 7f587ffff700 1 --2- 172.21.15.50:0/185799681 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5860064ee0 0x7f5860067390 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f58700090b0 tx=0x7f587001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:39.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.169+0000 7f587cff9700 1 -- 172.21.15.50:0/185799681 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f586804a400 con 0x7f58800b1ae0 2023-11-28T11:56:39.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:39.329+0000 7f58854a0700 1 -- 172.21.15.50:0/185799681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f58640055c0 con 0x7f58800b1ae0 2023-11-28T11:56:40.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.005+0000 7f587cff9700 1 -- 172.21.15.50:0/185799681 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v64) v1 ==== 170+0+0 (secure 0 0 0) 0x7f586804f290 con 0x7f58800b1ae0 2023-11-28T11:56:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.029+0000 7f58854a0700 1 -- 172.21.15.50:0/185799681 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5860064ee0 msgr2=0x7f5860067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.029+0000 7f58854a0700 1 --2- 172.21.15.50:0/185799681 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5860064ee0 0x7f5860067390 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f58700090b0 tx=0x7f587001c040 comp rx=0 tx=0).stop 2023-11-28T11:56:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.029+0000 7f58854a0700 1 -- 172.21.15.50:0/185799681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58800b1ae0 msgr2=0x7f588009c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.029+0000 7f58854a0700 1 --2- 172.21.15.50:0/185799681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58800b1ae0 0x7f588009c540 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f586800c4d0 tx=0x7f586800c890 comp rx=0 tx=0).stop 2023-11-28T11:56:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.029+0000 7f58854a0700 1 -- 172.21.15.50:0/185799681 shutdown_connections 2023-11-28T11:56:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.029+0000 7f58854a0700 1 --2- 172.21.15.50:0/185799681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58800cf0e0 0x7f588015e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.029+0000 7f58854a0700 1 --2- 172.21.15.50:0/185799681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58800b1ae0 0x7f588009c540 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.029+0000 7f58854a0700 1 --2- 172.21.15.50:0/185799681 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5860064ee0 0x7f5860067390 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.029+0000 7f58854a0700 1 --2- 172.21.15.50:0/185799681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f588006a4c0 0x7f588015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.029+0000 7f58854a0700 1 -- 172.21.15.50:0/185799681 >> 172.21.15.50:0/185799681 conn(0x7f588009bbd0 msgr2=0x7f58800b5790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.029+0000 7f58854a0700 1 -- 172.21.15.50:0/185799681 shutdown_connections 2023-11-28T11:56:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.029+0000 7f58854a0700 1 -- 172.21.15.50:0/185799681 wait complete. 2023-11-28T11:56:40.035 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-11-28T11:56:40.047 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T11:56:40.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f2577fff700 1 Processor -- start 2023-11-28T11:56:40.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f2577fff700 1 -- start start 2023-11-28T11:56:40.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f2577fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25780b00e0 0x7f257815d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f2577fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f25780cbb30 0x7f257806bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f2577fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25780b2db0 con 0x7f257809bdb0 2023-11-28T11:56:40.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f2577fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25780b3240 con 0x7f25780b00e0 2023-11-28T11:56:40.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f2577fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257806d840 con 0x7f25780cbb30 2023-11-28T11:56:40.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f2576ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25780b00e0 0x7f257815d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f25767fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f257809bdb0 0x7f257815d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56842/0 (socket says 172.21.15.50:56842) 2023-11-28T11:56:40.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f25767fc700 1 -- 172.21.15.50:0/743918213 learned_addr learned my addr 172.21.15.50:0/743918213 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:40.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f25777fe700 1 --2- 172.21.15.50:0/743918213 >> v2:172.21.15.192:3300/0 conn(0x7f25780cbb30 0x7f257806bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f2575ffb700 1 -- 172.21.15.50:0/743918213 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310884066 0 0) 0x7f25780b2db0 con 0x7f257809bdb0 2023-11-28T11:56:40.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f2575ffb700 1 -- 172.21.15.50:0/743918213 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25600035d0 con 0x7f257809bdb0 2023-11-28T11:56:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f2576ffd700 1 -- 172.21.15.50:0/743918213 >> v2:172.21.15.192:3300/0 conn(0x7f25780cbb30 msgr2=0x7f257806bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f2576ffd700 1 --2- 172.21.15.50:0/743918213 >> v2:172.21.15.192:3300/0 conn(0x7f25780cbb30 0x7f257806bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f2576ffd700 1 -- 172.21.15.50:0/743918213 >> v1:172.21.15.50:6789/0 conn(0x7f257809bdb0 legacy=0x7f257815d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f2576ffd700 1 -- 172.21.15.50:0/743918213 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257806d560 con 0x7f25780b00e0 2023-11-28T11:56:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.161+0000 7f25777fe700 1 --2- 172.21.15.50:0/743918213 >> v2:172.21.15.192:3300/0 conn(0x7f25780cbb30 0x7f257806bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.165+0000 7f2576ffd700 1 --2- 172.21.15.50:0/743918213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25780b00e0 0x7f257815d2e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f25780ce360 tx=0x7f256c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27a2fea9dd99d8c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.165+0000 7f2575ffb700 1 -- 172.21.15.50:0/743918213 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c011830 con 0x7f25780b00e0 2023-11-28T11:56:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.165+0000 7f2575ffb700 1 -- 172.21.15.50:0/743918213 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c011990 con 0x7f25780b00e0 2023-11-28T11:56:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.165+0000 7f2575ffb700 1 -- 172.21.15.50:0/743918213 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c011d20 con 0x7f25780b00e0 2023-11-28T11:56:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.165+0000 7f2577fff700 1 -- 172.21.15.50:0/743918213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25780b00e0 msgr2=0x7f257815d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.165+0000 7f2577fff700 1 --2- 172.21.15.50:0/743918213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25780b00e0 0x7f257815d2e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f25780ce360 tx=0x7f256c009b30 comp rx=0 tx=0).stop 2023-11-28T11:56:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.165+0000 7f2577fff700 1 -- 172.21.15.50:0/743918213 shutdown_connections 2023-11-28T11:56:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.165+0000 7f2577fff700 1 --2- 172.21.15.50:0/743918213 >> v2:172.21.15.192:3300/0 conn(0x7f25780cbb30 0x7f257806bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.165+0000 7f2577fff700 1 --2- 172.21.15.50:0/743918213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25780b00e0 0x7f257815d2e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.165+0000 7f2577fff700 1 -- 172.21.15.50:0/743918213 >> 172.21.15.50:0/743918213 conn(0x7f25780cae70 msgr2=0x7f25780cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:40.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.165+0000 7f2577fff700 1 -- 172.21.15.50:0/743918213 shutdown_connections 2023-11-28T11:56:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.165+0000 7f2577fff700 1 -- 172.21.15.50:0/743918213 wait complete. 2023-11-28T11:56:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.165+0000 7f2577fff700 1 Processor -- start 2023-11-28T11:56:40.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.165+0000 7f2577fff700 1 -- start start 2023-11-28T11:56:40.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f2577fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f257809bdb0 0x7f25781e3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f2577fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25780b00e0 0x7f257815b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f2577fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25780cbb30 0x7f25780c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f2577fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25781e3940 con 0x7f257809bdb0 2023-11-28T11:56:40.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f2576ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f257809bdb0 0x7f25781e3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f2577fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25781e2360 con 0x7f25780cbb30 2023-11-28T11:56:40.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f2577fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25781e2640 con 0x7f25780b00e0 2023-11-28T11:56:40.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f2576ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f257809bdb0 0x7f25781e3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38346/0 (socket says 172.21.15.50:38346) 2023-11-28T11:56:40.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f2576ffd700 1 -- 172.21.15.50:0/3241428387 learned_addr learned my addr 172.21.15.50:0/3241428387 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:40.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f2576ffd700 1 -- 172.21.15.50:0/3241428387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25780b00e0 msgr2=0x7f257815b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f2576ffd700 1 --2- 172.21.15.50:0/3241428387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25780b00e0 0x7f257815b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f2576ffd700 1 -- 172.21.15.50:0/3241428387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25780cbb30 msgr2=0x7f25780c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f2576ffd700 1 --2- 172.21.15.50:0/3241428387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25780cbb30 0x7f25780c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f2576ffd700 1 -- 172.21.15.50:0/3241428387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25700094b0 con 0x7f257809bdb0 2023-11-28T11:56:40.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f2576ffd700 1 --2- 172.21.15.50:0/3241428387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f257809bdb0 0x7f25781e3400 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f256c009b70 tx=0x7f256c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:40.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f255f7fe700 1 -- 172.21.15.50:0/3241428387 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c0044c0 con 0x7f257809bdb0 2023-11-28T11:56:40.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f255f7fe700 1 -- 172.21.15.50:0/3241428387 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c01f070 con 0x7f257809bdb0 2023-11-28T11:56:40.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f2577fff700 1 -- 172.21.15.50:0/3241428387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256c0094b0 con 0x7f257809bdb0 2023-11-28T11:56:40.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f255f7fe700 1 -- 172.21.15.50:0/3241428387 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c0038c0 con 0x7f257809bdb0 2023-11-28T11:56:40.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.169+0000 7f2577fff700 1 -- 172.21.15.50:0/3241428387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25780ac3d0 con 0x7f257809bdb0 2023-11-28T11:56:40.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.173+0000 7f2577fff700 1 -- 172.21.15.50:0/3241428387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25780ac0f0 con 0x7f257809bdb0 2023-11-28T11:56:40.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.173+0000 7f255f7fe700 1 -- 172.21.15.50:0/3241428387 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f256c02a020 con 0x7f257809bdb0 2023-11-28T11:56:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.173+0000 7f255f7fe700 1 --2- 172.21.15.50:0/3241428387 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2564064ee0 0x7f2564067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.173+0000 7f255f7fe700 1 -- 172.21.15.50:0/3241428387 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f256c0834d0 con 0x7f257809bdb0 2023-11-28T11:56:40.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.173+0000 7f25767fc700 1 --2- 172.21.15.50:0/3241428387 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2564064ee0 0x7f2564067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.173+0000 7f25767fc700 1 --2- 172.21.15.50:0/3241428387 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2564064ee0 0x7f2564067390 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f25780aba40 tx=0x7f25680015f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:40.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.181+0000 7f255f7fe700 1 -- 172.21.15.50:0/3241428387 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f256c051640 con 0x7f257809bdb0 2023-11-28T11:56:40.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.381+0000 7f2577fff700 1 -- 172.21.15.50:0/3241428387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f25780cc9f0 con 0x7f257809bdb0 2023-11-28T11:56:40.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.389+0000 7f255f7fe700 1 -- 172.21.15.50:0/3241428387 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v29) v1 ==== 174+0+0 (secure 0 0 0) 0x7f256c054c60 con 0x7f257809bdb0 2023-11-28T11:56:40.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.393+0000 7f2577fff700 1 -- 172.21.15.50:0/3241428387 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2564064ee0 msgr2=0x7f2564067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.393+0000 7f2577fff700 1 --2- 172.21.15.50:0/3241428387 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2564064ee0 0x7f2564067390 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f25780aba40 tx=0x7f25680015f0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.393+0000 7f2577fff700 1 -- 172.21.15.50:0/3241428387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f257809bdb0 msgr2=0x7f25781e3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.393+0000 7f2577fff700 1 --2- 172.21.15.50:0/3241428387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f257809bdb0 0x7f25781e3400 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f256c009b70 tx=0x7f256c004770 comp rx=0 tx=0).stop 2023-11-28T11:56:40.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.393+0000 7f2577fff700 1 -- 172.21.15.50:0/3241428387 shutdown_connections 2023-11-28T11:56:40.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.393+0000 7f2577fff700 1 --2- 172.21.15.50:0/3241428387 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2564064ee0 0x7f2564067390 secure :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f25780aba40 tx=0x7f25680015f0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.393+0000 7f2577fff700 1 --2- 172.21.15.50:0/3241428387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25780cbb30 0x7f25780c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.393+0000 7f2577fff700 1 --2- 172.21.15.50:0/3241428387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25780b00e0 0x7f257815b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.393+0000 7f2577fff700 1 --2- 172.21.15.50:0/3241428387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f257809bdb0 0x7f25781e3400 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.393+0000 7f2577fff700 1 -- 172.21.15.50:0/3241428387 >> 172.21.15.50:0/3241428387 conn(0x7f25780cae70 msgr2=0x7f257806a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:40.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.401+0000 7f2577fff700 1 -- 172.21.15.50:0/3241428387 shutdown_connections 2023-11-28T11:56:40.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.405+0000 7f2577fff700 1 -- 172.21.15.50:0/3241428387 wait complete. 2023-11-28T11:56:40.410 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 10 and data pool 11 2023-11-28T11:56:40.427 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:40.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faad4867700 1 Processor -- start 2023-11-28T11:56:40.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faad4867700 1 -- start start 2023-11-28T11:56:40.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faad4867700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faad006d7d0 0x7faad006a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faad4867700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad00b4c10 0x7faad00cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faad4867700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad006dc70 con 0x7faad00cf050 2023-11-28T11:56:40.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faad4867700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad006aa70 con 0x7faad006d7d0 2023-11-28T11:56:40.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faad4867700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad015c6d0 con 0x7faad00b4c10 2023-11-28T11:56:40.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faacf59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad00b4c10 0x7faad00cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faace59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faad006d7d0 0x7faad006a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faace59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faad006d7d0 0x7faad006a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:56028/0 (socket says 172.21.15.50:56028) 2023-11-28T11:56:40.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faacf59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad00b4c10 0x7faad00cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:36956/0 (socket says 172.21.15.50:36956) 2023-11-28T11:56:40.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faace59c700 1 -- 172.21.15.50:0/1497242000 learned_addr learned my addr 172.21.15.50:0/1497242000 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:40.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faaced9d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7faad00cf050 0x7faad00cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:41792/0 (socket says 172.21.15.50:41792) 2023-11-28T11:56:40.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faacf59e700 1 -- 172.21.15.50:0/1497242000 >> v2:172.21.15.192:3300/0 conn(0x7faad006d7d0 msgr2=0x7faad006a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:40.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faacf59e700 1 --2- 172.21.15.50:0/1497242000 >> v2:172.21.15.192:3300/0 conn(0x7faad006d7d0 0x7faad006a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faacf59e700 1 -- 172.21.15.50:0/1497242000 >> v1:172.21.15.192:6789/0 conn(0x7faad00cf050 legacy=0x7faad00cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faacf59e700 1 -- 172.21.15.50:0/1497242000 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad006ac60 con 0x7faad00b4c10 2023-11-28T11:56:40.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faace59c700 1 --2- 172.21.15.50:0/1497242000 >> v2:172.21.15.192:3300/0 conn(0x7faad006d7d0 0x7faad006a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:40.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faacf59e700 1 --2- 172.21.15.50:0/1497242000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad00b4c10 0x7faad00cce20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faac8009d90 tx=0x7faac800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21e51da78a67eefc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:40.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faacdd9b700 1 -- 172.21.15.50:0/1497242000 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac800e070 con 0x7faad00b4c10 2023-11-28T11:56:40.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faacdd9b700 1 -- 172.21.15.50:0/1497242000 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac800bb20 con 0x7faad00b4c10 2023-11-28T11:56:40.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.525+0000 7faacdd9b700 1 -- 172.21.15.50:0/1497242000 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac8012430 con 0x7faad00b4c10 2023-11-28T11:56:40.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.529+0000 7faad4867700 1 -- 172.21.15.50:0/1497242000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad00b4c10 msgr2=0x7faad00cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.529+0000 7faad4867700 1 --2- 172.21.15.50:0/1497242000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad00b4c10 0x7faad00cce20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faac8009d90 tx=0x7faac800b330 comp rx=0 tx=0).stop 2023-11-28T11:56:40.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.529+0000 7faad4867700 1 -- 172.21.15.50:0/1497242000 shutdown_connections 2023-11-28T11:56:40.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.529+0000 7faad4867700 1 --2- 172.21.15.50:0/1497242000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad00b4c10 0x7faad00cce20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.529+0000 7faad4867700 1 --2- 172.21.15.50:0/1497242000 >> v2:172.21.15.192:3300/0 conn(0x7faad006d7d0 0x7faad006a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.529+0000 7faad4867700 1 -- 172.21.15.50:0/1497242000 >> 172.21.15.50:0/1497242000 conn(0x7faad009bb30 msgr2=0x7faad00b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:40.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.529+0000 7faad4867700 1 -- 172.21.15.50:0/1497242000 shutdown_connections 2023-11-28T11:56:40.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.529+0000 7faad4867700 1 -- 172.21.15.50:0/1497242000 wait complete. 2023-11-28T11:56:40.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.529+0000 7faad4867700 1 Processor -- start 2023-11-28T11:56:40.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.529+0000 7faad4867700 1 -- start start 2023-11-28T11:56:40.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faad4867700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad006d7d0 0x7faad00c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faad4867700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faad00b4c10 0x7faad0158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faad4867700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad00cf050 0x7faad01591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faad4867700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad0159700 con 0x7faad006d7d0 2023-11-28T11:56:40.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faad4867700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad015c8a0 con 0x7faad00b4c10 2023-11-28T11:56:40.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faad4867700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad015cb40 con 0x7faad00cf050 2023-11-28T11:56:40.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faaced9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad006d7d0 0x7faad00c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faaced9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad006d7d0 0x7faad00c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38352/0 (socket says 172.21.15.50:38352) 2023-11-28T11:56:40.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faaced9d700 1 -- 172.21.15.50:0/3322414857 learned_addr learned my addr 172.21.15.50:0/3322414857 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:40.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faace59c700 1 --2- 172.21.15.50:0/3322414857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faad00b4c10 0x7faad0158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faacf59e700 1 --2- 172.21.15.50:0/3322414857 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad00cf050 0x7faad01591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faaced9d700 1 -- 172.21.15.50:0/3322414857 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad00cf050 msgr2=0x7faad01591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faaced9d700 1 --2- 172.21.15.50:0/3322414857 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad00cf050 0x7faad01591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faaced9d700 1 -- 172.21.15.50:0/3322414857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faad00b4c10 msgr2=0x7faad0158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faaced9d700 1 --2- 172.21.15.50:0/3322414857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faad00b4c10 0x7faad0158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faaced9d700 1 -- 172.21.15.50:0/3322414857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac4009570 con 0x7faad006d7d0 2023-11-28T11:56:40.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faaced9d700 1 --2- 172.21.15.50:0/3322414857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad006d7d0 0x7faad00c7f40 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7faac000c4d0 tx=0x7faac000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:40.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faab77fe700 1 -- 172.21.15.50:0/3322414857 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac000cea0 con 0x7faad006d7d0 2023-11-28T11:56:40.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faab77fe700 1 -- 172.21.15.50:0/3322414857 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac0005cd0 con 0x7faad006d7d0 2023-11-28T11:56:40.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faad4867700 1 -- 172.21.15.50:0/3322414857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac8009a70 con 0x7faad006d7d0 2023-11-28T11:56:40.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faab77fe700 1 -- 172.21.15.50:0/3322414857 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac00072d0 con 0x7faad006d7d0 2023-11-28T11:56:40.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faad4867700 1 -- 172.21.15.50:0/3322414857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad00b4410 con 0x7faad006d7d0 2023-11-28T11:56:40.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.533+0000 7faad4867700 1 -- 172.21.15.50:0/3322414857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad006af40 con 0x7faad006d7d0 2023-11-28T11:56:40.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.537+0000 7faab77fe700 1 -- 172.21.15.50:0/3322414857 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faac0019030 con 0x7faad006d7d0 2023-11-28T11:56:40.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.537+0000 7faab77fe700 1 --2- 172.21.15.50:0/3322414857 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faabc064ee0 0x7faabc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.537+0000 7faab77fe700 1 -- 172.21.15.50:0/3322414857 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6382+0+0 (secure 0 0 0) 0x7faac0080f10 con 0x7faad006d7d0 2023-11-28T11:56:40.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.537+0000 7faace59c700 1 --2- 172.21.15.50:0/3322414857 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faabc064ee0 0x7faabc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.537+0000 7faace59c700 1 --2- 172.21.15.50:0/3322414857 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faabc064ee0 0x7faabc067390 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7faad00d2480 tx=0x7faac40092e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:40.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.545+0000 7faab77fe700 1 -- 172.21.15.50:0/3322414857 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faac004a400 con 0x7faad006d7d0 2023-11-28T11:56:40.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.705+0000 7faad4867700 1 -- 172.21.15.50:0/3322414857 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faad00b46f0 con 0x7faad006d7d0 2023-11-28T11:56:40.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.705+0000 7faab77fe700 1 -- 172.21.15.50:0/3322414857 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+18042 (secure 0 0 0) 0x7faac0017090 con 0x7faad006d7d0 2023-11-28T11:56:40.711 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:40.711 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":65,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:56:40.385344+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.943405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:39.374123+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:40.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.709+0000 7faad4867700 1 -- 172.21.15.50:0/3322414857 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faabc064ee0 msgr2=0x7faabc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.709+0000 7faad4867700 1 --2- 172.21.15.50:0/3322414857 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faabc064ee0 0x7faabc067390 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7faad00d2480 tx=0x7faac40092e0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.709+0000 7faad4867700 1 -- 172.21.15.50:0/3322414857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad006d7d0 msgr2=0x7faad00c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.709+0000 7faad4867700 1 --2- 172.21.15.50:0/3322414857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad006d7d0 0x7faad00c7f40 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7faac000c4d0 tx=0x7faac000c7e0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.709+0000 7faad4867700 1 -- 172.21.15.50:0/3322414857 shutdown_connections 2023-11-28T11:56:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.709+0000 7faad4867700 1 --2- 172.21.15.50:0/3322414857 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad00cf050 0x7faad01591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.709+0000 7faad4867700 1 --2- 172.21.15.50:0/3322414857 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faabc064ee0 0x7faabc067390 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.709+0000 7faad4867700 1 --2- 172.21.15.50:0/3322414857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faad00b4c10 0x7faad0158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.709+0000 7faad4867700 1 --2- 172.21.15.50:0/3322414857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faad006d7d0 0x7faad00c7f40 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.709+0000 7faad4867700 1 -- 172.21.15.50:0/3322414857 >> 172.21.15.50:0/3322414857 conn(0x7faad009bb30 msgr2=0x7faad0069dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.709+0000 7faad4867700 1 -- 172.21.15.50:0/3322414857 shutdown_connections 2023-11-28T11:56:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.709+0000 7faad4867700 1 -- 172.21.15.50:0/3322414857 wait complete. 2023-11-28T11:56:40.727 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.833+0000 7f375d541700 1 Processor -- start 2023-11-28T11:56:40.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.833+0000 7f375d541700 1 -- start start 2023-11-28T11:56:40.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.833+0000 7f375d541700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f37580ca310 0x7f375806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.833+0000 7f375d541700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f375806cd80 0x7f375815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.833+0000 7f375d541700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37580cca10 con 0x7f3758069eb0 2023-11-28T11:56:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.833+0000 7f375d541700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37580cdeb0 con 0x7f37580ca310 2023-11-28T11:56:40.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.833+0000 7f375d541700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375806a670 con 0x7f375806cd80 2023-11-28T11:56:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f375cd40700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f375806cd80 0x7f375815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f3757fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f37580ca310 0x7f375806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f37577fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3758069eb0 0x7f375806c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:41796/0 (socket says 172.21.15.50:41796) 2023-11-28T11:56:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f37577fe700 1 -- 172.21.15.50:0/853871124 learned_addr learned my addr 172.21.15.50:0/853871124 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f375cd40700 1 -- 172.21.15.50:0/853871124 >> v2:172.21.15.192:3300/0 conn(0x7f37580ca310 msgr2=0x7f375806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:40.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f375cd40700 1 --2- 172.21.15.50:0/853871124 >> v2:172.21.15.192:3300/0 conn(0x7f37580ca310 0x7f375806c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f375cd40700 1 -- 172.21.15.50:0/853871124 >> v1:172.21.15.192:6789/0 conn(0x7f3758069eb0 legacy=0x7f375806c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f375cd40700 1 -- 172.21.15.50:0/853871124 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375806a950 con 0x7f375806cd80 2023-11-28T11:56:40.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f3756ffd700 1 -- 172.21.15.50:0/853871124 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032043638 0 0) 0x7f37580cca10 con 0x7f3758069eb0 2023-11-28T11:56:40.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f375cd40700 1 --2- 172.21.15.50:0/853871124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f375806cd80 0x7f375815b9f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3750009d90 tx=0x7f375000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64a3da3b700b372d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f3756ffd700 1 -- 172.21.15.50:0/853871124 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375000e070 con 0x7f375806cd80 2023-11-28T11:56:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f3756ffd700 1 -- 172.21.15.50:0/853871124 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375000bb20 con 0x7f375806cd80 2023-11-28T11:56:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f3756ffd700 1 -- 172.21.15.50:0/853871124 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3750012430 con 0x7f375806cd80 2023-11-28T11:56:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f375d541700 1 -- 172.21.15.50:0/853871124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f375806cd80 msgr2=0x7f375815b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f375d541700 1 --2- 172.21.15.50:0/853871124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f375806cd80 0x7f375815b9f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3750009d90 tx=0x7f375000b330 comp rx=0 tx=0).stop 2023-11-28T11:56:40.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f375d541700 1 -- 172.21.15.50:0/853871124 shutdown_connections 2023-11-28T11:56:40.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f375d541700 1 --2- 172.21.15.50:0/853871124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f375806cd80 0x7f375815b9f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f375d541700 1 --2- 172.21.15.50:0/853871124 >> v2:172.21.15.192:3300/0 conn(0x7f37580ca310 0x7f375806c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f375d541700 1 -- 172.21.15.50:0/853871124 >> 172.21.15.50:0/853871124 conn(0x7f37580ce3e0 msgr2=0x7f37580ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:40.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f375d541700 1 -- 172.21.15.50:0/853871124 shutdown_connections 2023-11-28T11:56:40.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.837+0000 7f375d541700 1 -- 172.21.15.50:0/853871124 wait complete. 2023-11-28T11:56:40.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f375d541700 1 Processor -- start 2023-11-28T11:56:40.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f375d541700 1 -- start start 2023-11-28T11:56:40.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f375d541700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3758069eb0 0x7f3758154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f375d541700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f375806cd80 0x7f37580c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f375d541700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37580ca310 0x7f37580ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f375d541700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37580ad4d0 con 0x7f3758069eb0 2023-11-28T11:56:40.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f375d541700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37581547a0 con 0x7f375806cd80 2023-11-28T11:56:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f375d541700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37580ac8c0 con 0x7f37580ca310 2023-11-28T11:56:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f3757fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3758069eb0 0x7f3758154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f3757fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3758069eb0 0x7f3758154260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38368/0 (socket says 172.21.15.50:38368) 2023-11-28T11:56:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f375cd40700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37580ca310 0x7f37580ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f37577fe700 1 --2- 172.21.15.50:0/4214667020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f375806cd80 0x7f37580c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f3757fff700 1 -- 172.21.15.50:0/4214667020 learned_addr learned my addr 172.21.15.50:0/4214667020 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:40.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f3757fff700 1 -- 172.21.15.50:0/4214667020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37580ca310 msgr2=0x7f37580ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f3757fff700 1 --2- 172.21.15.50:0/4214667020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37580ca310 0x7f37580ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f3757fff700 1 -- 172.21.15.50:0/4214667020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f375806cd80 msgr2=0x7f37580c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:40.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f3757fff700 1 --2- 172.21.15.50:0/4214667020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f375806cd80 0x7f37580c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:40.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f3757fff700 1 -- 172.21.15.50:0/4214667020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3750009a70 con 0x7f3758069eb0 2023-11-28T11:56:40.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f3757fff700 1 --2- 172.21.15.50:0/4214667020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3758069eb0 0x7f3758154260 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f374c00e840 tx=0x7f374c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:40.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f3754ff9700 1 -- 172.21.15.50:0/4214667020 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c0095a0 con 0x7f3758069eb0 2023-11-28T11:56:40.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f3754ff9700 1 -- 172.21.15.50:0/4214667020 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c013680 con 0x7f3758069eb0 2023-11-28T11:56:40.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f375d541700 1 -- 172.21.15.50:0/4214667020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37580c8a30 con 0x7f3758069eb0 2023-11-28T11:56:40.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f3754ff9700 1 -- 172.21.15.50:0/4214667020 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c0139f0 con 0x7f3758069eb0 2023-11-28T11:56:40.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.841+0000 7f375d541700 1 -- 172.21.15.50:0/4214667020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375806ac30 con 0x7f3758069eb0 2023-11-28T11:56:40.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.845+0000 7f375d541700 1 -- 172.21.15.50:0/4214667020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375806af10 con 0x7f3758069eb0 2023-11-28T11:56:40.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.845+0000 7f3754ff9700 1 -- 172.21.15.50:0/4214667020 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f374c019030 con 0x7f3758069eb0 2023-11-28T11:56:40.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.845+0000 7f3754ff9700 1 --2- 172.21.15.50:0/4214667020 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3744064f10 0x7f37440673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:40.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.845+0000 7f3754ff9700 1 -- 172.21.15.50:0/4214667020 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f374c082540 con 0x7f3758069eb0 2023-11-28T11:56:40.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.845+0000 7f37577fe700 1 --2- 172.21.15.50:0/4214667020 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3744064f10 0x7f37440673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:40.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.849+0000 7f37577fe700 1 --2- 172.21.15.50:0/4214667020 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3744064f10 0x7f37440673c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3758154cf0 tx=0x7f3748007e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:40.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:40.849+0000 7f3754ff9700 1 -- 172.21.15.50:0/4214667020 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f374c0504d0 con 0x7f3758069eb0 2023-11-28T11:56:41.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.009+0000 7f375d541700 1 -- 172.21.15.50:0/4214667020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3758072500 con 0x7f3758069eb0 2023-11-28T11:56:41.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.013+0000 7f3754ff9700 1 -- 172.21.15.50:0/4214667020 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+18042 (secure 0 0 0) 0x7f374c053af0 con 0x7f3758069eb0 2023-11-28T11:56:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:41.016 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":65,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:56:40.385344+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.943405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:39.374123+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:41.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.013+0000 7f375d541700 1 -- 172.21.15.50:0/4214667020 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3744064f10 msgr2=0x7f37440673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:41.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.013+0000 7f375d541700 1 --2- 172.21.15.50:0/4214667020 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3744064f10 0x7f37440673c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3758154cf0 tx=0x7f3748007e00 comp rx=0 tx=0).stop 2023-11-28T11:56:41.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.013+0000 7f375d541700 1 -- 172.21.15.50:0/4214667020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3758069eb0 msgr2=0x7f3758154260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:41.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.013+0000 7f375d541700 1 --2- 172.21.15.50:0/4214667020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3758069eb0 0x7f3758154260 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f374c00e840 tx=0x7f374c00eb50 comp rx=0 tx=0).stop 2023-11-28T11:56:41.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.013+0000 7f375d541700 1 -- 172.21.15.50:0/4214667020 shutdown_connections 2023-11-28T11:56:41.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.013+0000 7f375d541700 1 --2- 172.21.15.50:0/4214667020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37580ca310 0x7f37580ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.013+0000 7f375d541700 1 --2- 172.21.15.50:0/4214667020 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3744064f10 0x7f37440673c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.013+0000 7f375d541700 1 --2- 172.21.15.50:0/4214667020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f375806cd80 0x7f37580c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.013+0000 7f375d541700 1 --2- 172.21.15.50:0/4214667020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3758069eb0 0x7f3758154260 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.013+0000 7f375d541700 1 -- 172.21.15.50:0/4214667020 >> 172.21.15.50:0/4214667020 conn(0x7f37580ce3e0 msgr2=0x7f3758154e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:41.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.013+0000 7f375d541700 1 -- 172.21.15.50:0/4214667020 shutdown_connections 2023-11-28T11:56:41.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.013+0000 7f375d541700 1 -- 172.21.15.50:0/4214667020 wait complete. 2023-11-28T11:56:41.030 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T11:56:41.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1433fff700 1 Processor -- start 2023-11-28T11:56:41.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1433fff700 1 -- start start 2023-11-28T11:56:41.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1433fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f143406b2b0 0x7f143406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1433fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14340cb520 con 0x7f14340ad970 2023-11-28T11:56:41.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1433fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14340cd1f0 con 0x7f14340cb810 2023-11-28T11:56:41.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1433fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1434158df0 con 0x7f143406b2b0 2023-11-28T11:56:41.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f14327fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f14340ad970 0x7f14340cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56856/0 (socket says 172.21.15.50:56856) 2023-11-28T11:56:41.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f14327fc700 1 -- 172.21.15.50:0/1593693509 learned_addr learned my addr 172.21.15.50:0/1593693509 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:41.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1432ffd700 1 --2- 172.21.15.50:0/1593693509 >> v2:172.21.15.192:3300/0 conn(0x7f143406b2b0 0x7f143406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1431ffb700 1 -- 172.21.15.50:0/1593693509 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180306551 0 0) 0x7f14340cb520 con 0x7f14340ad970 2023-11-28T11:56:41.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1431ffb700 1 -- 172.21.15.50:0/1593693509 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f141c0035d0 con 0x7f14340ad970 2023-11-28T11:56:41.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1431ffb700 1 -- 172.21.15.50:0/1593693509 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1798383310 0 0) 0x7f141c0035d0 con 0x7f14340ad970 2023-11-28T11:56:41.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1431ffb700 1 -- 172.21.15.50:0/1593693509 >> v2:172.21.15.192:3300/0 conn(0x7f143406b2b0 msgr2=0x7f143406fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:41.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1431ffb700 1 --2- 172.21.15.50:0/1593693509 >> v2:172.21.15.192:3300/0 conn(0x7f143406b2b0 0x7f143406fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1431ffb700 1 -- 172.21.15.50:0/1593693509 >> v1:172.21.15.192:6789/0 conn(0x7f14340cb810 legacy=0x7f14340b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:41.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1431ffb700 1 -- 172.21.15.50:0/1593693509 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1434069fb0 con 0x7f14340ad970 2023-11-28T11:56:41.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1431ffb700 1 -- 172.21.15.50:0/1593693509 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f14240019f0 con 0x7f14340ad970 2023-11-28T11:56:41.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1431ffb700 1 -- 172.21.15.50:0/1593693509 >> v1:172.21.15.50:6789/0 conn(0x7f14340ad970 legacy=0x7f14340cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:41.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1431ffb700 1 --2- 172.21.15.50:0/1593693509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f141c003a20 0x7f141c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1431ffb700 1 --2- 172.21.15.50:0/1593693509 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f141c004870 0x7f141c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1431ffb700 1 --2- 172.21.15.50:0/1593693509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f141c005220 0x7f141c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1431ffb700 1 -- 172.21.15.50:0/1593693509 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1434158df0 con 0x7f141c003a20 2023-11-28T11:56:41.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1431ffb700 1 -- 172.21.15.50:0/1593693509 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c00c0a0 con 0x7f141c005220 2023-11-28T11:56:41.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1431ffb700 1 -- 172.21.15.50:0/1593693509 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c00c260 con 0x7f141c004870 2023-11-28T11:56:41.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f1432ffd700 1 --2- 172.21.15.50:0/1593693509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f141c003a20 0x7f141c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f14337fe700 1 --2- 172.21.15.50:0/1593693509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f141c005220 0x7f141c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.145+0000 7f14327fc700 1 --2- 172.21.15.50:0/1593693509 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f141c004870 0x7f141c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1432ffd700 1 -- 172.21.15.50:0/1593693509 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f141c004870 msgr2=0x7f141c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:41.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1432ffd700 1 --2- 172.21.15.50:0/1593693509 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f141c004870 0x7f141c004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1432ffd700 1 -- 172.21.15.50:0/1593693509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f141c005220 msgr2=0x7f141c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:41.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1432ffd700 1 --2- 172.21.15.50:0/1593693509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f141c005220 0x7f141c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1432ffd700 1 -- 172.21.15.50:0/1593693509 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0035d0 con 0x7f141c003a20 2023-11-28T11:56:41.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f14337fe700 1 --2- 172.21.15.50:0/1593693509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f141c005220 0x7f141c00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:41.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f14337fe700 1 -- 172.21.15.50:0/1593693509 reap_dead start 2023-11-28T11:56:41.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1432ffd700 1 --2- 172.21.15.50:0/1593693509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f141c003a20 0x7f141c003e30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1428009b60 tx=0x7f141c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be1c3ebd6862d89 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:41.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1431ffb700 1 -- 172.21.15.50:0/1593693509 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1428005a40 con 0x7f141c003a20 2023-11-28T11:56:41.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1431ffb700 1 -- 172.21.15.50:0/1593693509 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1428005ba0 con 0x7f141c003a20 2023-11-28T11:56:41.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1431ffb700 1 -- 172.21.15.50:0/1593693509 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800e6c0 con 0x7f141c003a20 2023-11-28T11:56:41.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1433fff700 1 -- 172.21.15.50:0/1593693509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f141c003a20 msgr2=0x7f141c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:41.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1433fff700 1 --2- 172.21.15.50:0/1593693509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f141c003a20 0x7f141c003e30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1428009b60 tx=0x7f141c0058a0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1433fff700 1 -- 172.21.15.50:0/1593693509 shutdown_connections 2023-11-28T11:56:41.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1433fff700 1 --2- 172.21.15.50:0/1593693509 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f141c003a20 0x7f141c003e30 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1433fff700 1 -- 172.21.15.50:0/1593693509 >> 172.21.15.50:0/1593693509 conn(0x7f14340ce3e0 msgr2=0x7f14340ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:41.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1433fff700 1 -- 172.21.15.50:0/1593693509 shutdown_connections 2023-11-28T11:56:41.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1433fff700 1 -- 172.21.15.50:0/1593693509 wait complete. 2023-11-28T11:56:41.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1433fff700 1 Processor -- start 2023-11-28T11:56:41.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.149+0000 7f1433fff700 1 -- start start 2023-11-28T11:56:41.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f1433fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f141c003a20 0x7f14340abea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f1433fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14340c9cd0 0x7f1434096b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f1433fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14340ca140 0x7f14340970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f1433fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14341e5f50 con 0x7f14340ca140 2023-11-28T11:56:41.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f1433fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14341e5340 con 0x7f14340c9cd0 2023-11-28T11:56:41.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f1433fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14341e5620 con 0x7f141c003a20 2023-11-28T11:56:41.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f14337fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14340ca140 0x7f14340970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f14337fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14340ca140 0x7f14340970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38378/0 (socket says 172.21.15.50:38378) 2023-11-28T11:56:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f14337fe700 1 -- 172.21.15.50:0/126359728 learned_addr learned my addr 172.21.15.50:0/126359728 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f14327fc700 1 --2- 172.21.15.50:0/126359728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14340c9cd0 0x7f1434096b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f1432ffd700 1 --2- 172.21.15.50:0/126359728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f141c003a20 0x7f14340abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f14337fe700 1 -- 172.21.15.50:0/126359728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f141c003a20 msgr2=0x7f14340abea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f14337fe700 1 --2- 172.21.15.50:0/126359728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f141c003a20 0x7f14340abea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f14337fe700 1 -- 172.21.15.50:0/126359728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14340c9cd0 msgr2=0x7f1434096b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f14337fe700 1 --2- 172.21.15.50:0/126359728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14340c9cd0 0x7f1434096b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f14337fe700 1 -- 172.21.15.50:0/126359728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143406a570 con 0x7f14340ca140 2023-11-28T11:56:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f14337fe700 1 --2- 172.21.15.50:0/126359728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14340ca140 0x7f14340970a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f14340cbbe0 tx=0x7f142c00e670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f141b7fe700 1 -- 172.21.15.50:0/126359728 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c00edf0 con 0x7f14340ca140 2023-11-28T11:56:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f141b7fe700 1 -- 172.21.15.50:0/126359728 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c0050d0 con 0x7f14340ca140 2023-11-28T11:56:41.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f1433fff700 1 -- 172.21.15.50:0/126359728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143406a290 con 0x7f14340ca140 2023-11-28T11:56:41.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f141b7fe700 1 -- 172.21.15.50:0/126359728 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c005480 con 0x7f14340ca140 2023-11-28T11:56:41.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f1433fff700 1 -- 172.21.15.50:0/126359728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143406a850 con 0x7f14340ca140 2023-11-28T11:56:41.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f1433fff700 1 -- 172.21.15.50:0/126359728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14340008d0 con 0x7f14340ca140 2023-11-28T11:56:41.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.153+0000 7f141b7fe700 1 -- 172.21.15.50:0/126359728 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f142c01b030 con 0x7f14340ca140 2023-11-28T11:56:41.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.157+0000 7f141b7fe700 1 --2- 172.21.15.50:0/126359728 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1420064ee0 0x7f1420067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.157+0000 7f141b7fe700 1 -- 172.21.15.50:0/126359728 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f142c081170 con 0x7f14340ca140 2023-11-28T11:56:41.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.157+0000 7f1432ffd700 1 --2- 172.21.15.50:0/126359728 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1420064ee0 0x7f1420067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.157+0000 7f1432ffd700 1 --2- 172.21.15.50:0/126359728 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1420064ee0 0x7f1420067390 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f142800a010 tx=0x7f1428008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:41.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.161+0000 7f141b7fe700 1 -- 172.21.15.50:0/126359728 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f142c04f1d0 con 0x7f14340ca140 2023-11-28T11:56:41.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.357+0000 7f1433fff700 1 -- 172.21.15.50:0/126359728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f14341e6090 con 0x7f14340ca140 2023-11-28T11:56:41.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.389+0000 7f141b7fe700 1 -- 172.21.15.50:0/126359728 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7f142c0190b0 con 0x7f14340ca140 2023-11-28T11:56:41.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.393+0000 7f1433fff700 1 -- 172.21.15.50:0/126359728 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1420064ee0 msgr2=0x7f1420067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:41.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.393+0000 7f1433fff700 1 --2- 172.21.15.50:0/126359728 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1420064ee0 0x7f1420067390 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f142800a010 tx=0x7f1428008030 comp rx=0 tx=0).stop 2023-11-28T11:56:41.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.393+0000 7f1433fff700 1 -- 172.21.15.50:0/126359728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14340ca140 msgr2=0x7f14340970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:41.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.393+0000 7f1433fff700 1 --2- 172.21.15.50:0/126359728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14340ca140 0x7f14340970a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f14340cbbe0 tx=0x7f142c00e670 comp rx=0 tx=0).stop 2023-11-28T11:56:41.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.393+0000 7f1433fff700 1 -- 172.21.15.50:0/126359728 shutdown_connections 2023-11-28T11:56:41.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.393+0000 7f1433fff700 1 --2- 172.21.15.50:0/126359728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14340ca140 0x7f14340970a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.393+0000 7f1433fff700 1 --2- 172.21.15.50:0/126359728 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1420064ee0 0x7f1420067390 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.393+0000 7f1433fff700 1 --2- 172.21.15.50:0/126359728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14340c9cd0 0x7f1434096b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.393+0000 7f1433fff700 1 --2- 172.21.15.50:0/126359728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f141c003a20 0x7f14340abea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.393+0000 7f1433fff700 1 -- 172.21.15.50:0/126359728 >> 172.21.15.50:0/126359728 conn(0x7f14340ce3e0 msgr2=0x7f1434157cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:41.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.393+0000 7f1433fff700 1 -- 172.21.15.50:0/126359728 shutdown_connections 2023-11-28T11:56:41.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.393+0000 7f1433fff700 1 -- 172.21.15.50:0/126359728 wait complete. 2023-11-28T11:56:41.412 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T11:56:41.412 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T11:56:41.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.525+0000 7fc9733a2700 1 Processor -- start 2023-11-28T11:56:41.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.525+0000 7fc9733a2700 1 -- start start 2023-11-28T11:56:41.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc9733a2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc96c15a430 0x7fc96c0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc9733a2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc96c0ac230 0x7fc96c0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc9733a2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96c06a490 con 0x7fc96c15a060 2023-11-28T11:56:41.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc9733a2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c0b2250 con 0x7fc96c15a430 2023-11-28T11:56:41.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc9733a2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c06a770 con 0x7fc96c0ac230 2023-11-28T11:56:41.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc971b9f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc96c15a430 0x7fc96c0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc971b9f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc96c15a430 0x7fc96c0cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38382/0 (socket says 172.21.15.50:38382) 2023-11-28T11:56:41.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc971b9f700 1 -- 172.21.15.50:0/859932729 learned_addr learned my addr 172.21.15.50:0/859932729 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:41.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc972ba1700 1 --2- 172.21.15.50:0/859932729 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc96c0ac230 0x7fc96c0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc971b9f700 1 -- 172.21.15.50:0/859932729 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc96c0ac230 msgr2=0x7fc96c0cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:41.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc971b9f700 1 --2- 172.21.15.50:0/859932729 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc96c0ac230 0x7fc96c0cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc971b9f700 1 -- 172.21.15.50:0/859932729 >> v1:172.21.15.192:6789/0 conn(0x7fc96c15a060 legacy=0x7fc96c069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:41.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc971b9f700 1 -- 172.21.15.50:0/859932729 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c06aa50 con 0x7fc96c15a430 2023-11-28T11:56:41.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc971b9f700 1 --2- 172.21.15.50:0/859932729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96c15a430 0x7fc96c0cc2f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009910 tx=0x7fc95c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dda5ed03fa6352c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:41.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc97139e700 1 -- 172.21.15.50:0/859932729 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c004230 con 0x7fc96c15a430 2023-11-28T11:56:41.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc97139e700 1 -- 172.21.15.50:0/859932729 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c004390 con 0x7fc96c15a430 2023-11-28T11:56:41.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc97139e700 1 -- 172.21.15.50:0/859932729 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c009e60 con 0x7fc96c15a430 2023-11-28T11:56:41.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc9733a2700 1 -- 172.21.15.50:0/859932729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96c15a430 msgr2=0x7fc96c0cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:41.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc9733a2700 1 --2- 172.21.15.50:0/859932729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96c15a430 0x7fc96c0cc2f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009910 tx=0x7fc95c009c20 comp rx=0 tx=0).stop 2023-11-28T11:56:41.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc9733a2700 1 -- 172.21.15.50:0/859932729 shutdown_connections 2023-11-28T11:56:41.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc9733a2700 1 --2- 172.21.15.50:0/859932729 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc96c0ac230 0x7fc96c0cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc9733a2700 1 --2- 172.21.15.50:0/859932729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96c15a430 0x7fc96c0cc2f0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc9733a2700 1 -- 172.21.15.50:0/859932729 >> 172.21.15.50:0/859932729 conn(0x7fc96c0cae70 msgr2=0x7fc96c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:41.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc9733a2700 1 -- 172.21.15.50:0/859932729 shutdown_connections 2023-11-28T11:56:41.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.529+0000 7fc9733a2700 1 -- 172.21.15.50:0/859932729 wait complete. 2023-11-28T11:56:41.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc9733a2700 1 Processor -- start 2023-11-28T11:56:41.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc9733a2700 1 -- start start 2023-11-28T11:56:41.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc9733a2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc96c0ac230 0x7fc96c098d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc9733a2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96c15a060 0x7fc96c09b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc9733a2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc96c15a430 0x7fc96c157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc9733a2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c1f5250 con 0x7fc96c15a060 2023-11-28T11:56:41.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc9733a2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c09b990 con 0x7fc96c15a430 2023-11-28T11:56:41.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc9733a2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c1f4b90 con 0x7fc96c0ac230 2023-11-28T11:56:41.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc971b9f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96c15a060 0x7fc96c09b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc971b9f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96c15a060 0x7fc96c09b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38392/0 (socket says 172.21.15.50:38392) 2023-11-28T11:56:41.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc971b9f700 1 -- 172.21.15.50:0/2016981083 learned_addr learned my addr 172.21.15.50:0/2016981083 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:41.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc9723a0700 1 --2- 172.21.15.50:0/2016981083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc96c0ac230 0x7fc96c098d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc972ba1700 1 --2- 172.21.15.50:0/2016981083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc96c15a430 0x7fc96c157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc971b9f700 1 -- 172.21.15.50:0/2016981083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc96c0ac230 msgr2=0x7fc96c098d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:41.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc971b9f700 1 --2- 172.21.15.50:0/2016981083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc96c0ac230 0x7fc96c098d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc971b9f700 1 -- 172.21.15.50:0/2016981083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc96c15a430 msgr2=0x7fc96c157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:41.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc971b9f700 1 --2- 172.21.15.50:0/2016981083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc96c15a430 0x7fc96c157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:41.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc971b9f700 1 -- 172.21.15.50:0/2016981083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c009570 con 0x7fc96c15a060 2023-11-28T11:56:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc971b9f700 1 --2- 172.21.15.50:0/2016981083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96c15a060 0x7fc96c09b0d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc95c004000 tx=0x7fc95c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc962ffd700 1 -- 172.21.15.50:0/2016981083 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00bbd0 con 0x7fc96c15a060 2023-11-28T11:56:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc962ffd700 1 -- 172.21.15.50:0/2016981083 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c01f070 con 0x7fc96c15a060 2023-11-28T11:56:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.533+0000 7fc9733a2700 1 -- 172.21.15.50:0/2016981083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c06b010 con 0x7fc96c15a060 2023-11-28T11:56:41.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.537+0000 7fc962ffd700 1 -- 172.21.15.50:0/2016981083 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0036c0 con 0x7fc96c15a060 2023-11-28T11:56:41.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.537+0000 7fc9733a2700 1 -- 172.21.15.50:0/2016981083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c06ad30 con 0x7fc96c15a060 2023-11-28T11:56:41.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.537+0000 7fc9733a2700 1 -- 172.21.15.50:0/2016981083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96c06b530 con 0x7fc96c15a060 2023-11-28T11:56:41.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.537+0000 7fc962ffd700 1 -- 172.21.15.50:0/2016981083 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc95c02a020 con 0x7fc96c15a060 2023-11-28T11:56:41.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.537+0000 7fc962ffd700 1 --2- 172.21.15.50:0/2016981083 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc950064ee0 0x7fc950067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:41.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.537+0000 7fc962ffd700 1 -- 172.21.15.50:0/2016981083 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc95c083730 con 0x7fc96c15a060 2023-11-28T11:56:41.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.537+0000 7fc9723a0700 1 --2- 172.21.15.50:0/2016981083 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc950064ee0 0x7fc950067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:41.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.541+0000 7fc9723a0700 1 --2- 172.21.15.50:0/2016981083 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc950064ee0 0x7fc950067390 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc968009980 tx=0x7fc9680090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.549+0000 7fc962ffd700 1 -- 172.21.15.50:0/2016981083 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc95c051710 con 0x7fc96c15a060 2023-11-28T11:56:41.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:41.749+0000 7fc9733a2700 1 -- 172.21.15.50:0/2016981083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc96c06b530 con 0x7fc96c15a060 2023-11-28T11:56:42.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.405+0000 7fc962ffd700 1 -- 172.21.15.50:0/2016981083 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc95c054d30 con 0x7fc96c15a060 2023-11-28T11:56:42.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.409+0000 7fc9733a2700 1 -- 172.21.15.50:0/2016981083 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc950064ee0 msgr2=0x7fc950067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:42.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.409+0000 7fc9733a2700 1 --2- 172.21.15.50:0/2016981083 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc950064ee0 0x7fc950067390 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc968009980 tx=0x7fc9680090e0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.409+0000 7fc9733a2700 1 -- 172.21.15.50:0/2016981083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96c15a060 msgr2=0x7fc96c09b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:42.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.409+0000 7fc9733a2700 1 --2- 172.21.15.50:0/2016981083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96c15a060 0x7fc96c09b0d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc95c004000 tx=0x7fc95c004770 comp rx=0 tx=0).stop 2023-11-28T11:56:42.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.409+0000 7fc9733a2700 1 -- 172.21.15.50:0/2016981083 shutdown_connections 2023-11-28T11:56:42.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.409+0000 7fc9733a2700 1 --2- 172.21.15.50:0/2016981083 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc950064ee0 0x7fc950067390 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.409+0000 7fc9733a2700 1 --2- 172.21.15.50:0/2016981083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc96c15a430 0x7fc96c157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.409+0000 7fc9733a2700 1 --2- 172.21.15.50:0/2016981083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc96c15a060 0x7fc96c09b0d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.409+0000 7fc9733a2700 1 --2- 172.21.15.50:0/2016981083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc96c0ac230 0x7fc96c098d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.409+0000 7fc9733a2700 1 -- 172.21.15.50:0/2016981083 >> 172.21.15.50:0/2016981083 conn(0x7fc96c0cae70 msgr2=0x7fc96c159830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:42.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.409+0000 7fc9733a2700 1 -- 172.21.15.50:0/2016981083 shutdown_connections 2023-11-28T11:56:42.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.409+0000 7fc9733a2700 1 -- 172.21.15.50:0/2016981083 wait complete. 2023-11-28T11:56:42.430 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T11:56:42.430 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:56:42.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25e2a2700 1 Processor -- start 2023-11-28T11:56:42.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25e2a2700 1 -- start start 2023-11-28T11:56:42.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25e2a2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff258159e70 0x7ff25806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:42.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25e2a2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff2580cb470 0x7ff2580c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:42.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25e2a2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff25806ace0 con 0x7ff258069c40 2023-11-28T11:56:42.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25e2a2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff25806a0d0 con 0x7ff2580cb470 2023-11-28T11:56:42.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25e2a2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25806a3b0 con 0x7ff258159e70 2023-11-28T11:56:42.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25daa1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff2580cb470 0x7ff2580c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:42.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25ca9f700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff258069c40 0x7ff2580cad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42874/0 (socket says 172.21.15.50:42874) 2023-11-28T11:56:42.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25daa1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff2580cb470 0x7ff2580c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48488/0 (socket says 172.21.15.50:48488) 2023-11-28T11:56:42.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25ca9f700 1 -- 172.21.15.50:0/3982539293 learned_addr learned my addr 172.21.15.50:0/3982539293 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:42.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25d2a0700 1 --2- 172.21.15.50:0/3982539293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff258159e70 0x7ff25806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:42.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25daa1700 1 -- 172.21.15.50:0/3982539293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff258159e70 msgr2=0x7ff25806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:42.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25daa1700 1 --2- 172.21.15.50:0/3982539293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff258159e70 0x7ff25806c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25daa1700 1 -- 172.21.15.50:0/3982539293 >> v1:172.21.15.50:6789/0 conn(0x7ff258069c40 legacy=0x7ff2580cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:42.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25daa1700 1 -- 172.21.15.50:0/3982539293 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25806a690 con 0x7ff2580cb470 2023-11-28T11:56:42.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25d2a0700 1 --2- 172.21.15.50:0/3982539293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff258159e70 0x7ff25806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:42.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25daa1700 1 --2- 172.21.15.50:0/3982539293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2580cb470 0x7ff2580c91d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff250009d90 tx=0x7ff25000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77f57db34c7c31 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:42.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff24ffff700 1 -- 172.21.15.50:0/3982539293 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25000e070 con 0x7ff2580cb470 2023-11-28T11:56:42.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff24ffff700 1 -- 172.21.15.50:0/3982539293 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25000bbd0 con 0x7ff2580cb470 2023-11-28T11:56:42.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff24ffff700 1 -- 172.21.15.50:0/3982539293 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff250012430 con 0x7ff2580cb470 2023-11-28T11:56:42.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25e2a2700 1 -- 172.21.15.50:0/3982539293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2580cb470 msgr2=0x7ff2580c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:42.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25e2a2700 1 --2- 172.21.15.50:0/3982539293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2580cb470 0x7ff2580c91d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff250009d90 tx=0x7ff25000b330 comp rx=0 tx=0).stop 2023-11-28T11:56:42.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25e2a2700 1 -- 172.21.15.50:0/3982539293 shutdown_connections 2023-11-28T11:56:42.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25e2a2700 1 --2- 172.21.15.50:0/3982539293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2580cb470 0x7ff2580c91d0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25e2a2700 1 --2- 172.21.15.50:0/3982539293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff258159e70 0x7ff25806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25e2a2700 1 -- 172.21.15.50:0/3982539293 >> 172.21.15.50:0/3982539293 conn(0x7ff2580ce3e0 msgr2=0x7ff2580ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:42.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25e2a2700 1 -- 172.21.15.50:0/3982539293 shutdown_connections 2023-11-28T11:56:42.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.549+0000 7ff25e2a2700 1 -- 172.21.15.50:0/3982539293 wait complete. 2023-11-28T11:56:42.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.553+0000 7ff25e2a2700 1 Processor -- start 2023-11-28T11:56:42.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.553+0000 7ff25e2a2700 1 -- start start 2023-11-28T11:56:42.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25e2a2700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff258069c40 0x7ff258097540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:42.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25e2a2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2580cb470 0x7ff2581f0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:42.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25e2a2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff258159e70 0x7ff2580c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:42.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25e2a2700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2580ab560 con 0x7ff258069c40 2023-11-28T11:56:42.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25e2a2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff258097a80 con 0x7ff258159e70 2023-11-28T11:56:42.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25e2a2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2580c23f0 con 0x7ff2580cb470 2023-11-28T11:56:42.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25d2a0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff258069c40 0x7ff258097540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:42.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25d2a0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff258069c40 0x7ff258097540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48494/0 (socket says 172.21.15.50:48494) 2023-11-28T11:56:42.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25d2a0700 1 -- 172.21.15.50:0/1329772452 learned_addr learned my addr 172.21.15.50:0/1329772452 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:42.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25daa1700 1 --2- 172.21.15.50:0/1329772452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff258159e70 0x7ff2580c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:42.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25ca9f700 1 --2- 172.21.15.50:0/1329772452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2580cb470 0x7ff2581f0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:42.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25d2a0700 1 -- 172.21.15.50:0/1329772452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2580cb470 msgr2=0x7ff2581f0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:42.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25d2a0700 1 --2- 172.21.15.50:0/1329772452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2580cb470 0x7ff2581f0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25d2a0700 1 -- 172.21.15.50:0/1329772452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff258159e70 msgr2=0x7ff2580c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:42.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25d2a0700 1 --2- 172.21.15.50:0/1329772452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff258159e70 0x7ff2580c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25d2a0700 1 -- 172.21.15.50:0/1329772452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff250009a70 con 0x7ff258069c40 2023-11-28T11:56:42.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25d2a0700 1 --2- 172.21.15.50:0/1329772452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff258069c40 0x7ff258097540 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff24800c7a0 tx=0x7ff24800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:42.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff24dffb700 1 -- 172.21.15.50:0/1329772452 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff248011800 con 0x7ff258069c40 2023-11-28T11:56:42.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff24dffb700 1 -- 172.21.15.50:0/1329772452 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff248011960 con 0x7ff258069c40 2023-11-28T11:56:42.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25e2a2700 1 -- 172.21.15.50:0/1329772452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25815a240 con 0x7ff258069c40 2023-11-28T11:56:42.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff24dffb700 1 -- 172.21.15.50:0/1329772452 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff248011d10 con 0x7ff258069c40 2023-11-28T11:56:42.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25e2a2700 1 -- 172.21.15.50:0/1329772452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25806a970 con 0x7ff258069c40 2023-11-28T11:56:42.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.557+0000 7ff25e2a2700 1 -- 172.21.15.50:0/1329772452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25806cee0 con 0x7ff258069c40 2023-11-28T11:56:42.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.561+0000 7ff24dffb700 1 -- 172.21.15.50:0/1329772452 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff248021070 con 0x7ff258069c40 2023-11-28T11:56:42.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.561+0000 7ff24dffb700 1 --2- 172.21.15.50:0/1329772452 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff23c064ee0 0x7ff23c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:42.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.561+0000 7ff24dffb700 1 -- 172.21.15.50:0/1329772452 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff248081fd0 con 0x7ff258069c40 2023-11-28T11:56:42.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.561+0000 7ff25ca9f700 1 --2- 172.21.15.50:0/1329772452 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff23c064ee0 0x7ff23c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:42.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.561+0000 7ff25ca9f700 1 --2- 172.21.15.50:0/1329772452 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff23c064ee0 0x7ff23c067390 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff2581592f0 tx=0x7ff254009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:42.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.569+0000 7ff24dffb700 1 -- 172.21.15.50:0/1329772452 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff24804ff40 con 0x7ff258069c40 2023-11-28T11:56:42.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.765+0000 7ff25e2a2700 1 -- 172.21.15.50:0/1329772452 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff258072500 con 0x7ff258069c40 2023-11-28T11:56:42.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.769+0000 7ff24dffb700 1 -- 172.21.15.50:0/1329772452 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4653 (secure 0 0 0) 0x7ff248053560 con 0x7ff258069c40 2023-11-28T11:56:42.771 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:42.771 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1573599194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1573599194},{"type":"v1","addr":"172.21.15.192:6836","nonce":1573599194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6445,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/983935617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":983935617},{"type":"v1","addr":"172.21.15.192:6837","nonce":983935617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2516263109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2516263109},{"type":"v1","addr":"172.21.15.50:6833","nonce":2516263109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:56:40.385672+0000","modified":"2023-11-28T11:56:42.402645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3894924751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3894924751},{"type":"v1","addr":"172.21.15.50:6835","nonce":3894924751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:56:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.769+0000 7ff25e2a2700 1 -- 172.21.15.50:0/1329772452 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff23c064ee0 msgr2=0x7ff23c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.769+0000 7ff25e2a2700 1 --2- 172.21.15.50:0/1329772452 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff23c064ee0 0x7ff23c067390 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff2581592f0 tx=0x7ff254009040 comp rx=0 tx=0).stop 2023-11-28T11:56:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.769+0000 7ff25e2a2700 1 -- 172.21.15.50:0/1329772452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff258069c40 msgr2=0x7ff258097540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.769+0000 7ff25e2a2700 1 --2- 172.21.15.50:0/1329772452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff258069c40 0x7ff258097540 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff24800c7a0 tx=0x7ff24800cb60 comp rx=0 tx=0).stop 2023-11-28T11:56:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.769+0000 7ff25e2a2700 1 -- 172.21.15.50:0/1329772452 shutdown_connections 2023-11-28T11:56:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.769+0000 7ff25e2a2700 1 --2- 172.21.15.50:0/1329772452 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff23c064ee0 0x7ff23c067390 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.769+0000 7ff25e2a2700 1 --2- 172.21.15.50:0/1329772452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff258159e70 0x7ff2580c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.769+0000 7ff25e2a2700 1 --2- 172.21.15.50:0/1329772452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2580cb470 0x7ff2581f0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.769+0000 7ff25e2a2700 1 --2- 172.21.15.50:0/1329772452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff258069c40 0x7ff258097540 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.769+0000 7ff25e2a2700 1 -- 172.21.15.50:0/1329772452 >> 172.21.15.50:0/1329772452 conn(0x7ff2580ce3e0 msgr2=0x7ff2580c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:42.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.769+0000 7ff25e2a2700 1 -- 172.21.15.50:0/1329772452 shutdown_connections 2023-11-28T11:56:42.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.769+0000 7ff25e2a2700 1 -- 172.21.15.50:0/1329772452 wait complete. 2023-11-28T11:56:42.775 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 31 2023-11-28T11:56:42.787 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:56:42.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.893+0000 7f1c3bfff700 1 Processor -- start 2023-11-28T11:56:42.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.893+0000 7f1c3bfff700 1 -- start start 2023-11-28T11:56:42.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c3c15c150 0x7f1c3c1607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:42.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c3c0cc600 0x7f1c3c0ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:42.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3bfff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3c15c520 con 0x7f1c3c0c9e70 2023-11-28T11:56:42.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3bfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c3c0ca680 con 0x7f1c3c0cc600 2023-11-28T11:56:42.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3bfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c0ca960 con 0x7f1c3c15c150 2023-11-28T11:56:42.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c3c0cc600 0x7f1c3c0ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:42.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c3c0cc600 0x7f1c3c0ce320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48502/0 (socket says 172.21.15.50:48502) 2023-11-28T11:56:42.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3b7fe700 1 -- 172.21.15.50:0/1757508606 learned_addr learned my addr 172.21.15.50:0/1757508606 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:42.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3affd700 1 --2- 172.21.15.50:0/1757508606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c3c15c150 0x7f1c3c1607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:42.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3b7fe700 1 -- 172.21.15.50:0/1757508606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c3c15c150 msgr2=0x7f1c3c1607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:42.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3b7fe700 1 --2- 172.21.15.50:0/1757508606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c3c15c150 0x7f1c3c1607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3b7fe700 1 -- 172.21.15.50:0/1757508606 >> v1:172.21.15.192:6789/0 conn(0x7f1c3c0c9e70 legacy=0x7f1c3c0cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:42.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3b7fe700 1 -- 172.21.15.50:0/1757508606 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c0cd840 con 0x7f1c3c0cc600 2023-11-28T11:56:42.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3b7fe700 1 --2- 172.21.15.50:0/1757508606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c3c0cc600 0x7f1c3c0ce320 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1c34009e50 tx=0x7f1c3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f3208209edadb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c39ffb700 1 -- 172.21.15.50:0/1757508606 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3400e070 con 0x7f1c3c0cc600 2023-11-28T11:56:42.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c39ffb700 1 -- 172.21.15.50:0/1757508606 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3400b910 con 0x7f1c3c0cc600 2023-11-28T11:56:42.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c39ffb700 1 -- 172.21.15.50:0/1757508606 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3400bcc0 con 0x7f1c3c0cc600 2023-11-28T11:56:42.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3bfff700 1 -- 172.21.15.50:0/1757508606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c3c0cc600 msgr2=0x7f1c3c0ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:42.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3bfff700 1 --2- 172.21.15.50:0/1757508606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c3c0cc600 0x7f1c3c0ce320 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1c34009e50 tx=0x7f1c3400b330 comp rx=0 tx=0).stop 2023-11-28T11:56:42.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3bfff700 1 -- 172.21.15.50:0/1757508606 shutdown_connections 2023-11-28T11:56:42.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3bfff700 1 --2- 172.21.15.50:0/1757508606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c3c0cc600 0x7f1c3c0ce320 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3bfff700 1 --2- 172.21.15.50:0/1757508606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c3c15c150 0x7f1c3c1607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3bfff700 1 -- 172.21.15.50:0/1757508606 >> 172.21.15.50:0/1757508606 conn(0x7f1c3c06ec40 msgr2=0x7f1c3c0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3bfff700 1 -- 172.21.15.50:0/1757508606 shutdown_connections 2023-11-28T11:56:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.897+0000 7f1c3bfff700 1 -- 172.21.15.50:0/1757508606 wait complete. 2023-11-28T11:56:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.901+0000 7f1c3bfff700 1 Processor -- start 2023-11-28T11:56:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.901+0000 7f1c3bfff700 1 -- start start 2023-11-28T11:56:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.901+0000 7f1c3bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c3c0c9e70 0x7f1c3c154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.901+0000 7f1c3bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c3c0cc600 0x7f1c3c0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.901+0000 7f1c3bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c3c15c150 0x7f1c3c0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.901+0000 7f1c3bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c0b39b0 con 0x7f1c3c15c150 2023-11-28T11:56:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.901+0000 7f1c3bfff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c0b2d30 con 0x7f1c3c0cc600 2023-11-28T11:56:42.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.901+0000 7f1c3bfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c0b3010 con 0x7f1c3c0c9e70 2023-11-28T11:56:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.901+0000 7f1c3b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c3c15c150 0x7f1c3c0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.901+0000 7f1c3b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c3c15c150 0x7f1c3c0b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48510/0 (socket says 172.21.15.50:48510) 2023-11-28T11:56:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.901+0000 7f1c3b7fe700 1 -- 172.21.15.50:0/2594023781 learned_addr learned my addr 172.21.15.50:0/2594023781 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c3a7fc700 1 --2- 172.21.15.50:0/2594023781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c3c0cc600 0x7f1c3c0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c3affd700 1 --2- 172.21.15.50:0/2594023781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c3c0c9e70 0x7f1c3c154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:42.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c3b7fe700 1 -- 172.21.15.50:0/2594023781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c3c0c9e70 msgr2=0x7f1c3c154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c3b7fe700 1 --2- 172.21.15.50:0/2594023781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c3c0c9e70 0x7f1c3c154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c3b7fe700 1 -- 172.21.15.50:0/2594023781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c3c0cc600 msgr2=0x7f1c3c0b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c3b7fe700 1 --2- 172.21.15.50:0/2594023781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c3c0cc600 0x7f1c3c0b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c3b7fe700 1 -- 172.21.15.50:0/2594023781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c34009b30 con 0x7f1c3c15c150 2023-11-28T11:56:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c3a7fc700 1 --2- 172.21.15.50:0/2594023781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c3c0cc600 0x7f1c3c0b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c3affd700 1 --2- 172.21.15.50:0/2594023781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c3c0c9e70 0x7f1c3c154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c3b7fe700 1 --2- 172.21.15.50:0/2594023781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c3c15c150 0x7f1c3c0b2500 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c071fb0 tx=0x7f1c34004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c23fff700 1 -- 172.21.15.50:0/2594023781 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c340099b0 con 0x7f1c3c15c150 2023-11-28T11:56:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c23fff700 1 -- 172.21.15.50:0/2594023781 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c340092e0 con 0x7f1c3c15c150 2023-11-28T11:56:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c3bfff700 1 -- 172.21.15.50:0/2594023781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3c0cde00 con 0x7f1c3c15c150 2023-11-28T11:56:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c23fff700 1 -- 172.21.15.50:0/2594023781 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3401c640 con 0x7f1c3c15c150 2023-11-28T11:56:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c3bfff700 1 -- 172.21.15.50:0/2594023781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3c0cdb20 con 0x7f1c3c15c150 2023-11-28T11:56:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c3bfff700 1 -- 172.21.15.50:0/2594023781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3c0ca2c0 con 0x7f1c3c15c150 2023-11-28T11:56:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c23fff700 1 -- 172.21.15.50:0/2594023781 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1c3402c070 con 0x7f1c3c15c150 2023-11-28T11:56:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c23fff700 1 --2- 172.21.15.50:0/2594023781 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c28064ee0 0x7f1c28067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c23fff700 1 -- 172.21.15.50:0/2594023781 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1c34083c60 con 0x7f1c3c15c150 2023-11-28T11:56:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.905+0000 7f1c3affd700 1 --2- 172.21.15.50:0/2594023781 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c28064ee0 0x7f1c28067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.909+0000 7f1c3affd700 1 --2- 172.21.15.50:0/2594023781 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c28064ee0 0x7f1c28067390 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009ba0 tx=0x7f1c2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:42.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:42.917+0000 7f1c23fff700 1 -- 172.21.15.50:0/2594023781 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1c34051cc0 con 0x7f1c3c15c150 2023-11-28T11:56:43.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.081+0000 7f1c3bfff700 1 -- 172.21.15.50:0/2594023781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c3c0b3af0 con 0x7f1c3c15c150 2023-11-28T11:56:43.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.085+0000 7f1c23fff700 1 -- 172.21.15.50:0/2594023781 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+18029 (secure 0 0 0) 0x7f1c3c0b3af0 con 0x7f1c3c15c150 2023-11-28T11:56:43.089 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:43.090 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":66,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:56:41.389653+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.943405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:39.374123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:56:43.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.089+0000 7f1c3bfff700 1 -- 172.21.15.50:0/2594023781 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c28064ee0 msgr2=0x7f1c28067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.089+0000 7f1c3bfff700 1 --2- 172.21.15.50:0/2594023781 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c28064ee0 0x7f1c28067390 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009ba0 tx=0x7f1c2c008040 comp rx=0 tx=0).stop 2023-11-28T11:56:43.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.089+0000 7f1c3bfff700 1 -- 172.21.15.50:0/2594023781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c3c15c150 msgr2=0x7f1c3c0b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.089+0000 7f1c3bfff700 1 --2- 172.21.15.50:0/2594023781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c3c15c150 0x7f1c3c0b2500 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c071fb0 tx=0x7f1c34004af0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.089+0000 7f1c3bfff700 1 -- 172.21.15.50:0/2594023781 shutdown_connections 2023-11-28T11:56:43.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.089+0000 7f1c3bfff700 1 --2- 172.21.15.50:0/2594023781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c3c15c150 0x7f1c3c0b2500 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.089+0000 7f1c3bfff700 1 --2- 172.21.15.50:0/2594023781 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c28064ee0 0x7f1c28067390 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.089+0000 7f1c3bfff700 1 --2- 172.21.15.50:0/2594023781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c3c0cc600 0x7f1c3c0b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.089+0000 7f1c3bfff700 1 --2- 172.21.15.50:0/2594023781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c3c0c9e70 0x7f1c3c154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.089+0000 7f1c3bfff700 1 -- 172.21.15.50:0/2594023781 >> 172.21.15.50:0/2594023781 conn(0x7f1c3c06ec40 msgr2=0x7f1c3c0afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:43.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.089+0000 7f1c3bfff700 1 -- 172.21.15.50:0/2594023781 shutdown_connections 2023-11-28T11:56:43.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.089+0000 7f1c3bfff700 1 -- 172.21.15.50:0/2594023781 wait complete. 2023-11-28T11:56:43.105 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T11:56:43.105 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:56:43.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbab5191700 1 Processor -- start 2023-11-28T11:56:43.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbab5191700 1 -- start start 2023-11-28T11:56:43.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbab5191700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbab0158ef0 0x7fbab00c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbab5191700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbab00cb460 0x7fbab00cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbab5191700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab00cde00 con 0x7fbab00ad490 2023-11-28T11:56:43.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbab5191700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab00ce290 con 0x7fbab0158ef0 2023-11-28T11:56:43.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbab5191700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab00adcc0 con 0x7fbab00cb460 2023-11-28T11:56:43.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbaaffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbab0158ef0 0x7fbab00c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbaaffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbab0158ef0 0x7fbab00c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48516/0 (socket says 172.21.15.50:48516) 2023-11-28T11:56:43.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbaaffff700 1 -- 172.21.15.50:0/4244054065 learned_addr learned my addr 172.21.15.50:0/4244054065 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:43.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbaaf7fe700 1 --1- 172.21.15.50:0/4244054065 >> v1:172.21.15.50:6789/0 conn(0x7fbab00ad490 0x7fbab00cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42882/0 (socket says 172.21.15.50:42882) 2023-11-28T11:56:43.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbaaffff700 1 -- 172.21.15.50:0/4244054065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbab00cb460 msgr2=0x7fbab00cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:43.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbaaffff700 1 --2- 172.21.15.50:0/4244054065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbab00cb460 0x7fbab00cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbaaffff700 1 -- 172.21.15.50:0/4244054065 >> v1:172.21.15.50:6789/0 conn(0x7fbab00ad490 legacy=0x7fbab00cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbaaffff700 1 -- 172.21.15.50:0/4244054065 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab006d630 con 0x7fbab0158ef0 2023-11-28T11:56:43.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbaaffff700 1 --2- 172.21.15.50:0/4244054065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbab0158ef0 0x7fbab00c8a30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009940 tx=0x7fbaa0009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d213f586f2b62c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:43.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbaaeffd700 1 -- 172.21.15.50:0/4244054065 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa000ba20 con 0x7fbab0158ef0 2023-11-28T11:56:43.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbaaeffd700 1 -- 172.21.15.50:0/4244054065 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa0009e90 con 0x7fbab0158ef0 2023-11-28T11:56:43.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbaaeffd700 1 -- 172.21.15.50:0/4244054065 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa000bda0 con 0x7fbab0158ef0 2023-11-28T11:56:43.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbab5191700 1 -- 172.21.15.50:0/4244054065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbab0158ef0 msgr2=0x7fbab00c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbab5191700 1 --2- 172.21.15.50:0/4244054065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbab0158ef0 0x7fbab00c8a30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009940 tx=0x7fbaa0009c50 comp rx=0 tx=0).stop 2023-11-28T11:56:43.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbab5191700 1 -- 172.21.15.50:0/4244054065 shutdown_connections 2023-11-28T11:56:43.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbab5191700 1 --2- 172.21.15.50:0/4244054065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbab00cb460 0x7fbab00cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbab5191700 1 --2- 172.21.15.50:0/4244054065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbab0158ef0 0x7fbab00c8a30 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbab5191700 1 -- 172.21.15.50:0/4244054065 >> 172.21.15.50:0/4244054065 conn(0x7fbab00ce3e0 msgr2=0x7fbab00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:43.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbab5191700 1 -- 172.21.15.50:0/4244054065 shutdown_connections 2023-11-28T11:56:43.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.213+0000 7fbab5191700 1 -- 172.21.15.50:0/4244054065 wait complete. 2023-11-28T11:56:43.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbab5191700 1 Processor -- start 2023-11-28T11:56:43.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbab5191700 1 -- start start 2023-11-28T11:56:43.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbab5191700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbab00ad490 0x7fbab00c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbab5191700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbab00cb460 0x7fbab0156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbab5191700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbab0158ef0 0x7fbab01f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbab5191700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab00c74b0 con 0x7fbab00cb460 2023-11-28T11:56:43.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbab5191700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab00c7cc0 con 0x7fbab0158ef0 2023-11-28T11:56:43.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbab5191700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab00c7700 con 0x7fbab00ad490 2023-11-28T11:56:43.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbaaf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbab00cb460 0x7fbab0156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbaaf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbab00cb460 0x7fbab0156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48520/0 (socket says 172.21.15.50:48520) 2023-11-28T11:56:43.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbaaf7fe700 1 -- 172.21.15.50:0/1902255946 learned_addr learned my addr 172.21.15.50:0/1902255946 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:43.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbaaffff700 1 --2- 172.21.15.50:0/1902255946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbab00ad490 0x7fbab00c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbab4990700 1 --2- 172.21.15.50:0/1902255946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbab0158ef0 0x7fbab01f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbaaf7fe700 1 -- 172.21.15.50:0/1902255946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbab00ad490 msgr2=0x7fbab00c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbaaf7fe700 1 --2- 172.21.15.50:0/1902255946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbab00ad490 0x7fbab00c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbaaf7fe700 1 -- 172.21.15.50:0/1902255946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbab0158ef0 msgr2=0x7fbab01f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbaaf7fe700 1 --2- 172.21.15.50:0/1902255946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbab0158ef0 0x7fbab01f1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbaaf7fe700 1 -- 172.21.15.50:0/1902255946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa0009570 con 0x7fbab00cb460 2023-11-28T11:56:43.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbaaf7fe700 1 --2- 172.21.15.50:0/1902255946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbab00cb460 0x7fbab0156c10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800cc50 tx=0x7fbaa800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:43.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbaacff9700 1 -- 172.21.15.50:0/1902255946 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa800aad0 con 0x7fbab00cb460 2023-11-28T11:56:43.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbaacff9700 1 -- 172.21.15.50:0/1902255946 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa800ac30 con 0x7fbab00cb460 2023-11-28T11:56:43.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbab5191700 1 -- 172.21.15.50:0/1902255946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab006dbf0 con 0x7fbab00cb460 2023-11-28T11:56:43.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.217+0000 7fbaacff9700 1 -- 172.21.15.50:0/1902255946 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8007070 con 0x7fbab00cb460 2023-11-28T11:56:43.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.221+0000 7fbab5191700 1 -- 172.21.15.50:0/1902255946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab006d910 con 0x7fbab00cb460 2023-11-28T11:56:43.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.221+0000 7fbab5191700 1 -- 172.21.15.50:0/1902255946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab00cda90 con 0x7fbab00cb460 2023-11-28T11:56:43.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.221+0000 7fbaacff9700 1 -- 172.21.15.50:0/1902255946 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbaa8019030 con 0x7fbab00cb460 2023-11-28T11:56:43.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.221+0000 7fbaacff9700 1 --2- 172.21.15.50:0/1902255946 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba90064ee0 0x7fba90067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.221+0000 7fbaacff9700 1 -- 172.21.15.50:0/1902255946 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbaa8081c80 con 0x7fbab00cb460 2023-11-28T11:56:43.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.225+0000 7fbaaffff700 1 --2- 172.21.15.50:0/1902255946 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba90064ee0 0x7fba90067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.225+0000 7fbaaffff700 1 --2- 172.21.15.50:0/1902255946 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba90064ee0 0x7fba90067390 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009890 tx=0x7fbaa0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.229+0000 7fbaacff9700 1 -- 172.21.15.50:0/1902255946 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbaa804a400 con 0x7fbab00cb460 2023-11-28T11:56:43.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.393+0000 7fbab5191700 1 -- 172.21.15.50:0/1902255946 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbab0072500 con 0x7fba90064ee0 2023-11-28T11:56:43.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.413+0000 7fbaacff9700 1 -- 172.21.15.50:0/1902255946 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295526 (secure 0 0 0) 0x7fbab0072500 con 0x7fba90064ee0 2023-11-28T11:56:43.421 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:43.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.417+0000 7fbab5191700 1 -- 172.21.15.50:0/1902255946 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba90064ee0 msgr2=0x7fba90067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.417+0000 7fbab5191700 1 --2- 172.21.15.50:0/1902255946 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba90064ee0 0x7fba90067390 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009890 tx=0x7fbaa0008030 comp rx=0 tx=0).stop 2023-11-28T11:56:43.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.417+0000 7fbab5191700 1 -- 172.21.15.50:0/1902255946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbab00cb460 msgr2=0x7fbab0156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.417+0000 7fbab5191700 1 --2- 172.21.15.50:0/1902255946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbab00cb460 0x7fbab0156c10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800cc50 tx=0x7fbaa800cf60 comp rx=0 tx=0).stop 2023-11-28T11:56:43.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.417+0000 7fbab5191700 1 -- 172.21.15.50:0/1902255946 shutdown_connections 2023-11-28T11:56:43.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.417+0000 7fbab5191700 1 --2- 172.21.15.50:0/1902255946 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fba90064ee0 0x7fba90067390 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.417+0000 7fbab5191700 1 --2- 172.21.15.50:0/1902255946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbab0158ef0 0x7fbab01f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.417+0000 7fbab5191700 1 --2- 172.21.15.50:0/1902255946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbab00cb460 0x7fbab0156c10 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.417+0000 7fbab5191700 1 --2- 172.21.15.50:0/1902255946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbab00ad490 0x7fbab00c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.417+0000 7fbab5191700 1 -- 172.21.15.50:0/1902255946 >> 172.21.15.50:0/1902255946 conn(0x7fbab00ce3e0 msgr2=0x7fbab00b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:43.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.417+0000 7fbab5191700 1 -- 172.21.15.50:0/1902255946 shutdown_connections 2023-11-28T11:56:43.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.417+0000 7fbab5191700 1 -- 172.21.15.50:0/1902255946 wait complete. 2023-11-28T11:56:43.426 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:56:43.437 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2023-11-28T11:56:42.934073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":90776,"kb_used_data":7000,"kb_used_omap":0,"kb_used_meta":83712,"kb_avail":754883944,"statfs":{"total":773094113280,"available":773001158656,"internally_reserved":0,"allocated":7168000,"data_stored":3957768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":85721088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001256"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159917+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:56:36.159917+0000","last_peered":"2023-11-28T11:56:36.159917+0000","last_clean":"2023-11-28T11:56:36.159917+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:56:36.159917+0000","last_undegraded":"2023-11-28T11:56:36.159917+0000","last_fullsized":"2023-11-28T11:56:36.159917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159822+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:56:36.159822+0000","last_peered":"2023-11-28T11:56:36.159822+0000","last_clean":"2023-11-28T11:56:36.159822+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:56:36.159822+0000","last_undegraded":"2023-11-28T11:56:36.159822+0000","last_fullsized":"2023-11-28T11:56:36.159822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":54,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:35.933132+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:56:35.933132+0000","last_peered":"2023-11-28T11:56:35.933132+0000","last_clean":"2023-11-28T11:56:35.933132+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:56:35.933132+0000","last_undegraded":"2023-11-28T11:56:35.933132+0000","last_fullsized":"2023-11-28T11:56:35.933132+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159123+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:56:36.159123+0000","last_peered":"2023-11-28T11:56:36.159123+0000","last_clean":"2023-11-28T11:56:36.159123+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:56:36.159123+0000","last_undegraded":"2023-11-28T11:56:36.159123+0000","last_fullsized":"2023-11-28T11:56:36.159123+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":198,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159354+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:56:36.159354+0000","last_peered":"2023-11-28T11:56:36.159354+0000","last_clean":"2023-11-28T11:56:36.159354+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:56:36.159354+0000","last_undegraded":"2023-11-28T11:56:36.159354+0000","last_fullsized":"2023-11-28T11:56:36.159354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.162480+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:56:36.162480+0000","last_peered":"2023-11-28T11:56:36.162480+0000","last_clean":"2023-11-28T11:56:36.162480+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:56:36.162480+0000","last_undegraded":"2023-11-28T11:56:36.162480+0000","last_fullsized":"2023-11-28T11:56:36.162480+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159344+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:56:36.159344+0000","last_peered":"2023-11-28T11:56:36.159344+0000","last_clean":"2023-11-28T11:56:36.159344+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:56:36.159344+0000","last_undegraded":"2023-11-28T11:56:36.159344+0000","last_fullsized":"2023-11-28T11:56:36.159344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":57,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:35.933161+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:56:35.933161+0000","last_peered":"2023-11-28T11:56:35.933161+0000","last_clean":"2023-11-28T11:56:35.933161+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:56:35.933161+0000","last_undegraded":"2023-11-28T11:56:35.933161+0000","last_fullsized":"2023-11-28T11:56:35.933161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159436+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:56:36.159436+0000","last_peered":"2023-11-28T11:56:36.159436+0000","last_clean":"2023-11-28T11:56:36.159436+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:56:36.159436+0000","last_undegraded":"2023-11-28T11:56:36.159436+0000","last_fullsized":"2023-11-28T11:56:36.159436+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10596,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":9280,"kb_avail":94361244,"statfs":{"total":96636764160,"available":96625913856,"internally_reserved":0,"allocated":1339392,"data_stored":937004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9502720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.90900000000000003,"15min":0.91800000000000004},"min":{"1min":0.54300000000000004,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.268,"5min":1.413,"15min":1.413},"last":1.073},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96899999999999997,"15min":0.96999999999999997},"min":{"1min":0.59799999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.006}]},{"osd":1,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.84199999999999997,"15min":0.83299999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81599999999999995,"15min":0.81999999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.63700000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81599999999999995,"15min":0.80800000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.91900000000000004,"15min":0.92100000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1140000000000001,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.78700000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.86199999999999999,"15min":0.85299999999999998},"min":{"1min":0.65200000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0009999999999999,"15min":1.0089999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1919999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.91400000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.86499999999999999,"15min":0.871},"min":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.109,"5min":1.2,"15min":1.2},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.012,"15min":1.018},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3480000000000001,"5min":1.621,"15min":1.621},"last":1.165}]},{"osd":5,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.67400000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.2589999999999999,"5min":1.387,"15min":1.387},"last":1.038},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.081,"15min":1.091},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.329,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.1020000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0880000000000001,"15min":1.0940000000000001},"min":{"1min":0.84099999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.151},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.111,"15min":1.1140000000000001},"min":{"1min":0.83199999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4119999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.127}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9376,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362464,"statfs":{"total":96636764160,"available":96627163136,"internally_reserved":0,"allocated":745472,"data_stored":346636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.89700000000000002,"15min":0.90600000000000003},"min":{"1min":0.61899999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3440000000000001,"5min":1.625,"15min":1.625},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.095,"5min":1.498,"15min":1.498},"last":1.0409999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.84999999999999998,"15min":0.85999999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.099,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.97699999999999998,"15min":0.98799999999999999},"min":{"1min":0.56100000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1419999999999999,"5min":1.444,"15min":1.444},"last":0.93100000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95999999999999996,"15min":0.96299999999999997},"min":{"1min":0.64300000000000002,"5min":0.62,"15min":0.62},"max":{"1min":1.196,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.89200000000000002,"15min":0.89900000000000002},"min":{"1min":0.59399999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.107,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.2}]},{"osd":3,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89600000000000002,"15min":0.88500000000000001},"min":{"1min":0.72499999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.86099999999999999,"15min":0.85599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.121,"5min":1.161,"15min":1.161},"last":1.0640000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.94599999999999995,"15min":0.95299999999999996},"min":{"1min":0.59499999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.272,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0029999999999999,"15min":1.01},"min":{"1min":0.65100000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.248,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.90000000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.0089999999999999,"15min":1.0269999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1970000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.131,"15min":1.141},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4199999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.101}]},{"osd":7,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.079,"15min":1.0840000000000001},"min":{"1min":0.67800000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.206,"5min":1.575,"15min":1.575},"last":1.137},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0449999999999999,"15min":1.0549999999999999},"min":{"1min":0.73699999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1910000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.754}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9508,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362332,"statfs":{"total":96636764160,"available":96627027968,"internally_reserved":0,"allocated":749568,"data_stored":347622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1259999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.87},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85499999999999998,"15min":0.85899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.165,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.63400000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.64500000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0620000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.167},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90300000000000002,"15min":0.91700000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1240000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.006}]},{"osd":2,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.84399999999999997,"15min":0.83599999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.872,"5min":0.83799999999999997,"15min":0.83199999999999996},"min":{"1min":0.66500000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1259999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.111}]},{"osd":3,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1180000000000001,"5min":1.212,"15min":1.212},"last":1.133},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.98399999999999999,"15min":0.98799999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.319,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78000000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.179,"5min":1.968,"15min":1.968},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.0309999999999999,"15min":1.0429999999999999},"min":{"1min":0.67800000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1259999999999999,"5min":1.581,"15min":1.581},"last":1.085}]},{"osd":6,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0069999999999999,"15min":1.01},"min":{"1min":0.64000000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.268,"5min":1.482,"15min":1.482},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.002,"15min":1.004},"min":{"1min":0.72599999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2210000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.92800000000000005}]},{"osd":7,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0680000000000001,"15min":1.0740000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1819999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.097,"15min":1.0960000000000001},"min":{"1min":0.81100000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.04}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9700,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362140,"statfs":{"total":96636764160,"available":96626831360,"internally_reserved":0,"allocated":749568,"data_stored":347622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.84099999999999997,"15min":0.84499999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.83899999999999997,"15min":0.84599999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.0700000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85899999999999999,"15min":0.86099999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.93000000000000005,"15min":0.94599999999999995},"min":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.081,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.93300000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.67700000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.167,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.96299999999999997,"15min":0.97599999999999998},"min":{"1min":0.57199999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2090000000000001,"5min":1.528,"15min":1.528},"last":1.1599999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.93400000000000005,"15min":0.94099999999999995},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.2609999999999999,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.052,"15min":1.0680000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.165,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.872}]},{"osd":5,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.98899999999999999,"15min":0.99299999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3149999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.097},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.034,"15min":1.046},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.208,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.66900000000000004}]},{"osd":6,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.073,"15min":1.0860000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.294,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.151,"15min":1.159},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3799999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.02}]},{"osd":7,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1379999999999999,"15min":1.159},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2549999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1870000000000001,"15min":1.198},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.331,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.133}]}]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9632,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362208,"statfs":{"total":96636764160,"available":96626900992,"internally_reserved":0,"allocated":745472,"data_stored":346636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":0.876,"15min":0.70099999999999996},"min":{"1min":0.46500000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":21.122,"5min":21.122,"15min":21.122},"last":0.46500000000000002},{"interface":"front","average":{"1min":1.96,"5min":0.94899999999999995,"15min":0.78500000000000003},"min":{"1min":0.441,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":21.288,"5min":21.288,"15min":21.288},"last":0.441}]},{"osd":1,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.70699999999999996,"15min":0.63500000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":6.3090000000000002,"5min":6.3090000000000002,"15min":6.3090000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":2.052,"5min":1.0049999999999999,"15min":0.83699999999999997},"min":{"1min":0.41199999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":21.151,"5min":21.151,"15min":21.151},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.76600000000000001,"15min":0.78900000000000003},"min":{"1min":0.38600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.0960000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.91100000000000003,"15min":0.88700000000000001},"min":{"1min":0.497,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":6.5149999999999997,"5min":6.5149999999999997,"15min":6.5149999999999997},"last":0.497}]},{"osd":4,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":2.2400000000000002,"5min":1.266,"15min":1.1080000000000001},"min":{"1min":0.72099999999999997,"5min":0.505,"15min":0.505},"max":{"1min":21.347999999999999,"5min":21.347999999999999,"15min":21.347999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":2.3140000000000001,"5min":1.2989999999999999,"15min":1.1299999999999999},"min":{"1min":0.73799999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":21.129999999999999,"5min":21.129999999999999,"15min":21.129999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":2.3290000000000002,"5min":1.3260000000000001,"15min":1.1819999999999999},"min":{"1min":0.68200000000000005,"5min":0.626,"15min":0.626},"max":{"1min":21.210999999999999,"5min":21.210999999999999,"15min":21.210999999999999},"last":1.012},{"interface":"front","average":{"1min":2.3210000000000002,"5min":1.3720000000000001,"15min":1.228},"min":{"1min":0.82899999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":21.32,"5min":21.32,"15min":21.32},"last":1.03}]},{"osd":6,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0940000000000001,"15min":1.1120000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3360000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":2.3420000000000001,"5min":1.345,"15min":1.194},"min":{"1min":0.75900000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":21.077999999999999,"5min":21.077999999999999,"15min":21.077999999999999},"last":0.872}]},{"osd":7,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.127,"15min":1.151},"min":{"1min":0.82199999999999995,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.3580000000000001,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.522,"5min":1.2390000000000001,"15min":1.196},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":6.5750000000000002,"5min":6.5750000000000002,"15min":6.5750000000000002},"last":0.69899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13472,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":12736,"kb_avail":94358368,"statfs":{"total":96636764160,"available":96622968832,"internally_reserved":0,"allocated":745472,"data_stored":346636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13041664},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61199999999999999,"15min":0.59399999999999997},"min":{"1min":0.47599999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0600000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.40999999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.42799999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97799999999999998,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1399999999999999,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.92900000000000005}]},{"osd":3,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68400000000000005,"15min":0.69499999999999995},"min":{"1min":0.51000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.036,"5min":1.254,"15min":1.254},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.84499999999999997,"15min":0.82899999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.409,"5min":1.968,"15min":1.968},"last":0.63300000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0289999999999999,"15min":1.0429999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.5089999999999999,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0640000000000001,"15min":1.0820000000000001},"min":{"1min":0.85599999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.3700000000000001,"5min":2.181,"15min":2.181},"last":1.137}]},{"osd":5,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.97199999999999998,"15min":0.97899999999999998},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1639999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.60499999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5600000000000001,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.069}]},{"osd":6,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.1419999999999999,"15min":1.1779999999999999},"min":{"1min":0.73199999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.484,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.1080000000000001,"15min":1.1359999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.466,"5min":1.867,"15min":1.867},"last":1.105}]},{"osd":7,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.165,"15min":1.1839999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.542,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.1220000000000001,"15min":1.1399999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.351,"5min":1.675,"15min":1.675},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14632,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357208,"statfs":{"total":96636764160,"available":96621780992,"internally_reserved":0,"allocated":1343488,"data_stored":937990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.90400000000000003,"5min":1.387,"15min":1.387},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69099999999999995,"15min":0.68500000000000005},"min":{"1min":0.46100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.69899999999999995}]},{"osd":2,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.46400000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":1.024},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79000000000000004,"15min":0.79200000000000004},"min":{"1min":0.46000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.1439999999999999,"5min":1.175,"15min":1.175},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.85999999999999999,"15min":0.87},"min":{"1min":0.52900000000000003,"5min":0.317,"15min":0.317},"max":{"1min":1.1100000000000001,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.51100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.86199999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.91500000000000004,"15min":0.91000000000000003},"min":{"1min":0.73399999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2689999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":1,"5min":1.0669999999999999,"15min":1.0780000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3740000000000001,"5min":2.29,"15min":2.29},"last":0.92000000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.018,"15min":1.0189999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1},{"interface":"front","average":{"1min":0.998,"5min":1.038,"15min":1.044},"min":{"1min":0.79100000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1379999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.103}]},{"osd":6,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0609999999999999,"15min":1.0549999999999999},"min":{"1min":0.72099999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.073},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.075,"15min":1.081},"min":{"1min":0.88800000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3460000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.96199999999999997}]},{"osd":7,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.2,"15min":1.2110000000000001},"min":{"1min":0.90100000000000002,"5min":0.747,"15min":0.747},"max":{"1min":1.5249999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1080000000000001,"15min":1.1040000000000001},"min":{"1min":0.81499999999999995,"5min":0.629,"15min":0.629},"max":{"1min":1.635,"5min":1.647,"15min":1.647},"last":1.133}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13860,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":13120,"kb_avail":94357980,"statfs":{"total":96636764160,"available":96622571520,"internally_reserved":0,"allocated":749568,"data_stored":347622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13434880},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.66800000000000004,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95299999999999996,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.628},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.016,"5min":1.091,"15min":1.091},"last":0.86799999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90500000000000003,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.45500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.1399999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.91600000000000004,"15min":0.92700000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0680000000000001,"5min":1.96,"15min":1.96},"last":1.1140000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.72499999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.996,"5min":1.1000000000000001,"15min":1.1180000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.2010000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.95599999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0640000000000001,"15min":1.0720000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2509999999999999,"5min":1.649,"15min":1.649},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.0029999999999999,"15min":1.0069999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2110000000000001,"5min":1.339,"15min":1.339},"last":0.84499999999999997}]},{"osd":6,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.177,"15min":1.1899999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.536,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.216},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.133,"15min":1.139},"min":{"1min":0.80400000000000005,"5min":0.749,"15min":0.749},"max":{"1min":1.2909999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.24}]},{"osd":7,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.155,"15min":1.161},"min":{"1min":0.84499999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.3169999999999999,"5min":1.486,"15min":1.486},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0800000000000001,"15min":1.0780000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.2470000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:56:43.444 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:56:43.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395d1a3700 1 Processor -- start 2023-11-28T11:56:43.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395d1a3700 1 -- start start 2023-11-28T11:56:43.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395d1a3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39581606b0 0x7f39580c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395d1a3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f39580ceef0 0x7f39580c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395d1a3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39580ad610 0x7f3958164040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395d1a3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39580cae70 con 0x7f39581606b0 2023-11-28T11:56:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395d1a3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39580cbc10 con 0x7f39580ceef0 2023-11-28T11:56:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395d1a3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39580cb130 con 0x7f39580ad610 2023-11-28T11:56:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f3957fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39581606b0 0x7f39580c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f3957fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39581606b0 0x7f39580c13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48526/0 (socket says 172.21.15.50:48526) 2023-11-28T11:56:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f3957fff700 1 -- 172.21.15.50:0/3388691922 learned_addr learned my addr 172.21.15.50:0/3388691922 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f39577fe700 1 --2- 172.21.15.50:0/3388691922 >> v2:172.21.15.192:3300/0 conn(0x7f39580ceef0 0x7f39580c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395c9a2700 1 --2- 172.21.15.50:0/3388691922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39580ad610 0x7f3958164040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f3957fff700 1 -- 172.21.15.50:0/3388691922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39580ad610 msgr2=0x7f3958164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f3957fff700 1 --2- 172.21.15.50:0/3388691922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39580ad610 0x7f3958164040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f3957fff700 1 -- 172.21.15.50:0/3388691922 >> v2:172.21.15.192:3300/0 conn(0x7f39580ceef0 msgr2=0x7f39580c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:43.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f3957fff700 1 --2- 172.21.15.50:0/3388691922 >> v2:172.21.15.192:3300/0 conn(0x7f39580ceef0 0x7f39580c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f3957fff700 1 -- 172.21.15.50:0/3388691922 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39580cb410 con 0x7f39581606b0 2023-11-28T11:56:43.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f3957fff700 1 --2- 172.21.15.50:0/3388691922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39581606b0 0x7f39580c13b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f395806b850 tx=0x7f3948009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a121a1bac99f79e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:43.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f3956ffd700 1 -- 172.21.15.50:0/3388691922 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394800b8a0 con 0x7f39581606b0 2023-11-28T11:56:43.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f3956ffd700 1 -- 172.21.15.50:0/3388691922 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394800ba00 con 0x7f39581606b0 2023-11-28T11:56:43.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f3956ffd700 1 -- 172.21.15.50:0/3388691922 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394800bd90 con 0x7f39581606b0 2023-11-28T11:56:43.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395d1a3700 1 -- 172.21.15.50:0/3388691922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39581606b0 msgr2=0x7f39580c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395d1a3700 1 --2- 172.21.15.50:0/3388691922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39581606b0 0x7f39580c13b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f395806b850 tx=0x7f3948009bf0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395d1a3700 1 -- 172.21.15.50:0/3388691922 shutdown_connections 2023-11-28T11:56:43.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395d1a3700 1 --2- 172.21.15.50:0/3388691922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39580ad610 0x7f3958164040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395d1a3700 1 --2- 172.21.15.50:0/3388691922 >> v2:172.21.15.192:3300/0 conn(0x7f39580ceef0 0x7f39580c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395d1a3700 1 --2- 172.21.15.50:0/3388691922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39581606b0 0x7f39580c13b0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395d1a3700 1 -- 172.21.15.50:0/3388691922 >> 172.21.15.50:0/3388691922 conn(0x7f39580ce3e0 msgr2=0x7f39580ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:43.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395d1a3700 1 -- 172.21.15.50:0/3388691922 shutdown_connections 2023-11-28T11:56:43.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.557+0000 7f395d1a3700 1 -- 172.21.15.50:0/3388691922 wait complete. 2023-11-28T11:56:43.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.561+0000 7f395d1a3700 1 Processor -- start 2023-11-28T11:56:43.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.561+0000 7f395d1a3700 1 -- start start 2023-11-28T11:56:43.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.561+0000 7f395d1a3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39580ad610 0x7f3958097800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.561+0000 7f395d1a3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39580ceef0 0x7f39581f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.561+0000 7f395d1a3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39581606b0 0x7f3958070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.561+0000 7f395d1a3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395815e9a0 con 0x7f39580ceef0 2023-11-28T11:56:43.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.561+0000 7f395d1a3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395815dd90 con 0x7f39581606b0 2023-11-28T11:56:43.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.561+0000 7f395d1a3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395815e070 con 0x7f39580ad610 2023-11-28T11:56:43.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.565+0000 7f39577fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39580ceef0 0x7f39581f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.565+0000 7f39577fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39580ceef0 0x7f39581f5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48532/0 (socket says 172.21.15.50:48532) 2023-11-28T11:56:43.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.565+0000 7f39577fe700 1 -- 172.21.15.50:0/2739545845 learned_addr learned my addr 172.21.15.50:0/2739545845 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:43.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.565+0000 7f3957fff700 1 --2- 172.21.15.50:0/2739545845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39580ad610 0x7f3958097800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.565+0000 7f395c9a2700 1 --2- 172.21.15.50:0/2739545845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39581606b0 0x7f3958070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.565+0000 7f39577fe700 1 -- 172.21.15.50:0/2739545845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39580ad610 msgr2=0x7f3958097800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.565+0000 7f39577fe700 1 --2- 172.21.15.50:0/2739545845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39580ad610 0x7f3958097800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.565+0000 7f39577fe700 1 -- 172.21.15.50:0/2739545845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39581606b0 msgr2=0x7f3958070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.565+0000 7f39577fe700 1 --2- 172.21.15.50:0/2739545845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39581606b0 0x7f3958070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.565+0000 7f39577fe700 1 -- 172.21.15.50:0/2739545845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3948009570 con 0x7f39580ceef0 2023-11-28T11:56:43.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.565+0000 7f39577fe700 1 --2- 172.21.15.50:0/2739545845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39580ceef0 0x7f39581f5bc0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3950007ef0 tx=0x7f395000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:43.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.565+0000 7f3954ff9700 1 -- 172.21.15.50:0/2739545845 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395000edf0 con 0x7f39580ceef0 2023-11-28T11:56:43.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.565+0000 7f3954ff9700 1 -- 172.21.15.50:0/2739545845 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3950014420 con 0x7f39580ceef0 2023-11-28T11:56:43.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.565+0000 7f395d1a3700 1 -- 172.21.15.50:0/2739545845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39580b36c0 con 0x7f39580ceef0 2023-11-28T11:56:43.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.565+0000 7f3954ff9700 1 -- 172.21.15.50:0/2739545845 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39500147d0 con 0x7f39580ceef0 2023-11-28T11:56:43.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.565+0000 7f395d1a3700 1 -- 172.21.15.50:0/2739545845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39580cb6f0 con 0x7f39580ceef0 2023-11-28T11:56:43.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.565+0000 7f395d1a3700 1 -- 172.21.15.50:0/2739545845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3958164580 con 0x7f39580ceef0 2023-11-28T11:56:43.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.569+0000 7f3954ff9700 1 -- 172.21.15.50:0/2739545845 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3950012050 con 0x7f39580ceef0 2023-11-28T11:56:43.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.569+0000 7f3954ff9700 1 --2- 172.21.15.50:0/2739545845 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3938064ee0 0x7f3938067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.569+0000 7f3954ff9700 1 -- 172.21.15.50:0/2739545845 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f39500826d0 con 0x7f39580ceef0 2023-11-28T11:56:43.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.569+0000 7f3957fff700 1 --2- 172.21.15.50:0/2739545845 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3938064ee0 0x7f3938067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.569+0000 7f3957fff700 1 --2- 172.21.15.50:0/2739545845 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3938064ee0 0x7f3938067390 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3948000c00 tx=0x7f3948008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:43.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.573+0000 7f3954ff9700 1 -- 172.21.15.50:0/2739545845 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3950050640 con 0x7f39580ceef0 2023-11-28T11:56:43.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.737+0000 7f395d1a3700 1 -- 172.21.15.50:0/2739545845 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3958072500 con 0x7f3938064ee0 2023-11-28T11:56:43.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.757+0000 7f3954ff9700 1 -- 172.21.15.50:0/2739545845 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295526 (secure 0 0 0) 0x7f3958072500 con 0x7f3938064ee0 2023-11-28T11:56:43.761 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:43.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.761+0000 7f395d1a3700 1 -- 172.21.15.50:0/2739545845 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3938064ee0 msgr2=0x7f3938067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.761+0000 7f395d1a3700 1 --2- 172.21.15.50:0/2739545845 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3938064ee0 0x7f3938067390 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3948000c00 tx=0x7f3948008030 comp rx=0 tx=0).stop 2023-11-28T11:56:43.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.761+0000 7f395d1a3700 1 -- 172.21.15.50:0/2739545845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39580ceef0 msgr2=0x7f39581f5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.761+0000 7f395d1a3700 1 --2- 172.21.15.50:0/2739545845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39580ceef0 0x7f39581f5bc0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3950007ef0 tx=0x7f395000e3c0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.761+0000 7f395d1a3700 1 -- 172.21.15.50:0/2739545845 shutdown_connections 2023-11-28T11:56:43.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.761+0000 7f395d1a3700 1 --2- 172.21.15.50:0/2739545845 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3938064ee0 0x7f3938067390 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.761+0000 7f395d1a3700 1 --2- 172.21.15.50:0/2739545845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39581606b0 0x7f3958070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.761+0000 7f395d1a3700 1 --2- 172.21.15.50:0/2739545845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39580ceef0 0x7f39581f5bc0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.761+0000 7f395d1a3700 1 --2- 172.21.15.50:0/2739545845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39580ad610 0x7f3958097800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.761+0000 7f395d1a3700 1 -- 172.21.15.50:0/2739545845 >> 172.21.15.50:0/2739545845 conn(0x7f39580ce3e0 msgr2=0x7f395815c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:43.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.761+0000 7f395d1a3700 1 -- 172.21.15.50:0/2739545845 shutdown_connections 2023-11-28T11:56:43.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.761+0000 7f395d1a3700 1 -- 172.21.15.50:0/2739545845 wait complete. 2023-11-28T11:56:43.765 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:56:43.779 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2023-11-28T11:56:42.934073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":90776,"kb_used_data":7000,"kb_used_omap":0,"kb_used_meta":83712,"kb_avail":754883944,"statfs":{"total":773094113280,"available":773001158656,"internally_reserved":0,"allocated":7168000,"data_stored":3957768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":85721088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001256"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159917+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:56:36.159917+0000","last_peered":"2023-11-28T11:56:36.159917+0000","last_clean":"2023-11-28T11:56:36.159917+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:56:36.159917+0000","last_undegraded":"2023-11-28T11:56:36.159917+0000","last_fullsized":"2023-11-28T11:56:36.159917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159822+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:56:36.159822+0000","last_peered":"2023-11-28T11:56:36.159822+0000","last_clean":"2023-11-28T11:56:36.159822+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:56:36.159822+0000","last_undegraded":"2023-11-28T11:56:36.159822+0000","last_fullsized":"2023-11-28T11:56:36.159822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":54,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:35.933132+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:56:35.933132+0000","last_peered":"2023-11-28T11:56:35.933132+0000","last_clean":"2023-11-28T11:56:35.933132+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:56:35.933132+0000","last_undegraded":"2023-11-28T11:56:35.933132+0000","last_fullsized":"2023-11-28T11:56:35.933132+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159123+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:56:36.159123+0000","last_peered":"2023-11-28T11:56:36.159123+0000","last_clean":"2023-11-28T11:56:36.159123+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:56:36.159123+0000","last_undegraded":"2023-11-28T11:56:36.159123+0000","last_fullsized":"2023-11-28T11:56:36.159123+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":198,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159354+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:56:36.159354+0000","last_peered":"2023-11-28T11:56:36.159354+0000","last_clean":"2023-11-28T11:56:36.159354+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:56:36.159354+0000","last_undegraded":"2023-11-28T11:56:36.159354+0000","last_fullsized":"2023-11-28T11:56:36.159354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.162480+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:56:36.162480+0000","last_peered":"2023-11-28T11:56:36.162480+0000","last_clean":"2023-11-28T11:56:36.162480+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:56:36.162480+0000","last_undegraded":"2023-11-28T11:56:36.162480+0000","last_fullsized":"2023-11-28T11:56:36.162480+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159344+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:56:36.159344+0000","last_peered":"2023-11-28T11:56:36.159344+0000","last_clean":"2023-11-28T11:56:36.159344+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:56:36.159344+0000","last_undegraded":"2023-11-28T11:56:36.159344+0000","last_fullsized":"2023-11-28T11:56:36.159344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":57,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:35.933161+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:56:35.933161+0000","last_peered":"2023-11-28T11:56:35.933161+0000","last_clean":"2023-11-28T11:56:35.933161+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:56:35.933161+0000","last_undegraded":"2023-11-28T11:56:35.933161+0000","last_fullsized":"2023-11-28T11:56:35.933161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159436+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:56:36.159436+0000","last_peered":"2023-11-28T11:56:36.159436+0000","last_clean":"2023-11-28T11:56:36.159436+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:56:36.159436+0000","last_undegraded":"2023-11-28T11:56:36.159436+0000","last_fullsized":"2023-11-28T11:56:36.159436+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10596,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":9280,"kb_avail":94361244,"statfs":{"total":96636764160,"available":96625913856,"internally_reserved":0,"allocated":1339392,"data_stored":937004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9502720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.90900000000000003,"15min":0.91800000000000004},"min":{"1min":0.54300000000000004,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.268,"5min":1.413,"15min":1.413},"last":1.073},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96899999999999997,"15min":0.96999999999999997},"min":{"1min":0.59799999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.006}]},{"osd":1,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.84199999999999997,"15min":0.83299999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81599999999999995,"15min":0.81999999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.63700000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81599999999999995,"15min":0.80800000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.91900000000000004,"15min":0.92100000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1140000000000001,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.78700000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.86199999999999999,"15min":0.85299999999999998},"min":{"1min":0.65200000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0009999999999999,"15min":1.0089999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1919999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.91400000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.86499999999999999,"15min":0.871},"min":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.109,"5min":1.2,"15min":1.2},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.012,"15min":1.018},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3480000000000001,"5min":1.621,"15min":1.621},"last":1.165}]},{"osd":5,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.67400000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.2589999999999999,"5min":1.387,"15min":1.387},"last":1.038},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.081,"15min":1.091},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.329,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.1020000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0880000000000001,"15min":1.0940000000000001},"min":{"1min":0.84099999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.151},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.111,"15min":1.1140000000000001},"min":{"1min":0.83199999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4119999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.127}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9376,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362464,"statfs":{"total":96636764160,"available":96627163136,"internally_reserved":0,"allocated":745472,"data_stored":346636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.89700000000000002,"15min":0.90600000000000003},"min":{"1min":0.61899999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3440000000000001,"5min":1.625,"15min":1.625},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.095,"5min":1.498,"15min":1.498},"last":1.0409999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.84999999999999998,"15min":0.85999999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.099,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.97699999999999998,"15min":0.98799999999999999},"min":{"1min":0.56100000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1419999999999999,"5min":1.444,"15min":1.444},"last":0.93100000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95999999999999996,"15min":0.96299999999999997},"min":{"1min":0.64300000000000002,"5min":0.62,"15min":0.62},"max":{"1min":1.196,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.89200000000000002,"15min":0.89900000000000002},"min":{"1min":0.59399999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.107,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.2}]},{"osd":3,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89600000000000002,"15min":0.88500000000000001},"min":{"1min":0.72499999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.86099999999999999,"15min":0.85599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.121,"5min":1.161,"15min":1.161},"last":1.0640000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.94599999999999995,"15min":0.95299999999999996},"min":{"1min":0.59499999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.272,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0029999999999999,"15min":1.01},"min":{"1min":0.65100000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.248,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.90000000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.0089999999999999,"15min":1.0269999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1970000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.131,"15min":1.141},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4199999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.101}]},{"osd":7,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.079,"15min":1.0840000000000001},"min":{"1min":0.67800000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.206,"5min":1.575,"15min":1.575},"last":1.137},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0449999999999999,"15min":1.0549999999999999},"min":{"1min":0.73699999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1910000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.754}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9508,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362332,"statfs":{"total":96636764160,"available":96627027968,"internally_reserved":0,"allocated":749568,"data_stored":347622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1259999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.87},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85499999999999998,"15min":0.85899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.165,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.63400000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.64500000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0620000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.167},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90300000000000002,"15min":0.91700000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1240000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.006}]},{"osd":2,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.84399999999999997,"15min":0.83599999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.872,"5min":0.83799999999999997,"15min":0.83199999999999996},"min":{"1min":0.66500000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1259999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.111}]},{"osd":3,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1180000000000001,"5min":1.212,"15min":1.212},"last":1.133},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.98399999999999999,"15min":0.98799999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.319,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78000000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.179,"5min":1.968,"15min":1.968},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.0309999999999999,"15min":1.0429999999999999},"min":{"1min":0.67800000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1259999999999999,"5min":1.581,"15min":1.581},"last":1.085}]},{"osd":6,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0069999999999999,"15min":1.01},"min":{"1min":0.64000000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.268,"5min":1.482,"15min":1.482},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.002,"15min":1.004},"min":{"1min":0.72599999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2210000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.92800000000000005}]},{"osd":7,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0680000000000001,"15min":1.0740000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1819999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.097,"15min":1.0960000000000001},"min":{"1min":0.81100000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.04}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9700,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362140,"statfs":{"total":96636764160,"available":96626831360,"internally_reserved":0,"allocated":749568,"data_stored":347622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.84099999999999997,"15min":0.84499999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.83899999999999997,"15min":0.84599999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.0700000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85899999999999999,"15min":0.86099999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.93000000000000005,"15min":0.94599999999999995},"min":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.081,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.93300000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.67700000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.167,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.96299999999999997,"15min":0.97599999999999998},"min":{"1min":0.57199999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2090000000000001,"5min":1.528,"15min":1.528},"last":1.1599999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.93400000000000005,"15min":0.94099999999999995},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.2609999999999999,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.052,"15min":1.0680000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.165,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.872}]},{"osd":5,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.98899999999999999,"15min":0.99299999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3149999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.097},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.034,"15min":1.046},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.208,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.66900000000000004}]},{"osd":6,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.073,"15min":1.0860000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.294,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.151,"15min":1.159},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3799999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.02}]},{"osd":7,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1379999999999999,"15min":1.159},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2549999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1870000000000001,"15min":1.198},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.331,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.133}]}]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9632,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362208,"statfs":{"total":96636764160,"available":96626900992,"internally_reserved":0,"allocated":745472,"data_stored":346636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":0.876,"15min":0.70099999999999996},"min":{"1min":0.46500000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":21.122,"5min":21.122,"15min":21.122},"last":0.46500000000000002},{"interface":"front","average":{"1min":1.96,"5min":0.94899999999999995,"15min":0.78500000000000003},"min":{"1min":0.441,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":21.288,"5min":21.288,"15min":21.288},"last":0.441}]},{"osd":1,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.70699999999999996,"15min":0.63500000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":6.3090000000000002,"5min":6.3090000000000002,"15min":6.3090000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":2.052,"5min":1.0049999999999999,"15min":0.83699999999999997},"min":{"1min":0.41199999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":21.151,"5min":21.151,"15min":21.151},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.76600000000000001,"15min":0.78900000000000003},"min":{"1min":0.38600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.0960000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.91100000000000003,"15min":0.88700000000000001},"min":{"1min":0.497,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":6.5149999999999997,"5min":6.5149999999999997,"15min":6.5149999999999997},"last":0.497}]},{"osd":4,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":2.2400000000000002,"5min":1.266,"15min":1.1080000000000001},"min":{"1min":0.72099999999999997,"5min":0.505,"15min":0.505},"max":{"1min":21.347999999999999,"5min":21.347999999999999,"15min":21.347999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":2.3140000000000001,"5min":1.2989999999999999,"15min":1.1299999999999999},"min":{"1min":0.73799999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":21.129999999999999,"5min":21.129999999999999,"15min":21.129999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":2.3290000000000002,"5min":1.3260000000000001,"15min":1.1819999999999999},"min":{"1min":0.68200000000000005,"5min":0.626,"15min":0.626},"max":{"1min":21.210999999999999,"5min":21.210999999999999,"15min":21.210999999999999},"last":1.012},{"interface":"front","average":{"1min":2.3210000000000002,"5min":1.3720000000000001,"15min":1.228},"min":{"1min":0.82899999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":21.32,"5min":21.32,"15min":21.32},"last":1.03}]},{"osd":6,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0940000000000001,"15min":1.1120000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3360000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":2.3420000000000001,"5min":1.345,"15min":1.194},"min":{"1min":0.75900000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":21.077999999999999,"5min":21.077999999999999,"15min":21.077999999999999},"last":0.872}]},{"osd":7,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.127,"15min":1.151},"min":{"1min":0.82199999999999995,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.3580000000000001,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.522,"5min":1.2390000000000001,"15min":1.196},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":6.5750000000000002,"5min":6.5750000000000002,"15min":6.5750000000000002},"last":0.69899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13472,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":12736,"kb_avail":94358368,"statfs":{"total":96636764160,"available":96622968832,"internally_reserved":0,"allocated":745472,"data_stored":346636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13041664},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61199999999999999,"15min":0.59399999999999997},"min":{"1min":0.47599999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0600000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.40999999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.42799999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97799999999999998,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1399999999999999,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.92900000000000005}]},{"osd":3,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68400000000000005,"15min":0.69499999999999995},"min":{"1min":0.51000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.036,"5min":1.254,"15min":1.254},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.84499999999999997,"15min":0.82899999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.409,"5min":1.968,"15min":1.968},"last":0.63300000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0289999999999999,"15min":1.0429999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.5089999999999999,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0640000000000001,"15min":1.0820000000000001},"min":{"1min":0.85599999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.3700000000000001,"5min":2.181,"15min":2.181},"last":1.137}]},{"osd":5,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.97199999999999998,"15min":0.97899999999999998},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1639999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.60499999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5600000000000001,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.069}]},{"osd":6,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.1419999999999999,"15min":1.1779999999999999},"min":{"1min":0.73199999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.484,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.1080000000000001,"15min":1.1359999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.466,"5min":1.867,"15min":1.867},"last":1.105}]},{"osd":7,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.165,"15min":1.1839999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.542,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.1220000000000001,"15min":1.1399999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.351,"5min":1.675,"15min":1.675},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14632,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357208,"statfs":{"total":96636764160,"available":96621780992,"internally_reserved":0,"allocated":1343488,"data_stored":937990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.90400000000000003,"5min":1.387,"15min":1.387},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69099999999999995,"15min":0.68500000000000005},"min":{"1min":0.46100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.69899999999999995}]},{"osd":2,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.46400000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":1.024},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79000000000000004,"15min":0.79200000000000004},"min":{"1min":0.46000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.1439999999999999,"5min":1.175,"15min":1.175},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.85999999999999999,"15min":0.87},"min":{"1min":0.52900000000000003,"5min":0.317,"15min":0.317},"max":{"1min":1.1100000000000001,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.51100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.86199999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.91500000000000004,"15min":0.91000000000000003},"min":{"1min":0.73399999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2689999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":1,"5min":1.0669999999999999,"15min":1.0780000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3740000000000001,"5min":2.29,"15min":2.29},"last":0.92000000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.018,"15min":1.0189999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1},{"interface":"front","average":{"1min":0.998,"5min":1.038,"15min":1.044},"min":{"1min":0.79100000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1379999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.103}]},{"osd":6,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0609999999999999,"15min":1.0549999999999999},"min":{"1min":0.72099999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.073},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.075,"15min":1.081},"min":{"1min":0.88800000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3460000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.96199999999999997}]},{"osd":7,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.2,"15min":1.2110000000000001},"min":{"1min":0.90100000000000002,"5min":0.747,"15min":0.747},"max":{"1min":1.5249999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1080000000000001,"15min":1.1040000000000001},"min":{"1min":0.81499999999999995,"5min":0.629,"15min":0.629},"max":{"1min":1.635,"5min":1.647,"15min":1.647},"last":1.133}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13860,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":13120,"kb_avail":94357980,"statfs":{"total":96636764160,"available":96622571520,"internally_reserved":0,"allocated":749568,"data_stored":347622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13434880},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.66800000000000004,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95299999999999996,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.628},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.016,"5min":1.091,"15min":1.091},"last":0.86799999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90500000000000003,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.45500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.1399999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.91600000000000004,"15min":0.92700000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0680000000000001,"5min":1.96,"15min":1.96},"last":1.1140000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.72499999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.996,"5min":1.1000000000000001,"15min":1.1180000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.2010000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.95599999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0640000000000001,"15min":1.0720000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2509999999999999,"5min":1.649,"15min":1.649},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.0029999999999999,"15min":1.0069999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2110000000000001,"5min":1.339,"15min":1.339},"last":0.84499999999999997}]},{"osd":6,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.177,"15min":1.1899999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.536,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.216},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.133,"15min":1.139},"min":{"1min":0.80400000000000005,"5min":0.749,"15min":0.749},"max":{"1min":1.2909999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.24}]},{"osd":7,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.155,"15min":1.161},"min":{"1min":0.84499999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.3169999999999999,"5min":1.486,"15min":1.486},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0800000000000001,"15min":1.0780000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.2470000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:56:43.786 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:56:43.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.901+0000 7f7e3bfff700 1 Processor -- start 2023-11-28T11:56:43.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.901+0000 7f7e3bfff700 1 -- start start 2023-11-28T11:56:43.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7e3c0cf050 0x7f7e3c06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e3c06a530 0x7f7e3c0cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e3c0b4c10 0x7f7e3c0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3bfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3c15c6d0 con 0x7f7e3c06a530 2023-11-28T11:56:43.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3bfff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3c06a9d0 con 0x7f7e3c0cf050 2023-11-28T11:56:43.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3bfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c0cf960 con 0x7f7e3c0b4c10 2023-11-28T11:56:43.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e33fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e3c06a530 0x7f7e3c0cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e33fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7e3c06a530 0x7f7e3c0cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48548/0 (socket says 172.21.15.50:48548) 2023-11-28T11:56:43.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e33fff700 1 -- 172.21.15.50:0/716735133 learned_addr learned my addr 172.21.15.50:0/716735133 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:43.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3b7fe700 1 --2- 172.21.15.50:0/716735133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e3c0b4c10 0x7f7e3c0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e33fff700 1 -- 172.21.15.50:0/716735133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e3c0b4c10 msgr2=0x7f7e3c0cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:43.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3affd700 1 --2- 172.21.15.50:0/716735133 >> v2:172.21.15.192:3300/0 conn(0x7f7e3c0cf050 0x7f7e3c06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e33fff700 1 --2- 172.21.15.50:0/716735133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e3c0b4c10 0x7f7e3c0cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e33fff700 1 -- 172.21.15.50:0/716735133 >> v2:172.21.15.192:3300/0 conn(0x7f7e3c0cf050 msgr2=0x7f7e3c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:43.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e33fff700 1 --2- 172.21.15.50:0/716735133 >> v2:172.21.15.192:3300/0 conn(0x7f7e3c0cf050 0x7f7e3c06d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e33fff700 1 -- 172.21.15.50:0/716735133 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c06ac60 con 0x7f7e3c06a530 2023-11-28T11:56:43.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3affd700 1 --2- 172.21.15.50:0/716735133 >> v2:172.21.15.192:3300/0 conn(0x7f7e3c0cf050 0x7f7e3c06d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:43.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e33fff700 1 --2- 172.21.15.50:0/716735133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e3c06a530 0x7f7e3c0cf420 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c08b9c0 tx=0x7f7e24009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729f398a9c7a3f5a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:43.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3a7fc700 1 -- 172.21.15.50:0/716735133 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2400b8a0 con 0x7f7e3c06a530 2023-11-28T11:56:43.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3a7fc700 1 -- 172.21.15.50:0/716735133 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2400ba00 con 0x7f7e3c06a530 2023-11-28T11:56:43.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3a7fc700 1 -- 172.21.15.50:0/716735133 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2400bd90 con 0x7f7e3c06a530 2023-11-28T11:56:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3bfff700 1 -- 172.21.15.50:0/716735133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e3c06a530 msgr2=0x7f7e3c0cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3bfff700 1 --2- 172.21.15.50:0/716735133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e3c06a530 0x7f7e3c0cf420 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c08b9c0 tx=0x7f7e24009bf0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3bfff700 1 -- 172.21.15.50:0/716735133 shutdown_connections 2023-11-28T11:56:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3bfff700 1 --2- 172.21.15.50:0/716735133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e3c0b4c10 0x7f7e3c0cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3bfff700 1 --2- 172.21.15.50:0/716735133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e3c06a530 0x7f7e3c0cf420 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3bfff700 1 --2- 172.21.15.50:0/716735133 >> v2:172.21.15.192:3300/0 conn(0x7f7e3c0cf050 0x7f7e3c06d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3bfff700 1 -- 172.21.15.50:0/716735133 >> 172.21.15.50:0/716735133 conn(0x7f7e3c09bb30 msgr2=0x7f7e3c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3bfff700 1 -- 172.21.15.50:0/716735133 shutdown_connections 2023-11-28T11:56:43.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.905+0000 7f7e3bfff700 1 -- 172.21.15.50:0/716735133 wait complete. 2023-11-28T11:56:43.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3bfff700 1 Processor -- start 2023-11-28T11:56:43.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3bfff700 1 -- start start 2023-11-28T11:56:43.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3c06a530 0x7f7e3c15f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e3c0b4c10 0x7f7e3c14cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e3c0cf050 0x7f7e3c09df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3bfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c15fae0 con 0x7f7e3c0cf050 2023-11-28T11:56:43.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3bfff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c14b0a0 con 0x7f7e3c06a530 2023-11-28T11:56:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3bfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c14b380 con 0x7f7e3c0b4c10 2023-11-28T11:56:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e3c0cf050 0x7f7e3c09df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3b7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e3c0cf050 0x7f7e3c09df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48562/0 (socket says 172.21.15.50:48562) 2023-11-28T11:56:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3b7fe700 1 -- 172.21.15.50:0/641060575 learned_addr learned my addr 172.21.15.50:0/641060575 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e33fff700 1 --2- 172.21.15.50:0/641060575 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e3c0b4c10 0x7f7e3c14cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3affd700 1 --2- 172.21.15.50:0/641060575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3c06a530 0x7f7e3c15f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3b7fe700 1 -- 172.21.15.50:0/641060575 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e3c0b4c10 msgr2=0x7f7e3c14cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3b7fe700 1 --2- 172.21.15.50:0/641060575 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e3c0b4c10 0x7f7e3c14cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3b7fe700 1 -- 172.21.15.50:0/641060575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3c06a530 msgr2=0x7f7e3c15f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3b7fe700 1 --2- 172.21.15.50:0/641060575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3c06a530 0x7f7e3c15f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3b7fe700 1 -- 172.21.15.50:0/641060575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e24009570 con 0x7f7e3c0cf050 2023-11-28T11:56:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e3b7fe700 1 --2- 172.21.15.50:0/641060575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e3c0cf050 0x7f7e3c09df00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400cd70 tx=0x7f7e3400a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:43.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e337fe700 1 -- 172.21.15.50:0/641060575 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34003a40 con 0x7f7e3c0cf050 2023-11-28T11:56:43.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.909+0000 7f7e337fe700 1 -- 172.21.15.50:0/641060575 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e34003ba0 con 0x7f7e3c0cf050 2023-11-28T11:56:43.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.913+0000 7f7e3bfff700 1 -- 172.21.15.50:0/641060575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3c0b4410 con 0x7f7e3c0cf050 2023-11-28T11:56:43.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.913+0000 7f7e337fe700 1 -- 172.21.15.50:0/641060575 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34004020 con 0x7f7e3c0cf050 2023-11-28T11:56:43.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.913+0000 7f7e3bfff700 1 -- 172.21.15.50:0/641060575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3c06af40 con 0x7f7e3c0cf050 2023-11-28T11:56:43.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.913+0000 7f7e3bfff700 1 -- 172.21.15.50:0/641060575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3c0b46f0 con 0x7f7e3c0cf050 2023-11-28T11:56:43.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.913+0000 7f7e337fe700 1 -- 172.21.15.50:0/641060575 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7e3401c020 con 0x7f7e3c0cf050 2023-11-28T11:56:43.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.913+0000 7f7e337fe700 1 --2- 172.21.15.50:0/641060575 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7e1c064ee0 0x7f7e1c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:43.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.913+0000 7f7e337fe700 1 -- 172.21.15.50:0/641060575 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7e34012070 con 0x7f7e3c0cf050 2023-11-28T11:56:43.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.913+0000 7f7e3affd700 1 --2- 172.21.15.50:0/641060575 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7e1c064ee0 0x7f7e1c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:43.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.917+0000 7f7e3affd700 1 --2- 172.21.15.50:0/641060575 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7e1c064ee0 0x7f7e1c067390 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00aae0 tx=0x7f7e2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:43.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:43.921+0000 7f7e337fe700 1 -- 172.21.15.50:0/641060575 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7e340506b0 con 0x7f7e3c0cf050 2023-11-28T11:56:44.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.077+0000 7f7e3bfff700 1 -- 172.21.15.50:0/641060575 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e3c0b60f0 con 0x7f7e1c064ee0 2023-11-28T11:56:44.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.093+0000 7f7e337fe700 1 -- 172.21.15.50:0/641060575 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295526 (secure 0 0 0) 0x7f7e3c0b60f0 con 0x7f7e1c064ee0 2023-11-28T11:56:44.101 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:44.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.101+0000 7f7e3bfff700 1 -- 172.21.15.50:0/641060575 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7e1c064ee0 msgr2=0x7f7e1c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.101+0000 7f7e3bfff700 1 --2- 172.21.15.50:0/641060575 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7e1c064ee0 0x7f7e1c067390 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00aae0 tx=0x7f7e2c008040 comp rx=0 tx=0).stop 2023-11-28T11:56:44.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.101+0000 7f7e3bfff700 1 -- 172.21.15.50:0/641060575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e3c0cf050 msgr2=0x7f7e3c09df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.101+0000 7f7e3bfff700 1 --2- 172.21.15.50:0/641060575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e3c0cf050 0x7f7e3c09df00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400cd70 tx=0x7f7e3400a570 comp rx=0 tx=0).stop 2023-11-28T11:56:44.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.101+0000 7f7e3bfff700 1 -- 172.21.15.50:0/641060575 shutdown_connections 2023-11-28T11:56:44.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.101+0000 7f7e3bfff700 1 --2- 172.21.15.50:0/641060575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e3c0cf050 0x7f7e3c09df00 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.101+0000 7f7e3bfff700 1 --2- 172.21.15.50:0/641060575 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e3c0b4c10 0x7f7e3c14cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.101+0000 7f7e3bfff700 1 --2- 172.21.15.50:0/641060575 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7e1c064ee0 0x7f7e1c067390 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.101+0000 7f7e3bfff700 1 --2- 172.21.15.50:0/641060575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3c06a530 0x7f7e3c15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.101+0000 7f7e3bfff700 1 -- 172.21.15.50:0/641060575 >> 172.21.15.50:0/641060575 conn(0x7f7e3c09bb30 msgr2=0x7f7e3c0d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:44.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.101+0000 7f7e3bfff700 1 -- 172.21.15.50:0/641060575 shutdown_connections 2023-11-28T11:56:44.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.101+0000 7f7e3bfff700 1 -- 172.21.15.50:0/641060575 wait complete. 2023-11-28T11:56:44.106 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:56:44.120 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2023-11-28T11:56:42.934073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":90776,"kb_used_data":7000,"kb_used_omap":0,"kb_used_meta":83712,"kb_avail":754883944,"statfs":{"total":773094113280,"available":773001158656,"internally_reserved":0,"allocated":7168000,"data_stored":3957768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":85721088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001256"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159917+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:56:36.159917+0000","last_peered":"2023-11-28T11:56:36.159917+0000","last_clean":"2023-11-28T11:56:36.159917+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:56:36.159917+0000","last_undegraded":"2023-11-28T11:56:36.159917+0000","last_fullsized":"2023-11-28T11:56:36.159917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159822+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:56:36.159822+0000","last_peered":"2023-11-28T11:56:36.159822+0000","last_clean":"2023-11-28T11:56:36.159822+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:56:36.159822+0000","last_undegraded":"2023-11-28T11:56:36.159822+0000","last_fullsized":"2023-11-28T11:56:36.159822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":54,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:35.933132+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:56:35.933132+0000","last_peered":"2023-11-28T11:56:35.933132+0000","last_clean":"2023-11-28T11:56:35.933132+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:56:35.933132+0000","last_undegraded":"2023-11-28T11:56:35.933132+0000","last_fullsized":"2023-11-28T11:56:35.933132+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159123+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:56:36.159123+0000","last_peered":"2023-11-28T11:56:36.159123+0000","last_clean":"2023-11-28T11:56:36.159123+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:56:36.159123+0000","last_undegraded":"2023-11-28T11:56:36.159123+0000","last_fullsized":"2023-11-28T11:56:36.159123+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":198,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159354+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:56:36.159354+0000","last_peered":"2023-11-28T11:56:36.159354+0000","last_clean":"2023-11-28T11:56:36.159354+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:56:36.159354+0000","last_undegraded":"2023-11-28T11:56:36.159354+0000","last_fullsized":"2023-11-28T11:56:36.159354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.162480+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:56:36.162480+0000","last_peered":"2023-11-28T11:56:36.162480+0000","last_clean":"2023-11-28T11:56:36.162480+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:56:36.162480+0000","last_undegraded":"2023-11-28T11:56:36.162480+0000","last_fullsized":"2023-11-28T11:56:36.162480+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159344+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:56:36.159344+0000","last_peered":"2023-11-28T11:56:36.159344+0000","last_clean":"2023-11-28T11:56:36.159344+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:56:36.159344+0000","last_undegraded":"2023-11-28T11:56:36.159344+0000","last_fullsized":"2023-11-28T11:56:36.159344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":57,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:35.933161+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:56:35.933161+0000","last_peered":"2023-11-28T11:56:35.933161+0000","last_clean":"2023-11-28T11:56:35.933161+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:56:35.933161+0000","last_undegraded":"2023-11-28T11:56:35.933161+0000","last_fullsized":"2023-11-28T11:56:35.933161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159436+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:56:36.159436+0000","last_peered":"2023-11-28T11:56:36.159436+0000","last_clean":"2023-11-28T11:56:36.159436+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:56:36.159436+0000","last_undegraded":"2023-11-28T11:56:36.159436+0000","last_fullsized":"2023-11-28T11:56:36.159436+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10596,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":9280,"kb_avail":94361244,"statfs":{"total":96636764160,"available":96625913856,"internally_reserved":0,"allocated":1339392,"data_stored":937004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9502720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.90900000000000003,"15min":0.91800000000000004},"min":{"1min":0.54300000000000004,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.268,"5min":1.413,"15min":1.413},"last":1.073},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96899999999999997,"15min":0.96999999999999997},"min":{"1min":0.59799999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.006}]},{"osd":1,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.84199999999999997,"15min":0.83299999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81599999999999995,"15min":0.81999999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.63700000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81599999999999995,"15min":0.80800000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.91900000000000004,"15min":0.92100000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1140000000000001,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.78700000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.86199999999999999,"15min":0.85299999999999998},"min":{"1min":0.65200000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0009999999999999,"15min":1.0089999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1919999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.91400000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.86499999999999999,"15min":0.871},"min":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.109,"5min":1.2,"15min":1.2},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.012,"15min":1.018},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3480000000000001,"5min":1.621,"15min":1.621},"last":1.165}]},{"osd":5,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.67400000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.2589999999999999,"5min":1.387,"15min":1.387},"last":1.038},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.081,"15min":1.091},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.329,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.1020000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0880000000000001,"15min":1.0940000000000001},"min":{"1min":0.84099999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.151},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.111,"15min":1.1140000000000001},"min":{"1min":0.83199999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4119999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.127}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9376,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362464,"statfs":{"total":96636764160,"available":96627163136,"internally_reserved":0,"allocated":745472,"data_stored":346636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.89700000000000002,"15min":0.90600000000000003},"min":{"1min":0.61899999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3440000000000001,"5min":1.625,"15min":1.625},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.095,"5min":1.498,"15min":1.498},"last":1.0409999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.84999999999999998,"15min":0.85999999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.099,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.97699999999999998,"15min":0.98799999999999999},"min":{"1min":0.56100000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1419999999999999,"5min":1.444,"15min":1.444},"last":0.93100000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95999999999999996,"15min":0.96299999999999997},"min":{"1min":0.64300000000000002,"5min":0.62,"15min":0.62},"max":{"1min":1.196,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.89200000000000002,"15min":0.89900000000000002},"min":{"1min":0.59399999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.107,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.2}]},{"osd":3,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89600000000000002,"15min":0.88500000000000001},"min":{"1min":0.72499999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.86099999999999999,"15min":0.85599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.121,"5min":1.161,"15min":1.161},"last":1.0640000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.94599999999999995,"15min":0.95299999999999996},"min":{"1min":0.59499999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.272,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0029999999999999,"15min":1.01},"min":{"1min":0.65100000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.248,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.90000000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.0089999999999999,"15min":1.0269999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1970000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.131,"15min":1.141},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4199999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.101}]},{"osd":7,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.079,"15min":1.0840000000000001},"min":{"1min":0.67800000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.206,"5min":1.575,"15min":1.575},"last":1.137},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0449999999999999,"15min":1.0549999999999999},"min":{"1min":0.73699999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1910000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.754}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9508,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362332,"statfs":{"total":96636764160,"available":96627027968,"internally_reserved":0,"allocated":749568,"data_stored":347622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1259999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.87},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85499999999999998,"15min":0.85899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.165,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.63400000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.64500000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0620000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.167},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90300000000000002,"15min":0.91700000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1240000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.006}]},{"osd":2,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.84399999999999997,"15min":0.83599999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.872,"5min":0.83799999999999997,"15min":0.83199999999999996},"min":{"1min":0.66500000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1259999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.111}]},{"osd":3,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1180000000000001,"5min":1.212,"15min":1.212},"last":1.133},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.98399999999999999,"15min":0.98799999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.319,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78000000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.179,"5min":1.968,"15min":1.968},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.0309999999999999,"15min":1.0429999999999999},"min":{"1min":0.67800000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1259999999999999,"5min":1.581,"15min":1.581},"last":1.085}]},{"osd":6,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0069999999999999,"15min":1.01},"min":{"1min":0.64000000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.268,"5min":1.482,"15min":1.482},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.002,"15min":1.004},"min":{"1min":0.72599999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2210000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.92800000000000005}]},{"osd":7,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0680000000000001,"15min":1.0740000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1819999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.097,"15min":1.0960000000000001},"min":{"1min":0.81100000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.04}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9700,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362140,"statfs":{"total":96636764160,"available":96626831360,"internally_reserved":0,"allocated":749568,"data_stored":347622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.84099999999999997,"15min":0.84499999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.83899999999999997,"15min":0.84599999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.0700000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85899999999999999,"15min":0.86099999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.93000000000000005,"15min":0.94599999999999995},"min":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.081,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.93300000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.67700000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.167,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.96299999999999997,"15min":0.97599999999999998},"min":{"1min":0.57199999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2090000000000001,"5min":1.528,"15min":1.528},"last":1.1599999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.93400000000000005,"15min":0.94099999999999995},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.2609999999999999,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.052,"15min":1.0680000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.165,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.872}]},{"osd":5,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.98899999999999999,"15min":0.99299999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3149999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.097},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.034,"15min":1.046},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.208,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.66900000000000004}]},{"osd":6,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.073,"15min":1.0860000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.294,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.151,"15min":1.159},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3799999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.02}]},{"osd":7,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1379999999999999,"15min":1.159},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2549999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1870000000000001,"15min":1.198},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.331,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.133}]}]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9632,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362208,"statfs":{"total":96636764160,"available":96626900992,"internally_reserved":0,"allocated":745472,"data_stored":346636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":0.876,"15min":0.70099999999999996},"min":{"1min":0.46500000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":21.122,"5min":21.122,"15min":21.122},"last":0.46500000000000002},{"interface":"front","average":{"1min":1.96,"5min":0.94899999999999995,"15min":0.78500000000000003},"min":{"1min":0.441,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":21.288,"5min":21.288,"15min":21.288},"last":0.441}]},{"osd":1,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.70699999999999996,"15min":0.63500000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":6.3090000000000002,"5min":6.3090000000000002,"15min":6.3090000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":2.052,"5min":1.0049999999999999,"15min":0.83699999999999997},"min":{"1min":0.41199999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":21.151,"5min":21.151,"15min":21.151},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.76600000000000001,"15min":0.78900000000000003},"min":{"1min":0.38600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.0960000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.91100000000000003,"15min":0.88700000000000001},"min":{"1min":0.497,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":6.5149999999999997,"5min":6.5149999999999997,"15min":6.5149999999999997},"last":0.497}]},{"osd":4,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":2.2400000000000002,"5min":1.266,"15min":1.1080000000000001},"min":{"1min":0.72099999999999997,"5min":0.505,"15min":0.505},"max":{"1min":21.347999999999999,"5min":21.347999999999999,"15min":21.347999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":2.3140000000000001,"5min":1.2989999999999999,"15min":1.1299999999999999},"min":{"1min":0.73799999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":21.129999999999999,"5min":21.129999999999999,"15min":21.129999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":2.3290000000000002,"5min":1.3260000000000001,"15min":1.1819999999999999},"min":{"1min":0.68200000000000005,"5min":0.626,"15min":0.626},"max":{"1min":21.210999999999999,"5min":21.210999999999999,"15min":21.210999999999999},"last":1.012},{"interface":"front","average":{"1min":2.3210000000000002,"5min":1.3720000000000001,"15min":1.228},"min":{"1min":0.82899999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":21.32,"5min":21.32,"15min":21.32},"last":1.03}]},{"osd":6,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0940000000000001,"15min":1.1120000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3360000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":2.3420000000000001,"5min":1.345,"15min":1.194},"min":{"1min":0.75900000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":21.077999999999999,"5min":21.077999999999999,"15min":21.077999999999999},"last":0.872}]},{"osd":7,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.127,"15min":1.151},"min":{"1min":0.82199999999999995,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.3580000000000001,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.522,"5min":1.2390000000000001,"15min":1.196},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":6.5750000000000002,"5min":6.5750000000000002,"15min":6.5750000000000002},"last":0.69899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13472,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":12736,"kb_avail":94358368,"statfs":{"total":96636764160,"available":96622968832,"internally_reserved":0,"allocated":745472,"data_stored":346636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13041664},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61199999999999999,"15min":0.59399999999999997},"min":{"1min":0.47599999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0600000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.40999999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.42799999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97799999999999998,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1399999999999999,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.92900000000000005}]},{"osd":3,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68400000000000005,"15min":0.69499999999999995},"min":{"1min":0.51000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.036,"5min":1.254,"15min":1.254},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.84499999999999997,"15min":0.82899999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.409,"5min":1.968,"15min":1.968},"last":0.63300000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0289999999999999,"15min":1.0429999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.5089999999999999,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0640000000000001,"15min":1.0820000000000001},"min":{"1min":0.85599999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.3700000000000001,"5min":2.181,"15min":2.181},"last":1.137}]},{"osd":5,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.97199999999999998,"15min":0.97899999999999998},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1639999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.60499999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5600000000000001,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.069}]},{"osd":6,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.1419999999999999,"15min":1.1779999999999999},"min":{"1min":0.73199999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.484,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.1080000000000001,"15min":1.1359999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.466,"5min":1.867,"15min":1.867},"last":1.105}]},{"osd":7,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.165,"15min":1.1839999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.542,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.1220000000000001,"15min":1.1399999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.351,"5min":1.675,"15min":1.675},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14632,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357208,"statfs":{"total":96636764160,"available":96621780992,"internally_reserved":0,"allocated":1343488,"data_stored":937990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.90400000000000003,"5min":1.387,"15min":1.387},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69099999999999995,"15min":0.68500000000000005},"min":{"1min":0.46100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.69899999999999995}]},{"osd":2,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.46400000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":1.024},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79000000000000004,"15min":0.79200000000000004},"min":{"1min":0.46000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.1439999999999999,"5min":1.175,"15min":1.175},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.85999999999999999,"15min":0.87},"min":{"1min":0.52900000000000003,"5min":0.317,"15min":0.317},"max":{"1min":1.1100000000000001,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.51100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.86199999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.91500000000000004,"15min":0.91000000000000003},"min":{"1min":0.73399999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2689999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":1,"5min":1.0669999999999999,"15min":1.0780000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3740000000000001,"5min":2.29,"15min":2.29},"last":0.92000000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.018,"15min":1.0189999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1},{"interface":"front","average":{"1min":0.998,"5min":1.038,"15min":1.044},"min":{"1min":0.79100000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1379999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.103}]},{"osd":6,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0609999999999999,"15min":1.0549999999999999},"min":{"1min":0.72099999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.073},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.075,"15min":1.081},"min":{"1min":0.88800000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3460000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.96199999999999997}]},{"osd":7,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.2,"15min":1.2110000000000001},"min":{"1min":0.90100000000000002,"5min":0.747,"15min":0.747},"max":{"1min":1.5249999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1080000000000001,"15min":1.1040000000000001},"min":{"1min":0.81499999999999995,"5min":0.629,"15min":0.629},"max":{"1min":1.635,"5min":1.647,"15min":1.647},"last":1.133}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13860,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":13120,"kb_avail":94357980,"statfs":{"total":96636764160,"available":96622571520,"internally_reserved":0,"allocated":749568,"data_stored":347622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13434880},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.66800000000000004,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95299999999999996,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.628},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.016,"5min":1.091,"15min":1.091},"last":0.86799999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90500000000000003,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.45500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.1399999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.91600000000000004,"15min":0.92700000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0680000000000001,"5min":1.96,"15min":1.96},"last":1.1140000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.72499999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.996,"5min":1.1000000000000001,"15min":1.1180000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.2010000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.95599999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0640000000000001,"15min":1.0720000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2509999999999999,"5min":1.649,"15min":1.649},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.0029999999999999,"15min":1.0069999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2110000000000001,"5min":1.339,"15min":1.339},"last":0.84499999999999997}]},{"osd":6,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.177,"15min":1.1899999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.536,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.216},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.133,"15min":1.139},"min":{"1min":0.80400000000000005,"5min":0.749,"15min":0.749},"max":{"1min":1.2909999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.24}]},{"osd":7,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.155,"15min":1.161},"min":{"1min":0.84499999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.3169999999999999,"5min":1.486,"15min":1.486},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0800000000000001,"15min":1.0780000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.2470000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:56:44.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-11-28T11:56:44.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-11-28T11:56:44.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-11-28T11:56:44.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-11-28T11:56:44.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-11-28T11:56:44.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-11-28T11:56:44.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-11-28T11:56:44.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-11-28T11:56:44.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-11-28T11:56:44.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-11-28T11:56:44.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-11-28T11:56:44.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-11-28T11:56:44.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-11-28T11:56:44.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-11-28T11:56:44.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-11-28T11:56:44.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-11-28T11:56:44.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-11-28T11:56:44.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-11-28T11:56:44.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-11-28T11:56:44.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-11-28T11:56:44.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-11-28T11:56:44.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-11-28T11:56:44.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-11-28T11:56:44.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-11-28T11:56:44.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-11-28T11:56:44.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-11-28T11:56:44.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-11-28T11:56:44.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-11-28T11:56:44.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-11-28T11:56:44.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-11-28T11:56:44.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-11-28T11:56:44.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-11-28T11:56:44.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-11-28T11:56:44.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-11-28T11:56:44.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-11-28T11:56:44.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-11-28T11:56:44.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-11-28T11:56:44.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-11-28T11:56:44.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-11-28T11:56:44.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-11-28T11:56:44.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-11-28T11:56:44.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-11-28T11:56:44.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-11-28T11:56:44.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-11-28T11:56:44.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-11-28T11:56:44.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-11-28T11:56:44.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-11-28T11:56:44.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-11-28T11:56:44.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-11-28T11:56:44.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-11-28T11:56:44.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-11-28T11:56:44.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-11-28T11:56:44.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-11-28T11:56:44.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-11-28T11:56:44.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-11-28T11:56:44.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-11-28T11:56:44.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-11-28T11:56:44.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-11-28T11:56:44.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-11-28T11:56:44.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-11-28T11:56:44.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-11-28T11:56:44.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-11-28T11:56:44.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-11-28T11:56:44.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-11-28T11:56:44.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-11-28T11:56:44.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-11-28T11:56:44.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-11-28T11:56:44.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-11-28T11:56:44.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-11-28T11:56:44.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-11-28T11:56:44.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-11-28T11:56:44.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-11-28T11:56:44.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-11-28T11:56:44.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-11-28T11:56:44.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-11-28T11:56:44.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-11-28T11:56:44.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-11-28T11:56:44.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-11-28T11:56:44.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-11-28T11:56:44.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-11-28T11:56:44.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-11-28T11:56:44.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-11-28T11:56:44.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-11-28T11:56:44.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-11-28T11:56:44.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-11-28T11:56:44.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-11-28T11:56:44.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-11-28T11:56:44.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-11-28T11:56:44.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-11-28T11:56:44.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-11-28T11:56:44.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-11-28T11:56:44.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-11-28T11:56:44.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-11-28T11:56:44.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-11-28T11:56:44.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-11-28T11:56:44.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:39.997185+0000', 'last_change': '2023-11-28T11:56:39.997185+0000', 'last_active': '2023-11-28T11:56:39.997185+0000', 'last_peered': '2023-11-28T11:56:39.997185+0000', 'last_clean': '2023-11-28T11:56:39.997185+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:39.997185+0000', 'last_undegraded': '2023-11-28T11:56:39.997185+0000', 'last_fullsized': '2023-11-28T11:56:39.997185+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:39.997185+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-11-28T11:56:44.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T11:56:38.993619+0000', 'last_change': '2023-11-28T11:56:38.993619+0000', 'last_active': '2023-11-28T11:56:38.993619+0000', 'last_peered': '2023-11-28T11:56:38.993619+0000', 'last_clean': '2023-11-28T11:56:38.993619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T11:56:38.993619+0000', 'last_undegraded': '2023-11-28T11:56:38.993619+0000', 'last_fullsized': '2023-11-28T11:56:38.993619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'last_clean_scrub_stamp': '2023-11-28T11:56:38.993619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T11:56:44.146 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T11:56:44.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.277+0000 7f8398f3a700 1 Processor -- start 2023-11-28T11:56:44.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.277+0000 7f8398f3a700 1 -- start start 2023-11-28T11:56:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.277+0000 7f8398f3a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83940c1ac0 0x7f8394069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.277+0000 7f8398f3a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f83940ceef0 0x7f839406a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.277+0000 7f8398f3a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83940cae70 con 0x7f83941606b0 2023-11-28T11:56:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.277+0000 7f8398f3a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83940cbc10 con 0x7f83940c1ac0 2023-11-28T11:56:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.277+0000 7f8398f3a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83940cb130 con 0x7f83940ceef0 2023-11-28T11:56:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.277+0000 7f8392ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83940c1ac0 0x7f8394069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.277+0000 7f8392ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83940c1ac0 0x7f8394069c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48574/0 (socket says 172.21.15.50:48574) 2023-11-28T11:56:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.277+0000 7f8392ffd700 1 -- 172.21.15.50:0/2056767140 learned_addr learned my addr 172.21.15.50:0/2056767140 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:44.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.277+0000 7f8393fff700 1 --2- 172.21.15.50:0/2056767140 >> v2:172.21.15.192:3300/0 conn(0x7f83940ceef0 0x7f839406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.277+0000 7f8392ffd700 1 -- 172.21.15.50:0/2056767140 >> v2:172.21.15.192:3300/0 conn(0x7f83940ceef0 msgr2=0x7f839406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.277+0000 7f8392ffd700 1 --2- 172.21.15.50:0/2056767140 >> v2:172.21.15.192:3300/0 conn(0x7f83940ceef0 0x7f839406a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.277+0000 7f8392ffd700 1 -- 172.21.15.50:0/2056767140 >> v1:172.21.15.192:6789/0 conn(0x7f83941606b0 legacy=0x7f83940c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.277+0000 7f8392ffd700 1 -- 172.21.15.50:0/2056767140 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83940cb410 con 0x7f83940c1ac0 2023-11-28T11:56:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.277+0000 7f8392ffd700 1 --2- 172.21.15.50:0/2056767140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83940c1ac0 0x7f8394069c40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f8394072100 tx=0x7f838400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc469d3a4ee1d4d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.277+0000 7f83927fc700 1 -- 172.21.15.50:0/2056767140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838400e070 con 0x7f83940c1ac0 2023-11-28T11:56:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f83927fc700 1 -- 172.21.15.50:0/2056767140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838400b9c0 con 0x7f83940c1ac0 2023-11-28T11:56:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f83927fc700 1 -- 172.21.15.50:0/2056767140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838400bd70 con 0x7f83940c1ac0 2023-11-28T11:56:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8398f3a700 1 -- 172.21.15.50:0/2056767140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83940c1ac0 msgr2=0x7f8394069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8398f3a700 1 --2- 172.21.15.50:0/2056767140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83940c1ac0 0x7f8394069c40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f8394072100 tx=0x7f838400b330 comp rx=0 tx=0).stop 2023-11-28T11:56:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8398f3a700 1 -- 172.21.15.50:0/2056767140 shutdown_connections 2023-11-28T11:56:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8398f3a700 1 --2- 172.21.15.50:0/2056767140 >> v2:172.21.15.192:3300/0 conn(0x7f83940ceef0 0x7f839406a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8398f3a700 1 --2- 172.21.15.50:0/2056767140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83940c1ac0 0x7f8394069c40 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8398f3a700 1 -- 172.21.15.50:0/2056767140 >> 172.21.15.50:0/2056767140 conn(0x7f83940ce3e0 msgr2=0x7f83940ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8398f3a700 1 -- 172.21.15.50:0/2056767140 shutdown_connections 2023-11-28T11:56:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8398f3a700 1 -- 172.21.15.50:0/2056767140 wait complete. 2023-11-28T11:56:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8398f3a700 1 Processor -- start 2023-11-28T11:56:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8398f3a700 1 -- start start 2023-11-28T11:56:44.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8398f3a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83940c1ac0 0x7f83940abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8398f3a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83940ceef0 0x7f8394157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8398f3a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83941606b0 0x7f83940c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8398f3a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839415e3e0 con 0x7f83941606b0 2023-11-28T11:56:44.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8398f3a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839415e680 con 0x7f83940c1ac0 2023-11-28T11:56:44.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8398f3a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83940ac0a0 con 0x7f83940ceef0 2023-11-28T11:56:44.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8393fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83941606b0 0x7f83940c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8393fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83941606b0 0x7f83940c27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48584/0 (socket says 172.21.15.50:48584) 2023-11-28T11:56:44.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8393fff700 1 -- 172.21.15.50:0/2074952564 learned_addr learned my addr 172.21.15.50:0/2074952564 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:44.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f8392ffd700 1 --2- 172.21.15.50:0/2074952564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83940ceef0 0x7f8394157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.281+0000 7f83937fe700 1 --2- 172.21.15.50:0/2074952564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83940c1ac0 0x7f83940abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.285+0000 7f8393fff700 1 -- 172.21.15.50:0/2074952564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83940ceef0 msgr2=0x7f8394157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.285+0000 7f8393fff700 1 --2- 172.21.15.50:0/2074952564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83940ceef0 0x7f8394157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.285+0000 7f8393fff700 1 -- 172.21.15.50:0/2074952564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83940c1ac0 msgr2=0x7f83940abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.285+0000 7f8393fff700 1 --2- 172.21.15.50:0/2074952564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83940c1ac0 0x7f83940abb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.285+0000 7f8393fff700 1 -- 172.21.15.50:0/2074952564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8384009b30 con 0x7f83941606b0 2023-11-28T11:56:44.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.285+0000 7f8393fff700 1 --2- 172.21.15.50:0/2074952564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83941606b0 0x7f83940c27d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f838c00e810 tx=0x7f838c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:44.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.285+0000 7f837bfff700 1 -- 172.21.15.50:0/2074952564 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c00c070 con 0x7f83941606b0 2023-11-28T11:56:44.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.285+0000 7f837bfff700 1 -- 172.21.15.50:0/2074952564 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c013650 con 0x7f83941606b0 2023-11-28T11:56:44.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.285+0000 7f8398f3a700 1 -- 172.21.15.50:0/2074952564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83940b36c0 con 0x7f83941606b0 2023-11-28T11:56:44.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.285+0000 7f837bfff700 1 -- 172.21.15.50:0/2074952564 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c013a00 con 0x7f83941606b0 2023-11-28T11:56:44.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.285+0000 7f8398f3a700 1 -- 172.21.15.50:0/2074952564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83940cb6f0 con 0x7f83941606b0 2023-11-28T11:56:44.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.285+0000 7f8398f3a700 1 -- 172.21.15.50:0/2074952564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83940ad610 con 0x7f83941606b0 2023-11-28T11:56:44.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.285+0000 7f837bfff700 1 -- 172.21.15.50:0/2074952564 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f838c013b60 con 0x7f83941606b0 2023-11-28T11:56:44.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.289+0000 7f837bfff700 1 --2- 172.21.15.50:0/2074952564 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8380064ee0 0x7f8380067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.289+0000 7f837bfff700 1 -- 172.21.15.50:0/2074952564 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f838c081c50 con 0x7f83941606b0 2023-11-28T11:56:44.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.289+0000 7f83937fe700 1 --2- 172.21.15.50:0/2074952564 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8380064ee0 0x7f8380067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.289+0000 7f83937fe700 1 --2- 172.21.15.50:0/2074952564 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8380064ee0 0x7f8380067390 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8388000f60 tx=0x7f8388009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.297+0000 7f837bfff700 1 -- 172.21.15.50:0/2074952564 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f838c04fcb0 con 0x7f83941606b0 2023-11-28T11:56:44.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.513+0000 7f8398f3a700 1 -- 172.21.15.50:0/2074952564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f839415e7f0 con 0x7f83941606b0 2023-11-28T11:56:44.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.513+0000 7f837bfff700 1 -- 172.21.15.50:0/2074952564 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1442 (secure 0 0 0) 0x7f838c0532d0 con 0x7f83941606b0 2023-11-28T11:56:44.516 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:44.516 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":201,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":66,"num_osds":8,"num_up_osds":8,"osd_up_since":1701172413,"num_in_osds":8,"osd_in_since":1701172405,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":92954624,"bytes_avail":773001158656,"bytes_total":773094113280,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":31,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6510}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-11-28T11:55:46.915303+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T11:56:44.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.513+0000 7f8398f3a700 1 -- 172.21.15.50:0/2074952564 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8380064ee0 msgr2=0x7f8380067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.513+0000 7f8398f3a700 1 --2- 172.21.15.50:0/2074952564 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8380064ee0 0x7f8380067390 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8388000f60 tx=0x7f8388009040 comp rx=0 tx=0).stop 2023-11-28T11:56:44.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.513+0000 7f8398f3a700 1 -- 172.21.15.50:0/2074952564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83941606b0 msgr2=0x7f83940c27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.513+0000 7f8398f3a700 1 --2- 172.21.15.50:0/2074952564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83941606b0 0x7f83940c27d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f838c00e810 tx=0x7f838c00eb20 comp rx=0 tx=0).stop 2023-11-28T11:56:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.513+0000 7f8398f3a700 1 -- 172.21.15.50:0/2074952564 shutdown_connections 2023-11-28T11:56:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.513+0000 7f8398f3a700 1 --2- 172.21.15.50:0/2074952564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83941606b0 0x7f83940c27d0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.513+0000 7f8398f3a700 1 --2- 172.21.15.50:0/2074952564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83940ceef0 0x7f8394157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.513+0000 7f8398f3a700 1 --2- 172.21.15.50:0/2074952564 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8380064ee0 0x7f8380067390 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.513+0000 7f8398f3a700 1 --2- 172.21.15.50:0/2074952564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83940c1ac0 0x7f83940abb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.513+0000 7f8398f3a700 1 -- 172.21.15.50:0/2074952564 >> 172.21.15.50:0/2074952564 conn(0x7f83940ce3e0 msgr2=0x7f839406ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.513+0000 7f8398f3a700 1 -- 172.21.15.50:0/2074952564 shutdown_connections 2023-11-28T11:56:44.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.513+0000 7f8398f3a700 1 -- 172.21.15.50:0/2074952564 wait complete. 2023-11-28T11:56:44.532 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T11:56:44.532 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:56:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.637+0000 7f39f77ad700 1 Processor -- start 2023-11-28T11:56:44.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.637+0000 7f39f77ad700 1 -- start start 2023-11-28T11:56:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f77ad700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f0153420 0x7f39f00c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f77ad700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39f01537f0 0x7f39f00ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f77ad700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f00cad30 con 0x7f39f015cb50 2023-11-28T11:56:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f77ad700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f00cdda0 con 0x7f39f01537f0 2023-11-28T11:56:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f77ad700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f00b0cd0 con 0x7f39f0153420 2023-11-28T11:56:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f4d48700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39f01537f0 0x7f39f00ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f4d48700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39f01537f0 0x7f39f00ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48590/0 (socket says 172.21.15.50:48590) 2023-11-28T11:56:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f4d48700 1 -- 172.21.15.50:0/3542489039 learned_addr learned my addr 172.21.15.50:0/3542489039 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f5549700 1 --2- 172.21.15.50:0/3542489039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f0153420 0x7f39f00c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f4d48700 1 -- 172.21.15.50:0/3542489039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f0153420 msgr2=0x7f39f00c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:44.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f4d48700 1 --2- 172.21.15.50:0/3542489039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f0153420 0x7f39f00c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f4d48700 1 -- 172.21.15.50:0/3542489039 >> v1:172.21.15.192:6789/0 conn(0x7f39f015cb50 legacy=0x7f39f0159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f4d48700 1 -- 172.21.15.50:0/3542489039 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f00caa00 con 0x7f39f01537f0 2023-11-28T11:56:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f5549700 1 --2- 172.21.15.50:0/3542489039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f0153420 0x7f39f00c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f4d48700 1 --2- 172.21.15.50:0/3542489039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39f01537f0 0x7f39f00ce050 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f39e4009910 tx=0x7f39e4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85d156fcce40136 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39e3fff700 1 -- 172.21.15.50:0/3542489039 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e400ba60 con 0x7f39f01537f0 2023-11-28T11:56:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39e3fff700 1 -- 172.21.15.50:0/3542489039 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e400bbc0 con 0x7f39f01537f0 2023-11-28T11:56:44.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39e3fff700 1 -- 172.21.15.50:0/3542489039 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e4009e60 con 0x7f39f01537f0 2023-11-28T11:56:44.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f77ad700 1 -- 172.21.15.50:0/3542489039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39f01537f0 msgr2=0x7f39f00ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f77ad700 1 --2- 172.21.15.50:0/3542489039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39f01537f0 0x7f39f00ce050 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f39e4009910 tx=0x7f39e4009c20 comp rx=0 tx=0).stop 2023-11-28T11:56:44.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f77ad700 1 -- 172.21.15.50:0/3542489039 shutdown_connections 2023-11-28T11:56:44.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f77ad700 1 --2- 172.21.15.50:0/3542489039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39f01537f0 0x7f39f00ce050 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f77ad700 1 --2- 172.21.15.50:0/3542489039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f0153420 0x7f39f00c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f77ad700 1 -- 172.21.15.50:0/3542489039 >> 172.21.15.50:0/3542489039 conn(0x7f39f006caf0 msgr2=0x7f39f00ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:44.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f77ad700 1 -- 172.21.15.50:0/3542489039 shutdown_connections 2023-11-28T11:56:44.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.641+0000 7f39f77ad700 1 -- 172.21.15.50:0/3542489039 wait complete. 2023-11-28T11:56:44.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f77ad700 1 Processor -- start 2023-11-28T11:56:44.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f77ad700 1 -- start start 2023-11-28T11:56:44.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f77ad700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f0153420 0x7f39f014af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f77ad700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39f01537f0 0x7f39f01482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f77ad700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f015cb50 0x7f39f00b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f77ad700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f015a490 con 0x7f39f01537f0 2023-11-28T11:56:44.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f77ad700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f0148820 con 0x7f39f0153420 2023-11-28T11:56:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f77ad700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f00c63c0 con 0x7f39f015cb50 2023-11-28T11:56:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f4d48700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39f01537f0 0x7f39f01482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f4d48700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39f01537f0 0x7f39f01482e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48592/0 (socket says 172.21.15.50:48592) 2023-11-28T11:56:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f4d48700 1 -- 172.21.15.50:0/3047607147 learned_addr learned my addr 172.21.15.50:0/3047607147 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f5549700 1 --2- 172.21.15.50:0/3047607147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f0153420 0x7f39f014af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f5d4a700 1 --2- 172.21.15.50:0/3047607147 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f015cb50 0x7f39f00b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f4d48700 1 -- 172.21.15.50:0/3047607147 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f015cb50 msgr2=0x7f39f00b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f4d48700 1 --2- 172.21.15.50:0/3047607147 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f015cb50 0x7f39f00b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f4d48700 1 -- 172.21.15.50:0/3047607147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f0153420 msgr2=0x7f39f014af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f4d48700 1 --2- 172.21.15.50:0/3047607147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f0153420 0x7f39f014af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f4d48700 1 -- 172.21.15.50:0/3047607147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e4009570 con 0x7f39f01537f0 2023-11-28T11:56:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f4d48700 1 --2- 172.21.15.50:0/3047607147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39f01537f0 0x7f39f01482e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f39e4000c00 tx=0x7f39e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:44.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39e1ffb700 1 -- 172.21.15.50:0/3047607147 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e40045d0 con 0x7f39f01537f0 2023-11-28T11:56:44.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39e1ffb700 1 -- 172.21.15.50:0/3047607147 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e401f070 con 0x7f39f01537f0 2023-11-28T11:56:44.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f77ad700 1 -- 172.21.15.50:0/3047607147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f00b0f70 con 0x7f39f01537f0 2023-11-28T11:56:44.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39e1ffb700 1 -- 172.21.15.50:0/3047607147 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e40038e0 con 0x7f39f01537f0 2023-11-28T11:56:44.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.645+0000 7f39f77ad700 1 -- 172.21.15.50:0/3047607147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f00ce590 con 0x7f39f01537f0 2023-11-28T11:56:44.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.649+0000 7f39f77ad700 1 -- 172.21.15.50:0/3047607147 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f00b1250 con 0x7f39f01537f0 2023-11-28T11:56:44.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.649+0000 7f39e1ffb700 1 -- 172.21.15.50:0/3047607147 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f39e400f050 con 0x7f39f01537f0 2023-11-28T11:56:44.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.649+0000 7f39e1ffb700 1 --2- 172.21.15.50:0/3047607147 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39d4064ee0 0x7f39d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:44.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.649+0000 7f39e1ffb700 1 -- 172.21.15.50:0/3047607147 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f39e4021070 con 0x7f39f01537f0 2023-11-28T11:56:44.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.649+0000 7f39f5549700 1 --2- 172.21.15.50:0/3047607147 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39d4064ee0 0x7f39d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:44.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.649+0000 7f39f5549700 1 --2- 172.21.15.50:0/3047607147 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39d4064ee0 0x7f39d4067390 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f39ec006fd0 tx=0x7f39ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:44.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.657+0000 7f39e1ffb700 1 -- 172.21.15.50:0/3047607147 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f39e4051980 con 0x7f39f01537f0 2023-11-28T11:56:44.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.813+0000 7f39f77ad700 1 -- 172.21.15.50:0/3047607147 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39f0072500 con 0x7f39d4064ee0 2023-11-28T11:56:44.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.825+0000 7f39e1ffb700 1 -- 172.21.15.50:0/3047607147 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295526 (secure 0 0 0) 0x7f39f0072500 con 0x7f39d4064ee0 2023-11-28T11:56:44.834 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:44.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.829+0000 7f39f77ad700 1 -- 172.21.15.50:0/3047607147 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39d4064ee0 msgr2=0x7f39d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.829+0000 7f39f77ad700 1 --2- 172.21.15.50:0/3047607147 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39d4064ee0 0x7f39d4067390 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f39ec006fd0 tx=0x7f39ec008040 comp rx=0 tx=0).stop 2023-11-28T11:56:44.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.829+0000 7f39f77ad700 1 -- 172.21.15.50:0/3047607147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39f01537f0 msgr2=0x7f39f01482e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:44.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.829+0000 7f39f77ad700 1 --2- 172.21.15.50:0/3047607147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39f01537f0 0x7f39f01482e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f39e4000c00 tx=0x7f39e4004770 comp rx=0 tx=0).stop 2023-11-28T11:56:44.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.829+0000 7f39f77ad700 1 -- 172.21.15.50:0/3047607147 shutdown_connections 2023-11-28T11:56:44.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.829+0000 7f39f77ad700 1 --2- 172.21.15.50:0/3047607147 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f015cb50 0x7f39f00b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.829+0000 7f39f77ad700 1 --2- 172.21.15.50:0/3047607147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39f01537f0 0x7f39f01482e0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.829+0000 7f39f77ad700 1 --2- 172.21.15.50:0/3047607147 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39d4064ee0 0x7f39d4067390 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.829+0000 7f39f77ad700 1 --2- 172.21.15.50:0/3047607147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f0153420 0x7f39f014af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:44.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.829+0000 7f39f77ad700 1 -- 172.21.15.50:0/3047607147 >> 172.21.15.50:0/3047607147 conn(0x7f39f006caf0 msgr2=0x7f39f014be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:44.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.829+0000 7f39f77ad700 1 -- 172.21.15.50:0/3047607147 shutdown_connections 2023-11-28T11:56:44.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:44.829+0000 7f39f77ad700 1 -- 172.21.15.50:0/3047607147 wait complete. 2023-11-28T11:56:44.837 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:56:44.850 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2023-11-28T11:56:42.934073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":90776,"kb_used_data":7000,"kb_used_omap":0,"kb_used_meta":83712,"kb_avail":754883944,"statfs":{"total":773094113280,"available":773001158656,"internally_reserved":0,"allocated":7168000,"data_stored":3957768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":85721088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001256"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159917+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:56:36.159917+0000","last_peered":"2023-11-28T11:56:36.159917+0000","last_clean":"2023-11-28T11:56:36.159917+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:56:36.159917+0000","last_undegraded":"2023-11-28T11:56:36.159917+0000","last_fullsized":"2023-11-28T11:56:36.159917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159822+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:56:36.159822+0000","last_peered":"2023-11-28T11:56:36.159822+0000","last_clean":"2023-11-28T11:56:36.159822+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:56:36.159822+0000","last_undegraded":"2023-11-28T11:56:36.159822+0000","last_fullsized":"2023-11-28T11:56:36.159822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":54,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:35.933132+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:56:35.933132+0000","last_peered":"2023-11-28T11:56:35.933132+0000","last_clean":"2023-11-28T11:56:35.933132+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:56:35.933132+0000","last_undegraded":"2023-11-28T11:56:35.933132+0000","last_fullsized":"2023-11-28T11:56:35.933132+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159123+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:56:36.159123+0000","last_peered":"2023-11-28T11:56:36.159123+0000","last_clean":"2023-11-28T11:56:36.159123+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:56:36.159123+0000","last_undegraded":"2023-11-28T11:56:36.159123+0000","last_fullsized":"2023-11-28T11:56:36.159123+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":198,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159354+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:56:36.159354+0000","last_peered":"2023-11-28T11:56:36.159354+0000","last_clean":"2023-11-28T11:56:36.159354+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:56:36.159354+0000","last_undegraded":"2023-11-28T11:56:36.159354+0000","last_fullsized":"2023-11-28T11:56:36.159354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.162480+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:56:36.162480+0000","last_peered":"2023-11-28T11:56:36.162480+0000","last_clean":"2023-11-28T11:56:36.162480+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:56:36.162480+0000","last_undegraded":"2023-11-28T11:56:36.162480+0000","last_fullsized":"2023-11-28T11:56:36.162480+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159344+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:56:36.159344+0000","last_peered":"2023-11-28T11:56:36.159344+0000","last_clean":"2023-11-28T11:56:36.159344+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:56:36.159344+0000","last_undegraded":"2023-11-28T11:56:36.159344+0000","last_fullsized":"2023-11-28T11:56:36.159344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":57,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:35.933161+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:56:35.933161+0000","last_peered":"2023-11-28T11:56:35.933161+0000","last_clean":"2023-11-28T11:56:35.933161+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:56:35.933161+0000","last_undegraded":"2023-11-28T11:56:35.933161+0000","last_fullsized":"2023-11-28T11:56:35.933161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:39.997185+0000","last_change":"2023-11-28T11:56:39.997185+0000","last_active":"2023-11-28T11:56:39.997185+0000","last_peered":"2023-11-28T11:56:39.997185+0000","last_clean":"2023-11-28T11:56:39.997185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:39.997185+0000","last_undegraded":"2023-11-28T11:56:39.997185+0000","last_fullsized":"2023-11-28T11:56:39.997185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T11:56:38.993619+0000","last_change":"2023-11-28T11:56:38.993619+0000","last_active":"2023-11-28T11:56:38.993619+0000","last_peered":"2023-11-28T11:56:38.993619+0000","last_clean":"2023-11-28T11:56:38.993619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T11:56:38.993619+0000","last_undegraded":"2023-11-28T11:56:38.993619+0000","last_fullsized":"2023-11-28T11:56:38.993619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-28T11:56:36.159436+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:56:36.159436+0000","last_peered":"2023-11-28T11:56:36.159436+0000","last_clean":"2023-11-28T11:56:36.159436+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:56:36.159436+0000","last_undegraded":"2023-11-28T11:56:36.159436+0000","last_fullsized":"2023-11-28T11:56:36.159436+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10596,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":9280,"kb_avail":94361244,"statfs":{"total":96636764160,"available":96625913856,"internally_reserved":0,"allocated":1339392,"data_stored":937004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9502720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.90900000000000003,"15min":0.91800000000000004},"min":{"1min":0.54300000000000004,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.268,"5min":1.413,"15min":1.413},"last":1.073},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96899999999999997,"15min":0.96999999999999997},"min":{"1min":0.59799999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.006}]},{"osd":1,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.84199999999999997,"15min":0.83299999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81599999999999995,"15min":0.81999999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.63700000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.81599999999999995,"15min":0.80800000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.91900000000000004,"15min":0.92100000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1140000000000001,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.78700000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.86199999999999999,"15min":0.85299999999999998},"min":{"1min":0.65200000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0009999999999999,"15min":1.0089999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1919999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.91400000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.86499999999999999,"15min":0.871},"min":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.109,"5min":1.2,"15min":1.2},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.012,"15min":1.018},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3480000000000001,"5min":1.621,"15min":1.621},"last":1.165}]},{"osd":5,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.67400000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.2589999999999999,"5min":1.387,"15min":1.387},"last":1.038},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.081,"15min":1.091},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.329,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.1020000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0880000000000001,"15min":1.0940000000000001},"min":{"1min":0.84099999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.151},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.111,"15min":1.1140000000000001},"min":{"1min":0.83199999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4119999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.127}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9376,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362464,"statfs":{"total":96636764160,"available":96627163136,"internally_reserved":0,"allocated":745472,"data_stored":346636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.89700000000000002,"15min":0.90600000000000003},"min":{"1min":0.61899999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3440000000000001,"5min":1.625,"15min":1.625},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.095,"5min":1.498,"15min":1.498},"last":1.0409999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.84999999999999998,"15min":0.85999999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.099,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.97699999999999998,"15min":0.98799999999999999},"min":{"1min":0.56100000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1419999999999999,"5min":1.444,"15min":1.444},"last":0.93100000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95999999999999996,"15min":0.96299999999999997},"min":{"1min":0.64300000000000002,"5min":0.62,"15min":0.62},"max":{"1min":1.196,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.89200000000000002,"15min":0.89900000000000002},"min":{"1min":0.59399999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.107,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.2}]},{"osd":3,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89600000000000002,"15min":0.88500000000000001},"min":{"1min":0.72499999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.86099999999999999,"15min":0.85599999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.121,"5min":1.161,"15min":1.161},"last":1.0640000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.94599999999999995,"15min":0.95299999999999996},"min":{"1min":0.59499999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.272,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0029999999999999,"15min":1.01},"min":{"1min":0.65100000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.248,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.90000000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.0089999999999999,"15min":1.0269999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1970000000000001,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.131,"15min":1.141},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4199999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.101}]},{"osd":7,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.079,"15min":1.0840000000000001},"min":{"1min":0.67800000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.206,"5min":1.575,"15min":1.575},"last":1.137},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0449999999999999,"15min":1.0549999999999999},"min":{"1min":0.73699999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1910000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.754}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9508,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362332,"statfs":{"total":96636764160,"available":96627027968,"internally_reserved":0,"allocated":749568,"data_stored":347622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1259999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.87},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85499999999999998,"15min":0.85899999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.165,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.63400000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.64500000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0620000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.167},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90300000000000002,"15min":0.91700000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1240000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.006}]},{"osd":2,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.84399999999999997,"15min":0.83599999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.872,"5min":0.83799999999999997,"15min":0.83199999999999996},"min":{"1min":0.66500000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1259999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.111}]},{"osd":3,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1180000000000001,"5min":1.212,"15min":1.212},"last":1.133},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.98399999999999999,"15min":0.98799999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.319,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78000000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.92400000000000004,"15min":0.93799999999999994},"min":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.179,"5min":1.968,"15min":1.968},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.0309999999999999,"15min":1.0429999999999999},"min":{"1min":0.67800000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1259999999999999,"5min":1.581,"15min":1.581},"last":1.085}]},{"osd":6,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0069999999999999,"15min":1.01},"min":{"1min":0.64000000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.268,"5min":1.482,"15min":1.482},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.002,"15min":1.004},"min":{"1min":0.72599999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2210000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.92800000000000005}]},{"osd":7,"last update":"Tue Nov 28 11:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0680000000000001,"15min":1.0740000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1819999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.097,"15min":1.0960000000000001},"min":{"1min":0.81100000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.04}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9700,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362140,"statfs":{"total":96636764160,"available":96626831360,"internally_reserved":0,"allocated":749568,"data_stored":347622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.84099999999999997,"15min":0.84499999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.83899999999999997,"15min":0.84599999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.0700000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85899999999999999,"15min":0.86099999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.93000000000000005,"15min":0.94599999999999995},"min":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.081,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.93300000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.67700000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.167,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.96299999999999997,"15min":0.97599999999999998},"min":{"1min":0.57199999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2090000000000001,"5min":1.528,"15min":1.528},"last":1.1599999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.93400000000000005,"15min":0.94099999999999995},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.2609999999999999,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.052,"15min":1.0680000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.165,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.872}]},{"osd":5,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.98899999999999999,"15min":0.99299999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3149999999999999,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.097},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.034,"15min":1.046},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.208,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.66900000000000004}]},{"osd":6,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.073,"15min":1.0860000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.294,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.151,"15min":1.159},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3799999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.02}]},{"osd":7,"last update":"Tue Nov 28 11:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1379999999999999,"15min":1.159},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2549999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1870000000000001,"15min":1.198},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.331,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.133}]}]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9632,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362208,"statfs":{"total":96636764160,"available":96626900992,"internally_reserved":0,"allocated":745472,"data_stored":346636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":0.876,"15min":0.70099999999999996},"min":{"1min":0.46500000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":21.122,"5min":21.122,"15min":21.122},"last":0.46500000000000002},{"interface":"front","average":{"1min":1.96,"5min":0.94899999999999995,"15min":0.78500000000000003},"min":{"1min":0.441,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":21.288,"5min":21.288,"15min":21.288},"last":0.441}]},{"osd":1,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.70699999999999996,"15min":0.63500000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":6.3090000000000002,"5min":6.3090000000000002,"15min":6.3090000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":2.052,"5min":1.0049999999999999,"15min":0.83699999999999997},"min":{"1min":0.41199999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":21.151,"5min":21.151,"15min":21.151},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.76600000000000001,"15min":0.78900000000000003},"min":{"1min":0.38600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.0960000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.91100000000000003,"15min":0.88700000000000001},"min":{"1min":0.497,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":6.5149999999999997,"5min":6.5149999999999997,"15min":6.5149999999999997},"last":0.497}]},{"osd":4,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":2.2400000000000002,"5min":1.266,"15min":1.1080000000000001},"min":{"1min":0.72099999999999997,"5min":0.505,"15min":0.505},"max":{"1min":21.347999999999999,"5min":21.347999999999999,"15min":21.347999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":2.3140000000000001,"5min":1.2989999999999999,"15min":1.1299999999999999},"min":{"1min":0.73799999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":21.129999999999999,"5min":21.129999999999999,"15min":21.129999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":2.3290000000000002,"5min":1.3260000000000001,"15min":1.1819999999999999},"min":{"1min":0.68200000000000005,"5min":0.626,"15min":0.626},"max":{"1min":21.210999999999999,"5min":21.210999999999999,"15min":21.210999999999999},"last":1.012},{"interface":"front","average":{"1min":2.3210000000000002,"5min":1.3720000000000001,"15min":1.228},"min":{"1min":0.82899999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":21.32,"5min":21.32,"15min":21.32},"last":1.03}]},{"osd":6,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0940000000000001,"15min":1.1120000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3360000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":2.3420000000000001,"5min":1.345,"15min":1.194},"min":{"1min":0.75900000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":21.077999999999999,"5min":21.077999999999999,"15min":21.077999999999999},"last":0.872}]},{"osd":7,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.127,"15min":1.151},"min":{"1min":0.82199999999999995,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.3580000000000001,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.522,"5min":1.2390000000000001,"15min":1.196},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":6.5750000000000002,"5min":6.5750000000000002,"15min":6.5750000000000002},"last":0.69899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13472,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":12736,"kb_avail":94358368,"statfs":{"total":96636764160,"available":96622968832,"internally_reserved":0,"allocated":745472,"data_stored":346636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13041664},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61199999999999999,"15min":0.59399999999999997},"min":{"1min":0.47599999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0600000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.40999999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.42799999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97799999999999998,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1399999999999999,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.92900000000000005}]},{"osd":3,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68400000000000005,"15min":0.69499999999999995},"min":{"1min":0.51000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.036,"5min":1.254,"15min":1.254},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.84499999999999997,"15min":0.82899999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.409,"5min":1.968,"15min":1.968},"last":0.63300000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0289999999999999,"15min":1.0429999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.5089999999999999,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0640000000000001,"15min":1.0820000000000001},"min":{"1min":0.85599999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.3700000000000001,"5min":2.181,"15min":2.181},"last":1.137}]},{"osd":5,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.97199999999999998,"15min":0.97899999999999998},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1639999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.60499999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5600000000000001,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.069}]},{"osd":6,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.1419999999999999,"15min":1.1779999999999999},"min":{"1min":0.73199999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.484,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.1080000000000001,"15min":1.1359999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.466,"5min":1.867,"15min":1.867},"last":1.105}]},{"osd":7,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.165,"15min":1.1839999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.542,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.1220000000000001,"15min":1.1399999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.351,"5min":1.675,"15min":1.675},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14632,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357208,"statfs":{"total":96636764160,"available":96621780992,"internally_reserved":0,"allocated":1343488,"data_stored":937990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.90400000000000003,"5min":1.387,"15min":1.387},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69099999999999995,"15min":0.68500000000000005},"min":{"1min":0.46100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.69899999999999995}]},{"osd":2,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.46400000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":1.024},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79000000000000004,"15min":0.79200000000000004},"min":{"1min":0.46000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.1439999999999999,"5min":1.175,"15min":1.175},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.85999999999999999,"15min":0.87},"min":{"1min":0.52900000000000003,"5min":0.317,"15min":0.317},"max":{"1min":1.1100000000000001,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.51100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.86199999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.91500000000000004,"15min":0.91000000000000003},"min":{"1min":0.73399999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2689999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":1,"5min":1.0669999999999999,"15min":1.0780000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3740000000000001,"5min":2.29,"15min":2.29},"last":0.92000000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.018,"15min":1.0189999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1},{"interface":"front","average":{"1min":0.998,"5min":1.038,"15min":1.044},"min":{"1min":0.79100000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1379999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.103}]},{"osd":6,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0609999999999999,"15min":1.0549999999999999},"min":{"1min":0.72099999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.073},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.075,"15min":1.081},"min":{"1min":0.88800000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3460000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.96199999999999997}]},{"osd":7,"last update":"Tue Nov 28 11:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.2,"15min":1.2110000000000001},"min":{"1min":0.90100000000000002,"5min":0.747,"15min":0.747},"max":{"1min":1.5249999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1080000000000001,"15min":1.1040000000000001},"min":{"1min":0.81499999999999995,"5min":0.629,"15min":0.629},"max":{"1min":1.635,"5min":1.647,"15min":1.647},"last":1.133}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13860,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":13120,"kb_avail":94357980,"statfs":{"total":96636764160,"available":96622571520,"internally_reserved":0,"allocated":749568,"data_stored":347622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13434880},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.66800000000000004,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95299999999999996,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.628},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.016,"5min":1.091,"15min":1.091},"last":0.86799999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90500000000000003,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.45500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.1399999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69599999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.91600000000000004,"15min":0.92700000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0680000000000001,"5min":1.96,"15min":1.96},"last":1.1140000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.72499999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.996,"5min":1.1000000000000001,"15min":1.1180000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.2010000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.95599999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0640000000000001,"15min":1.0720000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2509999999999999,"5min":1.649,"15min":1.649},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.0029999999999999,"15min":1.0069999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.2110000000000001,"5min":1.339,"15min":1.339},"last":0.84499999999999997}]},{"osd":6,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.177,"15min":1.1899999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.536,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.216},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.133,"15min":1.139},"min":{"1min":0.80400000000000005,"5min":0.749,"15min":0.749},"max":{"1min":1.2909999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.24}]},{"osd":7,"last update":"Tue Nov 28 11:55:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.155,"15min":1.161},"min":{"1min":0.84499999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.3169999999999999,"5min":1.486,"15min":1.486},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0800000000000001,"15min":1.0780000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.2470000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:56:46.278 INFO:tasks.ceph.mds.a.smithi050.stderr:2023-11-28T11:56:46.277+0000 7f67446b6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:56:47.855 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:56:47.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c9888700 1 Processor -- start 2023-11-28T11:56:47.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c9888700 1 -- start start 2023-11-28T11:56:47.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c9888700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39c40c1ac0 0x7f39c4069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:47.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c9888700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c40cae70 con 0x7f39c40ceef0 2023-11-28T11:56:47.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c9888700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c40cbc10 con 0x7f39c41606b0 2023-11-28T11:56:47.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c9888700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c40cb130 con 0x7f39c40c1ac0 2023-11-28T11:56:47.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39c40c1ac0 0x7f39c4069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f39c40c1ac0 0x7f39c4069c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48594/0 (socket says 172.21.15.50:48594) 2023-11-28T11:56:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c3fff700 1 -- 172.21.15.50:0/1853988189 learned_addr learned my addr 172.21.15.50:0/1853988189 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c9087700 1 --1- 172.21.15.50:0/1853988189 >> v1:172.21.15.50:6789/0 conn(0x7f39c40ceef0 0x7f39c406a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42894/0 (socket says 172.21.15.50:42894) 2023-11-28T11:56:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c3fff700 1 -- 172.21.15.50:0/1853988189 >> v1:172.21.15.192:6789/0 conn(0x7f39c41606b0 legacy=0x7f39c40c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c3fff700 1 -- 172.21.15.50:0/1853988189 >> v1:172.21.15.50:6789/0 conn(0x7f39c40ceef0 legacy=0x7f39c406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c37fe700 1 -- 172.21.15.50:0/1853988189 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482905445 0 0) 0x7f39c40cae70 con 0x7f39c40ceef0 2023-11-28T11:56:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c3fff700 1 -- 172.21.15.50:0/1853988189 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c40cb410 con 0x7f39c40c1ac0 2023-11-28T11:56:47.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c3fff700 1 --2- 172.21.15.50:0/1853988189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c40c1ac0 0x7f39c4069c40 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009e50 tx=0x7f39ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520fc9e24ce09dbf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:47.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c37fe700 1 -- 172.21.15.50:0/1853988189 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac00e070 con 0x7f39c40c1ac0 2023-11-28T11:56:47.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c37fe700 1 -- 172.21.15.50:0/1853988189 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac00b9c0 con 0x7f39c40c1ac0 2023-11-28T11:56:47.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.973+0000 7f39c37fe700 1 -- 172.21.15.50:0/1853988189 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac00bd70 con 0x7f39c40c1ac0 2023-11-28T11:56:47.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.977+0000 7f39c9888700 1 -- 172.21.15.50:0/1853988189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c40c1ac0 msgr2=0x7f39c4069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:47.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.977+0000 7f39c9888700 1 --2- 172.21.15.50:0/1853988189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c40c1ac0 0x7f39c4069c40 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009e50 tx=0x7f39ac00b330 comp rx=0 tx=0).stop 2023-11-28T11:56:47.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.977+0000 7f39c9888700 1 -- 172.21.15.50:0/1853988189 shutdown_connections 2023-11-28T11:56:47.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.977+0000 7f39c9888700 1 --2- 172.21.15.50:0/1853988189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c40c1ac0 0x7f39c4069c40 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:47.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.977+0000 7f39c9888700 1 -- 172.21.15.50:0/1853988189 >> 172.21.15.50:0/1853988189 conn(0x7f39c40ce3e0 msgr2=0x7f39c40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:47.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.977+0000 7f39c9888700 1 -- 172.21.15.50:0/1853988189 shutdown_connections 2023-11-28T11:56:47.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.977+0000 7f39c9888700 1 -- 172.21.15.50:0/1853988189 wait complete. 2023-11-28T11:56:47.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.977+0000 7f39c9888700 1 Processor -- start 2023-11-28T11:56:47.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.977+0000 7f39c9888700 1 -- start start 2023-11-28T11:56:47.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c9888700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c40ceef0 0x7f39c40c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:47.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c9888700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c41606b0 0x7f39c41618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:47.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c9888700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c4156df0 0x7f39c4157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:47.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c9888700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c415e340 con 0x7f39c40ceef0 2023-11-28T11:56:47.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c9888700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c415e620 con 0x7f39c41606b0 2023-11-28T11:56:47.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c9888700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c415e900 con 0x7f39c4156df0 2023-11-28T11:56:47.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c8886700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c40ceef0 0x7f39c40c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:47.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c8886700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c40ceef0 0x7f39c40c1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48596/0 (socket says 172.21.15.50:48596) 2023-11-28T11:56:47.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c8886700 1 -- 172.21.15.50:0/1204848548 learned_addr learned my addr 172.21.15.50:0/1204848548 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:47.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c9087700 1 --2- 172.21.15.50:0/1204848548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c4156df0 0x7f39c4157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:47.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c3fff700 1 --2- 172.21.15.50:0/1204848548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c41606b0 0x7f39c41618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:47.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c8886700 1 -- 172.21.15.50:0/1204848548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c4156df0 msgr2=0x7f39c4157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:47.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c8886700 1 --2- 172.21.15.50:0/1204848548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c4156df0 0x7f39c4157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:47.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c8886700 1 -- 172.21.15.50:0/1204848548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c41606b0 msgr2=0x7f39c41618a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:47.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c8886700 1 --2- 172.21.15.50:0/1204848548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c41606b0 0x7f39c41618a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:47.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c8886700 1 -- 172.21.15.50:0/1204848548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac009b30 con 0x7f39c40ceef0 2023-11-28T11:56:47.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c8886700 1 --2- 172.21.15.50:0/1204848548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c40ceef0 0x7f39c40c1ee0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c500 tx=0x7f39b400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:47.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c17fa700 1 -- 172.21.15.50:0/1204848548 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b40052d0 con 0x7f39c40ceef0 2023-11-28T11:56:47.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c17fa700 1 -- 172.21.15.50:0/1204848548 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b4005430 con 0x7f39c40ceef0 2023-11-28T11:56:47.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c9888700 1 -- 172.21.15.50:0/1204848548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c40b36c0 con 0x7f39c40ceef0 2023-11-28T11:56:47.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c17fa700 1 -- 172.21.15.50:0/1204848548 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b40055a0 con 0x7f39c40ceef0 2023-11-28T11:56:47.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.981+0000 7f39c9888700 1 -- 172.21.15.50:0/1204848548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c40cb6f0 con 0x7f39c40ceef0 2023-11-28T11:56:47.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.985+0000 7f39c9888700 1 -- 172.21.15.50:0/1204848548 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c40ad610 con 0x7f39c40ceef0 2023-11-28T11:56:47.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.985+0000 7f39c17fa700 1 -- 172.21.15.50:0/1204848548 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f39b4019030 con 0x7f39c40ceef0 2023-11-28T11:56:47.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.985+0000 7f39c17fa700 1 --2- 172.21.15.50:0/1204848548 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39a8064ee0 0x7f39a8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:47.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.985+0000 7f39c17fa700 1 -- 172.21.15.50:0/1204848548 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f39b4081190 con 0x7f39c40ceef0 2023-11-28T11:56:47.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.985+0000 7f39c3fff700 1 --2- 172.21.15.50:0/1204848548 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39a8064ee0 0x7f39a8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:47.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.985+0000 7f39c3fff700 1 --2- 172.21.15.50:0/1204848548 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39a8064ee0 0x7f39a8067390 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f39c40c1eb0 tx=0x7f39ac009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:47.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:47.993+0000 7f39c17fa700 1 -- 172.21.15.50:0/1204848548 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f39b404f1f0 con 0x7f39c40ceef0 2023-11-28T11:56:48.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.153+0000 7f39c9888700 1 -- 172.21.15.50:0/1204848548 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39c4072500 con 0x7f39a8064ee0 2023-11-28T11:56:48.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.177+0000 7f39c17fa700 1 -- 172.21.15.50:0/1204848548 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310002 (secure 0 0 0) 0x7f39c4072500 con 0x7f39a8064ee0 2023-11-28T11:56:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.177+0000 7f39c9888700 1 -- 172.21.15.50:0/1204848548 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39a8064ee0 msgr2=0x7f39a8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.177+0000 7f39c9888700 1 --2- 172.21.15.50:0/1204848548 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39a8064ee0 0x7f39a8067390 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f39c40c1eb0 tx=0x7f39ac009000 comp rx=0 tx=0).stop 2023-11-28T11:56:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.177+0000 7f39c9888700 1 -- 172.21.15.50:0/1204848548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c40ceef0 msgr2=0x7f39c40c1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.177+0000 7f39c9888700 1 --2- 172.21.15.50:0/1204848548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c40ceef0 0x7f39c40c1ee0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c500 tx=0x7f39b400c810 comp rx=0 tx=0).stop 2023-11-28T11:56:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.177+0000 7f39c9888700 1 -- 172.21.15.50:0/1204848548 shutdown_connections 2023-11-28T11:56:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.177+0000 7f39c9888700 1 --2- 172.21.15.50:0/1204848548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c4156df0 0x7f39c4157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.177+0000 7f39c9888700 1 --2- 172.21.15.50:0/1204848548 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f39a8064ee0 0x7f39a8067390 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.177+0000 7f39c9888700 1 --2- 172.21.15.50:0/1204848548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c41606b0 0x7f39c41618a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.177+0000 7f39c9888700 1 --2- 172.21.15.50:0/1204848548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39c40ceef0 0x7f39c40c1ee0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.177+0000 7f39c9888700 1 -- 172.21.15.50:0/1204848548 >> 172.21.15.50:0/1204848548 conn(0x7f39c40ce3e0 msgr2=0x7f39c4069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:48.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.177+0000 7f39c9888700 1 -- 172.21.15.50:0/1204848548 shutdown_connections 2023-11-28T11:56:48.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.177+0000 7f39c9888700 1 -- 172.21.15.50:0/1204848548 wait complete. 2023-11-28T11:56:48.185 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:56:48.196 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2023-11-28T11:56:46.935507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":96716,"kb_used_data":7436,"kb_used_omap":0,"kb_used_meta":89216,"kb_avail":754878004,"statfs":{"total":773094113280,"available":772995076096,"internally_reserved":0,"allocated":7614464,"data_stored":4178327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":91357184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.933695"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.035560+0000","last_change":"2023-11-28T11:56:40.426851+0000","last_active":"2023-11-28T11:56:43.035560+0000","last_peered":"2023-11-28T11:56:43.035560+0000","last_clean":"2023-11-28T11:56:43.035560+0000","last_became_active":"2023-11-28T11:56:40.426606+0000","last_became_peered":"2023-11-28T11:56:40.426606+0000","last_unstale":"2023-11-28T11:56:43.035560+0000","last_undegraded":"2023-11-28T11:56:43.035560+0000","last_fullsized":"2023-11-28T11:56:43.035560+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:53.038776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036712+0000","last_change":"2023-11-28T11:56:40.422438+0000","last_active":"2023-11-28T11:56:43.036712+0000","last_peered":"2023-11-28T11:56:43.036712+0000","last_clean":"2023-11-28T11:56:43.036712+0000","last_became_active":"2023-11-28T11:56:40.420188+0000","last_became_peered":"2023-11-28T11:56:40.420188+0000","last_unstale":"2023-11-28T11:56:43.036712+0000","last_undegraded":"2023-11-28T11:56:43.036712+0000","last_fullsized":"2023-11-28T11:56:43.036712+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:53.038776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.037845+0000","last_change":"2023-11-28T11:56:40.416737+0000","last_active":"2023-11-28T11:56:43.037845+0000","last_peered":"2023-11-28T11:56:43.037845+0000","last_clean":"2023-11-28T11:56:43.037845+0000","last_became_active":"2023-11-28T11:56:40.416270+0000","last_became_peered":"2023-11-28T11:56:40.416270+0000","last_unstale":"2023-11-28T11:56:43.037845+0000","last_undegraded":"2023-11-28T11:56:43.037845+0000","last_fullsized":"2023-11-28T11:56:43.037845+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:53:15.116169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:42.650625+0000","last_change":"2023-11-28T11:56:40.429868+0000","last_active":"2023-11-28T11:56:42.650625+0000","last_peered":"2023-11-28T11:56:42.650625+0000","last_clean":"2023-11-28T11:56:42.650625+0000","last_became_active":"2023-11-28T11:56:40.429599+0000","last_became_peered":"2023-11-28T11:56:40.429599+0000","last_unstale":"2023-11-28T11:56:42.650625+0000","last_undegraded":"2023-11-28T11:56:42.650625+0000","last_fullsized":"2023-11-28T11:56:42.650625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:33:32.233620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.037106+0000","last_change":"2023-11-28T11:56:40.413529+0000","last_active":"2023-11-28T11:56:43.037106+0000","last_peered":"2023-11-28T11:56:43.037106+0000","last_clean":"2023-11-28T11:56:43.037106+0000","last_became_active":"2023-11-28T11:56:40.413244+0000","last_became_peered":"2023-11-28T11:56:40.413244+0000","last_unstale":"2023-11-28T11:56:43.037106+0000","last_undegraded":"2023-11-28T11:56:43.037106+0000","last_fullsized":"2023-11-28T11:56:43.037106+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:28:30.612371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036294+0000","last_change":"2023-11-28T11:56:40.422165+0000","last_active":"2023-11-28T11:56:43.036294+0000","last_peered":"2023-11-28T11:56:43.036294+0000","last_clean":"2023-11-28T11:56:43.036294+0000","last_became_active":"2023-11-28T11:56:40.420196+0000","last_became_peered":"2023-11-28T11:56:40.420196+0000","last_unstale":"2023-11-28T11:56:43.036294+0000","last_undegraded":"2023-11-28T11:56:43.036294+0000","last_fullsized":"2023-11-28T11:56:43.036294+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:31.546385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.406231+0000","last_change":"2023-11-28T11:56:40.408316+0000","last_active":"2023-11-28T11:56:41.406231+0000","last_peered":"2023-11-28T11:56:41.406231+0000","last_clean":"2023-11-28T11:56:41.406231+0000","last_became_active":"2023-11-28T11:56:40.407972+0000","last_became_peered":"2023-11-28T11:56:40.407972+0000","last_unstale":"2023-11-28T11:56:41.406231+0000","last_undegraded":"2023-11-28T11:56:41.406231+0000","last_fullsized":"2023-11-28T11:56:41.406231+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:10:24.215533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.035988+0000","last_change":"2023-11-28T11:56:40.416308+0000","last_active":"2023-11-28T11:56:43.035988+0000","last_peered":"2023-11-28T11:56:43.035988+0000","last_clean":"2023-11-28T11:56:43.035988+0000","last_became_active":"2023-11-28T11:56:40.416019+0000","last_became_peered":"2023-11-28T11:56:40.416019+0000","last_unstale":"2023-11-28T11:56:43.035988+0000","last_undegraded":"2023-11-28T11:56:43.035988+0000","last_fullsized":"2023-11-28T11:56:43.035988+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:17:03.582585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.037124+0000","last_change":"2023-11-28T11:56:40.424226+0000","last_active":"2023-11-28T11:56:43.037124+0000","last_peered":"2023-11-28T11:56:43.037124+0000","last_clean":"2023-11-28T11:56:43.037124+0000","last_became_active":"2023-11-28T11:56:40.423680+0000","last_became_peered":"2023-11-28T11:56:40.423680+0000","last_unstale":"2023-11-28T11:56:43.037124+0000","last_undegraded":"2023-11-28T11:56:43.037124+0000","last_fullsized":"2023-11-28T11:56:43.037124+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:33:32.233620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.406223+0000","last_change":"2023-11-28T11:56:40.422359+0000","last_active":"2023-11-28T11:56:41.406223+0000","last_peered":"2023-11-28T11:56:41.406223+0000","last_clean":"2023-11-28T11:56:41.406223+0000","last_became_active":"2023-11-28T11:56:40.422027+0000","last_became_peered":"2023-11-28T11:56:40.422027+0000","last_unstale":"2023-11-28T11:56:41.406223+0000","last_undegraded":"2023-11-28T11:56:41.406223+0000","last_fullsized":"2023-11-28T11:56:41.406223+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:10:25.753915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.034920+0000","last_change":"2023-11-28T11:56:40.418168+0000","last_active":"2023-11-28T11:56:43.034920+0000","last_peered":"2023-11-28T11:56:43.034920+0000","last_clean":"2023-11-28T11:56:43.034920+0000","last_became_active":"2023-11-28T11:56:40.417120+0000","last_became_peered":"2023-11-28T11:56:40.417120+0000","last_unstale":"2023-11-28T11:56:43.034920+0000","last_undegraded":"2023-11-28T11:56:43.034920+0000","last_fullsized":"2023-11-28T11:56:43.034920+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:33:20.150057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:42.650601+0000","last_change":"2023-11-28T11:56:40.420926+0000","last_active":"2023-11-28T11:56:42.650601+0000","last_peered":"2023-11-28T11:56:42.650601+0000","last_clean":"2023-11-28T11:56:42.650601+0000","last_became_active":"2023-11-28T11:56:40.420668+0000","last_became_peered":"2023-11-28T11:56:40.420668+0000","last_unstale":"2023-11-28T11:56:42.650601+0000","last_undegraded":"2023-11-28T11:56:42.650601+0000","last_fullsized":"2023-11-28T11:56:42.650601+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:56.564678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.408071+0000","last_change":"2023-11-28T11:56:40.420014+0000","last_active":"2023-11-28T11:56:41.408071+0000","last_peered":"2023-11-28T11:56:41.408071+0000","last_clean":"2023-11-28T11:56:41.408071+0000","last_became_active":"2023-11-28T11:56:40.419746+0000","last_became_peered":"2023-11-28T11:56:40.419746+0000","last_unstale":"2023-11-28T11:56:41.408071+0000","last_undegraded":"2023-11-28T11:56:41.408071+0000","last_fullsized":"2023-11-28T11:56:41.408071+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:05.381934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036670+0000","last_change":"2023-11-28T11:56:40.417450+0000","last_active":"2023-11-28T11:56:43.036670+0000","last_peered":"2023-11-28T11:56:43.036670+0000","last_clean":"2023-11-28T11:56:43.036670+0000","last_became_active":"2023-11-28T11:56:40.413535+0000","last_became_peered":"2023-11-28T11:56:40.413535+0000","last_unstale":"2023-11-28T11:56:43.036670+0000","last_undegraded":"2023-11-28T11:56:43.036670+0000","last_fullsized":"2023-11-28T11:56:43.036670+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:24:35.308022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.407370+0000","last_change":"2023-11-28T11:56:40.420713+0000","last_active":"2023-11-28T11:56:41.407370+0000","last_peered":"2023-11-28T11:56:41.407370+0000","last_clean":"2023-11-28T11:56:41.407370+0000","last_became_active":"2023-11-28T11:56:40.420466+0000","last_became_peered":"2023-11-28T11:56:40.420466+0000","last_unstale":"2023-11-28T11:56:41.407370+0000","last_undegraded":"2023-11-28T11:56:41.407370+0000","last_fullsized":"2023-11-28T11:56:41.407370+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:53:15.116169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.405746+0000","last_change":"2023-11-28T11:56:40.424431+0000","last_active":"2023-11-28T11:56:41.405746+0000","last_peered":"2023-11-28T11:56:41.405746+0000","last_clean":"2023-11-28T11:56:41.405746+0000","last_became_active":"2023-11-28T11:56:40.424148+0000","last_became_peered":"2023-11-28T11:56:40.424148+0000","last_unstale":"2023-11-28T11:56:41.405746+0000","last_undegraded":"2023-11-28T11:56:41.405746+0000","last_fullsized":"2023-11-28T11:56:41.405746+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:54.465023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.037364+0000","last_change":"2023-11-28T11:56:40.418572+0000","last_active":"2023-11-28T11:56:43.037364+0000","last_peered":"2023-11-28T11:56:43.037364+0000","last_clean":"2023-11-28T11:56:43.037364+0000","last_became_active":"2023-11-28T11:56:40.418257+0000","last_became_peered":"2023-11-28T11:56:40.418257+0000","last_unstale":"2023-11-28T11:56:43.037364+0000","last_undegraded":"2023-11-28T11:56:43.037364+0000","last_fullsized":"2023-11-28T11:56:43.037364+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:56.564678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:42.651218+0000","last_change":"2023-11-28T11:56:40.422272+0000","last_active":"2023-11-28T11:56:42.651218+0000","last_peered":"2023-11-28T11:56:42.651218+0000","last_clean":"2023-11-28T11:56:42.651218+0000","last_became_active":"2023-11-28T11:56:40.421978+0000","last_became_peered":"2023-11-28T11:56:40.421978+0000","last_unstale":"2023-11-28T11:56:42.651218+0000","last_undegraded":"2023-11-28T11:56:42.651218+0000","last_fullsized":"2023-11-28T11:56:42.651218+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:33.127134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036632+0000","last_change":"2023-11-28T11:56:40.419719+0000","last_active":"2023-11-28T11:56:43.036632+0000","last_peered":"2023-11-28T11:56:43.036632+0000","last_clean":"2023-11-28T11:56:43.036632+0000","last_became_active":"2023-11-28T11:56:40.417445+0000","last_became_peered":"2023-11-28T11:56:40.417445+0000","last_unstale":"2023-11-28T11:56:43.036632+0000","last_undegraded":"2023-11-28T11:56:43.036632+0000","last_fullsized":"2023-11-28T11:56:43.036632+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:27.181098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.407877+0000","last_change":"2023-11-28T11:56:40.405128+0000","last_active":"2023-11-28T11:56:41.407877+0000","last_peered":"2023-11-28T11:56:41.407877+0000","last_clean":"2023-11-28T11:56:41.407877+0000","last_became_active":"2023-11-28T11:56:40.404689+0000","last_became_peered":"2023-11-28T11:56:40.404689+0000","last_unstale":"2023-11-28T11:56:41.407877+0000","last_undegraded":"2023-11-28T11:56:41.407877+0000","last_fullsized":"2023-11-28T11:56:41.407877+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:54.465023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.407068+0000","last_change":"2023-11-28T11:56:40.402682+0000","last_active":"2023-11-28T11:56:41.407068+0000","last_peered":"2023-11-28T11:56:41.407068+0000","last_clean":"2023-11-28T11:56:41.407068+0000","last_became_active":"2023-11-28T11:56:40.402392+0000","last_became_peered":"2023-11-28T11:56:40.402392+0000","last_unstale":"2023-11-28T11:56:41.407068+0000","last_undegraded":"2023-11-28T11:56:41.407068+0000","last_fullsized":"2023-11-28T11:56:41.407068+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:39:36.734268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.407408+0000","last_change":"2023-11-28T11:56:40.422528+0000","last_active":"2023-11-28T11:56:41.407408+0000","last_peered":"2023-11-28T11:56:41.407408+0000","last_clean":"2023-11-28T11:56:41.407408+0000","last_became_active":"2023-11-28T11:56:40.422235+0000","last_became_peered":"2023-11-28T11:56:40.422235+0000","last_unstale":"2023-11-28T11:56:41.407408+0000","last_undegraded":"2023-11-28T11:56:41.407408+0000","last_fullsized":"2023-11-28T11:56:41.407408+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:38:57.771762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.034494+0000","last_change":"2023-11-28T11:56:40.416657+0000","last_active":"2023-11-28T11:56:43.034494+0000","last_peered":"2023-11-28T11:56:43.034494+0000","last_clean":"2023-11-28T11:56:43.034494+0000","last_became_active":"2023-11-28T11:56:40.416376+0000","last_became_peered":"2023-11-28T11:56:40.416376+0000","last_unstale":"2023-11-28T11:56:43.034494+0000","last_undegraded":"2023-11-28T11:56:43.034494+0000","last_fullsized":"2023-11-28T11:56:43.034494+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:28:23.870465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.034302+0000","last_change":"2023-11-28T11:56:40.428253+0000","last_active":"2023-11-28T11:56:43.034302+0000","last_peered":"2023-11-28T11:56:43.034302+0000","last_clean":"2023-11-28T11:56:43.034302+0000","last_became_active":"2023-11-28T11:56:40.427671+0000","last_became_peered":"2023-11-28T11:56:40.427671+0000","last_unstale":"2023-11-28T11:56:43.034302+0000","last_undegraded":"2023-11-28T11:56:43.034302+0000","last_fullsized":"2023-11-28T11:56:43.034302+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:05.574123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.406645+0000","last_change":"2023-11-28T11:56:40.409653+0000","last_active":"2023-11-28T11:56:41.406645+0000","last_peered":"2023-11-28T11:56:41.406645+0000","last_clean":"2023-11-28T11:56:41.406645+0000","last_became_active":"2023-11-28T11:56:40.409289+0000","last_became_peered":"2023-11-28T11:56:40.409289+0000","last_unstale":"2023-11-28T11:56:41.406645+0000","last_undegraded":"2023-11-28T11:56:41.406645+0000","last_fullsized":"2023-11-28T11:56:41.406645+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:47:57.777211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.407325+0000","last_change":"2023-11-28T11:56:40.420172+0000","last_active":"2023-11-28T11:56:41.407325+0000","last_peered":"2023-11-28T11:56:41.407325+0000","last_clean":"2023-11-28T11:56:41.407325+0000","last_became_active":"2023-11-28T11:56:40.419896+0000","last_became_peered":"2023-11-28T11:56:40.419896+0000","last_unstale":"2023-11-28T11:56:41.407325+0000","last_undegraded":"2023-11-28T11:56:41.407325+0000","last_fullsized":"2023-11-28T11:56:41.407325+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:08:53.285914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.038078+0000","last_change":"2023-11-28T11:56:40.416530+0000","last_active":"2023-11-28T11:56:43.038078+0000","last_peered":"2023-11-28T11:56:43.038078+0000","last_clean":"2023-11-28T11:56:43.038078+0000","last_became_active":"2023-11-28T11:56:40.415697+0000","last_became_peered":"2023-11-28T11:56:40.415697+0000","last_unstale":"2023-11-28T11:56:43.038078+0000","last_undegraded":"2023-11-28T11:56:43.038078+0000","last_fullsized":"2023-11-28T11:56:43.038078+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:40:07.506593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.406624+0000","last_change":"2023-11-28T11:56:40.422595+0000","last_active":"2023-11-28T11:56:41.406624+0000","last_peered":"2023-11-28T11:56:41.406624+0000","last_clean":"2023-11-28T11:56:41.406624+0000","last_became_active":"2023-11-28T11:56:40.422260+0000","last_became_peered":"2023-11-28T11:56:40.422260+0000","last_unstale":"2023-11-28T11:56:41.406624+0000","last_undegraded":"2023-11-28T11:56:41.406624+0000","last_fullsized":"2023-11-28T11:56:41.406624+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:50:24.755375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.038429+0000","last_change":"2023-11-28T11:56:40.413858+0000","last_active":"2023-11-28T11:56:43.038429+0000","last_peered":"2023-11-28T11:56:43.038429+0000","last_clean":"2023-11-28T11:56:43.038429+0000","last_became_active":"2023-11-28T11:56:40.412344+0000","last_became_peered":"2023-11-28T11:56:40.412344+0000","last_unstale":"2023-11-28T11:56:43.038429+0000","last_undegraded":"2023-11-28T11:56:43.038429+0000","last_fullsized":"2023-11-28T11:56:43.038429+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:45:13.832755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.406829+0000","last_change":"2023-11-28T11:56:40.420125+0000","last_active":"2023-11-28T11:56:41.406829+0000","last_peered":"2023-11-28T11:56:41.406829+0000","last_clean":"2023-11-28T11:56:41.406829+0000","last_became_active":"2023-11-28T11:56:40.419848+0000","last_became_peered":"2023-11-28T11:56:40.419848+0000","last_unstale":"2023-11-28T11:56:41.406829+0000","last_undegraded":"2023-11-28T11:56:41.406829+0000","last_fullsized":"2023-11-28T11:56:41.406829+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:35:39.821357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.406455+0000","last_change":"2023-11-28T11:56:40.422584+0000","last_active":"2023-11-28T11:56:41.406455+0000","last_peered":"2023-11-28T11:56:41.406455+0000","last_clean":"2023-11-28T11:56:41.406455+0000","last_became_active":"2023-11-28T11:56:40.422363+0000","last_became_peered":"2023-11-28T11:56:40.422363+0000","last_unstale":"2023-11-28T11:56:41.406455+0000","last_undegraded":"2023-11-28T11:56:41.406455+0000","last_fullsized":"2023-11-28T11:56:41.406455+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:43:47.110809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.035995+0000","last_change":"2023-11-28T11:56:40.419639+0000","last_active":"2023-11-28T11:56:43.035995+0000","last_peered":"2023-11-28T11:56:43.035995+0000","last_clean":"2023-11-28T11:56:43.035995+0000","last_became_active":"2023-11-28T11:56:40.419321+0000","last_became_peered":"2023-11-28T11:56:40.419321+0000","last_unstale":"2023-11-28T11:56:43.035995+0000","last_undegraded":"2023-11-28T11:56:43.035995+0000","last_fullsized":"2023-11-28T11:56:43.035995+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:43:45.606861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.035137+0000","last_change":"2023-11-28T11:56:40.427747+0000","last_active":"2023-11-28T11:56:43.035137+0000","last_peered":"2023-11-28T11:56:43.035137+0000","last_clean":"2023-11-28T11:56:43.035137+0000","last_became_active":"2023-11-28T11:56:40.427466+0000","last_became_peered":"2023-11-28T11:56:40.427466+0000","last_unstale":"2023-11-28T11:56:43.035137+0000","last_undegraded":"2023-11-28T11:56:43.035137+0000","last_fullsized":"2023-11-28T11:56:43.035137+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:13:50.703887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"65'4","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.035866+0000","last_change":"2023-11-28T11:56:40.028360+0000","last_active":"2023-11-28T11:56:43.035866+0000","last_peered":"2023-11-28T11:56:43.035866+0000","last_clean":"2023-11-28T11:56:43.035866+0000","last_became_active":"2023-11-28T11:56:40.028082+0000","last_became_peered":"2023-11-28T11:56:40.028082+0000","last_unstale":"2023-11-28T11:56:43.035866+0000","last_undegraded":"2023-11-28T11:56:43.035866+0000","last_fullsized":"2023-11-28T11:56:43.035866+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:53:31.928834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.037410+0000","last_change":"2023-11-28T11:56:40.418343+0000","last_active":"2023-11-28T11:56:43.037410+0000","last_peered":"2023-11-28T11:56:43.037410+0000","last_clean":"2023-11-28T11:56:43.037410+0000","last_became_active":"2023-11-28T11:56:40.418058+0000","last_became_peered":"2023-11-28T11:56:40.418058+0000","last_unstale":"2023-11-28T11:56:43.037410+0000","last_undegraded":"2023-11-28T11:56:43.037410+0000","last_fullsized":"2023-11-28T11:56:43.037410+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:29:57.344181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"65'1","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.408457+0000","last_change":"2023-11-28T11:56:40.027959+0000","last_active":"2023-11-28T11:56:41.408457+0000","last_peered":"2023-11-28T11:56:41.408457+0000","last_clean":"2023-11-28T11:56:41.408457+0000","last_became_active":"2023-11-28T11:56:40.027652+0000","last_became_peered":"2023-11-28T11:56:40.027652+0000","last_unstale":"2023-11-28T11:56:41.408457+0000","last_undegraded":"2023-11-28T11:56:41.408457+0000","last_fullsized":"2023-11-28T11:56:41.408457+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:38:56.768196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036675+0000","last_change":"2023-11-28T11:56:40.426865+0000","last_active":"2023-11-28T11:56:43.036675+0000","last_peered":"2023-11-28T11:56:43.036675+0000","last_clean":"2023-11-28T11:56:43.036675+0000","last_became_active":"2023-11-28T11:56:40.425334+0000","last_became_peered":"2023-11-28T11:56:40.425334+0000","last_unstale":"2023-11-28T11:56:43.036675+0000","last_undegraded":"2023-11-28T11:56:43.036675+0000","last_fullsized":"2023-11-28T11:56:43.036675+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:49:13.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"65'2","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.406457+0000","last_change":"2023-11-28T11:56:40.031497+0000","last_active":"2023-11-28T11:56:41.406457+0000","last_peered":"2023-11-28T11:56:41.406457+0000","last_clean":"2023-11-28T11:56:41.406457+0000","last_became_active":"2023-11-28T11:56:40.031191+0000","last_became_peered":"2023-11-28T11:56:40.031191+0000","last_unstale":"2023-11-28T11:56:41.406457+0000","last_undegraded":"2023-11-28T11:56:41.406457+0000","last_fullsized":"2023-11-28T11:56:41.406457+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:05:15.103312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.035139+0000","last_change":"2023-11-28T11:56:40.418077+0000","last_active":"2023-11-28T11:56:43.035139+0000","last_peered":"2023-11-28T11:56:43.035139+0000","last_clean":"2023-11-28T11:56:43.035139+0000","last_became_active":"2023-11-28T11:56:40.417110+0000","last_became_peered":"2023-11-28T11:56:40.417110+0000","last_unstale":"2023-11-28T11:56:43.035139+0000","last_undegraded":"2023-11-28T11:56:43.035139+0000","last_fullsized":"2023-11-28T11:56:43.035139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:10:24.215533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"65'2","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036906+0000","last_change":"2023-11-28T11:56:40.030464+0000","last_active":"2023-11-28T11:56:43.036906+0000","last_peered":"2023-11-28T11:56:43.036906+0000","last_clean":"2023-11-28T11:56:43.036906+0000","last_became_active":"2023-11-28T11:56:40.030063+0000","last_became_peered":"2023-11-28T11:56:40.030063+0000","last_unstale":"2023-11-28T11:56:43.036906+0000","last_undegraded":"2023-11-28T11:56:43.036906+0000","last_fullsized":"2023-11-28T11:56:43.036906+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:35:29.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.406888+0000","last_change":"2023-11-28T11:56:40.405491+0000","last_active":"2023-11-28T11:56:41.406888+0000","last_peered":"2023-11-28T11:56:41.406888+0000","last_clean":"2023-11-28T11:56:41.406888+0000","last_became_active":"2023-11-28T11:56:40.405164+0000","last_became_peered":"2023-11-28T11:56:40.405164+0000","last_unstale":"2023-11-28T11:56:41.406888+0000","last_undegraded":"2023-11-28T11:56:41.406888+0000","last_fullsized":"2023-11-28T11:56:41.406888+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:22:37.838800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"65'1","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.038660+0000","last_change":"2023-11-28T11:56:40.023883+0000","last_active":"2023-11-28T11:56:43.038660+0000","last_peered":"2023-11-28T11:56:43.038660+0000","last_clean":"2023-11-28T11:56:43.038660+0000","last_became_active":"2023-11-28T11:56:40.023612+0000","last_became_peered":"2023-11-28T11:56:40.023612+0000","last_unstale":"2023-11-28T11:56:43.038660+0000","last_undegraded":"2023-11-28T11:56:43.038660+0000","last_fullsized":"2023-11-28T11:56:43.038660+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:40.931302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.406178+0000","last_change":"2023-11-28T11:56:40.417128+0000","last_active":"2023-11-28T11:56:41.406178+0000","last_peered":"2023-11-28T11:56:41.406178+0000","last_clean":"2023-11-28T11:56:41.406178+0000","last_became_active":"2023-11-28T11:56:40.416876+0000","last_became_peered":"2023-11-28T11:56:40.416876+0000","last_unstale":"2023-11-28T11:56:41.406178+0000","last_undegraded":"2023-11-28T11:56:41.406178+0000","last_fullsized":"2023-11-28T11:56:41.406178+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:15:40.195327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"65'1","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.035986+0000","last_change":"2023-11-28T11:56:40.031384+0000","last_active":"2023-11-28T11:56:43.035986+0000","last_peered":"2023-11-28T11:56:43.035986+0000","last_clean":"2023-11-28T11:56:43.035986+0000","last_became_active":"2023-11-28T11:56:40.030514+0000","last_became_peered":"2023-11-28T11:56:40.030514+0000","last_unstale":"2023-11-28T11:56:43.035986+0000","last_undegraded":"2023-11-28T11:56:43.035986+0000","last_fullsized":"2023-11-28T11:56:43.035986+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:44:32.123567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036126+0000","last_change":"2023-11-28T11:56:40.413588+0000","last_active":"2023-11-28T11:56:43.036126+0000","last_peered":"2023-11-28T11:56:43.036126+0000","last_clean":"2023-11-28T11:56:43.036126+0000","last_became_active":"2023-11-28T11:56:40.413259+0000","last_became_peered":"2023-11-28T11:56:40.413259+0000","last_unstale":"2023-11-28T11:56:43.036126+0000","last_undegraded":"2023-11-28T11:56:43.036126+0000","last_fullsized":"2023-11-28T11:56:43.036126+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:30.956217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:42.650355+0000","last_change":"2023-11-28T11:56:40.029134+0000","last_active":"2023-11-28T11:56:42.650355+0000","last_peered":"2023-11-28T11:56:42.650355+0000","last_clean":"2023-11-28T11:56:42.650355+0000","last_became_active":"2023-11-28T11:56:40.028777+0000","last_became_peered":"2023-11-28T11:56:40.028777+0000","last_unstale":"2023-11-28T11:56:42.650355+0000","last_undegraded":"2023-11-28T11:56:42.650355+0000","last_fullsized":"2023-11-28T11:56:42.650355+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:12:16.621141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.407590+0000","last_change":"2023-11-28T11:56:40.406603+0000","last_active":"2023-11-28T11:56:41.407590+0000","last_peered":"2023-11-28T11:56:41.407590+0000","last_clean":"2023-11-28T11:56:41.407590+0000","last_became_active":"2023-11-28T11:56:40.406378+0000","last_became_peered":"2023-11-28T11:56:40.406378+0000","last_unstale":"2023-11-28T11:56:41.407590+0000","last_undegraded":"2023-11-28T11:56:41.407590+0000","last_fullsized":"2023-11-28T11:56:41.407590+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:09:27.932277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036241+0000","last_change":"2023-11-28T11:56:40.029977+0000","last_active":"2023-11-28T11:56:43.036241+0000","last_peered":"2023-11-28T11:56:43.036241+0000","last_clean":"2023-11-28T11:56:43.036241+0000","last_became_active":"2023-11-28T11:56:40.029682+0000","last_became_peered":"2023-11-28T11:56:40.029682+0000","last_unstale":"2023-11-28T11:56:43.036241+0000","last_undegraded":"2023-11-28T11:56:43.036241+0000","last_fullsized":"2023-11-28T11:56:43.036241+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:54:37.807538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.407385+0000","last_change":"2023-11-28T11:56:40.408118+0000","last_active":"2023-11-28T11:56:41.407385+0000","last_peered":"2023-11-28T11:56:41.407385+0000","last_clean":"2023-11-28T11:56:41.407385+0000","last_became_active":"2023-11-28T11:56:40.407845+0000","last_became_peered":"2023-11-28T11:56:40.407845+0000","last_unstale":"2023-11-28T11:56:41.407385+0000","last_undegraded":"2023-11-28T11:56:41.407385+0000","last_fullsized":"2023-11-28T11:56:41.407385+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:05.574123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.406600+0000","last_change":"2023-11-28T11:56:40.022786+0000","last_active":"2023-11-28T11:56:41.406600+0000","last_peered":"2023-11-28T11:56:41.406600+0000","last_clean":"2023-11-28T11:56:41.406600+0000","last_became_active":"2023-11-28T11:56:40.022528+0000","last_became_peered":"2023-11-28T11:56:40.022528+0000","last_unstale":"2023-11-28T11:56:41.406600+0000","last_undegraded":"2023-11-28T11:56:41.406600+0000","last_fullsized":"2023-11-28T11:56:41.406600+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:33:19.146491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.035638+0000","last_change":"2023-11-28T11:56:40.427957+0000","last_active":"2023-11-28T11:56:43.035638+0000","last_peered":"2023-11-28T11:56:43.035638+0000","last_clean":"2023-11-28T11:56:43.035638+0000","last_became_active":"2023-11-28T11:56:40.427501+0000","last_became_peered":"2023-11-28T11:56:40.427501+0000","last_unstale":"2023-11-28T11:56:43.035638+0000","last_undegraded":"2023-11-28T11:56:43.035638+0000","last_fullsized":"2023-11-28T11:56:43.035638+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:43:47.110809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036904+0000","last_change":"2023-11-28T11:56:40.026590+0000","last_active":"2023-11-28T11:56:43.036904+0000","last_peered":"2023-11-28T11:56:43.036904+0000","last_clean":"2023-11-28T11:56:43.036904+0000","last_became_active":"2023-11-28T11:56:40.026205+0000","last_became_peered":"2023-11-28T11:56:40.026205+0000","last_unstale":"2023-11-28T11:56:43.036904+0000","last_undegraded":"2023-11-28T11:56:43.036904+0000","last_fullsized":"2023-11-28T11:56:43.036904+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:12:55.561112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036796+0000","last_change":"2023-11-28T11:56:40.422353+0000","last_active":"2023-11-28T11:56:43.036796+0000","last_peered":"2023-11-28T11:56:43.036796+0000","last_clean":"2023-11-28T11:56:43.036796+0000","last_became_active":"2023-11-28T11:56:40.422080+0000","last_became_peered":"2023-11-28T11:56:40.422080+0000","last_unstale":"2023-11-28T11:56:43.036796+0000","last_undegraded":"2023-11-28T11:56:43.036796+0000","last_fullsized":"2023-11-28T11:56:43.036796+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:08:36.565892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"65'3","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.038290+0000","last_change":"2023-11-28T11:56:40.022418+0000","last_active":"2023-11-28T11:56:43.038290+0000","last_peered":"2023-11-28T11:56:43.038290+0000","last_clean":"2023-11-28T11:56:43.038290+0000","last_became_active":"2023-11-28T11:56:40.022053+0000","last_became_peered":"2023-11-28T11:56:40.022053+0000","last_unstale":"2023-11-28T11:56:43.038290+0000","last_undegraded":"2023-11-28T11:56:43.038290+0000","last_fullsized":"2023-11-28T11:56:43.038290+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:26.377165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036730+0000","last_change":"2023-11-28T11:56:40.417460+0000","last_active":"2023-11-28T11:56:43.036730+0000","last_peered":"2023-11-28T11:56:43.036730+0000","last_clean":"2023-11-28T11:56:43.036730+0000","last_became_active":"2023-11-28T11:56:40.413966+0000","last_became_peered":"2023-11-28T11:56:40.413966+0000","last_unstale":"2023-11-28T11:56:43.036730+0000","last_undegraded":"2023-11-28T11:56:43.036730+0000","last_fullsized":"2023-11-28T11:56:43.036730+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:59:12.033406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"65'6","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:42.650847+0000","last_change":"2023-11-28T11:56:40.035042+0000","last_active":"2023-11-28T11:56:42.650847+0000","last_peered":"2023-11-28T11:56:42.650847+0000","last_clean":"2023-11-28T11:56:42.650847+0000","last_became_active":"2023-11-28T11:56:40.034701+0000","last_became_peered":"2023-11-28T11:56:40.034701+0000","last_unstale":"2023-11-28T11:56:42.650847+0000","last_undegraded":"2023-11-28T11:56:42.650847+0000","last_fullsized":"2023-11-28T11:56:42.650847+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:00:07.576006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.034620+0000","last_change":"2023-11-28T11:56:40.423292+0000","last_active":"2023-11-28T11:56:43.034620+0000","last_peered":"2023-11-28T11:56:43.034620+0000","last_clean":"2023-11-28T11:56:43.034620+0000","last_became_active":"2023-11-28T11:56:40.422989+0000","last_became_peered":"2023-11-28T11:56:40.422989+0000","last_unstale":"2023-11-28T11:56:43.034620+0000","last_undegraded":"2023-11-28T11:56:43.034620+0000","last_fullsized":"2023-11-28T11:56:43.034620+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:27.181098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"65'2","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:42.650697+0000","last_change":"2023-11-28T11:56:40.028776+0000","last_active":"2023-11-28T11:56:42.650697+0000","last_peered":"2023-11-28T11:56:42.650697+0000","last_clean":"2023-11-28T11:56:42.650697+0000","last_became_active":"2023-11-28T11:56:40.028063+0000","last_became_peered":"2023-11-28T11:56:40.028063+0000","last_unstale":"2023-11-28T11:56:42.650697+0000","last_undegraded":"2023-11-28T11:56:42.650697+0000","last_fullsized":"2023-11-28T11:56:42.650697+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:49:00.185452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.407061+0000","last_change":"2023-11-28T11:56:40.408926+0000","last_active":"2023-11-28T11:56:41.407061+0000","last_peered":"2023-11-28T11:56:41.407061+0000","last_clean":"2023-11-28T11:56:41.407061+0000","last_became_active":"2023-11-28T11:56:40.408609+0000","last_became_peered":"2023-11-28T11:56:40.408609+0000","last_unstale":"2023-11-28T11:56:41.407061+0000","last_undegraded":"2023-11-28T11:56:41.407061+0000","last_fullsized":"2023-11-28T11:56:41.407061+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:13:50.703887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036246+0000","last_change":"2023-11-28T11:56:40.032053+0000","last_active":"2023-11-28T11:56:43.036246+0000","last_peered":"2023-11-28T11:56:43.036246+0000","last_clean":"2023-11-28T11:56:43.036246+0000","last_became_active":"2023-11-28T11:56:40.031611+0000","last_became_peered":"2023-11-28T11:56:40.031611+0000","last_unstale":"2023-11-28T11:56:43.036246+0000","last_undegraded":"2023-11-28T11:56:43.036246+0000","last_fullsized":"2023-11-28T11:56:43.036246+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:44:35.683006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.407259+0000","last_change":"2023-11-28T11:56:40.429423+0000","last_active":"2023-11-28T11:56:41.407259+0000","last_peered":"2023-11-28T11:56:41.407259+0000","last_clean":"2023-11-28T11:56:41.407259+0000","last_became_active":"2023-11-28T11:56:40.429136+0000","last_became_peered":"2023-11-28T11:56:40.429136+0000","last_unstale":"2023-11-28T11:56:41.407259+0000","last_undegraded":"2023-11-28T11:56:41.407259+0000","last_fullsized":"2023-11-28T11:56:41.407259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:45:13.832755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.406337+0000","last_change":"2023-11-28T11:56:40.025470+0000","last_active":"2023-11-28T11:56:41.406337+0000","last_peered":"2023-11-28T11:56:41.406337+0000","last_clean":"2023-11-28T11:56:41.406337+0000","last_became_active":"2023-11-28T11:56:40.025168+0000","last_became_peered":"2023-11-28T11:56:40.025168+0000","last_unstale":"2023-11-28T11:56:41.406337+0000","last_undegraded":"2023-11-28T11:56:41.406337+0000","last_fullsized":"2023-11-28T11:56:41.406337+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:53:55.049164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036638+0000","last_change":"2023-11-28T11:56:40.422720+0000","last_active":"2023-11-28T11:56:43.036638+0000","last_peered":"2023-11-28T11:56:43.036638+0000","last_clean":"2023-11-28T11:56:43.036638+0000","last_became_active":"2023-11-28T11:56:40.422432+0000","last_became_peered":"2023-11-28T11:56:40.422432+0000","last_unstale":"2023-11-28T11:56:43.036638+0000","last_undegraded":"2023-11-28T11:56:43.036638+0000","last_fullsized":"2023-11-28T11:56:43.036638+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:05:00.697018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"65'8","reported_seq":19,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.406010+0000","last_change":"2023-11-28T11:56:40.021369+0000","last_active":"2023-11-28T11:56:41.406010+0000","last_peered":"2023-11-28T11:56:41.406010+0000","last_clean":"2023-11-28T11:56:41.406010+0000","last_became_active":"2023-11-28T11:56:40.021091+0000","last_became_peered":"2023-11-28T11:56:40.021091+0000","last_unstale":"2023-11-28T11:56:41.406010+0000","last_undegraded":"2023-11-28T11:56:41.406010+0000","last_fullsized":"2023-11-28T11:56:41.406010+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:43:46.107242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.408102+0000","last_change":"2023-11-28T11:56:40.420056+0000","last_active":"2023-11-28T11:56:41.408102+0000","last_peered":"2023-11-28T11:56:41.408102+0000","last_clean":"2023-11-28T11:56:41.408102+0000","last_became_active":"2023-11-28T11:56:40.419808+0000","last_became_peered":"2023-11-28T11:56:40.419808+0000","last_unstale":"2023-11-28T11:56:41.408102+0000","last_undegraded":"2023-11-28T11:56:41.408102+0000","last_fullsized":"2023-11-28T11:56:41.408102+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:32:41.247996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"65'2","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036464+0000","last_change":"2023-11-28T11:56:40.027755+0000","last_active":"2023-11-28T11:56:43.036464+0000","last_peered":"2023-11-28T11:56:43.036464+0000","last_clean":"2023-11-28T11:56:43.036464+0000","last_became_active":"2023-11-28T11:56:40.027196+0000","last_became_peered":"2023-11-28T11:56:40.027196+0000","last_unstale":"2023-11-28T11:56:43.036464+0000","last_undegraded":"2023-11-28T11:56:43.036464+0000","last_fullsized":"2023-11-28T11:56:43.036464+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:35:09.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.407069+0000","last_change":"2023-11-28T11:56:40.406367+0000","last_active":"2023-11-28T11:56:41.407069+0000","last_peered":"2023-11-28T11:56:41.407069+0000","last_clean":"2023-11-28T11:56:41.407069+0000","last_became_active":"2023-11-28T11:56:40.405934+0000","last_became_peered":"2023-11-28T11:56:40.405934+0000","last_unstale":"2023-11-28T11:56:41.407069+0000","last_undegraded":"2023-11-28T11:56:41.407069+0000","last_fullsized":"2023-11-28T11:56:41.407069+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:39:15.327975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.407457+0000","last_change":"2023-11-28T11:56:40.029302+0000","last_active":"2023-11-28T11:56:41.407457+0000","last_peered":"2023-11-28T11:56:41.407457+0000","last_clean":"2023-11-28T11:56:41.407457+0000","last_became_active":"2023-11-28T11:56:40.029088+0000","last_became_peered":"2023-11-28T11:56:40.029088+0000","last_unstale":"2023-11-28T11:56:41.407457+0000","last_undegraded":"2023-11-28T11:56:41.407457+0000","last_fullsized":"2023-11-28T11:56:41.407457+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:08:35.562326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.034959+0000","last_change":"2023-11-28T11:56:40.428441+0000","last_active":"2023-11-28T11:56:43.034959+0000","last_peered":"2023-11-28T11:56:43.034959+0000","last_clean":"2023-11-28T11:56:43.034959+0000","last_became_active":"2023-11-28T11:56:40.428021+0000","last_became_peered":"2023-11-28T11:56:40.428021+0000","last_unstale":"2023-11-28T11:56:43.034959+0000","last_undegraded":"2023-11-28T11:56:43.034959+0000","last_fullsized":"2023-11-28T11:56:43.034959+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:39:15.327975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036632+0000","last_change":"2023-11-28T11:56:40.031006+0000","last_active":"2023-11-28T11:56:43.036632+0000","last_peered":"2023-11-28T11:56:43.036632+0000","last_clean":"2023-11-28T11:56:43.036632+0000","last_became_active":"2023-11-28T11:56:40.030708+0000","last_became_peered":"2023-11-28T11:56:40.030708+0000","last_unstale":"2023-11-28T11:56:43.036632+0000","last_undegraded":"2023-11-28T11:56:43.036632+0000","last_fullsized":"2023-11-28T11:56:43.036632+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:19:39.930782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.035216+0000","last_change":"2023-11-28T11:56:40.418267+0000","last_active":"2023-11-28T11:56:43.035216+0000","last_peered":"2023-11-28T11:56:43.035216+0000","last_clean":"2023-11-28T11:56:43.035216+0000","last_became_active":"2023-11-28T11:56:40.417425+0000","last_became_peered":"2023-11-28T11:56:40.417425+0000","last_unstale":"2023-11-28T11:56:43.035216+0000","last_undegraded":"2023-11-28T11:56:43.035216+0000","last_fullsized":"2023-11-28T11:56:43.035216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:05:16.106879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.408085+0000","last_change":"2023-11-28T11:56:40.023580+0000","last_active":"2023-11-28T11:56:41.408085+0000","last_peered":"2023-11-28T11:56:41.408085+0000","last_clean":"2023-11-28T11:56:41.408085+0000","last_became_active":"2023-11-28T11:56:40.023287+0000","last_became_peered":"2023-11-28T11:56:40.023287+0000","last_unstale":"2023-11-28T11:56:41.408085+0000","last_undegraded":"2023-11-28T11:56:41.408085+0000","last_fullsized":"2023-11-28T11:56:41.408085+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:56:19.312359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036855+0000","last_change":"2023-11-28T11:56:40.414178+0000","last_active":"2023-11-28T11:56:43.036855+0000","last_peered":"2023-11-28T11:56:43.036855+0000","last_clean":"2023-11-28T11:56:43.036855+0000","last_became_active":"2023-11-28T11:56:40.413914+0000","last_became_peered":"2023-11-28T11:56:40.413914+0000","last_unstale":"2023-11-28T11:56:43.036855+0000","last_undegraded":"2023-11-28T11:56:43.036855+0000","last_fullsized":"2023-11-28T11:56:43.036855+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:44:36.686572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.037328+0000","last_change":"2023-11-28T11:56:40.027459+0000","last_active":"2023-11-28T11:56:43.037328+0000","last_peered":"2023-11-28T11:56:43.037328+0000","last_clean":"2023-11-28T11:56:43.037328+0000","last_became_active":"2023-11-28T11:56:40.027145+0000","last_became_peered":"2023-11-28T11:56:40.027145+0000","last_unstale":"2023-11-28T11:56:43.037328+0000","last_undegraded":"2023-11-28T11:56:43.037328+0000","last_fullsized":"2023-11-28T11:56:43.037328+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:27:38.862912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036418+0000","last_change":"2023-11-28T11:56:40.426728+0000","last_active":"2023-11-28T11:56:43.036418+0000","last_peered":"2023-11-28T11:56:43.036418+0000","last_clean":"2023-11-28T11:56:43.036418+0000","last_became_active":"2023-11-28T11:56:40.425255+0000","last_became_peered":"2023-11-28T11:56:40.425255+0000","last_unstale":"2023-11-28T11:56:43.036418+0000","last_undegraded":"2023-11-28T11:56:43.036418+0000","last_fullsized":"2023-11-28T11:56:43.036418+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:53:56.052730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:42.650283+0000","last_change":"2023-11-28T11:56:40.028836+0000","last_active":"2023-11-28T11:56:42.650283+0000","last_peered":"2023-11-28T11:56:42.650283+0000","last_clean":"2023-11-28T11:56:42.650283+0000","last_became_active":"2023-11-28T11:56:40.028292+0000","last_became_peered":"2023-11-28T11:56:40.028292+0000","last_unstale":"2023-11-28T11:56:42.650283+0000","last_undegraded":"2023-11-28T11:56:42.650283+0000","last_fullsized":"2023-11-28T11:56:42.650283+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:38:51.138858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:42.650413+0000","last_change":"2023-11-28T11:56:40.407338+0000","last_active":"2023-11-28T11:56:42.650413+0000","last_peered":"2023-11-28T11:56:42.650413+0000","last_clean":"2023-11-28T11:56:42.650413+0000","last_became_active":"2023-11-28T11:56:40.407071+0000","last_became_peered":"2023-11-28T11:56:40.407071+0000","last_unstale":"2023-11-28T11:56:42.650413+0000","last_undegraded":"2023-11-28T11:56:42.650413+0000","last_fullsized":"2023-11-28T11:56:42.650413+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:44:36.686572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.406967+0000","last_change":"2023-11-28T11:56:40.023816+0000","last_active":"2023-11-28T11:56:41.406967+0000","last_peered":"2023-11-28T11:56:41.406967+0000","last_clean":"2023-11-28T11:56:41.406967+0000","last_became_active":"2023-11-28T11:56:40.023537+0000","last_became_peered":"2023-11-28T11:56:40.023537+0000","last_unstale":"2023-11-28T11:56:41.406967+0000","last_undegraded":"2023-11-28T11:56:41.406967+0000","last_fullsized":"2023-11-28T11:56:41.406967+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:13:49.700320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.035643+0000","last_change":"2023-11-28T11:56:40.422235+0000","last_active":"2023-11-28T11:56:43.035643+0000","last_peered":"2023-11-28T11:56:43.035643+0000","last_clean":"2023-11-28T11:56:43.035643+0000","last_became_active":"2023-11-28T11:56:40.421948+0000","last_became_peered":"2023-11-28T11:56:40.421948+0000","last_unstale":"2023-11-28T11:56:43.035643+0000","last_undegraded":"2023-11-28T11:56:43.035643+0000","last_fullsized":"2023-11-28T11:56:43.035643+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:54:13.019021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036568+0000","last_change":"2023-11-28T11:56:40.029515+0000","last_active":"2023-11-28T11:56:43.036568+0000","last_peered":"2023-11-28T11:56:43.036568+0000","last_clean":"2023-11-28T11:56:43.036568+0000","last_became_active":"2023-11-28T11:56:40.029251+0000","last_became_peered":"2023-11-28T11:56:40.029251+0000","last_unstale":"2023-11-28T11:56:43.036568+0000","last_undegraded":"2023-11-28T11:56:43.036568+0000","last_fullsized":"2023-11-28T11:56:43.036568+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:33:31.230054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036539+0000","last_change":"2023-11-28T11:56:40.423941+0000","last_active":"2023-11-28T11:56:43.036539+0000","last_peered":"2023-11-28T11:56:43.036539+0000","last_clean":"2023-11-28T11:56:43.036539+0000","last_became_active":"2023-11-28T11:56:40.423669+0000","last_became_peered":"2023-11-28T11:56:40.423669+0000","last_unstale":"2023-11-28T11:56:43.036539+0000","last_undegraded":"2023-11-28T11:56:43.036539+0000","last_fullsized":"2023-11-28T11:56:43.036539+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:17:15.490820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.035001+0000","last_change":"2023-11-28T11:56:40.029001+0000","last_active":"2023-11-28T11:56:43.035001+0000","last_peered":"2023-11-28T11:56:43.035001+0000","last_clean":"2023-11-28T11:56:43.035001+0000","last_became_active":"2023-11-28T11:56:40.028726+0000","last_became_peered":"2023-11-28T11:56:40.028726+0000","last_unstale":"2023-11-28T11:56:43.035001+0000","last_undegraded":"2023-11-28T11:56:43.035001+0000","last_fullsized":"2023-11-28T11:56:43.035001+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:54.830533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:56:40.407801+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:56:40.407801+0000","last_peered":"2023-11-28T11:56:40.407801+0000","last_clean":"2023-11-28T11:56:40.407801+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:56:40.407801+0000","last_undegraded":"2023-11-28T11:56:40.407801+0000","last_fullsized":"2023-11-28T11:56:40.407801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:42.650702+0000","last_change":"2023-11-28T11:56:40.420688+0000","last_active":"2023-11-28T11:56:42.650702+0000","last_peered":"2023-11-28T11:56:42.650702+0000","last_clean":"2023-11-28T11:56:42.650702+0000","last_became_active":"2023-11-28T11:56:40.420319+0000","last_became_peered":"2023-11-28T11:56:40.420319+0000","last_unstale":"2023-11-28T11:56:42.650702+0000","last_undegraded":"2023-11-28T11:56:42.650702+0000","last_fullsized":"2023-11-28T11:56:42.650702+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:29:57.344181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"65'1","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036370+0000","last_change":"2023-11-28T11:56:40.026576+0000","last_active":"2023-11-28T11:56:43.036370+0000","last_peered":"2023-11-28T11:56:43.036370+0000","last_clean":"2023-11-28T11:56:43.036370+0000","last_became_active":"2023-11-28T11:56:40.026218+0000","last_became_peered":"2023-11-28T11:56:40.026218+0000","last_unstale":"2023-11-28T11:56:43.036370+0000","last_undegraded":"2023-11-28T11:56:43.036370+0000","last_fullsized":"2023-11-28T11:56:43.036370+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:37:20.352230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:56:40.407685+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:56:40.407685+0000","last_peered":"2023-11-28T11:56:40.407685+0000","last_clean":"2023-11-28T11:56:40.407685+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:56:40.407685+0000","last_undegraded":"2023-11-28T11:56:40.407685+0000","last_fullsized":"2023-11-28T11:56:40.407685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.035796+0000","last_change":"2023-11-28T11:56:40.417975+0000","last_active":"2023-11-28T11:56:43.035796+0000","last_peered":"2023-11-28T11:56:43.035796+0000","last_clean":"2023-11-28T11:56:43.035796+0000","last_became_active":"2023-11-28T11:56:40.417063+0000","last_became_peered":"2023-11-28T11:56:40.417063+0000","last_unstale":"2023-11-28T11:56:43.035796+0000","last_undegraded":"2023-11-28T11:56:43.035796+0000","last_fullsized":"2023-11-28T11:56:43.035796+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:31.085605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"65'2","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.406487+0000","last_change":"2023-11-28T11:56:40.031359+0000","last_active":"2023-11-28T11:56:41.406487+0000","last_peered":"2023-11-28T11:56:41.406487+0000","last_clean":"2023-11-28T11:56:41.406487+0000","last_became_active":"2023-11-28T11:56:40.031118+0000","last_became_peered":"2023-11-28T11:56:40.031118+0000","last_unstale":"2023-11-28T11:56:41.406487+0000","last_undegraded":"2023-11-28T11:56:41.406487+0000","last_fullsized":"2023-11-28T11:56:41.406487+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:10:23.211966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":58,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:56:40.396731+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:56:40.396731+0000","last_peered":"2023-11-28T11:56:40.396731+0000","last_clean":"2023-11-28T11:56:40.396731+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:56:40.396731+0000","last_undegraded":"2023-11-28T11:56:40.396731+0000","last_fullsized":"2023-11-28T11:56:40.396731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.406362+0000","last_change":"2023-11-28T11:56:40.406064+0000","last_active":"2023-11-28T11:56:41.406362+0000","last_peered":"2023-11-28T11:56:41.406362+0000","last_clean":"2023-11-28T11:56:41.406362+0000","last_became_active":"2023-11-28T11:56:40.405759+0000","last_became_peered":"2023-11-28T11:56:40.405759+0000","last_unstale":"2023-11-28T11:56:41.406362+0000","last_undegraded":"2023-11-28T11:56:41.406362+0000","last_fullsized":"2023-11-28T11:56:41.406362+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:57:31.363590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"65'1","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036403+0000","last_change":"2023-11-28T11:56:40.029007+0000","last_active":"2023-11-28T11:56:43.036403+0000","last_peered":"2023-11-28T11:56:43.036403+0000","last_clean":"2023-11-28T11:56:43.036403+0000","last_became_active":"2023-11-28T11:56:40.027506+0000","last_became_peered":"2023-11-28T11:56:40.027506+0000","last_unstale":"2023-11-28T11:56:43.036403+0000","last_undegraded":"2023-11-28T11:56:43.036403+0000","last_fullsized":"2023-11-28T11:56:43.036403+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:03.617708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:56:40.406007+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:56:40.406007+0000","last_peered":"2023-11-28T11:56:40.406007+0000","last_clean":"2023-11-28T11:56:40.406007+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:56:40.406007+0000","last_undegraded":"2023-11-28T11:56:40.406007+0000","last_fullsized":"2023-11-28T11:56:40.406007+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.037320+0000","last_change":"2023-11-28T11:56:40.425021+0000","last_active":"2023-11-28T11:56:43.037320+0000","last_peered":"2023-11-28T11:56:43.037320+0000","last_clean":"2023-11-28T11:56:43.037320+0000","last_became_active":"2023-11-28T11:56:40.424711+0000","last_became_peered":"2023-11-28T11:56:40.424711+0000","last_unstale":"2023-11-28T11:56:43.037320+0000","last_undegraded":"2023-11-28T11:56:43.037320+0000","last_fullsized":"2023-11-28T11:56:43.037320+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:57:31.363590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.407151+0000","last_change":"2023-11-28T11:56:40.029813+0000","last_active":"2023-11-28T11:56:41.407151+0000","last_peered":"2023-11-28T11:56:41.407151+0000","last_clean":"2023-11-28T11:56:41.407151+0000","last_became_active":"2023-11-28T11:56:40.029543+0000","last_became_peered":"2023-11-28T11:56:40.029543+0000","last_unstale":"2023-11-28T11:56:41.407151+0000","last_undegraded":"2023-11-28T11:56:41.407151+0000","last_fullsized":"2023-11-28T11:56:41.407151+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:49:40.931302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":202,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:56:40.401321+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:56:40.401321+0000","last_peered":"2023-11-28T11:56:40.401321+0000","last_clean":"2023-11-28T11:56:40.401321+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:56:40.401321+0000","last_undegraded":"2023-11-28T11:56:40.401321+0000","last_fullsized":"2023-11-28T11:56:40.401321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":51,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:56:40.403548+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:56:40.403548+0000","last_peered":"2023-11-28T11:56:40.403548+0000","last_clean":"2023-11-28T11:56:40.403548+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:56:40.403548+0000","last_undegraded":"2023-11-28T11:56:40.403548+0000","last_fullsized":"2023-11-28T11:56:40.403548+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036816+0000","last_change":"2023-11-28T11:56:40.425282+0000","last_active":"2023-11-28T11:56:43.036816+0000","last_peered":"2023-11-28T11:56:43.036816+0000","last_clean":"2023-11-28T11:56:43.036816+0000","last_became_active":"2023-11-28T11:56:40.425000+0000","last_became_peered":"2023-11-28T11:56:40.425000+0000","last_unstale":"2023-11-28T11:56:43.036816+0000","last_undegraded":"2023-11-28T11:56:43.036816+0000","last_fullsized":"2023-11-28T11:56:43.036816+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:55:54.465023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:41.406559+0000","last_change":"2023-11-28T11:56:40.019884+0000","last_active":"2023-11-28T11:56:41.406559+0000","last_peered":"2023-11-28T11:56:41.406559+0000","last_clean":"2023-11-28T11:56:41.406559+0000","last_became_active":"2023-11-28T11:56:40.019577+0000","last_became_peered":"2023-11-28T11:56:40.019577+0000","last_unstale":"2023-11-28T11:56:41.406559+0000","last_undegraded":"2023-11-28T11:56:41.406559+0000","last_fullsized":"2023-11-28T11:56:41.406559+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:12:56.724374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:56:40.403973+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:56:40.403973+0000","last_peered":"2023-11-28T11:56:40.403973+0000","last_clean":"2023-11-28T11:56:40.403973+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:56:40.403973+0000","last_undegraded":"2023-11-28T11:56:40.403973+0000","last_fullsized":"2023-11-28T11:56:40.403973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.038548+0000","last_change":"2023-11-28T11:56:40.414578+0000","last_active":"2023-11-28T11:56:43.038548+0000","last_peered":"2023-11-28T11:56:43.038548+0000","last_clean":"2023-11-28T11:56:43.038548+0000","last_became_active":"2023-11-28T11:56:40.412395+0000","last_became_peered":"2023-11-28T11:56:40.412395+0000","last_unstale":"2023-11-28T11:56:43.038548+0000","last_undegraded":"2023-11-28T11:56:43.038548+0000","last_fullsized":"2023-11-28T11:56:43.038548+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:09:27.932277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.036546+0000","last_change":"2023-11-28T11:56:40.030043+0000","last_active":"2023-11-28T11:56:43.036546+0000","last_peered":"2023-11-28T11:56:43.036546+0000","last_clean":"2023-11-28T11:56:43.036546+0000","last_became_active":"2023-11-28T11:56:40.029716+0000","last_became_peered":"2023-11-28T11:56:40.029716+0000","last_unstale":"2023-11-28T11:56:43.036546+0000","last_undegraded":"2023-11-28T11:56:43.036546+0000","last_fullsized":"2023-11-28T11:56:43.036546+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:37:09.547449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":61,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:56:40.399863+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:56:40.399863+0000","last_peered":"2023-11-28T11:56:40.399863+0000","last_clean":"2023-11-28T11:56:40.399863+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:56:40.399863+0000","last_undegraded":"2023-11-28T11:56:40.399863+0000","last_fullsized":"2023-11-28T11:56:40.399863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.037057+0000","last_change":"2023-11-28T11:56:40.421799+0000","last_active":"2023-11-28T11:56:43.037057+0000","last_peered":"2023-11-28T11:56:43.037057+0000","last_clean":"2023-11-28T11:56:43.037057+0000","last_became_active":"2023-11-28T11:56:40.421510+0000","last_became_peered":"2023-11-28T11:56:40.421510+0000","last_unstale":"2023-11-28T11:56:43.037057+0000","last_undegraded":"2023-11-28T11:56:43.037057+0000","last_fullsized":"2023-11-28T11:56:43.037057+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:39.997185+0000","last_clean_scrub_stamp":"2023-11-28T11:56:39.997185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:05.381934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"65'2","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T11:56:43.037106+0000","last_change":"2023-11-28T11:56:40.029579+0000","last_active":"2023-11-28T11:56:43.037106+0000","last_peered":"2023-11-28T11:56:43.037106+0000","last_clean":"2023-11-28T11:56:43.037106+0000","last_became_active":"2023-11-28T11:56:40.029302+0000","last_became_peered":"2023-11-28T11:56:40.029302+0000","last_unstale":"2023-11-28T11:56:43.037106+0000","last_undegraded":"2023-11-28T11:56:43.037106+0000","last_fullsized":"2023-11-28T11:56:43.037106+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:56:38.993619+0000","last_clean_scrub_stamp":"2023-11-28T11:56:38.993619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:14:26.705390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T11:56:40.403833+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:56:40.403833+0000","last_peered":"2023-11-28T11:56:40.403833+0000","last_clean":"2023-11-28T11:56:40.403833+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:56:40.403833+0000","last_undegraded":"2023-11-28T11:56:40.403833+0000","last_fullsized":"2023-11-28T11:56:40.403833+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10832,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":9472,"kb_avail":94361008,"statfs":{"total":96636764160,"available":96625672192,"internally_reserved":0,"allocated":1384448,"data_stored":958490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9699328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.89600000000000002,"15min":0.91400000000000003},"min":{"1min":0.59199999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0780000000000001,"5min":1.413,"15min":1.413},"last":0.495},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.98399999999999999,"15min":0.97499999999999998},"min":{"1min":0.76200000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.59799999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.85599999999999998,"15min":0.83799999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.119,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.82499999999999996,"15min":0.82299999999999995},"min":{"1min":0.622,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.83299999999999996}]},{"osd":2,"last update":"Tue Nov 28 11:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.81200000000000006,"15min":0.80600000000000005},"min":{"1min":0.59599999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.96399999999999997,"5min":1.266,"15min":1.266},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.034,"5min":0.94099999999999995,"15min":0.92800000000000005},"min":{"1min":0.66100000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.81200000000000006}]},{"osd":3,"last update":"Tue Nov 28 11:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.872,"15min":0.85599999999999998},"min":{"1min":0.68700000000000006,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.996,"15min":1.0069999999999999},"min":{"1min":0.70099999999999996,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.96899999999999997}]},{"osd":4,"last update":"Tue Nov 28 11:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.014,"5min":1.0109999999999999,"15min":1.018},"min":{"1min":0.66600000000000004,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3,"5min":1.621,"15min":1.621},"last":0.92900000000000005}]},{"osd":5,"last update":"Tue Nov 28 11:56:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0209999999999999,"15min":1.016},"min":{"1min":0.71399999999999997,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.143,"5min":1.0900000000000001,"15min":1.0940000000000001},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.0249999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:56:40 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.1000000000000001,"15min":1.0980000000000001},"min":{"1min":0.81299999999999994,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.135,"5min":1.115,"15min":1.115},"min":{"1min":0.94199999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.0009999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9688,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362152,"statfs":{"total":96636764160,"available":96626843648,"internally_reserved":0,"allocated":802816,"data_stored":374587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1579999999999999,"5min":1.625,"15min":1.625},"last":1.177},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83599999999999997,"15min":0.83399999999999996},"min":{"1min":0.54800000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2030000000000001,"5min":1.498,"15min":1.498},"last":0.78700000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.83499999999999996,"15min":0.85499999999999998},"min":{"1min":0.57099999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.099,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.95599999999999996,"15min":0.98099999999999998},"min":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1459999999999999,"5min":1.444,"15min":1.444},"last":0.745}]},{"osd":2,"last update":"Tue Nov 28 11:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.95599999999999996,"15min":0.96199999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1899999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.63100000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.89100000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.90900000000000003,"15min":0.88900000000000001},"min":{"1min":0.67200000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.875,"15min":0.86099999999999999},"min":{"1min":0.66900000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.68799999999999994}]},{"osd":4,"last update":"Tue Nov 28 11:56:39 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93799999999999994,"15min":0.94999999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.268,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.998,"5min":1,"15min":1.0089999999999999},"min":{"1min":0.73399999999999999,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1879999999999999,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.036}]},{"osd":5,"last update":"Tue Nov 28 11:56:39 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.0249999999999999},"min":{"1min":0.79400000000000004,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.55,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.119,"15min":1.137},"min":{"1min":0.63300000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.325,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.0680000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:56:39 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0760000000000001,"15min":1.083},"min":{"1min":0.70099999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.2649999999999999,"5min":1.575,"15min":1.575},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.046,"15min":1.0549999999999999},"min":{"1min":0.754,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.92000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9688,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362152,"statfs":{"total":96636764160,"available":96626843648,"internally_reserved":0,"allocated":802816,"data_stored":375571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.56299999999999994,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.153,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.85199999999999998,"15min":0.85799999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.157,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.69999999999999996}]},{"osd":1,"last update":"Tue Nov 28 11:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.86399999999999999,"15min":0.84199999999999997},"min":{"1min":0.65500000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.91300000000000003,"15min":0.92000000000000004},"min":{"1min":0.75600000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1890000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.93100000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.86399999999999999,"15min":0.84199999999999997},"min":{"1min":0.57899999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1910000000000001,"5min":1.208,"15min":1.208},"last":1.056},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.85999999999999999,"15min":0.83999999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.96699999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.91100000000000003,"15min":0.90500000000000003},"min":{"1min":0.60799999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98099999999999998,"15min":0.98699999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.3360000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.90300000000000002}]},{"osd":4,"last update":"Tue Nov 28 11:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.91400000000000003,"15min":0.93400000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2909999999999999,"5min":1.968,"15min":1.968},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.03,"15min":1.0429999999999999},"min":{"1min":0.64100000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.016}]},{"osd":6,"last update":"Tue Nov 28 11:56:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0069999999999999,"15min":1.01},"min":{"1min":0.70299999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.151},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.997,"15min":1.002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.252,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.218}]},{"osd":7,"last update":"Tue Nov 28 11:56:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0760000000000001,"15min":1.077},"min":{"1min":0.68500000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.085},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0900000000000001,"15min":1.0940000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.5660000000000001,"5min":1.605,"15min":1.605},"last":1.194}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9944,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361896,"statfs":{"total":96636764160,"available":96626581504,"internally_reserved":0,"allocated":802816,"data_stored":375551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.84199999999999997,"15min":0.84599999999999997},"min":{"1min":0.54300000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.51600000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.2569999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85299999999999998,"15min":0.85899999999999999},"min":{"1min":0.57599999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91700000000000004,"15min":0.94099999999999995},"min":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1519999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.111}]},{"osd":2,"last update":"Tue Nov 28 11:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.91100000000000003,"15min":0.92700000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.95599999999999996,"15min":0.97399999999999998},"min":{"1min":0.69799999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.77100000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.93400000000000005,"15min":0.94099999999999995},"min":{"1min":0.68400000000000005,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.472,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.024,"15min":1.0589999999999999},"min":{"1min":0.68500000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.29,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0509999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:56:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0009999999999999,"15min":0.997},"min":{"1min":0.748,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.7190000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0329999999999999,"15min":1.0449999999999999},"min":{"1min":0.66900000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.619,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.081}]},{"osd":6,"last update":"Tue Nov 28 11:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.05,"15min":1.0780000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.24,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1379999999999999,"15min":1.155},"min":{"1min":0.752,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.784,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.97899999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:56:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.129,"15min":1.1559999999999999},"min":{"1min":0.84999999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.6950000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.175,"15min":1.194},"min":{"1min":0.84499999999999997,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.52,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.2849999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13912,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":13120,"kb_avail":94357928,"statfs":{"total":96636764160,"available":96622518272,"internally_reserved":0,"allocated":802816,"data_stored":374607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13434880},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":0.876,"15min":0.70099999999999996},"min":{"1min":0.46500000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":21.122,"5min":21.122,"15min":21.122},"last":0.46500000000000002},{"interface":"front","average":{"1min":1.96,"5min":0.94899999999999995,"15min":0.78500000000000003},"min":{"1min":0.441,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":21.288,"5min":21.288,"15min":21.288},"last":0.441}]},{"osd":1,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.70699999999999996,"15min":0.63500000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":6.3090000000000002,"5min":6.3090000000000002,"15min":6.3090000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":2.052,"5min":1.0049999999999999,"15min":0.83699999999999997},"min":{"1min":0.41199999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":21.151,"5min":21.151,"15min":21.151},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.76600000000000001,"15min":0.78900000000000003},"min":{"1min":0.38600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.0960000000000001,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.91100000000000003,"15min":0.88700000000000001},"min":{"1min":0.497,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":6.5149999999999997,"5min":6.5149999999999997,"15min":6.5149999999999997},"last":0.497}]},{"osd":4,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":2.2400000000000002,"5min":1.266,"15min":1.1080000000000001},"min":{"1min":0.72099999999999997,"5min":0.505,"15min":0.505},"max":{"1min":21.347999999999999,"5min":21.347999999999999,"15min":21.347999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":2.3140000000000001,"5min":1.2989999999999999,"15min":1.1299999999999999},"min":{"1min":0.73799999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":21.129999999999999,"5min":21.129999999999999,"15min":21.129999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":2.3290000000000002,"5min":1.3260000000000001,"15min":1.1819999999999999},"min":{"1min":0.68200000000000005,"5min":0.626,"15min":0.626},"max":{"1min":21.210999999999999,"5min":21.210999999999999,"15min":21.210999999999999},"last":1.012},{"interface":"front","average":{"1min":2.3210000000000002,"5min":1.3720000000000001,"15min":1.228},"min":{"1min":0.82899999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":21.32,"5min":21.32,"15min":21.32},"last":1.03}]},{"osd":6,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0940000000000001,"15min":1.1120000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3360000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":2.3420000000000001,"5min":1.345,"15min":1.194},"min":{"1min":0.75900000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":21.077999999999999,"5min":21.077999999999999,"15min":21.077999999999999},"last":0.872}]},{"osd":7,"last update":"Tue Nov 28 11:56:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.127,"15min":1.151},"min":{"1min":0.82199999999999995,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.3580000000000001,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.522,"5min":1.2390000000000001,"15min":1.196},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":6.5750000000000002,"5min":6.5750000000000002,"15min":6.5750000000000002},"last":0.69899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13724,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":12928,"kb_avail":94358116,"statfs":{"total":96636764160,"available":96622710784,"internally_reserved":0,"allocated":806912,"data_stored":376043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13238272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61199999999999999,"15min":0.59399999999999997},"min":{"1min":0.47599999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0600000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.80600000000000005}]},{"osd":1,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.42799999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97799999999999998,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.86799999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1399999999999999,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.54500000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68400000000000005,"15min":0.69499999999999995},"min":{"1min":0.51000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.036,"5min":1.254,"15min":1.254},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.84499999999999997,"15min":0.82899999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.409,"5min":1.968,"15min":1.968},"last":0.70399999999999996}]},{"osd":4,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0289999999999999,"15min":1.0429999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.5089999999999999,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0640000000000001,"15min":1.0820000000000001},"min":{"1min":0.85599999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.3700000000000001,"5min":2.181,"15min":2.181},"last":1.056}]},{"osd":5,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.97199999999999998,"15min":0.97899999999999998},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1639999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.016},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.60499999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5600000000000001,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.175}]},{"osd":6,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.1419999999999999,"15min":1.1779999999999999},"min":{"1min":0.73199999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.484,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.139},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.1080000000000001,"15min":1.1359999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.466,"5min":1.867,"15min":1.867},"last":0.89000000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.165,"15min":1.1839999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.542,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.1220000000000001,"15min":1.1399999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.351,"5min":1.675,"15min":1.675},"last":0.995}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14892,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":13504,"kb_avail":94356948,"statfs":{"total":96636764160,"available":96621514752,"internally_reserved":0,"allocated":1413120,"data_stored":967997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13828096},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.67900000000000005,"15min":0.68600000000000005},"min":{"1min":0.49099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.96599999999999997,"5min":1.387,"15min":1.387},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70199999999999996,"15min":0.68899999999999995},"min":{"1min":0.57099999999999995,"5min":0.375,"15min":0.375},"max":{"1min":0.89800000000000002,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.88800000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.46500000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.78100000000000003,"15min":0.78900000000000003},"min":{"1min":0.44900000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.88700000000000001,"5min":1.175,"15min":1.175},"last":0.73899999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.85799999999999998,"15min":0.86899999999999999},"min":{"1min":0.51300000000000001,"5min":0.317,"15min":0.317},"max":{"1min":1.171,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.56299999999999994,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.625}]},{"osd":4,"last update":"Tue Nov 28 11:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92200000000000004,"15min":0.91200000000000003},"min":{"1min":0.78500000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.23,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.022,"5min":1.054,"15min":1.0740000000000001},"min":{"1min":0.82099999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.278,"5min":2.29,"15min":2.29},"last":0.96899999999999997}]},{"osd":5,"last update":"Tue Nov 28 11:56:42 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.0189999999999999},"min":{"1min":0.78100000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.288,"5min":1.47,"15min":1.47},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.046,"15min":1.0469999999999999},"min":{"1min":0.90400000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3380000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.163}]},{"osd":6,"last update":"Tue Nov 28 11:56:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0609999999999999,"15min":1.0549999999999999},"min":{"1min":0.81899999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.3089999999999999,"5min":1.581,"15min":1.581},"last":1.01},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.075,"15min":1.081},"min":{"1min":0.876,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3720000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":1.073}]},{"osd":7,"last update":"Tue Nov 28 11:56:42 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.173,"15min":1.202},"min":{"1min":0.83099999999999996,"5min":0.747,"15min":0.747},"max":{"1min":1.4279999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.052},{"interface":"front","average":{"1min":1.111,"5min":1.1100000000000001,"15min":1.105},"min":{"1min":0.79200000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.3959999999999999,"5min":1.647,"15min":1.647},"last":1.206}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14036,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":94357804,"statfs":{"total":96636764160,"available":96622391296,"internally_reserved":0,"allocated":798720,"data_stored":375481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.65000000000000002,"15min":0.67300000000000004},"min":{"1min":0.443,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84799999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.49399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0089999999999999,"5min":1.091,"15min":1.091},"last":0.91500000000000004}]},{"osd":2,"last update":"Tue Nov 28 11:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0389999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.876},{"interface":"front","average":{"1min":0.752,"5min":0.71399999999999997,"15min":0.70199999999999996},"min":{"1min":0.54300000000000004,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.80800000000000005}]},{"osd":3,"last update":"Tue Nov 28 11:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69199999999999995,"15min":0.68999999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.127,"5min":1.159,"15min":1.159},"last":0.62},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.90300000000000002,"15min":0.92300000000000004},"min":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.135,"5min":1.96,"15min":1.96},"last":0.71899999999999997}]},{"osd":4,"last update":"Tue Nov 28 11:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.88200000000000001,"15min":0.87},"min":{"1min":0.59499999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.997},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0720000000000001,"15min":1.1080000000000001},"min":{"1min":0.79500000000000004,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.23,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.1259999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:56:41 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0580000000000001,"15min":1.0700000000000001},"min":{"1min":0.76600000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.383,"5min":1.649,"15min":1.649},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.99299999999999999,"15min":1.004},"min":{"1min":0.78000000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.337,"5min":1.339,"15min":1.339},"last":0.84299999999999997}]},{"osd":6,"last update":"Tue Nov 28 11:56:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.155,"15min":1.1830000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.3169999999999999,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1319999999999999,"15min":1.1379999999999999},"min":{"1min":0.89100000000000001,"5min":0.749,"15min":0.749},"max":{"1min":1.3360000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.27}]},{"osd":7,"last update":"Tue Nov 28 11:56:41 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.1419999999999999,"15min":1.157},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.3440000000000001,"5min":1.486,"15min":1.486},"last":1.343},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0820000000000001,"15min":1.079},"min":{"1min":0.76900000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.1579999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:56:48.202 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T11:56:48.202 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-28T11:56:48.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.317+0000 7f697dc87700 1 Processor -- start 2023-11-28T11:56:48.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.317+0000 7f697dc87700 1 -- start start 2023-11-28T11:56:48.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f697dc87700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f697815c140 0x7f6978160850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:48.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f697dc87700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69780ca6c0 con 0x7f697806a860 2023-11-28T11:56:48.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f697dc87700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69780ca9a0 con 0x7f69780b1970 2023-11-28T11:56:48.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f697dc87700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6978160d90 con 0x7f697815c140 2023-11-28T11:56:48.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f6976ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f697806a860 0x7f69780b1260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42908/0 (socket says 172.21.15.50:42908) 2023-11-28T11:56:48.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f6976ffd700 1 -- 172.21.15.50:0/4018183210 learned_addr learned my addr 172.21.15.50:0/4018183210 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:48.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f69777fe700 1 --2- 172.21.15.50:0/4018183210 >> v2:172.21.15.192:3300/0 conn(0x7f697815c140 0x7f6978160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:48.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f69767fc700 1 -- 172.21.15.50:0/4018183210 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974044966 0 0) 0x7f69780ca6c0 con 0x7f697806a860 2023-11-28T11:56:48.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f69767fc700 1 -- 172.21.15.50:0/4018183210 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69600035d0 con 0x7f697806a860 2023-11-28T11:56:48.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f69767fc700 1 -- 172.21.15.50:0/4018183210 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25884603 0 0) 0x7f69780ca9a0 con 0x7f69780b1970 2023-11-28T11:56:48.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f69767fc700 1 -- 172.21.15.50:0/4018183210 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69780ca6c0 con 0x7f69780b1970 2023-11-28T11:56:48.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f69767fc700 1 -- 172.21.15.50:0/4018183210 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3760774984 0 0) 0x7f69600035d0 con 0x7f697806a860 2023-11-28T11:56:48.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f69777fe700 1 -- 172.21.15.50:0/4018183210 >> v1:172.21.15.192:6789/0 conn(0x7f69780b1970 legacy=0x7f69780cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:48.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f69777fe700 1 -- 172.21.15.50:0/4018183210 >> v1:172.21.15.50:6789/0 conn(0x7f697806a860 legacy=0x7f69780b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:48.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f69777fe700 1 -- 172.21.15.50:0/4018183210 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69780cac80 con 0x7f697815c140 2023-11-28T11:56:48.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f69777fe700 1 --2- 172.21.15.50:0/4018183210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697815c140 0x7f6978160850 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6968009850 tx=0x7f6968009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebcd826ed32a4519 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:48.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f69767fc700 1 -- 172.21.15.50:0/4018183210 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c001670 con 0x7f697815c140 2023-11-28T11:56:48.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f69767fc700 1 -- 172.21.15.50:0/4018183210 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6968004030 con 0x7f697815c140 2023-11-28T11:56:48.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.321+0000 7f69767fc700 1 -- 172.21.15.50:0/4018183210 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69680043c0 con 0x7f697815c140 2023-11-28T11:56:48.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.325+0000 7f697dc87700 1 -- 172.21.15.50:0/4018183210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697815c140 msgr2=0x7f6978160850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:48.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.325+0000 7f697dc87700 1 --2- 172.21.15.50:0/4018183210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697815c140 0x7f6978160850 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6968009850 tx=0x7f6968009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:48.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.325+0000 7f697dc87700 1 -- 172.21.15.50:0/4018183210 shutdown_connections 2023-11-28T11:56:48.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.325+0000 7f697dc87700 1 --2- 172.21.15.50:0/4018183210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697815c140 0x7f6978160850 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.325+0000 7f697dc87700 1 -- 172.21.15.50:0/4018183210 >> 172.21.15.50:0/4018183210 conn(0x7f69780cc260 msgr2=0x7f69780cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:48.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.325+0000 7f697dc87700 1 -- 172.21.15.50:0/4018183210 shutdown_connections 2023-11-28T11:56:48.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.325+0000 7f697dc87700 1 -- 172.21.15.50:0/4018183210 wait complete. 2023-11-28T11:56:48.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.325+0000 7f697dc87700 1 Processor -- start 2023-11-28T11:56:48.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.325+0000 7f697dc87700 1 -- start start 2023-11-28T11:56:48.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.325+0000 7f697dc87700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697806a860 0x7f697815d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:48.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.325+0000 7f697dc87700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69780b1970 0x7f69781f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:48.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.325+0000 7f697dc87700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f697815c140 0x7f69781f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:48.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.325+0000 7f697dc87700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697815d9e0 con 0x7f697815c140 2023-11-28T11:56:48.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.325+0000 7f697dc87700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697815dcc0 con 0x7f697806a860 2023-11-28T11:56:48.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.325+0000 7f697dc87700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697815dfa0 con 0x7f69780b1970 2023-11-28T11:56:48.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.329+0000 7f6977fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f697815c140 0x7f69781f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:48.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.329+0000 7f6977fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f697815c140 0x7f69781f56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48612/0 (socket says 172.21.15.50:48612) 2023-11-28T11:56:48.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.329+0000 7f6977fff700 1 -- 172.21.15.50:0/4264645436 learned_addr learned my addr 172.21.15.50:0/4264645436 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:48.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.329+0000 7f6976ffd700 1 --2- 172.21.15.50:0/4264645436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69780b1970 0x7f69781f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:48.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.329+0000 7f69777fe700 1 --2- 172.21.15.50:0/4264645436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697806a860 0x7f697815d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:48.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.329+0000 7f6977fff700 1 -- 172.21.15.50:0/4264645436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69780b1970 msgr2=0x7f69781f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:48.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.329+0000 7f6977fff700 1 --2- 172.21.15.50:0/4264645436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69780b1970 0x7f69781f5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.329+0000 7f6977fff700 1 -- 172.21.15.50:0/4264645436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697806a860 msgr2=0x7f697815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:48.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.329+0000 7f6977fff700 1 --2- 172.21.15.50:0/4264645436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697806a860 0x7f697815d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.329+0000 7f6977fff700 1 -- 172.21.15.50:0/4264645436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69680094b0 con 0x7f697815c140 2023-11-28T11:56:48.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.329+0000 7f6977fff700 1 --2- 172.21.15.50:0/4264645436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f697815c140 0x7f69781f56b0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f697000cc50 tx=0x7f697000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:48.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.329+0000 7f695ffff700 1 -- 172.21.15.50:0/4264645436 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6970003c20 con 0x7f697815c140 2023-11-28T11:56:48.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.329+0000 7f695ffff700 1 -- 172.21.15.50:0/4264645436 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6970003d80 con 0x7f697815c140 2023-11-28T11:56:48.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.329+0000 7f697dc87700 1 -- 172.21.15.50:0/4264645436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697815c510 con 0x7f697815c140 2023-11-28T11:56:48.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.329+0000 7f695ffff700 1 -- 172.21.15.50:0/4264645436 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697000aab0 con 0x7f697815c140 2023-11-28T11:56:48.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.329+0000 7f697dc87700 1 -- 172.21.15.50:0/4264645436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69780cd980 con 0x7f697815c140 2023-11-28T11:56:48.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.333+0000 7f697dc87700 1 -- 172.21.15.50:0/4264645436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69780caf60 con 0x7f697815c140 2023-11-28T11:56:48.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.333+0000 7f695ffff700 1 -- 172.21.15.50:0/4264645436 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6970010050 con 0x7f697815c140 2023-11-28T11:56:48.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.333+0000 7f695ffff700 1 --2- 172.21.15.50:0/4264645436 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6964064ee0 0x7f6964067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:48.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.333+0000 7f695ffff700 1 -- 172.21.15.50:0/4264645436 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6970081eb0 con 0x7f697815c140 2023-11-28T11:56:48.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.333+0000 7f69777fe700 1 --2- 172.21.15.50:0/4264645436 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6964064ee0 0x7f6964067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:48.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.333+0000 7f69777fe700 1 --2- 172.21.15.50:0/4264645436 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6964064ee0 0x7f6964067390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f69680090b0 tx=0x7f6968008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:48.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.341+0000 7f695ffff700 1 -- 172.21.15.50:0/4264645436 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f697004ff10 con 0x7f697815c140 2023-11-28T11:56:48.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.565+0000 7f697dc87700 1 -- 172.21.15.50:0/4264645436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f6978160850 con 0x7f697815c140 2023-11-28T11:56:48.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.573+0000 7f695ffff700 1 -- 172.21.15.50:0/4264645436 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6970053530 con 0x7f697815c140 2023-11-28T11:56:48.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.577+0000 7f697dc87700 1 -- 172.21.15.50:0/4264645436 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6964064ee0 msgr2=0x7f6964067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:48.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.577+0000 7f697dc87700 1 --2- 172.21.15.50:0/4264645436 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6964064ee0 0x7f6964067390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f69680090b0 tx=0x7f6968008030 comp rx=0 tx=0).stop 2023-11-28T11:56:48.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.577+0000 7f697dc87700 1 -- 172.21.15.50:0/4264645436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f697815c140 msgr2=0x7f69781f56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:48.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.577+0000 7f697dc87700 1 --2- 172.21.15.50:0/4264645436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f697815c140 0x7f69781f56b0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f697000cc50 tx=0x7f697000cf60 comp rx=0 tx=0).stop 2023-11-28T11:56:48.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.577+0000 7f697dc87700 1 -- 172.21.15.50:0/4264645436 shutdown_connections 2023-11-28T11:56:48.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.577+0000 7f697dc87700 1 --2- 172.21.15.50:0/4264645436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f697815c140 0x7f69781f56b0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.577+0000 7f697dc87700 1 --2- 172.21.15.50:0/4264645436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69780b1970 0x7f69781f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.577+0000 7f697dc87700 1 --2- 172.21.15.50:0/4264645436 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6964064ee0 0x7f6964067390 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.577+0000 7f697dc87700 1 --2- 172.21.15.50:0/4264645436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697806a860 0x7f697815d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.577+0000 7f697dc87700 1 -- 172.21.15.50:0/4264645436 >> 172.21.15.50:0/4264645436 conn(0x7f69780cc260 msgr2=0x7f69780cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:48.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.577+0000 7f697dc87700 1 -- 172.21.15.50:0/4264645436 shutdown_connections 2023-11-28T11:56:48.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.577+0000 7f697dc87700 1 -- 172.21.15.50:0/4264645436 wait complete. 2023-11-28T11:56:48.582 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-11-28T11:56:48.595 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:56:48.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.701+0000 7f1519920700 1 Processor -- start 2023-11-28T11:56:48.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.701+0000 7f1519920700 1 -- start start 2023-11-28T11:56:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1519920700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f151414f150 0x7f15140cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1519920700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f15140c99d0 0x7f15140c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1519920700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15140ca360 con 0x7f1514158e60 2023-11-28T11:56:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1519920700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15141595e0 con 0x7f15140c99d0 2023-11-28T11:56:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1519920700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f151414f520 con 0x7f151414f150 2023-11-28T11:56:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1513fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f15140c99d0 0x7f15140c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1513fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f15140c99d0 0x7f15140c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48626/0 (socket says 172.21.15.50:48626) 2023-11-28T11:56:48.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1513fff700 1 -- 172.21.15.50:0/1491073263 learned_addr learned my addr 172.21.15.50:0/1491073263 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f151891e700 1 --2- 172.21.15.50:0/1491073263 >> v2:172.21.15.192:3300/0 conn(0x7f151414f150 0x7f15140cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1513fff700 1 -- 172.21.15.50:0/1491073263 >> v2:172.21.15.192:3300/0 conn(0x7f151414f150 msgr2=0x7f15140cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1513fff700 1 --2- 172.21.15.50:0/1491073263 >> v2:172.21.15.192:3300/0 conn(0x7f151414f150 0x7f15140cdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1513fff700 1 -- 172.21.15.50:0/1491073263 >> v1:172.21.15.192:6789/0 conn(0x7f1514158e60 legacy=0x7f151415bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1513fff700 1 -- 172.21.15.50:0/1491073263 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1514159300 con 0x7f15140c99d0 2023-11-28T11:56:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f151891e700 1 --2- 172.21.15.50:0/1491073263 >> v2:172.21.15.192:3300/0 conn(0x7f151414f150 0x7f15140cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1513fff700 1 --2- 172.21.15.50:0/1491073263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15140c99d0 0x7f15140c9e20 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f15140cc3d0 tx=0x7f150400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fd753ed0448d59 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f15137fe700 1 -- 172.21.15.50:0/1491073263 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150400dd90 con 0x7f15140c99d0 2023-11-28T11:56:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f15137fe700 1 -- 172.21.15.50:0/1491073263 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1504010470 con 0x7f15140c99d0 2023-11-28T11:56:48.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f15137fe700 1 -- 172.21.15.50:0/1491073263 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504010800 con 0x7f15140c99d0 2023-11-28T11:56:48.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1519920700 1 -- 172.21.15.50:0/1491073263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15140c99d0 msgr2=0x7f15140c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:48.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1519920700 1 --2- 172.21.15.50:0/1491073263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15140c99d0 0x7f15140c9e20 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f15140cc3d0 tx=0x7f150400be90 comp rx=0 tx=0).stop 2023-11-28T11:56:48.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1519920700 1 -- 172.21.15.50:0/1491073263 shutdown_connections 2023-11-28T11:56:48.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1519920700 1 --2- 172.21.15.50:0/1491073263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15140c99d0 0x7f15140c9e20 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1519920700 1 --2- 172.21.15.50:0/1491073263 >> v2:172.21.15.192:3300/0 conn(0x7f151414f150 0x7f15140cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1519920700 1 -- 172.21.15.50:0/1491073263 >> 172.21.15.50:0/1491073263 conn(0x7f15140cb2d0 msgr2=0x7f15140cb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:48.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1519920700 1 -- 172.21.15.50:0/1491073263 shutdown_connections 2023-11-28T11:56:48.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.705+0000 7f1519920700 1 -- 172.21.15.50:0/1491073263 wait complete. 2023-11-28T11:56:48.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f1519920700 1 Processor -- start 2023-11-28T11:56:48.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f1519920700 1 -- start start 2023-11-28T11:56:48.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f1519920700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151414f150 0x7f1514070250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:48.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f1519920700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1514158e60 0x7f15141f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:48.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f1519920700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15140b25e0 0x7f15140b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:48.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f1519920700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15141f19e0 con 0x7f151414f150 2023-11-28T11:56:48.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f1519920700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1514071190 con 0x7f15140b25e0 2023-11-28T11:56:48.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f1519920700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15140708f0 con 0x7f1514158e60 2023-11-28T11:56:48.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f151891e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151414f150 0x7f1514070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:48.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f151891e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151414f150 0x7f1514070250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48630/0 (socket says 172.21.15.50:48630) 2023-11-28T11:56:48.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f151891e700 1 -- 172.21.15.50:0/530899254 learned_addr learned my addr 172.21.15.50:0/530899254 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:48.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f1513fff700 1 --2- 172.21.15.50:0/530899254 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1514158e60 0x7f15141f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:48.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f151911f700 1 --2- 172.21.15.50:0/530899254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15140b25e0 0x7f15140b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:48.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f151891e700 1 -- 172.21.15.50:0/530899254 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1514158e60 msgr2=0x7f15141f14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:48.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f151891e700 1 --2- 172.21.15.50:0/530899254 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1514158e60 0x7f15141f14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f151891e700 1 -- 172.21.15.50:0/530899254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15140b25e0 msgr2=0x7f15140b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:48.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f151891e700 1 --2- 172.21.15.50:0/530899254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15140b25e0 0x7f15140b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f151891e700 1 -- 172.21.15.50:0/530899254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150400b810 con 0x7f151414f150 2023-11-28T11:56:48.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f151891e700 1 --2- 172.21.15.50:0/530899254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151414f150 0x7f1514070250 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f150800c770 tx=0x7f150800ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:48.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f15117fa700 1 -- 172.21.15.50:0/530899254 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508011800 con 0x7f151414f150 2023-11-28T11:56:48.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f15117fa700 1 -- 172.21.15.50:0/530899254 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1508011960 con 0x7f151414f150 2023-11-28T11:56:48.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f1519920700 1 -- 172.21.15.50:0/530899254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15140cd2f0 con 0x7f151414f150 2023-11-28T11:56:48.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f15117fa700 1 -- 172.21.15.50:0/530899254 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508011d10 con 0x7f151414f150 2023-11-28T11:56:48.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.709+0000 7f1519920700 1 -- 172.21.15.50:0/530899254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15140cd010 con 0x7f151414f150 2023-11-28T11:56:48.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.713+0000 7f1519920700 1 -- 172.21.15.50:0/530899254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15140cd5d0 con 0x7f151414f150 2023-11-28T11:56:48.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.713+0000 7f15117fa700 1 -- 172.21.15.50:0/530899254 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1508021070 con 0x7f151414f150 2023-11-28T11:56:48.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.713+0000 7f15117fa700 1 --2- 172.21.15.50:0/530899254 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1500064ee0 0x7f1500067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:48.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.713+0000 7f15117fa700 1 -- 172.21.15.50:0/530899254 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1508081e50 con 0x7f151414f150 2023-11-28T11:56:48.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.713+0000 7f1513fff700 1 --2- 172.21.15.50:0/530899254 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1500064ee0 0x7f1500067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:48.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.717+0000 7f1513fff700 1 --2- 172.21.15.50:0/530899254 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1500064ee0 0x7f1500067390 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f15140ccc20 tx=0x7f1504013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:48.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.721+0000 7f15117fa700 1 -- 172.21.15.50:0/530899254 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f150804fdc0 con 0x7f151414f150 2023-11-28T11:56:48.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.917+0000 7f1519920700 1 -- 172.21.15.50:0/530899254 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1514072500 con 0x7f151414f150 2023-11-28T11:56:48.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.917+0000 7f15117fa700 1 -- 172.21.15.50:0/530899254 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f15080533e0 con 0x7f151414f150 2023-11-28T11:56:48.923 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:48.923 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1573599194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1573599194},{"type":"v1","addr":"172.21.15.192:6836","nonce":1573599194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6445,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/983935617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":983935617},{"type":"v1","addr":"172.21.15.192:6837","nonce":983935617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2516263109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2516263109},{"type":"v1","addr":"172.21.15.50:6833","nonce":2516263109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:56:40.385672+0000","modified":"2023-11-28T11:56:42.402645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3894924751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3894924751},{"type":"v1","addr":"172.21.15.50:6835","nonce":3894924751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:56:48.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.921+0000 7f1519920700 1 -- 172.21.15.50:0/530899254 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1500064ee0 msgr2=0x7f1500067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:48.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.921+0000 7f1519920700 1 --2- 172.21.15.50:0/530899254 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1500064ee0 0x7f1500067390 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f15140ccc20 tx=0x7f1504013000 comp rx=0 tx=0).stop 2023-11-28T11:56:48.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.921+0000 7f1519920700 1 -- 172.21.15.50:0/530899254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151414f150 msgr2=0x7f1514070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:48.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.921+0000 7f1519920700 1 --2- 172.21.15.50:0/530899254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151414f150 0x7f1514070250 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f150800c770 tx=0x7f150800ca80 comp rx=0 tx=0).stop 2023-11-28T11:56:48.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.921+0000 7f1519920700 1 -- 172.21.15.50:0/530899254 shutdown_connections 2023-11-28T11:56:48.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.921+0000 7f1519920700 1 --2- 172.21.15.50:0/530899254 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1500064ee0 0x7f1500067390 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.921+0000 7f1519920700 1 --2- 172.21.15.50:0/530899254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15140b25e0 0x7f15140b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.921+0000 7f1519920700 1 --2- 172.21.15.50:0/530899254 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1514158e60 0x7f15141f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.921+0000 7f1519920700 1 --2- 172.21.15.50:0/530899254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f151414f150 0x7f1514070250 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:48.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.921+0000 7f1519920700 1 -- 172.21.15.50:0/530899254 >> 172.21.15.50:0/530899254 conn(0x7f15140cb2d0 msgr2=0x7f1514158440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:48.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.921+0000 7f1519920700 1 -- 172.21.15.50:0/530899254 shutdown_connections 2023-11-28T11:56:48.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:48.921+0000 7f1519920700 1 -- 172.21.15.50:0/530899254 wait complete. 2023-11-28T11:56:48.926 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 31 2023-11-28T11:56:49.340 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T11:56:40.385672+0000', 'modified': '2023-11-28T11:56:42.402645+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6510}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6510': {'gid': 6510, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/3894924751', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 3894924751}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 3894924751}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T11:56:49.340 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T11:56:49.341 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T11:56:49.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.461+0000 7fedb7fff700 1 Processor -- start 2023-11-28T11:56:49.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.461+0000 7fedb7fff700 1 -- start start 2023-11-28T11:56:49.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb80d2e90 0x7fedb80b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb7fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb80cf070 con 0x7fedb806a330 2023-11-28T11:56:49.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb7fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb80b2070 con 0x7fedb80b1ca0 2023-11-28T11:56:49.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb7fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb806a8a0 con 0x7fedb80d2e90 2023-11-28T11:56:49.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb67fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fedb806a330 0x7fedb80d2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:42914/0 (socket says 172.21.15.50:42914) 2023-11-28T11:56:49.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb67fc700 1 -- 172.21.15.50:0/2604000244 learned_addr learned my addr 172.21.15.50:0/2604000244 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:49.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb77fe700 1 --2- 172.21.15.50:0/2604000244 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb80d2e90 0x7fedb80b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 -- 172.21.15.50:0/2604000244 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882484103 0 0) 0x7fedb80cf070 con 0x7fedb806a330 2023-11-28T11:56:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 -- 172.21.15.50:0/2604000244 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feda40035d0 con 0x7fedb806a330 2023-11-28T11:56:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 -- 172.21.15.50:0/2604000244 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3677494036 0 0) 0x7feda40035d0 con 0x7fedb806a330 2023-11-28T11:56:49.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 -- 172.21.15.50:0/2604000244 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb80d2e90 msgr2=0x7fedb80b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 --2- 172.21.15.50:0/2604000244 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb80d2e90 0x7fedb80b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 -- 172.21.15.50:0/2604000244 >> v1:172.21.15.192:6789/0 conn(0x7fedb80b1ca0 legacy=0x7fedb80cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 -- 172.21.15.50:0/2604000244 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb806ab80 con 0x7fedb806a330 2023-11-28T11:56:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 -- 172.21.15.50:0/2604000244 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7feda8001670 con 0x7fedb806a330 2023-11-28T11:56:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 -- 172.21.15.50:0/2604000244 >> v1:172.21.15.50:6789/0 conn(0x7fedb806a330 legacy=0x7fedb80d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 --2- 172.21.15.50:0/2604000244 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb80d2e90 0x7feda4003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 --2- 172.21.15.50:0/2604000244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feda4003fd0 0x7feda4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 --2- 172.21.15.50:0/2604000244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feda4004db0 0x7feda4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 -- 172.21.15.50:0/2604000244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb806a8a0 con 0x7feda4003fd0 2023-11-28T11:56:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 -- 172.21.15.50:0/2604000244 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda400bbc0 con 0x7feda4004db0 2023-11-28T11:56:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 -- 172.21.15.50:0/2604000244 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda400bd80 con 0x7fedb80d2e90 2023-11-28T11:56:49.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb67fc700 1 --2- 172.21.15.50:0/2604000244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feda4003fd0 0x7feda4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb6ffd700 1 --2- 172.21.15.50:0/2604000244 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb80d2e90 0x7feda4003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb77fe700 1 --2- 172.21.15.50:0/2604000244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feda4004db0 0x7feda4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb67fc700 1 -- 172.21.15.50:0/2604000244 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb80d2e90 msgr2=0x7feda4003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb67fc700 1 --2- 172.21.15.50:0/2604000244 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb80d2e90 0x7feda4003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb67fc700 1 -- 172.21.15.50:0/2604000244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feda4004db0 msgr2=0x7feda4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb67fc700 1 --2- 172.21.15.50:0/2604000244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feda4004db0 0x7feda4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb67fc700 1 -- 172.21.15.50:0/2604000244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda40035d0 con 0x7feda4003fd0 2023-11-28T11:56:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb67fc700 1 --2- 172.21.15.50:0/2604000244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feda4003fd0 0x7feda4004870 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7feda800c270 tx=0x7feda40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7feb49ce6104c7d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 -- 172.21.15.50:0/2604000244 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8007c30 con 0x7feda4003fd0 2023-11-28T11:56:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 -- 172.21.15.50:0/2604000244 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda800cdb0 con 0x7feda4003fd0 2023-11-28T11:56:49.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.465+0000 7fedb5ffb700 1 -- 172.21.15.50:0/2604000244 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8005bc0 con 0x7feda4003fd0 2023-11-28T11:56:49.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb7fff700 1 -- 172.21.15.50:0/2604000244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feda4003fd0 msgr2=0x7feda4004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:49.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb7fff700 1 --2- 172.21.15.50:0/2604000244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feda4003fd0 0x7feda4004870 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7feda800c270 tx=0x7feda40058a0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb77fe700 1 -- 172.21.15.50:0/2604000244 reap_dead start 2023-11-28T11:56:49.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb7fff700 1 -- 172.21.15.50:0/2604000244 shutdown_connections 2023-11-28T11:56:49.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb7fff700 1 -- 172.21.15.50:0/2604000244 >> 172.21.15.50:0/2604000244 conn(0x7fedb80b5740 msgr2=0x7fedb80b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:49.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb7fff700 1 -- 172.21.15.50:0/2604000244 shutdown_connections 2023-11-28T11:56:49.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb7fff700 1 -- 172.21.15.50:0/2604000244 wait complete. 2023-11-28T11:56:49.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb7fff700 1 Processor -- start 2023-11-28T11:56:49.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb7fff700 1 -- start start 2023-11-28T11:56:49.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feda4003fd0 0x7fedb80cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb81f4c30 0x7fedb80b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb8158bc0 0x7fedb80c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb7fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80b44a0 con 0x7fedb8158bc0 2023-11-28T11:56:49.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb7fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80b6200 con 0x7feda4003fd0 2023-11-28T11:56:49.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb7fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80b2310 con 0x7fedb81f4c30 2023-11-28T11:56:49.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb8158bc0 0x7fedb80c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb8158bc0 0x7fedb80c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48654/0 (socket says 172.21.15.50:48654) 2023-11-28T11:56:49.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb77fe700 1 -- 172.21.15.50:0/111468577 learned_addr learned my addr 172.21.15.50:0/111468577 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:49.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb6ffd700 1 --2- 172.21.15.50:0/111468577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feda4003fd0 0x7fedb80cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.469+0000 7fedb67fc700 1 --2- 172.21.15.50:0/111468577 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb81f4c30 0x7fedb80b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.473+0000 7fedb77fe700 1 -- 172.21.15.50:0/111468577 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb81f4c30 msgr2=0x7fedb80b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:49.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.473+0000 7fedb77fe700 1 --2- 172.21.15.50:0/111468577 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb81f4c30 0x7fedb80b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.473+0000 7fedb77fe700 1 -- 172.21.15.50:0/111468577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feda4003fd0 msgr2=0x7fedb80cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:49.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.473+0000 7fedb77fe700 1 --2- 172.21.15.50:0/111468577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feda4003fd0 0x7fedb80cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.473+0000 7fedb77fe700 1 -- 172.21.15.50:0/111468577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb806b140 con 0x7fedb8158bc0 2023-11-28T11:56:49.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.473+0000 7fedb77fe700 1 --2- 172.21.15.50:0/111468577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb8158bc0 0x7fedb80c8330 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fedb808ae30 tx=0x7fedb00111d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:49.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.473+0000 7fedaf7fe700 1 -- 172.21.15.50:0/111468577 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb000e070 con 0x7fedb8158bc0 2023-11-28T11:56:49.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.473+0000 7fedaf7fe700 1 -- 172.21.15.50:0/111468577 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb0003d10 con 0x7fedb8158bc0 2023-11-28T11:56:49.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.473+0000 7fedb7fff700 1 -- 172.21.15.50:0/111468577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb806ae60 con 0x7fedb8158bc0 2023-11-28T11:56:49.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.473+0000 7fedaf7fe700 1 -- 172.21.15.50:0/111468577 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb00117a0 con 0x7fedb8158bc0 2023-11-28T11:56:49.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.473+0000 7fedb7fff700 1 -- 172.21.15.50:0/111468577 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb806da70 con 0x7fedb8158bc0 2023-11-28T11:56:49.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.473+0000 7fedaf7fe700 1 -- 172.21.15.50:0/111468577 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fedb0011900 con 0x7fedb8158bc0 2023-11-28T11:56:49.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.477+0000 7fedaf7fe700 1 --2- 172.21.15.50:0/111468577 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fed98064f10 0x7fed980673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.477+0000 7fedaf7fe700 1 -- 172.21.15.50:0/111468577 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fedb0082410 con 0x7fedb8158bc0 2023-11-28T11:56:49.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.477+0000 7fedb6ffd700 1 --2- 172.21.15.50:0/111468577 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fed98064f10 0x7fed980673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.477+0000 7fedb6ffd700 1 --2- 172.21.15.50:0/111468577 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fed98064f10 0x7fed980673c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fedb815ba40 tx=0x7feda0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:49.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.477+0000 7fedc06cb740 1 Processor -- start 2023-11-28T11:56:49.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.477+0000 7fedc06cb740 1 -- start start 2023-11-28T11:56:49.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedc06cb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e3eae0 0x20eee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedc06cb740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3e710 0x20ef340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedc06cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e89790 0x20ef880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedc06cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fadae0 con 0x1e89790 2023-11-28T11:56:49.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedc06cb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x201dbd0 con 0x1e3eae0 2023-11-28T11:56:49.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedc06cb740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x2016ed0 con 0x1e3e710 2023-11-28T11:56:49.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e89790 0x20ef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e89790 0x20ef880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48666/0 (socket says 172.21.15.50:48666) 2023-11-28T11:56:49.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedb77fe700 1 -- 172.21.15.50:0/3824494021 learned_addr learned my addr 172.21.15.50:0/3824494021 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:49.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedb6ffd700 1 --2- 172.21.15.50:0/3824494021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e3eae0 0x20eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedb67fc700 1 --2- 172.21.15.50:0/3824494021 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3e710 0x20ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedb77fe700 1 -- 172.21.15.50:0/3824494021 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3e710 msgr2=0x20ef340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:49.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedb77fe700 1 --2- 172.21.15.50:0/3824494021 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3e710 0x20ef340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedb77fe700 1 -- 172.21.15.50:0/3824494021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e3eae0 msgr2=0x20eee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:49.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedb77fe700 1 --2- 172.21.15.50:0/3824494021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e3eae0 0x20eee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedb77fe700 1 -- 172.21.15.50:0/3824494021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x203ccc0 con 0x1e89790 2023-11-28T11:56:49.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedb77fe700 1 --2- 172.21.15.50:0/3824494021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e89790 0x20ef880 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fedb0053bf0 tx=0x7fedb0014350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bd70b5b172280f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:49.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedacff9700 1 -- 172.21.15.50:0/3824494021 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb005c240 con 0x1e89790 2023-11-28T11:56:49.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedacff9700 1 -- 172.21.15.50:0/3824494021 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb00820f0 con 0x1e89790 2023-11-28T11:56:49.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedacff9700 1 -- 172.21.15.50:0/3824494021 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb006b3f0 con 0x1e89790 2023-11-28T11:56:49.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedc06cb740 1 -- 172.21.15.50:0/3824494021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e89790 msgr2=0x20ef880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:49.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedc06cb740 1 --2- 172.21.15.50:0/3824494021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e89790 0x20ef880 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fedb0053bf0 tx=0x7fedb0014350 comp rx=0 tx=0).stop 2023-11-28T11:56:49.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedc06cb740 1 -- 172.21.15.50:0/3824494021 shutdown_connections 2023-11-28T11:56:49.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedc06cb740 1 --2- 172.21.15.50:0/3824494021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e89790 0x20ef880 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedc06cb740 1 --2- 172.21.15.50:0/3824494021 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3e710 0x20ef340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedc06cb740 1 --2- 172.21.15.50:0/3824494021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e3eae0 0x20eee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedc06cb740 1 -- 172.21.15.50:0/3824494021 >> 172.21.15.50:0/3824494021 conn(0x1e3eeb0 msgr2=0x20d7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:49.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedc06cb740 1 -- 172.21.15.50:0/3824494021 shutdown_connections 2023-11-28T11:56:49.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedc06cb740 1 -- 172.21.15.50:0/3824494021 wait complete. 2023-11-28T11:56:49.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedc06cb740 1 -- start start 2023-11-28T11:56:49.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.481+0000 7fedc06cb740 1 Processor -- start 2023-11-28T11:56:49.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedc06cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3e710 0x20af900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedc06cb740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3eae0 0x20d5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedc06cb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e89790 0x20d5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedc06cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ec3b20 con 0x1e3e710 2023-11-28T11:56:49.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedc06cb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x20adf50 con 0x1e89790 2023-11-28T11:56:49.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedc06cb740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x20afe40 con 0x1e3eae0 2023-11-28T11:56:49.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedc06cb740 10 client.0 _ll_register_callbacks cb 0x20730d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:56:49.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedb6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3e710 0x20af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedb6ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3e710 0x20af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48682/0 (socket says 172.21.15.50:48682) 2023-11-28T11:56:49.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedb6ffd700 1 -- 172.21.15.50:0/1415244625 learned_addr learned my addr 172.21.15.50:0/1415244625 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:49.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedb67fc700 1 --2- 172.21.15.50:0/1415244625 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3eae0 0x20d5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedb77fe700 1 --2- 172.21.15.50:0/1415244625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e89790 0x20d5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedb6ffd700 1 -- 172.21.15.50:0/1415244625 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3eae0 msgr2=0x20d5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:49.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedb6ffd700 1 --2- 172.21.15.50:0/1415244625 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3eae0 0x20d5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedb6ffd700 1 -- 172.21.15.50:0/1415244625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e89790 msgr2=0x20d5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:49.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedb6ffd700 1 --2- 172.21.15.50:0/1415244625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e89790 0x20d5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedb6ffd700 1 -- 172.21.15.50:0/1415244625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb806da70 con 0x1e3e710 2023-11-28T11:56:49.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedb6ffd700 1 --2- 172.21.15.50:0/1415244625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3e710 0x20af900 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7feda0007690 tx=0x7feda0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd7f49b229b384 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:49.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fed95ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:56:49.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fed95ffb700 1 -- 172.21.15.50:0/1415244625 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda0028030 con 0x1e3e710 2023-11-28T11:56:49.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fed95ffb700 1 -- 172.21.15.50:0/1415244625 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7feda0029070 con 0x1e3e710 2023-11-28T11:56:49.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedc06cb740 1 -- 172.21.15.50:0/1415244625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x200ff50 con 0x1e3e710 2023-11-28T11:56:49.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fed95ffb700 1 -- 172.21.15.50:0/1415244625 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7feda0006a90 con 0x1e3e710 2023-11-28T11:56:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedc06cb740 10 client.6666 fetch_fsmap learned FSMap version 31 2023-11-28T11:56:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedc06cb740 1 -- 172.21.15.50:0/1415244625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x1e8a9e0 con 0x1e3e710 2023-11-28T11:56:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fed95ffb700 1 -- 172.21.15.50:0/1415244625 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda0033020 con 0x1e3e710 2023-11-28T11:56:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fed95ffb700 1 -- 172.21.15.50:0/1415244625 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7feda0023410 con 0x1e3e710 2023-11-28T11:56:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedc06cb740 10 client.6666 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T11:56:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedc06cb740 10 client.6666 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T11:56:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedc06cb740 20 client.6666 populate_metadata read hostname 'smithi050' 2023-11-28T11:56:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedc06cb740 1 --2- 172.21.15.50:0/1415244625 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x20aa370 0x20ad160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedc06cb740 4 client.6666 mds_command: new command op to 6510 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:56:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedc06cb740 1 -- 172.21.15.50:0/1415244625 --> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x200fc70 con 0x20aa370 2023-11-28T11:56:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedb67fc700 1 --2- 172.21.15.50:0/1415244625 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x20aa370 0x20ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fed95ffb700 10 client.6666 ms_handle_connect on v2:172.21.15.50:6834/3894924751 2023-11-28T11:56:49.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.485+0000 7fedb67fc700 1 --2- 172.21.15.50:0/1415244625 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x20aa370 0x20ad160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5aa8092a317df90 server_cookie=9d30738f3b2642c3 in_seq=0 out_seq=0 2023-11-28T11:56:49.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.489+0000 7fed95ffb700 1 -- 172.21.15.50:0/1415244625 <== mds.0 v2:172.21.15.50:6834/3894924751 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x200fc70 con 0x20aa370 2023-11-28T11:56:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.489+0000 7fed95ffb700 10 client.6666 handle_command_reply: tid=0 2023-11-28T11:56:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.489+0000 7fedc06cb740 1 client.6666 shutdown 2023-11-28T11:56:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.489+0000 7fedc06cb740 1 -- 172.21.15.50:0/1415244625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3e710 msgr2=0x20af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.489+0000 7fedc06cb740 1 --2- 172.21.15.50:0/1415244625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3e710 0x20af900 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7feda0007690 tx=0x7feda0001120 comp rx=0 tx=0).stop 2023-11-28T11:56:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.489+0000 7fedc06cb740 1 -- 172.21.15.50:0/1415244625 shutdown_connections 2023-11-28T11:56:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.489+0000 7fedc06cb740 1 --2- 172.21.15.50:0/1415244625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e89790 0x20d5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.489+0000 7fedc06cb740 1 --2- 172.21.15.50:0/1415244625 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3eae0 0x20d5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.489+0000 7fedc06cb740 1 --2- 172.21.15.50:0/1415244625 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x20aa370 0x20ad160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.489+0000 7fedc06cb740 1 --2- 172.21.15.50:0/1415244625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3e710 0x20af900 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.489+0000 7fedc06cb740 1 -- 172.21.15.50:0/1415244625 >> 172.21.15.50:0/1415244625 conn(0x1e3eeb0 msgr2=0x20d7780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:49.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.489+0000 7fed95ffb700 0 client.6666 ms_handle_reset on v2:172.21.15.50:6834/3894924751 2023-11-28T11:56:49.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.489+0000 7fedc06cb740 1 -- 172.21.15.50:0/1415244625 shutdown_connections 2023-11-28T11:56:49.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.489+0000 7fedc06cb740 1 -- 172.21.15.50:0/1415244625 wait complete. 2023-11-28T11:56:49.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.489+0000 7fedc06cb740 20 client.6666 trim_cache size 0 max 16384 2023-11-28T11:56:49.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.509+0000 7fedc06cb740 1 Processor -- start 2023-11-28T11:56:49.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.509+0000 7fedc06cb740 1 -- start start 2023-11-28T11:56:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.509+0000 7fedc06cb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e3eeb0 0x20d77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.509+0000 7fedc06cb740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3e710 0x20d6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.509+0000 7fedc06cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3eae0 0x20d67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.509+0000 7fedc06cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fc15f0 con 0x1e3eae0 2023-11-28T11:56:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.509+0000 7fedc06cb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fcca40 con 0x1e3eeb0 2023-11-28T11:56:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.509+0000 7fedc06cb740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x20166e0 con 0x1e3e710 2023-11-28T11:56:49.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3eae0 0x20d67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedb67fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3e710 0x20d6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3eae0 0x20d67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48694/0 (socket says 172.21.15.50:48694) 2023-11-28T11:56:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedb77fe700 1 -- 172.21.15.50:0/1173074613 learned_addr learned my addr 172.21.15.50:0/1173074613 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedb6ffd700 1 --2- 172.21.15.50:0/1173074613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e3eeb0 0x20d77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedb77fe700 1 -- 172.21.15.50:0/1173074613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3e710 msgr2=0x20d6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedb77fe700 1 --2- 172.21.15.50:0/1173074613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3e710 0x20d6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedb77fe700 1 -- 172.21.15.50:0/1173074613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e3eeb0 msgr2=0x20d77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedb77fe700 1 --2- 172.21.15.50:0/1173074613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e3eeb0 0x20d77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedb77fe700 1 -- 172.21.15.50:0/1173074613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb80c8bd0 con 0x1e3eae0 2023-11-28T11:56:49.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedb77fe700 1 --2- 172.21.15.50:0/1173074613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3eae0 0x20d67c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fedb0050630 tx=0x7fedb0069000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a88ed0d7d104fe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:49.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedad7fa700 1 -- 172.21.15.50:0/1173074613 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0082260 con 0x1e3eae0 2023-11-28T11:56:49.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedad7fa700 1 -- 172.21.15.50:0/1173074613 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb005c1c0 con 0x1e3eae0 2023-11-28T11:56:49.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedad7fa700 1 -- 172.21.15.50:0/1173074613 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb006b410 con 0x1e3eae0 2023-11-28T11:56:49.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 1 -- 172.21.15.50:0/1173074613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3eae0 msgr2=0x20d67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:49.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 1 --2- 172.21.15.50:0/1173074613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3eae0 0x20d67c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fedb0050630 tx=0x7fedb0069000 comp rx=0 tx=0).stop 2023-11-28T11:56:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 1 -- 172.21.15.50:0/1173074613 shutdown_connections 2023-11-28T11:56:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 1 --2- 172.21.15.50:0/1173074613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3eae0 0x20d67c0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 1 --2- 172.21.15.50:0/1173074613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3e710 0x20d6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 1 --2- 172.21.15.50:0/1173074613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e3eeb0 0x20d77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 1 -- 172.21.15.50:0/1173074613 >> 172.21.15.50:0/1173074613 conn(0x20afa70 msgr2=0x20d5980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 1 -- 172.21.15.50:0/1173074613 shutdown_connections 2023-11-28T11:56:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 1 -- 172.21.15.50:0/1173074613 wait complete. 2023-11-28T11:56:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 1 -- start start 2023-11-28T11:56:49.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 1 Processor -- start 2023-11-28T11:56:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e3e710 0x2151da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3eae0 0x210b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3eeb0 0x21088f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x20adac0 con 0x1e3eeb0 2023-11-28T11:56:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x20acdd0 con 0x1e3e710 2023-11-28T11:56:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x2105550 con 0x1e3eae0 2023-11-28T11:56:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.513+0000 7fedc06cb740 10 client.0 _ll_register_callbacks cb 0x1fc32d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:56:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3eeb0 0x21088f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedb67fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3eae0 0x210b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedb6ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e3e710 0x2151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3eeb0 0x21088f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48700/0 (socket says 172.21.15.50:48700) 2023-11-28T11:56:49.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedb77fe700 1 -- 172.21.15.50:0/293458586 learned_addr learned my addr 172.21.15.50:0/293458586 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:49.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedb77fe700 1 -- 172.21.15.50:0/293458586 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3eae0 msgr2=0x210b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:49.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedb77fe700 1 --2- 172.21.15.50:0/293458586 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3eae0 0x210b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedb77fe700 1 -- 172.21.15.50:0/293458586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e3e710 msgr2=0x2151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:49.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedb77fe700 1 --2- 172.21.15.50:0/293458586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e3e710 0x2151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedb77fe700 1 -- 172.21.15.50:0/293458586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x203ccc0 con 0x1e3eeb0 2023-11-28T11:56:49.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fed95ffb700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:56:49.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedb77fe700 1 --2- 172.21.15.50:0/293458586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3eeb0 0x21088f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fedb0050630 tx=0x7fedb000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5285ad74c2685e11 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:49.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fed95ffb700 1 -- 172.21.15.50:0/293458586 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0082260 con 0x1e3eeb0 2023-11-28T11:56:49.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fed95ffb700 1 -- 172.21.15.50:0/293458586 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fedb0053620 con 0x1e3eeb0 2023-11-28T11:56:49.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 1 -- 172.21.15.50:0/293458586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fedb00820f0 con 0x1e3eeb0 2023-11-28T11:56:49.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fed95ffb700 1 -- 172.21.15.50:0/293458586 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedb00537e0 con 0x1e3eeb0 2023-11-28T11:56:49.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 10 client.6672 fetch_fsmap learned FSMap version 31 2023-11-28T11:56:49.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 1 -- 172.21.15.50:0/293458586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x1fc3a20 con 0x1e3eeb0 2023-11-28T11:56:49.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fed95ffb700 1 -- 172.21.15.50:0/293458586 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb00820f0 con 0x1e3eeb0 2023-11-28T11:56:49.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fed95ffb700 1 -- 172.21.15.50:0/293458586 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fedb005bd30 con 0x1e3eeb0 2023-11-28T11:56:49.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 10 client.6672 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T11:56:49.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 10 client.6672 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T11:56:49.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 20 client.6672 populate_metadata read hostname 'smithi050' 2023-11-28T11:56:49.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 1 --2- 172.21.15.50:0/293458586 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x1e89790 0x21093f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 4 client.6672 mds_command: new command op to 6510 tid=0[{"prefix": "status"}] 2023-11-28T11:56:49.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 1 -- 172.21.15.50:0/293458586 --> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1ebb260 con 0x1e89790 2023-11-28T11:56:49.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedb6ffd700 1 --2- 172.21.15.50:0/293458586 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x1e89790 0x21093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedb6ffd700 1 --2- 172.21.15.50:0/293458586 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x1e89790 0x21093f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=754876047b582b59 server_cookie=4093a1d0b67bc09b in_seq=0 out_seq=0 2023-11-28T11:56:49.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fed95ffb700 10 client.6672 ms_handle_connect on v2:172.21.15.50:6834/3894924751 2023-11-28T11:56:49.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fed95ffb700 1 -- 172.21.15.50:0/293458586 <== mds.0 v2:172.21.15.50:6834/3894924751 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x1ebb260 con 0x1e89790 2023-11-28T11:56:49.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fed95ffb700 10 client.6672 handle_command_reply: tid=0 2023-11-28T11:56:49.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 1 client.6672 shutdown 2023-11-28T11:56:49.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 1 -- 172.21.15.50:0/293458586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3eeb0 msgr2=0x21088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:49.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 1 --2- 172.21.15.50:0/293458586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3eeb0 0x21088f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fedb0050630 tx=0x7fedb000e000 comp rx=0 tx=0).stop 2023-11-28T11:56:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 1 -- 172.21.15.50:0/293458586 shutdown_connections 2023-11-28T11:56:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 1 --2- 172.21.15.50:0/293458586 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x1e89790 0x21093f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 1 --2- 172.21.15.50:0/293458586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1e3eeb0 0x21088f0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fed95ffb700 0 client.6672 ms_handle_reset on v2:172.21.15.50:6834/3894924751 2023-11-28T11:56:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 1 --2- 172.21.15.50:0/293458586 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1e3eae0 0x210b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 1 --2- 172.21.15.50:0/293458586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1e3e710 0x2151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.517+0000 7fedc06cb740 1 -- 172.21.15.50:0/293458586 >> 172.21.15.50:0/293458586 conn(0x20afa70 msgr2=0x20d5980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.521+0000 7fedc06cb740 1 -- 172.21.15.50:0/293458586 shutdown_connections 2023-11-28T11:56:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.521+0000 7fedc06cb740 1 -- 172.21.15.50:0/293458586 wait complete. 2023-11-28T11:56:49.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.521+0000 7fedc06cb740 20 client.6672 trim_cache size 0 max 16384 2023-11-28T11:56:49.529 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:56:49.529 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "cfe07b6e-9334-49cb-bc97-5dba7caa4ff8", 2023-11-28T11:56:49.529 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-11-28T11:56:49.529 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6510, 2023-11-28T11:56:49.529 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-11-28T11:56:49.529 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-11-28T11:56:49.529 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-11-28T11:56:49.529 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 9.1336822289999997, 2023-11-28T11:56:49.529 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 31, 2023-11-28T11:56:49.529 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 66, 2023-11-28T11:56:49.529 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 66, 2023-11-28T11:56:49.530 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 13.610974873 2023-11-28T11:56:49.530 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:56:49.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.521+0000 7fedb7fff700 1 -- 172.21.15.50:0/111468577 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fed98064f10 msgr2=0x7fed980673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:49.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.521+0000 7fedb7fff700 1 --2- 172.21.15.50:0/111468577 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fed98064f10 0x7fed980673c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fedb815ba40 tx=0x7feda0009040 comp rx=0 tx=0).stop 2023-11-28T11:56:49.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.521+0000 7fedb7fff700 1 -- 172.21.15.50:0/111468577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb8158bc0 msgr2=0x7fedb80c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:49.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.521+0000 7fedb7fff700 1 --2- 172.21.15.50:0/111468577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb8158bc0 0x7fedb80c8330 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fedb808ae30 tx=0x7fedb00111d0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.521+0000 7fedb7fff700 1 -- 172.21.15.50:0/111468577 shutdown_connections 2023-11-28T11:56:49.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.521+0000 7fedb7fff700 1 --2- 172.21.15.50:0/111468577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedb8158bc0 0x7fedb80c8330 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.521+0000 7fedb7fff700 1 --2- 172.21.15.50:0/111468577 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb81f4c30 0x7fedb80b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.521+0000 7fedb7fff700 1 --2- 172.21.15.50:0/111468577 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fed98064f10 0x7fed980673c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.521+0000 7fedb7fff700 1 --2- 172.21.15.50:0/111468577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feda4003fd0 0x7fedb80cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.521+0000 7fedb7fff700 1 -- 172.21.15.50:0/111468577 >> 172.21.15.50:0/111468577 conn(0x7fedb80b5740 msgr2=0x7fedb80cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:49.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.521+0000 7fedb7fff700 1 -- 172.21.15.50:0/111468577 shutdown_connections 2023-11-28T11:56:49.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.521+0000 7fedb7fff700 1 -- 172.21.15.50:0/111468577 wait complete. 2023-11-28T11:56:49.543 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T11:56:49.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.661+0000 7faf6759e700 1 Processor -- start 2023-11-28T11:56:49.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.661+0000 7faf6759e700 1 -- start start 2023-11-28T11:56:49.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6759e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faf6806a330 0x7faf680b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf680d2780 0x7faf680d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6759e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf680cf070 con 0x7faf680b1ca0 2023-11-28T11:56:49.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf680d3160 con 0x7faf680d2780 2023-11-28T11:56:49.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6759e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf680b2070 con 0x7faf6806a330 2023-11-28T11:56:49.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf66d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf680d2780 0x7faf680d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6659c700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7faf680b1ca0 0x7faf680cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:34734/0 (socket says 172.21.15.50:34734) 2023-11-28T11:56:49.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6659c700 1 -- 172.21.15.50:0/3708516122 learned_addr learned my addr 172.21.15.50:0/3708516122 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:49.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf65d9b700 1 --2- 172.21.15.50:0/3708516122 >> v2:172.21.15.192:3300/0 conn(0x7faf6806a330 0x7faf680b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf66d9d700 1 -- 172.21.15.50:0/3708516122 >> v2:172.21.15.192:3300/0 conn(0x7faf6806a330 msgr2=0x7faf680b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:49.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf66d9d700 1 --2- 172.21.15.50:0/3708516122 >> v2:172.21.15.192:3300/0 conn(0x7faf6806a330 0x7faf680b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf66d9d700 1 -- 172.21.15.50:0/3708516122 >> v1:172.21.15.192:6789/0 conn(0x7faf680b1ca0 legacy=0x7faf680cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:49.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6559a700 1 -- 172.21.15.50:0/3708516122 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466522974 0 0) 0x7faf680cf070 con 0x7faf680b1ca0 2023-11-28T11:56:49.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf66d9d700 1 -- 172.21.15.50:0/3708516122 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6806a8a0 con 0x7faf680d2780 2023-11-28T11:56:49.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf66d9d700 1 --2- 172.21.15.50:0/3708516122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf680d2780 0x7faf680d2c20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7faf6808ad10 tx=0x7faf6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c3175ac15bb9fc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:49.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6559a700 1 -- 172.21.15.50:0/3708516122 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6000e070 con 0x7faf680d2780 2023-11-28T11:56:49.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6559a700 1 -- 172.21.15.50:0/3708516122 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6000bb20 con 0x7faf680d2780 2023-11-28T11:56:49.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6559a700 1 -- 172.21.15.50:0/3708516122 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60012430 con 0x7faf680d2780 2023-11-28T11:56:49.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6759e700 1 -- 172.21.15.50:0/3708516122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf680d2780 msgr2=0x7faf680d2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:49.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6759e700 1 --2- 172.21.15.50:0/3708516122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf680d2780 0x7faf680d2c20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7faf6808ad10 tx=0x7faf6000b330 comp rx=0 tx=0).stop 2023-11-28T11:56:49.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6759e700 1 -- 172.21.15.50:0/3708516122 shutdown_connections 2023-11-28T11:56:49.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6759e700 1 --2- 172.21.15.50:0/3708516122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf680d2780 0x7faf680d2c20 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6759e700 1 --2- 172.21.15.50:0/3708516122 >> v2:172.21.15.192:3300/0 conn(0x7faf6806a330 0x7faf680b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6759e700 1 -- 172.21.15.50:0/3708516122 >> 172.21.15.50:0/3708516122 conn(0x7faf680b5740 msgr2=0x7faf680b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:49.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6759e700 1 -- 172.21.15.50:0/3708516122 shutdown_connections 2023-11-28T11:56:49.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.665+0000 7faf6759e700 1 -- 172.21.15.50:0/3708516122 wait complete. 2023-11-28T11:56:49.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.669+0000 7faf6759e700 1 Processor -- start 2023-11-28T11:56:49.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.669+0000 7faf6759e700 1 -- start start 2023-11-28T11:56:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.669+0000 7faf6759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf6806a330 0x7faf6815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.669+0000 7faf6759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf680b1ca0 0x7faf68157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.669+0000 7faf6759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf680d2780 0x7faf680b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.669+0000 7faf6759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf680c63d0 con 0x7faf6806a330 2023-11-28T11:56:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.669+0000 7faf6759e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf680c66b0 con 0x7faf680b1ca0 2023-11-28T11:56:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.669+0000 7faf6759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf680c6990 con 0x7faf680d2780 2023-11-28T11:56:49.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.669+0000 7faf6659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf6806a330 0x7faf6815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.669+0000 7faf6659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf6806a330 0x7faf6815f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48712/0 (socket says 172.21.15.50:48712) 2023-11-28T11:56:49.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.669+0000 7faf6659c700 1 -- 172.21.15.50:0/2495421718 learned_addr learned my addr 172.21.15.50:0/2495421718 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:49.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.669+0000 7faf65d9b700 1 --2- 172.21.15.50:0/2495421718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf680b1ca0 0x7faf68157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.669+0000 7faf66d9d700 1 --2- 172.21.15.50:0/2495421718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf680d2780 0x7faf680b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.673+0000 7faf6659c700 1 -- 172.21.15.50:0/2495421718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf680d2780 msgr2=0x7faf680b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:49.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.673+0000 7faf6659c700 1 --2- 172.21.15.50:0/2495421718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf680d2780 0x7faf680b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.673+0000 7faf6659c700 1 -- 172.21.15.50:0/2495421718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf680b1ca0 msgr2=0x7faf68157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:49.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.673+0000 7faf6659c700 1 --2- 172.21.15.50:0/2495421718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf680b1ca0 0x7faf68157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.673+0000 7faf6659c700 1 -- 172.21.15.50:0/2495421718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf60009a70 con 0x7faf6806a330 2023-11-28T11:56:49.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.673+0000 7faf65d9b700 1 --2- 172.21.15.50:0/2495421718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf680b1ca0 0x7faf68157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:56:49.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.673+0000 7faf6659c700 1 --2- 172.21.15.50:0/2495421718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf6806a330 0x7faf6815f0a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7faf5800c580 tx=0x7faf5800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:49.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.673+0000 7faf56ffd700 1 -- 172.21.15.50:0/2495421718 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58004ca0 con 0x7faf6806a330 2023-11-28T11:56:49.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.673+0000 7faf56ffd700 1 -- 172.21.15.50:0/2495421718 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf58004e20 con 0x7faf6806a330 2023-11-28T11:56:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.673+0000 7faf6759e700 1 -- 172.21.15.50:0/2495421718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6806ae60 con 0x7faf6806a330 2023-11-28T11:56:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.673+0000 7faf56ffd700 1 -- 172.21.15.50:0/2495421718 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58007310 con 0x7faf6806a330 2023-11-28T11:56:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.673+0000 7faf6759e700 1 -- 172.21.15.50:0/2495421718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6806ab80 con 0x7faf6806a330 2023-11-28T11:56:49.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.673+0000 7faf6759e700 1 -- 172.21.15.50:0/2495421718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6806b140 con 0x7faf6806a330 2023-11-28T11:56:49.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.673+0000 7faf56ffd700 1 -- 172.21.15.50:0/2495421718 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faf5801a020 con 0x7faf6806a330 2023-11-28T11:56:49.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.677+0000 7faf56ffd700 1 --2- 172.21.15.50:0/2495421718 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf48064ee0 0x7faf48067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:49.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.677+0000 7faf56ffd700 1 -- 172.21.15.50:0/2495421718 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7faf58081c20 con 0x7faf6806a330 2023-11-28T11:56:49.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.677+0000 7faf65d9b700 1 --2- 172.21.15.50:0/2495421718 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf48064ee0 0x7faf48067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:49.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.677+0000 7faf65d9b700 1 --2- 172.21.15.50:0/2495421718 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf48064ee0 0x7faf48067390 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7faf680c87e0 tx=0x7faf5c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:49.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.685+0000 7faf56ffd700 1 -- 172.21.15.50:0/2495421718 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faf5804fb30 con 0x7faf6806a330 2023-11-28T11:56:49.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.881+0000 7faf6759e700 1 -- 172.21.15.50:0/2495421718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faf680c6e80 con 0x7faf6806a330 2023-11-28T11:56:49.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.881+0000 7faf56ffd700 1 -- 172.21.15.50:0/2495421718 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7faf58053150 con 0x7faf6806a330 2023-11-28T11:56:49.887 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T11:56:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.885+0000 7faf6759e700 1 -- 172.21.15.50:0/2495421718 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf48064ee0 msgr2=0x7faf48067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.885+0000 7faf6759e700 1 --2- 172.21.15.50:0/2495421718 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf48064ee0 0x7faf48067390 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7faf680c87e0 tx=0x7faf5c009240 comp rx=0 tx=0).stop 2023-11-28T11:56:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.885+0000 7faf6759e700 1 -- 172.21.15.50:0/2495421718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf6806a330 msgr2=0x7faf6815f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:49.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.885+0000 7faf6759e700 1 --2- 172.21.15.50:0/2495421718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf6806a330 0x7faf6815f0a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7faf5800c580 tx=0x7faf5800c890 comp rx=0 tx=0).stop 2023-11-28T11:56:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.885+0000 7faf6759e700 1 -- 172.21.15.50:0/2495421718 shutdown_connections 2023-11-28T11:56:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.885+0000 7faf6759e700 1 --2- 172.21.15.50:0/2495421718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf680d2780 0x7faf680b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.885+0000 7faf6759e700 1 --2- 172.21.15.50:0/2495421718 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf48064ee0 0x7faf48067390 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.885+0000 7faf6759e700 1 --2- 172.21.15.50:0/2495421718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf680b1ca0 0x7faf68157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.885+0000 7faf6759e700 1 --2- 172.21.15.50:0/2495421718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf6806a330 0x7faf6815f0a0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.885+0000 7faf6759e700 1 -- 172.21.15.50:0/2495421718 >> 172.21.15.50:0/2495421718 conn(0x7faf680b5740 msgr2=0x7faf6815bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.885+0000 7faf6759e700 1 -- 172.21.15.50:0/2495421718 shutdown_connections 2023-11-28T11:56:49.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:49.885+0000 7faf6759e700 1 -- 172.21.15.50:0/2495421718 wait complete. 2023-11-28T11:56:49.901 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T11:56:49.901 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T11:56:49.901 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-11-28T11:56:49.901 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T11:56:49.901 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T11:56:49.902 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T11:56:49.902 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T11:56:49.902 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T11:56:49.902 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:56:49.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:49.902 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-11-28T11:56:49.908 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T11:56:49.908 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T11:56:49.908 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T11:56:49.908 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:49.908 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-11-28T11:56:49.908 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:49.908 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:56:49.908 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:56:49.908 INFO:teuthology.orchestra.run.smithi050.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T11:56:49.909 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:56:49.909 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T11:56:49.909 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42383sec preferred_lft 42383sec 2023-11-28T11:56:49.909 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2023-11-28T11:56:49.909 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:49.909 INFO:teuthology.orchestra.run.smithi050.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:56:49.909 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:56:49.909 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T11:56:49.909 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:56:49.909 INFO:teuthology.orchestra.run.smithi050.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T11:56:49.909 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 02:42:5d:90:5e:15 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:56:49.910 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T11:56:49.910 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:49.910 INFO:teuthology.orchestra.run.smithi050.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T11:56:49.910 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether da:3b:9e:d1:db:b2 brd ff:ff:ff:ff:ff:ff 2023-11-28T11:56:49.910 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T11:56:49.910 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:49.910 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::8086:d1ff:fed7:f4c8/64 scope link 2023-11-28T11:56:49.910 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:49.910 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:56:49.910 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether da:3b:9e:d1:db:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T11:56:49.910 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::d83b:9eff:fed1:dbb2/64 scope link 2023-11-28T11:56:49.910 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:49.911 INFO:teuthology.orchestra.run.smithi050.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T11:56:49.911 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether fa:16:94:5d:56:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T11:56:49.911 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f816:94ff:fe5d:5673/64 scope link 2023-11-28T11:56:49.911 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-11-28T11:56:49.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:49.911 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T11:56:49.926 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-11-28T11:56:49.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:49.928 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-11-28T11:56:49.981 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-11-28T11:56:49.981 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T11:56:49.982 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T11:56:49.982 INFO:teuthology.orchestra.run.smithi050.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T11:56:49.982 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T11:56:49.982 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T11:56:49.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:49.983 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-11-28T11:56:49.983 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-11-28T11:56:49.983 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T11:56:49.983 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T11:56:49.983 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T11:56:49.984 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-11-28T11:56:50.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:50.027 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-11-28T11:56:50.034 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T11:56:50.034 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T11:56:50.034 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:56:50.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:50.035 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-11-28T11:56:50.094 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T11:56:50.094 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:56:50.094 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T11:56:50.098 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T11:56:50.098 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T11:56:50.098 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:56:50.102 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:56:50.162 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:56:50.163 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:56:50.172 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:56:50.173 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:56:50.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:50.174 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:56:50.178 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T11:56:50.178 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-11-28T11:56:50.224 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:56:50.241 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:56:50.241 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:56:50.253 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:56:50.254 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:56:50.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:50.255 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:56:50.314 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:2023-11-28T11:56:50.309+0000 7f83aa750640 -1 init, newargv = 0x55aea1248670 newargc=15 2023-11-28T11:56:50.315 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[51563]: starting ceph client 2023-11-28T11:56:50.320 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[51563]: starting fuse 2023-11-28T11:56:51.407 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-11-28T11:56:51.424 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-28T11:56:51.424 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-28T11:56:51.483 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-28T11:56:51.484 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T11:56:51.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:51.485 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-11-28T11:56:51.489 INFO:teuthology.orchestra.run.smithi050.stdout:52 2023-11-28T11:56:51.489 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-11-28T11:56:51.490 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:56:51.490 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-11-28T11:56:51.490 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-11-28T11:56:51.490 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-11-28T11:56:51.490 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-11-28T11:56:51.490 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:56:51.490 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-11-28T11:56:51.490 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T11:56:51.490 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-11-28T11:56:51.490 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T11:56:51.491 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:56:51.491 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-11-28T11:56:51.491 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-11-28T11:56:51.491 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-11-28T11:56:51.491 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-11-28T11:56:51.491 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:56:51.491 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-11-28T11:56:51.491 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T11:56:51.491 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T11:56:51.491 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T11:56:51.491 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-11-28T11:56:51.491 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-11-28T11:56:51.492 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-11-28T11:56:51.492 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T11:56:51.492 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:56:51.492 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.0")) 2023-11-28T11:56:51.492 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-11-28T11:56:51.576 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.0.51563.asok 2023-11-28T11:56:51.761 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51563.asok 2023-11-28T11:56:51.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:51.761 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51563.asok status 2023-11-28T11:56:51.861 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:56:51.861 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-11-28T11:56:51.861 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "2f5f6028b893ad41357cd06e827373f0fe2a1232", 2023-11-28T11:56:51.861 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 18.0.0-2697-g2f5f6028 (2f5f6028b893ad41357cd06e827373f0fe2a1232) reef (dev)", 2023-11-28T11:56:51.861 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "0", 2023-11-28T11:56:51.861 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-11-28T11:56:51.861 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T11:56:51.861 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "51563", 2023-11-28T11:56:51.861 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-11-28T11:56:51.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:51.862 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-11-28T11:56:51.862 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-11-28T11:56:51.862 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6687, 2023-11-28T11:56:51.862 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-11-28T11:56:51.862 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-11-28T11:56:51.862 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-11-28T11:56:51.862 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 6687 2023-11-28T11:56:51.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:51.862 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-11-28T11:56:51.862 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-11-28T11:56:51.862 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:56:51.862 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1228128058 2023-11-28T11:56:51.862 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:51.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:51.863 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-11-28T11:56:51.863 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-11-28T11:56:51.863 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-11-28T11:56:51.863 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1228128058 2023-11-28T11:56:51.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:51.863 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.6687 192.168.0.1:0/1228128058", 2023-11-28T11:56:51.863 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/1228128058", 2023-11-28T11:56:51.863 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-11-28T11:56:51.863 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 31, 2023-11-28T11:56:51.863 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 66, 2023-11-28T11:56:51.863 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-11-28T11:56:51.864 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-11-28T11:56:51.864 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-11-28T11:56:51.864 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:56:51.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:51.870 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-11-28T11:56:51.871 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T11:56:51.879 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-11-28T11:56:51.879 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T11:56:51.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:51.879 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T11:56:51.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:51.893 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2023-11-28T11:56:51.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:56:51.913 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2023-11-28T11:56:51.925 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T11:56:51.925 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-11-28T11:56:51.926 DEBUG:teuthology.orchestra.run.smithi050:> import stat 2023-11-28T11:56:51.926 DEBUG:teuthology.orchestra.run.smithi050:> 2023-11-28T11:56:51.926 DEBUG:teuthology.orchestra.run.smithi050:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2023-11-28T11:56:51.926 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-11-28T11:56:51.993 INFO:teuthology.orchestra.run.smithi050.stdout:1099511627777 2023-11-28T11:56:52.183 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:56:52.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.344+0000 7f20291da700 1 Processor -- start 2023-11-28T11:56:52.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.344+0000 7f20291da700 1 -- start start 2023-11-28T11:56:52.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.344+0000 7f20291da700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f20241606b0 0x7f20240c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.344+0000 7f20291da700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20240ceef0 0x7f20240c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.344+0000 7f20291da700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f20240ad610 0x7f2024164040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.344+0000 7f20291da700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20240cae70 con 0x7f20240ad610 2023-11-28T11:56:52.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.344+0000 7f20291da700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20240cbc10 con 0x7f20241606b0 2023-11-28T11:56:52.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.344+0000 7f20291da700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20240cb130 con 0x7f20240ceef0 2023-11-28T11:56:52.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.344+0000 7f20289d9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f20240ad610 0x7f2024164040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.344+0000 7f20289d9700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f20240ad610 0x7f2024164040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35336/0 (socket says 172.21.15.50:35336) 2023-11-28T11:56:52.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.344+0000 7f20289d9700 1 -- 172.21.15.50:0/3074864478 learned_addr learned my addr 172.21.15.50:0/3074864478 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:52.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.344+0000 7f20237fe700 1 --2- 172.21.15.50:0/3074864478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20240ceef0 0x7f20240c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f2023fff700 1 --2- 172.21.15.50:0/3074864478 >> v2:172.21.15.192:3300/0 conn(0x7f20241606b0 0x7f20240c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f20289d9700 1 -- 172.21.15.50:0/3074864478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20240ceef0 msgr2=0x7f20240c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:52.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f20289d9700 1 --2- 172.21.15.50:0/3074864478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20240ceef0 0x7f20240c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f20289d9700 1 -- 172.21.15.50:0/3074864478 >> v2:172.21.15.192:3300/0 conn(0x7f20241606b0 msgr2=0x7f20240c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:52.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f20289d9700 1 --2- 172.21.15.50:0/3074864478 >> v2:172.21.15.192:3300/0 conn(0x7f20241606b0 0x7f20240c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f20289d9700 1 -- 172.21.15.50:0/3074864478 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20240cb410 con 0x7f20240ad610 2023-11-28T11:56:52.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f20289d9700 1 --2- 172.21.15.50:0/3074864478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20240ad610 0x7f2024164040 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f20240b34a0 tx=0x7f201c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9aa78cc071aae51 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f2022ffd700 1 -- 172.21.15.50:0/3074864478 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c011830 con 0x7f20240ad610 2023-11-28T11:56:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f2022ffd700 1 -- 172.21.15.50:0/3074864478 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c011990 con 0x7f20240ad610 2023-11-28T11:56:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f2022ffd700 1 -- 172.21.15.50:0/3074864478 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c011d20 con 0x7f20240ad610 2023-11-28T11:56:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f20291da700 1 -- 172.21.15.50:0/3074864478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20240ad610 msgr2=0x7f2024164040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f20291da700 1 --2- 172.21.15.50:0/3074864478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20240ad610 0x7f2024164040 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f20240b34a0 tx=0x7f201c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f20291da700 1 -- 172.21.15.50:0/3074864478 shutdown_connections 2023-11-28T11:56:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f20291da700 1 --2- 172.21.15.50:0/3074864478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20240ad610 0x7f2024164040 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f20291da700 1 --2- 172.21.15.50:0/3074864478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20240ceef0 0x7f20240c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f20291da700 1 --2- 172.21.15.50:0/3074864478 >> v2:172.21.15.192:3300/0 conn(0x7f20241606b0 0x7f20240c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f20291da700 1 -- 172.21.15.50:0/3074864478 >> 172.21.15.50:0/3074864478 conn(0x7f20240ce3e0 msgr2=0x7f20240ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f20291da700 1 -- 172.21.15.50:0/3074864478 shutdown_connections 2023-11-28T11:56:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.348+0000 7f20291da700 1 -- 172.21.15.50:0/3074864478 wait complete. 2023-11-28T11:56:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f20291da700 1 Processor -- start 2023-11-28T11:56:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f20291da700 1 -- start start 2023-11-28T11:56:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f20291da700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20240ad610 0x7f202415d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f20291da700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20240ceef0 0x7f20241f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f20291da700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20241606b0 0x7f20240c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f20291da700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2024155d50 con 0x7f20241606b0 2023-11-28T11:56:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f20291da700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202415dae0 con 0x7f20240ceef0 2023-11-28T11:56:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f20291da700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20241f9bc0 con 0x7f20240ad610 2023-11-28T11:56:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f20289d9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20241606b0 0x7f20240c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f2023fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20240ad610 0x7f202415d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f20237fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20240ceef0 0x7f20241f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f2023fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20240ad610 0x7f202415d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:36524/0 (socket says 172.21.15.50:36524) 2023-11-28T11:56:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f2023fff700 1 -- 172.21.15.50:0/2826121572 learned_addr learned my addr 172.21.15.50:0/2826121572 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f20289d9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20241606b0 0x7f20240c37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35346/0 (socket says 172.21.15.50:35346) 2023-11-28T11:56:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f2023fff700 1 -- 172.21.15.50:0/2826121572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20240ceef0 msgr2=0x7f20241f4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f2023fff700 1 --2- 172.21.15.50:0/2826121572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20240ceef0 0x7f20241f4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f2023fff700 1 -- 172.21.15.50:0/2826121572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20241606b0 msgr2=0x7f20240c37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f2023fff700 1 --2- 172.21.15.50:0/2826121572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20241606b0 0x7f20240c37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f2023fff700 1 -- 172.21.15.50:0/2826121572 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c009570 con 0x7f20240ad610 2023-11-28T11:56:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f2023fff700 1 --2- 172.21.15.50:0/2826121572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20240ad610 0x7f202415d5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f201800e840 tx=0x7f201800eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f2020ff9700 1 -- 172.21.15.50:0/2826121572 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20180095a0 con 0x7f20240ad610 2023-11-28T11:56:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f2020ff9700 1 -- 172.21.15.50:0/2826121572 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2018013680 con 0x7f20240ad610 2023-11-28T11:56:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f20291da700 1 -- 172.21.15.50:0/2826121572 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20240b36c0 con 0x7f20240ad610 2023-11-28T11:56:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f2020ff9700 1 -- 172.21.15.50:0/2826121572 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20180139f0 con 0x7f20240ad610 2023-11-28T11:56:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.352+0000 7f20291da700 1 -- 172.21.15.50:0/2826121572 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20240cb6f0 con 0x7f20240ad610 2023-11-28T11:56:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.356+0000 7f20291da700 1 -- 172.21.15.50:0/2826121572 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2024164580 con 0x7f20240ad610 2023-11-28T11:56:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.356+0000 7f2020ff9700 1 -- 172.21.15.50:0/2826121572 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2018019030 con 0x7f20240ad610 2023-11-28T11:56:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.356+0000 7f2020ff9700 1 --2- 172.21.15.50:0/2826121572 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2010064ee0 0x7f2010067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.356+0000 7f2020ff9700 1 -- 172.21.15.50:0/2826121572 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2018082520 con 0x7f20240ad610 2023-11-28T11:56:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.356+0000 7f20237fe700 1 --2- 172.21.15.50:0/2826121572 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2010064ee0 0x7f2010067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.360+0000 7f20237fe700 1 --2- 172.21.15.50:0/2826121572 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2010064ee0 0x7f2010067390 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f202406d340 tx=0x7f201400d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.364+0000 7f2020ff9700 1 -- 172.21.15.50:0/2826121572 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2018053f40 con 0x7f20240ad610 2023-11-28T11:56:52.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.564+0000 7f20291da700 1 -- 172.21.15.50:0/2826121572 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2024072500 con 0x7f20240ad610 2023-11-28T11:56:52.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.568+0000 7f2020ff9700 1 -- 172.21.15.50:0/2826121572 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f2018053b30 con 0x7f20240ad610 2023-11-28T11:56:52.572 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:52.572 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1573599194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1573599194},{"type":"v1","addr":"172.21.15.192:6836","nonce":1573599194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6445,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/983935617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":983935617},{"type":"v1","addr":"172.21.15.192:6837","nonce":983935617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2516263109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2516263109},{"type":"v1","addr":"172.21.15.50:6833","nonce":2516263109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:56:40.385672+0000","modified":"2023-11-28T11:56:42.402645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/3894924751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3894924751},{"type":"v1","addr":"172.21.15.50:6835","nonce":3894924751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:56:52.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.568+0000 7f20291da700 1 -- 172.21.15.50:0/2826121572 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2010064ee0 msgr2=0x7f2010067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.568+0000 7f20291da700 1 --2- 172.21.15.50:0/2826121572 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2010064ee0 0x7f2010067390 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f202406d340 tx=0x7f201400d040 comp rx=0 tx=0).stop 2023-11-28T11:56:52.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.568+0000 7f20291da700 1 -- 172.21.15.50:0/2826121572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20240ad610 msgr2=0x7f202415d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.568+0000 7f20291da700 1 --2- 172.21.15.50:0/2826121572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20240ad610 0x7f202415d5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f201800e840 tx=0x7f201800eb50 comp rx=0 tx=0).stop 2023-11-28T11:56:52.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.568+0000 7f20291da700 1 -- 172.21.15.50:0/2826121572 shutdown_connections 2023-11-28T11:56:52.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.568+0000 7f20291da700 1 --2- 172.21.15.50:0/2826121572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20241606b0 0x7f20240c37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.568+0000 7f20291da700 1 --2- 172.21.15.50:0/2826121572 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2010064ee0 0x7f2010067390 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.568+0000 7f20291da700 1 --2- 172.21.15.50:0/2826121572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20240ceef0 0x7f20241f4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.568+0000 7f20291da700 1 --2- 172.21.15.50:0/2826121572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20240ad610 0x7f202415d5a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.568+0000 7f20291da700 1 -- 172.21.15.50:0/2826121572 >> 172.21.15.50:0/2826121572 conn(0x7f20240ce3e0 msgr2=0x7f202406fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:52.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.568+0000 7f20291da700 1 -- 172.21.15.50:0/2826121572 shutdown_connections 2023-11-28T11:56:52.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.568+0000 7f20291da700 1 -- 172.21.15.50:0/2826121572 wait complete. 2023-11-28T11:56:52.576 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 31 2023-11-28T11:56:52.588 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-11-28T11:56:52.721 INFO:teuthology.orchestra.run.smithi050.stdout:{"message":"","return_code":0} 2023-11-28T11:56:52.722 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T11:56:52.722 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-28T11:56:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.760+0000 7fbe099a3140 1 Processor -- start 2023-11-28T11:56:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.760+0000 7fbe099a3140 1 -- start start 2023-11-28T11:56:52.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.760+0000 7fbe099a3140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f304d96160 0x55f304d933e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.760+0000 7fbe099a3140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55f304e09970 0x55f304d91570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.760+0000 7fbe099a3140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f304e09d40 0x55f304d91ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.760+0000 7fbe099a3140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f304c73240 con 0x55f304e09d40 2023-11-28T11:56:52.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.760+0000 7fbe099a3140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f304e24580 con 0x55f304d96160 2023-11-28T11:56:52.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.760+0000 7fbe099a3140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f304d7b040 con 0x55f304e09970 2023-11-28T11:56:52.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.760+0000 7fbe07cd9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f304e09d40 0x55f304d91ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.760+0000 7fbe07cd9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f304e09d40 0x55f304d91ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35374/0 (socket says 172.21.15.50:35374) 2023-11-28T11:56:52.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.760+0000 7fbdfecd7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55f304e09970 0x55f304d91570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.760+0000 7fbe07cd9700 1 -- 172.21.15.50:0/1658118403 learned_addr learned my addr 172.21.15.50:0/1658118403 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:52.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.760+0000 7fbe074d8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f304d96160 0x55f304d933e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.760+0000 7fbe07cd9700 1 -- 172.21.15.50:0/1658118403 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55f304e09970 msgr2=0x55f304d91570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:52.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.760+0000 7fbe07cd9700 1 --2- 172.21.15.50:0/1658118403 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55f304e09970 0x55f304d91570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.760+0000 7fbe07cd9700 1 -- 172.21.15.50:0/1658118403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f304d96160 msgr2=0x55f304d933e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:52.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.760+0000 7fbe07cd9700 1 --2- 172.21.15.50:0/1658118403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f304d96160 0x55f304d933e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.764+0000 7fbe07cd9700 1 -- 172.21.15.50:0/1658118403 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf0005de0 con 0x55f304e09d40 2023-11-28T11:56:52.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.764+0000 7fbe07cd9700 1 --2- 172.21.15.50:0/1658118403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f304e09d40 0x55f304d91ab0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fbe000014a0 tx=0x7fbe000017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18abd3da0f1425f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.764+0000 7fbe064d6700 1 -- 172.21.15.50:0/1658118403 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe000115f0 con 0x55f304e09d40 2023-11-28T11:56:52.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.764+0000 7fbe064d6700 1 -- 172.21.15.50:0/1658118403 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe00011770 con 0x55f304e09d40 2023-11-28T11:56:52.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.764+0000 7fbe064d6700 1 -- 172.21.15.50:0/1658118403 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00011b20 con 0x55f304e09d40 2023-11-28T11:56:52.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.764+0000 7fbe099a3140 1 -- 172.21.15.50:0/1658118403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f304e09d40 msgr2=0x55f304d91ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.764+0000 7fbe099a3140 1 --2- 172.21.15.50:0/1658118403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f304e09d40 0x55f304d91ab0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fbe000014a0 tx=0x7fbe000017b0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.764+0000 7fbe099a3140 1 -- 172.21.15.50:0/1658118403 shutdown_connections 2023-11-28T11:56:52.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.764+0000 7fbe099a3140 1 --2- 172.21.15.50:0/1658118403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f304e09d40 0x55f304d91ab0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.764+0000 7fbe099a3140 1 --2- 172.21.15.50:0/1658118403 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55f304e09970 0x55f304d91570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.764+0000 7fbe099a3140 1 --2- 172.21.15.50:0/1658118403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f304d96160 0x55f304d933e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.764+0000 7fbe099a3140 1 -- 172.21.15.50:0/1658118403 >> 172.21.15.50:0/1658118403 conn(0x55f304d76fb0 msgr2=0x55f304d4f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:52.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.764+0000 7fbe099a3140 1 -- 172.21.15.50:0/1658118403 shutdown_connections 2023-11-28T11:56:52.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.764+0000 7fbe099a3140 1 -- 172.21.15.50:0/1658118403 wait complete. 2023-11-28T11:56:52.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.764+0000 7fbe099a3140 1 Processor -- start 2023-11-28T11:56:52.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.764+0000 7fbe099a3140 1 -- start start 2023-11-28T11:56:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe099a3140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f304d96160 0x55f304e07990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe099a3140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f304e09970 0x55f304d71640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe099a3140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55f304e09d40 0x55f304d7a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe099a3140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f304e23560 con 0x55f304d96160 2023-11-28T11:56:52.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe099a3140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f304e07ed0 con 0x55f304e09970 2023-11-28T11:56:52.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe099a3140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f304d720d0 con 0x55f304e09d40 2023-11-28T11:56:52.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe074d8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f304d96160 0x55f304e07990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe074d8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f304d96160 0x55f304e07990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35378/0 (socket says 172.21.15.50:35378) 2023-11-28T11:56:52.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe074d8700 1 -- 172.21.15.50:0/1770966215 learned_addr learned my addr 172.21.15.50:0/1770966215 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:52.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe07cd9700 1 --2- 172.21.15.50:0/1770966215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55f304e09d40 0x55f304d7a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbdfecd7700 1 --2- 172.21.15.50:0/1770966215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f304e09970 0x55f304d71640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe074d8700 1 -- 172.21.15.50:0/1770966215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55f304e09d40 msgr2=0x55f304d7a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe074d8700 1 --2- 172.21.15.50:0/1770966215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55f304e09d40 0x55f304d7a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe074d8700 1 -- 172.21.15.50:0/1770966215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f304e09970 msgr2=0x55f304d71640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe074d8700 1 --2- 172.21.15.50:0/1770966215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f304e09970 0x55f304d71640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe074d8700 1 -- 172.21.15.50:0/1770966215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f304c7e520 con 0x55f304d96160 2023-11-28T11:56:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe074d8700 1 --2- 172.21.15.50:0/1770966215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f304d96160 0x55f304e07990 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8008400 tx=0x7fbdf80087c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe054d4700 1 -- 172.21.15.50:0/1770966215 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8011040 con 0x55f304d96160 2023-11-28T11:56:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe054d4700 1 -- 172.21.15.50:0/1770966215 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf8006790 con 0x55f304d96160 2023-11-28T11:56:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe099a3140 1 -- 172.21.15.50:0/1770966215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f304c8b390 con 0x55f304d96160 2023-11-28T11:56:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe054d4700 1 -- 172.21.15.50:0/1770966215 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8006b00 con 0x55f304d96160 2023-11-28T11:56:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.768+0000 7fbe099a3140 1 -- 172.21.15.50:0/1770966215 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f304c7e8b0 con 0x55f304d96160 2023-11-28T11:56:52.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.772+0000 7fbe054d4700 1 -- 172.21.15.50:0/1770966215 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbdf8006c60 con 0x55f304d96160 2023-11-28T11:56:52.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.772+0000 7fbe054d4700 1 --2- 172.21.15.50:0/1770966215 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbde8063840 0x7fbde8065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.772+0000 7fbe054d4700 1 -- 172.21.15.50:0/1770966215 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbdf8080a70 con 0x55f304d96160 2023-11-28T11:56:52.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.772+0000 7fbdfecd7700 1 --2- 172.21.15.50:0/1770966215 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbde8063840 0x7fbde8065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.772+0000 7fbe099a3140 1 --2- 172.21.15.50:0/1770966215 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x55f304d71b80 0x55f304d74760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.772+0000 7fbe099a3140 1 -- 172.21.15.50:0/1770966215 --> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] -- osd_op(unknown.0.0:1 11.7 11:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v8 -- 0x55f304d74ca0 con 0x55f304d71b80 2023-11-28T11:56:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.776+0000 7fbe07cd9700 1 --2- 172.21.15.50:0/1770966215 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x55f304d71b80 0x55f304d74760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.776+0000 7fbdfecd7700 1 --2- 172.21.15.50:0/1770966215 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbde8063840 0x7fbde8065cf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000af80 tx=0x7fbdf000f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.776+0000 7fbe07cd9700 1 --2- 172.21.15.50:0/1770966215 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x55f304d71b80 0x55f304d74760 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.776+0000 7fbe07cd9700 1 -- 172.21.15.50:0/1770966215 <== osd.5 v2:172.21.15.192:6802/36817 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+94 (crc 0 0 0) 0x7fbe00011470 con 0x55f304d71b80 2023-11-28T11:56:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.776+0000 7fbe099a3140 1 -- 172.21.15.50:0/1770966215 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x55f304d71b80 msgr2=0x55f304d74760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.776+0000 7fbe099a3140 1 --2- 172.21.15.50:0/1770966215 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x55f304d71b80 0x55f304d74760 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.776+0000 7fbe099a3140 1 -- 172.21.15.50:0/1770966215 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbde8063840 msgr2=0x7fbde8065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.776+0000 7fbe099a3140 1 --2- 172.21.15.50:0/1770966215 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbde8063840 0x7fbde8065cf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000af80 tx=0x7fbdf000f000 comp rx=0 tx=0).stop 2023-11-28T11:56:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.776+0000 7fbe099a3140 1 -- 172.21.15.50:0/1770966215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f304d96160 msgr2=0x55f304e07990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.776+0000 7fbe099a3140 1 --2- 172.21.15.50:0/1770966215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f304d96160 0x55f304e07990 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8008400 tx=0x7fbdf80087c0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.776+0000 7fbe07cd9700 1 -- 172.21.15.50:0/1770966215 reap_dead start 2023-11-28T11:56:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.776+0000 7fbe099a3140 1 -- 172.21.15.50:0/1770966215 shutdown_connections 2023-11-28T11:56:52.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.776+0000 7fbe099a3140 1 -- 172.21.15.50:0/1770966215 >> 172.21.15.50:0/1770966215 conn(0x55f304d76fb0 msgr2=0x55f304d95840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.776+0000 7fbe099a3140 1 -- 172.21.15.50:0/1770966215 shutdown_connections 2023-11-28T11:56:52.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.776+0000 7fbe099a3140 1 -- 172.21.15.50:0/1770966215 wait complete. 2023-11-28T11:56:52.784 INFO:teuthology.orchestra.run.smithi050.stdout:Xfiledir_test 2023-11-28T11:56:52.785 DEBUG:teuthology.orchestra.run.smithi050:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-28T11:56:52.847 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:56:52.847 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511627777, 2023-11-28T11:56:52.847 INFO:teuthology.orchestra.run.smithi050.stdout: "ancestors": [ 2023-11-28T11:56:52.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:52.847 INFO:teuthology.orchestra.run.smithi050.stdout: "dirino": 1099511627776, 2023-11-28T11:56:52.847 INFO:teuthology.orchestra.run.smithi050.stdout: "dname": "file", 2023-11-28T11:56:52.847 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 2 2023-11-28T11:56:52.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-11-28T11:56:52.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:56:52.848 INFO:teuthology.orchestra.run.smithi050.stdout: "dirino": 1, 2023-11-28T11:56:52.848 INFO:teuthology.orchestra.run.smithi050.stdout: "dname": "dir_test", 2023-11-28T11:56:52.848 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 4 2023-11-28T11:56:52.848 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:52.848 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2023-11-28T11:56:52.848 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 11, 2023-11-28T11:56:52.848 INFO:teuthology.orchestra.run.smithi050.stdout: "old_pools": [] 2023-11-28T11:56:52.848 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:56:52.848 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:56:52.850 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2023-11-28T11:56:52.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0013f2b140 1 Processor -- start 2023-11-28T11:56:52.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0013f2b140 1 -- start start 2023-11-28T11:56:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0013f2b140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5601618df6d0 0x56016196e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0013f2b140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560161987590 0x5601618fb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0013f2b140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560161987960 0x5601618fbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0013f2b140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601617d7240 con 0x560161987960 2023-11-28T11:56:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0013f2b140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56016196eeb0 con 0x560161987590 2023-11-28T11:56:52.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0013f2b140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5601618b0470 con 0x5601618df6d0 2023-11-28T11:56:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0012261700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560161987960 0x5601618fbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0012261700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560161987960 0x5601618fbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35386/0 (socket says 172.21.15.50:35386) 2023-11-28T11:56:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0012261700 1 -- 172.21.15.50:0/2394322193 learned_addr learned my addr 172.21.15.50:0/2394322193 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0011a60700 1 --2- 172.21.15.50:0/2394322193 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5601618df6d0 0x56016196e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f001125f700 1 --2- 172.21.15.50:0/2394322193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560161987590 0x5601618fb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0012261700 1 -- 172.21.15.50:0/2394322193 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5601618df6d0 msgr2=0x56016196e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0012261700 1 --2- 172.21.15.50:0/2394322193 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5601618df6d0 0x56016196e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0012261700 1 -- 172.21.15.50:0/2394322193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560161987590 msgr2=0x5601618fb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0012261700 1 --2- 172.21.15.50:0/2394322193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560161987590 0x5601618fb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0012261700 1 -- 172.21.15.50:0/2394322193 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c00a1c0 con 0x560161987960 2023-11-28T11:56:52.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0012261700 1 --2- 172.21.15.50:0/2394322193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560161987960 0x5601618fbb20 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7efffc00a5c0 tx=0x7efffc00a8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac18b5ee64406029 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f000bfff700 1 -- 172.21.15.50:0/2394322193 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc00f070 con 0x560161987960 2023-11-28T11:56:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f000bfff700 1 -- 172.21.15.50:0/2394322193 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc007600 con 0x560161987960 2023-11-28T11:56:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f000bfff700 1 -- 172.21.15.50:0/2394322193 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc007990 con 0x560161987960 2023-11-28T11:56:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0013f2b140 1 -- 172.21.15.50:0/2394322193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560161987960 msgr2=0x5601618fbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0013f2b140 1 --2- 172.21.15.50:0/2394322193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560161987960 0x5601618fbb20 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7efffc00a5c0 tx=0x7efffc00a8d0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0013f2b140 1 -- 172.21.15.50:0/2394322193 shutdown_connections 2023-11-28T11:56:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0013f2b140 1 --2- 172.21.15.50:0/2394322193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560161987960 0x5601618fbb20 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0013f2b140 1 --2- 172.21.15.50:0/2394322193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560161987590 0x5601618fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0013f2b140 1 --2- 172.21.15.50:0/2394322193 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5601618df6d0 0x56016196e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.884+0000 7f0013f2b140 1 -- 172.21.15.50:0/2394322193 >> 172.21.15.50:0/2394322193 conn(0x5601618de2c0 msgr2=0x560161987d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0013f2b140 1 -- 172.21.15.50:0/2394322193 shutdown_connections 2023-11-28T11:56:52.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0013f2b140 1 -- 172.21.15.50:0/2394322193 wait complete. 2023-11-28T11:56:52.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0013f2b140 1 Processor -- start 2023-11-28T11:56:52.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0013f2b140 1 -- start start 2023-11-28T11:56:52.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0013f2b140 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5601618df6d0 0x5601618dd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0013f2b140 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560161987590 0x560161989dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0013f2b140 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560161987960 0x56016196df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0013f2b140 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601618b0a00 con 0x5601618df6d0 2023-11-28T11:56:52.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0013f2b140 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601618dd900 con 0x560161987590 2023-11-28T11:56:52.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0013f2b140 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5601618f46b0 con 0x560161987960 2023-11-28T11:56:52.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0011a60700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5601618df6d0 0x5601618dd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0011a60700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5601618df6d0 0x5601618dd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35394/0 (socket says 172.21.15.50:35394) 2023-11-28T11:56:52.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0011a60700 1 -- 172.21.15.50:0/1957612339 learned_addr learned my addr 172.21.15.50:0/1957612339 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:52.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0012261700 1 --2- 172.21.15.50:0/1957612339 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560161987960 0x56016196df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f001125f700 1 --2- 172.21.15.50:0/1957612339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560161987590 0x560161989dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0011a60700 1 -- 172.21.15.50:0/1957612339 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560161987960 msgr2=0x56016196df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0011a60700 1 --2- 172.21.15.50:0/1957612339 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560161987960 0x56016196df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0011a60700 1 -- 172.21.15.50:0/1957612339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560161987590 msgr2=0x560161989dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0011a60700 1 --2- 172.21.15.50:0/1957612339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560161987590 0x560161989dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.888+0000 7f0011a60700 1 -- 172.21.15.50:0/1957612339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc005e20 con 0x5601618df6d0 2023-11-28T11:56:52.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.892+0000 7f0011a60700 1 --2- 172.21.15.50:0/1957612339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5601618df6d0 0x5601618dd310 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f0004002d10 tx=0x7f000400c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.892+0000 7f000affd700 1 -- 172.21.15.50:0/1957612339 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004002bb0 con 0x5601618df6d0 2023-11-28T11:56:52.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.892+0000 7f000affd700 1 -- 172.21.15.50:0/1957612339 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0004008030 con 0x5601618df6d0 2023-11-28T11:56:52.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.892+0000 7f0013f2b140 1 -- 172.21.15.50:0/1957612339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5601617ef390 con 0x5601618df6d0 2023-11-28T11:56:52.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.892+0000 7f000affd700 1 -- 172.21.15.50:0/1957612339 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004011450 con 0x5601618df6d0 2023-11-28T11:56:52.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.892+0000 7f0013f2b140 1 -- 172.21.15.50:0/1957612339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5601617e28b0 con 0x5601618df6d0 2023-11-28T11:56:52.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.892+0000 7f000affd700 1 -- 172.21.15.50:0/1957612339 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0004021070 con 0x5601618df6d0 2023-11-28T11:56:52.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.892+0000 7f000affd700 1 --2- 172.21.15.50:0/1957612339 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efff4063810 0x7efff4065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.892+0000 7f000affd700 1 -- 172.21.15.50:0/1957612339 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0004080c40 con 0x5601618df6d0 2023-11-28T11:56:52.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.892+0000 7f001125f700 1 --2- 172.21.15.50:0/1957612339 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efff4063810 0x7efff4065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.892+0000 7f0013f2b140 1 --2- 172.21.15.50:0/1957612339 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x5601618f6340 0x560161a28f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:52.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.892+0000 7f0013f2b140 1 -- 172.21.15.50:0/1957612339 --> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] -- osd_op(unknown.0.0:1 11.7 11:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v8 -- 0x560161a294a0 con 0x5601618f6340 2023-11-28T11:56:52.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.896+0000 7f0012261700 1 --2- 172.21.15.50:0/1957612339 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x5601618f6340 0x560161a28f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:52.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.896+0000 7f001125f700 1 --2- 172.21.15.50:0/1957612339 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efff4063810 0x7efff4065cc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f000c013040 tx=0x7f000c007030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.896+0000 7f0012261700 1 --2- 172.21.15.50:0/1957612339 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x5601618f6340 0x560161a28f60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:52.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.896+0000 7f0012261700 1 -- 172.21.15.50:0/1957612339 <== osd.5 v2:172.21.15.192:6802/36817 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v66'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7efffc007af0 con 0x5601618f6340 2023-11-28T11:56:52.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.896+0000 7f0013f2b140 1 -- 172.21.15.50:0/1957612339 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x5601618f6340 msgr2=0x560161a28f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.896+0000 7f0013f2b140 1 --2- 172.21.15.50:0/1957612339 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x5601618f6340 0x560161a28f60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:52.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.896+0000 7f0013f2b140 1 -- 172.21.15.50:0/1957612339 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efff4063810 msgr2=0x7efff4065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.896+0000 7f0013f2b140 1 --2- 172.21.15.50:0/1957612339 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efff4063810 0x7efff4065cc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f000c013040 tx=0x7f000c007030 comp rx=0 tx=0).stop 2023-11-28T11:56:52.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.896+0000 7f0013f2b140 1 -- 172.21.15.50:0/1957612339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5601618df6d0 msgr2=0x5601618dd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:52.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.896+0000 7f0013f2b140 1 --2- 172.21.15.50:0/1957612339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5601618df6d0 0x5601618dd310 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f0004002d10 tx=0x7f000400c530 comp rx=0 tx=0).stop 2023-11-28T11:56:52.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.896+0000 7f0012261700 1 -- 172.21.15.50:0/1957612339 reap_dead start 2023-11-28T11:56:52.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.896+0000 7f0013f2b140 1 -- 172.21.15.50:0/1957612339 shutdown_connections 2023-11-28T11:56:52.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.900+0000 7f0013f2b140 1 -- 172.21.15.50:0/1957612339 >> 172.21.15.50:0/1957612339 conn(0x5601618de2c0 msgr2=0x5601618fb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:52.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.900+0000 7f0013f2b140 1 -- 172.21.15.50:0/1957612339 shutdown_connections 2023-11-28T11:56:52.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:52.900+0000 7f0013f2b140 1 -- 172.21.15.50:0/1957612339 wait complete. 2023-11-28T11:56:52.907 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2023-11-28T11:56:53.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.080+0000 7f296ee82700 1 Processor -- start 2023-11-28T11:56:53.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.080+0000 7f296ee82700 1 -- start start 2023-11-28T11:56:53.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.080+0000 7f296ee82700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f29680cb520 0x7f2968163b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.080+0000 7f296ee82700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29680ce040 con 0x7f296806b250 2023-11-28T11:56:53.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.080+0000 7f296ee82700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29680c9460 con 0x7f2968158f10 2023-11-28T11:56:53.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.080+0000 7f296ee82700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29680c9fe0 con 0x7f29680cb520 2023-11-28T11:56:53.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296d67f700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f296806b250 0x7f29680cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56968/0 (socket says 172.21.15.50:56968) 2023-11-28T11:56:53.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296d67f700 1 -- 172.21.15.50:0/1162360953 learned_addr learned my addr 172.21.15.50:0/1162360953 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:56:53.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296e681700 1 --2- 172.21.15.50:0/1162360953 >> v2:172.21.15.192:3300/0 conn(0x7f29680cb520 0x7f2968163b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296ce7e700 1 -- 172.21.15.50:0/1162360953 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789158834 0 0) 0x7f2958001110 con 0x7f296806b250 2023-11-28T11:56:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296ce7e700 1 -- 172.21.15.50:0/1162360953 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29540035d0 con 0x7f296806b250 2023-11-28T11:56:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296e681700 1 -- 172.21.15.50:0/1162360953 >> v1:172.21.15.192:6789/0 conn(0x7f2968158f10 legacy=0x7f29680cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296e681700 1 -- 172.21.15.50:0/1162360953 >> v1:172.21.15.50:6789/0 conn(0x7f296806b250 legacy=0x7f29680cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296e681700 1 -- 172.21.15.50:0/1162360953 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296806dc90 con 0x7f29680cb520 2023-11-28T11:56:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296e681700 1 --2- 172.21.15.50:0/1162360953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29680cb520 0x7f2968163b50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2960009850 tx=0x7f2960009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc913a6e72e4d1c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296ce7e700 1 -- 172.21.15.50:0/1162360953 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960011830 con 0x7f29680cb520 2023-11-28T11:56:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296ce7e700 1 -- 172.21.15.50:0/1162360953 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2960011990 con 0x7f29680cb520 2023-11-28T11:56:53.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296ce7e700 1 -- 172.21.15.50:0/1162360953 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960011d40 con 0x7f29680cb520 2023-11-28T11:56:53.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296ee82700 1 -- 172.21.15.50:0/1162360953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29680cb520 msgr2=0x7f2968163b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296ee82700 1 --2- 172.21.15.50:0/1162360953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29680cb520 0x7f2968163b50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2960009850 tx=0x7f2960009b60 comp rx=0 tx=0).stop 2023-11-28T11:56:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296ee82700 1 -- 172.21.15.50:0/1162360953 shutdown_connections 2023-11-28T11:56:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296ee82700 1 --2- 172.21.15.50:0/1162360953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29680cb520 0x7f2968163b50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296ee82700 1 -- 172.21.15.50:0/1162360953 >> 172.21.15.50:0/1162360953 conn(0x7f29680ce400 msgr2=0x7f29680ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296ee82700 1 -- 172.21.15.50:0/1162360953 shutdown_connections 2023-11-28T11:56:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296ee82700 1 -- 172.21.15.50:0/1162360953 wait complete. 2023-11-28T11:56:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296ee82700 1 Processor -- start 2023-11-28T11:56:53.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.084+0000 7f296ee82700 1 -- start start 2023-11-28T11:56:53.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296ee82700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f296806b250 0x7f2968151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296ee82700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29680cb520 0x7f296814e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296ee82700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2968158f10 0x7f296814ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296ee82700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2968097230 con 0x7f296806b250 2023-11-28T11:56:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296ee82700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2968158820 con 0x7f29680cb520 2023-11-28T11:56:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296ee82700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2968151b80 con 0x7f2968158f10 2023-11-28T11:56:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296de80700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f296806b250 0x7f2968151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296de80700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f296806b250 0x7f2968151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35400/0 (socket says 172.21.15.50:35400) 2023-11-28T11:56:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296de80700 1 -- 172.21.15.50:0/3908455392 learned_addr learned my addr 172.21.15.50:0/3908455392 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296e681700 1 --2- 172.21.15.50:0/3908455392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2968158f10 0x7f296814ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296d67f700 1 --2- 172.21.15.50:0/3908455392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29680cb520 0x7f296814e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296de80700 1 -- 172.21.15.50:0/3908455392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2968158f10 msgr2=0x7f296814ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296de80700 1 --2- 172.21.15.50:0/3908455392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2968158f10 0x7f296814ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296de80700 1 -- 172.21.15.50:0/3908455392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29680cb520 msgr2=0x7f296814e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296de80700 1 --2- 172.21.15.50:0/3908455392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29680cb520 0x7f296814e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296de80700 1 -- 172.21.15.50:0/3908455392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29600094b0 con 0x7f296806b250 2023-11-28T11:56:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296e681700 1 --2- 172.21.15.50:0/3908455392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2968158f10 0x7f296814ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296d67f700 1 --2- 172.21.15.50:0/3908455392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29680cb520 0x7f296814e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296de80700 1 --2- 172.21.15.50:0/3908455392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f296806b250 0x7f2968151180 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f296400cbd0 tx=0x7f296400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f295e7fc700 1 -- 172.21.15.50:0/3908455392 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2964003c20 con 0x7f296806b250 2023-11-28T11:56:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f295e7fc700 1 -- 172.21.15.50:0/3908455392 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2964003d80 con 0x7f296806b250 2023-11-28T11:56:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296ee82700 1 -- 172.21.15.50:0/3908455392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29680c9990 con 0x7f296806b250 2023-11-28T11:56:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f295e7fc700 1 -- 172.21.15.50:0/3908455392 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296400abf0 con 0x7f296806b250 2023-11-28T11:56:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.088+0000 7f296ee82700 1 -- 172.21.15.50:0/3908455392 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29680c96b0 con 0x7f296806b250 2023-11-28T11:56:53.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.092+0000 7f295e7fc700 1 -- 172.21.15.50:0/3908455392 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2964010050 con 0x7f296806b250 2023-11-28T11:56:53.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.092+0000 7f295e7fc700 1 --2- 172.21.15.50:0/3908455392 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f294c064ee0 0x7f294c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.092+0000 7f295e7fc700 1 -- 172.21.15.50:0/3908455392 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2964081ff0 con 0x7f296806b250 2023-11-28T11:56:53.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.092+0000 7f296d67f700 1 --2- 172.21.15.50:0/3908455392 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f294c064ee0 0x7f294c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.092+0000 7f296d67f700 1 --2- 172.21.15.50:0/3908455392 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f294c064ee0 0x7f294c067390 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f29680abf50 tx=0x7f2958009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f2973364740 1 Processor -- start 2023-11-28T11:56:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f2973364740 1 -- start start 2023-11-28T11:56:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f2973364740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x142fd10 0x16c5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f2973364740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x142f940 0x16e0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f2973364740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x147a9c0 0x16e0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f2973364740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x159ec00 con 0x147a9c0 2023-11-28T11:56:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f2973364740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x160ecf0 con 0x142fd10 2023-11-28T11:56:53.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f2973364740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1607ff0 con 0x142f940 2023-11-28T11:56:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f296e681700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x147a9c0 0x16e0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f296e681700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x147a9c0 0x16e0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35402/0 (socket says 172.21.15.50:35402) 2023-11-28T11:56:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f296e681700 1 -- 172.21.15.50:0/3491348913 learned_addr learned my addr 172.21.15.50:0/3491348913 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f296de80700 1 --2- 172.21.15.50:0/3491348913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x142fd10 0x16c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f296d67f700 1 --2- 172.21.15.50:0/3491348913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x142f940 0x16e0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f296e681700 1 -- 172.21.15.50:0/3491348913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x142f940 msgr2=0x16e0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f296e681700 1 --2- 172.21.15.50:0/3491348913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x142f940 0x16e0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f296e681700 1 -- 172.21.15.50:0/3491348913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x142fd10 msgr2=0x16c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f296e681700 1 --2- 172.21.15.50:0/3491348913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x142fd10 0x16c5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f296e681700 1 -- 172.21.15.50:0/3491348913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x162dec0 con 0x147a9c0 2023-11-28T11:56:53.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f296e681700 1 --2- 172.21.15.50:0/3491348913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x147a9c0 0x16e0570 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2960013000 tx=0x7f2960010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34572d28bd4fc1d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f294b7fe700 1 -- 172.21.15.50:0/3491348913 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296001f070 con 0x147a9c0 2023-11-28T11:56:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f294b7fe700 1 -- 172.21.15.50:0/3491348913 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29600117b0 con 0x147a9c0 2023-11-28T11:56:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.096+0000 7f294b7fe700 1 -- 172.21.15.50:0/3491348913 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960011d40 con 0x147a9c0 2023-11-28T11:56:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.100+0000 7f2973364740 1 -- 172.21.15.50:0/3491348913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x147a9c0 msgr2=0x16e0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.100+0000 7f2973364740 1 --2- 172.21.15.50:0/3491348913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x147a9c0 0x16e0570 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2960013000 tx=0x7f2960010000 comp rx=0 tx=0).stop 2023-11-28T11:56:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.100+0000 7f2973364740 1 -- 172.21.15.50:0/3491348913 shutdown_connections 2023-11-28T11:56:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.100+0000 7f2973364740 1 --2- 172.21.15.50:0/3491348913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x147a9c0 0x16e0570 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.100+0000 7f2973364740 1 --2- 172.21.15.50:0/3491348913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x142f940 0x16e0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.100+0000 7f2973364740 1 --2- 172.21.15.50:0/3491348913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x142fd10 0x16c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.100+0000 7f2973364740 1 -- 172.21.15.50:0/3491348913 >> 172.21.15.50:0/3491348913 conn(0x14300e0 msgr2=0x16c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:53.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.100+0000 7f2973364740 1 -- 172.21.15.50:0/3491348913 shutdown_connections 2023-11-28T11:56:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.100+0000 7f2973364740 1 -- 172.21.15.50:0/3491348913 wait complete. 2023-11-28T11:56:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.100+0000 7f2973364740 1 -- start start 2023-11-28T11:56:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.100+0000 7f2973364740 1 Processor -- start 2023-11-28T11:56:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2973364740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142f940 0x16c4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2973364740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x142fd10 0x16ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2973364740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x147a9c0 0x16ca860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2973364740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x14b4d50 con 0x142f940 2023-11-28T11:56:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2973364740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x16efcf0 con 0x142fd10 2023-11-28T11:56:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2973364740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x16a16e0 con 0x147a9c0 2023-11-28T11:56:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f296de80700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142f940 0x16c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2973364740 10 client.0 _ll_register_callbacks cb 0x16648f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:56:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f296de80700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142f940 0x16c4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35418/0 (socket says 172.21.15.50:35418) 2023-11-28T11:56:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f296de80700 1 -- 172.21.15.50:0/28790835 learned_addr learned my addr 172.21.15.50:0/28790835 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f296d67f700 1 --2- 172.21.15.50:0/28790835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x142fd10 0x16ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f296e681700 1 --2- 172.21.15.50:0/28790835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x147a9c0 0x16ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f296de80700 1 -- 172.21.15.50:0/28790835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x147a9c0 msgr2=0x16ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f296de80700 1 --2- 172.21.15.50:0/28790835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x147a9c0 0x16ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f296de80700 1 -- 172.21.15.50:0/28790835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x142fd10 msgr2=0x16ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f296de80700 1 --2- 172.21.15.50:0/28790835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x142fd10 0x16ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f296de80700 1 -- 172.21.15.50:0/28790835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296806dc90 con 0x142f940 2023-11-28T11:56:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f296e681700 1 --2- 172.21.15.50:0/28790835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x147a9c0 0x16ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f296de80700 1 --2- 172.21.15.50:0/28790835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142f940 0x16c4320 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2964053980 tx=0x7f2964052160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04bcd03bfd5112f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2948ff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:56:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2948ff9700 1 -- 172.21.15.50:0/28790835 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2964057e80 con 0x142f940 2023-11-28T11:56:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2948ff9700 1 -- 172.21.15.50:0/28790835 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f296405b880 con 0x142f940 2023-11-28T11:56:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2973364740 1 -- 172.21.15.50:0/28790835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1635e30 con 0x142f940 2023-11-28T11:56:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2948ff9700 1 -- 172.21.15.50:0/28790835 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f296405ba40 con 0x142f940 2023-11-28T11:56:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2973364740 10 client.6723 fetch_fsmap learned FSMap version 31 2023-11-28T11:56:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2973364740 1 -- 172.21.15.50:0/28790835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x147bc10 con 0x142f940 2023-11-28T11:56:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2948ff9700 1 -- 172.21.15.50:0/28790835 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1635e30 con 0x142f940 2023-11-28T11:56:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2948ff9700 1 -- 172.21.15.50:0/28790835 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f296404fa70 con 0x142f940 2023-11-28T11:56:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2973364740 10 client.6723 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T11:56:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2973364740 10 client.6723 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-28T11:56:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2973364740 20 client.6723 populate_metadata read hostname 'smithi050' 2023-11-28T11:56:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2973364740 1 --2- 172.21.15.50:0/28790835 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x169fca0 0x16a0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2973364740 4 client.6723 mds_command: new command op to 6510 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:56:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2973364740 1 -- 172.21.15.50:0/28790835 --> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1601070 con 0x169fca0 2023-11-28T11:56:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f296d67f700 1 --2- 172.21.15.50:0/28790835 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x169fca0 0x16a0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f2948ff9700 10 client.6723 ms_handle_connect on v2:172.21.15.50:6834/3894924751 2023-11-28T11:56:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.104+0000 7f296d67f700 1 --2- 172.21.15.50:0/28790835 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x169fca0 0x16a0070 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a274d162bd02f14 server_cookie=e5ef7a8782f07fa9 in_seq=0 out_seq=0 2023-11-28T11:56:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.108+0000 7f2948ff9700 1 -- 172.21.15.50:0/28790835 <== mds.0 v2:172.21.15.50:6834/3894924751 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1601070 con 0x169fca0 2023-11-28T11:56:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.108+0000 7f2948ff9700 10 client.6723 handle_command_reply: tid=0 2023-11-28T11:56:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.108+0000 7f2973364740 1 client.6723 shutdown 2023-11-28T11:56:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.108+0000 7f2973364740 1 -- 172.21.15.50:0/28790835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142f940 msgr2=0x16c4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.108+0000 7f2973364740 1 --2- 172.21.15.50:0/28790835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142f940 0x16c4320 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2964053980 tx=0x7f2964052160 comp rx=0 tx=0).stop 2023-11-28T11:56:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.108+0000 7f2973364740 1 -- 172.21.15.50:0/28790835 shutdown_connections 2023-11-28T11:56:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.108+0000 7f2973364740 1 --2- 172.21.15.50:0/28790835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x147a9c0 0x16ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.108+0000 7f2973364740 1 --2- 172.21.15.50:0/28790835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x142fd10 0x16ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.108+0000 7f2973364740 1 --2- 172.21.15.50:0/28790835 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x169fca0 0x16a0070 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.108+0000 7f2973364740 1 --2- 172.21.15.50:0/28790835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142f940 0x16c4320 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.108+0000 7f2973364740 1 -- 172.21.15.50:0/28790835 >> 172.21.15.50:0/28790835 conn(0x14300e0 msgr2=0x16c4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.108+0000 7f2948ff9700 0 client.6723 ms_handle_reset on v2:172.21.15.50:6834/3894924751 2023-11-28T11:56:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.108+0000 7f2973364740 1 -- 172.21.15.50:0/28790835 shutdown_connections 2023-11-28T11:56:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.108+0000 7f2973364740 1 -- 172.21.15.50:0/28790835 wait complete. 2023-11-28T11:56:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.108+0000 7f2973364740 20 client.6723 trim_cache size 0 max 16384 2023-11-28T11:56:53.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.124+0000 7f2973364740 1 Processor -- start 2023-11-28T11:56:53.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.124+0000 7f2973364740 1 -- start start 2023-11-28T11:56:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f2973364740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142f940 0x16c3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f2973364740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x142fd10 0x16eb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f2973364740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x147a9c0 0x16eb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f2973364740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1605800 con 0x142f940 2023-11-28T11:56:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f2973364740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x160ff80 con 0x147a9c0 2023-11-28T11:56:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f2973364740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x16c9850 con 0x142fd10 2023-11-28T11:56:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f296de80700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142f940 0x16c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f296de80700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142f940 0x16c3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35420/0 (socket says 172.21.15.50:35420) 2023-11-28T11:56:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f296de80700 1 -- 172.21.15.50:0/1385617437 learned_addr learned my addr 172.21.15.50:0/1385617437 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f296d67f700 1 --2- 172.21.15.50:0/1385617437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x142fd10 0x16eb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f296e681700 1 --2- 172.21.15.50:0/1385617437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x147a9c0 0x16eb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f296de80700 1 -- 172.21.15.50:0/1385617437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x142fd10 msgr2=0x16eb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f296de80700 1 --2- 172.21.15.50:0/1385617437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x142fd10 0x16eb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f296de80700 1 -- 172.21.15.50:0/1385617437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x147a9c0 msgr2=0x16eb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f296de80700 1 --2- 172.21.15.50:0/1385617437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x147a9c0 0x16eb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f296de80700 1 -- 172.21.15.50:0/1385617437 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2968167200 con 0x142f940 2023-11-28T11:56:53.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f296e681700 1 --2- 172.21.15.50:0/1385617437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x147a9c0 0x16eb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:53.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f296de80700 1 --2- 172.21.15.50:0/1385617437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142f940 0x16c3730 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2964053750 tx=0x7f2964005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9b03f517d9383e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f294bfff700 1 -- 172.21.15.50:0/1385617437 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2964057be0 con 0x142f940 2023-11-28T11:56:53.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f294bfff700 1 -- 172.21.15.50:0/1385617437 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2964052020 con 0x142f940 2023-11-28T11:56:53.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f294bfff700 1 -- 172.21.15.50:0/1385617437 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296405b880 con 0x142f940 2023-11-28T11:56:53.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f2973364740 1 -- 172.21.15.50:0/1385617437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142f940 msgr2=0x16c3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f2973364740 1 --2- 172.21.15.50:0/1385617437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142f940 0x16c3730 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2964053750 tx=0x7f2964005000 comp rx=0 tx=0).stop 2023-11-28T11:56:53.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f2973364740 1 -- 172.21.15.50:0/1385617437 shutdown_connections 2023-11-28T11:56:53.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f2973364740 1 --2- 172.21.15.50:0/1385617437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x147a9c0 0x16eb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f2973364740 1 --2- 172.21.15.50:0/1385617437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x142fd10 0x16eb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f2973364740 1 --2- 172.21.15.50:0/1385617437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142f940 0x16c3730 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f2973364740 1 -- 172.21.15.50:0/1385617437 >> 172.21.15.50:0/1385617437 conn(0x14300e0 msgr2=0x16c3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:53.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f2973364740 1 -- 172.21.15.50:0/1385617437 shutdown_connections 2023-11-28T11:56:53.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f2973364740 1 -- 172.21.15.50:0/1385617437 wait complete. 2023-11-28T11:56:53.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f2973364740 1 -- start start 2023-11-28T11:56:53.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.128+0000 7f2973364740 1 Processor -- start 2023-11-28T11:56:53.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2973364740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x142f940 0x16fcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2973364740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142fd10 0x17438d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2973364740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x147a9c0 0x16fc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2973364740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x16c4ca0 con 0x142fd10 2023-11-28T11:56:53.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2973364740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x16cc250 con 0x142f940 2023-11-28T11:56:53.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2973364740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x16c3d70 con 0x147a9c0 2023-11-28T11:56:53.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2973364740 10 client.0 _ll_register_callbacks cb 0x15d2a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:56:53.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f296d67f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142fd10 0x17438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f296d67f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142fd10 0x17438d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35434/0 (socket says 172.21.15.50:35434) 2023-11-28T11:56:53.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f296d67f700 1 -- 172.21.15.50:0/788959582 learned_addr learned my addr 172.21.15.50:0/788959582 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:53.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f296e681700 1 --2- 172.21.15.50:0/788959582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x147a9c0 0x16fc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f296de80700 1 --2- 172.21.15.50:0/788959582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x142f940 0x16fcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f296d67f700 1 -- 172.21.15.50:0/788959582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x147a9c0 msgr2=0x16fc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f296d67f700 1 --2- 172.21.15.50:0/788959582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x147a9c0 0x16fc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f296d67f700 1 -- 172.21.15.50:0/788959582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x142f940 msgr2=0x16fcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f296d67f700 1 --2- 172.21.15.50:0/788959582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x142f940 0x16fcca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f296d67f700 1 -- 172.21.15.50:0/788959582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x147bc10 con 0x142fd10 2023-11-28T11:56:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f296de80700 1 --2- 172.21.15.50:0/788959582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x142f940 0x16fcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f296d67f700 1 --2- 172.21.15.50:0/788959582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142fd10 0x17438d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2958001370 tx=0x7f2958000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ab84ed929bb71f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2948ff9700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:56:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2948ff9700 1 -- 172.21.15.50:0/788959582 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29580076c0 con 0x142fd10 2023-11-28T11:56:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2973364740 1 -- 172.21.15.50:0/788959582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f29600117b0 con 0x142fd10 2023-11-28T11:56:53.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2948ff9700 1 -- 172.21.15.50:0/788959582 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f29580258e0 con 0x142fd10 2023-11-28T11:56:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2948ff9700 1 -- 172.21.15.50:0/788959582 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2958007820 con 0x142fd10 2023-11-28T11:56:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2973364740 10 client.6729 fetch_fsmap learned FSMap version 31 2023-11-28T11:56:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2973364740 1 -- 172.21.15.50:0/788959582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x15b4b70 con 0x142fd10 2023-11-28T11:56:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2948ff9700 1 -- 172.21.15.50:0/788959582 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29600117b0 con 0x142fd10 2023-11-28T11:56:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2948ff9700 1 -- 172.21.15.50:0/788959582 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f2958025aa0 con 0x142fd10 2023-11-28T11:56:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2973364740 10 client.6729 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T11:56:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2973364740 10 client.6729 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-28T11:56:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2973364740 20 client.6729 populate_metadata read hostname 'smithi050' 2023-11-28T11:56:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2973364740 1 --2- 172.21.15.50:0/788959582 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x16fafa0 0x16fb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2973364740 4 client.6729 mds_command: new command op to 6510 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2023-11-28T11:56:53.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2973364740 1 -- 172.21.15.50:0/788959582 --> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) v1 -- 0x1600d90 con 0x16fafa0 2023-11-28T11:56:53.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f296de80700 1 --2- 172.21.15.50:0/788959582 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x16fafa0 0x16fb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f2948ff9700 10 client.6729 ms_handle_connect on v2:172.21.15.50:6834/3894924751 2023-11-28T11:56:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.132+0000 7f296de80700 1 --2- 172.21.15.50:0/788959582 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x16fafa0 0x16fb3a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94d4ffd5047e56c7 server_cookie=76de2c4d8ce63913 in_seq=0 out_seq=0 2023-11-28T11:56:53.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f2948ff9700 1 -- 172.21.15.50:0/788959582 <== mds.0 v2:172.21.15.50:6834/3894924751 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x1600d90 con 0x16fafa0 2023-11-28T11:56:53.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f2948ff9700 10 client.6729 handle_command_reply: tid=0 2023-11-28T11:56:53.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f2973364740 1 client.6729 shutdown 2023-11-28T11:56:53.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f2973364740 1 -- 172.21.15.50:0/788959582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142fd10 msgr2=0x17438d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f2973364740 1 --2- 172.21.15.50:0/788959582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142fd10 0x17438d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2958001370 tx=0x7f2958000ed0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f2973364740 1 -- 172.21.15.50:0/788959582 shutdown_connections 2023-11-28T11:56:53.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f2973364740 1 --2- 172.21.15.50:0/788959582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x147a9c0 0x16fc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f2973364740 1 --2- 172.21.15.50:0/788959582 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x16fafa0 0x16fb3a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f2948ff9700 0 client.6729 ms_handle_reset on v2:172.21.15.50:6834/3894924751 2023-11-28T11:56:53.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f2973364740 1 --2- 172.21.15.50:0/788959582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x142fd10 0x17438d0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f2973364740 1 --2- 172.21.15.50:0/788959582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x142f940 0x16fcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f2973364740 1 -- 172.21.15.50:0/788959582 >> 172.21.15.50:0/788959582 conn(0x14300e0 msgr2=0x16c3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:53.146 INFO:tasks.ceph.mds.a.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f6740eaf700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6687=0-4194304@1} caps={6687=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6687 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55b088681b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(11)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T11:56:53.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f2973364740 1 -- 172.21.15.50:0/788959582 shutdown_connections 2023-11-28T11:56:53.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f2973364740 1 -- 172.21.15.50:0/788959582 wait complete. 2023-11-28T11:56:53.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f2973364740 20 client.6729 trim_cache size 0 max 16384 2023-11-28T11:56:53.147 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:56:53.147 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2023-11-28T11:56:53.147 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "8339e6aa-130f-47f3-aa6e-4e6941217652", 2023-11-28T11:56:53.147 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2023-11-28T11:56:53.147 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:56:53.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f296ee82700 1 -- 172.21.15.50:0/3908455392 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f294c064ee0 msgr2=0x7f294c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f296ee82700 1 --2- 172.21.15.50:0/3908455392 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f294c064ee0 0x7f294c067390 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f29680abf50 tx=0x7f2958009040 comp rx=0 tx=0).stop 2023-11-28T11:56:53.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f296ee82700 1 -- 172.21.15.50:0/3908455392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f296806b250 msgr2=0x7f2968151180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.136+0000 7f296ee82700 1 --2- 172.21.15.50:0/3908455392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f296806b250 0x7f2968151180 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f296400cbd0 tx=0x7f296400cf90 comp rx=0 tx=0).stop 2023-11-28T11:56:53.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.140+0000 7f296ee82700 1 -- 172.21.15.50:0/3908455392 shutdown_connections 2023-11-28T11:56:53.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.140+0000 7f296ee82700 1 --2- 172.21.15.50:0/3908455392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2968158f10 0x7f296814ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.140+0000 7f296ee82700 1 --2- 172.21.15.50:0/3908455392 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f294c064ee0 0x7f294c067390 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.140+0000 7f296ee82700 1 --2- 172.21.15.50:0/3908455392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29680cb520 0x7f296814e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.140+0000 7f296ee82700 1 --2- 172.21.15.50:0/3908455392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f296806b250 0x7f2968151180 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.140+0000 7f296ee82700 1 -- 172.21.15.50:0/3908455392 >> 172.21.15.50:0/3908455392 conn(0x7f29680ce400 msgr2=0x7f29680ac310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:53.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.140+0000 7f296ee82700 1 -- 172.21.15.50:0/3908455392 shutdown_connections 2023-11-28T11:56:53.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.140+0000 7f296ee82700 1 -- 172.21.15.50:0/3908455392 wait complete. 2023-11-28T11:56:53.161 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-11-28T11:56:53.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.284+0000 7fd7fb59e700 1 Processor -- start 2023-11-28T11:56:53.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.284+0000 7fd7fb59e700 1 -- start start 2023-11-28T11:56:53.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fb59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd7fc0b00e0 0x7fd7fc15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fb59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7fc09bdb0 0x7fd7fc15d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fb59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd7fc0cbb30 0x7fd7fc15dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fb59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7fc0b2db0 con 0x7fd7fc0cbb30 2023-11-28T11:56:53.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fb59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7fc0b3240 con 0x7fd7fc0b00e0 2023-11-28T11:56:53.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fb59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc06d840 con 0x7fd7fc09bdb0 2023-11-28T11:56:53.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd7fc0cbb30 0x7fd7fc15dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd7fc0cbb30 0x7fd7fc15dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35444/0 (socket says 172.21.15.50:35444) 2023-11-28T11:56:53.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fad9d700 1 -- 172.21.15.50:0/980434882 learned_addr learned my addr 172.21.15.50:0/980434882 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:53.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fa59c700 1 --2- 172.21.15.50:0/980434882 >> v2:172.21.15.192:3300/0 conn(0x7fd7fc0b00e0 0x7fd7fc15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7f9d9b700 1 --2- 172.21.15.50:0/980434882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7fc09bdb0 0x7fd7fc15d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fad9d700 1 -- 172.21.15.50:0/980434882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7fc09bdb0 msgr2=0x7fd7fc15d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fad9d700 1 --2- 172.21.15.50:0/980434882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7fc09bdb0 0x7fd7fc15d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fad9d700 1 -- 172.21.15.50:0/980434882 >> v2:172.21.15.192:3300/0 conn(0x7fd7fc0b00e0 msgr2=0x7fd7fc15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fad9d700 1 --2- 172.21.15.50:0/980434882 >> v2:172.21.15.192:3300/0 conn(0x7fd7fc0b00e0 0x7fd7fc15d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fad9d700 1 -- 172.21.15.50:0/980434882 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc06d560 con 0x7fd7fc0cbb30 2023-11-28T11:56:53.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fad9d700 1 --2- 172.21.15.50:0/980434882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7fc0cbb30 0x7fd7fc15dd60 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc06fbf0 tx=0x7fd7f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82abb472a2fb122d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7f959a700 1 -- 172.21.15.50:0/980434882 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f400e070 con 0x7fd7fc0cbb30 2023-11-28T11:56:53.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7f959a700 1 -- 172.21.15.50:0/980434882 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f400b910 con 0x7fd7fc0cbb30 2023-11-28T11:56:53.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7f959a700 1 -- 172.21.15.50:0/980434882 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f400bcc0 con 0x7fd7fc0cbb30 2023-11-28T11:56:53.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fb59e700 1 -- 172.21.15.50:0/980434882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7fc0cbb30 msgr2=0x7fd7fc15dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fb59e700 1 --2- 172.21.15.50:0/980434882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7fc0cbb30 0x7fd7fc15dd60 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc06fbf0 tx=0x7fd7f400b330 comp rx=0 tx=0).stop 2023-11-28T11:56:53.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fb59e700 1 -- 172.21.15.50:0/980434882 shutdown_connections 2023-11-28T11:56:53.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fb59e700 1 --2- 172.21.15.50:0/980434882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7fc0cbb30 0x7fd7fc15dd60 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fb59e700 1 --2- 172.21.15.50:0/980434882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7fc09bdb0 0x7fd7fc15d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fb59e700 1 --2- 172.21.15.50:0/980434882 >> v2:172.21.15.192:3300/0 conn(0x7fd7fc0b00e0 0x7fd7fc15d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fb59e700 1 -- 172.21.15.50:0/980434882 >> 172.21.15.50:0/980434882 conn(0x7fd7fc0cae70 msgr2=0x7fd7fc0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:53.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fb59e700 1 -- 172.21.15.50:0/980434882 shutdown_connections 2023-11-28T11:56:53.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.288+0000 7fd7fb59e700 1 -- 172.21.15.50:0/980434882 wait complete. 2023-11-28T11:56:53.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fb59e700 1 Processor -- start 2023-11-28T11:56:53.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fb59e700 1 -- start start 2023-11-28T11:56:53.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7fc09bdb0 0x7fd7fc14df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fb59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7fc0b00e0 0x7fd7fc153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fb59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7fc0cbb30 0x7fd7fc153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fb59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc099180 con 0x7fd7fc09bdb0 2023-11-28T11:56:53.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fb59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc14e490 con 0x7fd7fc0cbb30 2023-11-28T11:56:53.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fb59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc152a90 con 0x7fd7fc0b00e0 2023-11-28T11:56:53.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fa59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7fc09bdb0 0x7fd7fc14df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fa59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7fc09bdb0 0x7fd7fc14df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35454/0 (socket says 172.21.15.50:35454) 2023-11-28T11:56:53.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fa59c700 1 -- 172.21.15.50:0/3421372754 learned_addr learned my addr 172.21.15.50:0/3421372754 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:53.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fad9d700 1 --2- 172.21.15.50:0/3421372754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7fc0cbb30 0x7fd7fc153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7f9d9b700 1 --2- 172.21.15.50:0/3421372754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7fc0b00e0 0x7fd7fc153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fa59c700 1 -- 172.21.15.50:0/3421372754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7fc0b00e0 msgr2=0x7fd7fc153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fa59c700 1 --2- 172.21.15.50:0/3421372754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7fc0b00e0 0x7fd7fc153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fa59c700 1 -- 172.21.15.50:0/3421372754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7fc0cbb30 msgr2=0x7fd7fc153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fa59c700 1 --2- 172.21.15.50:0/3421372754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7fc0cbb30 0x7fd7fc153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fa59c700 1 -- 172.21.15.50:0/3421372754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f4009b30 con 0x7fd7fc09bdb0 2023-11-28T11:56:53.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7f9d9b700 1 --2- 172.21.15.50:0/3421372754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7fc0b00e0 0x7fd7fc153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:53.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fa59c700 1 --2- 172.21.15.50:0/3421372754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7fc09bdb0 0x7fd7fc14df50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000e9d0 tx=0x7fd7f000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7eaffd700 1 -- 172.21.15.50:0/3421372754 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0009720 con 0x7fd7fc09bdb0 2023-11-28T11:56:53.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7eaffd700 1 -- 172.21.15.50:0/3421372754 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f000c850 con 0x7fd7fc09bdb0 2023-11-28T11:56:53.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fb59e700 1 -- 172.21.15.50:0/3421372754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7fc0ac3d0 con 0x7fd7fc09bdb0 2023-11-28T11:56:53.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7eaffd700 1 -- 172.21.15.50:0/3421372754 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f000cbc0 con 0x7fd7fc09bdb0 2023-11-28T11:56:53.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.292+0000 7fd7fb59e700 1 -- 172.21.15.50:0/3421372754 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7fc0ac0f0 con 0x7fd7fc09bdb0 2023-11-28T11:56:53.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.296+0000 7fd7eaffd700 1 -- 172.21.15.50:0/3421372754 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd7f0019030 con 0x7fd7fc09bdb0 2023-11-28T11:56:53.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.296+0000 7fd7eaffd700 1 --2- 172.21.15.50:0/3421372754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd7dc064ee0 0x7fd7dc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.296+0000 7fd7eaffd700 1 -- 172.21.15.50:0/3421372754 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd7f0081fe0 con 0x7fd7fc09bdb0 2023-11-28T11:56:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.300+0000 7fd7f9d9b700 1 --2- 172.21.15.50:0/3421372754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd7dc064ee0 0x7fd7dc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.300+0000 7fd7f9d9b700 1 --2- 172.21.15.50:0/3421372754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd7dc064ee0 0x7fd7dc067390 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0ceea0 tx=0x7fd7ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.300+0000 7fd803eee740 1 Processor -- start 2023-11-28T11:56:53.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.300+0000 7fd803eee740 1 -- start start 2023-11-28T11:56:53.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd803eee740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1d94c10 0x204be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd803eee740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94840 0x204c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd803eee740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ddf8c0 0x20486a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd803eee740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f03d20 con 0x1ddf8c0 2023-11-28T11:56:53.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd803eee740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f73d60 con 0x1d94840 2023-11-28T11:56:53.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd803eee740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f6d060 con 0x1d94c10 2023-11-28T11:56:53.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd7fad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ddf8c0 0x20486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd7fad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ddf8c0 0x20486a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35466/0 (socket says 172.21.15.50:35466) 2023-11-28T11:56:53.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd7fad9d700 1 -- 172.21.15.50:0/3349660281 learned_addr learned my addr 172.21.15.50:0/3349660281 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:53.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd7fa59c700 1 --2- 172.21.15.50:0/3349660281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1d94c10 0x204be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd7f9d9b700 1 --2- 172.21.15.50:0/3349660281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94840 0x204c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd7fad9d700 1 -- 172.21.15.50:0/3349660281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1d94c10 msgr2=0x204be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd7fad9d700 1 --2- 172.21.15.50:0/3349660281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1d94c10 0x204be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd7fad9d700 1 -- 172.21.15.50:0/3349660281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94840 msgr2=0x204c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd7fad9d700 1 --2- 172.21.15.50:0/3349660281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94840 0x204c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd7fad9d700 1 -- 172.21.15.50:0/3349660281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1f930a0 con 0x1ddf8c0 2023-11-28T11:56:53.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd7fad9d700 1 --2- 172.21.15.50:0/3349660281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ddf8c0 0x20486a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4012000 tx=0x7fd7f4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35a02692743d6a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd7dbfff700 1 -- 172.21.15.50:0/3349660281 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f400bc80 con 0x1ddf8c0 2023-11-28T11:56:53.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd7dbfff700 1 -- 172.21.15.50:0/3349660281 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f4003a40 con 0x1ddf8c0 2023-11-28T11:56:53.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd7dbfff700 1 -- 172.21.15.50:0/3349660281 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4003dd0 con 0x1ddf8c0 2023-11-28T11:56:53.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd803eee740 1 -- 172.21.15.50:0/3349660281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ddf8c0 msgr2=0x20486a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd803eee740 1 --2- 172.21.15.50:0/3349660281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ddf8c0 0x20486a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4012000 tx=0x7fd7f4010000 comp rx=0 tx=0).stop 2023-11-28T11:56:53.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd803eee740 1 -- 172.21.15.50:0/3349660281 shutdown_connections 2023-11-28T11:56:53.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd803eee740 1 --2- 172.21.15.50:0/3349660281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1ddf8c0 0x20486a0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd803eee740 1 --2- 172.21.15.50:0/3349660281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94840 0x204c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd803eee740 1 --2- 172.21.15.50:0/3349660281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1d94c10 0x204be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd803eee740 1 -- 172.21.15.50:0/3349660281 >> 172.21.15.50:0/3349660281 conn(0x1d94fe0 msgr2=0x202dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:53.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd803eee740 1 -- 172.21.15.50:0/3349660281 shutdown_connections 2023-11-28T11:56:53.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.304+0000 7fd803eee740 1 -- 172.21.15.50:0/3349660281 wait complete. 2023-11-28T11:56:53.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 1 -- start start 2023-11-28T11:56:53.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 1 Processor -- start 2023-11-28T11:56:53.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94840 0x200f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94c10 0x20292f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1ddf8c0 0x200fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e19c50 con 0x1d94c10 2023-11-28T11:56:53.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x2010060 con 0x1d94840 2023-11-28T11:56:53.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x20299c0 con 0x1ddf8c0 2023-11-28T11:56:53.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 10 client.0 _ll_register_callbacks cb 0x1f669a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:56:53.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7f9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94c10 0x20292f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7f9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94c10 0x20292f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35468/0 (socket says 172.21.15.50:35468) 2023-11-28T11:56:53.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7f9d9b700 1 -- 172.21.15.50:0/1673373774 learned_addr learned my addr 172.21.15.50:0/1673373774 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:53.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7fa59c700 1 --2- 172.21.15.50:0/1673373774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94840 0x200f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7f9d9b700 1 -- 172.21.15.50:0/1673373774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1ddf8c0 msgr2=0x200fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7fad9d700 1 --2- 172.21.15.50:0/1673373774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1ddf8c0 0x200fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7f9d9b700 1 --2- 172.21.15.50:0/1673373774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1ddf8c0 0x200fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7f9d9b700 1 -- 172.21.15.50:0/1673373774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94840 msgr2=0x200f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7f9d9b700 1 --2- 172.21.15.50:0/1673373774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94840 0x200f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7f9d9b700 1 -- 172.21.15.50:0/1673373774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f400be70 con 0x1d94c10 2023-11-28T11:56:53.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7fa59c700 1 --2- 172.21.15.50:0/1673373774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94840 0x200f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:53.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7fad9d700 1 --2- 172.21.15.50:0/1673373774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1ddf8c0 0x200fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:56:53.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7f9d9b700 1 --2- 172.21.15.50:0/1673373774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94c10 0x20292f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0cadf0 tx=0x7fd7ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab250a9ced262520 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:56:53.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7d97fa700 1 -- 172.21.15.50:0/1673373774 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec015610 con 0x1d94c10 2023-11-28T11:56:53.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7d97fa700 1 -- 172.21.15.50:0/1673373774 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd7ec015770 con 0x1d94c10 2023-11-28T11:56:53.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 1 -- 172.21.15.50:0/1673373774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1f660e0 con 0x1d94c10 2023-11-28T11:56:53.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7d97fa700 1 -- 172.21.15.50:0/1673373774 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7ec014e60 con 0x1d94c10 2023-11-28T11:56:53.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 10 client.6741 fetch_fsmap learned FSMap version 31 2023-11-28T11:56:53.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 1 -- 172.21.15.50:0/1673373774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x1de0b10 con 0x1d94c10 2023-11-28T11:56:53.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7d97fa700 1 -- 172.21.15.50:0/1673373774 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1f660e0 con 0x1d94c10 2023-11-28T11:56:53.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7d97fa700 1 -- 172.21.15.50:0/1673373774 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fd7ec015930 con 0x1d94c10 2023-11-28T11:56:53.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 10 client.6741 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T11:56:53.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 10 client.6741 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-28T11:56:53.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 20 client.6741 populate_metadata read hostname 'smithi050' 2023-11-28T11:56:53.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 1 --2- 172.21.15.50:0/1673373774 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x202b720 0x200d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 4 client.6741 mds_command: new command op to 6510 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:56:53.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd803eee740 1 -- 172.21.15.50:0/1673373774 --> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1f65e00 con 0x202b720 2023-11-28T11:56:53.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.308+0000 7fd7fa59c700 1 --2- 172.21.15.50:0/1673373774 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x202b720 0x200d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.312+0000 7fd7fa59c700 1 --2- 172.21.15.50:0/1673373774 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x202b720 0x200d690 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa863beffb7bdf7b server_cookie=4f1a83316ecd988c in_seq=0 out_seq=0 2023-11-28T11:56:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.312+0000 7fd7d97fa700 10 client.6741 ms_handle_connect on v2:172.21.15.50:6834/3894924751 2023-11-28T11:56:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.312+0000 7fd7d97fa700 1 -- 172.21.15.50:0/1673373774 <== mds.0 v2:172.21.15.50:6834/3894924751 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1f65e00 con 0x202b720 2023-11-28T11:56:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.312+0000 7fd7d97fa700 10 client.6741 handle_command_reply: tid=0 2023-11-28T11:56:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.312+0000 7fd803eee740 1 client.6741 shutdown 2023-11-28T11:56:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.312+0000 7fd803eee740 1 -- 172.21.15.50:0/1673373774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94c10 msgr2=0x20292f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.312+0000 7fd803eee740 1 --2- 172.21.15.50:0/1673373774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94c10 0x20292f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0cadf0 tx=0x7fd7ec004770 comp rx=0 tx=0).stop 2023-11-28T11:56:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.312+0000 7fd803eee740 1 -- 172.21.15.50:0/1673373774 shutdown_connections 2023-11-28T11:56:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.312+0000 7fd803eee740 1 --2- 172.21.15.50:0/1673373774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1ddf8c0 0x200fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.312+0000 7fd803eee740 1 --2- 172.21.15.50:0/1673373774 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x202b720 0x200d690 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.312+0000 7fd803eee740 1 --2- 172.21.15.50:0/1673373774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94c10 0x20292f0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.312+0000 7fd803eee740 1 --2- 172.21.15.50:0/1673373774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94840 0x200f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.312+0000 7fd7d97fa700 0 client.6741 ms_handle_reset on v2:172.21.15.50:6834/3894924751 2023-11-28T11:56:53.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.312+0000 7fd803eee740 1 -- 172.21.15.50:0/1673373774 >> 172.21.15.50:0/1673373774 conn(0x1d94fe0 msgr2=0x2024800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:53.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.312+0000 7fd803eee740 1 -- 172.21.15.50:0/1673373774 shutdown_connections 2023-11-28T11:56:53.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.312+0000 7fd803eee740 1 -- 172.21.15.50:0/1673373774 wait complete. 2023-11-28T11:56:53.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.312+0000 7fd803eee740 20 client.6741 trim_cache size 0 max 16384 2023-11-28T11:56:53.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.332+0000 7fd803eee740 1 Processor -- start 2023-11-28T11:56:53.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.332+0000 7fd803eee740 1 -- start start 2023-11-28T11:56:53.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.332+0000 7fd803eee740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1d94fe0 0x2022790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.332+0000 7fd803eee740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94840 0x2022cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.332+0000 7fd803eee740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94c10 0x200bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.332+0000 7fd803eee740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f192c0 con 0x1d94840 2023-11-28T11:56:53.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.332+0000 7fd803eee740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f03200 con 0x1d94c10 2023-11-28T11:56:53.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.332+0000 7fd803eee740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f42f70 con 0x1d94fe0 2023-11-28T11:56:53.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.332+0000 7fd7f9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94840 0x2022cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.332+0000 7fd7f9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94840 0x2022cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35474/0 (socket says 172.21.15.50:35474) 2023-11-28T11:56:53.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.332+0000 7fd7f9d9b700 1 -- 172.21.15.50:0/214609852 learned_addr learned my addr 172.21.15.50:0/214609852 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:53.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.332+0000 7fd7fa59c700 1 --2- 172.21.15.50:0/214609852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1d94fe0 0x2022790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.332+0000 7fd7fad9d700 1 --2- 172.21.15.50:0/214609852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94c10 0x200bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7f9d9b700 1 -- 172.21.15.50:0/214609852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1d94fe0 msgr2=0x2022790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7f9d9b700 1 --2- 172.21.15.50:0/214609852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1d94fe0 0x2022790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7f9d9b700 1 -- 172.21.15.50:0/214609852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94c10 msgr2=0x200bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7f9d9b700 1 --2- 172.21.15.50:0/214609852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94c10 0x200bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7f9d9b700 1 -- 172.21.15.50:0/214609852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc154f10 con 0x1d94840 2023-11-28T11:56:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7fa59c700 1 --2- 172.21.15.50:0/214609852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1d94fe0 0x2022790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7f9d9b700 1 --2- 172.21.15.50:0/214609852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94840 0x2022cd0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec014bf0 tx=0x7fd7ec022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13cac5e67be3017 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7e8ff9700 1 -- 172.21.15.50:0/214609852 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec015da0 con 0x1d94840 2023-11-28T11:56:53.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7e8ff9700 1 -- 172.21.15.50:0/214609852 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ec0046b0 con 0x1d94840 2023-11-28T11:56:53.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7e8ff9700 1 -- 172.21.15.50:0/214609852 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec015650 con 0x1d94840 2023-11-28T11:56:53.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 1 -- 172.21.15.50:0/214609852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94840 msgr2=0x2022cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 1 --2- 172.21.15.50:0/214609852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94840 0x2022cd0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec014bf0 tx=0x7fd7ec022000 comp rx=0 tx=0).stop 2023-11-28T11:56:53.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 1 -- 172.21.15.50:0/214609852 shutdown_connections 2023-11-28T11:56:53.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 1 --2- 172.21.15.50:0/214609852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94c10 0x200bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 1 --2- 172.21.15.50:0/214609852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94840 0x2022cd0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 1 --2- 172.21.15.50:0/214609852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1d94fe0 0x2022790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 1 -- 172.21.15.50:0/214609852 >> 172.21.15.50:0/214609852 conn(0x200fc90 msgr2=0x20526c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:53.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 1 -- 172.21.15.50:0/214609852 shutdown_connections 2023-11-28T11:56:53.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 1 -- 172.21.15.50:0/214609852 wait complete. 2023-11-28T11:56:53.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 1 -- start start 2023-11-28T11:56:53.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 1 Processor -- start 2023-11-28T11:56:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94840 0x2026940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94c10 0x20251b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1d94fe0 0x20a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f2f140 con 0x1d94c10 2023-11-28T11:56:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x20270d0 con 0x1d94840 2023-11-28T11:56:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x2025e20 con 0x1d94fe0 2023-11-28T11:56:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd803eee740 10 client.0 _ll_register_callbacks cb 0x7fd7f00090e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:56:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7f9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94c10 0x20251b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7f9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94c10 0x20251b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35486/0 (socket says 172.21.15.50:35486) 2023-11-28T11:56:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7f9d9b700 1 -- 172.21.15.50:0/1692676439 learned_addr learned my addr 172.21.15.50:0/1692676439 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:56:53.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7fa59c700 1 --2- 172.21.15.50:0/1692676439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94840 0x2026940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7fad9d700 1 --2- 172.21.15.50:0/1692676439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1d94fe0 0x20a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7f9d9b700 1 -- 172.21.15.50:0/1692676439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1d94fe0 msgr2=0x20a7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7f9d9b700 1 --2- 172.21.15.50:0/1692676439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1d94fe0 0x20a7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7f9d9b700 1 -- 172.21.15.50:0/1692676439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94840 msgr2=0x2026940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:56:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7f9d9b700 1 --2- 172.21.15.50:0/1692676439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94840 0x2026940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7f9d9b700 1 -- 172.21.15.50:0/1692676439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1de0b10 con 0x1d94c10 2023-11-28T11:56:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7fad9d700 1 --2- 172.21.15.50:0/1692676439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1d94fe0 0x20a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.336+0000 7fd7fa59c700 1 --2- 172.21.15.50:0/1692676439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94840 0x2026940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:56:53.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7f9d9b700 1 --2- 172.21.15.50:0/1692676439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94c10 0x20251b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00fff0 tx=0x7fd7ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ab797b84bc9b2f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:56:53.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:56:53.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7d97fa700 1 -- 172.21.15.50:0/1692676439 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec015960 con 0x1d94c10 2023-11-28T11:56:53.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7d97fa700 1 -- 172.21.15.50:0/1692676439 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd7ec03e440 con 0x1d94c10 2023-11-28T11:56:53.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 1 -- 172.21.15.50:0/1692676439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd7f4003a40 con 0x1d94c10 2023-11-28T11:56:53.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7d97fa700 1 -- 172.21.15.50:0/1692676439 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7ec03e600 con 0x1d94c10 2023-11-28T11:56:53.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 10 client.6747 fetch_fsmap learned FSMap version 31 2023-11-28T11:56:53.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 1 -- 172.21.15.50:0/1692676439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x1f19af0 con 0x1d94c10 2023-11-28T11:56:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7d97fa700 1 -- 172.21.15.50:0/1692676439 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f4003a40 con 0x1d94c10 2023-11-28T11:56:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7d97fa700 1 -- 172.21.15.50:0/1692676439 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 31) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fd7ec045070 con 0x1d94c10 2023-11-28T11:56:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 10 client.6747 fetch_fsmap finished waiting for FSMap version 31 2023-11-28T11:56:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 10 client.6747 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-28T11:56:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 20 client.6747 populate_metadata read hostname 'smithi050' 2023-11-28T11:56:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 1 --2- 172.21.15.50:0/1692676439 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x1ddf8c0 0x20a8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:56:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 4 client.6747 mds_command: new command op to 6510 tid=0[{"prefix": "scrub status"}] 2023-11-28T11:56:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 1 -- 172.21.15.50:0/1692676439 --> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1e11390 con 0x1ddf8c0 2023-11-28T11:56:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7fa59c700 1 --2- 172.21.15.50:0/1692676439 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x1ddf8c0 0x20a8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:56:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7d97fa700 10 client.6747 ms_handle_connect on v2:172.21.15.50:6834/3894924751 2023-11-28T11:56:53.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7fa59c700 1 --2- 172.21.15.50:0/1692676439 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x1ddf8c0 0x20a8390 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=985620f69bc6128e server_cookie=f335b5c0498bd6c1 in_seq=0 out_seq=0 2023-11-28T11:56:53.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7d97fa700 1 -- 172.21.15.50:0/1692676439 <== mds.0 v2:172.21.15.50:6834/3894924751 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+253 (crc 0 0 0) 0x1e11390 con 0x1ddf8c0 2023-11-28T11:56:53.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7d97fa700 10 client.6747 handle_command_reply: tid=0 2023-11-28T11:56:53.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 1 client.6747 shutdown 2023-11-28T11:56:53.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 1 -- 172.21.15.50:0/1692676439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94c10 msgr2=0x20251b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 1 --2- 172.21.15.50:0/1692676439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94c10 0x20251b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00fff0 tx=0x7fd7ec016000 comp rx=0 tx=0).stop 2023-11-28T11:56:53.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 1 -- 172.21.15.50:0/1692676439 shutdown_connections 2023-11-28T11:56:53.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 1 --2- 172.21.15.50:0/1692676439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x1d94fe0 0x20a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 1 --2- 172.21.15.50:0/1692676439 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x1ddf8c0 0x20a8390 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 1 --2- 172.21.15.50:0/1692676439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x1d94c10 0x20251b0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 1 --2- 172.21.15.50:0/1692676439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x1d94840 0x2026940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7d97fa700 0 client.6747 ms_handle_reset on v2:172.21.15.50:6834/3894924751 2023-11-28T11:56:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 1 -- 172.21.15.50:0/1692676439 >> 172.21.15.50:0/1692676439 conn(0x200fc90 msgr2=0x200cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 1 -- 172.21.15.50:0/1692676439 shutdown_connections 2023-11-28T11:56:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 1 -- 172.21.15.50:0/1692676439 wait complete. 2023-11-28T11:56:53.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd803eee740 20 client.6747 trim_cache size 0 max 16384 2023-11-28T11:56:53.354 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:56:53.354 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-28T11:56:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2023-11-28T11:56:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: "8339e6aa-130f-47f3-aa6e-4e6941217652": { 2023-11-28T11:56:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2023-11-28T11:56:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "8339e6aa-130f-47f3-aa6e-4e6941217652", 2023-11-28T11:56:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive" 2023-11-28T11:56:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:53.355 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:56:53.355 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:56:53.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7fb59e700 1 -- 172.21.15.50:0/3421372754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd7dc064ee0 msgr2=0x7fd7dc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7fb59e700 1 --2- 172.21.15.50:0/3421372754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd7dc064ee0 0x7fd7dc067390 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0ceea0 tx=0x7fd7ec008040 comp rx=0 tx=0).stop 2023-11-28T11:56:53.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7fb59e700 1 -- 172.21.15.50:0/3421372754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7fc09bdb0 msgr2=0x7fd7fc14df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:56:53.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7fb59e700 1 --2- 172.21.15.50:0/3421372754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7fc09bdb0 0x7fd7fc14df50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000e9d0 tx=0x7fd7f000ece0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7fb59e700 1 -- 172.21.15.50:0/3421372754 shutdown_connections 2023-11-28T11:56:53.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7fb59e700 1 --2- 172.21.15.50:0/3421372754 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fd7dc064ee0 0x7fd7dc067390 secure :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0ceea0 tx=0x7fd7ec008040 comp rx=0 tx=0).stop 2023-11-28T11:56:53.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7fb59e700 1 --2- 172.21.15.50:0/3421372754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7fc0cbb30 0x7fd7fc153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7fb59e700 1 --2- 172.21.15.50:0/3421372754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7fc0b00e0 0x7fd7fc153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7fb59e700 1 --2- 172.21.15.50:0/3421372754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7fc09bdb0 0x7fd7fc14df50 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:56:53.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7fb59e700 1 -- 172.21.15.50:0/3421372754 >> 172.21.15.50:0/3421372754 conn(0x7fd7fc0cae70 msgr2=0x7fd7fc0ce3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:56:53.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7fb59e700 1 -- 172.21.15.50:0/3421372754 shutdown_connections 2023-11-28T11:56:53.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:56:53.340+0000 7fd7fb59e700 1 -- 172.21.15.50:0/3421372754 wait complete. 2023-11-28T11:56:53.365 INFO:tasks.cephfs.filesystem:scrub status for tag:8339e6aa-130f-47f3-aa6e-4e6941217652 - {'path': '/', 'tag': '8339e6aa-130f-47f3-aa6e-4e6941217652', 'options': 'recursive'} 2023-11-28T11:56:56.455 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-11-28T11:56:56.448+0000 7f6bcfbc1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-11-28T11:57:06.329 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:57:06.331 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:57:23.366 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-11-28T11:57:23.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.492+0000 7efe8759e700 1 Processor -- start 2023-11-28T11:57:23.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.492+0000 7efe8759e700 1 -- start start 2023-11-28T11:57:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.492+0000 7efe8759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efe8809bdb0 0x7efe8815d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.492+0000 7efe8759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe880cbb30 0x7efe8806bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.492+0000 7efe8759e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe880b2db0 con 0x7efe880b00e0 2023-11-28T11:57:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.492+0000 7efe8759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe880b3240 con 0x7efe8809bdb0 2023-11-28T11:57:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.492+0000 7efe8759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8806d840 con 0x7efe880cbb30 2023-11-28T11:57:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe85d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efe8809bdb0 0x7efe8815d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe85d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efe8809bdb0 0x7efe8815d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47152/0 (socket says 172.21.15.50:47152) 2023-11-28T11:57:23.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe85d9b700 1 -- 172.21.15.50:0/4126185559 learned_addr learned my addr 172.21.15.50:0/4126185559 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:23.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe86d9d700 1 --2- 172.21.15.50:0/4126185559 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe880cbb30 0x7efe8806bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe85d9b700 1 -- 172.21.15.50:0/4126185559 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe880cbb30 msgr2=0x7efe8806bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:23.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe85d9b700 1 --2- 172.21.15.50:0/4126185559 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe880cbb30 0x7efe8806bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe85d9b700 1 -- 172.21.15.50:0/4126185559 >> v1:172.21.15.192:6789/0 conn(0x7efe880b00e0 legacy=0x7efe8815d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe8559a700 1 -- 172.21.15.50:0/4126185559 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174312688 0 0) 0x7efe880b2db0 con 0x7efe880b00e0 2023-11-28T11:57:23.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe85d9b700 1 -- 172.21.15.50:0/4126185559 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8806d560 con 0x7efe8809bdb0 2023-11-28T11:57:23.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe85d9b700 1 --2- 172.21.15.50:0/4126185559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe8809bdb0 0x7efe8815d9f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7efe78009e50 tx=0x7efe7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4a7e94ca529da9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:23.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe8559a700 1 -- 172.21.15.50:0/4126185559 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7800e070 con 0x7efe8809bdb0 2023-11-28T11:57:23.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe8559a700 1 -- 172.21.15.50:0/4126185559 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7800b910 con 0x7efe8809bdb0 2023-11-28T11:57:23.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe8559a700 1 -- 172.21.15.50:0/4126185559 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7800bcc0 con 0x7efe8809bdb0 2023-11-28T11:57:23.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe8759e700 1 -- 172.21.15.50:0/4126185559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe8809bdb0 msgr2=0x7efe8815d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe8759e700 1 --2- 172.21.15.50:0/4126185559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe8809bdb0 0x7efe8815d9f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7efe78009e50 tx=0x7efe7800b330 comp rx=0 tx=0).stop 2023-11-28T11:57:23.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe8759e700 1 -- 172.21.15.50:0/4126185559 shutdown_connections 2023-11-28T11:57:23.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe8759e700 1 --2- 172.21.15.50:0/4126185559 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe880cbb30 0x7efe8806bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe8759e700 1 --2- 172.21.15.50:0/4126185559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe8809bdb0 0x7efe8815d9f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe8759e700 1 -- 172.21.15.50:0/4126185559 >> 172.21.15.50:0/4126185559 conn(0x7efe880cae70 msgr2=0x7efe880cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:23.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe8759e700 1 -- 172.21.15.50:0/4126185559 shutdown_connections 2023-11-28T11:57:23.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe8759e700 1 -- 172.21.15.50:0/4126185559 wait complete. 2023-11-28T11:57:23.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe8759e700 1 Processor -- start 2023-11-28T11:57:23.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.496+0000 7efe8759e700 1 -- start start 2023-11-28T11:57:23.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe8759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe8809bdb0 0x7efe881508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe8759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe880b00e0 0x7efe88071c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe8759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe880cbb30 0x7efe880ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe8759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe880708a0 con 0x7efe880b00e0 2023-11-28T11:57:23.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe8759e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe88152c40 con 0x7efe880cbb30 2023-11-28T11:57:23.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe8759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8815ac70 con 0x7efe8809bdb0 2023-11-28T11:57:23.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe85d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe880b00e0 0x7efe88071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe85d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe880b00e0 0x7efe88071c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47154/0 (socket says 172.21.15.50:47154) 2023-11-28T11:57:23.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe85d9b700 1 -- 172.21.15.50:0/3125557289 learned_addr learned my addr 172.21.15.50:0/3125557289 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:23.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe86d9d700 1 --2- 172.21.15.50:0/3125557289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe880cbb30 0x7efe880ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe8659c700 1 --2- 172.21.15.50:0/3125557289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe8809bdb0 0x7efe881508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe85d9b700 1 -- 172.21.15.50:0/3125557289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe8809bdb0 msgr2=0x7efe881508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe85d9b700 1 --2- 172.21.15.50:0/3125557289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe8809bdb0 0x7efe881508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe85d9b700 1 -- 172.21.15.50:0/3125557289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe880cbb30 msgr2=0x7efe880ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe85d9b700 1 --2- 172.21.15.50:0/3125557289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe880cbb30 0x7efe880ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe85d9b700 1 -- 172.21.15.50:0/3125557289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78009b30 con 0x7efe880b00e0 2023-11-28T11:57:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe86d9d700 1 --2- 172.21.15.50:0/3125557289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe880cbb30 0x7efe880ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe85d9b700 1 --2- 172.21.15.50:0/3125557289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe880b00e0 0x7efe88071c70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7efe8806f640 tx=0x7efe78004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe76ffd700 1 -- 172.21.15.50:0/3125557289 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe780048c0 con 0x7efe880b00e0 2023-11-28T11:57:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe76ffd700 1 -- 172.21.15.50:0/3125557289 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe780099b0 con 0x7efe880b00e0 2023-11-28T11:57:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe8759e700 1 -- 172.21.15.50:0/3125557289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe880ac3d0 con 0x7efe880b00e0 2023-11-28T11:57:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe76ffd700 1 -- 172.21.15.50:0/3125557289 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7801c660 con 0x7efe880b00e0 2023-11-28T11:57:23.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.500+0000 7efe8759e700 1 -- 172.21.15.50:0/3125557289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe880ac0f0 con 0x7efe880b00e0 2023-11-28T11:57:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe76ffd700 1 -- 172.21.15.50:0/3125557289 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efe78022030 con 0x7efe880b00e0 2023-11-28T11:57:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe76ffd700 1 --2- 172.21.15.50:0/3125557289 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efe68064ee0 0x7efe68067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe76ffd700 1 -- 172.21.15.50:0/3125557289 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7efe78083720 con 0x7efe880b00e0 2023-11-28T11:57:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe8659c700 1 --2- 172.21.15.50:0/3125557289 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efe68064ee0 0x7efe68067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe8fafe740 1 Processor -- start 2023-11-28T11:57:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe8fafe740 1 -- start start 2023-11-28T11:57:23.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe8659c700 1 --2- 172.21.15.50:0/3125557289 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efe68064ee0 0x7efe68067390 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efe7c007fd0 tx=0x7efe7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe8fafe740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xefac10 0x11b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe8fafe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefa840 0x11b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe8fafe740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf458c0 0x11ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe8fafe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1069d20 con 0xefa840 2023-11-28T11:57:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe8fafe740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x10d9d60 con 0xefac10 2023-11-28T11:57:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe8fafe740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x10d3060 con 0xf458c0 2023-11-28T11:57:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe85d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefa840 0x11b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe85d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefa840 0x11b2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47166/0 (socket says 172.21.15.50:47166) 2023-11-28T11:57:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe85d9b700 1 -- 172.21.15.50:0/817228800 learned_addr learned my addr 172.21.15.50:0/817228800 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe8659c700 1 --2- 172.21.15.50:0/817228800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xefac10 0x11b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe86d9d700 1 --2- 172.21.15.50:0/817228800 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf458c0 0x11ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe85d9b700 1 -- 172.21.15.50:0/817228800 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf458c0 msgr2=0x11ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:23.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe85d9b700 1 --2- 172.21.15.50:0/817228800 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf458c0 0x11ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe85d9b700 1 -- 172.21.15.50:0/817228800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xefac10 msgr2=0x11b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:23.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe85d9b700 1 --2- 172.21.15.50:0/817228800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xefac10 0x11b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe85d9b700 1 -- 172.21.15.50:0/817228800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10f90a0 con 0xefa840 2023-11-28T11:57:23.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe86d9d700 1 --2- 172.21.15.50:0/817228800 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf458c0 0x11ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:23.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.504+0000 7efe85d9b700 1 --2- 172.21.15.50:0/817228800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefa840 0x11b2340 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7efe78004ac0 tx=0x7efe78054e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f1acc54f460c3c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:23.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe67fff700 1 -- 172.21.15.50:0/817228800 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe780537e0 con 0xefa840 2023-11-28T11:57:23.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe67fff700 1 -- 172.21.15.50:0/817228800 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe78051b50 con 0xefa840 2023-11-28T11:57:23.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe67fff700 1 -- 172.21.15.50:0/817228800 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe78054b30 con 0xefa840 2023-11-28T11:57:23.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 1 -- 172.21.15.50:0/817228800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefa840 msgr2=0x11b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 1 --2- 172.21.15.50:0/817228800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefa840 0x11b2340 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7efe78004ac0 tx=0x7efe78054e20 comp rx=0 tx=0).stop 2023-11-28T11:57:23.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 1 -- 172.21.15.50:0/817228800 shutdown_connections 2023-11-28T11:57:23.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 1 --2- 172.21.15.50:0/817228800 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf458c0 0x11ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 1 --2- 172.21.15.50:0/817228800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefa840 0x11b2340 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 1 --2- 172.21.15.50:0/817228800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xefac10 0x11b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 1 -- 172.21.15.50:0/817228800 >> 172.21.15.50:0/817228800 conn(0xefafe0 msgr2=0x1193d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:23.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 1 -- 172.21.15.50:0/817228800 shutdown_connections 2023-11-28T11:57:23.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 1 -- 172.21.15.50:0/817228800 wait complete. 2023-11-28T11:57:23.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 1 -- start start 2023-11-28T11:57:23.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 1 Processor -- start 2023-11-28T11:57:23.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefa840 0x1193650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xefac10 0x1193b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf458c0 0x1191540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xf7fc50 con 0xefa840 2023-11-28T11:57:23.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x1190170 con 0xefac10 2023-11-28T11:57:23.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1190410 con 0xf458c0 2023-11-28T11:57:23.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8fafe740 10 client.0 _ll_register_callbacks cb 0x10cc9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:57:23.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefa840 0x1193650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefa840 0x1193650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47182/0 (socket says 172.21.15.50:47182) 2023-11-28T11:57:23.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8659c700 1 -- 172.21.15.50:0/3386356065 learned_addr learned my addr 172.21.15.50:0/3386356065 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:23.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe86d9d700 1 --2- 172.21.15.50:0/3386356065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf458c0 0x1191540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe85d9b700 1 --2- 172.21.15.50:0/3386356065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xefac10 0x1193b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8659c700 1 -- 172.21.15.50:0/3386356065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf458c0 msgr2=0x1191540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:23.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8659c700 1 --2- 172.21.15.50:0/3386356065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf458c0 0x1191540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8659c700 1 -- 172.21.15.50:0/3386356065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xefac10 msgr2=0x1193b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8659c700 1 --2- 172.21.15.50:0/3386356065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xefac10 0x1193b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.508+0000 7efe8659c700 1 -- 172.21.15.50:0/3386356065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe880ac0f0 con 0xefa840 2023-11-28T11:57:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8659c700 1 --2- 172.21.15.50:0/3386356065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefa840 0x1193650 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7efe7c001760 tx=0x7efe7c001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9e17c5ebdfffe6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe657fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:57:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe657fa700 1 -- 172.21.15.50:0/3386356065 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c014d40 con 0xefa840 2023-11-28T11:57:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe657fa700 1 -- 172.21.15.50:0/3386356065 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7efe7c01c040 con 0xefa840 2023-11-28T11:57:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 1 -- 172.21.15.50:0/3386356065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x10cc0e0 con 0xefa840 2023-11-28T11:57:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe657fa700 1 -- 172.21.15.50:0/3386356065 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe7c014ea0 con 0xefa840 2023-11-28T11:57:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 10 client.6759 fetch_fsmap learned FSMap version 32 2023-11-28T11:57:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 1 -- 172.21.15.50:0/3386356065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0xf46b10 con 0xefa840 2023-11-28T11:57:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe657fa700 1 -- 172.21.15.50:0/3386356065 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x10cc0e0 con 0xefa840 2023-11-28T11:57:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe657fa700 1 -- 172.21.15.50:0/3386356065 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7efe7c02a3f0 con 0xefa840 2023-11-28T11:57:23.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 10 client.6759 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T11:57:23.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 10 client.6759 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-28T11:57:23.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 20 client.6759 populate_metadata read hostname 'smithi050' 2023-11-28T11:57:23.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 1 --2- 172.21.15.50:0/3386356065 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x1191f70 0x11bb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 4 client.6759 mds_command: new command op to 6510 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:57:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 1 -- 172.21.15.50:0/3386356065 --> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x10cbe00 con 0x1191f70 2023-11-28T11:57:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe85d9b700 1 --2- 172.21.15.50:0/3386356065 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x1191f70 0x11bb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe85d9b700 1 --2- 172.21.15.50:0/3386356065 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x1191f70 0x11bb070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=417af2b757bf17a9 server_cookie=66f7645f5be15252 in_seq=0 out_seq=0 2023-11-28T11:57:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe657fa700 10 client.6759 ms_handle_connect on v2:172.21.15.50:6834/3894924751 2023-11-28T11:57:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe657fa700 1 -- 172.21.15.50:0/3386356065 <== mds.0 v2:172.21.15.50:6834/3894924751 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x10cbe00 con 0x1191f70 2023-11-28T11:57:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe657fa700 10 client.6759 handle_command_reply: tid=0 2023-11-28T11:57:23.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 1 client.6759 shutdown 2023-11-28T11:57:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 1 -- 172.21.15.50:0/3386356065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefa840 msgr2=0x1193650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 1 --2- 172.21.15.50:0/3386356065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefa840 0x1193650 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7efe7c001760 tx=0x7efe7c001080 comp rx=0 tx=0).stop 2023-11-28T11:57:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 1 -- 172.21.15.50:0/3386356065 shutdown_connections 2023-11-28T11:57:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 1 --2- 172.21.15.50:0/3386356065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf458c0 0x1191540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 1 --2- 172.21.15.50:0/3386356065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xefac10 0x1193b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 1 --2- 172.21.15.50:0/3386356065 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x1191f70 0x11bb070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 1 --2- 172.21.15.50:0/3386356065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefa840 0x1193650 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe657fa700 0 client.6759 ms_handle_reset on v2:172.21.15.50:6834/3894924751 2023-11-28T11:57:23.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 1 -- 172.21.15.50:0/3386356065 >> 172.21.15.50:0/3386356065 conn(0xefafe0 msgr2=0x118a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:23.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 1 -- 172.21.15.50:0/3386356065 shutdown_connections 2023-11-28T11:57:23.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 1 -- 172.21.15.50:0/3386356065 wait complete. 2023-11-28T11:57:23.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.512+0000 7efe8fafe740 20 client.6759 trim_cache size 0 max 16384 2023-11-28T11:57:23.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe8fafe740 1 Processor -- start 2023-11-28T11:57:23.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe8fafe740 1 -- start start 2023-11-28T11:57:23.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe8fafe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefac10 0x118eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe8fafe740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf458c0 0x118f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe8fafe740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x116be40 0x116c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe8fafe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x10d19b0 con 0xefac10 2023-11-28T11:57:23.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe8fafe740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x1069d20 con 0xf458c0 2023-11-28T11:57:23.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe8fafe740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1098440 con 0x116be40 2023-11-28T11:57:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe8659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefac10 0x118eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe8659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefac10 0x118eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47186/0 (socket says 172.21.15.50:47186) 2023-11-28T11:57:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe8659c700 1 -- 172.21.15.50:0/4136121491 learned_addr learned my addr 172.21.15.50:0/4136121491 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe85d9b700 1 --2- 172.21.15.50:0/4136121491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf458c0 0x118f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe86d9d700 1 --2- 172.21.15.50:0/4136121491 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x116be40 0x116c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe8659c700 1 -- 172.21.15.50:0/4136121491 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x116be40 msgr2=0x116c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe8659c700 1 --2- 172.21.15.50:0/4136121491 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x116be40 0x116c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe8659c700 1 -- 172.21.15.50:0/4136121491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf458c0 msgr2=0x118f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:23.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe8659c700 1 --2- 172.21.15.50:0/4136121491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf458c0 0x118f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe8659c700 1 -- 172.21.15.50:0/4136121491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe880aeb90 con 0xefac10 2023-11-28T11:57:23.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe8659c700 1 --2- 172.21.15.50:0/4136121491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefac10 0x118eb00 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00fbf0 tx=0x7efe7c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576f6df5cb7c0b65 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe74ff9700 1 -- 172.21.15.50:0/4136121491 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c02ab90 con 0xefac10 2023-11-28T11:57:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe74ff9700 1 -- 172.21.15.50:0/4136121491 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c0149b0 con 0xefac10 2023-11-28T11:57:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.532+0000 7efe74ff9700 1 -- 172.21.15.50:0/4136121491 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c02a950 con 0xefac10 2023-11-28T11:57:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 -- 172.21.15.50:0/4136121491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefac10 msgr2=0x118eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 --2- 172.21.15.50:0/4136121491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefac10 0x118eb00 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00fbf0 tx=0x7efe7c021000 comp rx=0 tx=0).stop 2023-11-28T11:57:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 -- 172.21.15.50:0/4136121491 shutdown_connections 2023-11-28T11:57:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 --2- 172.21.15.50:0/4136121491 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x116be40 0x116c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 --2- 172.21.15.50:0/4136121491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf458c0 0x118f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 --2- 172.21.15.50:0/4136121491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefac10 0x118eb00 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 -- 172.21.15.50:0/4136121491 >> 172.21.15.50:0/4136121491 conn(0xefafe0 msgr2=0x11c1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 -- 172.21.15.50:0/4136121491 shutdown_connections 2023-11-28T11:57:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 -- 172.21.15.50:0/4136121491 wait complete. 2023-11-28T11:57:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 -- start start 2023-11-28T11:57:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 Processor -- start 2023-11-28T11:57:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefac10 0x11c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf458c0 0x1212280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x116be40 0x11cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x11d08b0 con 0xefac10 2023-11-28T11:57:23.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x1193f70 con 0xf458c0 2023-11-28T11:57:23.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x12127c0 con 0x116be40 2023-11-28T11:57:23.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 10 client.0 _ll_register_callbacks cb 0x7efe7c001350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:57:23.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefac10 0x11c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefac10 0x11c1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47202/0 (socket says 172.21.15.50:47202) 2023-11-28T11:57:23.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8659c700 1 -- 172.21.15.50:0/1718016229 learned_addr learned my addr 172.21.15.50:0/1718016229 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:23.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe85d9b700 1 --2- 172.21.15.50:0/1718016229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf458c0 0x1212280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe86d9d700 1 --2- 172.21.15.50:0/1718016229 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x116be40 0x11cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8659c700 1 -- 172.21.15.50:0/1718016229 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x116be40 msgr2=0x11cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8659c700 1 --2- 172.21.15.50:0/1718016229 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x116be40 0x11cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8659c700 1 -- 172.21.15.50:0/1718016229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf458c0 msgr2=0x1212280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8659c700 1 --2- 172.21.15.50:0/1718016229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf458c0 0x1212280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8659c700 1 -- 172.21.15.50:0/1718016229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xf46b10 con 0xefac10 2023-11-28T11:57:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe85d9b700 1 --2- 172.21.15.50:0/1718016229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf458c0 0x1212280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8659c700 1 --2- 172.21.15.50:0/1718016229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefac10 0x11c1c60 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7efe7c011010 tx=0x7efe7c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a8287237521ad2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe657fa700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:57:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe657fa700 1 -- 172.21.15.50:0/1718016229 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0149b0 con 0xefac10 2023-11-28T11:57:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 -- 172.21.15.50:0/1718016229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xf77390 con 0xefac10 2023-11-28T11:57:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe657fa700 1 -- 172.21.15.50:0/1718016229 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7efe7c006860 con 0xefac10 2023-11-28T11:57:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe657fa700 1 -- 172.21.15.50:0/1718016229 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe7c006a20 con 0xefac10 2023-11-28T11:57:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 10 client.6765 fetch_fsmap learned FSMap version 32 2023-11-28T11:57:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 1 -- 172.21.15.50:0/1718016229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x107faf0 con 0xefac10 2023-11-28T11:57:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe657fa700 1 -- 172.21.15.50:0/1718016229 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xf77390 con 0xefac10 2023-11-28T11:57:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe657fa700 1 -- 172.21.15.50:0/1718016229 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7efe7c006b80 con 0xefac10 2023-11-28T11:57:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 10 client.6765 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T11:57:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.536+0000 7efe8fafe740 10 client.6765 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-28T11:57:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8fafe740 20 client.6765 populate_metadata read hostname 'smithi050' 2023-11-28T11:57:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8fafe740 1 --2- 172.21.15.50:0/1718016229 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x1189010 0x1189410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8fafe740 4 client.6765 mds_command: new command op to 6510 tid=0[{"prefix": "scrub status"}] 2023-11-28T11:57:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8fafe740 1 -- 172.21.15.50:0/1718016229 --> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xf08390 con 0x1189010 2023-11-28T11:57:23.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe85d9b700 1 --2- 172.21.15.50:0/1718016229 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x1189010 0x1189410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe657fa700 10 client.6765 ms_handle_connect on v2:172.21.15.50:6834/3894924751 2023-11-28T11:57:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe85d9b700 1 --2- 172.21.15.50:0/1718016229 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x1189010 0x1189410 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c761ab3e9ce9559 server_cookie=1ea564aafe52fb84 in_seq=0 out_seq=0 2023-11-28T11:57:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe657fa700 1 -- 172.21.15.50:0/1718016229 <== mds.0 v2:172.21.15.50:6834/3894924751 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0xf08390 con 0x1189010 2023-11-28T11:57:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe657fa700 10 client.6765 handle_command_reply: tid=0 2023-11-28T11:57:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8fafe740 1 client.6765 shutdown 2023-11-28T11:57:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8fafe740 1 -- 172.21.15.50:0/1718016229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefac10 msgr2=0x11c1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8fafe740 1 --2- 172.21.15.50:0/1718016229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefac10 0x11c1c60 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7efe7c011010 tx=0x7efe7c014000 comp rx=0 tx=0).stop 2023-11-28T11:57:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8fafe740 1 -- 172.21.15.50:0/1718016229 shutdown_connections 2023-11-28T11:57:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8fafe740 1 --2- 172.21.15.50:0/1718016229 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x116be40 0x11cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8fafe740 1 --2- 172.21.15.50:0/1718016229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf458c0 0x1212280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8fafe740 1 --2- 172.21.15.50:0/1718016229 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x1189010 0x1189410 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8fafe740 1 --2- 172.21.15.50:0/1718016229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xefac10 0x11c1c60 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe657fa700 0 client.6765 ms_handle_reset on v2:172.21.15.50:6834/3894924751 2023-11-28T11:57:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8fafe740 1 -- 172.21.15.50:0/1718016229 >> 172.21.15.50:0/1718016229 conn(0xefafe0 msgr2=0x11c0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8fafe740 1 -- 172.21.15.50:0/1718016229 shutdown_connections 2023-11-28T11:57:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8fafe740 1 -- 172.21.15.50:0/1718016229 wait complete. 2023-11-28T11:57:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8fafe740 20 client.6765 trim_cache size 0 max 16384 2023-11-28T11:57:23.551 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:57:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2023-11-28T11:57:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2023-11-28T11:57:23.551 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:57:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8759e700 1 -- 172.21.15.50:0/3125557289 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efe68064ee0 msgr2=0x7efe68067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8759e700 1 --2- 172.21.15.50:0/3125557289 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efe68064ee0 0x7efe68067390 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efe7c007fd0 tx=0x7efe7c009040 comp rx=0 tx=0).stop 2023-11-28T11:57:23.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8759e700 1 -- 172.21.15.50:0/3125557289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe880b00e0 msgr2=0x7efe88071c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8759e700 1 --2- 172.21.15.50:0/3125557289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe880b00e0 0x7efe88071c70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7efe8806f640 tx=0x7efe78004af0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8759e700 1 -- 172.21.15.50:0/3125557289 shutdown_connections 2023-11-28T11:57:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8759e700 1 --2- 172.21.15.50:0/3125557289 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efe68064ee0 0x7efe68067390 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8759e700 1 --2- 172.21.15.50:0/3125557289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe880cbb30 0x7efe880ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8759e700 1 --2- 172.21.15.50:0/3125557289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe880b00e0 0x7efe88071c70 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8759e700 1 --2- 172.21.15.50:0/3125557289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe8809bdb0 0x7efe881508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8759e700 1 -- 172.21.15.50:0/3125557289 >> 172.21.15.50:0/3125557289 conn(0x7efe880cae70 msgr2=0x7efe8806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8759e700 1 -- 172.21.15.50:0/3125557289 shutdown_connections 2023-11-28T11:57:23.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.540+0000 7efe8759e700 1 -- 172.21.15.50:0/3125557289 wait complete. 2023-11-28T11:57:23.560 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-28T11:57:23.560 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:57:23.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.680+0000 7ff443fff700 1 Processor -- start 2023-11-28T11:57:23.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.680+0000 7ff443fff700 1 -- start start 2023-11-28T11:57:23.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff443fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4440cb470 0x7ff444164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff443fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44406ace0 con 0x7ff444069c40 2023-11-28T11:57:23.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff443fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44406a0d0 con 0x7ff444159e70 2023-11-28T11:57:23.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff443fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44406a3b0 con 0x7ff4440cb470 2023-11-28T11:57:23.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff4427fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff444069c40 0x7ff4440cad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49518/0 (socket says 172.21.15.50:49518) 2023-11-28T11:57:23.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff4427fc700 1 -- 172.21.15.50:0/2237209747 learned_addr learned my addr 172.21.15.50:0/2237209747 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:57:23.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff4437fe700 1 --2- 172.21.15.50:0/2237209747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4440cb470 0x7ff444164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff441ffb700 1 -- 172.21.15.50:0/2237209747 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234140023 0 0) 0x7ff44406ace0 con 0x7ff444069c40 2023-11-28T11:57:23.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff441ffb700 1 -- 172.21.15.50:0/2237209747 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff42c0035d0 con 0x7ff444069c40 2023-11-28T11:57:23.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff441ffb700 1 -- 172.21.15.50:0/2237209747 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3614251904 0 0) 0x7ff44406a0d0 con 0x7ff444159e70 2023-11-28T11:57:23.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff441ffb700 1 -- 172.21.15.50:0/2237209747 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff44406ace0 con 0x7ff444159e70 2023-11-28T11:57:23.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff4437fe700 1 -- 172.21.15.50:0/2237209747 >> v1:172.21.15.192:6789/0 conn(0x7ff444159e70 legacy=0x7ff44406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff4437fe700 1 -- 172.21.15.50:0/2237209747 >> v1:172.21.15.50:6789/0 conn(0x7ff444069c40 legacy=0x7ff4440cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff4437fe700 1 -- 172.21.15.50:0/2237209747 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44406a690 con 0x7ff4440cb470 2023-11-28T11:57:23.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff4437fe700 1 --2- 172.21.15.50:0/2237209747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4440cb470 0x7ff444164a20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009880 tx=0x7ff43c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8e3b033f4ff5c77 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:23.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff441ffb700 1 -- 172.21.15.50:0/2237209747 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c011830 con 0x7ff4440cb470 2023-11-28T11:57:23.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff441ffb700 1 -- 172.21.15.50:0/2237209747 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c011990 con 0x7ff4440cb470 2023-11-28T11:57:23.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff441ffb700 1 -- 172.21.15.50:0/2237209747 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c011d20 con 0x7ff4440cb470 2023-11-28T11:57:23.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff443fff700 1 -- 172.21.15.50:0/2237209747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4440cb470 msgr2=0x7ff444164a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff443fff700 1 --2- 172.21.15.50:0/2237209747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4440cb470 0x7ff444164a20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009880 tx=0x7ff43c009b90 comp rx=0 tx=0).stop 2023-11-28T11:57:23.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff443fff700 1 -- 172.21.15.50:0/2237209747 shutdown_connections 2023-11-28T11:57:23.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff443fff700 1 --2- 172.21.15.50:0/2237209747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4440cb470 0x7ff444164a20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff443fff700 1 -- 172.21.15.50:0/2237209747 >> 172.21.15.50:0/2237209747 conn(0x7ff4440ce3e0 msgr2=0x7ff4440ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:23.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff443fff700 1 -- 172.21.15.50:0/2237209747 shutdown_connections 2023-11-28T11:57:23.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.684+0000 7ff443fff700 1 -- 172.21.15.50:0/2237209747 wait complete. 2023-11-28T11:57:23.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff443fff700 1 Processor -- start 2023-11-28T11:57:23.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff443fff700 1 -- start start 2023-11-28T11:57:23.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff443fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff444069c40 0x7ff444153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff443fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4440cb470 0x7ff4440c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff443fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff444159e70 0x7ff4440c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff443fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff444153c00 con 0x7ff4440cb470 2023-11-28T11:57:23.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff443fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff444156420 con 0x7ff444159e70 2023-11-28T11:57:23.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff443fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff444156d80 con 0x7ff444069c40 2023-11-28T11:57:23.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff4427fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4440cb470 0x7ff4440c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff4427fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4440cb470 0x7ff4440c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47212/0 (socket says 172.21.15.50:47212) 2023-11-28T11:57:23.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff4427fc700 1 -- 172.21.15.50:0/3029168529 learned_addr learned my addr 172.21.15.50:0/3029168529 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:23.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff442ffd700 1 --2- 172.21.15.50:0/3029168529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff444069c40 0x7ff444153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff4437fe700 1 --2- 172.21.15.50:0/3029168529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff444159e70 0x7ff4440c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff4427fc700 1 -- 172.21.15.50:0/3029168529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff444069c40 msgr2=0x7ff444153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff4427fc700 1 --2- 172.21.15.50:0/3029168529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff444069c40 0x7ff444153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff4427fc700 1 -- 172.21.15.50:0/3029168529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff444159e70 msgr2=0x7ff4440c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff4427fc700 1 --2- 172.21.15.50:0/3029168529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff444159e70 0x7ff4440c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff4427fc700 1 -- 172.21.15.50:0/3029168529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c0094b0 con 0x7ff4440cb470 2023-11-28T11:57:23.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff4437fe700 1 --2- 172.21.15.50:0/3029168529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff444159e70 0x7ff4440c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:23.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff4427fc700 1 --2- 172.21.15.50:0/3029168529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4440cb470 0x7ff4440c3a70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff43400cbf0 tx=0x7ff43400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:23.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff42b7fe700 1 -- 172.21.15.50:0/3029168529 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43400a9a0 con 0x7ff4440cb470 2023-11-28T11:57:23.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff42b7fe700 1 -- 172.21.15.50:0/3029168529 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43400ab00 con 0x7ff4440cb470 2023-11-28T11:57:23.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff443fff700 1 -- 172.21.15.50:0/3029168529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44406d0b0 con 0x7ff4440cb470 2023-11-28T11:57:23.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff42b7fe700 1 -- 172.21.15.50:0/3029168529 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43400ae90 con 0x7ff4440cb470 2023-11-28T11:57:23.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff443fff700 1 -- 172.21.15.50:0/3029168529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44406a970 con 0x7ff4440cb470 2023-11-28T11:57:23.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.688+0000 7ff443fff700 1 -- 172.21.15.50:0/3029168529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44415a240 con 0x7ff4440cb470 2023-11-28T11:57:23.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.692+0000 7ff42b7fe700 1 -- 172.21.15.50:0/3029168529 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff434019030 con 0x7ff4440cb470 2023-11-28T11:57:23.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.692+0000 7ff42b7fe700 1 --2- 172.21.15.50:0/3029168529 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff430064f10 0x7ff4300673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:23.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.692+0000 7ff42b7fe700 1 -- 172.21.15.50:0/3029168529 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff434081a00 con 0x7ff4440cb470 2023-11-28T11:57:23.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.692+0000 7ff442ffd700 1 --2- 172.21.15.50:0/3029168529 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff430064f10 0x7ff4300673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:23.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.692+0000 7ff442ffd700 1 --2- 172.21.15.50:0/3029168529 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff430064f10 0x7ff4300673c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff4380017b0 tx=0x7ff438009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:23.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.700+0000 7ff42b7fe700 1 -- 172.21.15.50:0/3029168529 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff43404f9e0 con 0x7ff4440cb470 2023-11-28T11:57:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.900+0000 7ff443fff700 1 -- 172.21.15.50:0/3029168529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4441588a0 con 0x7ff4440cb470 2023-11-28T11:57:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.900+0000 7ff42b7fe700 1 -- 172.21.15.50:0/3029168529 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4653 (secure 0 0 0) 0x7ff43400ce60 con 0x7ff4440cb470 2023-11-28T11:57:23.903 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:57:23.903 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1573599194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1573599194},{"type":"v1","addr":"172.21.15.192:6836","nonce":1573599194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6445,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/983935617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":983935617},{"type":"v1","addr":"172.21.15.192:6837","nonce":983935617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2516263109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2516263109},{"type":"v1","addr":"172.21.15.50:6833","nonce":2516263109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:56:40.385672+0000","modified":"2023-11-28T11:56:56.456234+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":7,"addr":"172.21.15.50:6835/3894924751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3894924751},{"type":"v1","addr":"172.21.15.50:6835","nonce":3894924751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:57:23.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.904+0000 7ff443fff700 1 -- 172.21.15.50:0/3029168529 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff430064f10 msgr2=0x7ff4300673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.904+0000 7ff443fff700 1 --2- 172.21.15.50:0/3029168529 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff430064f10 0x7ff4300673c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff4380017b0 tx=0x7ff438009040 comp rx=0 tx=0).stop 2023-11-28T11:57:23.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.904+0000 7ff443fff700 1 -- 172.21.15.50:0/3029168529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4440cb470 msgr2=0x7ff4440c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:23.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.904+0000 7ff443fff700 1 --2- 172.21.15.50:0/3029168529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4440cb470 0x7ff4440c3a70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff43400cbf0 tx=0x7ff43400cc20 comp rx=0 tx=0).stop 2023-11-28T11:57:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.904+0000 7ff443fff700 1 -- 172.21.15.50:0/3029168529 shutdown_connections 2023-11-28T11:57:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.904+0000 7ff443fff700 1 --2- 172.21.15.50:0/3029168529 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff430064f10 0x7ff4300673c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.904+0000 7ff443fff700 1 --2- 172.21.15.50:0/3029168529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff444159e70 0x7ff4440c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.904+0000 7ff443fff700 1 --2- 172.21.15.50:0/3029168529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4440cb470 0x7ff4440c3a70 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.904+0000 7ff443fff700 1 --2- 172.21.15.50:0/3029168529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff444069c40 0x7ff444153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.904+0000 7ff443fff700 1 -- 172.21.15.50:0/3029168529 >> 172.21.15.50:0/3029168529 conn(0x7ff4440ce3e0 msgr2=0x7ff4440ab9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.904+0000 7ff443fff700 1 -- 172.21.15.50:0/3029168529 shutdown_connections 2023-11-28T11:57:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:23.904+0000 7ff443fff700 1 -- 172.21.15.50:0/3029168529 wait complete. 2023-11-28T11:57:23.909 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 32 2023-11-28T11:57:23.918 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2023-11-28T11:57:24.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f1855d91700 1 Processor -- start 2023-11-28T11:57:24.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f1855d91700 1 -- start start 2023-11-28T11:57:24.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f1855d91700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f18500b00e0 0x7f185015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f1855d91700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18500cbb30 0x7f185006bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f1855d91700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18500b2db0 con 0x7f185009bdb0 2023-11-28T11:57:24.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f1855d91700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18500b3240 con 0x7f18500b00e0 2023-11-28T11:57:24.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f1855d91700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185006d840 con 0x7f18500cbb30 2023-11-28T11:57:24.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f1854d8f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f18500b00e0 0x7f185015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f184ffff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f185009bdb0 0x7f185015d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:36454/0 (socket says 172.21.15.50:36454) 2023-11-28T11:57:24.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f1855590700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18500cbb30 0x7f185006bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f184ffff700 1 -- 172.21.15.50:0/4104984752 learned_addr learned my addr 172.21.15.50:0/4104984752 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:57:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f1854d8f700 1 -- 172.21.15.50:0/4104984752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18500cbb30 msgr2=0x7f185006bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f1854d8f700 1 --2- 172.21.15.50:0/4104984752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18500cbb30 0x7f185006bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f1854d8f700 1 -- 172.21.15.50:0/4104984752 >> v1:172.21.15.192:6789/0 conn(0x7f185009bdb0 legacy=0x7f185015d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f1854d8f700 1 -- 172.21.15.50:0/4104984752 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185006d560 con 0x7f18500b00e0 2023-11-28T11:57:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f1854d8f700 1 --2- 172.21.15.50:0/4104984752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18500b00e0 0x7f185015d2e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f184000baf0 tx=0x7f184000be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b55fa1d55d77cf73 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f184f7fe700 1 -- 172.21.15.50:0/4104984752 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184000dc70 con 0x7f18500b00e0 2023-11-28T11:57:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f184f7fe700 1 -- 172.21.15.50:0/4104984752 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184000ddd0 con 0x7f18500b00e0 2023-11-28T11:57:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.036+0000 7f184f7fe700 1 -- 172.21.15.50:0/4104984752 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840010690 con 0x7f18500b00e0 2023-11-28T11:57:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1855d91700 1 -- 172.21.15.50:0/4104984752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18500b00e0 msgr2=0x7f185015d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1855d91700 1 --2- 172.21.15.50:0/4104984752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18500b00e0 0x7f185015d2e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f184000baf0 tx=0x7f184000be00 comp rx=0 tx=0).stop 2023-11-28T11:57:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1855d91700 1 -- 172.21.15.50:0/4104984752 shutdown_connections 2023-11-28T11:57:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1855d91700 1 --2- 172.21.15.50:0/4104984752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18500cbb30 0x7f185006bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1855d91700 1 --2- 172.21.15.50:0/4104984752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18500b00e0 0x7f185015d2e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1855d91700 1 -- 172.21.15.50:0/4104984752 >> 172.21.15.50:0/4104984752 conn(0x7f18500cae70 msgr2=0x7f18500cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1855d91700 1 -- 172.21.15.50:0/4104984752 shutdown_connections 2023-11-28T11:57:24.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1855d91700 1 -- 172.21.15.50:0/4104984752 wait complete. 2023-11-28T11:57:24.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1855d91700 1 Processor -- start 2023-11-28T11:57:24.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1855d91700 1 -- start start 2023-11-28T11:57:24.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1855d91700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185009bdb0 0x7f185014c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1855d91700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18500b00e0 0x7f185009b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1855d91700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18500cbb30 0x7f185006c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1855d91700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18500c83f0 con 0x7f185009bdb0 2023-11-28T11:57:24.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1855d91700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18500c7870 con 0x7f18500b00e0 2023-11-28T11:57:24.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1855d91700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18500c7b50 con 0x7f18500cbb30 2023-11-28T11:57:24.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1854d8f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185009bdb0 0x7f185014c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1854d8f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185009bdb0 0x7f185014c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47226/0 (socket says 172.21.15.50:47226) 2023-11-28T11:57:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1854d8f700 1 -- 172.21.15.50:0/1732114653 learned_addr learned my addr 172.21.15.50:0/1732114653 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f184ffff700 1 --2- 172.21.15.50:0/1732114653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18500b00e0 0x7f185009b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1855590700 1 --2- 172.21.15.50:0/1732114653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18500cbb30 0x7f185006c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1854d8f700 1 -- 172.21.15.50:0/1732114653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18500cbb30 msgr2=0x7f185006c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1854d8f700 1 --2- 172.21.15.50:0/1732114653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18500cbb30 0x7f185006c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1854d8f700 1 -- 172.21.15.50:0/1732114653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18500b00e0 msgr2=0x7f185009b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1854d8f700 1 --2- 172.21.15.50:0/1732114653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18500b00e0 0x7f185009b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f1854d8f700 1 -- 172.21.15.50:0/1732114653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184000b750 con 0x7f185009bdb0 2023-11-28T11:57:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.040+0000 7f184ffff700 1 --2- 172.21.15.50:0/1732114653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18500b00e0 0x7f185009b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.044+0000 7f1854d8f700 1 --2- 172.21.15.50:0/1732114653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185009bdb0 0x7f185014c740 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f184000b2c0 tx=0x7f1840004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.044+0000 7f184d7fa700 1 -- 172.21.15.50:0/1732114653 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840003d00 con 0x7f185009bdb0 2023-11-28T11:57:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.044+0000 7f184d7fa700 1 -- 172.21.15.50:0/1732114653 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1840003e80 con 0x7f185009bdb0 2023-11-28T11:57:24.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.044+0000 7f1855d91700 1 -- 172.21.15.50:0/1732114653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18500ac3d0 con 0x7f185009bdb0 2023-11-28T11:57:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.044+0000 7f184d7fa700 1 -- 172.21.15.50:0/1732114653 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18400106b0 con 0x7f185009bdb0 2023-11-28T11:57:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.044+0000 7f1855d91700 1 -- 172.21.15.50:0/1732114653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18500ac0f0 con 0x7f185009bdb0 2023-11-28T11:57:24.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.044+0000 7f184d7fa700 1 -- 172.21.15.50:0/1732114653 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1840029020 con 0x7f185009bdb0 2023-11-28T11:57:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.044+0000 7f184d7fa700 1 --2- 172.21.15.50:0/1732114653 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f183c064f10 0x7f183c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.044+0000 7f184d7fa700 1 -- 172.21.15.50:0/1732114653 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1840083810 con 0x7f185009bdb0 2023-11-28T11:57:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.044+0000 7f185a273740 1 Processor -- start 2023-11-28T11:57:24.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.044+0000 7f184ffff700 1 --2- 172.21.15.50:0/1732114653 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f183c064f10 0x7f183c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.044+0000 7f185a273740 1 -- start start 2023-11-28T11:57:24.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f184ffff700 1 --2- 172.21.15.50:0/1732114653 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f183c064f10 0x7f183c0673c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f185009ac80 tx=0x7f1844009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f185a273740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6cd20 0x1224420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f185a273740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6c950 0x1226970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f185a273740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xfb79d0 0x1228ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f185a273740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x10dbdc0 con 0xf6cd20 2023-11-28T11:57:24.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f185a273740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x114be20 con 0xf6c950 2023-11-28T11:57:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f185a273740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1145120 con 0xfb79d0 2023-11-28T11:57:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f1854d8f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6cd20 0x1224420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f1854d8f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6cd20 0x1224420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47236/0 (socket says 172.21.15.50:47236) 2023-11-28T11:57:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f1854d8f700 1 -- 172.21.15.50:0/419957500 learned_addr learned my addr 172.21.15.50:0/419957500 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f1855590700 1 --2- 172.21.15.50:0/419957500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xfb79d0 0x1228ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f184ffff700 1 --2- 172.21.15.50:0/419957500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6c950 0x1226970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f1854d8f700 1 -- 172.21.15.50:0/419957500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xfb79d0 msgr2=0x1228ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f1854d8f700 1 --2- 172.21.15.50:0/419957500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xfb79d0 0x1228ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f1854d8f700 1 -- 172.21.15.50:0/419957500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6c950 msgr2=0x1226970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f1854d8f700 1 --2- 172.21.15.50:0/419957500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6c950 0x1226970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f1854d8f700 1 -- 172.21.15.50:0/419957500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x116b9b0 con 0xf6cd20 2023-11-28T11:57:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f1854d8f700 1 --2- 172.21.15.50:0/419957500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6cd20 0x1224420 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1840054f40 tx=0x7f1840054f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b467a1abadb24450 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f18367fc700 1 -- 172.21.15.50:0/419957500 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840051c40 con 0xf6cd20 2023-11-28T11:57:24.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f18367fc700 1 -- 172.21.15.50:0/419957500 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1840051da0 con 0xf6cd20 2023-11-28T11:57:24.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f18367fc700 1 -- 172.21.15.50:0/419957500 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840054c40 con 0xf6cd20 2023-11-28T11:57:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f185a273740 1 -- 172.21.15.50:0/419957500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6cd20 msgr2=0x1224420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f185a273740 1 --2- 172.21.15.50:0/419957500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6cd20 0x1224420 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1840054f40 tx=0x7f1840054f70 comp rx=0 tx=0).stop 2023-11-28T11:57:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f185a273740 1 -- 172.21.15.50:0/419957500 shutdown_connections 2023-11-28T11:57:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f185a273740 1 --2- 172.21.15.50:0/419957500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xfb79d0 0x1228ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f185a273740 1 --2- 172.21.15.50:0/419957500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6c950 0x1226970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f185a273740 1 --2- 172.21.15.50:0/419957500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6cd20 0x1224420 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f185a273740 1 -- 172.21.15.50:0/419957500 >> 172.21.15.50:0/419957500 conn(0xf6d0f0 msgr2=0x1205e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f185a273740 1 -- 172.21.15.50:0/419957500 shutdown_connections 2023-11-28T11:57:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.048+0000 7f185a273740 1 -- 172.21.15.50:0/419957500 wait complete. 2023-11-28T11:57:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 1 -- start start 2023-11-28T11:57:24.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 1 Processor -- start 2023-11-28T11:57:24.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x1203210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6cd20 0x11df2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xfb79d0 0x1229030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0xff1d60 con 0xf6c950 2023-11-28T11:57:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x120a030 con 0xf6cd20 2023-11-28T11:57:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1203750 con 0xfb79d0 2023-11-28T11:57:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 10 client.0 _ll_register_callbacks cb 0x113ea60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:57:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f1854d8f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x1203210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f1854d8f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x1203210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47242/0 (socket says 172.21.15.50:47242) 2023-11-28T11:57:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f1854d8f700 1 -- 172.21.15.50:0/3536432555 learned_addr learned my addr 172.21.15.50:0/3536432555 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f1855590700 1 --2- 172.21.15.50:0/3536432555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xfb79d0 0x1229030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f184ffff700 1 --2- 172.21.15.50:0/3536432555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6cd20 0x11df2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f1854d8f700 1 -- 172.21.15.50:0/3536432555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xfb79d0 msgr2=0x1229030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f1854d8f700 1 --2- 172.21.15.50:0/3536432555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xfb79d0 0x1229030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f1854d8f700 1 -- 172.21.15.50:0/3536432555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6cd20 msgr2=0x11df2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f1854d8f700 1 --2- 172.21.15.50:0/3536432555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6cd20 0x11df2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f1854d8f700 1 -- 172.21.15.50:0/3536432555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18500ac0f0 con 0xf6c950 2023-11-28T11:57:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f1854d8f700 1 --2- 172.21.15.50:0/3536432555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x1203210 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f1840055460 tx=0x7f1840081c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944318abb1078958 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f182f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:57:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f182f7fe700 1 -- 172.21.15.50:0/3536432555 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840051c40 con 0xf6c950 2023-11-28T11:57:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f182f7fe700 1 -- 172.21.15.50:0/3536432555 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f184007e070 con 0xf6c950 2023-11-28T11:57:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 1 -- 172.21.15.50:0/3536432555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x113e1a0 con 0xf6c950 2023-11-28T11:57:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f182f7fe700 1 -- 172.21.15.50:0/3536432555 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1840051320 con 0xf6c950 2023-11-28T11:57:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 10 client.6780 fetch_fsmap learned FSMap version 32 2023-11-28T11:57:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 1 -- 172.21.15.50:0/3536432555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0xfb8c20 con 0xf6c950 2023-11-28T11:57:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f182f7fe700 1 -- 172.21.15.50:0/3536432555 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x113e1a0 con 0xf6c950 2023-11-28T11:57:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f182f7fe700 1 -- 172.21.15.50:0/3536432555 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f1840051480 con 0xf6c950 2023-11-28T11:57:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 10 client.6780 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T11:57:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 10 client.6780 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T11:57:24.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 20 client.6780 populate_metadata read hostname 'smithi050' 2023-11-28T11:57:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 1 --2- 172.21.15.50:0/3536432555 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x12084d0 0x12088a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 4 client.6780 mds_command: new command op to 6510 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T11:57:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.052+0000 7f185a273740 1 -- 172.21.15.50:0/3536432555 --> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x113dec0 con 0x12084d0 2023-11-28T11:57:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f184ffff700 1 --2- 172.21.15.50:0/3536432555 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x12084d0 0x12088a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f184ffff700 1 --2- 172.21.15.50:0/3536432555 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x12084d0 0x12088a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d98c2dfc1e10f021 server_cookie=ae1afc4d22eb1509 in_seq=0 out_seq=0 2023-11-28T11:57:24.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f182f7fe700 10 client.6780 ms_handle_connect on v2:172.21.15.50:6834/3894924751 2023-11-28T11:57:24.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f182f7fe700 1 -- 172.21.15.50:0/3536432555 <== mds.0 v2:172.21.15.50:6834/3894924751 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x113dec0 con 0x12084d0 2023-11-28T11:57:24.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f182f7fe700 10 client.6780 handle_command_reply: tid=0 2023-11-28T11:57:24.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f185a273740 1 client.6780 shutdown 2023-11-28T11:57:24.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f185a273740 1 -- 172.21.15.50:0/3536432555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 msgr2=0x1203210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f185a273740 1 --2- 172.21.15.50:0/3536432555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x1203210 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f1840055460 tx=0x7f1840081c90 comp rx=0 tx=0).stop 2023-11-28T11:57:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f185a273740 1 -- 172.21.15.50:0/3536432555 shutdown_connections 2023-11-28T11:57:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f185a273740 1 --2- 172.21.15.50:0/3536432555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xfb79d0 0x1229030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f185a273740 1 --2- 172.21.15.50:0/3536432555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6cd20 0x11df2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f185a273740 1 --2- 172.21.15.50:0/3536432555 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0x12084d0 0x12088a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f185a273740 1 --2- 172.21.15.50:0/3536432555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x1203210 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f185a273740 1 -- 172.21.15.50:0/3536432555 >> 172.21.15.50:0/3536432555 conn(0xf6d0f0 msgr2=0x1205dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f182f7fe700 0 client.6780 ms_handle_reset on v2:172.21.15.50:6834/3894924751 2023-11-28T11:57:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f185a273740 1 -- 172.21.15.50:0/3536432555 shutdown_connections 2023-11-28T11:57:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f185a273740 1 -- 172.21.15.50:0/3536432555 wait complete. 2023-11-28T11:57:24.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.056+0000 7f185a273740 20 client.6780 trim_cache size 0 max 16384 2023-11-28T11:57:24.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.072+0000 7f185a273740 1 Processor -- start 2023-11-28T11:57:24.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.072+0000 7f185a273740 1 -- start start 2023-11-28T11:57:24.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.072+0000 7f185a273740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6d0f0 0x1232a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.072+0000 7f185a273740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x1232f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.072+0000 7f185a273740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf6cd20 0x11dda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.072+0000 7f185a273740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x114be20 con 0xf6c950 2023-11-28T11:57:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.072+0000 7f185a273740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x11dfde0 con 0xf6d0f0 2023-11-28T11:57:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.072+0000 7f185a273740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x1142930 con 0xf6cd20 2023-11-28T11:57:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f184ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x1232f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f184ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x1232f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47244/0 (socket says 172.21.15.50:47244) 2023-11-28T11:57:24.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f184ffff700 1 -- 172.21.15.50:0/3930154969 learned_addr learned my addr 172.21.15.50:0/3930154969 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:24.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f1854d8f700 1 --2- 172.21.15.50:0/3930154969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6d0f0 0x1232a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f1855590700 1 --2- 172.21.15.50:0/3930154969 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf6cd20 0x11dda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f184ffff700 1 -- 172.21.15.50:0/3930154969 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf6cd20 msgr2=0x11dda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f184ffff700 1 --2- 172.21.15.50:0/3930154969 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf6cd20 0x11dda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f184ffff700 1 -- 172.21.15.50:0/3930154969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6d0f0 msgr2=0x1232a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f184ffff700 1 --2- 172.21.15.50:0/3930154969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6d0f0 0x1232a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f184ffff700 1 -- 172.21.15.50:0/3930154969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185006cc60 con 0xf6c950 2023-11-28T11:57:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f1854d8f700 1 --2- 172.21.15.50:0/3930154969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6d0f0 0x1232a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f184ffff700 1 --2- 172.21.15.50:0/3930154969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x1232f90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f1844007040 tx=0x7f1844012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2baa7accdc201d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f1836ffd700 1 -- 172.21.15.50:0/3930154969 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184400ea50 con 0xf6c950 2023-11-28T11:57:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f1836ffd700 1 -- 172.21.15.50:0/3930154969 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1844013b90 con 0xf6c950 2023-11-28T11:57:24.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f1836ffd700 1 -- 172.21.15.50:0/3930154969 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844013d00 con 0xf6c950 2023-11-28T11:57:24.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f185a273740 1 -- 172.21.15.50:0/3930154969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 msgr2=0x1232f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f185a273740 1 --2- 172.21.15.50:0/3930154969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x1232f90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f1844007040 tx=0x7f1844012000 comp rx=0 tx=0).stop 2023-11-28T11:57:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f185a273740 1 -- 172.21.15.50:0/3930154969 shutdown_connections 2023-11-28T11:57:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f185a273740 1 --2- 172.21.15.50:0/3930154969 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf6cd20 0x11dda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f185a273740 1 --2- 172.21.15.50:0/3930154969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x1232f90 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f185a273740 1 --2- 172.21.15.50:0/3930154969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6d0f0 0x1232a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f185a273740 1 -- 172.21.15.50:0/3930154969 >> 172.21.15.50:0/3930154969 conn(0x1203380 msgr2=0x1232340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f185a273740 1 -- 172.21.15.50:0/3930154969 shutdown_connections 2023-11-28T11:57:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f185a273740 1 -- 172.21.15.50:0/3930154969 wait complete. 2023-11-28T11:57:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f185a273740 1 -- start start 2023-11-28T11:57:24.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.076+0000 7f185a273740 1 Processor -- start 2023-11-28T11:57:24.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x11dc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf6cd20 0x11db270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6d0f0 0x1201c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x1142520 con 0xf6c950 2023-11-28T11:57:24.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x11df060 con 0xf6d0f0 2023-11-28T11:57:24.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x11dad10 con 0xf6cd20 2023-11-28T11:57:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 10 client.0 _ll_register_callbacks cb 0x7f18400518f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T11:57:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f1854d8f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x11dc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f1854d8f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x11dc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47258/0 (socket says 172.21.15.50:47258) 2023-11-28T11:57:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f1854d8f700 1 -- 172.21.15.50:0/726748349 learned_addr learned my addr 172.21.15.50:0/726748349 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f184ffff700 1 --2- 172.21.15.50:0/726748349 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf6cd20 0x11db270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f1855590700 1 --2- 172.21.15.50:0/726748349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6d0f0 0x1201c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f1854d8f700 1 -- 172.21.15.50:0/726748349 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf6cd20 msgr2=0x11db270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f1854d8f700 1 --2- 172.21.15.50:0/726748349 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf6cd20 0x11db270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f1854d8f700 1 -- 172.21.15.50:0/726748349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6d0f0 msgr2=0x1201c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f1854d8f700 1 --2- 172.21.15.50:0/726748349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6d0f0 0x1201c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f1854d8f700 1 -- 172.21.15.50:0/726748349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184401d040 con 0xf6c950 2023-11-28T11:57:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f1854d8f700 1 --2- 172.21.15.50:0/726748349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x11dc170 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f184000b720 tx=0x7f1840011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41386a9cb91552b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f182f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-11-28T11:57:24.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f182f7fe700 1 -- 172.21.15.50:0/726748349 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840051c40 con 0xf6c950 2023-11-28T11:57:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f182f7fe700 1 -- 172.21.15.50:0/726748349 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1840051520 con 0xf6c950 2023-11-28T11:57:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 -- 172.21.15.50:0/726748349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1840051da0 con 0xf6c950 2023-11-28T11:57:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f182f7fe700 1 -- 172.21.15.50:0/726748349 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f184005d5c0 con 0xf6c950 2023-11-28T11:57:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 10 client.6786 fetch_fsmap learned FSMap version 32 2023-11-28T11:57:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 -- 172.21.15.50:0/726748349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x10f1b90 con 0xf6c950 2023-11-28T11:57:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f182f7fe700 1 -- 172.21.15.50:0/726748349 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1840051da0 con 0xf6c950 2023-11-28T11:57:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f182f7fe700 1 -- 172.21.15.50:0/726748349 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f1840054490 con 0xf6c950 2023-11-28T11:57:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 10 client.6786 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T11:57:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 10 client.6786 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T11:57:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 20 client.6786 populate_metadata read hostname 'smithi050' 2023-11-28T11:57:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 --2- 172.21.15.50:0/726748349 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0xfb79d0 0x11dd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 4 client.6786 mds_command: new command op to 6510 tid=0[{"prefix": "damage ls", "format": "json-pretty"}] 2023-11-28T11:57:24.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 -- 172.21.15.50:0/726748349 --> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0xfe94a0 con 0xfb79d0 2023-11-28T11:57:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f184ffff700 1 --2- 172.21.15.50:0/726748349 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0xfb79d0 0x11dd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f182f7fe700 10 client.6786 ms_handle_connect on v2:172.21.15.50:6834/3894924751 2023-11-28T11:57:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f184ffff700 1 --2- 172.21.15.50:0/726748349 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0xfb79d0 0x11dd500 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=779b45ee87ad055f server_cookie=77db5f936753de53 in_seq=0 out_seq=0 2023-11-28T11:57:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f182f7fe700 1 -- 172.21.15.50:0/726748349 <== mds.0 v2:172.21.15.50:6834/3894924751 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+141 (crc 0 0 0) 0xfe94a0 con 0xfb79d0 2023-11-28T11:57:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f182f7fe700 10 client.6786 handle_command_reply: tid=0 2023-11-28T11:57:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 client.6786 shutdown 2023-11-28T11:57:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 -- 172.21.15.50:0/726748349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 msgr2=0x11dc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 --2- 172.21.15.50:0/726748349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x11dc170 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f184000b720 tx=0x7f1840011000 comp rx=0 tx=0).stop 2023-11-28T11:57:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 -- 172.21.15.50:0/726748349 shutdown_connections 2023-11-28T11:57:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 --2- 172.21.15.50:0/726748349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0xf6d0f0 0x1201c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 --2- 172.21.15.50:0/726748349 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0xf6cd20 0x11db270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 --2- 172.21.15.50:0/726748349 >> [v2:172.21.15.50:6834/3894924751,v1:172.21.15.50:6835/3894924751] conn(0xfb79d0 0x11dd500 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 --2- 172.21.15.50:0/726748349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0xf6c950 0x11dc170 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f182f7fe700 0 client.6786 ms_handle_reset on v2:172.21.15.50:6834/3894924751 2023-11-28T11:57:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.080+0000 7f185a273740 1 -- 172.21.15.50:0/726748349 >> 172.21.15.50:0/726748349 conn(0x1203380 msgr2=0x121e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.084+0000 7f185a273740 1 -- 172.21.15.50:0/726748349 shutdown_connections 2023-11-28T11:57:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.084+0000 7f185a273740 1 -- 172.21.15.50:0/726748349 wait complete. 2023-11-28T11:57:24.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.084+0000 7f185a273740 20 client.6786 trim_cache size 0 max 16384 2023-11-28T11:57:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:57:24.087 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-11-28T11:57:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-11-28T11:57:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: "damage_type": "backtrace", 2023-11-28T11:57:24.087 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 3929572948, 2023-11-28T11:57:24.088 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1099511627777, 2023-11-28T11:57:24.088 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/dir_test/file" 2023-11-28T11:57:24.088 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-11-28T11:57:24.088 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-11-28T11:57:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.084+0000 7f1855d91700 1 -- 172.21.15.50:0/1732114653 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f183c064f10 msgr2=0x7f183c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.084+0000 7f1855d91700 1 --2- 172.21.15.50:0/1732114653 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f183c064f10 0x7f183c0673c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f185009ac80 tx=0x7f1844009040 comp rx=0 tx=0).stop 2023-11-28T11:57:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.084+0000 7f1855d91700 1 -- 172.21.15.50:0/1732114653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185009bdb0 msgr2=0x7f185014c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.084+0000 7f1855d91700 1 --2- 172.21.15.50:0/1732114653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185009bdb0 0x7f185014c740 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f184000b2c0 tx=0x7f1840004770 comp rx=0 tx=0).stop 2023-11-28T11:57:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.084+0000 7f1855d91700 1 -- 172.21.15.50:0/1732114653 shutdown_connections 2023-11-28T11:57:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.084+0000 7f1855d91700 1 --2- 172.21.15.50:0/1732114653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18500cbb30 0x7f185006c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.084+0000 7f1855d91700 1 --2- 172.21.15.50:0/1732114653 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f183c064f10 0x7f183c0673c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.084+0000 7f1855d91700 1 --2- 172.21.15.50:0/1732114653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18500b00e0 0x7f185009b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.084+0000 7f1855d91700 1 --2- 172.21.15.50:0/1732114653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185009bdb0 0x7f185014c740 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.084+0000 7f1855d91700 1 -- 172.21.15.50:0/1732114653 >> 172.21.15.50:0/1732114653 conn(0x7f18500cae70 msgr2=0x7f185015c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.084+0000 7f1855d91700 1 -- 172.21.15.50:0/1732114653 shutdown_connections 2023-11-28T11:57:24.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.084+0000 7f1855d91700 1 -- 172.21.15.50:0/1732114653 wait complete. 2023-11-28T11:57:24.098 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:57:24.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.208+0000 7efc60ffe700 1 Processor -- start 2023-11-28T11:57:24.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.208+0000 7efc60ffe700 1 -- start start 2023-11-28T11:57:24.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.208+0000 7efc60ffe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc5c0b32e0 0x7efc5c0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.208+0000 7efc60ffe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efc5c069cd0 0x7efc5c06a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.208+0000 7efc60ffe700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5c0cbe00 con 0x7efc5c1584c0 2023-11-28T11:57:24.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.208+0000 7efc60ffe700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5c06dbd0 con 0x7efc5c069cd0 2023-11-28T11:57:24.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.208+0000 7efc60ffe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0b3c30 con 0x7efc5c0b32e0 2023-11-28T11:57:24.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.208+0000 7efc5bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efc5c069cd0 0x7efc5c06a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.208+0000 7efc5b7fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7efc5c1584c0 0x7efc5c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:36456/0 (socket says 172.21.15.50:36456) 2023-11-28T11:57:24.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.208+0000 7efc5affd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc5c0b32e0 0x7efc5c0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.208+0000 7efc5b7fe700 1 -- 172.21.15.50:0/630024120 learned_addr learned my addr 172.21.15.50:0/630024120 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:57:24.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc5bfff700 1 -- 172.21.15.50:0/630024120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc5c0b32e0 msgr2=0x7efc5c0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:24.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc5bfff700 1 --2- 172.21.15.50:0/630024120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc5c0b32e0 0x7efc5c0b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc5bfff700 1 -- 172.21.15.50:0/630024120 >> v1:172.21.15.192:6789/0 conn(0x7efc5c1584c0 legacy=0x7efc5c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc5a7fc700 1 -- 172.21.15.50:0/630024120 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961934412 0 0) 0x7efc5c0cbe00 con 0x7efc5c1584c0 2023-11-28T11:57:24.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc5bfff700 1 -- 172.21.15.50:0/630024120 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c0cd0f0 con 0x7efc5c069cd0 2023-11-28T11:57:24.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc5affd700 1 --2- 172.21.15.50:0/630024120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc5c0b32e0 0x7efc5c0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:24.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc5bfff700 1 --2- 172.21.15.50:0/630024120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc5c069cd0 0x7efc5c06a0f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efc54009d90 tx=0x7efc5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c5b9cf573ce5463 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc5a7fc700 1 -- 172.21.15.50:0/630024120 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5400e070 con 0x7efc5c069cd0 2023-11-28T11:57:24.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc5a7fc700 1 -- 172.21.15.50:0/630024120 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5400bb20 con 0x7efc5c069cd0 2023-11-28T11:57:24.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc5a7fc700 1 -- 172.21.15.50:0/630024120 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc54012430 con 0x7efc5c069cd0 2023-11-28T11:57:24.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc60ffe700 1 -- 172.21.15.50:0/630024120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc5c069cd0 msgr2=0x7efc5c06a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc60ffe700 1 --2- 172.21.15.50:0/630024120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc5c069cd0 0x7efc5c06a0f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efc54009d90 tx=0x7efc5400b330 comp rx=0 tx=0).stop 2023-11-28T11:57:24.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc60ffe700 1 -- 172.21.15.50:0/630024120 shutdown_connections 2023-11-28T11:57:24.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc60ffe700 1 --2- 172.21.15.50:0/630024120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc5c069cd0 0x7efc5c06a0f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc60ffe700 1 --2- 172.21.15.50:0/630024120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc5c0b32e0 0x7efc5c0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc60ffe700 1 -- 172.21.15.50:0/630024120 >> 172.21.15.50:0/630024120 conn(0x7efc5c0ce3e0 msgr2=0x7efc5c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:24.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc60ffe700 1 -- 172.21.15.50:0/630024120 shutdown_connections 2023-11-28T11:57:24.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc60ffe700 1 -- 172.21.15.50:0/630024120 wait complete. 2023-11-28T11:57:24.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc60ffe700 1 Processor -- start 2023-11-28T11:57:24.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.212+0000 7efc60ffe700 1 -- start start 2023-11-28T11:57:24.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc60ffe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc5c069cd0 0x7efc5c156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc60ffe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc5c0b32e0 0x7efc5c0affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc60ffe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc5c1584c0 0x7efc5c0af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc60ffe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0b0510 con 0x7efc5c1584c0 2023-11-28T11:57:24.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc60ffe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0af5c0 con 0x7efc5c069cd0 2023-11-28T11:57:24.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc60ffe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c14d4e0 con 0x7efc5c0b32e0 2023-11-28T11:57:24.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc5bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc5c1584c0 0x7efc5c0af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc5bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc5c1584c0 0x7efc5c0af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47266/0 (socket says 172.21.15.50:47266) 2023-11-28T11:57:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc5bfff700 1 -- 172.21.15.50:0/2969252104 learned_addr learned my addr 172.21.15.50:0/2969252104 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc5b7fe700 1 --2- 172.21.15.50:0/2969252104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc5c069cd0 0x7efc5c156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc5affd700 1 --2- 172.21.15.50:0/2969252104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc5c0b32e0 0x7efc5c0affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc5bfff700 1 -- 172.21.15.50:0/2969252104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc5c0b32e0 msgr2=0x7efc5c0affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc5bfff700 1 --2- 172.21.15.50:0/2969252104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc5c0b32e0 0x7efc5c0affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc5bfff700 1 -- 172.21.15.50:0/2969252104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc5c069cd0 msgr2=0x7efc5c156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc5bfff700 1 --2- 172.21.15.50:0/2969252104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc5c069cd0 0x7efc5c156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc5bfff700 1 -- 172.21.15.50:0/2969252104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc500094b0 con 0x7efc5c1584c0 2023-11-28T11:57:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc5b7fe700 1 --2- 172.21.15.50:0/2969252104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc5c069cd0 0x7efc5c156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:57:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc5bfff700 1 --2- 172.21.15.50:0/2969252104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc5c1584c0 0x7efc5c0af080 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7efc54014040 tx=0x7efc54004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc43fff700 1 -- 172.21.15.50:0/2969252104 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc54012430 con 0x7efc5c1584c0 2023-11-28T11:57:24.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc43fff700 1 -- 172.21.15.50:0/2969252104 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc54020070 con 0x7efc5c1584c0 2023-11-28T11:57:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc43fff700 1 -- 172.21.15.50:0/2969252104 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc54004280 con 0x7efc5c1584c0 2023-11-28T11:57:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc60ffe700 1 -- 172.21.15.50:0/2969252104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc54009a70 con 0x7efc5c1584c0 2023-11-28T11:57:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc60ffe700 1 -- 172.21.15.50:0/2969252104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5c0cd6b0 con 0x7efc5c1584c0 2023-11-28T11:57:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.216+0000 7efc60ffe700 1 -- 172.21.15.50:0/2969252104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5c0cd3d0 con 0x7efc5c1584c0 2023-11-28T11:57:24.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.220+0000 7efc43fff700 1 -- 172.21.15.50:0/2969252104 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efc5402e070 con 0x7efc5c1584c0 2023-11-28T11:57:24.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.220+0000 7efc43fff700 1 --2- 172.21.15.50:0/2969252104 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efc48064ee0 0x7efc48067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:24.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.220+0000 7efc43fff700 1 -- 172.21.15.50:0/2969252104 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7efc54022070 con 0x7efc5c1584c0 2023-11-28T11:57:24.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.220+0000 7efc5b7fe700 1 --2- 172.21.15.50:0/2969252104 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efc48064ee0 0x7efc48067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:24.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.220+0000 7efc5b7fe700 1 --2- 172.21.15.50:0/2969252104 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efc48064ee0 0x7efc48067390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efc4c000f60 tx=0x7efc4c007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:24.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.228+0000 7efc43fff700 1 -- 172.21.15.50:0/2969252104 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efc54051bd0 con 0x7efc5c1584c0 2023-11-28T11:57:24.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.420+0000 7efc60ffe700 1 -- 172.21.15.50:0/2969252104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efc5c0cd990 con 0x7efc5c1584c0 2023-11-28T11:57:24.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.420+0000 7efc43fff700 1 -- 172.21.15.50:0/2969252104 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7efc540551f0 con 0x7efc5c1584c0 2023-11-28T11:57:24.422 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:57:24.422 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:57:24.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.424+0000 7efc60ffe700 1 -- 172.21.15.50:0/2969252104 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efc48064ee0 msgr2=0x7efc48067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.424+0000 7efc60ffe700 1 --2- 172.21.15.50:0/2969252104 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efc48064ee0 0x7efc48067390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efc4c000f60 tx=0x7efc4c007e90 comp rx=0 tx=0).stop 2023-11-28T11:57:24.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.424+0000 7efc60ffe700 1 -- 172.21.15.50:0/2969252104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc5c1584c0 msgr2=0x7efc5c0af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:24.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.424+0000 7efc60ffe700 1 --2- 172.21.15.50:0/2969252104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc5c1584c0 0x7efc5c0af080 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7efc54014040 tx=0x7efc54004af0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.424+0000 7efc60ffe700 1 -- 172.21.15.50:0/2969252104 shutdown_connections 2023-11-28T11:57:24.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.424+0000 7efc60ffe700 1 --2- 172.21.15.50:0/2969252104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc5c1584c0 0x7efc5c0af080 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.424+0000 7efc60ffe700 1 --2- 172.21.15.50:0/2969252104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc5c0b32e0 0x7efc5c0affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.424+0000 7efc60ffe700 1 --2- 172.21.15.50:0/2969252104 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efc48064ee0 0x7efc48067390 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.424+0000 7efc60ffe700 1 --2- 172.21.15.50:0/2969252104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc5c069cd0 0x7efc5c156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:24.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.424+0000 7efc60ffe700 1 -- 172.21.15.50:0/2969252104 >> 172.21.15.50:0/2969252104 conn(0x7efc5c0ce3e0 msgr2=0x7efc5c151810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:24.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.424+0000 7efc60ffe700 1 -- 172.21.15.50:0/2969252104 shutdown_connections 2023-11-28T11:57:24.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:24.424+0000 7efc60ffe700 1 -- 172.21.15.50:0/2969252104 wait complete. 2023-11-28T11:57:24.437 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:57:29.437 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:57:29.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab8818700 1 Processor -- start 2023-11-28T11:57:29.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab8818700 1 -- start start 2023-11-28T11:57:29.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab8818700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ab4156710 0x7f8ab40cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:29.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab8818700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab4156ae0 con 0x7f8ab40ce160 2023-11-28T11:57:29.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab8818700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab406b440 con 0x7f8ab40caa10 2023-11-28T11:57:29.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab8818700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab40ce600 con 0x7f8ab4156710 2023-11-28T11:57:29.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab2d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ab4156710 0x7f8ab40cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:29.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab2d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ab4156710 0x7f8ab40cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47276/0 (socket says 172.21.15.50:47276) 2023-11-28T11:57:29.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab2d9d700 1 -- 172.21.15.50:0/2075358545 learned_addr learned my addr 172.21.15.50:0/2075358545 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:29.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab2d9d700 1 -- 172.21.15.50:0/2075358545 >> v1:172.21.15.192:6789/0 conn(0x7f8ab40caa10 legacy=0x7f8ab415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab2d9d700 1 -- 172.21.15.50:0/2075358545 >> v1:172.21.15.50:6789/0 conn(0x7f8ab40ce160 legacy=0x7f8ab40ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab2d9d700 1 -- 172.21.15.50:0/2075358545 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab40cafe0 con 0x7f8ab4156710 2023-11-28T11:57:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab2d9d700 1 --2- 172.21.15.50:0/2075358545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab4156710 0x7f8ab40cdc20 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009910 tx=0x7f8aa4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bae41ebcc1c4745 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab1d9b700 1 -- 172.21.15.50:0/2075358545 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4004230 con 0x7f8ab4156710 2023-11-28T11:57:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab1d9b700 1 -- 172.21.15.50:0/2075358545 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa4004390 con 0x7f8ab4156710 2023-11-28T11:57:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab1d9b700 1 -- 172.21.15.50:0/2075358545 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4009e60 con 0x7f8ab4156710 2023-11-28T11:57:29.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab8818700 1 -- 172.21.15.50:0/2075358545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab4156710 msgr2=0x7f8ab40cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab8818700 1 --2- 172.21.15.50:0/2075358545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab4156710 0x7f8ab40cdc20 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009910 tx=0x7f8aa4009c20 comp rx=0 tx=0).stop 2023-11-28T11:57:29.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab8818700 1 -- 172.21.15.50:0/2075358545 shutdown_connections 2023-11-28T11:57:29.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab8818700 1 --2- 172.21.15.50:0/2075358545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab4156710 0x7f8ab40cdc20 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab8818700 1 -- 172.21.15.50:0/2075358545 >> 172.21.15.50:0/2075358545 conn(0x7f8ab40cb2d0 msgr2=0x7f8ab40cb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:29.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab8818700 1 -- 172.21.15.50:0/2075358545 shutdown_connections 2023-11-28T11:57:29.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.560+0000 7f8ab8818700 1 -- 172.21.15.50:0/2075358545 wait complete. 2023-11-28T11:57:29.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.564+0000 7f8ab8818700 1 Processor -- start 2023-11-28T11:57:29.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.564+0000 7f8ab8818700 1 -- start start 2023-11-28T11:57:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.564+0000 7f8ab8818700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ab40caa10 0x7f8ab4144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.564+0000 7f8ab8818700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ab40ce160 0x7f8ab4152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.564+0000 7f8ab8818700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab4156710 0x7f8ab4157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.564+0000 7f8ab8818700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab4159580 con 0x7f8ab4156710 2023-11-28T11:57:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.564+0000 7f8ab8818700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab41549a0 con 0x7f8ab40ce160 2023-11-28T11:57:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.564+0000 7f8ab8818700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab4153890 con 0x7f8ab40caa10 2023-11-28T11:57:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8ab359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab4156710 0x7f8ab4157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8ab359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab4156710 0x7f8ab4157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47284/0 (socket says 172.21.15.50:47284) 2023-11-28T11:57:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8ab359e700 1 -- 172.21.15.50:0/3716994694 learned_addr learned my addr 172.21.15.50:0/3716994694 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8ab259c700 1 --2- 172.21.15.50:0/3716994694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ab40ce160 0x7f8ab4152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8ab2d9d700 1 --2- 172.21.15.50:0/3716994694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ab40caa10 0x7f8ab4144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8ab359e700 1 -- 172.21.15.50:0/3716994694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ab40caa10 msgr2=0x7f8ab4144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8ab359e700 1 --2- 172.21.15.50:0/3716994694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ab40caa10 0x7f8ab4144080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8ab359e700 1 -- 172.21.15.50:0/3716994694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ab40ce160 msgr2=0x7f8ab4152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8ab359e700 1 --2- 172.21.15.50:0/3716994694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ab40ce160 0x7f8ab4152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8ab359e700 1 -- 172.21.15.50:0/3716994694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa4009570 con 0x7f8ab4156710 2023-11-28T11:57:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8ab259c700 1 --2- 172.21.15.50:0/3716994694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ab40ce160 0x7f8ab4152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8ab2d9d700 1 --2- 172.21.15.50:0/3716994694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ab40caa10 0x7f8ab4144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8ab359e700 1 --2- 172.21.15.50:0/3716994694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab4156710 0x7f8ab4157620 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00b9a0 tx=0x7f8aac00bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8a9b7fe700 1 -- 172.21.15.50:0/3716994694 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac00c9b0 con 0x7f8ab4156710 2023-11-28T11:57:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8a9b7fe700 1 -- 172.21.15.50:0/3716994694 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac00cb10 con 0x7f8ab4156710 2023-11-28T11:57:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8a9b7fe700 1 -- 172.21.15.50:0/3716994694 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac014440 con 0x7f8ab4156710 2023-11-28T11:57:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8ab8818700 1 -- 172.21.15.50:0/3716994694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab415fea0 con 0x7f8ab4156710 2023-11-28T11:57:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8ab8818700 1 -- 172.21.15.50:0/3716994694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab415fbc0 con 0x7f8ab4156710 2023-11-28T11:57:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.568+0000 7f8ab8818700 1 -- 172.21.15.50:0/3716994694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab4160180 con 0x7f8ab4156710 2023-11-28T11:57:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.572+0000 7f8a9b7fe700 1 -- 172.21.15.50:0/3716994694 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8aac01b030 con 0x7f8ab4156710 2023-11-28T11:57:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.572+0000 7f8a9b7fe700 1 --2- 172.21.15.50:0/3716994694 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8aa0064ee0 0x7f8aa0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.572+0000 7f8a9b7fe700 1 -- 172.21.15.50:0/3716994694 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8aac081bf0 con 0x7f8ab4156710 2023-11-28T11:57:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.572+0000 7f8ab2d9d700 1 --2- 172.21.15.50:0/3716994694 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8aa0064ee0 0x7f8aa0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.572+0000 7f8ab2d9d700 1 --2- 172.21.15.50:0/3716994694 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8aa0064ee0 0x7f8aa0067390 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009910 tx=0x7f8aa4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:29.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.576+0000 7f8a9b7fe700 1 -- 172.21.15.50:0/3716994694 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8aac04fbd0 con 0x7f8ab4156710 2023-11-28T11:57:29.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.784+0000 7f8ab8818700 1 -- 172.21.15.50:0/3716994694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8ab4072500 con 0x7f8ab4156710 2023-11-28T11:57:29.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.784+0000 7f8a9b7fe700 1 -- 172.21.15.50:0/3716994694 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f8aac0531f0 con 0x7f8ab4156710 2023-11-28T11:57:29.783 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:57:29.783 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:57:29.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.784+0000 7f8ab8818700 1 -- 172.21.15.50:0/3716994694 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8aa0064ee0 msgr2=0x7f8aa0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.784+0000 7f8ab8818700 1 --2- 172.21.15.50:0/3716994694 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8aa0064ee0 0x7f8aa0067390 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009910 tx=0x7f8aa4008030 comp rx=0 tx=0).stop 2023-11-28T11:57:29.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.784+0000 7f8ab8818700 1 -- 172.21.15.50:0/3716994694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab4156710 msgr2=0x7f8ab4157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:29.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.784+0000 7f8ab8818700 1 --2- 172.21.15.50:0/3716994694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab4156710 0x7f8ab4157620 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00b9a0 tx=0x7f8aac00bd60 comp rx=0 tx=0).stop 2023-11-28T11:57:29.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.784+0000 7f8ab8818700 1 -- 172.21.15.50:0/3716994694 shutdown_connections 2023-11-28T11:57:29.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.784+0000 7f8ab8818700 1 --2- 172.21.15.50:0/3716994694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ab4156710 0x7f8ab4157620 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.784+0000 7f8ab8818700 1 --2- 172.21.15.50:0/3716994694 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8aa0064ee0 0x7f8aa0067390 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.784+0000 7f8ab8818700 1 --2- 172.21.15.50:0/3716994694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ab40ce160 0x7f8ab4152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.784+0000 7f8ab8818700 1 --2- 172.21.15.50:0/3716994694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ab40caa10 0x7f8ab4144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:29.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.784+0000 7f8ab8818700 1 -- 172.21.15.50:0/3716994694 >> 172.21.15.50:0/3716994694 conn(0x7f8ab40cb2d0 msgr2=0x7f8ab406c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:29.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.784+0000 7f8ab8818700 1 -- 172.21.15.50:0/3716994694 shutdown_connections 2023-11-28T11:57:29.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:29.784+0000 7f8ab8818700 1 -- 172.21.15.50:0/3716994694 wait complete. 2023-11-28T11:57:29.799 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:57:34.800 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:57:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.919+0000 7f8bf7fff700 1 Processor -- start 2023-11-28T11:57:34.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.919+0000 7f8bf7fff700 1 -- start start 2023-11-28T11:57:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.919+0000 7f8bf7fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8bf81606b0 0x7f8bf80c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.919+0000 7f8bf7fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf80ad610 0x7f8bf80c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.919+0000 7f8bf7fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf80cae70 con 0x7f8bf80ceef0 2023-11-28T11:57:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.919+0000 7f8bf7fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf80cbc10 con 0x7f8bf81606b0 2023-11-28T11:57:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.919+0000 7f8bf7fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf80cb130 con 0x7f8bf80ad610 2023-11-28T11:57:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf77fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf80ad610 0x7f8bf80c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf6ffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8bf81606b0 0x7f8bf80c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:34.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf67fc700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f8bf80ceef0 0x7f8bf8164040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:49632/0 (socket says 172.21.15.50:49632) 2023-11-28T11:57:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf67fc700 1 -- 172.21.15.50:0/2673015546 learned_addr learned my addr 172.21.15.50:0/2673015546 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:57:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf77fe700 1 -- 172.21.15.50:0/2673015546 >> v2:172.21.15.192:3300/0 conn(0x7f8bf81606b0 msgr2=0x7f8bf80c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf77fe700 1 --2- 172.21.15.50:0/2673015546 >> v2:172.21.15.192:3300/0 conn(0x7f8bf81606b0 0x7f8bf80c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf5ffb700 1 -- 172.21.15.50:0/2673015546 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231559525 0 0) 0x7f8bf80cae70 con 0x7f8bf80ceef0 2023-11-28T11:57:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf77fe700 1 -- 172.21.15.50:0/2673015546 >> v1:172.21.15.192:6789/0 conn(0x7f8bf80ceef0 legacy=0x7f8bf8164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf77fe700 1 -- 172.21.15.50:0/2673015546 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf80cb410 con 0x7f8bf80ad610 2023-11-28T11:57:34.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf77fe700 1 --2- 172.21.15.50:0/2673015546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf80ad610 0x7f8bf80c18f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009d90 tx=0x7f8bf000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5703f9cdaffbff67 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:34.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf5ffb700 1 -- 172.21.15.50:0/2673015546 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000e070 con 0x7f8bf80ad610 2023-11-28T11:57:34.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf5ffb700 1 -- 172.21.15.50:0/2673015546 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf000bb20 con 0x7f8bf80ad610 2023-11-28T11:57:34.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf5ffb700 1 -- 172.21.15.50:0/2673015546 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0012430 con 0x7f8bf80ad610 2023-11-28T11:57:34.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf7fff700 1 -- 172.21.15.50:0/2673015546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf80ad610 msgr2=0x7f8bf80c18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:34.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf7fff700 1 --2- 172.21.15.50:0/2673015546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf80ad610 0x7f8bf80c18f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009d90 tx=0x7f8bf000b330 comp rx=0 tx=0).stop 2023-11-28T11:57:34.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf7fff700 1 -- 172.21.15.50:0/2673015546 shutdown_connections 2023-11-28T11:57:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf7fff700 1 --2- 172.21.15.50:0/2673015546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf80ad610 0x7f8bf80c18f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf7fff700 1 --2- 172.21.15.50:0/2673015546 >> v2:172.21.15.192:3300/0 conn(0x7f8bf81606b0 0x7f8bf80c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf7fff700 1 -- 172.21.15.50:0/2673015546 >> 172.21.15.50:0/2673015546 conn(0x7f8bf80ce3e0 msgr2=0x7f8bf80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf7fff700 1 -- 172.21.15.50:0/2673015546 shutdown_connections 2023-11-28T11:57:34.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf7fff700 1 -- 172.21.15.50:0/2673015546 wait complete. 2023-11-28T11:57:34.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf7fff700 1 Processor -- start 2023-11-28T11:57:34.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.923+0000 7f8bf7fff700 1 -- start start 2023-11-28T11:57:34.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf7fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bf80ad610 0x7f8bf815fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:34.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80ceef0 0x7f8bf81f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:34.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf7fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf81606b0 0x7f8bf815c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:34.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf7fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf81f6b60 con 0x7f8bf80ceef0 2023-11-28T11:57:34.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf7fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf815ffb0 con 0x7f8bf80ad610 2023-11-28T11:57:34.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf7fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf81f6010 con 0x7f8bf81606b0 2023-11-28T11:57:34.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80ceef0 0x7f8bf81f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:34.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf67fc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80ceef0 0x7f8bf81f5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58840/0 (socket says 172.21.15.50:58840) 2023-11-28T11:57:34.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf67fc700 1 -- 172.21.15.50:0/717325530 learned_addr learned my addr 172.21.15.50:0/717325530 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:34.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf77fe700 1 --2- 172.21.15.50:0/717325530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf81606b0 0x7f8bf815c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:34.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf6ffd700 1 --2- 172.21.15.50:0/717325530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bf80ad610 0x7f8bf815fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:34.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf67fc700 1 -- 172.21.15.50:0/717325530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf81606b0 msgr2=0x7f8bf815c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:34.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf67fc700 1 --2- 172.21.15.50:0/717325530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf81606b0 0x7f8bf815c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf67fc700 1 -- 172.21.15.50:0/717325530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bf80ad610 msgr2=0x7f8bf815fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:34.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf67fc700 1 --2- 172.21.15.50:0/717325530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bf80ad610 0x7f8bf815fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:34.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf67fc700 1 -- 172.21.15.50:0/717325530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf0009a70 con 0x7f8bf80ceef0 2023-11-28T11:57:34.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf67fc700 1 --2- 172.21.15.50:0/717325530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80ceef0 0x7f8bf81f5ad0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f8be800c4e0 tx=0x7f8be800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bdf7fe700 1 -- 172.21.15.50:0/717325530 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be8004ca0 con 0x7f8bf80ceef0 2023-11-28T11:57:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf7fff700 1 -- 172.21.15.50:0/717325530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf806ac50 con 0x7f8bf80ceef0 2023-11-28T11:57:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bdf7fe700 1 -- 172.21.15.50:0/717325530 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be8004e20 con 0x7f8bf80ceef0 2023-11-28T11:57:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf7fff700 1 -- 172.21.15.50:0/717325530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf80cb6f0 con 0x7f8bf80ceef0 2023-11-28T11:57:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bdf7fe700 1 -- 172.21.15.50:0/717325530 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be80072d0 con 0x7f8bf80ceef0 2023-11-28T11:57:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.927+0000 7f8bf7fff700 1 -- 172.21.15.50:0/717325530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf80b36c0 con 0x7f8bf80ceef0 2023-11-28T11:57:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.931+0000 7f8bdf7fe700 1 -- 172.21.15.50:0/717325530 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8be801a020 con 0x7f8bf80ceef0 2023-11-28T11:57:34.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.931+0000 7f8bdf7fe700 1 --2- 172.21.15.50:0/717325530 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8be4064ee0 0x7f8be4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:34.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.931+0000 7f8bdf7fe700 1 -- 172.21.15.50:0/717325530 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f8be8081ed0 con 0x7f8bf80ceef0 2023-11-28T11:57:34.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.931+0000 7f8bf6ffd700 1 --2- 172.21.15.50:0/717325530 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8be4064ee0 0x7f8be4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:34.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.931+0000 7f8bf6ffd700 1 --2- 172.21.15.50:0/717325530 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8be4064ee0 0x7f8be4067390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009b50 tx=0x7f8bec009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:34.939+0000 7f8bdf7fe700 1 -- 172.21.15.50:0/717325530 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8be804fda0 con 0x7f8bf80ceef0 2023-11-28T11:57:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:35.135+0000 7f8bf7fff700 1 -- 172.21.15.50:0/717325530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8bf8072500 con 0x7f8bf80ceef0 2023-11-28T11:57:35.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:35.135+0000 7f8bdf7fe700 1 -- 172.21.15.50:0/717325530 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f8be80533c0 con 0x7f8bf80ceef0 2023-11-28T11:57:35.136 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:57:35.136 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:57:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:35.135+0000 7f8bf7fff700 1 -- 172.21.15.50:0/717325530 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8be4064ee0 msgr2=0x7f8be4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:35.135+0000 7f8bf7fff700 1 --2- 172.21.15.50:0/717325530 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8be4064ee0 0x7f8be4067390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009b50 tx=0x7f8bec009240 comp rx=0 tx=0).stop 2023-11-28T11:57:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:35.135+0000 7f8bf7fff700 1 -- 172.21.15.50:0/717325530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80ceef0 msgr2=0x7f8bf81f5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:35.135+0000 7f8bf7fff700 1 --2- 172.21.15.50:0/717325530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80ceef0 0x7f8bf81f5ad0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f8be800c4e0 tx=0x7f8be800c7f0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:35.135+0000 7f8bf7fff700 1 -- 172.21.15.50:0/717325530 shutdown_connections 2023-11-28T11:57:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:35.135+0000 7f8bf7fff700 1 --2- 172.21.15.50:0/717325530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bf81606b0 0x7f8bf815c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:35.135+0000 7f8bf7fff700 1 --2- 172.21.15.50:0/717325530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf80ceef0 0x7f8bf81f5ad0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:35.135+0000 7f8bf7fff700 1 --2- 172.21.15.50:0/717325530 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8be4064ee0 0x7f8be4067390 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:35.135+0000 7f8bf7fff700 1 --2- 172.21.15.50:0/717325530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bf80ad610 0x7f8bf815fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:35.135+0000 7f8bf7fff700 1 -- 172.21.15.50:0/717325530 >> 172.21.15.50:0/717325530 conn(0x7f8bf80ce3e0 msgr2=0x7f8bf80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:35.135+0000 7f8bf7fff700 1 -- 172.21.15.50:0/717325530 shutdown_connections 2023-11-28T11:57:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:35.135+0000 7f8bf7fff700 1 -- 172.21.15.50:0/717325530 wait complete. 2023-11-28T11:57:35.150 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:57:36.385 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:57:36.388 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:57:40.151 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:57:40.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa353fff700 1 Processor -- start 2023-11-28T11:57:40.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa353fff700 1 -- start start 2023-11-28T11:57:40.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa353fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa35406b540 0x7fa3540cb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa353fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa35406d420 0x7fa3540ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa353fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3540b38c0 con 0x7fa3540c1330 2023-11-28T11:57:40.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa353fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3540cbca0 con 0x7fa35406b540 2023-11-28T11:57:40.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa353fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3540cb2d0 con 0x7fa35406d420 2023-11-28T11:57:40.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa352ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa35406b540 0x7fa3540cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa352ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa35406b540 0x7fa3540cb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58856/0 (socket says 172.21.15.50:58856) 2023-11-28T11:57:40.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa352ffd700 1 -- 172.21.15.50:0/2702809020 learned_addr learned my addr 172.21.15.50:0/2702809020 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:40.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa3537fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa3540c1330 0x7fa35406bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35852/0 (socket says 172.21.15.50:35852) 2023-11-28T11:57:40.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa3527fc700 1 --2- 172.21.15.50:0/2702809020 >> v2:172.21.15.192:3300/0 conn(0x7fa35406d420 0x7fa3540ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa352ffd700 1 -- 172.21.15.50:0/2702809020 >> v2:172.21.15.192:3300/0 conn(0x7fa35406d420 msgr2=0x7fa3540ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:40.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa352ffd700 1 --2- 172.21.15.50:0/2702809020 >> v2:172.21.15.192:3300/0 conn(0x7fa35406d420 0x7fa3540ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa352ffd700 1 -- 172.21.15.50:0/2702809020 >> v1:172.21.15.50:6789/0 conn(0x7fa3540c1330 legacy=0x7fa35406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa352ffd700 1 -- 172.21.15.50:0/2702809020 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa354160b50 con 0x7fa35406b540 2023-11-28T11:57:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa3527fc700 1 --2- 172.21.15.50:0/2702809020 >> v2:172.21.15.192:3300/0 conn(0x7fa35406d420 0x7fa3540ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa352ffd700 1 --2- 172.21.15.50:0/2702809020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa35406b540 0x7fa3540cb760 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa35406e420 tx=0x7fa33c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70cc49e024dcb6b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa351ffb700 1 -- 172.21.15.50:0/2702809020 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c005e50 con 0x7fa35406b540 2023-11-28T11:57:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa351ffb700 1 -- 172.21.15.50:0/2702809020 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33c006030 con 0x7fa35406b540 2023-11-28T11:57:40.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa351ffb700 1 -- 172.21.15.50:0/2702809020 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c0063c0 con 0x7fa35406b540 2023-11-28T11:57:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa353fff700 1 -- 172.21.15.50:0/2702809020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa35406b540 msgr2=0x7fa3540cb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.271+0000 7fa353fff700 1 --2- 172.21.15.50:0/2702809020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa35406b540 0x7fa3540cb760 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa35406e420 tx=0x7fa33c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.275+0000 7fa353fff700 1 -- 172.21.15.50:0/2702809020 shutdown_connections 2023-11-28T11:57:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.275+0000 7fa353fff700 1 --2- 172.21.15.50:0/2702809020 >> v2:172.21.15.192:3300/0 conn(0x7fa35406d420 0x7fa3540ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.275+0000 7fa353fff700 1 --2- 172.21.15.50:0/2702809020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa35406b540 0x7fa3540cb760 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.275+0000 7fa353fff700 1 -- 172.21.15.50:0/2702809020 >> 172.21.15.50:0/2702809020 conn(0x7fa3540ce360 msgr2=0x7fa3540ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.275+0000 7fa353fff700 1 -- 172.21.15.50:0/2702809020 shutdown_connections 2023-11-28T11:57:40.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.275+0000 7fa353fff700 1 -- 172.21.15.50:0/2702809020 wait complete. 2023-11-28T11:57:40.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.275+0000 7fa353fff700 1 Processor -- start 2023-11-28T11:57:40.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.275+0000 7fa353fff700 1 -- start start 2023-11-28T11:57:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa353fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa35406b540 0x7fa35406fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa353fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa35406d420 0x7fa3540701c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa353fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3540c1330 0x7fa3541517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa353fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540b85c0 con 0x7fa3540c1330 2023-11-28T11:57:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa353fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa354150d40 con 0x7fa35406d420 2023-11-28T11:57:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa353fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa354150130 con 0x7fa35406b540 2023-11-28T11:57:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa3537fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3540c1330 0x7fa3541517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa3537fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3540c1330 0x7fa3541517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58858/0 (socket says 172.21.15.50:58858) 2023-11-28T11:57:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa3537fe700 1 -- 172.21.15.50:0/165535483 learned_addr learned my addr 172.21.15.50:0/165535483 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa352ffd700 1 --2- 172.21.15.50:0/165535483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa35406b540 0x7fa35406fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa3527fc700 1 --2- 172.21.15.50:0/165535483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa35406d420 0x7fa3540701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa3537fe700 1 -- 172.21.15.50:0/165535483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa35406b540 msgr2=0x7fa35406fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa3537fe700 1 --2- 172.21.15.50:0/165535483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa35406b540 0x7fa35406fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa3537fe700 1 -- 172.21.15.50:0/165535483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa35406d420 msgr2=0x7fa3540701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa3537fe700 1 --2- 172.21.15.50:0/165535483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa35406d420 0x7fa3540701c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa3537fe700 1 -- 172.21.15.50:0/165535483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33c009520 con 0x7fa3540c1330 2023-11-28T11:57:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa3527fc700 1 --2- 172.21.15.50:0/165535483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa35406d420 0x7fa3540701c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:57:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa3537fe700 1 --2- 172.21.15.50:0/165535483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3540c1330 0x7fa3541517a0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00c4d0 tx=0x7fa34c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa34b7fe700 1 -- 172.21.15.50:0/165535483 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c005cd0 con 0x7fa3540c1330 2023-11-28T11:57:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa34b7fe700 1 -- 172.21.15.50:0/165535483 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c005e30 con 0x7fa3540c1330 2023-11-28T11:57:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa353fff700 1 -- 172.21.15.50:0/165535483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3540b3b10 con 0x7fa3540c1330 2023-11-28T11:57:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa34b7fe700 1 -- 172.21.15.50:0/165535483 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c0072d0 con 0x7fa3540c1330 2023-11-28T11:57:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.279+0000 7fa353fff700 1 -- 172.21.15.50:0/165535483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3540adba0 con 0x7fa3540c1330 2023-11-28T11:57:40.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.283+0000 7fa353fff700 1 -- 172.21.15.50:0/165535483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3540b3df0 con 0x7fa3540c1330 2023-11-28T11:57:40.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.283+0000 7fa34b7fe700 1 -- 172.21.15.50:0/165535483 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa34c019030 con 0x7fa3540c1330 2023-11-28T11:57:40.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.283+0000 7fa34b7fe700 1 --2- 172.21.15.50:0/165535483 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa338064ee0 0x7fa338067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:40.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.283+0000 7fa34b7fe700 1 -- 172.21.15.50:0/165535483 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fa34c0811c0 con 0x7fa3540c1330 2023-11-28T11:57:40.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.283+0000 7fa352ffd700 1 --2- 172.21.15.50:0/165535483 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa338064ee0 0x7fa338067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.283+0000 7fa352ffd700 1 --2- 172.21.15.50:0/165535483 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa338064ee0 0x7fa338067390 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa33c009c30 tx=0x7fa33c008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:40.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.291+0000 7fa34b7fe700 1 -- 172.21.15.50:0/165535483 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa34c04a400 con 0x7fa3540c1330 2023-11-28T11:57:40.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.491+0000 7fa353fff700 1 -- 172.21.15.50:0/165535483 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa3540008d0 con 0x7fa3540c1330 2023-11-28T11:57:40.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.491+0000 7fa34b7fe700 1 -- 172.21.15.50:0/165535483 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fa34c04f210 con 0x7fa3540c1330 2023-11-28T11:57:40.494 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:57:40.494 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:57:40.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.495+0000 7fa353fff700 1 -- 172.21.15.50:0/165535483 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa338064ee0 msgr2=0x7fa338067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.495+0000 7fa353fff700 1 --2- 172.21.15.50:0/165535483 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa338064ee0 0x7fa338067390 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa33c009c30 tx=0x7fa33c008070 comp rx=0 tx=0).stop 2023-11-28T11:57:40.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.495+0000 7fa353fff700 1 -- 172.21.15.50:0/165535483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3540c1330 msgr2=0x7fa3541517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:40.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.495+0000 7fa353fff700 1 --2- 172.21.15.50:0/165535483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3540c1330 0x7fa3541517a0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00c4d0 tx=0x7fa34c00c7e0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.495+0000 7fa353fff700 1 -- 172.21.15.50:0/165535483 shutdown_connections 2023-11-28T11:57:40.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.495+0000 7fa353fff700 1 --2- 172.21.15.50:0/165535483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3540c1330 0x7fa3541517a0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.495+0000 7fa353fff700 1 --2- 172.21.15.50:0/165535483 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa338064ee0 0x7fa338067390 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.495+0000 7fa353fff700 1 --2- 172.21.15.50:0/165535483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa35406d420 0x7fa3540701c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.495+0000 7fa353fff700 1 --2- 172.21.15.50:0/165535483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa35406b540 0x7fa35406fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.495+0000 7fa353fff700 1 -- 172.21.15.50:0/165535483 >> 172.21.15.50:0/165535483 conn(0x7fa3540ce360 msgr2=0x7fa35406ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.495+0000 7fa353fff700 1 -- 172.21.15.50:0/165535483 shutdown_connections 2023-11-28T11:57:40.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:40.495+0000 7fa353fff700 1 -- 172.21.15.50:0/165535483 wait complete. 2023-11-28T11:57:40.509 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:57:45.510 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:57:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.635+0000 7f6a371d3700 1 Processor -- start 2023-11-28T11:57:45.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.635+0000 7f6a371d3700 1 -- start start 2023-11-28T11:57:45.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a371d3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a301607b0 0x7f6a300cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a371d3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a300cc430 0x7f6a300ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a371d3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3015c520 con 0x7f6a3015c150 2023-11-28T11:57:45.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a371d3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a30160c00 con 0x7f6a300cc430 2023-11-28T11:57:45.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a371d3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300ca680 con 0x7f6a301607b0 2023-11-28T11:57:45.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a369d2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a300cc430 0x7f6a300ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a361d1700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6a3015c150 0x7f6a300c9e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39432/0 (socket says 172.21.15.50:39432) 2023-11-28T11:57:45.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a369d2700 1 --2- 172.21.15.50:0/4207054882 >> v2:172.21.15.50:3300/0 conn(0x7f6a300cc430 0x7f6a300ce320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54324/0 (socket says 172.21.15.50:54324) 2023-11-28T11:57:45.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a361d1700 1 -- 172.21.15.50:0/4207054882 learned_addr learned my addr 172.21.15.50:0/4207054882 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:57:45.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a359d0700 1 --2- 172.21.15.50:0/4207054882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a301607b0 0x7f6a300cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a369d2700 1 -- 172.21.15.50:0/4207054882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a301607b0 msgr2=0x7f6a300cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:45.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a369d2700 1 --2- 172.21.15.50:0/4207054882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a301607b0 0x7f6a300cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a351cf700 1 -- 172.21.15.50:0/4207054882 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459657620 0 0) 0x7f6a3015c520 con 0x7f6a3015c150 2023-11-28T11:57:45.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a369d2700 1 -- 172.21.15.50:0/4207054882 >> v1:172.21.15.50:6789/0 conn(0x7f6a3015c150 legacy=0x7f6a300c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a369d2700 1 -- 172.21.15.50:0/4207054882 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a300ca960 con 0x7f6a300cc430 2023-11-28T11:57:45.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a369d2700 1 --2- 172.21.15.50:0/4207054882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a300cc430 0x7f6a300ce320 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009d90 tx=0x7f6a2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fea390e1508a27 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:45.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a351cf700 1 -- 172.21.15.50:0/4207054882 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2800e070 con 0x7f6a300cc430 2023-11-28T11:57:45.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a351cf700 1 -- 172.21.15.50:0/4207054882 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2800bb20 con 0x7f6a300cc430 2023-11-28T11:57:45.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a351cf700 1 -- 172.21.15.50:0/4207054882 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28012430 con 0x7f6a300cc430 2023-11-28T11:57:45.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a371d3700 1 -- 172.21.15.50:0/4207054882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a300cc430 msgr2=0x7f6a300ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a371d3700 1 --2- 172.21.15.50:0/4207054882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a300cc430 0x7f6a300ce320 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009d90 tx=0x7f6a2800b330 comp rx=0 tx=0).stop 2023-11-28T11:57:45.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a371d3700 1 -- 172.21.15.50:0/4207054882 shutdown_connections 2023-11-28T11:57:45.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a371d3700 1 --2- 172.21.15.50:0/4207054882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a300cc430 0x7f6a300ce320 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a371d3700 1 --2- 172.21.15.50:0/4207054882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a301607b0 0x7f6a300cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a371d3700 1 -- 172.21.15.50:0/4207054882 >> 172.21.15.50:0/4207054882 conn(0x7f6a3006ec40 msgr2=0x7f6a300b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:45.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a371d3700 1 -- 172.21.15.50:0/4207054882 shutdown_connections 2023-11-28T11:57:45.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.639+0000 7f6a371d3700 1 -- 172.21.15.50:0/4207054882 wait complete. 2023-11-28T11:57:45.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a371d3700 1 Processor -- start 2023-11-28T11:57:45.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a371d3700 1 -- start start 2023-11-28T11:57:45.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a371d3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a300cc430 0x7f6a3015de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a371d3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a3015c150 0x7f6a300c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a371d3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a301607b0 0x7f6a300c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a371d3700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300c5130 con 0x7f6a300cc430 2023-11-28T11:57:45.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a371d3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300c5f90 con 0x7f6a3015c150 2023-11-28T11:57:45.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a371d3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3015d060 con 0x7f6a301607b0 2023-11-28T11:57:45.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a361d1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a300cc430 0x7f6a3015de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a361d1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a300cc430 0x7f6a3015de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54328/0 (socket says 172.21.15.50:54328) 2023-11-28T11:57:45.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a361d1700 1 -- 172.21.15.50:0/2730992893 learned_addr learned my addr 172.21.15.50:0/2730992893 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:45.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a369d2700 1 --2- 172.21.15.50:0/2730992893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a301607b0 0x7f6a300c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a359d0700 1 --2- 172.21.15.50:0/2730992893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a3015c150 0x7f6a300c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a361d1700 1 -- 172.21.15.50:0/2730992893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a301607b0 msgr2=0x7f6a300c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a361d1700 1 --2- 172.21.15.50:0/2730992893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a301607b0 0x7f6a300c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a361d1700 1 -- 172.21.15.50:0/2730992893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a3015c150 msgr2=0x7f6a300c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a361d1700 1 --2- 172.21.15.50:0/2730992893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a3015c150 0x7f6a300c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a361d1700 1 -- 172.21.15.50:0/2730992893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a28009a70 con 0x7f6a300cc430 2023-11-28T11:57:45.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a361d1700 1 --2- 172.21.15.50:0/2730992893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a300cc430 0x7f6a3015de20 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000c580 tx=0x7f6a2000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:45.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a26ffd700 1 -- 172.21.15.50:0/2730992893 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20004ca0 con 0x7f6a300cc430 2023-11-28T11:57:45.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a26ffd700 1 -- 172.21.15.50:0/2730992893 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a20004e20 con 0x7f6a300cc430 2023-11-28T11:57:45.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a371d3700 1 -- 172.21.15.50:0/2730992893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a300cdb20 con 0x7f6a300cc430 2023-11-28T11:57:45.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a26ffd700 1 -- 172.21.15.50:0/2730992893 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20007310 con 0x7f6a300cc430 2023-11-28T11:57:45.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.643+0000 7f6a371d3700 1 -- 172.21.15.50:0/2730992893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a300cd840 con 0x7f6a300cc430 2023-11-28T11:57:45.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.647+0000 7f6a371d3700 1 -- 172.21.15.50:0/2730992893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a300cde00 con 0x7f6a300cc430 2023-11-28T11:57:45.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.647+0000 7f6a26ffd700 1 -- 172.21.15.50:0/2730992893 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6a2001a020 con 0x7f6a300cc430 2023-11-28T11:57:45.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.647+0000 7f6a26ffd700 1 --2- 172.21.15.50:0/2730992893 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6a14064ee0 0x7f6a14067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:45.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.647+0000 7f6a26ffd700 1 -- 172.21.15.50:0/2730992893 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f6a20081b90 con 0x7f6a300cc430 2023-11-28T11:57:45.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.647+0000 7f6a359d0700 1 --2- 172.21.15.50:0/2730992893 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6a14064ee0 0x7f6a14067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:45.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.647+0000 7f6a359d0700 1 --2- 172.21.15.50:0/2730992893 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6a14064ee0 0x7f6a14067390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6a30157620 tx=0x7f6a2c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:45.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.659+0000 7f6a26ffd700 1 -- 172.21.15.50:0/2730992893 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6a2004fb30 con 0x7f6a300cc430 2023-11-28T11:57:45.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.851+0000 7f6a371d3700 1 -- 172.21.15.50:0/2730992893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6a3006cf00 con 0x7f6a300cc430 2023-11-28T11:57:45.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.855+0000 7f6a26ffd700 1 -- 172.21.15.50:0/2730992893 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f6a20053150 con 0x7f6a300cc430 2023-11-28T11:57:45.855 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:57:45.855 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:57:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.855+0000 7f6a371d3700 1 -- 172.21.15.50:0/2730992893 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6a14064ee0 msgr2=0x7f6a14067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.855+0000 7f6a371d3700 1 --2- 172.21.15.50:0/2730992893 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6a14064ee0 0x7f6a14067390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6a30157620 tx=0x7f6a2c009240 comp rx=0 tx=0).stop 2023-11-28T11:57:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.855+0000 7f6a371d3700 1 -- 172.21.15.50:0/2730992893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a300cc430 msgr2=0x7f6a3015de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.855+0000 7f6a371d3700 1 --2- 172.21.15.50:0/2730992893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a300cc430 0x7f6a3015de20 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000c580 tx=0x7f6a2000c890 comp rx=0 tx=0).stop 2023-11-28T11:57:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.855+0000 7f6a371d3700 1 -- 172.21.15.50:0/2730992893 shutdown_connections 2023-11-28T11:57:45.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.855+0000 7f6a371d3700 1 --2- 172.21.15.50:0/2730992893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a301607b0 0x7f6a300c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.855+0000 7f6a371d3700 1 --2- 172.21.15.50:0/2730992893 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6a14064ee0 0x7f6a14067390 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.855+0000 7f6a371d3700 1 --2- 172.21.15.50:0/2730992893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a3015c150 0x7f6a300c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.855+0000 7f6a371d3700 1 --2- 172.21.15.50:0/2730992893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a300cc430 0x7f6a3015de20 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.855+0000 7f6a371d3700 1 -- 172.21.15.50:0/2730992893 >> 172.21.15.50:0/2730992893 conn(0x7f6a3006ec40 msgr2=0x7f6a300c9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.855+0000 7f6a371d3700 1 -- 172.21.15.50:0/2730992893 shutdown_connections 2023-11-28T11:57:45.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:45.855+0000 7f6a371d3700 1 -- 172.21.15.50:0/2730992893 wait complete. 2023-11-28T11:57:45.869 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:57:50.871 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:57:50.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c19f3b700 1 Processor -- start 2023-11-28T11:57:50.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c19f3b700 1 -- start start 2023-11-28T11:57:50.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c19f3b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8c141606c0 0x7f8c140cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:50.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c19f3b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c140cd8f0 0x7f8c14165fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:50.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c19f3b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c14160b60 con 0x7f8c141566d0 2023-11-28T11:57:50.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c19f3b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1406d570 con 0x7f8c140cd8f0 2023-11-28T11:57:50.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c19f3b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1415c8f0 con 0x7f8c141606c0 2023-11-28T11:57:50.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c1973a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c140cd8f0 0x7f8c14165fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:50.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c1973a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8c140cd8f0 0x7f8c14165fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54340/0 (socket says 172.21.15.50:54340) 2023-11-28T11:57:50.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c1973a700 1 -- 172.21.15.50:0/2460034377 learned_addr learned my addr 172.21.15.50:0/2460034377 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:50.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c13fff700 1 --2- 172.21.15.50:0/2460034377 >> v2:172.21.15.192:3300/0 conn(0x7f8c141606c0 0x7f8c140cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:50.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c1973a700 1 -- 172.21.15.50:0/2460034377 >> v2:172.21.15.192:3300/0 conn(0x7f8c141606c0 msgr2=0x7f8c140cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:50.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c1973a700 1 --2- 172.21.15.50:0/2460034377 >> v2:172.21.15.192:3300/0 conn(0x7f8c141606c0 0x7f8c140cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:50.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c1973a700 1 -- 172.21.15.50:0/2460034377 >> v1:172.21.15.192:6789/0 conn(0x7f8c141566d0 legacy=0x7f8c1406ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:50.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c1973a700 1 -- 172.21.15.50:0/2460034377 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1415cbd0 con 0x7f8c140cd8f0 2023-11-28T11:57:50.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c13fff700 1 --2- 172.21.15.50:0/2460034377 >> v2:172.21.15.192:3300/0 conn(0x7f8c141606c0 0x7f8c140cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:57:50.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c1973a700 1 --2- 172.21.15.50:0/2460034377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c140cd8f0 0x7f8c14165fb0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8c1406b110 tx=0x7f8c0c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4728631dbc660e9d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:50.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c137fe700 1 -- 172.21.15.50:0/2460034377 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c004230 con 0x7f8c140cd8f0 2023-11-28T11:57:50.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c137fe700 1 -- 172.21.15.50:0/2460034377 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c004390 con 0x7f8c140cd8f0 2023-11-28T11:57:50.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c137fe700 1 -- 172.21.15.50:0/2460034377 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c0036c0 con 0x7f8c140cd8f0 2023-11-28T11:57:50.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c19f3b700 1 -- 172.21.15.50:0/2460034377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c140cd8f0 msgr2=0x7f8c14165fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:50.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c19f3b700 1 --2- 172.21.15.50:0/2460034377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c140cd8f0 0x7f8c14165fb0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8c1406b110 tx=0x7f8c0c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:57:50.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.991+0000 7f8c19f3b700 1 -- 172.21.15.50:0/2460034377 shutdown_connections 2023-11-28T11:57:50.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c19f3b700 1 --2- 172.21.15.50:0/2460034377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c140cd8f0 0x7f8c14165fb0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:50.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c19f3b700 1 --2- 172.21.15.50:0/2460034377 >> v2:172.21.15.192:3300/0 conn(0x7f8c141606c0 0x7f8c140cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:50.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c19f3b700 1 -- 172.21.15.50:0/2460034377 >> 172.21.15.50:0/2460034377 conn(0x7f8c14069c40 msgr2=0x7f8c1406a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:50.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c19f3b700 1 -- 172.21.15.50:0/2460034377 shutdown_connections 2023-11-28T11:57:50.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c19f3b700 1 -- 172.21.15.50:0/2460034377 wait complete. 2023-11-28T11:57:50.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c19f3b700 1 Processor -- start 2023-11-28T11:57:50.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c19f3b700 1 -- start start 2023-11-28T11:57:51.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c19f3b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c140cd8f0 0x7f8c141f1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:51.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c19f3b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c141566d0 0x7f8c140cef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:51.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c19f3b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c141606c0 0x7f8c14153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:51.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c19f3b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140d0040 con 0x7f8c141566d0 2023-11-28T11:57:51.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c19f3b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c14153570 con 0x7f8c141606c0 2023-11-28T11:57:51.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c19f3b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c141f1d70 con 0x7f8c140cd8f0 2023-11-28T11:57:51.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c13fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c141566d0 0x7f8c140cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:51.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c13fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c141566d0 0x7f8c140cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54346/0 (socket says 172.21.15.50:54346) 2023-11-28T11:57:51.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c13fff700 1 -- 172.21.15.50:0/1668867249 learned_addr learned my addr 172.21.15.50:0/1668867249 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:51.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c1973a700 1 --2- 172.21.15.50:0/1668867249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c141606c0 0x7f8c14153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:51.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c18f39700 1 --2- 172.21.15.50:0/1668867249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c140cd8f0 0x7f8c141f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:51.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c13fff700 1 -- 172.21.15.50:0/1668867249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c140cd8f0 msgr2=0x7f8c141f1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:51.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c13fff700 1 --2- 172.21.15.50:0/1668867249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c140cd8f0 0x7f8c141f1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:51.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c13fff700 1 -- 172.21.15.50:0/1668867249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c141606c0 msgr2=0x7f8c14153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:51.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c13fff700 1 --2- 172.21.15.50:0/1668867249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c141606c0 0x7f8c14153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.995+0000 7f8c13fff700 1 -- 172.21.15.50:0/1668867249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c009570 con 0x7f8c141566d0 2023-11-28T11:57:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.999+0000 7f8c13fff700 1 --2- 172.21.15.50:0/1668867249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c141566d0 0x7f8c140cef30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00ce00 tx=0x7f8bfc00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.999+0000 7f8c117fa700 1 -- 172.21.15.50:0/1668867249 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc00f480 con 0x7f8c141566d0 2023-11-28T11:57:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.999+0000 7f8c117fa700 1 -- 172.21.15.50:0/1668867249 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc00f5e0 con 0x7f8c141566d0 2023-11-28T11:57:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.999+0000 7f8c117fa700 1 -- 172.21.15.50:0/1668867249 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc00f970 con 0x7f8c141566d0 2023-11-28T11:57:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.999+0000 7f8c19f3b700 1 -- 172.21.15.50:0/1668867249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1415d190 con 0x7f8c141566d0 2023-11-28T11:57:51.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.999+0000 7f8c19f3b700 1 -- 172.21.15.50:0/1668867249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1415ceb0 con 0x7f8c141566d0 2023-11-28T11:57:51.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.999+0000 7f8c19f3b700 1 -- 172.21.15.50:0/1668867249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c140cdcf0 con 0x7f8c141566d0 2023-11-28T11:57:51.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.999+0000 7f8c117fa700 1 -- 172.21.15.50:0/1668867249 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8bfc009030 con 0x7f8c141566d0 2023-11-28T11:57:51.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.999+0000 7f8c117fa700 1 --2- 172.21.15.50:0/1668867249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8bf4064ee0 0x7f8bf4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:51.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.999+0000 7f8c117fa700 1 -- 172.21.15.50:0/1668867249 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f8bfc082a50 con 0x7f8c141566d0 2023-11-28T11:57:51.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:50.999+0000 7f8c18f39700 1 --2- 172.21.15.50:0/1668867249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8bf4064ee0 0x7f8bf4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:51.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:51.003+0000 7f8c18f39700 1 --2- 172.21.15.50:0/1668867249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8bf4064ee0 0x7f8bf4067390 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8c04009890 tx=0x7f8c04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:51.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:51.007+0000 7f8c117fa700 1 -- 172.21.15.50:0/1668867249 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8bfc050990 con 0x7f8c141566d0 2023-11-28T11:57:51.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:51.207+0000 7f8c19f3b700 1 -- 172.21.15.50:0/1668867249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8c14072c20 con 0x7f8c141566d0 2023-11-28T11:57:51.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:51.207+0000 7f8c117fa700 1 -- 172.21.15.50:0/1668867249 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f8bfc053fb0 con 0x7f8c141566d0 2023-11-28T11:57:51.210 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:57:51.210 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:57:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:51.211+0000 7f8c19f3b700 1 -- 172.21.15.50:0/1668867249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8bf4064ee0 msgr2=0x7f8bf4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:51.211+0000 7f8c19f3b700 1 --2- 172.21.15.50:0/1668867249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8bf4064ee0 0x7f8bf4067390 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8c04009890 tx=0x7f8c04008040 comp rx=0 tx=0).stop 2023-11-28T11:57:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:51.211+0000 7f8c19f3b700 1 -- 172.21.15.50:0/1668867249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c141566d0 msgr2=0x7f8c140cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:51.211+0000 7f8c19f3b700 1 --2- 172.21.15.50:0/1668867249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c141566d0 0x7f8c140cef30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00ce00 tx=0x7f8bfc00a560 comp rx=0 tx=0).stop 2023-11-28T11:57:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:51.211+0000 7f8c19f3b700 1 -- 172.21.15.50:0/1668867249 shutdown_connections 2023-11-28T11:57:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:51.211+0000 7f8c19f3b700 1 --2- 172.21.15.50:0/1668867249 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8bf4064ee0 0x7f8bf4067390 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:51.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:51.211+0000 7f8c19f3b700 1 --2- 172.21.15.50:0/1668867249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c141606c0 0x7f8c14153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:51.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:51.211+0000 7f8c19f3b700 1 --2- 172.21.15.50:0/1668867249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c141566d0 0x7f8c140cef30 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:51.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:51.211+0000 7f8c19f3b700 1 --2- 172.21.15.50:0/1668867249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c140cd8f0 0x7f8c141f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:51.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:51.211+0000 7f8c19f3b700 1 -- 172.21.15.50:0/1668867249 >> 172.21.15.50:0/1668867249 conn(0x7f8c14069c40 msgr2=0x7f8c1406a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:51.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:51.211+0000 7f8c19f3b700 1 -- 172.21.15.50:0/1668867249 shutdown_connections 2023-11-28T11:57:51.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:51.211+0000 7f8c19f3b700 1 -- 172.21.15.50:0/1668867249 wait complete. 2023-11-28T11:57:51.231 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:57:56.231 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:57:56.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.351+0000 7fbfeb1ce700 1 Processor -- start 2023-11-28T11:57:56.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.351+0000 7fbfeb1ce700 1 -- start start 2023-11-28T11:57:56.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfeb1ce700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfe40cb470 0x7fbfe4164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:56.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfeb1ce700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe406ace0 con 0x7fbfe4159e70 2023-11-28T11:57:56.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfeb1ce700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe406a0d0 con 0x7fbfe4069c40 2023-11-28T11:57:56.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfeb1ce700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe406a3b0 con 0x7fbfe40cb470 2023-11-28T11:57:56.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfea9cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfe40cb470 0x7fbfe4164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:56.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfea9cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbfe40cb470 0x7fbfe4164a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51592/0 (socket says 172.21.15.50:51592) 2023-11-28T11:57:56.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfea9cd700 1 -- 172.21.15.50:0/3427971951 learned_addr learned my addr 172.21.15.50:0/3427971951 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:56.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfea9cd700 1 -- 172.21.15.50:0/3427971951 >> v1:172.21.15.192:6789/0 conn(0x7fbfe4069c40 legacy=0x7fbfe40cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:57:56.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfea9cd700 1 -- 172.21.15.50:0/3427971951 >> v1:172.21.15.50:6789/0 conn(0x7fbfe4159e70 legacy=0x7fbfe406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfea9cd700 1 -- 172.21.15.50:0/3427971951 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe406a690 con 0x7fbfe40cb470 2023-11-28T11:57:56.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfea9cd700 1 --2- 172.21.15.50:0/3427971951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfe40cb470 0x7fbfe4164a20 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009e50 tx=0x7fbfdc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90cc5e33ef4a371a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:56.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfe91ca700 1 -- 172.21.15.50:0/3427971951 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00e070 con 0x7fbfe40cb470 2023-11-28T11:57:56.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfe91ca700 1 -- 172.21.15.50:0/3427971951 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc00b9c0 con 0x7fbfe40cb470 2023-11-28T11:57:56.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfe91ca700 1 -- 172.21.15.50:0/3427971951 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00bd70 con 0x7fbfe40cb470 2023-11-28T11:57:56.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfeb1ce700 1 -- 172.21.15.50:0/3427971951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfe40cb470 msgr2=0x7fbfe4164a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfeb1ce700 1 --2- 172.21.15.50:0/3427971951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfe40cb470 0x7fbfe4164a20 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009e50 tx=0x7fbfdc00b330 comp rx=0 tx=0).stop 2023-11-28T11:57:56.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfeb1ce700 1 -- 172.21.15.50:0/3427971951 shutdown_connections 2023-11-28T11:57:56.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfeb1ce700 1 --2- 172.21.15.50:0/3427971951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfe40cb470 0x7fbfe4164a20 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfeb1ce700 1 -- 172.21.15.50:0/3427971951 >> 172.21.15.50:0/3427971951 conn(0x7fbfe40ce3e0 msgr2=0x7fbfe40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:56.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfeb1ce700 1 -- 172.21.15.50:0/3427971951 shutdown_connections 2023-11-28T11:57:56.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.355+0000 7fbfeb1ce700 1 -- 172.21.15.50:0/3427971951 wait complete. 2023-11-28T11:57:56.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.359+0000 7fbfeb1ce700 1 Processor -- start 2023-11-28T11:57:56.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.359+0000 7fbfeb1ce700 1 -- start start 2023-11-28T11:57:56.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.359+0000 7fbfeb1ce700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfe4069c40 0x7fbfe41eecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:56.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.359+0000 7fbfeb1ce700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfe40cb470 0x7fbfe40afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:56.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.359+0000 7fbfeb1ce700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfe4159e70 0x7fbfe40c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:56.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.359+0000 7fbfeb1ce700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe40aed00 con 0x7fbfe4069c40 2023-11-28T11:57:56.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.359+0000 7fbfeb1ce700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe40aefe0 con 0x7fbfe4159e70 2023-11-28T11:57:56.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.359+0000 7fbfeb1ce700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe40af2c0 con 0x7fbfe40cb470 2023-11-28T11:57:56.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.359+0000 7fbfea1cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfe4069c40 0x7fbfe41eecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:56.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.359+0000 7fbfea1cc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfe4069c40 0x7fbfe41eecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51598/0 (socket says 172.21.15.50:51598) 2023-11-28T11:57:56.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.359+0000 7fbfea1cc700 1 -- 172.21.15.50:0/3148316429 learned_addr learned my addr 172.21.15.50:0/3148316429 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:57:56.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.359+0000 7fbfe99cb700 1 --2- 172.21.15.50:0/3148316429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfe40cb470 0x7fbfe40afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:56.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.359+0000 7fbfea9cd700 1 --2- 172.21.15.50:0/3148316429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfe4159e70 0x7fbfe40c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:56.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.363+0000 7fbfea1cc700 1 -- 172.21.15.50:0/3148316429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfe40cb470 msgr2=0x7fbfe40afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.363+0000 7fbfea1cc700 1 --2- 172.21.15.50:0/3148316429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfe40cb470 0x7fbfe40afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.363+0000 7fbfea1cc700 1 -- 172.21.15.50:0/3148316429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfe4159e70 msgr2=0x7fbfe40c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.363+0000 7fbfea1cc700 1 --2- 172.21.15.50:0/3148316429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfe4159e70 0x7fbfe40c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.363+0000 7fbfea1cc700 1 -- 172.21.15.50:0/3148316429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc009b30 con 0x7fbfe4069c40 2023-11-28T11:57:56.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.363+0000 7fbfea1cc700 1 --2- 172.21.15.50:0/3148316429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfe4069c40 0x7fbfe41eecd0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fbfd400c500 tx=0x7fbfd400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:56.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.363+0000 7fbfdaffd700 1 -- 172.21.15.50:0/3148316429 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd40052d0 con 0x7fbfe4069c40 2023-11-28T11:57:56.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.363+0000 7fbfdaffd700 1 -- 172.21.15.50:0/3148316429 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd4005430 con 0x7fbfe4069c40 2023-11-28T11:57:56.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.363+0000 7fbfeb1ce700 1 -- 172.21.15.50:0/3148316429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe406d0b0 con 0x7fbfe4069c40 2023-11-28T11:57:56.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.363+0000 7fbfdaffd700 1 -- 172.21.15.50:0/3148316429 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd40055a0 con 0x7fbfe4069c40 2023-11-28T11:57:56.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.363+0000 7fbfeb1ce700 1 -- 172.21.15.50:0/3148316429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe406a970 con 0x7fbfe4069c40 2023-11-28T11:57:56.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.363+0000 7fbfeb1ce700 1 -- 172.21.15.50:0/3148316429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe415a240 con 0x7fbfe4069c40 2023-11-28T11:57:56.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.367+0000 7fbfdaffd700 1 -- 172.21.15.50:0/3148316429 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbfd4019030 con 0x7fbfe4069c40 2023-11-28T11:57:56.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.367+0000 7fbfdaffd700 1 --2- 172.21.15.50:0/3148316429 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbfc8064ee0 0x7fbfc8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:57:56.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.367+0000 7fbfdaffd700 1 -- 172.21.15.50:0/3148316429 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fbfd4081210 con 0x7fbfe4069c40 2023-11-28T11:57:56.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.367+0000 7fbfe99cb700 1 --2- 172.21.15.50:0/3148316429 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbfc8064ee0 0x7fbfc8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:57:56.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.367+0000 7fbfe99cb700 1 --2- 172.21.15.50:0/3148316429 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbfc8064ee0 0x7fbfc8067390 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4156910 tx=0x7fbfe0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:57:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.375+0000 7fbfdaffd700 1 -- 172.21.15.50:0/3148316429 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbfd404f230 con 0x7fbfe4069c40 2023-11-28T11:57:56.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.571+0000 7fbfeb1ce700 1 -- 172.21.15.50:0/3148316429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbfe4072500 con 0x7fbfe4069c40 2023-11-28T11:57:56.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.575+0000 7fbfdaffd700 1 -- 172.21.15.50:0/3148316429 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fbfd4052850 con 0x7fbfe4069c40 2023-11-28T11:57:56.575 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:57:56.575 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:57:56.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.575+0000 7fbfeb1ce700 1 -- 172.21.15.50:0/3148316429 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbfc8064ee0 msgr2=0x7fbfc8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.575+0000 7fbfeb1ce700 1 --2- 172.21.15.50:0/3148316429 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbfc8064ee0 0x7fbfc8067390 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4156910 tx=0x7fbfe0009040 comp rx=0 tx=0).stop 2023-11-28T11:57:56.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.575+0000 7fbfeb1ce700 1 -- 172.21.15.50:0/3148316429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfe4069c40 msgr2=0x7fbfe41eecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:57:56.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.575+0000 7fbfeb1ce700 1 --2- 172.21.15.50:0/3148316429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfe4069c40 0x7fbfe41eecd0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fbfd400c500 tx=0x7fbfd400c810 comp rx=0 tx=0).stop 2023-11-28T11:57:56.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.575+0000 7fbfeb1ce700 1 -- 172.21.15.50:0/3148316429 shutdown_connections 2023-11-28T11:57:56.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.575+0000 7fbfeb1ce700 1 --2- 172.21.15.50:0/3148316429 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbfc8064ee0 0x7fbfc8067390 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.575+0000 7fbfeb1ce700 1 --2- 172.21.15.50:0/3148316429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfe4159e70 0x7fbfe40c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.575+0000 7fbfeb1ce700 1 --2- 172.21.15.50:0/3148316429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfe40cb470 0x7fbfe40afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.575+0000 7fbfeb1ce700 1 --2- 172.21.15.50:0/3148316429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbfe4069c40 0x7fbfe41eecd0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:57:56.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.575+0000 7fbfeb1ce700 1 -- 172.21.15.50:0/3148316429 >> 172.21.15.50:0/3148316429 conn(0x7fbfe40ce3e0 msgr2=0x7fbfe406c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:57:56.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.575+0000 7fbfeb1ce700 1 -- 172.21.15.50:0/3148316429 shutdown_connections 2023-11-28T11:57:56.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:57:56.575+0000 7fbfeb1ce700 1 -- 172.21.15.50:0/3148316429 wait complete. 2023-11-28T11:57:56.590 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:58:01.591 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:58:01.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.711+0000 7fa2c743c700 1 Processor -- start 2023-11-28T11:58:01.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.711+0000 7fa2c743c700 1 -- start start 2023-11-28T11:58:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c743c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa2c0152bb0 0x7fa2c015caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c743c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2c006c640 0x7fa2c006cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c743c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c0152f80 con 0x7fa2c00706f0 2023-11-28T11:58:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c743c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c006d020 con 0x7fa2c006c640 2023-11-28T11:58:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c743c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c015cfe0 con 0x7fa2c0152bb0 2023-11-28T11:58:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c5c39700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2c006c640 0x7fa2c006cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c5c39700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa2c006c640 0x7fa2c006cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50504/0 (socket says 172.21.15.50:50504) 2023-11-28T11:58:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c5c39700 1 -- 172.21.15.50:0/739190035 learned_addr learned my addr 172.21.15.50:0/739190035 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:58:01.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c643a700 1 --2- 172.21.15.50:0/739190035 >> v2:172.21.15.192:3300/0 conn(0x7fa2c0152bb0 0x7fa2c015caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c5c39700 1 -- 172.21.15.50:0/739190035 >> v2:172.21.15.192:3300/0 conn(0x7fa2c0152bb0 msgr2=0x7fa2c015caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c5c39700 1 --2- 172.21.15.50:0/739190035 >> v2:172.21.15.192:3300/0 conn(0x7fa2c0152bb0 0x7fa2c015caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c5c39700 1 -- 172.21.15.50:0/739190035 >> v1:172.21.15.192:6789/0 conn(0x7fa2c00706f0 legacy=0x7fa2c0070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c5c39700 1 -- 172.21.15.50:0/739190035 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c0159a30 con 0x7fa2c006c640 2023-11-28T11:58:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c643a700 1 --2- 172.21.15.50:0/739190035 >> v2:172.21.15.192:3300/0 conn(0x7fa2c0152bb0 0x7fa2c015caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:58:01.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c5c39700 1 --2- 172.21.15.50:0/739190035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c006c640 0x7fa2c006cae0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa2c006e890 tx=0x7fa2b0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b799724597d7621b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:01.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c5438700 1 -- 172.21.15.50:0/739190035 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0004230 con 0x7fa2c006c640 2023-11-28T11:58:01.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c5438700 1 -- 172.21.15.50:0/739190035 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b0004390 con 0x7fa2c006c640 2023-11-28T11:58:01.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c5438700 1 -- 172.21.15.50:0/739190035 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00036c0 con 0x7fa2c006c640 2023-11-28T11:58:01.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c743c700 1 -- 172.21.15.50:0/739190035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c006c640 msgr2=0x7fa2c006cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c743c700 1 --2- 172.21.15.50:0/739190035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c006c640 0x7fa2c006cae0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa2c006e890 tx=0x7fa2b0009bf0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c743c700 1 -- 172.21.15.50:0/739190035 shutdown_connections 2023-11-28T11:58:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c743c700 1 --2- 172.21.15.50:0/739190035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c006c640 0x7fa2c006cae0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c743c700 1 --2- 172.21.15.50:0/739190035 >> v2:172.21.15.192:3300/0 conn(0x7fa2c0152bb0 0x7fa2c015caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c743c700 1 -- 172.21.15.50:0/739190035 >> 172.21.15.50:0/739190035 conn(0x7fa2c006e000 msgr2=0x7fa2c00b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c743c700 1 -- 172.21.15.50:0/739190035 shutdown_connections 2023-11-28T11:58:01.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.715+0000 7fa2c743c700 1 -- 172.21.15.50:0/739190035 wait complete. 2023-11-28T11:58:01.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.719+0000 7fa2c743c700 1 Processor -- start 2023-11-28T11:58:01.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.719+0000 7fa2c743c700 1 -- start start 2023-11-28T11:58:01.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.719+0000 7fa2c743c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2c006c640 0x7fa2c0147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:01.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.719+0000 7fa2c743c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c00706f0 0x7fa2c014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.719+0000 7fa2c743c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2c0152bb0 0x7fa2c00ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.719+0000 7fa2c743c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c014e170 con 0x7fa2c00706f0 2023-11-28T11:58:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.719+0000 7fa2c743c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c014d580 con 0x7fa2c0152bb0 2023-11-28T11:58:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.719+0000 7fa2c743c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c0147660 con 0x7fa2c006c640 2023-11-28T11:58:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2c5c39700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c00706f0 0x7fa2c014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2c5c39700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c00706f0 0x7fa2c014e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50520/0 (socket says 172.21.15.50:50520) 2023-11-28T11:58:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2c5c39700 1 -- 172.21.15.50:0/1678271956 learned_addr learned my addr 172.21.15.50:0/1678271956 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:58:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2c643a700 1 --2- 172.21.15.50:0/1678271956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2c006c640 0x7fa2c0147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2c6c3b700 1 --2- 172.21.15.50:0/1678271956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2c0152bb0 0x7fa2c00ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2c5c39700 1 -- 172.21.15.50:0/1678271956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2c006c640 msgr2=0x7fa2c0147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2c5c39700 1 --2- 172.21.15.50:0/1678271956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2c006c640 0x7fa2c0147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2c5c39700 1 -- 172.21.15.50:0/1678271956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2c0152bb0 msgr2=0x7fa2c00ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2c5c39700 1 --2- 172.21.15.50:0/1678271956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2c0152bb0 0x7fa2c00ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2c5c39700 1 -- 172.21.15.50:0/1678271956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b0009570 con 0x7fa2c00706f0 2023-11-28T11:58:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2c643a700 1 --2- 172.21.15.50:0/1678271956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2c006c640 0x7fa2c0147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2c5c39700 1 --2- 172.21.15.50:0/1678271956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c00706f0 0x7fa2c014e590 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0004000 tx=0x7fa2b0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2b6ffd700 1 -- 172.21.15.50:0/1678271956 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b001f070 con 0x7fa2c00706f0 2023-11-28T11:58:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2b6ffd700 1 -- 172.21.15.50:0/1678271956 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b0004500 con 0x7fa2c00706f0 2023-11-28T11:58:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2c743c700 1 -- 172.21.15.50:0/1678271956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c0159190 con 0x7fa2c00706f0 2023-11-28T11:58:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2b6ffd700 1 -- 172.21.15.50:0/1678271956 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b000be90 con 0x7fa2c00706f0 2023-11-28T11:58:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2c743c700 1 -- 172.21.15.50:0/1678271956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c0158eb0 con 0x7fa2c00706f0 2023-11-28T11:58:01.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2b6ffd700 1 -- 172.21.15.50:0/1678271956 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa2b002b030 con 0x7fa2c00706f0 2023-11-28T11:58:01.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.723+0000 7fa2c743c700 1 -- 172.21.15.50:0/1678271956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c0159470 con 0x7fa2c00706f0 2023-11-28T11:58:01.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.727+0000 7fa2b6ffd700 1 --2- 172.21.15.50:0/1678271956 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa2a4064f10 0x7fa2a40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:01.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.727+0000 7fa2b6ffd700 1 -- 172.21.15.50:0/1678271956 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fa2b00858a0 con 0x7fa2c00706f0 2023-11-28T11:58:01.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.727+0000 7fa2c643a700 1 --2- 172.21.15.50:0/1678271956 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa2a4064f10 0x7fa2a40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:01.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.727+0000 7fa2c643a700 1 --2- 172.21.15.50:0/1678271956 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa2a4064f10 0x7fa2a40673c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc006fd0 tx=0x7fa2bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:01.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.731+0000 7fa2b6ffd700 1 -- 172.21.15.50:0/1678271956 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa2b0053840 con 0x7fa2c00706f0 2023-11-28T11:58:01.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.931+0000 7fa2c743c700 1 -- 172.21.15.50:0/1678271956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa2c014e2b0 con 0x7fa2c00706f0 2023-11-28T11:58:01.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.931+0000 7fa2b6ffd700 1 -- 172.21.15.50:0/1678271956 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fa2c014e2b0 con 0x7fa2c00706f0 2023-11-28T11:58:01.932 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:58:01.933 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:58:01.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.931+0000 7fa2c743c700 1 -- 172.21.15.50:0/1678271956 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa2a4064f10 msgr2=0x7fa2a40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:01.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.931+0000 7fa2c743c700 1 --2- 172.21.15.50:0/1678271956 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa2a4064f10 0x7fa2a40673c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc006fd0 tx=0x7fa2bc008040 comp rx=0 tx=0).stop 2023-11-28T11:58:01.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.931+0000 7fa2c743c700 1 -- 172.21.15.50:0/1678271956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c00706f0 msgr2=0x7fa2c014e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:01.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.931+0000 7fa2c743c700 1 --2- 172.21.15.50:0/1678271956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c00706f0 0x7fa2c014e590 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0004000 tx=0x7fa2b0004770 comp rx=0 tx=0).stop 2023-11-28T11:58:01.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.931+0000 7fa2c743c700 1 -- 172.21.15.50:0/1678271956 shutdown_connections 2023-11-28T11:58:01.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.935+0000 7fa2c743c700 1 --2- 172.21.15.50:0/1678271956 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa2a4064f10 0x7fa2a40673c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.935+0000 7fa2c743c700 1 --2- 172.21.15.50:0/1678271956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2c0152bb0 0x7fa2c00ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.935+0000 7fa2c743c700 1 --2- 172.21.15.50:0/1678271956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2c00706f0 0x7fa2c014e590 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.935+0000 7fa2c743c700 1 --2- 172.21.15.50:0/1678271956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2c006c640 0x7fa2c0147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:01.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.935+0000 7fa2c743c700 1 -- 172.21.15.50:0/1678271956 >> 172.21.15.50:0/1678271956 conn(0x7fa2c006e000 msgr2=0x7fa2c00b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:01.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.935+0000 7fa2c743c700 1 -- 172.21.15.50:0/1678271956 shutdown_connections 2023-11-28T11:58:01.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:01.935+0000 7fa2c743c700 1 -- 172.21.15.50:0/1678271956 wait complete. 2023-11-28T11:58:01.947 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:58:06.435 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:58:06.438 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:58:06.948 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:58:07.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.063+0000 7f72497fb700 1 Processor -- start 2023-11-28T11:58:07.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.063+0000 7f72497fb700 1 -- start start 2023-11-28T11:58:07.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f72497fb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f72440c1ac0 0x7f7244069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f72497fb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f72440ceef0 0x7f724406a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f72497fb700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72440cae70 con 0x7f72441606b0 2023-11-28T11:58:07.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f72497fb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72440cbc10 con 0x7f72440ceef0 2023-11-28T11:58:07.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f72497fb700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72440cb130 con 0x7f72440c1ac0 2023-11-28T11:58:07.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f7243fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f72441606b0 0x7f72440c13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45082/0 (socket says 172.21.15.50:45082) 2023-11-28T11:58:07.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f7243fff700 1 -- 172.21.15.50:0/1549189895 learned_addr learned my addr 172.21.15.50:0/1549189895 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:58:07.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f7248ffa700 1 --2- 172.21.15.50:0/1549189895 >> v2:172.21.15.50:3300/0 conn(0x7f72440ceef0 0x7f724406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f72437fe700 1 --2- 172.21.15.50:0/1549189895 >> v2:172.21.15.192:3300/0 conn(0x7f72440c1ac0 0x7f7244069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f7242ffd700 1 -- 172.21.15.50:0/1549189895 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045210235 0 0) 0x7f72440cae70 con 0x7f72441606b0 2023-11-28T11:58:07.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f7248ffa700 1 -- 172.21.15.50:0/1549189895 >> v2:172.21.15.192:3300/0 conn(0x7f72440c1ac0 msgr2=0x7f7244069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:07.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f7248ffa700 1 --2- 172.21.15.50:0/1549189895 >> v2:172.21.15.192:3300/0 conn(0x7f72440c1ac0 0x7f7244069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f7248ffa700 1 -- 172.21.15.50:0/1549189895 >> v1:172.21.15.50:6789/0 conn(0x7f72441606b0 legacy=0x7f72440c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f7248ffa700 1 -- 172.21.15.50:0/1549189895 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72440cb410 con 0x7f72440ceef0 2023-11-28T11:58:07.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f7248ffa700 1 --2- 172.21.15.50:0/1549189895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72440ceef0 0x7f724406a180 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f724406b850 tx=0x7f723c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e57a5a13f18fcf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:07.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f7242ffd700 1 -- 172.21.15.50:0/1549189895 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c00e070 con 0x7f72440ceef0 2023-11-28T11:58:07.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f7242ffd700 1 -- 172.21.15.50:0/1549189895 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723c00bb20 con 0x7f72440ceef0 2023-11-28T11:58:07.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f7242ffd700 1 -- 172.21.15.50:0/1549189895 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c012430 con 0x7f72440ceef0 2023-11-28T11:58:07.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f72497fb700 1 -- 172.21.15.50:0/1549189895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72440ceef0 msgr2=0x7f724406a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f72497fb700 1 --2- 172.21.15.50:0/1549189895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72440ceef0 0x7f724406a180 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f724406b850 tx=0x7f723c00b330 comp rx=0 tx=0).stop 2023-11-28T11:58:07.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f72497fb700 1 -- 172.21.15.50:0/1549189895 shutdown_connections 2023-11-28T11:58:07.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f72497fb700 1 --2- 172.21.15.50:0/1549189895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72440ceef0 0x7f724406a180 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f72497fb700 1 --2- 172.21.15.50:0/1549189895 >> v2:172.21.15.192:3300/0 conn(0x7f72440c1ac0 0x7f7244069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f72497fb700 1 -- 172.21.15.50:0/1549189895 >> 172.21.15.50:0/1549189895 conn(0x7f72440ce3e0 msgr2=0x7f72440ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:07.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f72497fb700 1 -- 172.21.15.50:0/1549189895 shutdown_connections 2023-11-28T11:58:07.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.067+0000 7f72497fb700 1 -- 172.21.15.50:0/1549189895 wait complete. 2023-11-28T11:58:07.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f72497fb700 1 Processor -- start 2023-11-28T11:58:07.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f72497fb700 1 -- start start 2023-11-28T11:58:07.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f72497fb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72440c1ac0 0x7f72441f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f72497fb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72440ceef0 0x7f72440c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f72497fb700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72441606b0 0x7f724415dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f72497fb700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72441fa1a0 con 0x7f72441606b0 2023-11-28T11:58:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f72497fb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72441f9210 con 0x7f72440ceef0 2023-11-28T11:58:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f72497fb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724415e680 con 0x7f72440c1ac0 2023-11-28T11:58:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f7248ffa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72441606b0 0x7f724415dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f7248ffa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72441606b0 0x7f724415dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50536/0 (socket says 172.21.15.50:50536) 2023-11-28T11:58:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f7248ffa700 1 -- 172.21.15.50:0/4144419051 learned_addr learned my addr 172.21.15.50:0/4144419051 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:58:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f72437fe700 1 --2- 172.21.15.50:0/4144419051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72440ceef0 0x7f72440c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f7243fff700 1 --2- 172.21.15.50:0/4144419051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72440c1ac0 0x7f72441f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f7248ffa700 1 -- 172.21.15.50:0/4144419051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72440c1ac0 msgr2=0x7f72441f9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f7248ffa700 1 --2- 172.21.15.50:0/4144419051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72440c1ac0 0x7f72441f9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f7248ffa700 1 -- 172.21.15.50:0/4144419051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72440ceef0 msgr2=0x7f72440c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f7248ffa700 1 --2- 172.21.15.50:0/4144419051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72440ceef0 0x7f72440c3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f7248ffa700 1 -- 172.21.15.50:0/4144419051 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c009a70 con 0x7f72441606b0 2023-11-28T11:58:07.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f72437fe700 1 --2- 172.21.15.50:0/4144419051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72440ceef0 0x7f72440c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:07.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f7248ffa700 1 --2- 172.21.15.50:0/4144419051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72441606b0 0x7f724415dca0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f724406f740 tx=0x7f723c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:07.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f7240ff9700 1 -- 172.21.15.50:0/4144419051 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c012430 con 0x7f72441606b0 2023-11-28T11:58:07.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f7240ff9700 1 -- 172.21.15.50:0/4144419051 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723c020070 con 0x7f72441606b0 2023-11-28T11:58:07.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f7240ff9700 1 -- 172.21.15.50:0/4144419051 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c004280 con 0x7f72441606b0 2023-11-28T11:58:07.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f72497fb700 1 -- 172.21.15.50:0/4144419051 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72440b36c0 con 0x7f72441606b0 2023-11-28T11:58:07.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.071+0000 7f72497fb700 1 -- 172.21.15.50:0/4144419051 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72440cb6f0 con 0x7f72441606b0 2023-11-28T11:58:07.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.075+0000 7f72497fb700 1 -- 172.21.15.50:0/4144419051 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72440ad610 con 0x7f72441606b0 2023-11-28T11:58:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.075+0000 7f7240ff9700 1 -- 172.21.15.50:0/4144419051 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f723c02e070 con 0x7f72441606b0 2023-11-28T11:58:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.075+0000 7f7240ff9700 1 --2- 172.21.15.50:0/4144419051 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7230064ee0 0x7f7230067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:07.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.075+0000 7f7240ff9700 1 -- 172.21.15.50:0/4144419051 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f723c022070 con 0x7f72441606b0 2023-11-28T11:58:07.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.075+0000 7f7243fff700 1 --2- 172.21.15.50:0/4144419051 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7230064ee0 0x7f7230067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:07.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.079+0000 7f7243fff700 1 --2- 172.21.15.50:0/4144419051 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7230064ee0 0x7f7230067390 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7238000f60 tx=0x7f7238007cb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:07.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.083+0000 7f7240ff9700 1 -- 172.21.15.50:0/4144419051 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f723c051d40 con 0x7f72441606b0 2023-11-28T11:58:07.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.279+0000 7f72497fb700 1 -- 172.21.15.50:0/4144419051 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7244072500 con 0x7f72441606b0 2023-11-28T11:58:07.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.279+0000 7f7240ff9700 1 -- 172.21.15.50:0/4144419051 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f723c055360 con 0x7f72441606b0 2023-11-28T11:58:07.282 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:58:07.282 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:58:07.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.283+0000 7f72497fb700 1 -- 172.21.15.50:0/4144419051 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7230064ee0 msgr2=0x7f7230067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.283+0000 7f72497fb700 1 --2- 172.21.15.50:0/4144419051 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7230064ee0 0x7f7230067390 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7238000f60 tx=0x7f7238007cb0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.283+0000 7f72497fb700 1 -- 172.21.15.50:0/4144419051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72441606b0 msgr2=0x7f724415dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.283+0000 7f72497fb700 1 --2- 172.21.15.50:0/4144419051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72441606b0 0x7f724415dca0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f724406f740 tx=0x7f723c004af0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.283+0000 7f72497fb700 1 -- 172.21.15.50:0/4144419051 shutdown_connections 2023-11-28T11:58:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.283+0000 7f72497fb700 1 --2- 172.21.15.50:0/4144419051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72441606b0 0x7f724415dca0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.283+0000 7f72497fb700 1 --2- 172.21.15.50:0/4144419051 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7230064ee0 0x7f7230067390 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.283+0000 7f72497fb700 1 --2- 172.21.15.50:0/4144419051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72440ceef0 0x7f72440c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.283+0000 7f72497fb700 1 --2- 172.21.15.50:0/4144419051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72440c1ac0 0x7f72441f9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.283+0000 7f72497fb700 1 -- 172.21.15.50:0/4144419051 >> 172.21.15.50:0/4144419051 conn(0x7f72440ce3e0 msgr2=0x7f72440afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.283+0000 7f72497fb700 1 -- 172.21.15.50:0/4144419051 shutdown_connections 2023-11-28T11:58:07.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:07.283+0000 7f72497fb700 1 -- 172.21.15.50:0/4144419051 wait complete. 2023-11-28T11:58:07.296 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:58:12.297 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:58:12.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.419+0000 7faf8f288700 1 Processor -- start 2023-11-28T11:58:12.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.419+0000 7faf8f288700 1 -- start start 2023-11-28T11:58:12.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.419+0000 7faf8f288700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faf88154600 0x7faf8815aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:12.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.419+0000 7faf8f288700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf8806abe0 0x7faf8815b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:12.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.419+0000 7faf8f288700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8815e300 con 0x7faf8806c650 2023-11-28T11:58:12.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.419+0000 7faf8f288700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf8806ced0 con 0x7faf8806abe0 2023-11-28T11:58:12.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.419+0000 7faf8f288700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf8815d9d0 con 0x7faf88154600 2023-11-28T11:58:12.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.419+0000 7faf8ea87700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf8806abe0 0x7faf8815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:12.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.419+0000 7faf8ea87700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf8806abe0 0x7faf8815b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45862/0 (socket says 172.21.15.50:45862) 2023-11-28T11:58:12.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.419+0000 7faf8ea87700 1 -- 172.21.15.50:0/2811820900 learned_addr learned my addr 172.21.15.50:0/2811820900 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:58:12.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.419+0000 7faf8e286700 1 --2- 172.21.15.50:0/2811820900 >> v2:172.21.15.192:3300/0 conn(0x7faf88154600 0x7faf8815aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:12.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.419+0000 7faf8ea87700 1 -- 172.21.15.50:0/2811820900 >> v2:172.21.15.192:3300/0 conn(0x7faf88154600 msgr2=0x7faf8815aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:12.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.419+0000 7faf8ea87700 1 --2- 172.21.15.50:0/2811820900 >> v2:172.21.15.192:3300/0 conn(0x7faf88154600 0x7faf8815aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:12.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.419+0000 7faf8ea87700 1 -- 172.21.15.50:0/2811820900 >> v1:172.21.15.192:6789/0 conn(0x7faf8806c650 legacy=0x7faf8806a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:12.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.419+0000 7faf8ea87700 1 -- 172.21.15.50:0/2811820900 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8815dcb0 con 0x7faf8806abe0 2023-11-28T11:58:12.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.423+0000 7faf8ea87700 1 --2- 172.21.15.50:0/2811820900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8806abe0 0x7faf8815b500 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7faf880b1b10 tx=0x7faf80009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6592a2abe5a27881 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:12.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.423+0000 7faf8d284700 1 -- 172.21.15.50:0/2811820900 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80011830 con 0x7faf8806abe0 2023-11-28T11:58:12.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.423+0000 7faf8d284700 1 -- 172.21.15.50:0/2811820900 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf80011990 con 0x7faf8806abe0 2023-11-28T11:58:12.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.423+0000 7faf8d284700 1 -- 172.21.15.50:0/2811820900 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80011d20 con 0x7faf8806abe0 2023-11-28T11:58:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.423+0000 7faf8f288700 1 -- 172.21.15.50:0/2811820900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8806abe0 msgr2=0x7faf8815b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.423+0000 7faf8f288700 1 --2- 172.21.15.50:0/2811820900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8806abe0 0x7faf8815b500 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7faf880b1b10 tx=0x7faf80009bf0 comp rx=0 tx=0).stop 2023-11-28T11:58:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.423+0000 7faf8f288700 1 -- 172.21.15.50:0/2811820900 shutdown_connections 2023-11-28T11:58:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.423+0000 7faf8f288700 1 --2- 172.21.15.50:0/2811820900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8806abe0 0x7faf8815b500 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.423+0000 7faf8f288700 1 --2- 172.21.15.50:0/2811820900 >> v2:172.21.15.192:3300/0 conn(0x7faf88154600 0x7faf8815aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.423+0000 7faf8f288700 1 -- 172.21.15.50:0/2811820900 >> 172.21.15.50:0/2811820900 conn(0x7faf8806ec40 msgr2=0x7faf880b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.423+0000 7faf8f288700 1 -- 172.21.15.50:0/2811820900 shutdown_connections 2023-11-28T11:58:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.423+0000 7faf8f288700 1 -- 172.21.15.50:0/2811820900 wait complete. 2023-11-28T11:58:12.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.423+0000 7faf8f288700 1 Processor -- start 2023-11-28T11:58:12.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.423+0000 7faf8f288700 1 -- start start 2023-11-28T11:58:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8f288700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8806abe0 0x7faf881488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8f288700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf8806c650 0x7faf880c3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8f288700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf880b44e0 0x7faf880c3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8f288700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf880b34d0 con 0x7faf880b44e0 2023-11-28T11:58:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8f288700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8815a3d0 con 0x7faf8806c650 2023-11-28T11:58:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8f288700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf88148e30 con 0x7faf8806abe0 2023-11-28T11:58:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8ea87700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf880b44e0 0x7faf880c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8e286700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8806abe0 0x7faf881488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8ea87700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf880b44e0 0x7faf880c3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45868/0 (socket says 172.21.15.50:45868) 2023-11-28T11:58:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8ea87700 1 -- 172.21.15.50:0/1691293188 learned_addr learned my addr 172.21.15.50:0/1691293188 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:58:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8da85700 1 --2- 172.21.15.50:0/1691293188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf8806c650 0x7faf880c3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8ea87700 1 -- 172.21.15.50:0/1691293188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8806abe0 msgr2=0x7faf881488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8ea87700 1 --2- 172.21.15.50:0/1691293188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8806abe0 0x7faf881488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8ea87700 1 -- 172.21.15.50:0/1691293188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf8806c650 msgr2=0x7faf880c3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8ea87700 1 --2- 172.21.15.50:0/1691293188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf8806c650 0x7faf880c3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8ea87700 1 -- 172.21.15.50:0/1691293188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf80009570 con 0x7faf880b44e0 2023-11-28T11:58:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8ea87700 1 --2- 172.21.15.50:0/1691293188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf880b44e0 0x7faf880c3580 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7faf80014040 tx=0x7faf80004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf7effd700 1 -- 172.21.15.50:0/1691293188 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80004450 con 0x7faf880b44e0 2023-11-28T11:58:12.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf7effd700 1 -- 172.21.15.50:0/1691293188 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8001e070 con 0x7faf880b44e0 2023-11-28T11:58:12.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8f288700 1 -- 172.21.15.50:0/1691293188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8815e790 con 0x7faf880b44e0 2023-11-28T11:58:12.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf8f288700 1 -- 172.21.15.50:0/1691293188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8815df90 con 0x7faf880b44e0 2023-11-28T11:58:12.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.427+0000 7faf7effd700 1 -- 172.21.15.50:0/1691293188 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80003900 con 0x7faf880b44e0 2023-11-28T11:58:12.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.431+0000 7faf8f288700 1 -- 172.21.15.50:0/1691293188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8806cad0 con 0x7faf880b44e0 2023-11-28T11:58:12.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.431+0000 7faf7effd700 1 -- 172.21.15.50:0/1691293188 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faf8000f050 con 0x7faf880b44e0 2023-11-28T11:58:12.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.431+0000 7faf7effd700 1 --2- 172.21.15.50:0/1691293188 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf6c064ee0 0x7faf6c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:12.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.431+0000 7faf7effd700 1 -- 172.21.15.50:0/1691293188 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7faf80020070 con 0x7faf880b44e0 2023-11-28T11:58:12.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.431+0000 7faf8e286700 1 --2- 172.21.15.50:0/1691293188 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf6c064ee0 0x7faf6c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:12.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.431+0000 7faf8e286700 1 --2- 172.21.15.50:0/1691293188 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf6c064ee0 0x7faf6c067390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faf78009bf0 tx=0x7faf78009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.439+0000 7faf7effd700 1 -- 172.21.15.50:0/1691293188 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faf800514b0 con 0x7faf880b44e0 2023-11-28T11:58:12.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.635+0000 7faf8f288700 1 -- 172.21.15.50:0/1691293188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7faf8815a540 con 0x7faf880b44e0 2023-11-28T11:58:12.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.639+0000 7faf7effd700 1 -- 172.21.15.50:0/1691293188 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7faf8815a540 con 0x7faf880b44e0 2023-11-28T11:58:12.639 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:58:12.639 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:58:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.639+0000 7faf8f288700 1 -- 172.21.15.50:0/1691293188 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf6c064ee0 msgr2=0x7faf6c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.639+0000 7faf8f288700 1 --2- 172.21.15.50:0/1691293188 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf6c064ee0 0x7faf6c067390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faf78009bf0 tx=0x7faf78009240 comp rx=0 tx=0).stop 2023-11-28T11:58:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.639+0000 7faf8f288700 1 -- 172.21.15.50:0/1691293188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf880b44e0 msgr2=0x7faf880c3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.639+0000 7faf8f288700 1 --2- 172.21.15.50:0/1691293188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf880b44e0 0x7faf880c3580 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7faf80014040 tx=0x7faf80004770 comp rx=0 tx=0).stop 2023-11-28T11:58:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.639+0000 7faf8f288700 1 -- 172.21.15.50:0/1691293188 shutdown_connections 2023-11-28T11:58:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.639+0000 7faf8f288700 1 --2- 172.21.15.50:0/1691293188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf880b44e0 0x7faf880c3580 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.639+0000 7faf8f288700 1 --2- 172.21.15.50:0/1691293188 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faf6c064ee0 0x7faf6c067390 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.639+0000 7faf8f288700 1 --2- 172.21.15.50:0/1691293188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf8806c650 0x7faf880c3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.639+0000 7faf8f288700 1 --2- 172.21.15.50:0/1691293188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8806abe0 0x7faf881488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.639+0000 7faf8f288700 1 -- 172.21.15.50:0/1691293188 >> 172.21.15.50:0/1691293188 conn(0x7faf8806ec40 msgr2=0x7faf88070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.639+0000 7faf8f288700 1 -- 172.21.15.50:0/1691293188 shutdown_connections 2023-11-28T11:58:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:12.639+0000 7faf8f288700 1 -- 172.21.15.50:0/1691293188 wait complete. 2023-11-28T11:58:12.654 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:58:17.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:58:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.774+0000 7f836898e700 1 Processor -- start 2023-11-28T11:58:17.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.774+0000 7f836898e700 1 -- start start 2023-11-28T11:58:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.774+0000 7f836898e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8364153420 0x7f83640c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.774+0000 7f836898e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f836415cb50 0x7f836415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.774+0000 7f836898e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83640cad30 con 0x7f83641537f0 2023-11-28T11:58:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.774+0000 7f836898e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83640cdda0 con 0x7f836415cb50 2023-11-28T11:58:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.774+0000 7f836898e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836415d4b0 con 0x7f8364153420 2023-11-28T11:58:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.774+0000 7f8362d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f836415cb50 0x7f836415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.774+0000 7f8362d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f836415cb50 0x7f836415cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45884/0 (socket says 172.21.15.50:45884) 2023-11-28T11:58:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.774+0000 7f8362d9d700 1 -- 172.21.15.50:0/3745588333 learned_addr learned my addr 172.21.15.50:0/3745588333 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:58:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.774+0000 7f836259c700 1 --2- 172.21.15.50:0/3745588333 >> v2:172.21.15.192:3300/0 conn(0x7f8364153420 0x7f83640c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f8362d9d700 1 -- 172.21.15.50:0/3745588333 >> v2:172.21.15.192:3300/0 conn(0x7f8364153420 msgr2=0x7f83640c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:17.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f8362d9d700 1 --2- 172.21.15.50:0/3745588333 >> v2:172.21.15.192:3300/0 conn(0x7f8364153420 0x7f83640c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f8362d9d700 1 -- 172.21.15.50:0/3745588333 >> v1:172.21.15.192:6789/0 conn(0x7f83641537f0 legacy=0x7f83640ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f8362d9d700 1 -- 172.21.15.50:0/3745588333 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83640b0cd0 con 0x7f836415cb50 2023-11-28T11:58:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f8362d9d700 1 --2- 172.21.15.50:0/3745588333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f836415cb50 0x7f836415cf70 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f836406f8e0 tx=0x7f835c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d1cd4020b0e1c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f8361d9b700 1 -- 172.21.15.50:0/3745588333 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c00e070 con 0x7f836415cb50 2023-11-28T11:58:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f8361d9b700 1 -- 172.21.15.50:0/3745588333 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c00b9c0 con 0x7f836415cb50 2023-11-28T11:58:17.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f8361d9b700 1 -- 172.21.15.50:0/3745588333 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c00bd70 con 0x7f836415cb50 2023-11-28T11:58:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f836898e700 1 -- 172.21.15.50:0/3745588333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f836415cb50 msgr2=0x7f836415cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f836898e700 1 --2- 172.21.15.50:0/3745588333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f836415cb50 0x7f836415cf70 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f836406f8e0 tx=0x7f835c00b330 comp rx=0 tx=0).stop 2023-11-28T11:58:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f836898e700 1 -- 172.21.15.50:0/3745588333 shutdown_connections 2023-11-28T11:58:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f836898e700 1 --2- 172.21.15.50:0/3745588333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f836415cb50 0x7f836415cf70 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f836898e700 1 --2- 172.21.15.50:0/3745588333 >> v2:172.21.15.192:3300/0 conn(0x7f8364153420 0x7f83640c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f836898e700 1 -- 172.21.15.50:0/3745588333 >> 172.21.15.50:0/3745588333 conn(0x7f836406caf0 msgr2=0x7f83640ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:17.782 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f836898e700 1 -- 172.21.15.50:0/3745588333 shutdown_connections 2023-11-28T11:58:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f836898e700 1 -- 172.21.15.50:0/3745588333 wait complete. 2023-11-28T11:58:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f836898e700 1 Processor -- start 2023-11-28T11:58:17.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.778+0000 7f836898e700 1 -- start start 2023-11-28T11:58:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836898e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8364153420 0x7f83641f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836898e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83641537f0 0x7f8364151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836898e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f836415cb50 0x7f83640c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836898e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83641591c0 con 0x7f8364153420 2023-11-28T11:58:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836898e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83640c6f10 con 0x7f836415cb50 2023-11-28T11:58:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836898e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8364158b70 con 0x7f83641537f0 2023-11-28T11:58:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8364153420 0x7f83641f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836259c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8364153420 0x7f83641f2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45886/0 (socket says 172.21.15.50:45886) 2023-11-28T11:58:17.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836259c700 1 -- 172.21.15.50:0/3554540194 learned_addr learned my addr 172.21.15.50:0/3554540194 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:58:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f8362d9d700 1 --2- 172.21.15.50:0/3554540194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f836415cb50 0x7f83640c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f835bfff700 1 --2- 172.21.15.50:0/3554540194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83641537f0 0x7f8364151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836259c700 1 -- 172.21.15.50:0/3554540194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83641537f0 msgr2=0x7f8364151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836259c700 1 --2- 172.21.15.50:0/3554540194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83641537f0 0x7f8364151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836259c700 1 -- 172.21.15.50:0/3554540194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f836415cb50 msgr2=0x7f83640c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836259c700 1 --2- 172.21.15.50:0/3554540194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f836415cb50 0x7f83640c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836259c700 1 -- 172.21.15.50:0/3554540194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c009b30 con 0x7f8364153420 2023-11-28T11:58:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836259c700 1 --2- 172.21.15.50:0/3554540194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8364153420 0x7f83641f2a70 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f835400d800 tx=0x7f835400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f835affd700 1 -- 172.21.15.50:0/3554540194 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83540125f0 con 0x7f8364153420 2023-11-28T11:58:17.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836898e700 1 -- 172.21.15.50:0/3554540194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83640b0f70 con 0x7f8364153420 2023-11-28T11:58:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f835affd700 1 -- 172.21.15.50:0/3554540194 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8354012750 con 0x7f8364153420 2023-11-28T11:58:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f835affd700 1 -- 172.21.15.50:0/3554540194 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8354012ac0 con 0x7f8364153420 2023-11-28T11:58:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836898e700 1 -- 172.21.15.50:0/3554540194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83640caa00 con 0x7f8364153420 2023-11-28T11:58:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.782+0000 7f836898e700 1 -- 172.21.15.50:0/3554540194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83641f30d0 con 0x7f8364153420 2023-11-28T11:58:17.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.786+0000 7f835affd700 1 -- 172.21.15.50:0/3554540194 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8354012c20 con 0x7f8364153420 2023-11-28T11:58:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.786+0000 7f835affd700 1 --2- 172.21.15.50:0/3554540194 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8344064ee0 0x7f8344067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.786+0000 7f835affd700 1 -- 172.21.15.50:0/3554540194 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f8354082220 con 0x7f8364153420 2023-11-28T11:58:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.786+0000 7f835bfff700 1 --2- 172.21.15.50:0/3554540194 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8344064ee0 0x7f8344067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:17.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.786+0000 7f835bfff700 1 --2- 172.21.15.50:0/3554540194 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8344064ee0 0x7f8344067390 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f83640c5d60 tx=0x7f834c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:17.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.790+0000 7f835affd700 1 -- 172.21.15.50:0/3554540194 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f83540501c0 con 0x7f8364153420 2023-11-28T11:58:17.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.990+0000 7f836898e700 1 -- 172.21.15.50:0/3554540194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f83640b1250 con 0x7f8364153420 2023-11-28T11:58:17.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.990+0000 7f835affd700 1 -- 172.21.15.50:0/3554540194 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f83540537e0 con 0x7f8364153420 2023-11-28T11:58:17.994 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:58:17.994 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:58:17.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.994+0000 7f836898e700 1 -- 172.21.15.50:0/3554540194 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8344064ee0 msgr2=0x7f8344067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:17.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.994+0000 7f836898e700 1 --2- 172.21.15.50:0/3554540194 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8344064ee0 0x7f8344067390 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f83640c5d60 tx=0x7f834c009040 comp rx=0 tx=0).stop 2023-11-28T11:58:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.994+0000 7f836898e700 1 -- 172.21.15.50:0/3554540194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8364153420 msgr2=0x7f83641f2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.994+0000 7f836898e700 1 --2- 172.21.15.50:0/3554540194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8364153420 0x7f83641f2a70 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f835400d800 tx=0x7f835400db10 comp rx=0 tx=0).stop 2023-11-28T11:58:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.994+0000 7f836898e700 1 -- 172.21.15.50:0/3554540194 shutdown_connections 2023-11-28T11:58:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.994+0000 7f836898e700 1 --2- 172.21.15.50:0/3554540194 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8344064ee0 0x7f8344067390 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.994+0000 7f836898e700 1 --2- 172.21.15.50:0/3554540194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f836415cb50 0x7f83640c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.994+0000 7f836898e700 1 --2- 172.21.15.50:0/3554540194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83641537f0 0x7f8364151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.994+0000 7f836898e700 1 --2- 172.21.15.50:0/3554540194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8364153420 0x7f83641f2a70 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.994+0000 7f836898e700 1 -- 172.21.15.50:0/3554540194 >> 172.21.15.50:0/3554540194 conn(0x7f836406caf0 msgr2=0x7f83640c4850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.994+0000 7f836898e700 1 -- 172.21.15.50:0/3554540194 shutdown_connections 2023-11-28T11:58:17.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:17.994+0000 7f836898e700 1 -- 172.21.15.50:0/3554540194 wait complete. 2023-11-28T11:58:18.009 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:58:23.010 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:58:23.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.130+0000 7f1357fff700 1 Processor -- start 2023-11-28T11:58:23.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.130+0000 7f1357fff700 1 -- start start 2023-11-28T11:58:23.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f1357fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f135813f240 0x7f135806c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:23.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f1357fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135813d5a0 con 0x7f135813ee70 2023-11-28T11:58:23.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f1357fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135813f880 con 0x7f135806cb80 2023-11-28T11:58:23.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f1357fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135813f670 con 0x7f135813f240 2023-11-28T11:58:23.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f1356ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f135813ee70 0x7f135815e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46352/0 (socket says 172.21.15.50:46352) 2023-11-28T11:58:23.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f1356ffd700 1 -- 172.21.15.50:0/3726553144 learned_addr learned my addr 172.21.15.50:0/3726553144 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:58:23.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f13567fc700 1 --2- 172.21.15.50:0/3726553144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f135813f240 0x7f135806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:23.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f1355ffb700 1 -- 172.21.15.50:0/3726553144 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391589759 0 0) 0x7f135813d5a0 con 0x7f135813ee70 2023-11-28T11:58:23.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f1355ffb700 1 -- 172.21.15.50:0/3726553144 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13400035d0 con 0x7f135813ee70 2023-11-28T11:58:23.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f1355ffb700 1 -- 172.21.15.50:0/3726553144 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720033708 0 0) 0x7f135813f880 con 0x7f135806cb80 2023-11-28T11:58:23.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f1355ffb700 1 -- 172.21.15.50:0/3726553144 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f135813d5a0 con 0x7f135806cb80 2023-11-28T11:58:23.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f1355ffb700 1 -- 172.21.15.50:0/3726553144 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2248917550 0 0) 0x7f13400035d0 con 0x7f135813ee70 2023-11-28T11:58:23.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f13567fc700 1 -- 172.21.15.50:0/3726553144 >> v1:172.21.15.192:6789/0 conn(0x7f135806cb80 legacy=0x7f13580cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:23.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f13567fc700 1 -- 172.21.15.50:0/3726553144 >> v1:172.21.15.50:6789/0 conn(0x7f135813ee70 legacy=0x7f135815e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:23.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f13567fc700 1 -- 172.21.15.50:0/3726553144 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135813fb60 con 0x7f135813f240 2023-11-28T11:58:23.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f13567fc700 1 --2- 172.21.15.50:0/3726553144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f135813f240 0x7f135806c640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f134c009880 tx=0x7f134c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab9739397c01b452 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:23.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f1355ffb700 1 -- 172.21.15.50:0/3726553144 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348001670 con 0x7f135813f240 2023-11-28T11:58:23.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f1355ffb700 1 -- 172.21.15.50:0/3726553144 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c004030 con 0x7f135813f240 2023-11-28T11:58:23.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f1355ffb700 1 -- 172.21.15.50:0/3726553144 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c0043a0 con 0x7f135813f240 2023-11-28T11:58:23.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f1357fff700 1 -- 172.21.15.50:0/3726553144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f135813f240 msgr2=0x7f135806c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.134+0000 7f1357fff700 1 --2- 172.21.15.50:0/3726553144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f135813f240 0x7f135806c640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f134c009880 tx=0x7f134c009b90 comp rx=0 tx=0).stop 2023-11-28T11:58:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.138+0000 7f1357fff700 1 -- 172.21.15.50:0/3726553144 shutdown_connections 2023-11-28T11:58:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.138+0000 7f1357fff700 1 --2- 172.21.15.50:0/3726553144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f135813f240 0x7f135806c640 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.138+0000 7f1357fff700 1 -- 172.21.15.50:0/3726553144 >> 172.21.15.50:0/3726553144 conn(0x7f135806e000 msgr2=0x7f13580b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.138+0000 7f1357fff700 1 -- 172.21.15.50:0/3726553144 shutdown_connections 2023-11-28T11:58:23.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.138+0000 7f1357fff700 1 -- 172.21.15.50:0/3726553144 wait complete. 2023-11-28T11:58:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.138+0000 7f1357fff700 1 Processor -- start 2023-11-28T11:58:23.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.138+0000 7f1357fff700 1 -- start start 2023-11-28T11:58:23.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1357fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135806cb80 0x7f13581eed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:23.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1357fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f135813ee70 0x7f13580ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1357fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f135813f240 0x7f13580cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1357fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13581558d0 con 0x7f135806cb80 2023-11-28T11:58:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1357fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1358149490 con 0x7f135813f240 2023-11-28T11:58:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1357fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1358154c50 con 0x7f135813ee70 2023-11-28T11:58:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1356ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135806cb80 0x7f13581eed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:23.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1356ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135806cb80 0x7f13581eed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60582/0 (socket says 172.21.15.50:60582) 2023-11-28T11:58:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1356ffd700 1 -- 172.21.15.50:0/2108335438 learned_addr learned my addr 172.21.15.50:0/2108335438 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:58:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f13567fc700 1 --2- 172.21.15.50:0/2108335438 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f135813ee70 0x7f13580ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f13577fe700 1 --2- 172.21.15.50:0/2108335438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f135813f240 0x7f13580cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1356ffd700 1 -- 172.21.15.50:0/2108335438 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f135813ee70 msgr2=0x7f13580ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1356ffd700 1 --2- 172.21.15.50:0/2108335438 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f135813ee70 0x7f13580ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:23.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1356ffd700 1 -- 172.21.15.50:0/2108335438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f135813f240 msgr2=0x7f13580cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1356ffd700 1 --2- 172.21.15.50:0/2108335438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f135813f240 0x7f13580cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1356ffd700 1 -- 172.21.15.50:0/2108335438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c0094b0 con 0x7f135806cb80 2023-11-28T11:58:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f13577fe700 1 --2- 172.21.15.50:0/2108335438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f135813f240 0x7f13580cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1356ffd700 1 --2- 172.21.15.50:0/2108335438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135806cb80 0x7f13581eed90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f134800c750 tx=0x7f134800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f133ffff700 1 -- 172.21.15.50:0/2108335438 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348004ca0 con 0x7f135806cb80 2023-11-28T11:58:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f133ffff700 1 -- 172.21.15.50:0/2108335438 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1348004e20 con 0x7f135806cb80 2023-11-28T11:58:23.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1357fff700 1 -- 172.21.15.50:0/2108335438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1358140120 con 0x7f135806cb80 2023-11-28T11:58:23.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f133ffff700 1 -- 172.21.15.50:0/2108335438 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348007310 con 0x7f135806cb80 2023-11-28T11:58:23.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1357fff700 1 -- 172.21.15.50:0/2108335438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135813fe40 con 0x7f135806cb80 2023-11-28T11:58:23.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.142+0000 7f1357fff700 1 -- 172.21.15.50:0/2108335438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1358140400 con 0x7f135806cb80 2023-11-28T11:58:23.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.146+0000 7f133ffff700 1 -- 172.21.15.50:0/2108335438 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f134801a030 con 0x7f135806cb80 2023-11-28T11:58:23.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.146+0000 7f133ffff700 1 --2- 172.21.15.50:0/2108335438 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1344064ee0 0x7f1344067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:23.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.146+0000 7f133ffff700 1 -- 172.21.15.50:0/2108335438 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f1348081470 con 0x7f135806cb80 2023-11-28T11:58:23.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.146+0000 7f13567fc700 1 --2- 172.21.15.50:0/2108335438 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1344064ee0 0x7f1344067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:23.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.146+0000 7f13567fc700 1 --2- 172.21.15.50:0/2108335438 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1344064ee0 0x7f1344067390 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f134c0090b0 tx=0x7f134c010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:23.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.154+0000 7f133ffff700 1 -- 172.21.15.50:0/2108335438 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f134804f3a0 con 0x7f135806cb80 2023-11-28T11:58:23.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.354+0000 7f1357fff700 1 -- 172.21.15.50:0/2108335438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1358072c20 con 0x7f135806cb80 2023-11-28T11:58:23.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.354+0000 7f133ffff700 1 -- 172.21.15.50:0/2108335438 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f13480529c0 con 0x7f135806cb80 2023-11-28T11:58:23.357 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:58:23.357 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:58:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.354+0000 7f1357fff700 1 -- 172.21.15.50:0/2108335438 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1344064ee0 msgr2=0x7f1344067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.354+0000 7f1357fff700 1 --2- 172.21.15.50:0/2108335438 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1344064ee0 0x7f1344067390 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f134c0090b0 tx=0x7f134c010000 comp rx=0 tx=0).stop 2023-11-28T11:58:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.354+0000 7f1357fff700 1 -- 172.21.15.50:0/2108335438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135806cb80 msgr2=0x7f13581eed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.354+0000 7f1357fff700 1 --2- 172.21.15.50:0/2108335438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135806cb80 0x7f13581eed90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f134800c750 tx=0x7f134800cb10 comp rx=0 tx=0).stop 2023-11-28T11:58:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.354+0000 7f1357fff700 1 -- 172.21.15.50:0/2108335438 shutdown_connections 2023-11-28T11:58:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.354+0000 7f1357fff700 1 --2- 172.21.15.50:0/2108335438 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1344064ee0 0x7f1344067390 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.354+0000 7f1357fff700 1 --2- 172.21.15.50:0/2108335438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f135813f240 0x7f13580cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.354+0000 7f1357fff700 1 --2- 172.21.15.50:0/2108335438 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f135813ee70 0x7f13580ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.354+0000 7f1357fff700 1 --2- 172.21.15.50:0/2108335438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f135806cb80 0x7f13581eed90 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.354+0000 7f1357fff700 1 -- 172.21.15.50:0/2108335438 >> 172.21.15.50:0/2108335438 conn(0x7f135806e000 msgr2=0x7f13580706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.358+0000 7f1357fff700 1 -- 172.21.15.50:0/2108335438 shutdown_connections 2023-11-28T11:58:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:23.358+0000 7f1357fff700 1 -- 172.21.15.50:0/2108335438 wait complete. 2023-11-28T11:58:23.371 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:58:28.372 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:58:28.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.490+0000 7f9cabfff700 1 Processor -- start 2023-11-28T11:58:28.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.490+0000 7f9cabfff700 1 -- start start 2023-11-28T11:58:28.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9cabfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9cac0b1ca0 0x7f9cac0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:28.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9cabfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9cac0d2780 0x7f9cac0d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:28.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9cabfff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cac0cf070 con 0x7f9cac06a330 2023-11-28T11:58:28.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9cabfff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cac0d3140 con 0x7f9cac0b1ca0 2023-11-28T11:58:28.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9cabfff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cac0b2070 con 0x7f9cac0d2780 2023-11-28T11:58:28.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9caaffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9cac0b1ca0 0x7f9cac0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:28.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9caa7fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9cac06a330 0x7f9cac0cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46366/0 (socket says 172.21.15.50:46366) 2023-11-28T11:58:28.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9caa7fc700 1 -- 172.21.15.50:0/546503146 learned_addr learned my addr 172.21.15.50:0/546503146 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:58:28.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9cab7fe700 1 --2- 172.21.15.50:0/546503146 >> v2:172.21.15.192:3300/0 conn(0x7f9cac0d2780 0x7f9cac0d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:28.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9caaffd700 1 -- 172.21.15.50:0/546503146 >> v2:172.21.15.192:3300/0 conn(0x7f9cac0d2780 msgr2=0x7f9cac0d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:28.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9caaffd700 1 --2- 172.21.15.50:0/546503146 >> v2:172.21.15.192:3300/0 conn(0x7f9cac0d2780 0x7f9cac0d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:28.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9caaffd700 1 -- 172.21.15.50:0/546503146 >> v1:172.21.15.50:6789/0 conn(0x7f9cac06a330 legacy=0x7f9cac0cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9ca9ffb700 1 -- 172.21.15.50:0/546503146 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176049225 0 0) 0x7f9cac0cf070 con 0x7f9cac06a330 2023-11-28T11:58:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9caaffd700 1 -- 172.21.15.50:0/546503146 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac06a8a0 con 0x7f9cac0b1ca0 2023-11-28T11:58:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9caaffd700 1 --2- 172.21.15.50:0/546503146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cac0b1ca0 0x7f9cac0b6250 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0b56f0 tx=0x7f9c9c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df530322889d46af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9ca9ffb700 1 -- 172.21.15.50:0/546503146 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c011830 con 0x7f9cac0b1ca0 2023-11-28T11:58:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9ca9ffb700 1 -- 172.21.15.50:0/546503146 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9c011990 con 0x7f9cac0b1ca0 2023-11-28T11:58:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9ca9ffb700 1 -- 172.21.15.50:0/546503146 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c011d40 con 0x7f9cac0b1ca0 2023-11-28T11:58:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9cabfff700 1 -- 172.21.15.50:0/546503146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cac0b1ca0 msgr2=0x7f9cac0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9cabfff700 1 --2- 172.21.15.50:0/546503146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cac0b1ca0 0x7f9cac0b6250 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0b56f0 tx=0x7f9c9c009b30 comp rx=0 tx=0).stop 2023-11-28T11:58:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9cabfff700 1 -- 172.21.15.50:0/546503146 shutdown_connections 2023-11-28T11:58:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9cabfff700 1 --2- 172.21.15.50:0/546503146 >> v2:172.21.15.192:3300/0 conn(0x7f9cac0d2780 0x7f9cac0d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:28.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9cabfff700 1 --2- 172.21.15.50:0/546503146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cac0b1ca0 0x7f9cac0b6250 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:28.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9cabfff700 1 -- 172.21.15.50:0/546503146 >> 172.21.15.50:0/546503146 conn(0x7f9cac0b5740 msgr2=0x7f9cac0b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:28.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9cabfff700 1 -- 172.21.15.50:0/546503146 shutdown_connections 2023-11-28T11:58:28.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9cabfff700 1 -- 172.21.15.50:0/546503146 wait complete. 2023-11-28T11:58:28.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9cabfff700 1 Processor -- start 2023-11-28T11:58:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.494+0000 7f9cabfff700 1 -- start start 2023-11-28T11:58:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9cabfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cac06a330 0x7f9cac14aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9cabfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cac0b1ca0 0x7f9cac14b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9cabfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cac0d2780 0x7f9cac0cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9cabfff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac0ca570 con 0x7f9cac06a330 2023-11-28T11:58:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9cabfff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac0c9960 con 0x7f9cac0d2780 2023-11-28T11:58:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9cabfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac0c9c40 con 0x7f9cac0b1ca0 2023-11-28T11:58:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9caaffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cac06a330 0x7f9cac14aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9caaffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cac06a330 0x7f9cac14aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60606/0 (socket says 172.21.15.50:60606) 2023-11-28T11:58:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9caaffd700 1 -- 172.21.15.50:0/339036275 learned_addr learned my addr 172.21.15.50:0/339036275 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:58:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9caa7fc700 1 --2- 172.21.15.50:0/339036275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cac0b1ca0 0x7f9cac14b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:28.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9cab7fe700 1 --2- 172.21.15.50:0/339036275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cac0d2780 0x7f9cac0cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:28.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9caaffd700 1 -- 172.21.15.50:0/339036275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cac0b1ca0 msgr2=0x7f9cac14b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:28.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9caaffd700 1 --2- 172.21.15.50:0/339036275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cac0b1ca0 0x7f9cac14b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:28.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9caaffd700 1 -- 172.21.15.50:0/339036275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cac0d2780 msgr2=0x7f9cac0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:28.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9caaffd700 1 --2- 172.21.15.50:0/339036275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cac0d2780 0x7f9cac0cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:28.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9caaffd700 1 -- 172.21.15.50:0/339036275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c0094b0 con 0x7f9cac06a330 2023-11-28T11:58:28.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9caa7fc700 1 --2- 172.21.15.50:0/339036275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cac0b1ca0 0x7f9cac14b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:58:28.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9caaffd700 1 --2- 172.21.15.50:0/339036275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cac06a330 0x7f9cac14aba0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c014040 tx=0x7f9c9c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:28.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9ca3fff700 1 -- 172.21.15.50:0/339036275 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c019ab0 con 0x7f9cac06a330 2023-11-28T11:58:28.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9ca3fff700 1 -- 172.21.15.50:0/339036275 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9c01e070 con 0x7f9cac06a330 2023-11-28T11:58:28.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9ca3fff700 1 -- 172.21.15.50:0/339036275 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c019e50 con 0x7f9cac06a330 2023-11-28T11:58:28.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9cabfff700 1 -- 172.21.15.50:0/339036275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cac06ae60 con 0x7f9cac06a330 2023-11-28T11:58:28.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9cabfff700 1 -- 172.21.15.50:0/339036275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cac06ab80 con 0x7f9cac06a330 2023-11-28T11:58:28.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.498+0000 7f9cabfff700 1 -- 172.21.15.50:0/339036275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cac06b140 con 0x7f9cac06a330 2023-11-28T11:58:28.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.502+0000 7f9ca3fff700 1 -- 172.21.15.50:0/339036275 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9c9c00f050 con 0x7f9cac06a330 2023-11-28T11:58:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.502+0000 7f9ca3fff700 1 --2- 172.21.15.50:0/339036275 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9c8c064ee0 0x7f9c8c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:28.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.502+0000 7f9ca3fff700 1 -- 172.21.15.50:0/339036275 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f9c9c0830d0 con 0x7f9cac06a330 2023-11-28T11:58:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.502+0000 7f9caa7fc700 1 --2- 172.21.15.50:0/339036275 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9c8c064ee0 0x7f9c8c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:28.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.502+0000 7f9caa7fc700 1 --2- 172.21.15.50:0/339036275 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9c8c064ee0 0x7f9c8c067390 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9cac1f4da0 tx=0x7f9c94001960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:28.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.510+0000 7f9ca3fff700 1 -- 172.21.15.50:0/339036275 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9c9c0510f0 con 0x7f9cac06a330 2023-11-28T11:58:28.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.710+0000 7f9cabfff700 1 -- 172.21.15.50:0/339036275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9cac072c20 con 0x7f9cac06a330 2023-11-28T11:58:28.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.710+0000 7f9ca3fff700 1 -- 172.21.15.50:0/339036275 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f9c9c0200c0 con 0x7f9cac06a330 2023-11-28T11:58:28.714 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:58:28.714 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:58:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.714+0000 7f9cabfff700 1 -- 172.21.15.50:0/339036275 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9c8c064ee0 msgr2=0x7f9c8c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.714+0000 7f9cabfff700 1 --2- 172.21.15.50:0/339036275 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9c8c064ee0 0x7f9c8c067390 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9cac1f4da0 tx=0x7f9c94001960 comp rx=0 tx=0).stop 2023-11-28T11:58:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.714+0000 7f9cabfff700 1 -- 172.21.15.50:0/339036275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cac06a330 msgr2=0x7f9cac14aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.714+0000 7f9cabfff700 1 --2- 172.21.15.50:0/339036275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cac06a330 0x7f9cac14aba0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c014040 tx=0x7f9c9c004770 comp rx=0 tx=0).stop 2023-11-28T11:58:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.714+0000 7f9cabfff700 1 -- 172.21.15.50:0/339036275 shutdown_connections 2023-11-28T11:58:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.714+0000 7f9cabfff700 1 --2- 172.21.15.50:0/339036275 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9c8c064ee0 0x7f9c8c067390 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:28.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.714+0000 7f9cabfff700 1 --2- 172.21.15.50:0/339036275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cac0d2780 0x7f9cac0cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.714+0000 7f9cabfff700 1 --2- 172.21.15.50:0/339036275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cac0b1ca0 0x7f9cac14b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.714+0000 7f9cabfff700 1 --2- 172.21.15.50:0/339036275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cac06a330 0x7f9cac14aba0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.714+0000 7f9cabfff700 1 -- 172.21.15.50:0/339036275 >> 172.21.15.50:0/339036275 conn(0x7f9cac0b5740 msgr2=0x7f9cac0cf500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.714+0000 7f9cabfff700 1 -- 172.21.15.50:0/339036275 shutdown_connections 2023-11-28T11:58:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:28.714+0000 7f9cabfff700 1 -- 172.21.15.50:0/339036275 wait complete. 2023-11-28T11:58:28.729 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:58:33.730 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:58:33.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f39ed5700 1 Processor -- start 2023-11-28T11:58:33.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f39ed5700 1 -- start start 2023-11-28T11:58:33.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f39ed5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f341606b0 0x7f4f340c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f39ed5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4f340ceef0 0x7f4f340c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f39ed5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f340ad610 0x7f4f34164040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f39ed5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f340cae70 con 0x7f4f340ad610 2023-11-28T11:58:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f39ed5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f340cbc10 con 0x7f4f340ceef0 2023-11-28T11:58:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f39ed5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f340cb130 con 0x7f4f341606b0 2023-11-28T11:58:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f396d4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f340ad610 0x7f4f34164040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f396d4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f340ad610 0x7f4f34164040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47618/0 (socket says 172.21.15.50:47618) 2023-11-28T11:58:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f396d4700 1 -- 172.21.15.50:0/1941401976 learned_addr learned my addr 172.21.15.50:0/1941401976 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:58:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f38ed3700 1 --2- 172.21.15.50:0/1941401976 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f341606b0 0x7f4f340c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f33fff700 1 --2- 172.21.15.50:0/1941401976 >> v2:172.21.15.192:3300/0 conn(0x7f4f340ceef0 0x7f4f340c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f396d4700 1 -- 172.21.15.50:0/1941401976 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f341606b0 msgr2=0x7f4f340c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f396d4700 1 --2- 172.21.15.50:0/1941401976 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f341606b0 0x7f4f340c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f396d4700 1 -- 172.21.15.50:0/1941401976 >> v2:172.21.15.192:3300/0 conn(0x7f4f340ceef0 msgr2=0x7f4f340c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f396d4700 1 --2- 172.21.15.50:0/1941401976 >> v2:172.21.15.192:3300/0 conn(0x7f4f340ceef0 0x7f4f340c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f396d4700 1 -- 172.21.15.50:0/1941401976 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f340cb410 con 0x7f4f340ad610 2023-11-28T11:58:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f33fff700 1 --2- 172.21.15.50:0/1941401976 >> v2:172.21.15.192:3300/0 conn(0x7f4f340ceef0 0x7f4f340c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.854+0000 7f4f396d4700 1 --2- 172.21.15.50:0/1941401976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340ad610 0x7f4f34164040 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f4f340cbf00 tx=0x7f4f2c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71660d3c006f037 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.858+0000 7f4f337fe700 1 -- 172.21.15.50:0/1941401976 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c011830 con 0x7f4f340ad610 2023-11-28T11:58:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.858+0000 7f4f337fe700 1 -- 172.21.15.50:0/1941401976 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c011990 con 0x7f4f340ad610 2023-11-28T11:58:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.858+0000 7f4f337fe700 1 -- 172.21.15.50:0/1941401976 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c011d20 con 0x7f4f340ad610 2023-11-28T11:58:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.858+0000 7f4f39ed5700 1 -- 172.21.15.50:0/1941401976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340ad610 msgr2=0x7f4f34164040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.858+0000 7f4f39ed5700 1 --2- 172.21.15.50:0/1941401976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340ad610 0x7f4f34164040 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f4f340cbf00 tx=0x7f4f2c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.858+0000 7f4f39ed5700 1 -- 172.21.15.50:0/1941401976 shutdown_connections 2023-11-28T11:58:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.858+0000 7f4f39ed5700 1 --2- 172.21.15.50:0/1941401976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340ad610 0x7f4f34164040 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.858+0000 7f4f39ed5700 1 --2- 172.21.15.50:0/1941401976 >> v2:172.21.15.192:3300/0 conn(0x7f4f340ceef0 0x7f4f340c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.858+0000 7f4f39ed5700 1 --2- 172.21.15.50:0/1941401976 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f341606b0 0x7f4f340c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.858+0000 7f4f39ed5700 1 -- 172.21.15.50:0/1941401976 >> 172.21.15.50:0/1941401976 conn(0x7f4f340ce3e0 msgr2=0x7f4f340ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.858+0000 7f4f39ed5700 1 -- 172.21.15.50:0/1941401976 shutdown_connections 2023-11-28T11:58:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.858+0000 7f4f39ed5700 1 -- 172.21.15.50:0/1941401976 wait complete. 2023-11-28T11:58:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.858+0000 7f4f39ed5700 1 Processor -- start 2023-11-28T11:58:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.858+0000 7f4f39ed5700 1 -- start start 2023-11-28T11:58:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f39ed5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340ad610 0x7f4f340c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f39ed5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f340ceef0 0x7f4f341e9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f39ed5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f341606b0 0x7f4f3415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f39ed5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f340c29f0 con 0x7f4f340ad610 2023-11-28T11:58:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f39ed5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f341e9d20 con 0x7f4f340ceef0 2023-11-28T11:58:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f39ed5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f341ea000 con 0x7f4f341606b0 2023-11-28T11:58:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f38ed3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340ad610 0x7f4f340c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f38ed3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340ad610 0x7f4f340c35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47622/0 (socket says 172.21.15.50:47622) 2023-11-28T11:58:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f38ed3700 1 -- 172.21.15.50:0/2258985800 learned_addr learned my addr 172.21.15.50:0/2258985800 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:58:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f33fff700 1 --2- 172.21.15.50:0/2258985800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f340ceef0 0x7f4f341e9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f396d4700 1 --2- 172.21.15.50:0/2258985800 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f341606b0 0x7f4f3415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f38ed3700 1 -- 172.21.15.50:0/2258985800 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f341606b0 msgr2=0x7f4f3415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f38ed3700 1 --2- 172.21.15.50:0/2258985800 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f341606b0 0x7f4f3415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f38ed3700 1 -- 172.21.15.50:0/2258985800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f340ceef0 msgr2=0x7f4f341e9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:33.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f38ed3700 1 --2- 172.21.15.50:0/2258985800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f340ceef0 0x7f4f341e9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:33.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f38ed3700 1 -- 172.21.15.50:0/2258985800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f24009a70 con 0x7f4f340ad610 2023-11-28T11:58:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f38ed3700 1 --2- 172.21.15.50:0/2258985800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340ad610 0x7f4f340c35c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800e840 tx=0x7f4f2800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f317fa700 1 -- 172.21.15.50:0/2258985800 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f280095a0 con 0x7f4f340ad610 2023-11-28T11:58:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f317fa700 1 -- 172.21.15.50:0/2258985800 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f28013680 con 0x7f4f340ad610 2023-11-28T11:58:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f39ed5700 1 -- 172.21.15.50:0/2258985800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c009570 con 0x7f4f340ad610 2023-11-28T11:58:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f317fa700 1 -- 172.21.15.50:0/2258985800 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f280139f0 con 0x7f4f340ad610 2023-11-28T11:58:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.862+0000 7f4f39ed5700 1 -- 172.21.15.50:0/2258985800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f340b36c0 con 0x7f4f340ad610 2023-11-28T11:58:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.866+0000 7f4f39ed5700 1 -- 172.21.15.50:0/2258985800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f340cb6f0 con 0x7f4f340ad610 2023-11-28T11:58:33.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.866+0000 7f4f317fa700 1 -- 172.21.15.50:0/2258985800 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4f28019030 con 0x7f4f340ad610 2023-11-28T11:58:33.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.866+0000 7f4f317fa700 1 --2- 172.21.15.50:0/2258985800 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4f20064ee0 0x7f4f20067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:33.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.866+0000 7f4f317fa700 1 -- 172.21.15.50:0/2258985800 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f4f28081da0 con 0x7f4f340ad610 2023-11-28T11:58:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.866+0000 7f4f33fff700 1 --2- 172.21.15.50:0/2258985800 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4f20064ee0 0x7f4f20067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.870+0000 7f4f33fff700 1 --2- 172.21.15.50:0/2258985800 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4f20064ee0 0x7f4f20067390 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4f24009fd0 tx=0x7f4f2400d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:33.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:33.878+0000 7f4f317fa700 1 -- 172.21.15.50:0/2258985800 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4f2804fd60 con 0x7f4f340ad610 2023-11-28T11:58:34.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:34.078+0000 7f4f39ed5700 1 -- 172.21.15.50:0/2258985800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4f34164580 con 0x7f4f340ad610 2023-11-28T11:58:34.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:34.082+0000 7f4f317fa700 1 -- 172.21.15.50:0/2258985800 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f4f28053380 con 0x7f4f340ad610 2023-11-28T11:58:34.083 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:58:34.083 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:34.086+0000 7f4f39ed5700 1 -- 172.21.15.50:0/2258985800 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4f20064ee0 msgr2=0x7f4f20067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:34.086+0000 7f4f39ed5700 1 --2- 172.21.15.50:0/2258985800 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4f20064ee0 0x7f4f20067390 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4f24009fd0 tx=0x7f4f2400d040 comp rx=0 tx=0).stop 2023-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:34.086+0000 7f4f39ed5700 1 -- 172.21.15.50:0/2258985800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340ad610 msgr2=0x7f4f340c35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:34.086+0000 7f4f39ed5700 1 --2- 172.21.15.50:0/2258985800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340ad610 0x7f4f340c35c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800e840 tx=0x7f4f2800eb50 comp rx=0 tx=0).stop 2023-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:34.086+0000 7f4f39ed5700 1 -- 172.21.15.50:0/2258985800 shutdown_connections 2023-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:34.086+0000 7f4f39ed5700 1 --2- 172.21.15.50:0/2258985800 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f341606b0 0x7f4f3415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:34.086+0000 7f4f39ed5700 1 --2- 172.21.15.50:0/2258985800 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4f20064ee0 0x7f4f20067390 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:34.086+0000 7f4f39ed5700 1 --2- 172.21.15.50:0/2258985800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f340ceef0 0x7f4f341e9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:34.086+0000 7f4f39ed5700 1 --2- 172.21.15.50:0/2258985800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340ad610 0x7f4f340c35c0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:34.086+0000 7f4f39ed5700 1 -- 172.21.15.50:0/2258985800 >> 172.21.15.50:0/2258985800 conn(0x7f4f340ce3e0 msgr2=0x7f4f3406bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:34.086+0000 7f4f39ed5700 1 -- 172.21.15.50:0/2258985800 shutdown_connections 2023-11-28T11:58:34.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:34.086+0000 7f4f39ed5700 1 -- 172.21.15.50:0/2258985800 wait complete. 2023-11-28T11:58:34.102 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:58:36.513 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:58:36.516 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:58:39.103 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:58:39.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.218+0000 7f991359e700 1 Processor -- start 2023-11-28T11:58:39.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.218+0000 7f991359e700 1 -- start start 2023-11-28T11:58:39.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991359e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f99140ad490 0x7f99140c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:39.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991359e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99140cd8f0 con 0x7f9914158e60 2023-11-28T11:58:39.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991359e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991406dc60 con 0x7f99140cb460 2023-11-28T11:58:39.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991359e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99140add00 con 0x7f99140ad490 2023-11-28T11:58:39.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991259c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9914158e60 0x7f99140cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59452/0 (socket says 172.21.15.50:59452) 2023-11-28T11:58:39.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991259c700 1 -- 172.21.15.50:0/3054592478 learned_addr learned my addr 172.21.15.50:0/3054592478 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:58:39.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f9912d9d700 1 --2- 172.21.15.50:0/3054592478 >> v2:172.21.15.192:3300/0 conn(0x7f99140ad490 0x7f99140c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991159a700 1 -- 172.21.15.50:0/3054592478 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172269991 0 0) 0x7f99140cd8f0 con 0x7f9914158e60 2023-11-28T11:58:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991159a700 1 -- 172.21.15.50:0/3054592478 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98fc0035d0 con 0x7f9914158e60 2023-11-28T11:58:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991159a700 1 -- 172.21.15.50:0/3054592478 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762671242 0 0) 0x7f991406dc60 con 0x7f99140cb460 2023-11-28T11:58:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991159a700 1 -- 172.21.15.50:0/3054592478 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99140cd8f0 con 0x7f99140cb460 2023-11-28T11:58:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f9912d9d700 1 -- 172.21.15.50:0/3054592478 >> v1:172.21.15.192:6789/0 conn(0x7f99140cb460 legacy=0x7f991406c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f9912d9d700 1 -- 172.21.15.50:0/3054592478 >> v1:172.21.15.50:6789/0 conn(0x7f9914158e60 legacy=0x7f99140cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f9912d9d700 1 -- 172.21.15.50:0/3054592478 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99140cde90 con 0x7f99140ad490 2023-11-28T11:58:39.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f9912d9d700 1 --2- 172.21.15.50:0/3054592478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99140ad490 0x7f99140c8a30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f990c009850 tx=0x7f990c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1a62caf42ea312e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:39.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991159a700 1 -- 172.21.15.50:0/3054592478 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c011830 con 0x7f99140ad490 2023-11-28T11:58:39.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991159a700 1 -- 172.21.15.50:0/3054592478 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c011990 con 0x7f99140ad490 2023-11-28T11:58:39.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991159a700 1 -- 172.21.15.50:0/3054592478 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c011d40 con 0x7f99140ad490 2023-11-28T11:58:39.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991359e700 1 -- 172.21.15.50:0/3054592478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99140ad490 msgr2=0x7f99140c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:39.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991359e700 1 --2- 172.21.15.50:0/3054592478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99140ad490 0x7f99140c8a30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f990c009850 tx=0x7f990c009b60 comp rx=0 tx=0).stop 2023-11-28T11:58:39.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991359e700 1 -- 172.21.15.50:0/3054592478 shutdown_connections 2023-11-28T11:58:39.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991359e700 1 --2- 172.21.15.50:0/3054592478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99140ad490 0x7f99140c8a30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:39.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991359e700 1 -- 172.21.15.50:0/3054592478 >> 172.21.15.50:0/3054592478 conn(0x7f99140ce3e0 msgr2=0x7f99140ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:39.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991359e700 1 -- 172.21.15.50:0/3054592478 shutdown_connections 2023-11-28T11:58:39.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.222+0000 7f991359e700 1 -- 172.21.15.50:0/3054592478 wait complete. 2023-11-28T11:58:39.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.226+0000 7f991359e700 1 Processor -- start 2023-11-28T11:58:39.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.226+0000 7f991359e700 1 -- start start 2023-11-28T11:58:39.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.226+0000 7f991359e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99140ad490 0x7f9914156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:39.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.226+0000 7f991359e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99140cb460 0x7f9914070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:39.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.226+0000 7f991359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914158e60 0x7f9914071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:39.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.226+0000 7f991359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99141581b0 con 0x7f9914158e60 2023-11-28T11:58:39.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.226+0000 7f991359e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99140c56c0 con 0x7f99140ad490 2023-11-28T11:58:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.226+0000 7f991359e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9914157880 con 0x7f99140cb460 2023-11-28T11:58:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.226+0000 7f9912d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914158e60 0x7f9914071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.226+0000 7f9912d9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914158e60 0x7f9914071330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47626/0 (socket says 172.21.15.50:47626) 2023-11-28T11:58:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.226+0000 7f9912d9d700 1 -- 172.21.15.50:0/3202528742 learned_addr learned my addr 172.21.15.50:0/3202528742 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:58:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.226+0000 7f991259c700 1 --2- 172.21.15.50:0/3202528742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99140ad490 0x7f9914156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:39.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.226+0000 7f9911d9b700 1 --2- 172.21.15.50:0/3202528742 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99140cb460 0x7f9914070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:39.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.230+0000 7f9912d9d700 1 -- 172.21.15.50:0/3202528742 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99140cb460 msgr2=0x7f9914070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:39.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.230+0000 7f9912d9d700 1 --2- 172.21.15.50:0/3202528742 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99140cb460 0x7f9914070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:39.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.230+0000 7f9912d9d700 1 -- 172.21.15.50:0/3202528742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99140ad490 msgr2=0x7f9914156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:39.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.230+0000 7f9912d9d700 1 --2- 172.21.15.50:0/3202528742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99140ad490 0x7f9914156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:39.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.230+0000 7f9912d9d700 1 -- 172.21.15.50:0/3202528742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c0094b0 con 0x7f9914158e60 2023-11-28T11:58:39.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.230+0000 7f9912d9d700 1 --2- 172.21.15.50:0/3202528742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914158e60 0x7f9914071330 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f991406f7e0 tx=0x7f990c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:39.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.230+0000 7f9902ffd700 1 -- 172.21.15.50:0/3202528742 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c01b840 con 0x7f9914158e60 2023-11-28T11:58:39.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.230+0000 7f9902ffd700 1 -- 172.21.15.50:0/3202528742 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c01f070 con 0x7f9914158e60 2023-11-28T11:58:39.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.230+0000 7f991359e700 1 -- 172.21.15.50:0/3202528742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991406d6a0 con 0x7f9914158e60 2023-11-28T11:58:39.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.230+0000 7f9902ffd700 1 -- 172.21.15.50:0/3202528742 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c01bc00 con 0x7f9914158e60 2023-11-28T11:58:39.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.230+0000 7f991359e700 1 -- 172.21.15.50:0/3202528742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9914159230 con 0x7f9914158e60 2023-11-28T11:58:39.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.230+0000 7f991359e700 1 -- 172.21.15.50:0/3202528742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991406d980 con 0x7f9914158e60 2023-11-28T11:58:39.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.234+0000 7f9902ffd700 1 -- 172.21.15.50:0/3202528742 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f990c00f050 con 0x7f9914158e60 2023-11-28T11:58:39.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.234+0000 7f9902ffd700 1 --2- 172.21.15.50:0/3202528742 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f98f4064f10 0x7f98f40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:39.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.234+0000 7f9902ffd700 1 -- 172.21.15.50:0/3202528742 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f990c021070 con 0x7f9914158e60 2023-11-28T11:58:39.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.234+0000 7f991259c700 1 --2- 172.21.15.50:0/3202528742 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f98f4064f10 0x7f98f40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:39.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.234+0000 7f991259c700 1 --2- 172.21.15.50:0/3202528742 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f98f4064f10 0x7f98f40673c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9908000f60 tx=0x7f9908007e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:39.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.242+0000 7f9902ffd700 1 -- 172.21.15.50:0/3202528742 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f990c051780 con 0x7f9914158e60 2023-11-28T11:58:39.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.446+0000 7f991359e700 1 -- 172.21.15.50:0/3202528742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9914072500 con 0x7f9914158e60 2023-11-28T11:58:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.446+0000 7f9902ffd700 1 -- 172.21.15.50:0/3202528742 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f990c0150c0 con 0x7f9914158e60 2023-11-28T11:58:39.449 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:58:39.449 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:58:39.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.450+0000 7f991359e700 1 -- 172.21.15.50:0/3202528742 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f98f4064f10 msgr2=0x7f98f40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:39.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.450+0000 7f991359e700 1 --2- 172.21.15.50:0/3202528742 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f98f4064f10 0x7f98f40673c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9908000f60 tx=0x7f9908007e00 comp rx=0 tx=0).stop 2023-11-28T11:58:39.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.450+0000 7f991359e700 1 -- 172.21.15.50:0/3202528742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914158e60 msgr2=0x7f9914071330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:39.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.450+0000 7f991359e700 1 --2- 172.21.15.50:0/3202528742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914158e60 0x7f9914071330 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f991406f7e0 tx=0x7f990c004770 comp rx=0 tx=0).stop 2023-11-28T11:58:39.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.450+0000 7f991359e700 1 -- 172.21.15.50:0/3202528742 shutdown_connections 2023-11-28T11:58:39.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.450+0000 7f991359e700 1 --2- 172.21.15.50:0/3202528742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9914158e60 0x7f9914071330 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:39.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.450+0000 7f991359e700 1 --2- 172.21.15.50:0/3202528742 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99140cb460 0x7f9914070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:39.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.450+0000 7f991359e700 1 --2- 172.21.15.50:0/3202528742 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f98f4064f10 0x7f98f40673c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:39.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.450+0000 7f991359e700 1 --2- 172.21.15.50:0/3202528742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99140ad490 0x7f9914156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:39.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.450+0000 7f991359e700 1 -- 172.21.15.50:0/3202528742 >> 172.21.15.50:0/3202528742 conn(0x7f99140ce3e0 msgr2=0x7f99140ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:39.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.450+0000 7f991359e700 1 -- 172.21.15.50:0/3202528742 shutdown_connections 2023-11-28T11:58:39.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:39.450+0000 7f991359e700 1 -- 172.21.15.50:0/3202528742 wait complete. 2023-11-28T11:58:39.467 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:58:44.470 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:58:44.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.590+0000 7f3d938c5700 1 Processor -- start 2023-11-28T11:58:44.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.590+0000 7f3d938c5700 1 -- start start 2023-11-28T11:58:44.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.590+0000 7f3d938c5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8c160680 0x7f3d8c071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.590+0000 7f3d938c5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8c0cc420 con 0x7f3d8c069c40 2023-11-28T11:58:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.590+0000 7f3d938c5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8c0cc6c0 con 0x7f3d8c0cd5e0 2023-11-28T11:58:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.590+0000 7f3d938c5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0cc9a0 con 0x7f3d8c160680 2023-11-28T11:58:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.590+0000 7f3d90e60700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3d8c069c40 0x7f3d8c0cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33646/0 (socket says 172.21.15.50:33646) 2023-11-28T11:58:44.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.590+0000 7f3d90e60700 1 -- 172.21.15.50:0/2041154809 learned_addr learned my addr 172.21.15.50:0/2041154809 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:58:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.590+0000 7f3d91661700 1 --2- 172.21.15.50:0/2041154809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8c160680 0x7f3d8c071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.590+0000 7f3d7ffff700 1 -- 172.21.15.50:0/2041154809 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494361845 0 0) 0x7f3d8c0cc420 con 0x7f3d8c069c40 2023-11-28T11:58:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.590+0000 7f3d7ffff700 1 -- 172.21.15.50:0/2041154809 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d780035d0 con 0x7f3d8c069c40 2023-11-28T11:58:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.590+0000 7f3d7ffff700 1 -- 172.21.15.50:0/2041154809 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830296194 0 0) 0x7f3d8c0cc6c0 con 0x7f3d8c0cd5e0 2023-11-28T11:58:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.590+0000 7f3d7ffff700 1 -- 172.21.15.50:0/2041154809 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d8c0cc420 con 0x7f3d8c0cd5e0 2023-11-28T11:58:44.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.590+0000 7f3d91661700 1 -- 172.21.15.50:0/2041154809 >> v1:172.21.15.192:6789/0 conn(0x7f3d8c0cd5e0 legacy=0x7f3d8c0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.590+0000 7f3d91661700 1 -- 172.21.15.50:0/2041154809 >> v1:172.21.15.50:6789/0 conn(0x7f3d8c069c40 legacy=0x7f3d8c0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.590+0000 7f3d91661700 1 -- 172.21.15.50:0/2041154809 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c0705c0 con 0x7f3d8c160680 2023-11-28T11:58:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.590+0000 7f3d91661700 1 --2- 172.21.15.50:0/2041154809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8c160680 0x7f3d8c071260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009880 tx=0x7f3d88009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d365c352ae6116ad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.594+0000 7f3d7ffff700 1 -- 172.21.15.50:0/2041154809 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88011830 con 0x7f3d8c160680 2023-11-28T11:58:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.594+0000 7f3d7ffff700 1 -- 172.21.15.50:0/2041154809 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d88011990 con 0x7f3d8c160680 2023-11-28T11:58:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.594+0000 7f3d7ffff700 1 -- 172.21.15.50:0/2041154809 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88011d00 con 0x7f3d8c160680 2023-11-28T11:58:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.594+0000 7f3d938c5700 1 -- 172.21.15.50:0/2041154809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8c160680 msgr2=0x7f3d8c071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.594+0000 7f3d938c5700 1 --2- 172.21.15.50:0/2041154809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8c160680 0x7f3d8c071260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009880 tx=0x7f3d88009b90 comp rx=0 tx=0).stop 2023-11-28T11:58:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.594+0000 7f3d938c5700 1 -- 172.21.15.50:0/2041154809 shutdown_connections 2023-11-28T11:58:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.594+0000 7f3d938c5700 1 --2- 172.21.15.50:0/2041154809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8c160680 0x7f3d8c071260 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.594+0000 7f3d938c5700 1 -- 172.21.15.50:0/2041154809 >> 172.21.15.50:0/2041154809 conn(0x7f3d8c06caf0 msgr2=0x7f3d8c0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.594+0000 7f3d938c5700 1 -- 172.21.15.50:0/2041154809 shutdown_connections 2023-11-28T11:58:44.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.594+0000 7f3d938c5700 1 -- 172.21.15.50:0/2041154809 wait complete. 2023-11-28T11:58:44.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d938c5700 1 Processor -- start 2023-11-28T11:58:44.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d938c5700 1 -- start start 2023-11-28T11:58:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d938c5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d8c069c40 0x7f3d8c0b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d938c5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8c0cd5e0 0x7f3d8c15f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d938c5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d8c160680 0x7f3d8c15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d938c5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0b2c40 con 0x7f3d8c069c40 2023-11-28T11:58:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d938c5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0b2f20 con 0x7f3d8c160680 2023-11-28T11:58:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d938c5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0b3200 con 0x7f3d8c0cd5e0 2023-11-28T11:58:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d91661700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d8c069c40 0x7f3d8c0b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d91661700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d8c069c40 0x7f3d8c0b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42828/0 (socket says 172.21.15.50:42828) 2023-11-28T11:58:44.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d91661700 1 -- 172.21.15.50:0/1177536779 learned_addr learned my addr 172.21.15.50:0/1177536779 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:58:44.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d90e60700 1 --2- 172.21.15.50:0/1177536779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8c0cd5e0 0x7f3d8c15f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:44.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d91e62700 1 --2- 172.21.15.50:0/1177536779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d8c160680 0x7f3d8c15cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:44.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d91661700 1 -- 172.21.15.50:0/1177536779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8c0cd5e0 msgr2=0x7f3d8c15f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:44.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d91661700 1 --2- 172.21.15.50:0/1177536779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8c0cd5e0 0x7f3d8c15f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:44.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d91661700 1 -- 172.21.15.50:0/1177536779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d8c160680 msgr2=0x7f3d8c15cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:44.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d91661700 1 --2- 172.21.15.50:0/1177536779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d8c160680 0x7f3d8c15cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:44.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d91661700 1 -- 172.21.15.50:0/1177536779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d880094b0 con 0x7f3d8c069c40 2023-11-28T11:58:44.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d91661700 1 --2- 172.21.15.50:0/1177536779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d8c069c40 0x7f3d8c0b3ce0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3d880090b0 tx=0x7f3d88004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:44.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d7dffb700 1 -- 172.21.15.50:0/1177536779 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88004510 con 0x7f3d8c069c40 2023-11-28T11:58:44.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d7dffb700 1 -- 172.21.15.50:0/1177536779 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d880036c0 con 0x7f3d8c069c40 2023-11-28T11:58:44.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d938c5700 1 -- 172.21.15.50:0/1177536779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8c0c9750 con 0x7f3d8c069c40 2023-11-28T11:58:44.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.598+0000 7f3d7dffb700 1 -- 172.21.15.50:0/1177536779 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88003a70 con 0x7f3d8c069c40 2023-11-28T11:58:44.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.602+0000 7f3d938c5700 1 -- 172.21.15.50:0/1177536779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8c071940 con 0x7f3d8c069c40 2023-11-28T11:58:44.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.602+0000 7f3d938c5700 1 -- 172.21.15.50:0/1177536779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8c160a50 con 0x7f3d8c069c40 2023-11-28T11:58:44.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.602+0000 7f3d7dffb700 1 -- 172.21.15.50:0/1177536779 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3d8800f050 con 0x7f3d8c069c40 2023-11-28T11:58:44.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.602+0000 7f3d7dffb700 1 --2- 172.21.15.50:0/1177536779 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d70064ee0 0x7f3d70067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:44.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.606+0000 7f3d7dffb700 1 -- 172.21.15.50:0/1177536779 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f3d880832e0 con 0x7f3d8c069c40 2023-11-28T11:58:44.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.606+0000 7f3d90e60700 1 --2- 172.21.15.50:0/1177536779 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d70064ee0 0x7f3d70067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:44.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.606+0000 7f3d90e60700 1 --2- 172.21.15.50:0/1177536779 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d70064ee0 0x7f3d70067390 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0c67e0 tx=0x7f3d80007e20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:44.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.610+0000 7f3d7dffb700 1 -- 172.21.15.50:0/1177536779 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3d88051300 con 0x7f3d8c069c40 2023-11-28T11:58:44.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.810+0000 7f3d938c5700 1 -- 172.21.15.50:0/1177536779 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3d8c072500 con 0x7f3d8c069c40 2023-11-28T11:58:44.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.814+0000 7f3d7dffb700 1 -- 172.21.15.50:0/1177536779 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f3d88054920 con 0x7f3d8c069c40 2023-11-28T11:58:44.815 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:58:44.815 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:58:44.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.814+0000 7f3d938c5700 1 -- 172.21.15.50:0/1177536779 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d70064ee0 msgr2=0x7f3d70067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:44.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.814+0000 7f3d938c5700 1 --2- 172.21.15.50:0/1177536779 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d70064ee0 0x7f3d70067390 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0c67e0 tx=0x7f3d80007e20 comp rx=0 tx=0).stop 2023-11-28T11:58:44.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.814+0000 7f3d938c5700 1 -- 172.21.15.50:0/1177536779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d8c069c40 msgr2=0x7f3d8c0b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:44.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.814+0000 7f3d938c5700 1 --2- 172.21.15.50:0/1177536779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d8c069c40 0x7f3d8c0b3ce0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3d880090b0 tx=0x7f3d88004770 comp rx=0 tx=0).stop 2023-11-28T11:58:44.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.814+0000 7f3d938c5700 1 -- 172.21.15.50:0/1177536779 shutdown_connections 2023-11-28T11:58:44.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.814+0000 7f3d938c5700 1 --2- 172.21.15.50:0/1177536779 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d70064ee0 0x7f3d70067390 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:44.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.814+0000 7f3d938c5700 1 --2- 172.21.15.50:0/1177536779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d8c160680 0x7f3d8c15cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:44.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.814+0000 7f3d938c5700 1 --2- 172.21.15.50:0/1177536779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d8c0cd5e0 0x7f3d8c15f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:44.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.814+0000 7f3d938c5700 1 --2- 172.21.15.50:0/1177536779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d8c069c40 0x7f3d8c0b3ce0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:44.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.814+0000 7f3d938c5700 1 -- 172.21.15.50:0/1177536779 >> 172.21.15.50:0/1177536779 conn(0x7f3d8c06caf0 msgr2=0x7f3d8c0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:44.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.814+0000 7f3d938c5700 1 -- 172.21.15.50:0/1177536779 shutdown_connections 2023-11-28T11:58:44.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:44.814+0000 7f3d938c5700 1 -- 172.21.15.50:0/1177536779 wait complete. 2023-11-28T11:58:44.830 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:58:49.831 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:58:49.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.946+0000 7f4425f88700 1 Processor -- start 2023-11-28T11:58:49.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.946+0000 7f4425f88700 1 -- start start 2023-11-28T11:58:49.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f4425f88700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44201606b0 0x7f44200c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f4425f88700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f44200ceef0 0x7f44200c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f4425f88700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f44200ad610 0x7f4420164040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f4425f88700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44200cae70 con 0x7f44200ceef0 2023-11-28T11:58:49.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f4425f88700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44200cbc10 con 0x7f44200ad610 2023-11-28T11:58:49.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f4425f88700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44200cb130 con 0x7f44201606b0 2023-11-28T11:58:49.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f441ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f44200ceef0 0x7f44200c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f441ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f44200ceef0 0x7f44200c18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42842/0 (socket says 172.21.15.50:42842) 2023-11-28T11:58:49.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f441ffff700 1 -- 172.21.15.50:0/1099278141 learned_addr learned my addr 172.21.15.50:0/1099278141 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:58:49.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f4424f86700 1 --2- 172.21.15.50:0/1099278141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44201606b0 0x7f44200c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f4425787700 1 --2- 172.21.15.50:0/1099278141 >> v2:172.21.15.192:3300/0 conn(0x7f44200ad610 0x7f4420164040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f441ffff700 1 -- 172.21.15.50:0/1099278141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44201606b0 msgr2=0x7f44200c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f441ffff700 1 --2- 172.21.15.50:0/1099278141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44201606b0 0x7f44200c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f441ffff700 1 -- 172.21.15.50:0/1099278141 >> v2:172.21.15.192:3300/0 conn(0x7f44200ad610 msgr2=0x7f4420164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f441ffff700 1 --2- 172.21.15.50:0/1099278141 >> v2:172.21.15.192:3300/0 conn(0x7f44200ad610 0x7f4420164040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f441ffff700 1 -- 172.21.15.50:0/1099278141 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44200cb410 con 0x7f44200ceef0 2023-11-28T11:58:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f441ffff700 1 --2- 172.21.15.50:0/1099278141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44200ceef0 0x7f44200c18f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f442006f4b0 tx=0x7f4414009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb085a0b56b2351 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f441f7fe700 1 -- 172.21.15.50:0/1099278141 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414011830 con 0x7f44200ceef0 2023-11-28T11:58:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f441f7fe700 1 -- 172.21.15.50:0/1099278141 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4414011990 con 0x7f44200ceef0 2023-11-28T11:58:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f441f7fe700 1 -- 172.21.15.50:0/1099278141 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414011d20 con 0x7f44200ceef0 2023-11-28T11:58:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f4425f88700 1 -- 172.21.15.50:0/1099278141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44200ceef0 msgr2=0x7f44200c18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f4425f88700 1 --2- 172.21.15.50:0/1099278141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44200ceef0 0x7f44200c18f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f442006f4b0 tx=0x7f4414009bf0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f4425f88700 1 -- 172.21.15.50:0/1099278141 shutdown_connections 2023-11-28T11:58:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f4425f88700 1 --2- 172.21.15.50:0/1099278141 >> v2:172.21.15.192:3300/0 conn(0x7f44200ad610 0x7f4420164040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f4425f88700 1 --2- 172.21.15.50:0/1099278141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44200ceef0 0x7f44200c18f0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f4425f88700 1 --2- 172.21.15.50:0/1099278141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44201606b0 0x7f44200c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.950+0000 7f4425f88700 1 -- 172.21.15.50:0/1099278141 >> 172.21.15.50:0/1099278141 conn(0x7f44200ce3e0 msgr2=0x7f44200ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.954+0000 7f4425f88700 1 -- 172.21.15.50:0/1099278141 shutdown_connections 2023-11-28T11:58:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.954+0000 7f4425f88700 1 -- 172.21.15.50:0/1099278141 wait complete. 2023-11-28T11:58:49.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.954+0000 7f4425f88700 1 Processor -- start 2023-11-28T11:58:49.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.954+0000 7f4425f88700 1 -- start start 2023-11-28T11:58:49.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.954+0000 7f4425f88700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44200ad610 0x7f442015bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.954+0000 7f4425f88700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44200ceef0 0x7f44200ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.954+0000 7f4425f88700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44201606b0 0x7f44200ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.954+0000 7f4425f88700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44200c3360 con 0x7f44201606b0 2023-11-28T11:58:49.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.954+0000 7f4425f88700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44201eaaf0 con 0x7f44200ad610 2023-11-28T11:58:49.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.954+0000 7f4425f88700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44201630e0 con 0x7f44200ceef0 2023-11-28T11:58:49.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.954+0000 7f4425787700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44201606b0 0x7f44200ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.954+0000 7f4425787700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44201606b0 0x7f44200ac810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42848/0 (socket says 172.21.15.50:42848) 2023-11-28T11:58:49.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.954+0000 7f4425787700 1 -- 172.21.15.50:0/2483901663 learned_addr learned my addr 172.21.15.50:0/2483901663 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:58:49.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.954+0000 7f4424f86700 1 --2- 172.21.15.50:0/2483901663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44200ad610 0x7f442015bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.954+0000 7f441ffff700 1 --2- 172.21.15.50:0/2483901663 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44200ceef0 0x7f44200ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.958+0000 7f4425787700 1 -- 172.21.15.50:0/2483901663 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44200ceef0 msgr2=0x7f44200ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:49.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.958+0000 7f4425787700 1 --2- 172.21.15.50:0/2483901663 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44200ceef0 0x7f44200ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.958+0000 7f4425787700 1 -- 172.21.15.50:0/2483901663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44200ad610 msgr2=0x7f442015bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:49.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.958+0000 7f4425787700 1 --2- 172.21.15.50:0/2483901663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44200ad610 0x7f442015bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:49.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.958+0000 7f4425787700 1 -- 172.21.15.50:0/2483901663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4414009570 con 0x7f44201606b0 2023-11-28T11:58:49.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.958+0000 7f4425787700 1 --2- 172.21.15.50:0/2483901663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44201606b0 0x7f44200ac810 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f441800eed0 tx=0x7f441800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:49.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.958+0000 7f441d7fa700 1 -- 172.21.15.50:0/2483901663 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4418010040 con 0x7f44201606b0 2023-11-28T11:58:49.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.958+0000 7f441d7fa700 1 -- 172.21.15.50:0/2483901663 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441800bd30 con 0x7f44201606b0 2023-11-28T11:58:49.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.958+0000 7f441d7fa700 1 -- 172.21.15.50:0/2483901663 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441800bea0 con 0x7f44201606b0 2023-11-28T11:58:49.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.958+0000 7f4425f88700 1 -- 172.21.15.50:0/2483901663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44200b36c0 con 0x7f44201606b0 2023-11-28T11:58:49.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.958+0000 7f4425f88700 1 -- 172.21.15.50:0/2483901663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44200cb6f0 con 0x7f44201606b0 2023-11-28T11:58:49.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.958+0000 7f4425f88700 1 -- 172.21.15.50:0/2483901663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4420164580 con 0x7f44201606b0 2023-11-28T11:58:49.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.958+0000 7f441d7fa700 1 -- 172.21.15.50:0/2483901663 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4418014620 con 0x7f44201606b0 2023-11-28T11:58:49.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.958+0000 7f441d7fa700 1 --2- 172.21.15.50:0/2483901663 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f440c064ee0 0x7f440c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:49.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.958+0000 7f441d7fa700 1 -- 172.21.15.50:0/2483901663 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f4418082830 con 0x7f44201606b0 2023-11-28T11:58:49.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.962+0000 7f4424f86700 1 --2- 172.21.15.50:0/2483901663 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f440c064ee0 0x7f440c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:49.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.962+0000 7f4424f86700 1 --2- 172.21.15.50:0/2483901663 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f440c064ee0 0x7f440c067390 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f44201f92b0 tx=0x7f4410009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:49.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:49.970+0000 7f441d7fa700 1 -- 172.21.15.50:0/2483901663 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f44180507f0 con 0x7f44201606b0 2023-11-28T11:58:50.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:50.170+0000 7f4425f88700 1 -- 172.21.15.50:0/2483901663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f44200c34a0 con 0x7f44201606b0 2023-11-28T11:58:50.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:50.174+0000 7f441d7fa700 1 -- 172.21.15.50:0/2483901663 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f44200c34a0 con 0x7f44201606b0 2023-11-28T11:58:50.175 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:58:50.175 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:58:50.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:50.174+0000 7f4425f88700 1 -- 172.21.15.50:0/2483901663 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f440c064ee0 msgr2=0x7f440c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:50.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:50.174+0000 7f4425f88700 1 --2- 172.21.15.50:0/2483901663 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f440c064ee0 0x7f440c067390 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f44201f92b0 tx=0x7f4410009240 comp rx=0 tx=0).stop 2023-11-28T11:58:50.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:50.174+0000 7f4425f88700 1 -- 172.21.15.50:0/2483901663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44201606b0 msgr2=0x7f44200ac810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:50.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:50.174+0000 7f4425f88700 1 --2- 172.21.15.50:0/2483901663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44201606b0 0x7f44200ac810 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f441800eed0 tx=0x7f441800b390 comp rx=0 tx=0).stop 2023-11-28T11:58:50.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:50.174+0000 7f4425f88700 1 -- 172.21.15.50:0/2483901663 shutdown_connections 2023-11-28T11:58:50.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:50.174+0000 7f4425f88700 1 --2- 172.21.15.50:0/2483901663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44201606b0 0x7f44200ac810 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:50.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:50.174+0000 7f4425f88700 1 --2- 172.21.15.50:0/2483901663 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44200ceef0 0x7f44200ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:50.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:50.174+0000 7f4425f88700 1 --2- 172.21.15.50:0/2483901663 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f440c064ee0 0x7f440c067390 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:50.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:50.174+0000 7f4425f88700 1 --2- 172.21.15.50:0/2483901663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44200ad610 0x7f442015bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:50.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:50.174+0000 7f4425f88700 1 -- 172.21.15.50:0/2483901663 >> 172.21.15.50:0/2483901663 conn(0x7f44200ce3e0 msgr2=0x7f44200af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:50.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:50.174+0000 7f4425f88700 1 -- 172.21.15.50:0/2483901663 shutdown_connections 2023-11-28T11:58:50.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:50.174+0000 7f4425f88700 1 -- 172.21.15.50:0/2483901663 wait complete. 2023-11-28T11:58:50.190 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:58:55.191 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:58:55.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcf59e700 1 Processor -- start 2023-11-28T11:58:55.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcf59e700 1 -- start start 2023-11-28T11:58:55.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcf59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdd00c1ac0 0x7fcdd0069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcf59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcdd00ceef0 0x7fcdd006a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcf59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd00cae70 con 0x7fcdd01606b0 2023-11-28T11:58:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcf59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd00cbc10 con 0x7fcdd00ceef0 2023-11-28T11:58:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcf59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00cb130 con 0x7fcdd00c1ac0 2023-11-28T11:58:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdce59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcdd01606b0 0x7fcdd00c13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59448/0 (socket says 172.21.15.50:59448) 2023-11-28T11:58:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdce59c700 1 -- 172.21.15.50:0/124521946 learned_addr learned my addr 172.21.15.50:0/124521946 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:58:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcdd9b700 1 --2- 172.21.15.50:0/124521946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdd00c1ac0 0x7fcdd0069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcd59a700 1 -- 172.21.15.50:0/124521946 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3803990766 0 0) 0x7fcdd00cae70 con 0x7fcdd01606b0 2023-11-28T11:58:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdced9d700 1 --2- 172.21.15.50:0/124521946 >> v2:172.21.15.192:3300/0 conn(0x7fcdd00ceef0 0x7fcdd006a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcd59a700 1 -- 172.21.15.50:0/124521946 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdb00035d0 con 0x7fcdd01606b0 2023-11-28T11:58:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcd59a700 1 -- 172.21.15.50:0/124521946 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3250613852 0 0) 0x7fcdb00035d0 con 0x7fcdd01606b0 2023-11-28T11:58:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcd59a700 1 -- 172.21.15.50:0/124521946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdd00c1ac0 msgr2=0x7fcdd0069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcd59a700 1 --2- 172.21.15.50:0/124521946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdd00c1ac0 0x7fcdd0069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcd59a700 1 -- 172.21.15.50:0/124521946 >> v2:172.21.15.192:3300/0 conn(0x7fcdd00ceef0 msgr2=0x7fcdd006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcd59a700 1 --2- 172.21.15.50:0/124521946 >> v2:172.21.15.192:3300/0 conn(0x7fcdd00ceef0 0x7fcdd006a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcd59a700 1 -- 172.21.15.50:0/124521946 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd00cb410 con 0x7fcdd01606b0 2023-11-28T11:58:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcd59a700 1 -- 172.21.15.50:0/124521946 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7fcdc00019f0 con 0x7fcdd01606b0 2023-11-28T11:58:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcd59a700 1 -- 172.21.15.50:0/124521946 >> v1:172.21.15.50:6789/0 conn(0x7fcdd01606b0 legacy=0x7fcdd00c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcd59a700 1 --2- 172.21.15.50:0/124521946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdb0003a20 0x7fcdb0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcd59a700 1 --2- 172.21.15.50:0/124521946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdb0004870 0x7fcdb0004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcd59a700 1 --2- 172.21.15.50:0/124521946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdb0005220 0x7fcdb000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcd59a700 1 -- 172.21.15.50:0/124521946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00cbc10 con 0x7fcdb0004870 2023-11-28T11:58:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcd59a700 1 -- 172.21.15.50:0/124521946 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00cb130 con 0x7fcdb0003a20 2023-11-28T11:58:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.310+0000 7fcdcd59a700 1 -- 172.21.15.50:0/124521946 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb000c020 con 0x7fcdb0005220 2023-11-28T11:58:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdced9d700 1 --2- 172.21.15.50:0/124521946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdb0005220 0x7fcdb000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdcdd9b700 1 --2- 172.21.15.50:0/124521946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdb0004870 0x7fcdb0004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdce59c700 1 --2- 172.21.15.50:0/124521946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdb0003a20 0x7fcdb0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdced9d700 1 -- 172.21.15.50:0/124521946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdb0003a20 msgr2=0x7fcdb0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdced9d700 1 --2- 172.21.15.50:0/124521946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdb0003a20 0x7fcdb0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdced9d700 1 -- 172.21.15.50:0/124521946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdb0004870 msgr2=0x7fcdb0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:58:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdced9d700 1 --2- 172.21.15.50:0/124521946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdb0004870 0x7fcdb0004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdced9d700 1 -- 172.21.15.50:0/124521946 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb00035d0 con 0x7fcdb0005220 2023-11-28T11:58:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdce59c700 1 --2- 172.21.15.50:0/124521946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdb0003a20 0x7fcdb0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdced9d700 1 --2- 172.21.15.50:0/124521946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdb0005220 0x7fcdb000ba30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80098b0 tx=0x7fcdb00058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26b5c855b6105438 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdcd59a700 1 -- 172.21.15.50:0/124521946 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800c070 con 0x7fcdb0005220 2023-11-28T11:58:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdcd59a700 1 -- 172.21.15.50:0/124521946 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc8013610 con 0x7fcdb0005220 2023-11-28T11:58:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdcd59a700 1 -- 172.21.15.50:0/124521946 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc80139c0 con 0x7fcdb0005220 2023-11-28T11:58:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdcf59e700 1 -- 172.21.15.50:0/124521946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdb0005220 msgr2=0x7fcdb000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdcf59e700 1 --2- 172.21.15.50:0/124521946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdb0005220 0x7fcdb000ba30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80098b0 tx=0x7fcdb00058a0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdced9d700 1 -- 172.21.15.50:0/124521946 reap_dead start 2023-11-28T11:58:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdcf59e700 1 -- 172.21.15.50:0/124521946 shutdown_connections 2023-11-28T11:58:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdcf59e700 1 -- 172.21.15.50:0/124521946 >> 172.21.15.50:0/124521946 conn(0x7fcdd00ce3e0 msgr2=0x7fcdd00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdcf59e700 1 -- 172.21.15.50:0/124521946 shutdown_connections 2023-11-28T11:58:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdcf59e700 1 -- 172.21.15.50:0/124521946 wait complete. 2023-11-28T11:58:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdcf59e700 1 Processor -- start 2023-11-28T11:58:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.314+0000 7fcdcf59e700 1 -- start start 2023-11-28T11:58:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcf59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdb0005220 0x7fcdd0156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcf59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdd00cd710 0x7fcdd00c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcf59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdd00ac1a0 0x7fcdd00ac610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcf59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0159bc0 con 0x7fcdd00cd710 2023-11-28T11:58:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcf59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00acb50 con 0x7fcdb0005220 2023-11-28T11:58:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcf59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0158d10 con 0x7fcdd00ac1a0 2023-11-28T11:58:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcdd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdd00cd710 0x7fcdd00c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcdd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdd00cd710 0x7fcdd00c47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60358/0 (socket says 172.21.15.50:60358) 2023-11-28T11:58:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcdd9b700 1 -- 172.21.15.50:0/3326898891 learned_addr learned my addr 172.21.15.50:0/3326898891 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:58:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdced9d700 1 --2- 172.21.15.50:0/3326898891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdd00ac1a0 0x7fcdd00ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdce59c700 1 --2- 172.21.15.50:0/3326898891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdb0005220 0x7fcdd0156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcdd9b700 1 -- 172.21.15.50:0/3326898891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdd00ac1a0 msgr2=0x7fcdd00ac610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcdd9b700 1 --2- 172.21.15.50:0/3326898891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdd00ac1a0 0x7fcdd00ac610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcdd9b700 1 -- 172.21.15.50:0/3326898891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdb0005220 msgr2=0x7fcdd0156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcdd9b700 1 --2- 172.21.15.50:0/3326898891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdb0005220 0x7fcdd0156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcdd9b700 1 -- 172.21.15.50:0/3326898891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd00b36c0 con 0x7fcdd00cd710 2023-11-28T11:58:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdced9d700 1 --2- 172.21.15.50:0/3326898891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdd00ac1a0 0x7fcdd00ac610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdce59c700 1 --2- 172.21.15.50:0/3326898891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdb0005220 0x7fcdd0156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:58:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcdd9b700 1 --2- 172.21.15.50:0/3326898891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdd00cd710 0x7fcdd00c47c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8011610 tx=0x7fcdb8011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdc6ffd700 1 -- 172.21.15.50:0/3326898891 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8004500 con 0x7fcdd00cd710 2023-11-28T11:58:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdc6ffd700 1 -- 172.21.15.50:0/3326898891 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb80036c0 con 0x7fcdd00cd710 2023-11-28T11:58:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcf59e700 1 -- 172.21.15.50:0/3326898891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd00cb6f0 con 0x7fcdd00cd710 2023-11-28T11:58:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdc6ffd700 1 -- 172.21.15.50:0/3326898891 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8003a70 con 0x7fcdd00cd710 2023-11-28T11:58:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcf59e700 1 -- 172.21.15.50:0/3326898891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd00ad610 con 0x7fcdd00cd710 2023-11-28T11:58:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.318+0000 7fcdcf59e700 1 -- 172.21.15.50:0/3326898891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd01f5ce0 con 0x7fcdd00cd710 2023-11-28T11:58:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.322+0000 7fcdc6ffd700 1 -- 172.21.15.50:0/3326898891 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcdb8025070 con 0x7fcdd00cd710 2023-11-28T11:58:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.322+0000 7fcdc6ffd700 1 --2- 172.21.15.50:0/3326898891 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcdb4064ee0 0x7fcdb4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:58:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.322+0000 7fcdc6ffd700 1 -- 172.21.15.50:0/3326898891 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fcdb8082260 con 0x7fcdd00cd710 2023-11-28T11:58:55.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.322+0000 7fcdce59c700 1 --2- 172.21.15.50:0/3326898891 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcdb4064ee0 0x7fcdb4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:58:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.322+0000 7fcdce59c700 1 --2- 172.21.15.50:0/3326898891 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcdb4064ee0 0x7fcdb4067390 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0000f80 tx=0x7fcdc0006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:58:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.330+0000 7fcdc6ffd700 1 -- 172.21.15.50:0/3326898891 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcdb8050280 con 0x7fcdd00cd710 2023-11-28T11:58:55.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.526+0000 7fcdcf59e700 1 -- 172.21.15.50:0/3326898891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcdd0072500 con 0x7fcdd00cd710 2023-11-28T11:58:55.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.530+0000 7fcdc6ffd700 1 -- 172.21.15.50:0/3326898891 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fcdb80538a0 con 0x7fcdd00cd710 2023-11-28T11:58:55.531 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:58:55.531 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:58:55.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.530+0000 7fcdcf59e700 1 -- 172.21.15.50:0/3326898891 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcdb4064ee0 msgr2=0x7fcdb4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.530+0000 7fcdcf59e700 1 --2- 172.21.15.50:0/3326898891 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcdb4064ee0 0x7fcdb4067390 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0000f80 tx=0x7fcdc0006040 comp rx=0 tx=0).stop 2023-11-28T11:58:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.530+0000 7fcdcf59e700 1 -- 172.21.15.50:0/3326898891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdd00cd710 msgr2=0x7fcdd00c47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:58:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.530+0000 7fcdcf59e700 1 --2- 172.21.15.50:0/3326898891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdd00cd710 0x7fcdd00c47c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8011610 tx=0x7fcdb8011920 comp rx=0 tx=0).stop 2023-11-28T11:58:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.530+0000 7fcdcf59e700 1 -- 172.21.15.50:0/3326898891 shutdown_connections 2023-11-28T11:58:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.530+0000 7fcdcf59e700 1 --2- 172.21.15.50:0/3326898891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdd00ac1a0 0x7fcdd00ac610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.530+0000 7fcdcf59e700 1 --2- 172.21.15.50:0/3326898891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdd00cd710 0x7fcdd00c47c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.530+0000 7fcdcf59e700 1 --2- 172.21.15.50:0/3326898891 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcdb4064ee0 0x7fcdb4067390 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.530+0000 7fcdcf59e700 1 --2- 172.21.15.50:0/3326898891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdb0005220 0x7fcdd0156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:58:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.530+0000 7fcdcf59e700 1 -- 172.21.15.50:0/3326898891 >> 172.21.15.50:0/3326898891 conn(0x7fcdd00ce3e0 msgr2=0x7fcdd00713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:58:55.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.530+0000 7fcdcf59e700 1 -- 172.21.15.50:0/3326898891 shutdown_connections 2023-11-28T11:58:55.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:58:55.530+0000 7fcdcf59e700 1 -- 172.21.15.50:0/3326898891 wait complete. 2023-11-28T11:58:55.546 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:59:00.548 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:59:00.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.665+0000 7f6b47fff700 1 Processor -- start 2023-11-28T11:59:00.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.665+0000 7f6b47fff700 1 -- start start 2023-11-28T11:59:00.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.665+0000 7f6b47fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6b48158e60 0x7f6b480c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:00.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.665+0000 7f6b47fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b480ad490 0x7f6b480cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:00.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.665+0000 7f6b47fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b480cd8f0 con 0x7f6b480cad50 2023-11-28T11:59:00.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.665+0000 7f6b47fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b480add00 con 0x7f6b480ad490 2023-11-28T11:59:00.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.665+0000 7f6b47fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b480cc4f0 con 0x7f6b48158e60 2023-11-28T11:59:00.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.665+0000 7f6b3ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b480ad490 0x7f6b480cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:00.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.665+0000 7f6b3ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b480ad490 0x7f6b480cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60362/0 (socket says 172.21.15.50:60362) 2023-11-28T11:59:00.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.665+0000 7f6b3ffff700 1 -- 172.21.15.50:0/3735921525 learned_addr learned my addr 172.21.15.50:0/3735921525 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:00.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.665+0000 7f6b46ffd700 1 --2- 172.21.15.50:0/3735921525 >> v2:172.21.15.192:3300/0 conn(0x7f6b48158e60 0x7f6b480c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:00.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.665+0000 7f6b3ffff700 1 -- 172.21.15.50:0/3735921525 >> v2:172.21.15.192:3300/0 conn(0x7f6b48158e60 msgr2=0x7f6b480c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:00.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.665+0000 7f6b3ffff700 1 --2- 172.21.15.50:0/3735921525 >> v2:172.21.15.192:3300/0 conn(0x7f6b48158e60 0x7f6b480c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:00.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.665+0000 7f6b3ffff700 1 -- 172.21.15.50:0/3735921525 >> v1:172.21.15.50:6789/0 conn(0x7f6b480cad50 legacy=0x7f6b4806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:00.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.665+0000 7f6b3ffff700 1 -- 172.21.15.50:0/3735921525 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4806dc60 con 0x7f6b480ad490 2023-11-28T11:59:00.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b3ffff700 1 --2- 172.21.15.50:0/3735921525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b480ad490 0x7f6b480cbfb0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f6b4806f4e0 tx=0x7f6b30009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7013ae2d77d35cdc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:00.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b467fc700 1 -- 172.21.15.50:0/3735921525 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3000ba20 con 0x7f6b480ad490 2023-11-28T11:59:00.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b467fc700 1 -- 172.21.15.50:0/3735921525 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3000bb80 con 0x7f6b480ad490 2023-11-28T11:59:00.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b467fc700 1 -- 172.21.15.50:0/3735921525 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30009e60 con 0x7f6b480ad490 2023-11-28T11:59:00.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b47fff700 1 -- 172.21.15.50:0/3735921525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b480ad490 msgr2=0x7f6b480cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:00.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b47fff700 1 --2- 172.21.15.50:0/3735921525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b480ad490 0x7f6b480cbfb0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f6b4806f4e0 tx=0x7f6b30009c20 comp rx=0 tx=0).stop 2023-11-28T11:59:00.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b47fff700 1 -- 172.21.15.50:0/3735921525 shutdown_connections 2023-11-28T11:59:00.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b47fff700 1 --2- 172.21.15.50:0/3735921525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b480ad490 0x7f6b480cbfb0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:00.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b47fff700 1 --2- 172.21.15.50:0/3735921525 >> v2:172.21.15.192:3300/0 conn(0x7f6b48158e60 0x7f6b480c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:00.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b47fff700 1 -- 172.21.15.50:0/3735921525 >> 172.21.15.50:0/3735921525 conn(0x7f6b480ce3e0 msgr2=0x7f6b480ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:00.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b47fff700 1 -- 172.21.15.50:0/3735921525 shutdown_connections 2023-11-28T11:59:00.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b47fff700 1 -- 172.21.15.50:0/3735921525 wait complete. 2023-11-28T11:59:00.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b47fff700 1 Processor -- start 2023-11-28T11:59:00.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b47fff700 1 -- start start 2023-11-28T11:59:00.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b47fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b480ad490 0x7f6b481577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:00.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b47fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b480cad50 0x7f6b480c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:00.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b47fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b48158e60 0x7f6b480c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:00.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b47fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b480c3210 con 0x7f6b480cad50 2023-11-28T11:59:00.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b47fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b480c2590 con 0x7f6b480ad490 2023-11-28T11:59:00.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b47fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b480c2870 con 0x7f6b48158e60 2023-11-28T11:59:00.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b3ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b480cad50 0x7f6b480c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:00.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b3ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b480cad50 0x7f6b480c1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60372/0 (socket says 172.21.15.50:60372) 2023-11-28T11:59:00.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b3ffff700 1 -- 172.21.15.50:0/555994360 learned_addr learned my addr 172.21.15.50:0/555994360 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:00.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b46ffd700 1 --2- 172.21.15.50:0/555994360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b480ad490 0x7f6b481577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:00.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.669+0000 7f6b477fe700 1 --2- 172.21.15.50:0/555994360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b48158e60 0x7f6b480c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:00.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.673+0000 7f6b3ffff700 1 -- 172.21.15.50:0/555994360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b48158e60 msgr2=0x7f6b480c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:00.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.673+0000 7f6b3ffff700 1 --2- 172.21.15.50:0/555994360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b48158e60 0x7f6b480c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:00.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.673+0000 7f6b3ffff700 1 -- 172.21.15.50:0/555994360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b480ad490 msgr2=0x7f6b481577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:00.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.673+0000 7f6b3ffff700 1 --2- 172.21.15.50:0/555994360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b480ad490 0x7f6b481577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:00.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.673+0000 7f6b3ffff700 1 -- 172.21.15.50:0/555994360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b30009570 con 0x7f6b480cad50 2023-11-28T11:59:00.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.673+0000 7f6b477fe700 1 --2- 172.21.15.50:0/555994360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b48158e60 0x7f6b480c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:00.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.673+0000 7f6b3ffff700 1 --2- 172.21.15.50:0/555994360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b480cad50 0x7f6b480c1d40 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f6b30000c00 tx=0x7f6b30004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:00.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.673+0000 7f6b3f7fe700 1 -- 172.21.15.50:0/555994360 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b300038c0 con 0x7f6b480cad50 2023-11-28T11:59:00.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.673+0000 7f6b3f7fe700 1 -- 172.21.15.50:0/555994360 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b30003a20 con 0x7f6b480cad50 2023-11-28T11:59:00.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.673+0000 7f6b3f7fe700 1 -- 172.21.15.50:0/555994360 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30003dd0 con 0x7f6b480cad50 2023-11-28T11:59:00.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.673+0000 7f6b47fff700 1 -- 172.21.15.50:0/555994360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b48159230 con 0x7f6b480cad50 2023-11-28T11:59:00.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.673+0000 7f6b47fff700 1 -- 172.21.15.50:0/555994360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b480cde90 con 0x7f6b480cad50 2023-11-28T11:59:00.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.673+0000 7f6b3f7fe700 1 -- 172.21.15.50:0/555994360 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6b30019400 con 0x7f6b480cad50 2023-11-28T11:59:00.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.673+0000 7f6b47fff700 1 -- 172.21.15.50:0/555994360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4806d6a0 con 0x7f6b480cad50 2023-11-28T11:59:00.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.677+0000 7f6b3f7fe700 1 --2- 172.21.15.50:0/555994360 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6b28064ee0 0x7f6b28067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:00.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.677+0000 7f6b3f7fe700 1 -- 172.21.15.50:0/555994360 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f6b30083990 con 0x7f6b480cad50 2023-11-28T11:59:00.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.677+0000 7f6b46ffd700 1 --2- 172.21.15.50:0/555994360 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6b28064ee0 0x7f6b28067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:00.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.677+0000 7f6b46ffd700 1 --2- 172.21.15.50:0/555994360 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6b28064ee0 0x7f6b28067390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6b38007a60 tx=0x7f6b38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:00.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.685+0000 7f6b3f7fe700 1 -- 172.21.15.50:0/555994360 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6b300518a0 con 0x7f6b480cad50 2023-11-28T11:59:00.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.889+0000 7f6b47fff700 1 -- 172.21.15.50:0/555994360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6b480c3350 con 0x7f6b480cad50 2023-11-28T11:59:00.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.889+0000 7f6b3f7fe700 1 -- 172.21.15.50:0/555994360 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f6b480c3350 con 0x7f6b480cad50 2023-11-28T11:59:00.892 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:59:00.892 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:59:00.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.893+0000 7f6b47fff700 1 -- 172.21.15.50:0/555994360 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6b28064ee0 msgr2=0x7f6b28067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:00.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.893+0000 7f6b47fff700 1 --2- 172.21.15.50:0/555994360 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6b28064ee0 0x7f6b28067390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6b38007a60 tx=0x7f6b38008040 comp rx=0 tx=0).stop 2023-11-28T11:59:00.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.893+0000 7f6b47fff700 1 -- 172.21.15.50:0/555994360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b480cad50 msgr2=0x7f6b480c1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:00.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.893+0000 7f6b47fff700 1 --2- 172.21.15.50:0/555994360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b480cad50 0x7f6b480c1d40 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f6b30000c00 tx=0x7f6b30004770 comp rx=0 tx=0).stop 2023-11-28T11:59:00.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.893+0000 7f6b47fff700 1 -- 172.21.15.50:0/555994360 shutdown_connections 2023-11-28T11:59:00.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.893+0000 7f6b47fff700 1 --2- 172.21.15.50:0/555994360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b48158e60 0x7f6b480c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:00.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.893+0000 7f6b47fff700 1 --2- 172.21.15.50:0/555994360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b480cad50 0x7f6b480c1d40 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:00.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.893+0000 7f6b47fff700 1 --2- 172.21.15.50:0/555994360 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6b28064ee0 0x7f6b28067390 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:00.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.893+0000 7f6b47fff700 1 --2- 172.21.15.50:0/555994360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b480ad490 0x7f6b481577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:00.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.893+0000 7f6b47fff700 1 -- 172.21.15.50:0/555994360 >> 172.21.15.50:0/555994360 conn(0x7f6b480ce3e0 msgr2=0x7f6b480afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:00.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.893+0000 7f6b47fff700 1 -- 172.21.15.50:0/555994360 shutdown_connections 2023-11-28T11:59:00.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:00.893+0000 7f6b47fff700 1 -- 172.21.15.50:0/555994360 wait complete. 2023-11-28T11:59:00.911 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:59:05.912 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:59:06.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.029+0000 7f86baf2e700 1 Processor -- start 2023-11-28T11:59:06.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.029+0000 7f86baf2e700 1 -- start start 2023-11-28T11:59:06.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86baf2e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f86b4069c40 0x7f86b40cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86baf2e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b40cb2a0 0x7f86b40c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86baf2e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b406ace0 con 0x7f86b4159e70 2023-11-28T11:59:06.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86baf2e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b40cb720 con 0x7f86b4069c40 2023-11-28T11:59:06.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86baf2e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b406a0d0 con 0x7f86b40cb2a0 2023-11-28T11:59:06.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86b972b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f86b4069c40 0x7f86b40cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86b9f2c700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f86b4159e70 0x7f86b406c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:40396/0 (socket says 172.21.15.50:40396) 2023-11-28T11:59:06.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86b9f2c700 1 -- 172.21.15.50:0/189970020 learned_addr learned my addr 172.21.15.50:0/189970020 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:06.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86ba72d700 1 --2- 172.21.15.50:0/189970020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b40cb2a0 0x7f86b40c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86b972b700 1 -- 172.21.15.50:0/189970020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b40cb2a0 msgr2=0x7f86b40c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:06.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86b972b700 1 --2- 172.21.15.50:0/189970020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b40cb2a0 0x7f86b40c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86b972b700 1 -- 172.21.15.50:0/189970020 >> v1:172.21.15.192:6789/0 conn(0x7f86b4159e70 legacy=0x7f86b406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86b972b700 1 -- 172.21.15.50:0/189970020 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b406a3b0 con 0x7f86b4069c40 2023-11-28T11:59:06.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86ba72d700 1 --2- 172.21.15.50:0/189970020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b40cb2a0 0x7f86b40c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:06.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86b972b700 1 --2- 172.21.15.50:0/189970020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b4069c40 0x7f86b40cad60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f86b0009d90 tx=0x7f86b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73c972d08dfda0c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86b8f2a700 1 -- 172.21.15.50:0/189970020 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b000e070 con 0x7f86b4069c40 2023-11-28T11:59:06.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86b8f2a700 1 -- 172.21.15.50:0/189970020 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b000bb20 con 0x7f86b4069c40 2023-11-28T11:59:06.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86b8f2a700 1 -- 172.21.15.50:0/189970020 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0012430 con 0x7f86b4069c40 2023-11-28T11:59:06.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86baf2e700 1 -- 172.21.15.50:0/189970020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b4069c40 msgr2=0x7f86b40cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86baf2e700 1 --2- 172.21.15.50:0/189970020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b4069c40 0x7f86b40cad60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f86b0009d90 tx=0x7f86b000b330 comp rx=0 tx=0).stop 2023-11-28T11:59:06.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86baf2e700 1 -- 172.21.15.50:0/189970020 shutdown_connections 2023-11-28T11:59:06.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86baf2e700 1 --2- 172.21.15.50:0/189970020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b40cb2a0 0x7f86b40c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86baf2e700 1 --2- 172.21.15.50:0/189970020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b4069c40 0x7f86b40cad60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86baf2e700 1 -- 172.21.15.50:0/189970020 >> 172.21.15.50:0/189970020 conn(0x7f86b40ce3e0 msgr2=0x7f86b40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:06.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86baf2e700 1 -- 172.21.15.50:0/189970020 shutdown_connections 2023-11-28T11:59:06.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.033+0000 7f86baf2e700 1 -- 172.21.15.50:0/189970020 wait complete. 2023-11-28T11:59:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86baf2e700 1 Processor -- start 2023-11-28T11:59:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86baf2e700 1 -- start start 2023-11-28T11:59:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86baf2e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b4069c40 0x7f86b40c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86baf2e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b40cb2a0 0x7f86b41f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86baf2e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86b4159e70 0x7f86b40c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86baf2e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40c83b0 con 0x7f86b4159e70 2023-11-28T11:59:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86baf2e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40c75b0 con 0x7f86b4069c40 2023-11-28T11:59:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86baf2e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b41f2800 con 0x7f86b40cb2a0 2023-11-28T11:59:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86ba72d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86b4159e70 0x7f86b40c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86ba72d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86b4159e70 0x7f86b40c5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37584/0 (socket says 172.21.15.50:37584) 2023-11-28T11:59:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86b972b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b40cb2a0 0x7f86b41f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86ba72d700 1 -- 172.21.15.50:0/840676059 learned_addr learned my addr 172.21.15.50:0/840676059 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:06.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86b9f2c700 1 --2- 172.21.15.50:0/840676059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b4069c40 0x7f86b40c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86b972b700 1 -- 172.21.15.50:0/840676059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b4069c40 msgr2=0x7f86b40c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86b972b700 1 --2- 172.21.15.50:0/840676059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b4069c40 0x7f86b40c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86b972b700 1 -- 172.21.15.50:0/840676059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86b4159e70 msgr2=0x7f86b40c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86b972b700 1 --2- 172.21.15.50:0/840676059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86b4159e70 0x7f86b40c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86b972b700 1 -- 172.21.15.50:0/840676059 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac0094b0 con 0x7f86b40cb2a0 2023-11-28T11:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86ba72d700 1 --2- 172.21.15.50:0/840676059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86b4159e70 0x7f86b40c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86b972b700 1 --2- 172.21.15.50:0/840676059 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b40cb2a0 0x7f86b41f22c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f86b0016000 tx=0x7f86b0004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86aa7fc700 1 -- 172.21.15.50:0/840676059 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0012430 con 0x7f86b40cb2a0 2023-11-28T11:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86aa7fc700 1 -- 172.21.15.50:0/840676059 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b0020070 con 0x7f86b40cb2a0 2023-11-28T11:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86baf2e700 1 -- 172.21.15.50:0/840676059 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b0009a70 con 0x7f86b40cb2a0 2023-11-28T11:59:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86aa7fc700 1 -- 172.21.15.50:0/840676059 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b00098f0 con 0x7f86b40cb2a0 2023-11-28T11:59:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.037+0000 7f86baf2e700 1 -- 172.21.15.50:0/840676059 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b406a970 con 0x7f86b40cb2a0 2023-11-28T11:59:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.041+0000 7f86baf2e700 1 -- 172.21.15.50:0/840676059 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b406a690 con 0x7f86b40cb2a0 2023-11-28T11:59:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.041+0000 7f86aa7fc700 1 -- 172.21.15.50:0/840676059 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f86b0004040 con 0x7f86b40cb2a0 2023-11-28T11:59:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.041+0000 7f86aa7fc700 1 --2- 172.21.15.50:0/840676059 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8698064f10 0x7f86980673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.041+0000 7f86aa7fc700 1 -- 172.21.15.50:0/840676059 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f86b0022070 con 0x7f86b40cb2a0 2023-11-28T11:59:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.041+0000 7f86b9f2c700 1 --2- 172.21.15.50:0/840676059 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8698064f10 0x7f86980673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.045+0000 7f86b9f2c700 1 --2- 172.21.15.50:0/840676059 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8698064f10 0x7f86980673c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f86a4005930 tx=0x7f86a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:06.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.053+0000 7f86aa7fc700 1 -- 172.21.15.50:0/840676059 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f86b00520c0 con 0x7f86b40cb2a0 2023-11-28T11:59:06.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.253+0000 7f86baf2e700 1 -- 172.21.15.50:0/840676059 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f86b406b6d0 con 0x7f86b40cb2a0 2023-11-28T11:59:06.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.257+0000 7f86aa7fc700 1 -- 172.21.15.50:0/840676059 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f86b00556e0 con 0x7f86b40cb2a0 2023-11-28T11:59:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:59:06.259 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:59:06.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.257+0000 7f86baf2e700 1 -- 172.21.15.50:0/840676059 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8698064f10 msgr2=0x7f86980673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.257+0000 7f86baf2e700 1 --2- 172.21.15.50:0/840676059 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8698064f10 0x7f86980673c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f86a4005930 tx=0x7f86a4009040 comp rx=0 tx=0).stop 2023-11-28T11:59:06.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.257+0000 7f86baf2e700 1 -- 172.21.15.50:0/840676059 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b40cb2a0 msgr2=0x7f86b41f22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:06.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.257+0000 7f86baf2e700 1 --2- 172.21.15.50:0/840676059 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b40cb2a0 0x7f86b41f22c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f86b0016000 tx=0x7f86b0004af0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.257+0000 7f86baf2e700 1 -- 172.21.15.50:0/840676059 shutdown_connections 2023-11-28T11:59:06.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.257+0000 7f86baf2e700 1 --2- 172.21.15.50:0/840676059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86b4159e70 0x7f86b40c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.257+0000 7f86baf2e700 1 --2- 172.21.15.50:0/840676059 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86b40cb2a0 0x7f86b41f22c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.257+0000 7f86baf2e700 1 --2- 172.21.15.50:0/840676059 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8698064f10 0x7f86980673c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.257+0000 7f86baf2e700 1 --2- 172.21.15.50:0/840676059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b4069c40 0x7f86b40c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.257+0000 7f86baf2e700 1 -- 172.21.15.50:0/840676059 >> 172.21.15.50:0/840676059 conn(0x7f86b40ce3e0 msgr2=0x7f86b40c9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.257+0000 7f86baf2e700 1 -- 172.21.15.50:0/840676059 shutdown_connections 2023-11-28T11:59:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:06.257+0000 7f86baf2e700 1 -- 172.21.15.50:0/840676059 wait complete. 2023-11-28T11:59:06.274 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T11:59:06.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:59:06.570 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:59:11.275 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T11:59:11.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90b61dd700 1 Processor -- start 2023-11-28T11:59:11.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90b61dd700 1 -- start start 2023-11-28T11:59:11.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90b61dd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f90a80e12a0 0x7f90a8037b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:11.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90b61dd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90a80e1670 0x7f90a80e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:11.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90b61dd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a80e0af0 con 0x7f90a80e4f50 2023-11-28T11:59:11.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90b61dd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a80e45f0 con 0x7f90a80e12a0 2023-11-28T11:59:11.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90b61dd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8038080 con 0x7f90a80e1670 2023-11-28T11:59:11.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90b59dc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f90a80e4f50 0x7f90a8036770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36786/0 (socket says 172.21.15.50:36786) 2023-11-28T11:59:11.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90b59dc700 1 -- 172.21.15.50:0/2774418046 learned_addr learned my addr 172.21.15.50:0/2774418046 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:11.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90b49da700 1 --2- 172.21.15.50:0/2774418046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90a80e1670 0x7f90a80e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:11.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90b51db700 1 --2- 172.21.15.50:0/2774418046 >> v2:172.21.15.192:3300/0 conn(0x7f90a80e12a0 0x7f90a8037b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:11.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90a7fff700 1 -- 172.21.15.50:0/2774418046 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989604942 0 0) 0x7f90b004e720 con 0x7f90a80e4f50 2023-11-28T11:59:11.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90a7fff700 1 -- 172.21.15.50:0/2774418046 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f909c0035d0 con 0x7f90a80e4f50 2023-11-28T11:59:11.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90b49da700 1 -- 172.21.15.50:0/2774418046 >> v2:172.21.15.192:3300/0 conn(0x7f90a80e12a0 msgr2=0x7f90a8037b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:11.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90b49da700 1 --2- 172.21.15.50:0/2774418046 >> v2:172.21.15.192:3300/0 conn(0x7f90a80e12a0 0x7f90a8037b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90b49da700 1 -- 172.21.15.50:0/2774418046 >> v1:172.21.15.50:6789/0 conn(0x7f90a80e4f50 legacy=0x7f90a8036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:11.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90b49da700 1 -- 172.21.15.50:0/2774418046 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a8050f00 con 0x7f90a80e1670 2023-11-28T11:59:11.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90b49da700 1 --2- 172.21.15.50:0/2774418046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90a80e1670 0x7f90a80e4a10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009850 tx=0x7f90a0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f570d9a7b215624 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:11.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90a7fff700 1 -- 172.21.15.50:0/2774418046 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0011830 con 0x7f90a80e1670 2023-11-28T11:59:11.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90a7fff700 1 -- 172.21.15.50:0/2774418046 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a0011990 con 0x7f90a80e1670 2023-11-28T11:59:11.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.397+0000 7f90a7fff700 1 -- 172.21.15.50:0/2774418046 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0011d00 con 0x7f90a80e1670 2023-11-28T11:59:11.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.401+0000 7f90b61dd700 1 -- 172.21.15.50:0/2774418046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90a80e1670 msgr2=0x7f90a80e4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:11.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.401+0000 7f90b61dd700 1 --2- 172.21.15.50:0/2774418046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90a80e1670 0x7f90a80e4a10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009850 tx=0x7f90a0009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:11.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.401+0000 7f90b61dd700 1 -- 172.21.15.50:0/2774418046 shutdown_connections 2023-11-28T11:59:11.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.401+0000 7f90b61dd700 1 --2- 172.21.15.50:0/2774418046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90a80e1670 0x7f90a80e4a10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.401+0000 7f90b61dd700 1 --2- 172.21.15.50:0/2774418046 >> v2:172.21.15.192:3300/0 conn(0x7f90a80e12a0 0x7f90a8037b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.401+0000 7f90b61dd700 1 -- 172.21.15.50:0/2774418046 >> 172.21.15.50:0/2774418046 conn(0x7f90a8051770 msgr2=0x7f90a8051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:11.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.401+0000 7f90b61dd700 1 -- 172.21.15.50:0/2774418046 shutdown_connections 2023-11-28T11:59:11.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.401+0000 7f90b61dd700 1 -- 172.21.15.50:0/2774418046 wait complete. 2023-11-28T11:59:11.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.401+0000 7f90b61dd700 1 Processor -- start 2023-11-28T11:59:11.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.401+0000 7f90b61dd700 1 -- start start 2023-11-28T11:59:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.401+0000 7f90b61dd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90a80e12a0 0x7f90a80d6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.401+0000 7f90b61dd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90a80e1670 0x7f90a80488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:11.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.401+0000 7f90b61dd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a80e4f50 0x7f90a8048e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.401+0000 7f90b61dd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a80537d0 con 0x7f90a80e4f50 2023-11-28T11:59:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.401+0000 7f90b61dd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8053ab0 con 0x7f90a80e1670 2023-11-28T11:59:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.401+0000 7f90b61dd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8053d90 con 0x7f90a80e12a0 2023-11-28T11:59:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90b59dc700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a80e4f50 0x7f90a8048e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90b51db700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90a80e12a0 0x7f90a80d6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90b51db700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90a80e12a0 0x7f90a80d6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:58810/0 (socket says 172.21.15.50:58810) 2023-11-28T11:59:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90b51db700 1 -- 172.21.15.50:0/2758933559 learned_addr learned my addr 172.21.15.50:0/2758933559 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90b49da700 1 --2- 172.21.15.50:0/2758933559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90a80e1670 0x7f90a80488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90b51db700 1 -- 172.21.15.50:0/2758933559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90a80e1670 msgr2=0x7f90a80488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90b51db700 1 --2- 172.21.15.50:0/2758933559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90a80e1670 0x7f90a80488d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90b51db700 1 -- 172.21.15.50:0/2758933559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a80e4f50 msgr2=0x7f90a8048e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:11.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90b51db700 1 --2- 172.21.15.50:0/2758933559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a80e4f50 0x7f90a8048e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90b51db700 1 -- 172.21.15.50:0/2758933559 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a00094b0 con 0x7f90a80e12a0 2023-11-28T11:59:11.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90b59dc700 1 --2- 172.21.15.50:0/2758933559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a80e4f50 0x7f90a8048e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:11.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90b51db700 1 --2- 172.21.15.50:0/2758933559 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90a80e12a0 0x7f90a80d6530 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00e9d0 tx=0x7f90ac00ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90a5ffb700 1 -- 172.21.15.50:0/2758933559 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac009720 con 0x7f90a80e12a0 2023-11-28T11:59:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90a5ffb700 1 -- 172.21.15.50:0/2758933559 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ac00ee70 con 0x7f90a80e12a0 2023-11-28T11:59:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90b61dd700 1 -- 172.21.15.50:0/2758933559 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a8051430 con 0x7f90a80e12a0 2023-11-28T11:59:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90a5ffb700 1 -- 172.21.15.50:0/2758933559 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac00ca50 con 0x7f90a80e12a0 2023-11-28T11:59:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90b61dd700 1 -- 172.21.15.50:0/2758933559 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a8051150 con 0x7f90a80e12a0 2023-11-28T11:59:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.405+0000 7f90b61dd700 1 -- 172.21.15.50:0/2758933559 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a80e4210 con 0x7f90a80e12a0 2023-11-28T11:59:11.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.409+0000 7f90a5ffb700 1 -- 172.21.15.50:0/2758933559 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f90ac019030 con 0x7f90a80e12a0 2023-11-28T11:59:11.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.409+0000 7f90a5ffb700 1 --2- 172.21.15.50:0/2758933559 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9094064ee0 0x7f9094067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:11.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.409+0000 7f90a5ffb700 1 -- 172.21.15.50:0/2758933559 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f90ac081fe0 con 0x7f90a80e12a0 2023-11-28T11:59:11.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.409+0000 7f90b49da700 1 --2- 172.21.15.50:0/2758933559 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9094064ee0 0x7f9094067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:11.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.409+0000 7f90b49da700 1 --2- 172.21.15.50:0/2758933559 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9094064ee0 0x7f9094067390 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f90a00090b0 tx=0x7f90a0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:11.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.421+0000 7f90a5ffb700 1 -- 172.21.15.50:0/2758933559 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f90ac04ff70 con 0x7f90a80e12a0 2023-11-28T11:59:11.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.629+0000 7f90b61dd700 1 -- 172.21.15.50:0/2758933559 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f90a8053ed0 con 0x7f90a80e12a0 2023-11-28T11:59:11.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.629+0000 7f90a5ffb700 1 -- 172.21.15.50:0/2758933559 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f90a8053ed0 con 0x7f90a80e12a0 2023-11-28T11:59:11.633 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:59:11.633 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T11:59:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.633+0000 7f90b61dd700 1 -- 172.21.15.50:0/2758933559 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9094064ee0 msgr2=0x7f9094067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.633+0000 7f90b61dd700 1 --2- 172.21.15.50:0/2758933559 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9094064ee0 0x7f9094067390 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f90a00090b0 tx=0x7f90a0008030 comp rx=0 tx=0).stop 2023-11-28T11:59:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.633+0000 7f90b61dd700 1 -- 172.21.15.50:0/2758933559 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90a80e12a0 msgr2=0x7f90a80d6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:11.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.633+0000 7f90b61dd700 1 --2- 172.21.15.50:0/2758933559 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90a80e12a0 0x7f90a80d6530 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00e9d0 tx=0x7f90ac00ece0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.633+0000 7f90b61dd700 1 -- 172.21.15.50:0/2758933559 shutdown_connections 2023-11-28T11:59:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.633+0000 7f90b61dd700 1 --2- 172.21.15.50:0/2758933559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90a80e4f50 0x7f90a8048e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.633+0000 7f90b61dd700 1 --2- 172.21.15.50:0/2758933559 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9094064ee0 0x7f9094067390 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.633+0000 7f90b61dd700 1 --2- 172.21.15.50:0/2758933559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90a80e1670 0x7f90a80488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.633+0000 7f90b61dd700 1 --2- 172.21.15.50:0/2758933559 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90a80e12a0 0x7f90a80d6530 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.633+0000 7f90b61dd700 1 -- 172.21.15.50:0/2758933559 >> 172.21.15.50:0/2758933559 conn(0x7f90a8051770 msgr2=0x7f90a8050010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.633+0000 7f90b61dd700 1 -- 172.21.15.50:0/2758933559 shutdown_connections 2023-11-28T11:59:11.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.633+0000 7f90b61dd700 1 -- 172.21.15.50:0/2758933559 wait complete. 2023-11-28T11:59:11.648 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T11:59:11.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:59:11.668 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T11:59:11.689 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T11:59:11.690 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:59:11.690 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:11.717 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:59:11.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a2832700 1 Processor -- start 2023-11-28T11:59:11.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a2832700 1 -- start start 2023-11-28T11:59:11.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a2832700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f279c1606b0 0x7f279c0c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a2832700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f279c0ceef0 0x7f279c0c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a2832700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c0ad610 0x7f279c164040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a2832700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279c0cae70 con 0x7f279c0ceef0 2023-11-28T11:59:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a2832700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279c0cbc10 con 0x7f279c1606b0 2023-11-28T11:59:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a2832700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0cb130 con 0x7f279c0ad610 2023-11-28T11:59:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a102f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f279c0ceef0 0x7f279c0c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a102f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f279c0ceef0 0x7f279c0c18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43954/0 (socket says 172.21.15.50:43954) 2023-11-28T11:59:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a102f700 1 -- 172.21.15.50:0/3061597609 learned_addr learned my addr 172.21.15.50:0/3061597609 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a1830700 1 --2- 172.21.15.50:0/3061597609 >> v2:172.21.15.192:3300/0 conn(0x7f279c1606b0 0x7f279c0c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:11.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a2031700 1 --2- 172.21.15.50:0/3061597609 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c0ad610 0x7f279c164040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a102f700 1 -- 172.21.15.50:0/3061597609 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c0ad610 msgr2=0x7f279c164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a102f700 1 --2- 172.21.15.50:0/3061597609 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c0ad610 0x7f279c164040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a102f700 1 -- 172.21.15.50:0/3061597609 >> v2:172.21.15.192:3300/0 conn(0x7f279c1606b0 msgr2=0x7f279c0c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a102f700 1 --2- 172.21.15.50:0/3061597609 >> v2:172.21.15.192:3300/0 conn(0x7f279c1606b0 0x7f279c0c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a102f700 1 -- 172.21.15.50:0/3061597609 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c0cb410 con 0x7f279c0ceef0 2023-11-28T11:59:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a102f700 1 --2- 172.21.15.50:0/3061597609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f279c0ceef0 0x7f279c0c18f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f279c0b34a0 tx=0x7f2784009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef2153092d2f708 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a082e700 1 -- 172.21.15.50:0/3061597609 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784011830 con 0x7f279c0ceef0 2023-11-28T11:59:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a082e700 1 -- 172.21.15.50:0/3061597609 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2784011990 con 0x7f279c0ceef0 2023-11-28T11:59:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.833+0000 7f27a082e700 1 -- 172.21.15.50:0/3061597609 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784011d20 con 0x7f279c0ceef0 2023-11-28T11:59:11.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.837+0000 7f27a2832700 1 -- 172.21.15.50:0/3061597609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f279c0ceef0 msgr2=0x7f279c0c18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.837+0000 7f27a2832700 1 --2- 172.21.15.50:0/3061597609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f279c0ceef0 0x7f279c0c18f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f279c0b34a0 tx=0x7f2784009bf0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.837+0000 7f27a2832700 1 -- 172.21.15.50:0/3061597609 shutdown_connections 2023-11-28T11:59:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.837+0000 7f27a2832700 1 --2- 172.21.15.50:0/3061597609 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c0ad610 0x7f279c164040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.837+0000 7f27a2832700 1 --2- 172.21.15.50:0/3061597609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f279c0ceef0 0x7f279c0c18f0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.837+0000 7f27a2832700 1 --2- 172.21.15.50:0/3061597609 >> v2:172.21.15.192:3300/0 conn(0x7f279c1606b0 0x7f279c0c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.837+0000 7f27a2832700 1 -- 172.21.15.50:0/3061597609 >> 172.21.15.50:0/3061597609 conn(0x7f279c0ce3e0 msgr2=0x7f279c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.837+0000 7f27a2832700 1 -- 172.21.15.50:0/3061597609 shutdown_connections 2023-11-28T11:59:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.837+0000 7f27a2832700 1 -- 172.21.15.50:0/3061597609 wait complete. 2023-11-28T11:59:11.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.837+0000 7f27a2832700 1 Processor -- start 2023-11-28T11:59:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.837+0000 7f27a2832700 1 -- start start 2023-11-28T11:59:11.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.837+0000 7f27a2832700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f279c0ad610 0x7f279c1540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:11.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a2832700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f279c0ceef0 0x7f279c0afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:11.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a2832700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c1606b0 0x7f279c0b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:11.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a2832700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c15a120 con 0x7f279c0ceef0 2023-11-28T11:59:11.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a2832700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c15a3c0 con 0x7f279c0ad610 2023-11-28T11:59:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a2832700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c15a6a0 con 0x7f279c1606b0 2023-11-28T11:59:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a102f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f279c0ceef0 0x7f279c0afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a102f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f279c0ceef0 0x7f279c0afeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43958/0 (socket says 172.21.15.50:43958) 2023-11-28T11:59:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a102f700 1 -- 172.21.15.50:0/3153214276 learned_addr learned my addr 172.21.15.50:0/3153214276 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a1830700 1 --2- 172.21.15.50:0/3153214276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f279c0ad610 0x7f279c1540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a2031700 1 --2- 172.21.15.50:0/3153214276 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c1606b0 0x7f279c0b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a102f700 1 -- 172.21.15.50:0/3153214276 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c1606b0 msgr2=0x7f279c0b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a102f700 1 --2- 172.21.15.50:0/3153214276 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c1606b0 0x7f279c0b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a102f700 1 -- 172.21.15.50:0/3153214276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f279c0ad610 msgr2=0x7f279c1540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a102f700 1 --2- 172.21.15.50:0/3153214276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f279c0ad610 0x7f279c1540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a102f700 1 -- 172.21.15.50:0/3153214276 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2784009570 con 0x7f279c0ceef0 2023-11-28T11:59:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a2031700 1 --2- 172.21.15.50:0/3153214276 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c1606b0 0x7f279c0b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a1830700 1 --2- 172.21.15.50:0/3153214276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f279c0ad610 0x7f279c1540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a102f700 1 --2- 172.21.15.50:0/3153214276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f279c0ceef0 0x7f279c0afeb0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f2784000c00 tx=0x7f2784004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f279a7fc700 1 -- 172.21.15.50:0/3153214276 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784004240 con 0x7f279c0ceef0 2023-11-28T11:59:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f279a7fc700 1 -- 172.21.15.50:0/3153214276 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278401f070 con 0x7f279c0ceef0 2023-11-28T11:59:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a2832700 1 -- 172.21.15.50:0/3153214276 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279c0b36c0 con 0x7f279c0ceef0 2023-11-28T11:59:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f279a7fc700 1 -- 172.21.15.50:0/3153214276 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27840045c0 con 0x7f279c0ceef0 2023-11-28T11:59:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a2832700 1 -- 172.21.15.50:0/3153214276 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279c0cb6f0 con 0x7f279c0ceef0 2023-11-28T11:59:11.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f27a2832700 1 -- 172.21.15.50:0/3153214276 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279c164580 con 0x7f279c0ceef0 2023-11-28T11:59:11.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.841+0000 7f279a7fc700 1 -- 172.21.15.50:0/3153214276 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f278402a020 con 0x7f279c0ceef0 2023-11-28T11:59:11.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.845+0000 7f279a7fc700 1 --2- 172.21.15.50:0/3153214276 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f277c064ee0 0x7f277c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:11.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.845+0000 7f279a7fc700 1 -- 172.21.15.50:0/3153214276 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f2784083370 con 0x7f279c0ceef0 2023-11-28T11:59:11.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.845+0000 7f27a1830700 1 --2- 172.21.15.50:0/3153214276 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f277c064ee0 0x7f277c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:11.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.845+0000 7f27a1830700 1 --2- 172.21.15.50:0/3153214276 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f277c064ee0 0x7f277c067390 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f278c009fd0 tx=0x7f278c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:11.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:11.853+0000 7f279a7fc700 1 -- 172.21.15.50:0/3153214276 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2784051390 con 0x7f279c0ceef0 2023-11-28T11:59:12.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.017+0000 7f27a2832700 1 -- 172.21.15.50:0/3153214276 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f279c072500 con 0x7f279c0ceef0 2023-11-28T11:59:12.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.017+0000 7f279a7fc700 1 -- 172.21.15.50:0/3153214276 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+18126 (secure 0 0 0) 0x7f27840549b0 con 0x7f279c0ceef0 2023-11-28T11:59:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:59:12.022 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":68,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:57:31.028964+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.943405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:39.374123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.14","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:59:12.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.021+0000 7f27a2832700 1 -- 172.21.15.50:0/3153214276 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f277c064ee0 msgr2=0x7f277c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.021+0000 7f27a2832700 1 --2- 172.21.15.50:0/3153214276 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f277c064ee0 0x7f277c067390 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f278c009fd0 tx=0x7f278c00b040 comp rx=0 tx=0).stop 2023-11-28T11:59:12.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.021+0000 7f27a2832700 1 -- 172.21.15.50:0/3153214276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f279c0ceef0 msgr2=0x7f279c0afeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.021+0000 7f27a2832700 1 --2- 172.21.15.50:0/3153214276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f279c0ceef0 0x7f279c0afeb0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f2784000c00 tx=0x7f2784004770 comp rx=0 tx=0).stop 2023-11-28T11:59:12.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.021+0000 7f27a2832700 1 -- 172.21.15.50:0/3153214276 shutdown_connections 2023-11-28T11:59:12.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.021+0000 7f27a2832700 1 --2- 172.21.15.50:0/3153214276 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c1606b0 0x7f279c0b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.021+0000 7f27a2832700 1 --2- 172.21.15.50:0/3153214276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f279c0ceef0 0x7f279c0afeb0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.021+0000 7f27a2832700 1 --2- 172.21.15.50:0/3153214276 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f277c064ee0 0x7f277c067390 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.021+0000 7f27a2832700 1 --2- 172.21.15.50:0/3153214276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f279c0ad610 0x7f279c1540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.021+0000 7f27a2832700 1 -- 172.21.15.50:0/3153214276 >> 172.21.15.50:0/3153214276 conn(0x7f279c0ce3e0 msgr2=0x7f279c0ae450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:12.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.021+0000 7f27a2832700 1 -- 172.21.15.50:0/3153214276 shutdown_connections 2023-11-28T11:59:12.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.021+0000 7f27a2832700 1 -- 172.21.15.50:0/3153214276 wait complete. 2023-11-28T11:59:12.038 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:56:38.943405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:56:39.374123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:59:12.038 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:59:12.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d759e700 1 Processor -- start 2023-11-28T11:59:12.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d759e700 1 -- start start 2023-11-28T11:59:12.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d759e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f72d80c9c00 0x7f72d806cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d806f990 con 0x7f72d806ea10 2023-11-28T11:59:12.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d759e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d806ee90 con 0x7f72d815c160 2023-11-28T11:59:12.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d759e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d806a4d0 con 0x7f72d80c9c00 2023-11-28T11:59:12.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d6d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f72d806ea10 0x7f72d80cde30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58636/0 (socket says 172.21.15.50:58636) 2023-11-28T11:59:12.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d6d9d700 1 -- 172.21.15.50:0/3923187410 learned_addr learned my addr 172.21.15.50:0/3923187410 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:12.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d659c700 1 --2- 172.21.15.50:0/3923187410 >> v2:172.21.15.192:3300/0 conn(0x7f72d80c9c00 0x7f72d806cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d559a700 1 -- 172.21.15.50:0/3923187410 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944410138 0 0) 0x7f72d806f990 con 0x7f72d806ea10 2023-11-28T11:59:12.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d559a700 1 -- 172.21.15.50:0/3923187410 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c40035d0 con 0x7f72d806ea10 2023-11-28T11:59:12.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d559a700 1 -- 172.21.15.50:0/3923187410 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3104163642 0 0) 0x7f72c40035d0 con 0x7f72d806ea10 2023-11-28T11:59:12.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d559a700 1 -- 172.21.15.50:0/3923187410 >> v2:172.21.15.192:3300/0 conn(0x7f72d80c9c00 msgr2=0x7f72d806cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:12.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d559a700 1 --2- 172.21.15.50:0/3923187410 >> v2:172.21.15.192:3300/0 conn(0x7f72d80c9c00 0x7f72d806cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d559a700 1 -- 172.21.15.50:0/3923187410 >> v1:172.21.15.192:6789/0 conn(0x7f72d815c160 legacy=0x7f72d80c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d559a700 1 -- 172.21.15.50:0/3923187410 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d806f0f0 con 0x7f72d806ea10 2023-11-28T11:59:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d559a700 1 -- 172.21.15.50:0/3923187410 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f72d00019f0 con 0x7f72d806ea10 2023-11-28T11:59:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.153+0000 7f72d559a700 1 -- 172.21.15.50:0/3923187410 >> v1:172.21.15.50:6789/0 conn(0x7f72d806ea10 legacy=0x7f72d80cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d559a700 1 --2- 172.21.15.50:0/3923187410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72c4003a20 0x7f72c4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d559a700 1 --2- 172.21.15.50:0/3923187410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72c4004410 0x7f72c40048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d559a700 1 --2- 172.21.15.50:0/3923187410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72c40050d0 0x7f72c400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d559a700 1 -- 172.21.15.50:0/3923187410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d806a4d0 con 0x7f72c4003a20 2023-11-28T11:59:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d559a700 1 -- 172.21.15.50:0/3923187410 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c400c020 con 0x7f72c40050d0 2023-11-28T11:59:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d559a700 1 -- 172.21.15.50:0/3923187410 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c400c1e0 con 0x7f72c4004410 2023-11-28T11:59:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d659c700 1 --2- 172.21.15.50:0/3923187410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72c4003a20 0x7f72c4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d6d9d700 1 --2- 172.21.15.50:0/3923187410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72c40050d0 0x7f72c400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d5d9b700 1 --2- 172.21.15.50:0/3923187410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72c4004410 0x7f72c40048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d659c700 1 -- 172.21.15.50:0/3923187410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72c4004410 msgr2=0x7f72c40048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:12.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d659c700 1 --2- 172.21.15.50:0/3923187410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72c4004410 0x7f72c40048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d659c700 1 -- 172.21.15.50:0/3923187410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72c40050d0 msgr2=0x7f72c400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:12.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d659c700 1 --2- 172.21.15.50:0/3923187410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72c40050d0 0x7f72c400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d6d9d700 1 -- 172.21.15.50:0/3923187410 reap_dead start 2023-11-28T11:59:12.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d659c700 1 -- 172.21.15.50:0/3923187410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c40035d0 con 0x7f72c4003a20 2023-11-28T11:59:12.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d659c700 1 --2- 172.21.15.50:0/3923187410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72c4003a20 0x7f72c4003df0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f72c8009b70 tx=0x7f72c40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125830deee8091ee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:12.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d559a700 1 -- 172.21.15.50:0/3923187410 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c800e6c0 con 0x7f72c4003a20 2023-11-28T11:59:12.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d559a700 1 -- 172.21.15.50:0/3923187410 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c800e820 con 0x7f72c4003a20 2023-11-28T11:59:12.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d559a700 1 -- 172.21.15.50:0/3923187410 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c800eb90 con 0x7f72c4003a20 2023-11-28T11:59:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d759e700 1 -- 172.21.15.50:0/3923187410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72c4003a20 msgr2=0x7f72c4003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d759e700 1 --2- 172.21.15.50:0/3923187410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72c4003a20 0x7f72c4003df0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f72c8009b70 tx=0x7f72c40058a0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d759e700 1 -- 172.21.15.50:0/3923187410 shutdown_connections 2023-11-28T11:59:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d759e700 1 --2- 172.21.15.50:0/3923187410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72c4003a20 0x7f72c4003df0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d759e700 1 -- 172.21.15.50:0/3923187410 >> 172.21.15.50:0/3923187410 conn(0x7f72d80d0240 msgr2=0x7f72d80cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d759e700 1 -- 172.21.15.50:0/3923187410 shutdown_connections 2023-11-28T11:59:12.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d759e700 1 -- 172.21.15.50:0/3923187410 wait complete. 2023-11-28T11:59:12.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d759e700 1 Processor -- start 2023-11-28T11:59:12.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.157+0000 7f72d759e700 1 -- start start 2023-11-28T11:59:12.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72c4003a20 0x7f72d80c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72d815ee70 0x7f72d80c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72d81566b0 0x7f72d8156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d815c940 con 0x7f72d815ee70 2023-11-28T11:59:12.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d759e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d8157060 con 0x7f72d81566b0 2023-11-28T11:59:12.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d815f2e0 con 0x7f72c4003a20 2023-11-28T11:59:12.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72d815ee70 0x7f72d80c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72d815ee70 0x7f72d80c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43984/0 (socket says 172.21.15.50:43984) 2023-11-28T11:59:12.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d5d9b700 1 -- 172.21.15.50:0/3549552923 learned_addr learned my addr 172.21.15.50:0/3549552923 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:12.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d659c700 1 --2- 172.21.15.50:0/3549552923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72c4003a20 0x7f72d80c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d6d9d700 1 --2- 172.21.15.50:0/3549552923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72d81566b0 0x7f72d8156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d5d9b700 1 -- 172.21.15.50:0/3549552923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72c4003a20 msgr2=0x7f72d80c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d5d9b700 1 --2- 172.21.15.50:0/3549552923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72c4003a20 0x7f72d80c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d5d9b700 1 -- 172.21.15.50:0/3549552923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72d81566b0 msgr2=0x7f72d8156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d5d9b700 1 --2- 172.21.15.50:0/3549552923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72d81566b0 0x7f72d8156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d5d9b700 1 -- 172.21.15.50:0/3549552923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d806f6b0 con 0x7f72d815ee70 2023-11-28T11:59:12.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d6d9d700 1 --2- 172.21.15.50:0/3549552923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72d81566b0 0x7f72d8156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:12.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d5d9b700 1 --2- 172.21.15.50:0/3549552923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72d815ee70 0x7f72d80c68f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f72c000f790 tx=0x7f72c000faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72ceffd700 1 -- 172.21.15.50:0/3549552923 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c00052e0 con 0x7f72d815ee70 2023-11-28T11:59:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72ceffd700 1 -- 172.21.15.50:0/3549552923 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c0005440 con 0x7f72d815ee70 2023-11-28T11:59:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d759e700 1 -- 172.21.15.50:0/3549552923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d806f3d0 con 0x7f72d815ee70 2023-11-28T11:59:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72ceffd700 1 -- 172.21.15.50:0/3549552923 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c00055b0 con 0x7f72d815ee70 2023-11-28T11:59:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d759e700 1 -- 172.21.15.50:0/3549552923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d80cd910 con 0x7f72d815ee70 2023-11-28T11:59:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.161+0000 7f72d759e700 1 -- 172.21.15.50:0/3549552923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d8072c20 con 0x7f72d815ee70 2023-11-28T11:59:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.165+0000 7f72ceffd700 1 -- 172.21.15.50:0/3549552923 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f72c00038f0 con 0x7f72d815ee70 2023-11-28T11:59:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.165+0000 7f72ceffd700 1 --2- 172.21.15.50:0/3549552923 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72b8064ee0 0x7f72b8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.165+0000 7f72ceffd700 1 -- 172.21.15.50:0/3549552923 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f72c0082af0 con 0x7f72d815ee70 2023-11-28T11:59:12.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.165+0000 7f72d659c700 1 --2- 172.21.15.50:0/3549552923 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72b8064ee0 0x7f72b8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.165+0000 7f72d659c700 1 --2- 172.21.15.50:0/3549552923 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72b8064ee0 0x7f72b8067390 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f72c80090b0 tx=0x7f72c801f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:12.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.169+0000 7f72ceffd700 1 -- 172.21.15.50:0/3549552923 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f72c0050a40 con 0x7f72d815ee70 2023-11-28T11:59:12.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.329+0000 7f72d759e700 1 -- 172.21.15.50:0/3549552923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f72d80cd1e0 con 0x7f72d815ee70 2023-11-28T11:59:12.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.333+0000 7f72ceffd700 1 -- 172.21.15.50:0/3549552923 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v68) v1 ==== 92+0+10 (secure 0 0 0) 0x7f72c0054060 con 0x7f72d815ee70 2023-11-28T11:59:12.335 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:59:12.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.333+0000 7f72d759e700 1 -- 172.21.15.50:0/3549552923 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72b8064ee0 msgr2=0x7f72b8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.333+0000 7f72d759e700 1 --2- 172.21.15.50:0/3549552923 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72b8064ee0 0x7f72b8067390 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f72c80090b0 tx=0x7f72c801f040 comp rx=0 tx=0).stop 2023-11-28T11:59:12.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.333+0000 7f72d759e700 1 -- 172.21.15.50:0/3549552923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72d815ee70 msgr2=0x7f72d80c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.333+0000 7f72d759e700 1 --2- 172.21.15.50:0/3549552923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72d815ee70 0x7f72d80c68f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f72c000f790 tx=0x7f72c000faa0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.333+0000 7f72d759e700 1 -- 172.21.15.50:0/3549552923 shutdown_connections 2023-11-28T11:59:12.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.333+0000 7f72d759e700 1 --2- 172.21.15.50:0/3549552923 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f72b8064ee0 0x7f72b8067390 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.333+0000 7f72d759e700 1 --2- 172.21.15.50:0/3549552923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72d81566b0 0x7f72d8156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.333+0000 7f72d759e700 1 --2- 172.21.15.50:0/3549552923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f72d815ee70 0x7f72d80c68f0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.333+0000 7f72d759e700 1 --2- 172.21.15.50:0/3549552923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72c4003a20 0x7f72d80c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.333+0000 7f72d759e700 1 -- 172.21.15.50:0/3549552923 >> 172.21.15.50:0/3549552923 conn(0x7f72d80d0240 msgr2=0x7f72d80ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:12.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.333+0000 7f72d759e700 1 -- 172.21.15.50:0/3549552923 shutdown_connections 2023-11-28T11:59:12.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.333+0000 7f72d759e700 1 -- 172.21.15.50:0/3549552923 wait complete. 2023-11-28T11:59:12.350 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:59:12.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28c52f1700 1 Processor -- start 2023-11-28T11:59:12.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28c52f1700 1 -- start start 2023-11-28T11:59:12.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28c52f1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28c00cf3e0 0x7f28c00c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28c52f1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f28c0069c40 0x7f28c00cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28c52f1700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c00ca400 con 0x7f28c0159ec0 2023-11-28T11:59:12.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28c52f1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c006b6d0 con 0x7f28c0069c40 2023-11-28T11:59:12.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28c52f1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c006b9b0 con 0x7f28c00cf3e0 2023-11-28T11:59:12.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28bffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f28c0159ec0 0x7f28c00cecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58648/0 (socket says 172.21.15.50:58648) 2023-11-28T11:59:12.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28bffff700 1 -- 172.21.15.50:0/1422949234 learned_addr learned my addr 172.21.15.50:0/1422949234 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:12.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28bf7fe700 1 --2- 172.21.15.50:0/1422949234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28c00cf3e0 0x7f28c00c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28c4af0700 1 --2- 172.21.15.50:0/1422949234 >> v2:172.21.15.192:3300/0 conn(0x7f28c0069c40 0x7f28c00cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28beffd700 1 -- 172.21.15.50:0/1422949234 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798464153 0 0) 0x7f28c00ca400 con 0x7f28c0159ec0 2023-11-28T11:59:12.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28beffd700 1 -- 172.21.15.50:0/1422949234 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28a80035d0 con 0x7f28c0159ec0 2023-11-28T11:59:12.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28bf7fe700 1 -- 172.21.15.50:0/1422949234 >> v2:172.21.15.192:3300/0 conn(0x7f28c0069c40 msgr2=0x7f28c00cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:12.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28bf7fe700 1 --2- 172.21.15.50:0/1422949234 >> v2:172.21.15.192:3300/0 conn(0x7f28c0069c40 0x7f28c00cb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28bf7fe700 1 -- 172.21.15.50:0/1422949234 >> v1:172.21.15.50:6789/0 conn(0x7f28c0159ec0 legacy=0x7f28c00cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28bf7fe700 1 -- 172.21.15.50:0/1422949234 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c00cafd0 con 0x7f28c00cf3e0 2023-11-28T11:59:12.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.465+0000 7f28c4af0700 1 --2- 172.21.15.50:0/1422949234 >> v2:172.21.15.192:3300/0 conn(0x7f28c0069c40 0x7f28c00cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:12.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.469+0000 7f28bf7fe700 1 --2- 172.21.15.50:0/1422949234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28c00cf3e0 0x7f28c00c9df0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009850 tx=0x7f28b4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19932bf7b40af993 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:12.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.469+0000 7f28beffd700 1 -- 172.21.15.50:0/1422949234 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4011830 con 0x7f28c00cf3e0 2023-11-28T11:59:12.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.469+0000 7f28beffd700 1 -- 172.21.15.50:0/1422949234 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b4011990 con 0x7f28c00cf3e0 2023-11-28T11:59:12.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.469+0000 7f28beffd700 1 -- 172.21.15.50:0/1422949234 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4011d00 con 0x7f28c00cf3e0 2023-11-28T11:59:12.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.469+0000 7f28c52f1700 1 -- 172.21.15.50:0/1422949234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28c00cf3e0 msgr2=0x7f28c00c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.469+0000 7f28c52f1700 1 --2- 172.21.15.50:0/1422949234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28c00cf3e0 0x7f28c00c9df0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009850 tx=0x7f28b4009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:12.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.469+0000 7f28c52f1700 1 -- 172.21.15.50:0/1422949234 shutdown_connections 2023-11-28T11:59:12.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.469+0000 7f28c52f1700 1 --2- 172.21.15.50:0/1422949234 >> v2:172.21.15.192:3300/0 conn(0x7f28c0069c40 0x7f28c00cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.469+0000 7f28c52f1700 1 --2- 172.21.15.50:0/1422949234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28c00cf3e0 0x7f28c00c9df0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.469+0000 7f28c52f1700 1 -- 172.21.15.50:0/1422949234 >> 172.21.15.50:0/1422949234 conn(0x7f28c006c660 msgr2=0x7f28c006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:12.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.469+0000 7f28c52f1700 1 -- 172.21.15.50:0/1422949234 shutdown_connections 2023-11-28T11:59:12.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.469+0000 7f28c52f1700 1 -- 172.21.15.50:0/1422949234 wait complete. 2023-11-28T11:59:12.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.469+0000 7f28c52f1700 1 Processor -- start 2023-11-28T11:59:12.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.469+0000 7f28c52f1700 1 -- start start 2023-11-28T11:59:12.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28c52f1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28c0069c40 0x7f28c014b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28c52f1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28c00cf3e0 0x7f28c00c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28c52f1700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c0159ec0 0x7f28c01f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28c52f1700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c0148f90 con 0x7f28c0159ec0 2023-11-28T11:59:12.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28c52f1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c0149b10 con 0x7f28c00cf3e0 2023-11-28T11:59:12.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28c52f1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c0148aa0 con 0x7f28c0069c40 2023-11-28T11:59:12.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28c4af0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c0159ec0 0x7f28c01f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28c4af0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c0159ec0 0x7f28c01f4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43992/0 (socket says 172.21.15.50:43992) 2023-11-28T11:59:12.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28c4af0700 1 -- 172.21.15.50:0/2973048896 learned_addr learned my addr 172.21.15.50:0/2973048896 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:12.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28bf7fe700 1 --2- 172.21.15.50:0/2973048896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28c00cf3e0 0x7f28c00c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28bffff700 1 --2- 172.21.15.50:0/2973048896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28c0069c40 0x7f28c014b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28c4af0700 1 -- 172.21.15.50:0/2973048896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28c0069c40 msgr2=0x7f28c014b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28c4af0700 1 --2- 172.21.15.50:0/2973048896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28c0069c40 0x7f28c014b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28c4af0700 1 -- 172.21.15.50:0/2973048896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28c00cf3e0 msgr2=0x7f28c00c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28c4af0700 1 --2- 172.21.15.50:0/2973048896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28c00cf3e0 0x7f28c00c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28c4af0700 1 -- 172.21.15.50:0/2973048896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b8009a70 con 0x7f28c0159ec0 2023-11-28T11:59:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28c4af0700 1 --2- 172.21.15.50:0/2973048896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c0159ec0 0x7f28c01f4d90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f28b800efc0 tx=0x7f28b800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28bcff9700 1 -- 172.21.15.50:0/2973048896 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b800ca90 con 0x7f28c0159ec0 2023-11-28T11:59:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28bcff9700 1 -- 172.21.15.50:0/2973048896 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b800f040 con 0x7f28c0159ec0 2023-11-28T11:59:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28c52f1700 1 -- 172.21.15.50:0/2973048896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b40094b0 con 0x7f28c0159ec0 2023-11-28T11:59:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28bcff9700 1 -- 172.21.15.50:0/2973048896 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b800ce10 con 0x7f28c0159ec0 2023-11-28T11:59:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.473+0000 7f28c52f1700 1 -- 172.21.15.50:0/2973048896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c006bc90 con 0x7f28c0159ec0 2023-11-28T11:59:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.477+0000 7f28c52f1700 1 -- 172.21.15.50:0/2973048896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c00caa10 con 0x7f28c0159ec0 2023-11-28T11:59:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.477+0000 7f28bcff9700 1 -- 172.21.15.50:0/2973048896 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f28b8014480 con 0x7f28c0159ec0 2023-11-28T11:59:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.477+0000 7f28bcff9700 1 --2- 172.21.15.50:0/2973048896 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f28ac064f10 0x7f28ac0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.477+0000 7f28bcff9700 1 -- 172.21.15.50:0/2973048896 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f28b8082700 con 0x7f28c0159ec0 2023-11-28T11:59:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.477+0000 7f28bffff700 1 --2- 172.21.15.50:0/2973048896 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f28ac064f10 0x7f28ac0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.477+0000 7f28bffff700 1 --2- 172.21.15.50:0/2973048896 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f28ac064f10 0x7f28ac0673c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f28b0001360 tx=0x7f28b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:12.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.485+0000 7f28bcff9700 1 -- 172.21.15.50:0/2973048896 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f28b80506c0 con 0x7f28c0159ec0 2023-11-28T11:59:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.641+0000 7f28c52f1700 1 -- 172.21.15.50:0/2973048896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28c015a290 con 0x7f28c0159ec0 2023-11-28T11:59:12.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.641+0000 7f28bcff9700 1 -- 172.21.15.50:0/2973048896 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28b8009d70 con 0x7f28c0159ec0 2023-11-28T11:59:12.646 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:59:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.645+0000 7f28c52f1700 1 -- 172.21.15.50:0/2973048896 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f28ac064f10 msgr2=0x7f28ac0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.645+0000 7f28c52f1700 1 --2- 172.21.15.50:0/2973048896 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f28ac064f10 0x7f28ac0673c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f28b0001360 tx=0x7f28b0009040 comp rx=0 tx=0).stop 2023-11-28T11:59:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.645+0000 7f28c52f1700 1 -- 172.21.15.50:0/2973048896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c0159ec0 msgr2=0x7f28c01f4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.645+0000 7f28c52f1700 1 --2- 172.21.15.50:0/2973048896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c0159ec0 0x7f28c01f4d90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f28b800efc0 tx=0x7f28b800c3a0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.645+0000 7f28c52f1700 1 -- 172.21.15.50:0/2973048896 shutdown_connections 2023-11-28T11:59:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.645+0000 7f28c52f1700 1 --2- 172.21.15.50:0/2973048896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c0159ec0 0x7f28c01f4d90 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.645+0000 7f28c52f1700 1 --2- 172.21.15.50:0/2973048896 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f28ac064f10 0x7f28ac0673c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.645+0000 7f28c52f1700 1 --2- 172.21.15.50:0/2973048896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28c00cf3e0 0x7f28c00c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.645+0000 7f28c52f1700 1 --2- 172.21.15.50:0/2973048896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28c0069c40 0x7f28c014b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.645+0000 7f28c52f1700 1 -- 172.21.15.50:0/2973048896 >> 172.21.15.50:0/2973048896 conn(0x7f28c006c660 msgr2=0x7f28c01594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.645+0000 7f28c52f1700 1 -- 172.21.15.50:0/2973048896 shutdown_connections 2023-11-28T11:59:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.645+0000 7f28c52f1700 1 -- 172.21.15.50:0/2973048896 wait complete. 2023-11-28T11:59:12.668 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:59:12.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.781+0000 7f8d76a1d700 1 Processor -- start 2023-11-28T11:59:12.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.781+0000 7f8d76a1d700 1 -- start start 2023-11-28T11:59:12.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.781+0000 7f8d76a1d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d700c2a30 0x7f8d70164c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.781+0000 7f8d76a1d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d70160b60 con 0x7f8d700c2e00 2023-11-28T11:59:12.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.781+0000 7f8d76a1d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d70165140 con 0x7f8d700b1260 2023-11-28T11:59:12.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.781+0000 7f8d76a1d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d700ce890 con 0x7f8d700c2a30 2023-11-28T11:59:12.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.781+0000 7f8d6f7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8d700c2e00 0x7f8d700ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58662/0 (socket says 172.21.15.50:58662) 2023-11-28T11:59:12.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.781+0000 7f8d6f7fe700 1 -- 172.21.15.50:0/4174801097 learned_addr learned my addr 172.21.15.50:0/4174801097 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:12.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.781+0000 7f8d6ffff700 1 --2- 172.21.15.50:0/4174801097 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d700c2a30 0x7f8d70164c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d6effd700 1 -- 172.21.15.50:0/4174801097 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3459338399 0 0) 0x7f8d70160b60 con 0x7f8d700c2e00 2023-11-28T11:59:12.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d6effd700 1 -- 172.21.15.50:0/4174801097 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d580035d0 con 0x7f8d700c2e00 2023-11-28T11:59:12.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d6effd700 1 -- 172.21.15.50:0/4174801097 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928039077 0 0) 0x7f8d68001490 con 0x7f8d700b1260 2023-11-28T11:59:12.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d6effd700 1 -- 172.21.15.50:0/4174801097 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d70160b60 con 0x7f8d700b1260 2023-11-28T11:59:12.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d6effd700 1 -- 172.21.15.50:0/4174801097 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3398684317 0 0) 0x7f8d580035d0 con 0x7f8d700c2e00 2023-11-28T11:59:12.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d6ffff700 1 -- 172.21.15.50:0/4174801097 >> v1:172.21.15.192:6789/0 conn(0x7f8d700b1260 legacy=0x7f8d7006a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d6ffff700 1 -- 172.21.15.50:0/4174801097 >> v1:172.21.15.50:6789/0 conn(0x7f8d700c2e00 legacy=0x7f8d700ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d6ffff700 1 -- 172.21.15.50:0/4174801097 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d700cf430 con 0x7f8d700c2a30 2023-11-28T11:59:12.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d6ffff700 1 --2- 172.21.15.50:0/4174801097 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d700c2a30 0x7f8d70164c00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009880 tx=0x7f8d60009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97012d14406aebdd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:12.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d6effd700 1 -- 172.21.15.50:0/4174801097 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64001670 con 0x7f8d700c2a30 2023-11-28T11:59:12.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d6effd700 1 -- 172.21.15.50:0/4174801097 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d60004030 con 0x7f8d700c2a30 2023-11-28T11:59:12.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d6effd700 1 -- 172.21.15.50:0/4174801097 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d600043c0 con 0x7f8d700c2a30 2023-11-28T11:59:12.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d76a1d700 1 -- 172.21.15.50:0/4174801097 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d700c2a30 msgr2=0x7f8d70164c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d76a1d700 1 --2- 172.21.15.50:0/4174801097 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d700c2a30 0x7f8d70164c00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009880 tx=0x7f8d60009b90 comp rx=0 tx=0).stop 2023-11-28T11:59:12.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d76a1d700 1 -- 172.21.15.50:0/4174801097 shutdown_connections 2023-11-28T11:59:12.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d76a1d700 1 --2- 172.21.15.50:0/4174801097 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d700c2a30 0x7f8d70164c00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d76a1d700 1 -- 172.21.15.50:0/4174801097 >> 172.21.15.50:0/4174801097 conn(0x7f8d700cc260 msgr2=0x7f8d700cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:12.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d76a1d700 1 -- 172.21.15.50:0/4174801097 shutdown_connections 2023-11-28T11:59:12.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d76a1d700 1 -- 172.21.15.50:0/4174801097 wait complete. 2023-11-28T11:59:12.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d76a1d700 1 Processor -- start 2023-11-28T11:59:12.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.785+0000 7f8d76a1d700 1 -- start start 2023-11-28T11:59:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d76a1d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d700b1260 0x7f8d701633f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d76a1d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d700c2a30 0x7f8d700c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d76a1d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d700c2e00 0x7f8d700c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d76a1d700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d700c3f60 con 0x7f8d700c2a30 2023-11-28T11:59:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d76a1d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d700c3350 con 0x7f8d700b1260 2023-11-28T11:59:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d76a1d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d700c3630 con 0x7f8d700c2e00 2023-11-28T11:59:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d6f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d700c2a30 0x7f8d700c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d6ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d700b1260 0x7f8d701633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d6f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d700c2a30 0x7f8d700c43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44004/0 (socket says 172.21.15.50:44004) 2023-11-28T11:59:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d6f7fe700 1 -- 172.21.15.50:0/1427611340 learned_addr learned my addr 172.21.15.50:0/1427611340 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d74fba700 1 --2- 172.21.15.50:0/1427611340 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d700c2e00 0x7f8d700c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d6f7fe700 1 -- 172.21.15.50:0/1427611340 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d700c2e00 msgr2=0x7f8d700c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d6f7fe700 1 --2- 172.21.15.50:0/1427611340 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d700c2e00 0x7f8d700c4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d6f7fe700 1 -- 172.21.15.50:0/1427611340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d700b1260 msgr2=0x7f8d701633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d6f7fe700 1 --2- 172.21.15.50:0/1427611340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d700b1260 0x7f8d701633f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d6f7fe700 1 -- 172.21.15.50:0/1427611340 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d600094b0 con 0x7f8d700c2a30 2023-11-28T11:59:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d6f7fe700 1 --2- 172.21.15.50:0/1427611340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d700c2a30 0x7f8d700c43f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400c6b0 tx=0x7f8d6400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d6cff9700 1 -- 172.21.15.50:0/1427611340 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64004ca0 con 0x7f8d700c2a30 2023-11-28T11:59:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d6cff9700 1 -- 172.21.15.50:0/1427611340 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d64004e00 con 0x7f8d700c2a30 2023-11-28T11:59:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d76a1d700 1 -- 172.21.15.50:0/1427611340 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d700cdf60 con 0x7f8d700c2a30 2023-11-28T11:59:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d6cff9700 1 -- 172.21.15.50:0/1427611340 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64007310 con 0x7f8d700c2a30 2023-11-28T11:59:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.789+0000 7f8d76a1d700 1 -- 172.21.15.50:0/1427611340 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d700cdc80 con 0x7f8d700c2a30 2023-11-28T11:59:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.793+0000 7f8d6cff9700 1 -- 172.21.15.50:0/1427611340 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8d6401a020 con 0x7f8d700c2a30 2023-11-28T11:59:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.793+0000 7f8d76a1d700 1 -- 172.21.15.50:0/1427611340 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d700ce240 con 0x7f8d700c2a30 2023-11-28T11:59:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.793+0000 7f8d6cff9700 1 --2- 172.21.15.50:0/1427611340 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d5c064ee0 0x7f8d5c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:12.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.793+0000 7f8d6cff9700 1 -- 172.21.15.50:0/1427611340 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f8d64081c70 con 0x7f8d700c2a30 2023-11-28T11:59:12.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.793+0000 7f8d6ffff700 1 --2- 172.21.15.50:0/1427611340 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d5c064ee0 0x7f8d5c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:12.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.793+0000 7f8d6ffff700 1 --2- 172.21.15.50:0/1427611340 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d5c064ee0 0x7f8d5c067390 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8d600090b0 tx=0x7f8d60010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:12.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.801+0000 7f8d6cff9700 1 -- 172.21.15.50:0/1427611340 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8d6404fc50 con 0x7f8d700c2a30 2023-11-28T11:59:12.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.957+0000 7f8d76a1d700 1 -- 172.21.15.50:0/1427611340 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d70072c20 con 0x7f8d700c2a30 2023-11-28T11:59:12.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.957+0000 7f8d6cff9700 1 -- 172.21.15.50:0/1427611340 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8d64053270 con 0x7f8d700c2a30 2023-11-28T11:59:12.962 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:59:12.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.961+0000 7f8d76a1d700 1 -- 172.21.15.50:0/1427611340 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d5c064ee0 msgr2=0x7f8d5c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.961+0000 7f8d76a1d700 1 --2- 172.21.15.50:0/1427611340 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d5c064ee0 0x7f8d5c067390 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8d600090b0 tx=0x7f8d60010000 comp rx=0 tx=0).stop 2023-11-28T11:59:12.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.961+0000 7f8d76a1d700 1 -- 172.21.15.50:0/1427611340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d700c2a30 msgr2=0x7f8d700c43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:12.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.961+0000 7f8d76a1d700 1 --2- 172.21.15.50:0/1427611340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d700c2a30 0x7f8d700c43f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400c6b0 tx=0x7f8d6400c9c0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.961+0000 7f8d76a1d700 1 -- 172.21.15.50:0/1427611340 shutdown_connections 2023-11-28T11:59:12.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.961+0000 7f8d76a1d700 1 --2- 172.21.15.50:0/1427611340 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d700c2e00 0x7f8d700c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.961+0000 7f8d76a1d700 1 --2- 172.21.15.50:0/1427611340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d700c2a30 0x7f8d700c43f0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.961+0000 7f8d76a1d700 1 --2- 172.21.15.50:0/1427611340 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8d5c064ee0 0x7f8d5c067390 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.961+0000 7f8d76a1d700 1 --2- 172.21.15.50:0/1427611340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d700b1260 0x7f8d701633f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:12.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.961+0000 7f8d76a1d700 1 -- 172.21.15.50:0/1427611340 >> 172.21.15.50:0/1427611340 conn(0x7f8d700cc260 msgr2=0x7f8d700c9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:12.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.961+0000 7f8d76a1d700 1 -- 172.21.15.50:0/1427611340 shutdown_connections 2023-11-28T11:59:12.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:12.961+0000 7f8d76a1d700 1 -- 172.21.15.50:0/1427611340 wait complete. 2023-11-28T11:59:12.982 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:59:13.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.089+0000 7f125ea35700 1 Processor -- start 2023-11-28T11:59:13.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.089+0000 7f125ea35700 1 -- start start 2023-11-28T11:59:13.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.089+0000 7f125ea35700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f12580b1ae0 0x7f125806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.089+0000 7f125ea35700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12580cf0e0 0x7f12580cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.089+0000 7f125ea35700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12580cfa80 con 0x7f125806a4c0 2023-11-28T11:59:13.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.089+0000 7f125ea35700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12580d0ab0 con 0x7f12580b1ae0 2023-11-28T11:59:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.089+0000 7f125ea35700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125806a9c0 con 0x7f12580cf0e0 2023-11-28T11:59:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.089+0000 7f125da33700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f12580b1ae0 0x7f125806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.089+0000 7f125da33700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f12580b1ae0 0x7f125806d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44014/0 (socket says 172.21.15.50:44014) 2023-11-28T11:59:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125da33700 1 -- 172.21.15.50:0/777126783 learned_addr learned my addr 172.21.15.50:0/777126783 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:13.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125e234700 1 --2- 172.21.15.50:0/777126783 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12580cf0e0 0x7f12580cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125da33700 1 -- 172.21.15.50:0/777126783 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12580cf0e0 msgr2=0x7f12580cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:13.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125da33700 1 --2- 172.21.15.50:0/777126783 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12580cf0e0 0x7f12580cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125da33700 1 -- 172.21.15.50:0/777126783 >> v1:172.21.15.192:6789/0 conn(0x7f125806a4c0 legacy=0x7f12580d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:13.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125ca31700 1 -- 172.21.15.50:0/777126783 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965274873 0 0) 0x7f12580cfa80 con 0x7f125806a4c0 2023-11-28T11:59:13.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125da33700 1 -- 172.21.15.50:0/777126783 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125806aca0 con 0x7f12580b1ae0 2023-11-28T11:59:13.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125da33700 1 --2- 172.21.15.50:0/777126783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12580b1ae0 0x7f125806d8e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f1248009910 tx=0x7f1248009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920bf24654707d3b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:13.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125ca31700 1 -- 172.21.15.50:0/777126783 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248011830 con 0x7f12580b1ae0 2023-11-28T11:59:13.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125ca31700 1 -- 172.21.15.50:0/777126783 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1248011990 con 0x7f12580b1ae0 2023-11-28T11:59:13.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125ca31700 1 -- 172.21.15.50:0/777126783 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248011d40 con 0x7f12580b1ae0 2023-11-28T11:59:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125ea35700 1 -- 172.21.15.50:0/777126783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12580b1ae0 msgr2=0x7f125806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125ea35700 1 --2- 172.21.15.50:0/777126783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12580b1ae0 0x7f125806d8e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f1248009910 tx=0x7f1248009c20 comp rx=0 tx=0).stop 2023-11-28T11:59:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125ea35700 1 -- 172.21.15.50:0/777126783 shutdown_connections 2023-11-28T11:59:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125ea35700 1 --2- 172.21.15.50:0/777126783 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12580cf0e0 0x7f12580cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125ea35700 1 --2- 172.21.15.50:0/777126783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12580b1ae0 0x7f125806d8e0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125ea35700 1 -- 172.21.15.50:0/777126783 >> 172.21.15.50:0/777126783 conn(0x7f125809bbd0 msgr2=0x7f12580b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125ea35700 1 -- 172.21.15.50:0/777126783 shutdown_connections 2023-11-28T11:59:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.093+0000 7f125ea35700 1 -- 172.21.15.50:0/777126783 wait complete. 2023-11-28T11:59:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125ea35700 1 Processor -- start 2023-11-28T11:59:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125ea35700 1 -- start start 2023-11-28T11:59:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125ea35700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f125806a4c0 0x7f125814ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125ea35700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12580b1ae0 0x7f125815cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125ea35700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12580cf0e0 0x7f125809c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125ea35700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125809f030 con 0x7f125806a4c0 2023-11-28T11:59:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125ea35700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125809e700 con 0x7f12580b1ae0 2023-11-28T11:59:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125ea35700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125809e9e0 con 0x7f12580cf0e0 2023-11-28T11:59:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125da33700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f125806a4c0 0x7f125814ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125da33700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f125806a4c0 0x7f125814ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44024/0 (socket says 172.21.15.50:44024) 2023-11-28T11:59:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125e234700 1 --2- 172.21.15.50:0/2074184482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12580cf0e0 0x7f125809c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125da33700 1 -- 172.21.15.50:0/2074184482 learned_addr learned my addr 172.21.15.50:0/2074184482 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125d232700 1 --2- 172.21.15.50:0/2074184482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12580b1ae0 0x7f125815cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125da33700 1 -- 172.21.15.50:0/2074184482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12580cf0e0 msgr2=0x7f125809c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125da33700 1 --2- 172.21.15.50:0/2074184482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12580cf0e0 0x7f125809c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125da33700 1 -- 172.21.15.50:0/2074184482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12580b1ae0 msgr2=0x7f125815cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125da33700 1 --2- 172.21.15.50:0/2074184482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12580b1ae0 0x7f125815cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125da33700 1 -- 172.21.15.50:0/2074184482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1248009570 con 0x7f125806a4c0 2023-11-28T11:59:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125da33700 1 --2- 172.21.15.50:0/2074184482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f125806a4c0 0x7f125814ddb0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f1248009f70 tx=0x7f1248004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f124e7fc700 1 -- 172.21.15.50:0/2074184482 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124801a900 con 0x7f125806a4c0 2023-11-28T11:59:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f124e7fc700 1 -- 172.21.15.50:0/2074184482 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124801f070 con 0x7f125806a4c0 2023-11-28T11:59:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125ea35700 1 -- 172.21.15.50:0/2074184482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12580b4380 con 0x7f125806a4c0 2023-11-28T11:59:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f124e7fc700 1 -- 172.21.15.50:0/2074184482 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124801acc0 con 0x7f125806a4c0 2023-11-28T11:59:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.097+0000 7f125ea35700 1 -- 172.21.15.50:0/2074184482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125806af80 con 0x7f125806a4c0 2023-11-28T11:59:13.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.101+0000 7f125ea35700 1 -- 172.21.15.50:0/2074184482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12580b1eb0 con 0x7f125806a4c0 2023-11-28T11:59:13.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.101+0000 7f124e7fc700 1 -- 172.21.15.50:0/2074184482 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f124800f050 con 0x7f125806a4c0 2023-11-28T11:59:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.101+0000 7f124e7fc700 1 --2- 172.21.15.50:0/2074184482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f123c064f10 0x7f123c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.101+0000 7f124e7fc700 1 -- 172.21.15.50:0/2074184482 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f1248021070 con 0x7f125806a4c0 2023-11-28T11:59:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.101+0000 7f125d232700 1 --2- 172.21.15.50:0/2074184482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f123c064f10 0x7f123c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.101+0000 7f125d232700 1 --2- 172.21.15.50:0/2074184482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f123c064f10 0x7f123c0673c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f12581e6df0 tx=0x7f1254009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:13.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.109+0000 7f124e7fc700 1 -- 172.21.15.50:0/2074184482 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f12480518c0 con 0x7f125806a4c0 2023-11-28T11:59:13.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.273+0000 7f125ea35700 1 -- 172.21.15.50:0/2074184482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1258072500 con 0x7f125806a4c0 2023-11-28T11:59:13.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.273+0000 7f124e7fc700 1 -- 172.21.15.50:0/2074184482 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1248006da0 con 0x7f125806a4c0 2023-11-28T11:59:13.277 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:59:13.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.277+0000 7f125ea35700 1 -- 172.21.15.50:0/2074184482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f123c064f10 msgr2=0x7f123c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:13.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.277+0000 7f125ea35700 1 --2- 172.21.15.50:0/2074184482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f123c064f10 0x7f123c0673c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f12581e6df0 tx=0x7f1254009040 comp rx=0 tx=0).stop 2023-11-28T11:59:13.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.277+0000 7f125ea35700 1 -- 172.21.15.50:0/2074184482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f125806a4c0 msgr2=0x7f125814ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:13.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.277+0000 7f125ea35700 1 --2- 172.21.15.50:0/2074184482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f125806a4c0 0x7f125814ddb0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f1248009f70 tx=0x7f1248004770 comp rx=0 tx=0).stop 2023-11-28T11:59:13.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.277+0000 7f125ea35700 1 -- 172.21.15.50:0/2074184482 shutdown_connections 2023-11-28T11:59:13.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.277+0000 7f125ea35700 1 --2- 172.21.15.50:0/2074184482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12580cf0e0 0x7f125809c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.277+0000 7f125ea35700 1 --2- 172.21.15.50:0/2074184482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f123c064f10 0x7f123c0673c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.277+0000 7f125ea35700 1 --2- 172.21.15.50:0/2074184482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12580b1ae0 0x7f125815cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.277+0000 7f125ea35700 1 --2- 172.21.15.50:0/2074184482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f125806a4c0 0x7f125814ddb0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.277+0000 7f125ea35700 1 -- 172.21.15.50:0/2074184482 >> 172.21.15.50:0/2074184482 conn(0x7f125809bbd0 msgr2=0x7f125815bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:13.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.277+0000 7f125ea35700 1 -- 172.21.15.50:0/2074184482 shutdown_connections 2023-11-28T11:59:13.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.277+0000 7f125ea35700 1 -- 172.21.15.50:0/2074184482 wait complete. 2023-11-28T11:59:13.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T11:59:13.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.409+0000 7f3b0e4d0700 1 Processor -- start 2023-11-28T11:59:13.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.409+0000 7f3b0e4d0700 1 -- start start 2023-11-28T11:59:13.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.409+0000 7f3b0e4d0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080cb460 0x7f3b080c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.409+0000 7f3b0e4d0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3b080ad490 0x7f3b080cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.409+0000 7f3b0e4d0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b080cd8f0 con 0x7f3b08158e60 2023-11-28T11:59:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.409+0000 7f3b0e4d0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b080add00 con 0x7f3b080ad490 2023-11-28T11:59:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.409+0000 7f3b0e4d0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080cc4f0 con 0x7f3b080cb460 2023-11-28T11:59:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3b0cccd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080cb460 0x7f3b080c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3b0cccd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080cb460 0x7f3b080c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:53318/0 (socket says 172.21.15.50:53318) 2023-11-28T11:59:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3b0dccf700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3b080ad490 0x7f3b080cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3b0cccd700 1 -- 172.21.15.50:0/3985974170 learned_addr learned my addr 172.21.15.50:0/3985974170 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3b0cccd700 1 -- 172.21.15.50:0/3985974170 >> v2:172.21.15.192:3300/0 conn(0x7f3b080ad490 msgr2=0x7f3b080cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3b0cccd700 1 --2- 172.21.15.50:0/3985974170 >> v2:172.21.15.192:3300/0 conn(0x7f3b080ad490 0x7f3b080cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3b0cccd700 1 -- 172.21.15.50:0/3985974170 >> v1:172.21.15.192:6789/0 conn(0x7f3b08158e60 legacy=0x7f3b080cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:13.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3b0cccd700 1 -- 172.21.15.50:0/3985974170 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0806dc60 con 0x7f3b080cb460 2023-11-28T11:59:13.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3b0cccd700 1 --2- 172.21.15.50:0/3985974170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080cb460 0x7f3b080c8a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400d180 tx=0x7f3b0400d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e53ffa6601acc73 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:13.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3afffff700 1 -- 172.21.15.50:0/3985974170 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04010070 con 0x7f3b080cb460 2023-11-28T11:59:13.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3afffff700 1 -- 172.21.15.50:0/3985974170 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0400dd00 con 0x7f3b080cb460 2023-11-28T11:59:13.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3afffff700 1 -- 172.21.15.50:0/3985974170 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0400b310 con 0x7f3b080cb460 2023-11-28T11:59:13.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3b0e4d0700 1 -- 172.21.15.50:0/3985974170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080cb460 msgr2=0x7f3b080c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:13.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3b0e4d0700 1 --2- 172.21.15.50:0/3985974170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080cb460 0x7f3b080c8a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400d180 tx=0x7f3b0400d490 comp rx=0 tx=0).stop 2023-11-28T11:59:13.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3b0e4d0700 1 -- 172.21.15.50:0/3985974170 shutdown_connections 2023-11-28T11:59:13.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3b0e4d0700 1 --2- 172.21.15.50:0/3985974170 >> v2:172.21.15.192:3300/0 conn(0x7f3b080ad490 0x7f3b080cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3b0e4d0700 1 --2- 172.21.15.50:0/3985974170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080cb460 0x7f3b080c8a30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3b0e4d0700 1 -- 172.21.15.50:0/3985974170 >> 172.21.15.50:0/3985974170 conn(0x7f3b080ce3e0 msgr2=0x7f3b080ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:13.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3b0e4d0700 1 -- 172.21.15.50:0/3985974170 shutdown_connections 2023-11-28T11:59:13.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.413+0000 7f3b0e4d0700 1 -- 172.21.15.50:0/3985974170 wait complete. 2023-11-28T11:59:13.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0e4d0700 1 Processor -- start 2023-11-28T11:59:13.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0e4d0700 1 -- start start 2023-11-28T11:59:13.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0e4d0700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b080ad490 0x7f3b080c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0e4d0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b080cb460 0x7f3b0814cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0e4d0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b08158e60 0x7f3b0814b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0e4d0700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080c48b0 con 0x7f3b080ad490 2023-11-28T11:59:13.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0e4d0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0814ca80 con 0x7f3b080cb460 2023-11-28T11:59:13.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0e4d0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0814be70 con 0x7f3b08158e60 2023-11-28T11:59:13.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0d4ce700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b080ad490 0x7f3b080c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0dccf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b08158e60 0x7f3b0814b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0d4ce700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b080ad490 0x7f3b080c4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44036/0 (socket says 172.21.15.50:44036) 2023-11-28T11:59:13.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0d4ce700 1 -- 172.21.15.50:0/186239553 learned_addr learned my addr 172.21.15.50:0/186239553 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:13.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0cccd700 1 --2- 172.21.15.50:0/186239553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b080cb460 0x7f3b0814cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0d4ce700 1 -- 172.21.15.50:0/186239553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b08158e60 msgr2=0x7f3b0814b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:13.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0d4ce700 1 --2- 172.21.15.50:0/186239553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b08158e60 0x7f3b0814b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0d4ce700 1 -- 172.21.15.50:0/186239553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b080cb460 msgr2=0x7f3b0814cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:13.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0d4ce700 1 --2- 172.21.15.50:0/186239553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b080cb460 0x7f3b0814cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0d4ce700 1 -- 172.21.15.50:0/186239553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0400bd40 con 0x7f3b080ad490 2023-11-28T11:59:13.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0d4ce700 1 --2- 172.21.15.50:0/186239553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b080ad490 0x7f3b080c4370 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3af800c500 tx=0x7f3af800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:13.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3afdffb700 1 -- 172.21.15.50:0/186239553 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af80052d0 con 0x7f3b080ad490 2023-11-28T11:59:13.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3afdffb700 1 -- 172.21.15.50:0/186239553 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af8005430 con 0x7f3b080ad490 2023-11-28T11:59:13.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0e4d0700 1 -- 172.21.15.50:0/186239553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b08159230 con 0x7f3b080ad490 2023-11-28T11:59:13.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3afdffb700 1 -- 172.21.15.50:0/186239553 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af80055a0 con 0x7f3b080ad490 2023-11-28T11:59:13.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.417+0000 7f3b0e4d0700 1 -- 172.21.15.50:0/186239553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b080cde90 con 0x7f3b080ad490 2023-11-28T11:59:13.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.421+0000 7f3b0e4d0700 1 -- 172.21.15.50:0/186239553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0806d6a0 con 0x7f3b080ad490 2023-11-28T11:59:13.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.421+0000 7f3afdffb700 1 -- 172.21.15.50:0/186239553 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3af8019030 con 0x7f3b080ad490 2023-11-28T11:59:13.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.421+0000 7f3afdffb700 1 --2- 172.21.15.50:0/186239553 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3aec064f10 0x7f3aec0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.421+0000 7f3afdffb700 1 -- 172.21.15.50:0/186239553 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f3af8081380 con 0x7f3b080ad490 2023-11-28T11:59:13.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.421+0000 7f3b0cccd700 1 --2- 172.21.15.50:0/186239553 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3aec064f10 0x7f3aec0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.425+0000 7f3b0cccd700 1 --2- 172.21.15.50:0/186239553 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3aec064f10 0x7f3aec0673c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400d4d0 tx=0x7f3b0400b000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:13.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.429+0000 7f3afdffb700 1 -- 172.21.15.50:0/186239553 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3af804f250 con 0x7f3b080ad490 2023-11-28T11:59:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.609+0000 7f3b0e4d0700 1 -- 172.21.15.50:0/186239553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3b08072500 con 0x7f3b080ad490 2023-11-28T11:59:13.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.609+0000 7f3afdffb700 1 -- 172.21.15.50:0/186239553 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v68) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3af8052870 con 0x7f3b080ad490 2023-11-28T11:59:13.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.609+0000 7f3b0e4d0700 1 -- 172.21.15.50:0/186239553 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3aec064f10 msgr2=0x7f3aec0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:13.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.609+0000 7f3b0e4d0700 1 --2- 172.21.15.50:0/186239553 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3aec064f10 0x7f3aec0673c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400d4d0 tx=0x7f3b0400b000 comp rx=0 tx=0).stop 2023-11-28T11:59:13.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.609+0000 7f3b0e4d0700 1 -- 172.21.15.50:0/186239553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b080ad490 msgr2=0x7f3b080c4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:13.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.609+0000 7f3b0e4d0700 1 --2- 172.21.15.50:0/186239553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b080ad490 0x7f3b080c4370 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3af800c500 tx=0x7f3af800c810 comp rx=0 tx=0).stop 2023-11-28T11:59:13.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.609+0000 7f3b0e4d0700 1 -- 172.21.15.50:0/186239553 shutdown_connections 2023-11-28T11:59:13.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.609+0000 7f3b0e4d0700 1 --2- 172.21.15.50:0/186239553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b08158e60 0x7f3b0814b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.609+0000 7f3b0e4d0700 1 --2- 172.21.15.50:0/186239553 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3aec064f10 0x7f3aec0673c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.609+0000 7f3b0e4d0700 1 --2- 172.21.15.50:0/186239553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b080cb460 0x7f3b0814cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.609+0000 7f3b0e4d0700 1 --2- 172.21.15.50:0/186239553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b080ad490 0x7f3b080c4370 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.609+0000 7f3b0e4d0700 1 -- 172.21.15.50:0/186239553 >> 172.21.15.50:0/186239553 conn(0x7f3b080ce3e0 msgr2=0x7f3b080b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:13.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.609+0000 7f3b0e4d0700 1 -- 172.21.15.50:0/186239553 shutdown_connections 2023-11-28T11:59:13.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.609+0000 7f3b0e4d0700 1 -- 172.21.15.50:0/186239553 wait complete. 2023-11-28T11:59:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-11-28T11:59:13.626 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-11-28T11:59:13.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:13.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T11:59:13.641 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[51563]: fuse finished with error 0 and tester_r 0 2023-11-28T11:59:13.642 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T11:59:13.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:13.643 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T11:59:13.705 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:59:13.705 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:13.711 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17871 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:59:13.711 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T11:59:13.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:13.711 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T11:59:13.716 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-28T11:59:13.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:59:13.717 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:59:13.717 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:13.722 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349436k,nr_inodes=4087359,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20953 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276116k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:59:13.723 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T11:59:13.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:13.723 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T11:59:13.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:59:13.729 INFO:teuthology.orchestra.run.smithi050.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-28T11:59:13.729 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:59:13.729 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:13.736 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17871 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:59:13.737 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T11:59:13.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:13.737 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T11:59:13.784 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-28T11:59:13.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:59:13.785 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:59:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.901+0000 7fbc689db700 1 Processor -- start 2023-11-28T11:59:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.901+0000 7fbc689db700 1 -- start start 2023-11-28T11:59:13.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc689db700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbc64069c40 0x7fbc640cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc689db700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbc640cb2a0 0x7fbc640c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc689db700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6406ace0 con 0x7fbc64159e70 2023-11-28T11:59:13.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc689db700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc640cb6e0 con 0x7fbc64069c40 2023-11-28T11:59:13.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc689db700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6406a0d0 con 0x7fbc640cb2a0 2023-11-28T11:59:13.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc62ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbc64069c40 0x7fbc640cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc62ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbc64069c40 0x7fbc640cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44040/0 (socket says 172.21.15.50:44040) 2023-11-28T11:59:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc62ffd700 1 -- 172.21.15.50:0/2036851781 learned_addr learned my addr 172.21.15.50:0/2036851781 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc63fff700 1 --2- 172.21.15.50:0/2036851781 >> v2:172.21.15.192:3300/0 conn(0x7fbc640cb2a0 0x7fbc640c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc62ffd700 1 -- 172.21.15.50:0/2036851781 >> v2:172.21.15.192:3300/0 conn(0x7fbc640cb2a0 msgr2=0x7fbc640c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc62ffd700 1 --2- 172.21.15.50:0/2036851781 >> v2:172.21.15.192:3300/0 conn(0x7fbc640cb2a0 0x7fbc640c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc62ffd700 1 -- 172.21.15.50:0/2036851781 >> v1:172.21.15.192:6789/0 conn(0x7fbc64159e70 legacy=0x7fbc6406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc627fc700 1 -- 172.21.15.50:0/2036851781 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962113559 0 0) 0x7fbc6406ace0 con 0x7fbc64159e70 2023-11-28T11:59:13.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc62ffd700 1 -- 172.21.15.50:0/2036851781 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6406a3b0 con 0x7fbc64069c40 2023-11-28T11:59:13.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc62ffd700 1 --2- 172.21.15.50:0/2036851781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc64069c40 0x7fbc640cad60 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fbc640afe60 tx=0x7fbc4c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3d61c1dcc5ee51 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:13.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc627fc700 1 -- 172.21.15.50:0/2036851781 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c011830 con 0x7fbc64069c40 2023-11-28T11:59:13.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc627fc700 1 -- 172.21.15.50:0/2036851781 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c011990 con 0x7fbc64069c40 2023-11-28T11:59:13.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc627fc700 1 -- 172.21.15.50:0/2036851781 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c011d20 con 0x7fbc64069c40 2023-11-28T11:59:13.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc689db700 1 -- 172.21.15.50:0/2036851781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc64069c40 msgr2=0x7fbc640cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:13.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc689db700 1 --2- 172.21.15.50:0/2036851781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc64069c40 0x7fbc640cad60 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fbc640afe60 tx=0x7fbc4c009bf0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc689db700 1 -- 172.21.15.50:0/2036851781 shutdown_connections 2023-11-28T11:59:13.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc689db700 1 --2- 172.21.15.50:0/2036851781 >> v2:172.21.15.192:3300/0 conn(0x7fbc640cb2a0 0x7fbc640c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc689db700 1 --2- 172.21.15.50:0/2036851781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc64069c40 0x7fbc640cad60 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc689db700 1 -- 172.21.15.50:0/2036851781 >> 172.21.15.50:0/2036851781 conn(0x7fbc640ce3e0 msgr2=0x7fbc640ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:13.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc689db700 1 -- 172.21.15.50:0/2036851781 shutdown_connections 2023-11-28T11:59:13.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.905+0000 7fbc689db700 1 -- 172.21.15.50:0/2036851781 wait complete. 2023-11-28T11:59:13.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc689db700 1 Processor -- start 2023-11-28T11:59:13.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc689db700 1 -- start start 2023-11-28T11:59:13.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc689db700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc64069c40 0x7fbc640ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc689db700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc640cb2a0 0x7fbc6415a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc689db700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc64159e70 0x7fbc64098260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc689db700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc640c6940 con 0x7fbc640cb2a0 2023-11-28T11:59:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc689db700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6415d360 con 0x7fbc64069c40 2023-11-28T11:59:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc689db700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6415a780 con 0x7fbc64159e70 2023-11-28T11:59:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc62ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc640cb2a0 0x7fbc6415a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc62ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc640cb2a0 0x7fbc6415a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44050/0 (socket says 172.21.15.50:44050) 2023-11-28T11:59:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc62ffd700 1 -- 172.21.15.50:0/2006552282 learned_addr learned my addr 172.21.15.50:0/2006552282 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc637fe700 1 --2- 172.21.15.50:0/2006552282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc64069c40 0x7fbc640ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc63fff700 1 --2- 172.21.15.50:0/2006552282 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc64159e70 0x7fbc64098260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc62ffd700 1 -- 172.21.15.50:0/2006552282 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc64159e70 msgr2=0x7fbc64098260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc62ffd700 1 --2- 172.21.15.50:0/2006552282 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc64159e70 0x7fbc64098260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc62ffd700 1 -- 172.21.15.50:0/2006552282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc64069c40 msgr2=0x7fbc640ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc62ffd700 1 --2- 172.21.15.50:0/2006552282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc64069c40 0x7fbc640ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc62ffd700 1 -- 172.21.15.50:0/2006552282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4c009570 con 0x7fbc640cb2a0 2023-11-28T11:59:13.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc62ffd700 1 --2- 172.21.15.50:0/2006552282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc640cb2a0 0x7fbc6415a240 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fbc6406f4b0 tx=0x7fbc4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:13.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc5bfff700 1 -- 172.21.15.50:0/2006552282 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c0044d0 con 0x7fbc640cb2a0 2023-11-28T11:59:13.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc5bfff700 1 -- 172.21.15.50:0/2006552282 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c01f070 con 0x7fbc640cb2a0 2023-11-28T11:59:13.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc689db700 1 -- 172.21.15.50:0/2006552282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6406a970 con 0x7fbc640cb2a0 2023-11-28T11:59:13.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.909+0000 7fbc5bfff700 1 -- 172.21.15.50:0/2006552282 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c003900 con 0x7fbc640cb2a0 2023-11-28T11:59:13.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.913+0000 7fbc689db700 1 -- 172.21.15.50:0/2006552282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6406a690 con 0x7fbc640cb2a0 2023-11-28T11:59:13.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.913+0000 7fbc689db700 1 -- 172.21.15.50:0/2006552282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6406d0b0 con 0x7fbc640cb2a0 2023-11-28T11:59:13.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.913+0000 7fbc5bfff700 1 -- 172.21.15.50:0/2006552282 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbc4c00f050 con 0x7fbc640cb2a0 2023-11-28T11:59:13.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.913+0000 7fbc5bfff700 1 --2- 172.21.15.50:0/2006552282 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc44064ee0 0x7fbc44067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:13.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.913+0000 7fbc5bfff700 1 -- 172.21.15.50:0/2006552282 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fbc4c021070 con 0x7fbc640cb2a0 2023-11-28T11:59:13.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.913+0000 7fbc637fe700 1 --2- 172.21.15.50:0/2006552282 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc44064ee0 0x7fbc44067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:13.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.917+0000 7fbc637fe700 1 --2- 172.21.15.50:0/2006552282 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc44064ee0 0x7fbc44067390 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0012e0 tx=0x7fbc5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:13.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:13.921+0000 7fbc5bfff700 1 -- 172.21.15.50:0/2006552282 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbc4c051450 con 0x7fbc640cb2a0 2023-11-28T11:59:14.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.125+0000 7fbc689db700 1 -- 172.21.15.50:0/2006552282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc640c6a80 con 0x7fbc640cb2a0 2023-11-28T11:59:14.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.125+0000 7fbc5bfff700 1 -- 172.21.15.50:0/2006552282 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4653 (secure 0 0 0) 0x7fbc640c6a80 con 0x7fbc640cb2a0 2023-11-28T11:59:14.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:59:14.129 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1573599194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1573599194},{"type":"v1","addr":"172.21.15.192:6836","nonce":1573599194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6445,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/983935617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":983935617},{"type":"v1","addr":"172.21.15.192:6837","nonce":983935617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2516263109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2516263109},{"type":"v1","addr":"172.21.15.50:6833","nonce":2516263109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:56:40.385672+0000","modified":"2023-11-28T11:56:56.456234+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":7,"addr":"172.21.15.50:6835/3894924751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3894924751},{"type":"v1","addr":"172.21.15.50:6835","nonce":3894924751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:59:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.129+0000 7fbc689db700 1 -- 172.21.15.50:0/2006552282 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc44064ee0 msgr2=0x7fbc44067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.129+0000 7fbc689db700 1 --2- 172.21.15.50:0/2006552282 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc44064ee0 0x7fbc44067390 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0012e0 tx=0x7fbc5c009040 comp rx=0 tx=0).stop 2023-11-28T11:59:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.129+0000 7fbc689db700 1 -- 172.21.15.50:0/2006552282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc640cb2a0 msgr2=0x7fbc6415a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.129+0000 7fbc689db700 1 --2- 172.21.15.50:0/2006552282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc640cb2a0 0x7fbc6415a240 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fbc6406f4b0 tx=0x7fbc4c004770 comp rx=0 tx=0).stop 2023-11-28T11:59:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.129+0000 7fbc689db700 1 -- 172.21.15.50:0/2006552282 shutdown_connections 2023-11-28T11:59:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.129+0000 7fbc689db700 1 --2- 172.21.15.50:0/2006552282 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc64159e70 0x7fbc64098260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.129+0000 7fbc689db700 1 --2- 172.21.15.50:0/2006552282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc640cb2a0 0x7fbc6415a240 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.129+0000 7fbc689db700 1 --2- 172.21.15.50:0/2006552282 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc44064ee0 0x7fbc44067390 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.129+0000 7fbc689db700 1 --2- 172.21.15.50:0/2006552282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc64069c40 0x7fbc640ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.129+0000 7fbc689db700 1 -- 172.21.15.50:0/2006552282 >> 172.21.15.50:0/2006552282 conn(0x7fbc640ce3e0 msgr2=0x7fbc640adb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.129+0000 7fbc689db700 1 -- 172.21.15.50:0/2006552282 shutdown_connections 2023-11-28T11:59:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.129+0000 7fbc689db700 1 -- 172.21.15.50:0/2006552282 wait complete. 2023-11-28T11:59:14.133 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 32 2023-11-28T11:59:14.149 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:59:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.261+0000 7f8ad4eae700 1 Processor -- start 2023-11-28T11:59:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8ad4eae700 1 -- start start 2023-11-28T11:59:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8ad4eae700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ac8006c20 0x7f8ac8007070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8ad4eae700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8ac8039dd0 0x7f8ac803a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8ad4eae700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac8008110 con 0x7f8ac8037880 2023-11-28T11:59:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8ad4eae700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac80396a0 con 0x7f8ac8006c20 2023-11-28T11:59:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8ad4eae700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac80518b0 con 0x7f8ac8039dd0 2023-11-28T11:59:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8aceffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ac8006c20 0x7f8ac8007070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8aceffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ac8006c20 0x7f8ac8007070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44060/0 (socket says 172.21.15.50:44060) 2023-11-28T11:59:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8aceffd700 1 -- 172.21.15.50:0/3528415840 learned_addr learned my addr 172.21.15.50:0/3528415840 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8aceffd700 1 -- 172.21.15.50:0/3528415840 >> v2:172.21.15.192:3300/0 conn(0x7f8ac8039dd0 msgr2=0x7f8ac803a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8acffff700 1 --2- 172.21.15.50:0/3528415840 >> v2:172.21.15.192:3300/0 conn(0x7f8ac8039dd0 0x7f8ac803a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8aceffd700 1 --2- 172.21.15.50:0/3528415840 >> v2:172.21.15.192:3300/0 conn(0x7f8ac8039dd0 0x7f8ac803a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8aceffd700 1 -- 172.21.15.50:0/3528415840 >> v1:172.21.15.50:6789/0 conn(0x7f8ac8037880 legacy=0x7f8ac8037c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8aceffd700 1 -- 172.21.15.50:0/3528415840 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac80075b0 con 0x7f8ac8006c20 2023-11-28T11:59:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8acffff700 1 --2- 172.21.15.50:0/3528415840 >> v2:172.21.15.192:3300/0 conn(0x7f8ac8039dd0 0x7f8ac803a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:59:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8aceffd700 1 --2- 172.21.15.50:0/3528415840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac8006c20 0x7f8ac8007070 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80514f0 tx=0x7f8ac4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783b75ceae7abe69 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8ace7fc700 1 -- 172.21.15.50:0/3528415840 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac400b8a0 con 0x7f8ac8006c20 2023-11-28T11:59:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8ace7fc700 1 -- 172.21.15.50:0/3528415840 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac400ba00 con 0x7f8ac8006c20 2023-11-28T11:59:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8ace7fc700 1 -- 172.21.15.50:0/3528415840 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac400bd90 con 0x7f8ac8006c20 2023-11-28T11:59:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8ad4eae700 1 -- 172.21.15.50:0/3528415840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac8006c20 msgr2=0x7f8ac8007070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8ad4eae700 1 --2- 172.21.15.50:0/3528415840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac8006c20 0x7f8ac8007070 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80514f0 tx=0x7f8ac4009bf0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8ad4eae700 1 -- 172.21.15.50:0/3528415840 shutdown_connections 2023-11-28T11:59:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8ad4eae700 1 --2- 172.21.15.50:0/3528415840 >> v2:172.21.15.192:3300/0 conn(0x7f8ac8039dd0 0x7f8ac803a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8ad4eae700 1 --2- 172.21.15.50:0/3528415840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac8006c20 0x7f8ac8007070 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8ad4eae700 1 -- 172.21.15.50:0/3528415840 >> 172.21.15.50:0/3528415840 conn(0x7f8ac8052880 msgr2=0x7f8ac8052c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8ad4eae700 1 -- 172.21.15.50:0/3528415840 shutdown_connections 2023-11-28T11:59:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.265+0000 7f8ad4eae700 1 -- 172.21.15.50:0/3528415840 wait complete. 2023-11-28T11:59:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8ad4eae700 1 Processor -- start 2023-11-28T11:59:14.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8ad4eae700 1 -- start start 2023-11-28T11:59:14.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8ad4eae700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac8006c20 0x7f8ac8177b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8ad4eae700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ac8037880 0x7f8ac80e3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8ad4eae700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ac8039dd0 0x7f8ac80de850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8ad4eae700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac80e3a40 con 0x7f8ac8006c20 2023-11-28T11:59:14.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8ad4eae700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac8178170 con 0x7f8ac8037880 2023-11-28T11:59:14.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8ad4eae700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac8178450 con 0x7f8ac8039dd0 2023-11-28T11:59:14.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8acf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac8006c20 0x7f8ac8177b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8acf7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac8006c20 0x7f8ac8177b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44076/0 (socket says 172.21.15.50:44076) 2023-11-28T11:59:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8acf7fe700 1 -- 172.21.15.50:0/3433477434 learned_addr learned my addr 172.21.15.50:0/3433477434 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8acffff700 1 --2- 172.21.15.50:0/3433477434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ac8039dd0 0x7f8ac80de850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8aceffd700 1 --2- 172.21.15.50:0/3433477434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ac8037880 0x7f8ac80e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8acf7fe700 1 -- 172.21.15.50:0/3433477434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ac8039dd0 msgr2=0x7f8ac80de850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8acf7fe700 1 --2- 172.21.15.50:0/3433477434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ac8039dd0 0x7f8ac80de850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8acf7fe700 1 -- 172.21.15.50:0/3433477434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ac8037880 msgr2=0x7f8ac80e3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8acf7fe700 1 --2- 172.21.15.50:0/3433477434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ac8037880 0x7f8ac80e3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8acf7fe700 1 -- 172.21.15.50:0/3433477434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac4009570 con 0x7f8ac8006c20 2023-11-28T11:59:14.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8aceffd700 1 --2- 172.21.15.50:0/3433477434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ac8037880 0x7f8ac80e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:59:14.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8acf7fe700 1 --2- 172.21.15.50:0/3433477434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac8006c20 0x7f8ac8177b20 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00c500 tx=0x7f8abc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:14.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8abbfff700 1 -- 172.21.15.50:0/3433477434 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc0052d0 con 0x7f8ac8006c20 2023-11-28T11:59:14.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8abbfff700 1 -- 172.21.15.50:0/3433477434 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8abc005430 con 0x7f8ac8006c20 2023-11-28T11:59:14.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8ad4eae700 1 -- 172.21.15.50:0/3433477434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac8007b50 con 0x7f8ac8006c20 2023-11-28T11:59:14.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8abbfff700 1 -- 172.21.15.50:0/3433477434 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc0055a0 con 0x7f8ac8006c20 2023-11-28T11:59:14.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.269+0000 7f8ad4eae700 1 -- 172.21.15.50:0/3433477434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac8007870 con 0x7f8ac8006c20 2023-11-28T11:59:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.273+0000 7f8ad4eae700 1 -- 172.21.15.50:0/3433477434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac8007e30 con 0x7f8ac8006c20 2023-11-28T11:59:14.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.273+0000 7f8abbfff700 1 -- 172.21.15.50:0/3433477434 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8abc010050 con 0x7f8ac8006c20 2023-11-28T11:59:14.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.273+0000 7f8abbfff700 1 --2- 172.21.15.50:0/3433477434 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8ab4064ee0 0x7f8ab4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.273+0000 7f8abbfff700 1 -- 172.21.15.50:0/3433477434 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f8abc081310 con 0x7f8ac8006c20 2023-11-28T11:59:14.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.273+0000 7f8aceffd700 1 --2- 172.21.15.50:0/3433477434 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8ab4064ee0 0x7f8ab4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.277+0000 7f8aceffd700 1 --2- 172.21.15.50:0/3433477434 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8ab4064ee0 0x7f8ab4067390 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80dddc0 tx=0x7f8ac4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.281+0000 7f8abbfff700 1 -- 172.21.15.50:0/3433477434 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8abc049400 con 0x7f8ac8006c20 2023-11-28T11:59:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.441+0000 7f8ad4eae700 1 -- 172.21.15.50:0/3433477434 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ac80059c0 con 0x7f8ac8006c20 2023-11-28T11:59:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.445+0000 7f8abbfff700 1 -- 172.21.15.50:0/3433477434 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+18126 (secure 0 0 0) 0x7f8abc056e60 con 0x7f8ac8006c20 2023-11-28T11:59:14.450 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:59:14.450 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":68,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:57:31.028964+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.943405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:39.374123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.14","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:59:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.449+0000 7f8ad4eae700 1 -- 172.21.15.50:0/3433477434 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8ab4064ee0 msgr2=0x7f8ab4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.449+0000 7f8ad4eae700 1 --2- 172.21.15.50:0/3433477434 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8ab4064ee0 0x7f8ab4067390 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80dddc0 tx=0x7f8ac4008030 comp rx=0 tx=0).stop 2023-11-28T11:59:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.449+0000 7f8ad4eae700 1 -- 172.21.15.50:0/3433477434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac8006c20 msgr2=0x7f8ac8177b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.449+0000 7f8ad4eae700 1 --2- 172.21.15.50:0/3433477434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac8006c20 0x7f8ac8177b20 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00c500 tx=0x7f8abc00c8c0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.449+0000 7f8ad4eae700 1 -- 172.21.15.50:0/3433477434 shutdown_connections 2023-11-28T11:59:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.449+0000 7f8ad4eae700 1 --2- 172.21.15.50:0/3433477434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ac8039dd0 0x7f8ac80de850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.449+0000 7f8ad4eae700 1 --2- 172.21.15.50:0/3433477434 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8ab4064ee0 0x7f8ab4067390 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.449+0000 7f8ad4eae700 1 --2- 172.21.15.50:0/3433477434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ac8037880 0x7f8ac80e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.449+0000 7f8ad4eae700 1 --2- 172.21.15.50:0/3433477434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac8006c20 0x7f8ac8177b20 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.449+0000 7f8ad4eae700 1 -- 172.21.15.50:0/3433477434 >> 172.21.15.50:0/3433477434 conn(0x7f8ac8052880 msgr2=0x7f8ac8037c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.449+0000 7f8ad4eae700 1 -- 172.21.15.50:0/3433477434 shutdown_connections 2023-11-28T11:59:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.449+0000 7f8ad4eae700 1 -- 172.21.15.50:0/3433477434 wait complete. 2023-11-28T11:59:14.465 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T11:53:33.953532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T11:53:34.923315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T11:56:38.943405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T11:56:39.374123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T11:59:14.465 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T11:59:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ceb59e700 1 Processor -- start 2023-11-28T11:59:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ceb59e700 1 -- start start 2023-11-28T11:59:14.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ceb59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8cec06a4c0 0x7f8cec06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ceb59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cec0cf0e0 0x7f8cec0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ceb59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cec0cfa80 con 0x7f8cec0b1ae0 2023-11-28T11:59:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ceb59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cec0d0ab0 con 0x7f8cec06a4c0 2023-11-28T11:59:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ceb59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec06a9c0 con 0x7f8cec0cf0e0 2023-11-28T11:59:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8cea59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8cec0b1ae0 0x7f8cec0d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58680/0 (socket says 172.21.15.50:58680) 2023-11-28T11:59:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8cea59c700 1 -- 172.21.15.50:0/3500653556 learned_addr learned my addr 172.21.15.50:0/3500653556 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce1d9b700 1 --2- 172.21.15.50:0/3500653556 >> v2:172.21.15.192:3300/0 conn(0x7f8cec06a4c0 0x7f8cec06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8cead9d700 1 --2- 172.21.15.50:0/3500653556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cec0cf0e0 0x7f8cec0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce9d9b700 1 -- 172.21.15.50:0/3500653556 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378130417 0 0) 0x7f8cec0cfa80 con 0x7f8cec0b1ae0 2023-11-28T11:59:14.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce9d9b700 1 -- 172.21.15.50:0/3500653556 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cd80035d0 con 0x7f8cec0b1ae0 2023-11-28T11:59:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce9d9b700 1 -- 172.21.15.50:0/3500653556 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 540151827 0 0) 0x7f8cd80035d0 con 0x7f8cec0b1ae0 2023-11-28T11:59:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce9d9b700 1 -- 172.21.15.50:0/3500653556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cec0cf0e0 msgr2=0x7f8cec0cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce9d9b700 1 --2- 172.21.15.50:0/3500653556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cec0cf0e0 0x7f8cec0cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce9d9b700 1 -- 172.21.15.50:0/3500653556 >> v2:172.21.15.192:3300/0 conn(0x7f8cec06a4c0 msgr2=0x7f8cec06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce9d9b700 1 --2- 172.21.15.50:0/3500653556 >> v2:172.21.15.192:3300/0 conn(0x7f8cec06a4c0 0x7f8cec06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce9d9b700 1 -- 172.21.15.50:0/3500653556 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec06aca0 con 0x7f8cec0b1ae0 2023-11-28T11:59:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce9d9b700 1 -- 172.21.15.50:0/3500653556 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f8cdc001670 con 0x7f8cec0b1ae0 2023-11-28T11:59:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce9d9b700 1 -- 172.21.15.50:0/3500653556 >> v1:172.21.15.50:6789/0 conn(0x7f8cec0b1ae0 legacy=0x7f8cec0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce9d9b700 1 --2- 172.21.15.50:0/3500653556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cd8003a20 0x7f8cd8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce9d9b700 1 --2- 172.21.15.50:0/3500653556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cd80043c0 0x7f8cd8004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce9d9b700 1 --2- 172.21.15.50:0/3500653556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cec0cf0e0 0x7f8cd8004f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8cea59c700 1 --2- 172.21.15.50:0/3500653556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cd8003a20 0x7f8cd8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce9d9b700 1 -- 172.21.15.50:0/3500653556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec0d0ab0 con 0x7f8cd8003a20 2023-11-28T11:59:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce9d9b700 1 -- 172.21.15.50:0/3500653556 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec06a9c0 con 0x7f8cd80043c0 2023-11-28T11:59:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce9d9b700 1 -- 172.21.15.50:0/3500653556 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8005720 con 0x7f8cec0cf0e0 2023-11-28T11:59:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8ce1d9b700 1 --2- 172.21.15.50:0/3500653556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cd80043c0 0x7f8cd8004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8cead9d700 1 --2- 172.21.15.50:0/3500653556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cec0cf0e0 0x7f8cd8004f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8cea59c700 1 -- 172.21.15.50:0/3500653556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cec0cf0e0 msgr2=0x7f8cd8004f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8cea59c700 1 --2- 172.21.15.50:0/3500653556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cec0cf0e0 0x7f8cd8004f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8cea59c700 1 -- 172.21.15.50:0/3500653556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cd80043c0 msgr2=0x7f8cd8004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8cea59c700 1 --2- 172.21.15.50:0/3500653556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cd80043c0 0x7f8cd8004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.589+0000 7f8cea59c700 1 -- 172.21.15.50:0/3500653556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd80035d0 con 0x7f8cd8003a20 2023-11-28T11:59:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.593+0000 7f8cea59c700 1 --2- 172.21.15.50:0/3500653556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cd8003a20 0x7f8cd8003df0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc005160 tx=0x7f8cd80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810045986db584b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.593+0000 7f8ce9d9b700 1 -- 172.21.15.50:0/3500653556 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc004c00 con 0x7f8cd8003a20 2023-11-28T11:59:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.593+0000 7f8ce9d9b700 1 -- 172.21.15.50:0/3500653556 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc005b80 con 0x7f8cd8003a20 2023-11-28T11:59:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.593+0000 7f8ce9d9b700 1 -- 172.21.15.50:0/3500653556 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0080d0 con 0x7f8cd8003a20 2023-11-28T11:59:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.593+0000 7f8ceb59e700 1 -- 172.21.15.50:0/3500653556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cd8003a20 msgr2=0x7f8cd8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.593+0000 7f8ceb59e700 1 --2- 172.21.15.50:0/3500653556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cd8003a20 0x7f8cd8003df0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc005160 tx=0x7f8cd80058a0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.593+0000 7f8cead9d700 1 -- 172.21.15.50:0/3500653556 reap_dead start 2023-11-28T11:59:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.593+0000 7f8ceb59e700 1 -- 172.21.15.50:0/3500653556 shutdown_connections 2023-11-28T11:59:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.593+0000 7f8ceb59e700 1 -- 172.21.15.50:0/3500653556 >> 172.21.15.50:0/3500653556 conn(0x7f8cec09bbd0 msgr2=0x7f8cec0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.593+0000 7f8ceb59e700 1 -- 172.21.15.50:0/3500653556 shutdown_connections 2023-11-28T11:59:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.593+0000 7f8ceb59e700 1 -- 172.21.15.50:0/3500653556 wait complete. 2023-11-28T11:59:14.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.593+0000 7f8ceb59e700 1 Processor -- start 2023-11-28T11:59:14.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.593+0000 7f8ceb59e700 1 -- start start 2023-11-28T11:59:14.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8ceb59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cd8003a20 0x7f8cec0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8ceb59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cec15e5a0 0x7f8cec0b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8ceb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cec0c81c0 0x7f8cec0c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8ceb59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec0d1d70 con 0x7f8cec0c81c0 2023-11-28T11:59:14.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8ceb59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec0c8ba0 con 0x7f8cd8003a20 2023-11-28T11:59:14.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8ceb59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec15ed60 con 0x7f8cec15e5a0 2023-11-28T11:59:14.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8cead9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cec0c81c0 0x7f8cec0c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8cead9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cec0c81c0 0x7f8cec0c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44090/0 (socket says 172.21.15.50:44090) 2023-11-28T11:59:14.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8cead9d700 1 -- 172.21.15.50:0/2259469568 learned_addr learned my addr 172.21.15.50:0/2259469568 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:14.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8cea59c700 1 --2- 172.21.15.50:0/2259469568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cd8003a20 0x7f8cec0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8ce1d9b700 1 --2- 172.21.15.50:0/2259469568 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cec15e5a0 0x7f8cec0b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8cead9d700 1 -- 172.21.15.50:0/2259469568 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cec15e5a0 msgr2=0x7f8cec0b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8cead9d700 1 --2- 172.21.15.50:0/2259469568 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cec15e5a0 0x7f8cec0b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8cead9d700 1 -- 172.21.15.50:0/2259469568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cd8003a20 msgr2=0x7f8cec0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8cead9d700 1 --2- 172.21.15.50:0/2259469568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cd8003a20 0x7f8cec0d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8cead9d700 1 -- 172.21.15.50:0/2259469568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec0b4380 con 0x7f8cec0c81c0 2023-11-28T11:59:14.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8cead9d700 1 --2- 172.21.15.50:0/2259469568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cec0c81c0 0x7f8cec0c8660 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f8cec08cd20 tx=0x7f8ce4011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:14.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8ce37fe700 1 -- 172.21.15.50:0/2259469568 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce400e040 con 0x7f8cec0c81c0 2023-11-28T11:59:14.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8ce37fe700 1 -- 172.21.15.50:0/2259469568 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce400f040 con 0x7f8cec0c81c0 2023-11-28T11:59:14.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8ceb59e700 1 -- 172.21.15.50:0/2259469568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cec06af80 con 0x7f8cec0c81c0 2023-11-28T11:59:14.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8ce37fe700 1 -- 172.21.15.50:0/2259469568 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce400fe30 con 0x7f8cec0c81c0 2023-11-28T11:59:14.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.597+0000 7f8ceb59e700 1 -- 172.21.15.50:0/2259469568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cec0b1eb0 con 0x7f8cec0c81c0 2023-11-28T11:59:14.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.601+0000 7f8ceb59e700 1 -- 172.21.15.50:0/2259469568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cec15fa40 con 0x7f8cec0c81c0 2023-11-28T11:59:14.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.601+0000 7f8ce37fe700 1 -- 172.21.15.50:0/2259469568 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8ce4015430 con 0x7f8cec0c81c0 2023-11-28T11:59:14.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.601+0000 7f8ce37fe700 1 --2- 172.21.15.50:0/2259469568 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8ccc064ee0 0x7f8ccc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.601+0000 7f8ce37fe700 1 -- 172.21.15.50:0/2259469568 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f8ce4082b50 con 0x7f8cec0c81c0 2023-11-28T11:59:14.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.601+0000 7f8cea59c700 1 --2- 172.21.15.50:0/2259469568 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8ccc064ee0 0x7f8ccc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.601+0000 7f8cea59c700 1 --2- 172.21.15.50:0/2259469568 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8ccc064ee0 0x7f8ccc067390 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc005160 tx=0x7f8cdc00a070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:14.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.609+0000 7f8ce37fe700 1 -- 172.21.15.50:0/2259469568 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8ce4050ad0 con 0x7f8cec0c81c0 2023-11-28T11:59:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.769+0000 7f8ceb59e700 1 -- 172.21.15.50:0/2259469568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8cec157f90 con 0x7f8cec0c81c0 2023-11-28T11:59:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.773+0000 7f8ce37fe700 1 -- 172.21.15.50:0/2259469568 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v68) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8cec157f90 con 0x7f8cec0c81c0 2023-11-28T11:59:14.775 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2023-11-28T11:59:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.773+0000 7f8ceb59e700 1 -- 172.21.15.50:0/2259469568 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8ccc064ee0 msgr2=0x7f8ccc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.773+0000 7f8ceb59e700 1 --2- 172.21.15.50:0/2259469568 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8ccc064ee0 0x7f8ccc067390 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc005160 tx=0x7f8cdc00a070 comp rx=0 tx=0).stop 2023-11-28T11:59:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.773+0000 7f8ceb59e700 1 -- 172.21.15.50:0/2259469568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cec0c81c0 msgr2=0x7f8cec0c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.773+0000 7f8ceb59e700 1 --2- 172.21.15.50:0/2259469568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cec0c81c0 0x7f8cec0c8660 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f8cec08cd20 tx=0x7f8ce4011f60 comp rx=0 tx=0).stop 2023-11-28T11:59:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.773+0000 7f8ceb59e700 1 -- 172.21.15.50:0/2259469568 shutdown_connections 2023-11-28T11:59:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.773+0000 7f8ceb59e700 1 --2- 172.21.15.50:0/2259469568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cec0c81c0 0x7f8cec0c8660 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.773+0000 7f8ceb59e700 1 --2- 172.21.15.50:0/2259469568 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cec15e5a0 0x7f8cec0b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.773+0000 7f8ceb59e700 1 --2- 172.21.15.50:0/2259469568 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f8ccc064ee0 0x7f8ccc067390 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.773+0000 7f8ceb59e700 1 --2- 172.21.15.50:0/2259469568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cd8003a20 0x7f8cec0d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.773+0000 7f8ceb59e700 1 -- 172.21.15.50:0/2259469568 >> 172.21.15.50:0/2259469568 conn(0x7f8cec09bbd0 msgr2=0x7f8cec06d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.773+0000 7f8ceb59e700 1 -- 172.21.15.50:0/2259469568 shutdown_connections 2023-11-28T11:59:14.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.773+0000 7f8ceb59e700 1 -- 172.21.15.50:0/2259469568 wait complete. 2023-11-28T11:59:14.790 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T11:59:14.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.905+0000 7f6e8b59e700 1 Processor -- start 2023-11-28T11:59:14.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.905+0000 7f6e8b59e700 1 -- start start 2023-11-28T11:59:14.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.905+0000 7f6e8b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e8c0b00e0 0x7f6e8c15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.905+0000 7f6e8b59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6e8c09bdb0 0x7f6e8c15d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.905+0000 7f6e8b59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c0b2db0 con 0x7f6e8c0cbb30 2023-11-28T11:59:14.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.905+0000 7f6e8b59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c0b3240 con 0x7f6e8c09bdb0 2023-11-28T11:59:14.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.905+0000 7f6e8b59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c06d840 con 0x7f6e8c0b00e0 2023-11-28T11:59:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e89d9b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6e8c09bdb0 0x7f6e8c15d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8a59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e8c0b00e0 0x7f6e8c15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8ad9d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6e8c0cbb30 0x7f6e8c0ccf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:52052/0 (socket says 172.21.15.50:52052) 2023-11-28T11:59:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e89d9b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6e8c09bdb0 0x7f6e8c15d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:58030/0 (socket says 172.21.15.50:58030) 2023-11-28T11:59:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8ad9d700 1 -- 172.21.15.50:0/2105997127 learned_addr learned my addr 172.21.15.50:0/2105997127 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8a59c700 1 -- 172.21.15.50:0/2105997127 >> v2:172.21.15.192:3300/0 conn(0x7f6e8c09bdb0 msgr2=0x7f6e8c15d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:14.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8a59c700 1 --2- 172.21.15.50:0/2105997127 >> v2:172.21.15.192:3300/0 conn(0x7f6e8c09bdb0 0x7f6e8c15d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8a59c700 1 -- 172.21.15.50:0/2105997127 >> v1:172.21.15.192:6789/0 conn(0x7f6e8c0cbb30 legacy=0x7f6e8c0ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8a59c700 1 -- 172.21.15.50:0/2105997127 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c06d560 con 0x7f6e8c0b00e0 2023-11-28T11:59:14.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8a59c700 1 --2- 172.21.15.50:0/2105997127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e8c0b00e0 0x7f6e8c15d2e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009850 tx=0x7f6e74009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88e7b99e26fd2f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:14.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8959a700 1 -- 172.21.15.50:0/2105997127 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74011830 con 0x7f6e8c0b00e0 2023-11-28T11:59:14.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8959a700 1 -- 172.21.15.50:0/2105997127 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e74011990 con 0x7f6e8c0b00e0 2023-11-28T11:59:14.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8959a700 1 -- 172.21.15.50:0/2105997127 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74011d40 con 0x7f6e8c0b00e0 2023-11-28T11:59:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8b59e700 1 -- 172.21.15.50:0/2105997127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e8c0b00e0 msgr2=0x7f6e8c15d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8b59e700 1 --2- 172.21.15.50:0/2105997127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e8c0b00e0 0x7f6e8c15d2e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009850 tx=0x7f6e74009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8b59e700 1 -- 172.21.15.50:0/2105997127 shutdown_connections 2023-11-28T11:59:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8b59e700 1 --2- 172.21.15.50:0/2105997127 >> v2:172.21.15.192:3300/0 conn(0x7f6e8c09bdb0 0x7f6e8c15d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8b59e700 1 --2- 172.21.15.50:0/2105997127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e8c0b00e0 0x7f6e8c15d2e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8b59e700 1 -- 172.21.15.50:0/2105997127 >> 172.21.15.50:0/2105997127 conn(0x7f6e8c0cae70 msgr2=0x7f6e8c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:14.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8b59e700 1 -- 172.21.15.50:0/2105997127 shutdown_connections 2023-11-28T11:59:14.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.909+0000 7f6e8b59e700 1 -- 172.21.15.50:0/2105997127 wait complete. 2023-11-28T11:59:14.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8b59e700 1 Processor -- start 2023-11-28T11:59:14.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8b59e700 1 -- start start 2023-11-28T11:59:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8c09bdb0 0x7f6e8c155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8b59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e8c0cbb30 0x7f6e8c159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e8c09b500 0x7f6e8c0c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c071000 con 0x7f6e8c09bdb0 2023-11-28T11:59:14.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8b59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c15ad40 con 0x7f6e8c0cbb30 2023-11-28T11:59:14.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8b59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c15a130 con 0x7f6e8c09b500 2023-11-28T11:59:14.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8c09bdb0 0x7f6e8c155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8a59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8c09bdb0 0x7f6e8c155f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44104/0 (socket says 172.21.15.50:44104) 2023-11-28T11:59:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8a59c700 1 -- 172.21.15.50:0/2432231584 learned_addr learned my addr 172.21.15.50:0/2432231584 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e89d9b700 1 --2- 172.21.15.50:0/2432231584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e8c0cbb30 0x7f6e8c159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8ad9d700 1 --2- 172.21.15.50:0/2432231584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e8c09b500 0x7f6e8c0c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8a59c700 1 -- 172.21.15.50:0/2432231584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e8c09b500 msgr2=0x7f6e8c0c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8a59c700 1 --2- 172.21.15.50:0/2432231584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e8c09b500 0x7f6e8c0c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8a59c700 1 -- 172.21.15.50:0/2432231584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e8c0cbb30 msgr2=0x7f6e8c159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8a59c700 1 --2- 172.21.15.50:0/2432231584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e8c0cbb30 0x7f6e8c159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8a59c700 1 -- 172.21.15.50:0/2432231584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e740094b0 con 0x7f6e8c09bdb0 2023-11-28T11:59:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8a59c700 1 --2- 172.21.15.50:0/2432231584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8c09bdb0 0x7f6e8c155f50 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0cc430 tx=0x7f6e74004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e82ffd700 1 -- 172.21.15.50:0/2432231584 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74004340 con 0x7f6e8c09bdb0 2023-11-28T11:59:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e82ffd700 1 -- 172.21.15.50:0/2432231584 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7401f070 con 0x7f6e8c09bdb0 2023-11-28T11:59:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8b59e700 1 -- 172.21.15.50:0/2432231584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8c0ac3d0 con 0x7f6e8c09bdb0 2023-11-28T11:59:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e82ffd700 1 -- 172.21.15.50:0/2432231584 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e740036c0 con 0x7f6e8c09bdb0 2023-11-28T11:59:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.913+0000 7f6e8b59e700 1 -- 172.21.15.50:0/2432231584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8c0ac0f0 con 0x7f6e8c09bdb0 2023-11-28T11:59:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.917+0000 7f6e8b59e700 1 -- 172.21.15.50:0/2432231584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8c06cbe0 con 0x7f6e8c09bdb0 2023-11-28T11:59:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.917+0000 7f6e82ffd700 1 -- 172.21.15.50:0/2432231584 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6e7402a020 con 0x7f6e8c09bdb0 2023-11-28T11:59:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.917+0000 7f6e82ffd700 1 --2- 172.21.15.50:0/2432231584 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6e6c064f10 0x7f6e6c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.917+0000 7f6e82ffd700 1 -- 172.21.15.50:0/2432231584 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f6e74083430 con 0x7f6e8c09bdb0 2023-11-28T11:59:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.917+0000 7f6e89d9b700 1 --2- 172.21.15.50:0/2432231584 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6e6c064f10 0x7f6e6c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.917+0000 7f6e89d9b700 1 --2- 172.21.15.50:0/2432231584 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6e6c064f10 0x7f6e6c0673c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0c4f20 tx=0x7f6e7c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:14.925+0000 7f6e82ffd700 1 -- 172.21.15.50:0/2432231584 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6e74051390 con 0x7f6e8c09bdb0 2023-11-28T11:59:15.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.089+0000 7f6e8b59e700 1 -- 172.21.15.50:0/2432231584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e8c072500 con 0x7f6e8c09bdb0 2023-11-28T11:59:15.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.089+0000 7f6e82ffd700 1 -- 172.21.15.50:0/2432231584 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e740549b0 con 0x7f6e8c09bdb0 2023-11-28T11:59:15.093 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-11-28T11:59:15.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.093+0000 7f6e8b59e700 1 -- 172.21.15.50:0/2432231584 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6e6c064f10 msgr2=0x7f6e6c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.093+0000 7f6e8b59e700 1 --2- 172.21.15.50:0/2432231584 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6e6c064f10 0x7f6e6c0673c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0c4f20 tx=0x7f6e7c009240 comp rx=0 tx=0).stop 2023-11-28T11:59:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.093+0000 7f6e8b59e700 1 -- 172.21.15.50:0/2432231584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8c09bdb0 msgr2=0x7f6e8c155f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.093+0000 7f6e8b59e700 1 --2- 172.21.15.50:0/2432231584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8c09bdb0 0x7f6e8c155f50 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0cc430 tx=0x7f6e74004770 comp rx=0 tx=0).stop 2023-11-28T11:59:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.093+0000 7f6e8b59e700 1 -- 172.21.15.50:0/2432231584 shutdown_connections 2023-11-28T11:59:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.093+0000 7f6e8b59e700 1 --2- 172.21.15.50:0/2432231584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e8c09b500 0x7f6e8c0c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.093+0000 7f6e8b59e700 1 --2- 172.21.15.50:0/2432231584 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6e6c064f10 0x7f6e6c0673c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.093+0000 7f6e8b59e700 1 --2- 172.21.15.50:0/2432231584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e8c0cbb30 0x7f6e8c159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.093+0000 7f6e8b59e700 1 --2- 172.21.15.50:0/2432231584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e8c09bdb0 0x7f6e8c155f50 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.093+0000 7f6e8b59e700 1 -- 172.21.15.50:0/2432231584 >> 172.21.15.50:0/2432231584 conn(0x7f6e8c0cae70 msgr2=0x7f6e8c0cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.093+0000 7f6e8b59e700 1 -- 172.21.15.50:0/2432231584 shutdown_connections 2023-11-28T11:59:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.093+0000 7f6e8b59e700 1 -- 172.21.15.50:0/2432231584 wait complete. 2023-11-28T11:59:15.112 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T11:59:15.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.221+0000 7f66c090a700 1 Processor -- start 2023-11-28T11:59:15.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.221+0000 7f66c090a700 1 -- start start 2023-11-28T11:59:15.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66c090a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f66bc158850 0x7f66bc0c9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66c090a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f66bc0cd3a0 0x7f66bc0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66c090a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66bc06a4d0 con 0x7f66bc158480 2023-11-28T11:59:15.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66c090a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66bc0cc490 con 0x7f66bc158850 2023-11-28T11:59:15.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66c090a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66bc06a720 con 0x7f66bc0cd3a0 2023-11-28T11:59:15.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66bb7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f66bc158480 0x7f66bc0cbcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58692/0 (socket says 172.21.15.50:58692) 2023-11-28T11:59:15.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66bb7fe700 1 -- 172.21.15.50:0/2111301674 learned_addr learned my addr 172.21.15.50:0/2111301674 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:15.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66baffd700 1 --2- 172.21.15.50:0/2111301674 >> v2:172.21.15.50:3300/0 conn(0x7f66bc158850 0x7f66bc0c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66bbfff700 1 --2- 172.21.15.50:0/2111301674 >> v2:172.21.15.192:3300/0 conn(0x7f66bc0cd3a0 0x7f66bc0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66ba7fc700 1 -- 172.21.15.50:0/2111301674 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929947049 0 0) 0x7f66bc06a4d0 con 0x7f66bc158480 2023-11-28T11:59:15.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66ba7fc700 1 -- 172.21.15.50:0/2111301674 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66a40057e0 con 0x7f66bc158480 2023-11-28T11:59:15.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66baffd700 1 -- 172.21.15.50:0/2111301674 >> v2:172.21.15.192:3300/0 conn(0x7f66bc0cd3a0 msgr2=0x7f66bc0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:15.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66ba7fc700 1 -- 172.21.15.50:0/2111301674 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1789022753 0 0) 0x7f66a40057e0 con 0x7f66bc158480 2023-11-28T11:59:15.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66baffd700 1 --2- 172.21.15.50:0/2111301674 >> v2:172.21.15.192:3300/0 conn(0x7f66bc0cd3a0 0x7f66bc0ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66baffd700 1 -- 172.21.15.50:0/2111301674 >> v1:172.21.15.50:6789/0 conn(0x7f66bc158480 legacy=0x7f66bc0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:15.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66baffd700 1 -- 172.21.15.50:0/2111301674 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc06aa00 con 0x7f66bc158850 2023-11-28T11:59:15.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66baffd700 1 --2- 172.21.15.50:0/2111301674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66bc158850 0x7f66bc0c9410 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f66bc15d2c0 tx=0x7f66b000acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfac19f319409c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:15.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66ba7fc700 1 -- 172.21.15.50:0/2111301674 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac001b70 con 0x7f66bc158850 2023-11-28T11:59:15.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66ba7fc700 1 -- 172.21.15.50:0/2111301674 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b000ae00 con 0x7f66bc158850 2023-11-28T11:59:15.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.225+0000 7f66ba7fc700 1 -- 172.21.15.50:0/2111301674 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b0004230 con 0x7f66bc158850 2023-11-28T11:59:15.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.229+0000 7f66c090a700 1 -- 172.21.15.50:0/2111301674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66bc158850 msgr2=0x7f66bc0c9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:15.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.229+0000 7f66c090a700 1 --2- 172.21.15.50:0/2111301674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66bc158850 0x7f66bc0c9410 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f66bc15d2c0 tx=0x7f66b000acd0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.229+0000 7f66c090a700 1 -- 172.21.15.50:0/2111301674 shutdown_connections 2023-11-28T11:59:15.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.229+0000 7f66c090a700 1 --2- 172.21.15.50:0/2111301674 >> v2:172.21.15.192:3300/0 conn(0x7f66bc0cd3a0 0x7f66bc0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.229+0000 7f66c090a700 1 --2- 172.21.15.50:0/2111301674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66bc158850 0x7f66bc0c9410 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.229+0000 7f66c090a700 1 -- 172.21.15.50:0/2111301674 >> 172.21.15.50:0/2111301674 conn(0x7f66bc06c660 msgr2=0x7f66bc06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:15.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.229+0000 7f66c090a700 1 -- 172.21.15.50:0/2111301674 shutdown_connections 2023-11-28T11:59:15.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.229+0000 7f66c090a700 1 -- 172.21.15.50:0/2111301674 wait complete. 2023-11-28T11:59:15.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.229+0000 7f66c090a700 1 Processor -- start 2023-11-28T11:59:15.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.229+0000 7f66c090a700 1 -- start start 2023-11-28T11:59:15.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66c090a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66bc0cd3a0 0x7f66bc0c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66c090a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66bc158480 0x7f66bc0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66c090a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66bc158850 0x7f66bc153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66c090a700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc0b4be0 con 0x7f66bc158850 2023-11-28T11:59:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66c090a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc145b40 con 0x7f66bc158480 2023-11-28T11:59:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66c090a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc145e20 con 0x7f66bc0cd3a0 2023-11-28T11:59:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66bbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66bc158850 0x7f66bc153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66bbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66bc158850 0x7f66bc153270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44124/0 (socket says 172.21.15.50:44124) 2023-11-28T11:59:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66bbfff700 1 -- 172.21.15.50:0/739691621 learned_addr learned my addr 172.21.15.50:0/739691621 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:15.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66bb7fe700 1 --2- 172.21.15.50:0/739691621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66bc0cd3a0 0x7f66bc0c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66baffd700 1 --2- 172.21.15.50:0/739691621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66bc158480 0x7f66bc0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66bbfff700 1 -- 172.21.15.50:0/739691621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66bc0cd3a0 msgr2=0x7f66bc0c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:15.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66bbfff700 1 --2- 172.21.15.50:0/739691621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66bc0cd3a0 0x7f66bc0c5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66bbfff700 1 -- 172.21.15.50:0/739691621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66bc158480 msgr2=0x7f66bc0b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:15.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66bbfff700 1 --2- 172.21.15.50:0/739691621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66bc158480 0x7f66bc0b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66bbfff700 1 -- 172.21.15.50:0/739691621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b000a650 con 0x7f66bc158850 2023-11-28T11:59:15.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66bbfff700 1 --2- 172.21.15.50:0/739691621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66bc158850 0x7f66bc153270 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f66b400eb60 tx=0x7f66b400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:15.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66a3fff700 1 -- 172.21.15.50:0/739691621 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4009740 con 0x7f66bc158850 2023-11-28T11:59:15.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66a3fff700 1 -- 172.21.15.50:0/739691621 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b4009e00 con 0x7f66bc158850 2023-11-28T11:59:15.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66c090a700 1 -- 172.21.15.50:0/739691621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66bc0c9950 con 0x7f66bc158850 2023-11-28T11:59:15.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66a3fff700 1 -- 172.21.15.50:0/739691621 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b400ca70 con 0x7f66bc158850 2023-11-28T11:59:15.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.233+0000 7f66c090a700 1 -- 172.21.15.50:0/739691621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66bc06ace0 con 0x7f66bc158850 2023-11-28T11:59:15.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.237+0000 7f66c090a700 1 -- 172.21.15.50:0/739691621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66bc0cf1e0 con 0x7f66bc158850 2023-11-28T11:59:15.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.237+0000 7f66a3fff700 1 -- 172.21.15.50:0/739691621 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f66b4019030 con 0x7f66bc158850 2023-11-28T11:59:15.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.237+0000 7f66a3fff700 1 --2- 172.21.15.50:0/739691621 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f66a8064ee0 0x7f66a8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.237+0000 7f66a3fff700 1 -- 172.21.15.50:0/739691621 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f66b4081f20 con 0x7f66bc158850 2023-11-28T11:59:15.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.237+0000 7f66bb7fe700 1 --2- 172.21.15.50:0/739691621 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f66a8064ee0 0x7f66a8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.237+0000 7f66bb7fe700 1 --2- 172.21.15.50:0/739691621 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f66a8064ee0 0x7f66a8067390 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f66ac001270 tx=0x7f66ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:15.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.241+0000 7f66a3fff700 1 -- 172.21.15.50:0/739691621 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f66b404fe50 con 0x7f66bc158850 2023-11-28T11:59:15.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.405+0000 7f66c090a700 1 -- 172.21.15.50:0/739691621 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f66bc072c20 con 0x7f66bc158850 2023-11-28T11:59:15.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.405+0000 7f66a3fff700 1 -- 172.21.15.50:0/739691621 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7f66b4053470 con 0x7f66bc158850 2023-11-28T11:59:15.410 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-11-28T11:59:15.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.409+0000 7f66c090a700 1 -- 172.21.15.50:0/739691621 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f66a8064ee0 msgr2=0x7f66a8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:15.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.409+0000 7f66c090a700 1 --2- 172.21.15.50:0/739691621 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f66a8064ee0 0x7f66a8067390 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f66ac001270 tx=0x7f66ac009040 comp rx=0 tx=0).stop 2023-11-28T11:59:15.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.409+0000 7f66c090a700 1 -- 172.21.15.50:0/739691621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66bc158850 msgr2=0x7f66bc153270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:15.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.409+0000 7f66c090a700 1 --2- 172.21.15.50:0/739691621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66bc158850 0x7f66bc153270 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f66b400eb60 tx=0x7f66b400ee70 comp rx=0 tx=0).stop 2023-11-28T11:59:15.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.409+0000 7f66c090a700 1 -- 172.21.15.50:0/739691621 shutdown_connections 2023-11-28T11:59:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.409+0000 7f66c090a700 1 --2- 172.21.15.50:0/739691621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66bc158850 0x7f66bc153270 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.409+0000 7f66c090a700 1 --2- 172.21.15.50:0/739691621 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f66a8064ee0 0x7f66a8067390 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.409+0000 7f66c090a700 1 --2- 172.21.15.50:0/739691621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66bc158480 0x7f66bc0b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.409+0000 7f66c090a700 1 --2- 172.21.15.50:0/739691621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66bc0cd3a0 0x7f66bc0c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.409+0000 7f66c090a700 1 -- 172.21.15.50:0/739691621 >> 172.21.15.50:0/739691621 conn(0x7f66bc06c660 msgr2=0x7f66bc06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.409+0000 7f66c090a700 1 -- 172.21.15.50:0/739691621 shutdown_connections 2023-11-28T11:59:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.409+0000 7f66c090a700 1 -- 172.21.15.50:0/739691621 wait complete. 2023-11-28T11:59:15.425 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T11:59:15.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.541+0000 7f88d759e700 1 Processor -- start 2023-11-28T11:59:15.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.541+0000 7f88d759e700 1 -- start start 2023-11-28T11:59:15.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d759e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88d8159fa0 0x7f88d80b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f88d80cd710 0x7f88d80cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d815a370 con 0x7f88d80b1300 2023-11-28T11:59:15.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d80cf770 con 0x7f88d80cd710 2023-11-28T11:59:15.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d759e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d80cff70 con 0x7f88d8159fa0 2023-11-28T11:59:15.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d5d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f88d80b1300 0x7f88d80cd000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58694/0 (socket says 172.21.15.50:58694) 2023-11-28T11:59:15.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d5d9b700 1 -- 172.21.15.50:0/779157292 learned_addr learned my addr 172.21.15.50:0/779157292 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:15.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d6d9d700 1 --2- 172.21.15.50:0/779157292 >> v2:172.21.15.50:3300/0 conn(0x7f88d80cd710 0x7f88d80cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d659c700 1 --2- 172.21.15.50:0/779157292 >> v2:172.21.15.192:3300/0 conn(0x7f88d8159fa0 0x7f88d80b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d559a700 1 -- 172.21.15.50:0/779157292 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542519117 0 0) 0x7f88d815a370 con 0x7f88d80b1300 2023-11-28T11:59:15.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d559a700 1 -- 172.21.15.50:0/779157292 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88c40035d0 con 0x7f88d80b1300 2023-11-28T11:59:15.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d6d9d700 1 -- 172.21.15.50:0/779157292 >> v2:172.21.15.192:3300/0 conn(0x7f88d8159fa0 msgr2=0x7f88d80b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:15.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d6d9d700 1 --2- 172.21.15.50:0/779157292 >> v2:172.21.15.192:3300/0 conn(0x7f88d8159fa0 0x7f88d80b34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d6d9d700 1 -- 172.21.15.50:0/779157292 >> v1:172.21.15.50:6789/0 conn(0x7f88d80b1300 legacy=0x7f88d80cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:15.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d6d9d700 1 -- 172.21.15.50:0/779157292 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d80d0250 con 0x7f88d80cd710 2023-11-28T11:59:15.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d6d9d700 1 --2- 172.21.15.50:0/779157292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d80cd710 0x7f88d80cf230 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f88d80ce190 tx=0x7f88d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b85834be6c887e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:15.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d559a700 1 -- 172.21.15.50:0/779157292 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d000e070 con 0x7f88d80cd710 2023-11-28T11:59:15.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d559a700 1 -- 172.21.15.50:0/779157292 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d000bb20 con 0x7f88d80cd710 2023-11-28T11:59:15.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d559a700 1 -- 172.21.15.50:0/779157292 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d0012430 con 0x7f88d80cd710 2023-11-28T11:59:15.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d759e700 1 -- 172.21.15.50:0/779157292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d80cd710 msgr2=0x7f88d80cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:15.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d759e700 1 --2- 172.21.15.50:0/779157292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d80cd710 0x7f88d80cf230 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f88d80ce190 tx=0x7f88d000b330 comp rx=0 tx=0).stop 2023-11-28T11:59:15.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d759e700 1 -- 172.21.15.50:0/779157292 shutdown_connections 2023-11-28T11:59:15.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d759e700 1 --2- 172.21.15.50:0/779157292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d80cd710 0x7f88d80cf230 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d759e700 1 --2- 172.21.15.50:0/779157292 >> v2:172.21.15.192:3300/0 conn(0x7f88d8159fa0 0x7f88d80b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d759e700 1 -- 172.21.15.50:0/779157292 >> 172.21.15.50:0/779157292 conn(0x7f88d80b2180 msgr2=0x7f88d80b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:15.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d759e700 1 -- 172.21.15.50:0/779157292 shutdown_connections 2023-11-28T11:59:15.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.545+0000 7f88d759e700 1 -- 172.21.15.50:0/779157292 wait complete. 2023-11-28T11:59:15.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d759e700 1 Processor -- start 2023-11-28T11:59:15.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d759e700 1 -- start start 2023-11-28T11:59:15.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d80b1300 0x7f88d8155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d80cd710 0x7f88d80c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88d8159fa0 0x7f88d81f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d81f2380 con 0x7f88d80cd710 2023-11-28T11:59:15.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d759e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d80c7720 con 0x7f88d8159fa0 2023-11-28T11:59:15.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d80ca3e0 con 0x7f88d80b1300 2023-11-28T11:59:15.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d80cd710 0x7f88d80c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d5d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d80cd710 0x7f88d80c9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44128/0 (socket says 172.21.15.50:44128) 2023-11-28T11:59:15.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d5d9b700 1 -- 172.21.15.50:0/179948553 learned_addr learned my addr 172.21.15.50:0/179948553 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:15.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d6d9d700 1 --2- 172.21.15.50:0/179948553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88d8159fa0 0x7f88d81f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d659c700 1 --2- 172.21.15.50:0/179948553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d80b1300 0x7f88d8155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d5d9b700 1 -- 172.21.15.50:0/179948553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d80b1300 msgr2=0x7f88d8155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:15.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d5d9b700 1 --2- 172.21.15.50:0/179948553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d80b1300 0x7f88d8155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d5d9b700 1 -- 172.21.15.50:0/179948553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88d8159fa0 msgr2=0x7f88d81f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:15.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d5d9b700 1 --2- 172.21.15.50:0/179948553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88d8159fa0 0x7f88d81f1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.549+0000 7f88d5d9b700 1 -- 172.21.15.50:0/179948553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d0009a70 con 0x7f88d80cd710 2023-11-28T11:59:15.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.553+0000 7f88d5d9b700 1 --2- 172.21.15.50:0/179948553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d80cd710 0x7f88d80c9cd0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f88c000c700 tx=0x7f88c000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:15.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.553+0000 7f88ceffd700 1 -- 172.21.15.50:0/179948553 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0005d90 con 0x7f88d80cd710 2023-11-28T11:59:15.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.553+0000 7f88ceffd700 1 -- 172.21.15.50:0/179948553 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c00070d0 con 0x7f88d80cd710 2023-11-28T11:59:15.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.553+0000 7f88d759e700 1 -- 172.21.15.50:0/179948553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d80afd80 con 0x7f88d80cd710 2023-11-28T11:59:15.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.553+0000 7f88ceffd700 1 -- 172.21.15.50:0/179948553 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0007480 con 0x7f88d80cd710 2023-11-28T11:59:15.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.553+0000 7f88d759e700 1 -- 172.21.15.50:0/179948553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d80afaa0 con 0x7f88d80cd710 2023-11-28T11:59:15.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.553+0000 7f88d759e700 1 -- 172.21.15.50:0/179948553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d80b0060 con 0x7f88d80cd710 2023-11-28T11:59:15.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.553+0000 7f88ceffd700 1 -- 172.21.15.50:0/179948553 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f88c0019030 con 0x7f88d80cd710 2023-11-28T11:59:15.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.553+0000 7f88ceffd700 1 --2- 172.21.15.50:0/179948553 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f88b8064f10 0x7f88b80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.553+0000 7f88ceffd700 1 -- 172.21.15.50:0/179948553 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f88c00812e0 con 0x7f88d80cd710 2023-11-28T11:59:15.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.557+0000 7f88d659c700 1 --2- 172.21.15.50:0/179948553 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f88b8064f10 0x7f88b80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.557+0000 7f88d659c700 1 --2- 172.21.15.50:0/179948553 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f88b8064f10 0x7f88b80673c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f88d80cbbc0 tx=0x7f88c8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:15.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.561+0000 7f88ceffd700 1 -- 172.21.15.50:0/179948553 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f88c004f2a0 con 0x7f88d80cd710 2023-11-28T11:59:15.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.721+0000 7f88d759e700 1 -- 172.21.15.50:0/179948553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f88d8072500 con 0x7f88d80cd710 2023-11-28T11:59:15.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.721+0000 7f88ceffd700 1 -- 172.21.15.50:0/179948553 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7f88c00528c0 con 0x7f88d80cd710 2023-11-28T11:59:15.725 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-11-28T11:59:15.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.721+0000 7f88d759e700 1 -- 172.21.15.50:0/179948553 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f88b8064f10 msgr2=0x7f88b80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:15.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.721+0000 7f88d759e700 1 --2- 172.21.15.50:0/179948553 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f88b8064f10 0x7f88b80673c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f88d80cbbc0 tx=0x7f88c8009240 comp rx=0 tx=0).stop 2023-11-28T11:59:15.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.721+0000 7f88d759e700 1 -- 172.21.15.50:0/179948553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d80cd710 msgr2=0x7f88d80c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:15.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.721+0000 7f88d759e700 1 --2- 172.21.15.50:0/179948553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d80cd710 0x7f88d80c9cd0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f88c000c700 tx=0x7f88c000ca10 comp rx=0 tx=0).stop 2023-11-28T11:59:15.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.721+0000 7f88d759e700 1 -- 172.21.15.50:0/179948553 shutdown_connections 2023-11-28T11:59:15.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.721+0000 7f88d759e700 1 --2- 172.21.15.50:0/179948553 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f88b8064f10 0x7f88b80673c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.725+0000 7f88d759e700 1 --2- 172.21.15.50:0/179948553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88d8159fa0 0x7f88d81f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.725+0000 7f88d759e700 1 --2- 172.21.15.50:0/179948553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d80cd710 0x7f88d80c9cd0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.725+0000 7f88d759e700 1 --2- 172.21.15.50:0/179948553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d80b1300 0x7f88d8155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.725+0000 7f88d759e700 1 -- 172.21.15.50:0/179948553 >> 172.21.15.50:0/179948553 conn(0x7f88d80b2180 msgr2=0x7f88d80b0480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:15.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.725+0000 7f88d759e700 1 -- 172.21.15.50:0/179948553 shutdown_connections 2023-11-28T11:59:15.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.725+0000 7f88d759e700 1 -- 172.21.15.50:0/179948553 wait complete. 2023-11-28T11:59:15.739 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:59:15.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d5564c700 1 Processor -- start 2023-11-28T11:59:15.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d5564c700 1 -- start start 2023-11-28T11:59:15.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d5564c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d50160680 0x7f3d50071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d5564c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d50069c40 0x7f3d500cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d5564c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3d500b0c30 0x7f3d500cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d5564c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d500cc420 con 0x7f3d50160680 2023-11-28T11:59:15.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d5564c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d500cc6c0 con 0x7f3d500b0c30 2023-11-28T11:59:15.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d5564c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d500cc9a0 con 0x7f3d50069c40 2023-11-28T11:59:15.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d4effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d50160680 0x7f3d50071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d4e7fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d50069c40 0x7f3d500cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d4effd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d50160680 0x7f3d50071260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44140/0 (socket says 172.21.15.50:44140) 2023-11-28T11:59:15.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d4f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3d500b0c30 0x7f3d500cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d4e7fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d50069c40 0x7f3d500cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:53428/0 (socket says 172.21.15.50:53428) 2023-11-28T11:59:15.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d4effd700 1 -- 172.21.15.50:0/3920692843 learned_addr learned my addr 172.21.15.50:0/3920692843 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:15.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d4e7fc700 1 -- 172.21.15.50:0/3920692843 >> v2:172.21.15.192:3300/0 conn(0x7f3d500b0c30 msgr2=0x7f3d500cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:15.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d4e7fc700 1 --2- 172.21.15.50:0/3920692843 >> v2:172.21.15.192:3300/0 conn(0x7f3d500b0c30 0x7f3d500cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d4e7fc700 1 -- 172.21.15.50:0/3920692843 >> v2:172.21.15.50:3300/0 conn(0x7f3d50160680 msgr2=0x7f3d50071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:15.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d4e7fc700 1 --2- 172.21.15.50:0/3920692843 >> v2:172.21.15.50:3300/0 conn(0x7f3d50160680 0x7f3d50071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d4e7fc700 1 -- 172.21.15.50:0/3920692843 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d500705c0 con 0x7f3d50069c40 2023-11-28T11:59:15.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d4effd700 1 --2- 172.21.15.50:0/3920692843 >> v2:172.21.15.50:3300/0 conn(0x7f3d50160680 0x7f3d50071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:15.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d4e7fc700 1 --2- 172.21.15.50:0/3920692843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d50069c40 0x7f3d500cced0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3d500c8d90 tx=0x7f3d38009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ca8740bfc15151c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:15.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d4dffb700 1 -- 172.21.15.50:0/3920692843 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38011830 con 0x7f3d50069c40 2023-11-28T11:59:15.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d4dffb700 1 -- 172.21.15.50:0/3920692843 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d38011990 con 0x7f3d50069c40 2023-11-28T11:59:15.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.853+0000 7f3d4dffb700 1 -- 172.21.15.50:0/3920692843 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38011d20 con 0x7f3d50069c40 2023-11-28T11:59:15.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.857+0000 7f3d5564c700 1 -- 172.21.15.50:0/3920692843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d50069c40 msgr2=0x7f3d500cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:15.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.857+0000 7f3d5564c700 1 --2- 172.21.15.50:0/3920692843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d50069c40 0x7f3d500cced0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3d500c8d90 tx=0x7f3d38009b30 comp rx=0 tx=0).stop 2023-11-28T11:59:15.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.857+0000 7f3d5564c700 1 -- 172.21.15.50:0/3920692843 shutdown_connections 2023-11-28T11:59:15.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.857+0000 7f3d5564c700 1 --2- 172.21.15.50:0/3920692843 >> v2:172.21.15.192:3300/0 conn(0x7f3d500b0c30 0x7f3d500cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.857+0000 7f3d5564c700 1 --2- 172.21.15.50:0/3920692843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d50069c40 0x7f3d500cced0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.857+0000 7f3d5564c700 1 --2- 172.21.15.50:0/3920692843 >> v2:172.21.15.50:3300/0 conn(0x7f3d50160680 0x7f3d50071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.857+0000 7f3d5564c700 1 -- 172.21.15.50:0/3920692843 >> 172.21.15.50:0/3920692843 conn(0x7f3d5006caf0 msgr2=0x7f3d500ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:15.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.857+0000 7f3d5564c700 1 -- 172.21.15.50:0/3920692843 shutdown_connections 2023-11-28T11:59:15.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.857+0000 7f3d5564c700 1 -- 172.21.15.50:0/3920692843 wait complete. 2023-11-28T11:59:15.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d5564c700 1 Processor -- start 2023-11-28T11:59:15.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d5564c700 1 -- start start 2023-11-28T11:59:15.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d5564c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d50069c40 0x7f3d50159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d5564c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d500b0c30 0x7f3d50161740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d5564c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d50160680 0x7f3d500b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d5564c700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d500c5880 con 0x7f3d50069c40 2023-11-28T11:59:15.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d5564c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5015a2e0 con 0x7f3d500b0c30 2023-11-28T11:59:15.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d5564c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d500c5ad0 con 0x7f3d50160680 2023-11-28T11:59:15.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d4effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d50069c40 0x7f3d50159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d4effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d50069c40 0x7f3d50159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44148/0 (socket says 172.21.15.50:44148) 2023-11-28T11:59:15.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d4effd700 1 -- 172.21.15.50:0/1183515347 learned_addr learned my addr 172.21.15.50:0/1183515347 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:15.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d4f7fe700 1 --2- 172.21.15.50:0/1183515347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d50160680 0x7f3d500b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d4e7fc700 1 --2- 172.21.15.50:0/1183515347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d500b0c30 0x7f3d50161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d4effd700 1 -- 172.21.15.50:0/1183515347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d50160680 msgr2=0x7f3d500b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d4effd700 1 --2- 172.21.15.50:0/1183515347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d50160680 0x7f3d500b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d4effd700 1 -- 172.21.15.50:0/1183515347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d500b0c30 msgr2=0x7f3d50161740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d4effd700 1 --2- 172.21.15.50:0/1183515347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d500b0c30 0x7f3d50161740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d4effd700 1 -- 172.21.15.50:0/1183515347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40009570 con 0x7f3d50069c40 2023-11-28T11:59:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d4e7fc700 1 --2- 172.21.15.50:0/1183515347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d500b0c30 0x7f3d50161740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d4effd700 1 --2- 172.21.15.50:0/1183515347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d50069c40 0x7f3d50159da0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000e9d0 tx=0x7f3d4000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d477fe700 1 -- 172.21.15.50:0/1183515347 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4000c850 con 0x7f3d50069c40 2023-11-28T11:59:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d477fe700 1 -- 172.21.15.50:0/1183515347 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4000c9b0 con 0x7f3d50069c40 2023-11-28T11:59:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.861+0000 7f3d5564c700 1 -- 172.21.15.50:0/1183515347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d380094b0 con 0x7f3d50069c40 2023-11-28T11:59:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.865+0000 7f3d477fe700 1 -- 172.21.15.50:0/1183515347 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4000cd20 con 0x7f3d50069c40 2023-11-28T11:59:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.865+0000 7f3d5564c700 1 -- 172.21.15.50:0/1183515347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d500c9750 con 0x7f3d50069c40 2023-11-28T11:59:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.865+0000 7f3d5564c700 1 -- 172.21.15.50:0/1183515347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d50071940 con 0x7f3d50069c40 2023-11-28T11:59:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.865+0000 7f3d477fe700 1 -- 172.21.15.50:0/1183515347 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3d40019030 con 0x7f3d50069c40 2023-11-28T11:59:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.865+0000 7f3d477fe700 1 --2- 172.21.15.50:0/1183515347 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d30064ee0 0x7f3d30067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.865+0000 7f3d477fe700 1 -- 172.21.15.50:0/1183515347 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f3d40081bf0 con 0x7f3d50069c40 2023-11-28T11:59:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.865+0000 7f3d4e7fc700 1 --2- 172.21.15.50:0/1183515347 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d30064ee0 0x7f3d30067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.869+0000 7f3d4e7fc700 1 --2- 172.21.15.50:0/1183515347 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d30064ee0 0x7f3d30067390 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3d38000c00 tx=0x7f3d38008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:15.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:15.869+0000 7f3d477fe700 1 -- 172.21.15.50:0/1183515347 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3d4004fc10 con 0x7f3d50069c40 2023-11-28T11:59:16.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.073+0000 7f3d5564c700 1 -- 172.21.15.50:0/1183515347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d50160a50 con 0x7f3d50069c40 2023-11-28T11:59:16.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.073+0000 7f3d477fe700 1 -- 172.21.15.50:0/1183515347 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f3d40053230 con 0x7f3d50069c40 2023-11-28T11:59:16.077 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:59:16.077 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1573599194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1573599194},{"type":"v1","addr":"172.21.15.192:6836","nonce":1573599194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6445,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/983935617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":983935617},{"type":"v1","addr":"172.21.15.192:6837","nonce":983935617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2516263109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2516263109},{"type":"v1","addr":"172.21.15.50:6833","nonce":2516263109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:56:40.385672+0000","modified":"2023-11-28T11:56:56.456234+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":7,"addr":"172.21.15.50:6835/3894924751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3894924751},{"type":"v1","addr":"172.21.15.50:6835","nonce":3894924751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:59:16.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.077+0000 7f3d5564c700 1 -- 172.21.15.50:0/1183515347 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d30064ee0 msgr2=0x7f3d30067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.077+0000 7f3d5564c700 1 --2- 172.21.15.50:0/1183515347 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d30064ee0 0x7f3d30067390 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3d38000c00 tx=0x7f3d38008030 comp rx=0 tx=0).stop 2023-11-28T11:59:16.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.077+0000 7f3d5564c700 1 -- 172.21.15.50:0/1183515347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d50069c40 msgr2=0x7f3d50159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.077+0000 7f3d5564c700 1 --2- 172.21.15.50:0/1183515347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d50069c40 0x7f3d50159da0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000e9d0 tx=0x7f3d4000ece0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.077+0000 7f3d5564c700 1 -- 172.21.15.50:0/1183515347 shutdown_connections 2023-11-28T11:59:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.077+0000 7f3d5564c700 1 --2- 172.21.15.50:0/1183515347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d50160680 0x7f3d500b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.077+0000 7f3d5564c700 1 --2- 172.21.15.50:0/1183515347 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3d30064ee0 0x7f3d30067390 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.077+0000 7f3d5564c700 1 --2- 172.21.15.50:0/1183515347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d500b0c30 0x7f3d50161740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.077+0000 7f3d5564c700 1 --2- 172.21.15.50:0/1183515347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d50069c40 0x7f3d50159da0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.077+0000 7f3d5564c700 1 -- 172.21.15.50:0/1183515347 >> 172.21.15.50:0/1183515347 conn(0x7f3d5006caf0 msgr2=0x7f3d500c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:16.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.077+0000 7f3d5564c700 1 -- 172.21.15.50:0/1183515347 shutdown_connections 2023-11-28T11:59:16.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.077+0000 7f3d5564c700 1 -- 172.21.15.50:0/1183515347 wait complete. 2023-11-28T11:59:16.084 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 32 2023-11-28T11:59:16.094 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:59:16.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.201+0000 7fc71cb03700 1 Processor -- start 2023-11-28T11:59:16.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.201+0000 7fc71cb03700 1 -- start start 2023-11-28T11:59:16.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc71cb03700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc718159e70 0x7fc71806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:16.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc71cb03700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc718069c40 0x7fc7180cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:16.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc71cb03700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc71806ace0 con 0x7fc71806cee0 2023-11-28T11:59:16.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc71cb03700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc71806a0d0 con 0x7fc718159e70 2023-11-28T11:59:16.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc71cb03700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71806a3b0 con 0x7fc718069c40 2023-11-28T11:59:16.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc7177fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc718159e70 0x7fc71806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:16.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc716ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc718069c40 0x7fc7180cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:16.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc717fff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fc71806cee0 0x7fc7180b32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:52066/0 (socket says 172.21.15.50:52066) 2023-11-28T11:59:16.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc717fff700 1 -- 172.21.15.50:0/2924672882 learned_addr learned my addr 172.21.15.50:0/2924672882 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:16.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc716ffd700 1 -- 172.21.15.50:0/2924672882 >> v2:172.21.15.192:3300/0 conn(0x7fc718159e70 msgr2=0x7fc71806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:16.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc716ffd700 1 --2- 172.21.15.50:0/2924672882 >> v2:172.21.15.192:3300/0 conn(0x7fc718159e70 0x7fc71806c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc716ffd700 1 -- 172.21.15.50:0/2924672882 >> v1:172.21.15.192:6789/0 conn(0x7fc71806cee0 legacy=0x7fc7180b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc716ffd700 1 -- 172.21.15.50:0/2924672882 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71806a690 con 0x7fc718069c40 2023-11-28T11:59:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc7167fc700 1 -- 172.21.15.50:0/2924672882 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942819365 0 0) 0x7fc71806ace0 con 0x7fc71806cee0 2023-11-28T11:59:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc716ffd700 1 --2- 172.21.15.50:0/2924672882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc718069c40 0x7fc7180cad60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc708009850 tx=0x7fc708009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b88773f4a795b58 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc7167fc700 1 -- 172.21.15.50:0/2924672882 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708011830 con 0x7fc718069c40 2023-11-28T11:59:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc7167fc700 1 -- 172.21.15.50:0/2924672882 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc708011990 con 0x7fc718069c40 2023-11-28T11:59:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc7167fc700 1 -- 172.21.15.50:0/2924672882 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708011d40 con 0x7fc718069c40 2023-11-28T11:59:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc71cb03700 1 -- 172.21.15.50:0/2924672882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc718069c40 msgr2=0x7fc7180cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc71cb03700 1 --2- 172.21.15.50:0/2924672882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc718069c40 0x7fc7180cad60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc708009850 tx=0x7fc708009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc71cb03700 1 -- 172.21.15.50:0/2924672882 shutdown_connections 2023-11-28T11:59:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc71cb03700 1 --2- 172.21.15.50:0/2924672882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc718069c40 0x7fc7180cad60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc71cb03700 1 --2- 172.21.15.50:0/2924672882 >> v2:172.21.15.192:3300/0 conn(0x7fc718159e70 0x7fc71806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc71cb03700 1 -- 172.21.15.50:0/2924672882 >> 172.21.15.50:0/2924672882 conn(0x7fc7180ce3e0 msgr2=0x7fc7180ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc71cb03700 1 -- 172.21.15.50:0/2924672882 shutdown_connections 2023-11-28T11:59:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.205+0000 7fc71cb03700 1 -- 172.21.15.50:0/2924672882 wait complete. 2023-11-28T11:59:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc71cb03700 1 Processor -- start 2023-11-28T11:59:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc71cb03700 1 -- start start 2023-11-28T11:59:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc71cb03700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc718069c40 0x7fc7181f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc71cb03700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc71806cee0 0x7fc71815a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc71cb03700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc718159e70 0x7fc71815a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc71cb03700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180c4880 con 0x7fc71806cee0 2023-11-28T11:59:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc71cb03700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180c3c00 con 0x7fc718069c40 2023-11-28T11:59:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc71cb03700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180c3ee0 con 0x7fc718159e70 2023-11-28T11:59:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc716ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc71806cee0 0x7fc71815a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc716ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc71806cee0 0x7fc71815a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44152/0 (socket says 172.21.15.50:44152) 2023-11-28T11:59:16.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc716ffd700 1 -- 172.21.15.50:0/636224484 learned_addr learned my addr 172.21.15.50:0/636224484 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:16.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc717fff700 1 --2- 172.21.15.50:0/636224484 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc718159e70 0x7fc71815a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:16.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc7177fe700 1 --2- 172.21.15.50:0/636224484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc718069c40 0x7fc7181f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:16.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc716ffd700 1 -- 172.21.15.50:0/636224484 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc718159e70 msgr2=0x7fc71815a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc716ffd700 1 --2- 172.21.15.50:0/636224484 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc718159e70 0x7fc71815a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc716ffd700 1 -- 172.21.15.50:0/636224484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc718069c40 msgr2=0x7fc7181f0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc716ffd700 1 --2- 172.21.15.50:0/636224484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc718069c40 0x7fc7181f0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc716ffd700 1 -- 172.21.15.50:0/636224484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7080094b0 con 0x7fc71806cee0 2023-11-28T11:59:16.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc716ffd700 1 --2- 172.21.15.50:0/636224484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc71806cee0 0x7fc71815a3d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc708000c00 tx=0x7fc708004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:16.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc6fffff700 1 -- 172.21.15.50:0/636224484 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70801aac0 con 0x7fc71806cee0 2023-11-28T11:59:16.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc6fffff700 1 -- 172.21.15.50:0/636224484 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70801f070 con 0x7fc71806cee0 2023-11-28T11:59:16.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc71cb03700 1 -- 172.21.15.50:0/636224484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc71815a240 con 0x7fc71806cee0 2023-11-28T11:59:16.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc6fffff700 1 -- 172.21.15.50:0/636224484 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70801ae60 con 0x7fc71806cee0 2023-11-28T11:59:16.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc71cb03700 1 -- 172.21.15.50:0/636224484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71806a970 con 0x7fc71806cee0 2023-11-28T11:59:16.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.209+0000 7fc71cb03700 1 -- 172.21.15.50:0/636224484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7180ca1e0 con 0x7fc71806cee0 2023-11-28T11:59:16.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.213+0000 7fc6fffff700 1 -- 172.21.15.50:0/636224484 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc70800f050 con 0x7fc71806cee0 2023-11-28T11:59:16.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.213+0000 7fc6fffff700 1 --2- 172.21.15.50:0/636224484 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc704064ee0 0x7fc704067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:16.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.213+0000 7fc6fffff700 1 -- 172.21.15.50:0/636224484 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc7080831a0 con 0x7fc71806cee0 2023-11-28T11:59:16.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.213+0000 7fc7177fe700 1 --2- 172.21.15.50:0/636224484 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc704064ee0 0x7fc704067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:16.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.213+0000 7fc7177fe700 1 --2- 172.21.15.50:0/636224484 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc704064ee0 0x7fc704067390 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009ae0 tx=0x7fc70c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:16.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.217+0000 7fc6fffff700 1 -- 172.21.15.50:0/636224484 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc7080511c0 con 0x7fc71806cee0 2023-11-28T11:59:16.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.381+0000 7fc71cb03700 1 -- 172.21.15.50:0/636224484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc718072500 con 0x7fc71806cee0 2023-11-28T11:59:16.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.385+0000 7fc6fffff700 1 -- 172.21.15.50:0/636224484 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+18126 (secure 0 0 0) 0x7fc708021090 con 0x7fc71806cee0 2023-11-28T11:59:16.387 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:59:16.387 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":68,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:57:31.028964+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.943405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:39.374123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.14","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:59:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.385+0000 7fc71cb03700 1 -- 172.21.15.50:0/636224484 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc704064ee0 msgr2=0x7fc704067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.385+0000 7fc71cb03700 1 --2- 172.21.15.50:0/636224484 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc704064ee0 0x7fc704067390 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009ae0 tx=0x7fc70c008040 comp rx=0 tx=0).stop 2023-11-28T11:59:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.385+0000 7fc71cb03700 1 -- 172.21.15.50:0/636224484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc71806cee0 msgr2=0x7fc71815a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.385+0000 7fc71cb03700 1 --2- 172.21.15.50:0/636224484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc71806cee0 0x7fc71815a3d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc708000c00 tx=0x7fc708004770 comp rx=0 tx=0).stop 2023-11-28T11:59:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.385+0000 7fc71cb03700 1 -- 172.21.15.50:0/636224484 shutdown_connections 2023-11-28T11:59:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.385+0000 7fc71cb03700 1 --2- 172.21.15.50:0/636224484 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc718159e70 0x7fc71815a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.385+0000 7fc71cb03700 1 --2- 172.21.15.50:0/636224484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc71806cee0 0x7fc71815a3d0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.385+0000 7fc71cb03700 1 --2- 172.21.15.50:0/636224484 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fc704064ee0 0x7fc704067390 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.385+0000 7fc71cb03700 1 --2- 172.21.15.50:0/636224484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc718069c40 0x7fc7181f0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.385+0000 7fc71cb03700 1 -- 172.21.15.50:0/636224484 >> 172.21.15.50:0/636224484 conn(0x7fc7180ce3e0 msgr2=0x7fc7180abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:16.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.385+0000 7fc71cb03700 1 -- 172.21.15.50:0/636224484 shutdown_connections 2023-11-28T11:59:16.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.385+0000 7fc71cb03700 1 -- 172.21.15.50:0/636224484 wait complete. 2023-11-28T11:59:16.406 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T11:59:16.406 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:59:16.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.513+0000 7f046a405700 1 Processor -- start 2023-11-28T11:59:16.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.513+0000 7f046a405700 1 -- start start 2023-11-28T11:59:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f046a405700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f04640cd000 0x7f04640cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f046a405700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04640b0dc0 con 0x7f04640cd3d0 2023-11-28T11:59:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f046a405700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04640ce3a0 con 0x7f04640b09a0 2023-11-28T11:59:16.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f046a405700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04640d02c0 con 0x7f04640cd000 2023-11-28T11:59:16.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f0468c02700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f04640cd3d0 0x7f04640b3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58700/0 (socket says 172.21.15.50:58700) 2023-11-28T11:59:16.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f0468c02700 1 -- 172.21.15.50:0/615209445 learned_addr learned my addr 172.21.15.50:0/615209445 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:16.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f0469403700 1 --2- 172.21.15.50:0/615209445 >> v2:172.21.15.192:3300/0 conn(0x7f04640cd000 0x7f04640cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:16.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f045bfff700 1 -- 172.21.15.50:0/615209445 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685683108 0 0) 0x7f04640b0dc0 con 0x7f04640cd3d0 2023-11-28T11:59:16.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f045bfff700 1 -- 172.21.15.50:0/615209445 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04500035d0 con 0x7f04640cd3d0 2023-11-28T11:59:16.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f045bfff700 1 -- 172.21.15.50:0/615209445 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369125609 0 0) 0x7f04640ce3a0 con 0x7f04640b09a0 2023-11-28T11:59:16.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f045bfff700 1 -- 172.21.15.50:0/615209445 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04640b0dc0 con 0x7f04640b09a0 2023-11-28T11:59:16.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f0469403700 1 -- 172.21.15.50:0/615209445 >> v1:172.21.15.192:6789/0 conn(0x7f04640b09a0 legacy=0x7f04640cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f0469403700 1 -- 172.21.15.50:0/615209445 >> v1:172.21.15.50:6789/0 conn(0x7f04640cd3d0 legacy=0x7f04640b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f0469403700 1 -- 172.21.15.50:0/615209445 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04640ce640 con 0x7f04640cd000 2023-11-28T11:59:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f0469403700 1 --2- 172.21.15.50:0/615209445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04640cd000 0x7f04640cfd80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0454009850 tx=0x7f0454009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebdcbdf0a304bd17 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f045bfff700 1 -- 172.21.15.50:0/615209445 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0454011830 con 0x7f04640cd000 2023-11-28T11:59:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f045bfff700 1 -- 172.21.15.50:0/615209445 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0454011990 con 0x7f04640cd000 2023-11-28T11:59:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f045bfff700 1 -- 172.21.15.50:0/615209445 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0454011d40 con 0x7f04640cd000 2023-11-28T11:59:16.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f046a405700 1 -- 172.21.15.50:0/615209445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04640cd000 msgr2=0x7f04640cfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f046a405700 1 --2- 172.21.15.50:0/615209445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04640cd000 0x7f04640cfd80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0454009850 tx=0x7f0454009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:16.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f046a405700 1 -- 172.21.15.50:0/615209445 shutdown_connections 2023-11-28T11:59:16.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f046a405700 1 --2- 172.21.15.50:0/615209445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04640cd000 0x7f04640cfd80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f046a405700 1 -- 172.21.15.50:0/615209445 >> 172.21.15.50:0/615209445 conn(0x7f04640b2140 msgr2=0x7f04640b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f046a405700 1 -- 172.21.15.50:0/615209445 shutdown_connections 2023-11-28T11:59:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.517+0000 7f046a405700 1 -- 172.21.15.50:0/615209445 wait complete. 2023-11-28T11:59:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f046a405700 1 Processor -- start 2023-11-28T11:59:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f046a405700 1 -- start start 2023-11-28T11:59:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f046a405700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04640b09a0 0x7f04641554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f046a405700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04640cd000 0x7f04640b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f046a405700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04640cd3d0 0x7f04640b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f046a405700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04641eff60 con 0x7f04640cd000 2023-11-28T11:59:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f046a405700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04641ef320 con 0x7f04640b09a0 2023-11-28T11:59:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f046a405700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04641ef5c0 con 0x7f04640cd3d0 2023-11-28T11:59:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f0468c02700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04640cd000 0x7f04640b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f0468c02700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04640cd000 0x7f04640b5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44154/0 (socket says 172.21.15.50:44154) 2023-11-28T11:59:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f0468c02700 1 -- 172.21.15.50:0/2852240681 learned_addr learned my addr 172.21.15.50:0/2852240681 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f0469c04700 1 --2- 172.21.15.50:0/2852240681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04640cd3d0 0x7f04640b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f0469403700 1 --2- 172.21.15.50:0/2852240681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04640b09a0 0x7f04641554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f0468c02700 1 -- 172.21.15.50:0/2852240681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04640cd3d0 msgr2=0x7f04640b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f0468c02700 1 --2- 172.21.15.50:0/2852240681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04640cd3d0 0x7f04640b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f0468c02700 1 -- 172.21.15.50:0/2852240681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04640b09a0 msgr2=0x7f04641554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f0468c02700 1 --2- 172.21.15.50:0/2852240681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04640b09a0 0x7f04641554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f0468c02700 1 -- 172.21.15.50:0/2852240681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04540094b0 con 0x7f04640cd000 2023-11-28T11:59:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f0469c04700 1 --2- 172.21.15.50:0/2852240681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04640cd3d0 0x7f04640b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f0469403700 1 --2- 172.21.15.50:0/2852240681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04640b09a0 0x7f04641554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.521+0000 7f0468c02700 1 --2- 172.21.15.50:0/2852240681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04640cd000 0x7f04640b5630 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f0460001eb0 tx=0x7f046000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.525+0000 7f0459ffb700 1 -- 172.21.15.50:0/2852240681 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04600074e0 con 0x7f04640cd000 2023-11-28T11:59:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.525+0000 7f0459ffb700 1 -- 172.21.15.50:0/2852240681 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0460007640 con 0x7f04640cd000 2023-11-28T11:59:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.525+0000 7f046a405700 1 -- 172.21.15.50:0/2852240681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04640cec00 con 0x7f04640cd000 2023-11-28T11:59:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.525+0000 7f0459ffb700 1 -- 172.21.15.50:0/2852240681 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0460005a50 con 0x7f04640cd000 2023-11-28T11:59:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.525+0000 7f046a405700 1 -- 172.21.15.50:0/2852240681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04640ce920 con 0x7f04640cd000 2023-11-28T11:59:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.525+0000 7f0459ffb700 1 -- 172.21.15.50:0/2852240681 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0460019030 con 0x7f04640cd000 2023-11-28T11:59:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.525+0000 7f046a405700 1 -- 172.21.15.50:0/2852240681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046415d6a0 con 0x7f04640cd000 2023-11-28T11:59:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.525+0000 7f0459ffb700 1 --2- 172.21.15.50:0/2852240681 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0448064f10 0x7f04480673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.525+0000 7f0459ffb700 1 -- 172.21.15.50:0/2852240681 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f0460081260 con 0x7f04640cd000 2023-11-28T11:59:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.525+0000 7f0469403700 1 --2- 172.21.15.50:0/2852240681 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0448064f10 0x7f04480673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.529+0000 7f0469403700 1 --2- 172.21.15.50:0/2852240681 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0448064f10 0x7f04480673c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f04540090b0 tx=0x7f0454008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:16.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.529+0000 7f0459ffb700 1 -- 172.21.15.50:0/2852240681 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f046004a400 con 0x7f04640cd000 2023-11-28T11:59:16.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.729+0000 7f046a405700 1 -- 172.21.15.50:0/2852240681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04641f00a0 con 0x7f04640cd000 2023-11-28T11:59:16.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.729+0000 7f0459ffb700 1 -- 172.21.15.50:0/2852240681 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4653 (secure 0 0 0) 0x7f04641f00a0 con 0x7f04640cd000 2023-11-28T11:59:16.733 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:59:16.733 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1573599194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1573599194},{"type":"v1","addr":"172.21.15.192:6836","nonce":1573599194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6445,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/983935617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":983935617},{"type":"v1","addr":"172.21.15.192:6837","nonce":983935617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2516263109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2516263109},{"type":"v1","addr":"172.21.15.50:6833","nonce":2516263109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:56:40.385672+0000","modified":"2023-11-28T11:56:56.456234+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":7,"addr":"172.21.15.50:6835/3894924751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3894924751},{"type":"v1","addr":"172.21.15.50:6835","nonce":3894924751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:59:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.733+0000 7f046a405700 1 -- 172.21.15.50:0/2852240681 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0448064f10 msgr2=0x7f04480673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.733+0000 7f046a405700 1 --2- 172.21.15.50:0/2852240681 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0448064f10 0x7f04480673c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f04540090b0 tx=0x7f0454008030 comp rx=0 tx=0).stop 2023-11-28T11:59:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.733+0000 7f046a405700 1 -- 172.21.15.50:0/2852240681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04640cd000 msgr2=0x7f04640b5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.733+0000 7f046a405700 1 --2- 172.21.15.50:0/2852240681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04640cd000 0x7f04640b5630 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f0460001eb0 tx=0x7f046000c860 comp rx=0 tx=0).stop 2023-11-28T11:59:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.733+0000 7f046a405700 1 -- 172.21.15.50:0/2852240681 shutdown_connections 2023-11-28T11:59:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.733+0000 7f046a405700 1 --2- 172.21.15.50:0/2852240681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04640cd3d0 0x7f04640b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.733+0000 7f046a405700 1 --2- 172.21.15.50:0/2852240681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04640cd000 0x7f04640b5630 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.733+0000 7f046a405700 1 --2- 172.21.15.50:0/2852240681 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0448064f10 0x7f04480673c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.733+0000 7f046a405700 1 --2- 172.21.15.50:0/2852240681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04640b09a0 0x7f04641554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.733+0000 7f046a405700 1 -- 172.21.15.50:0/2852240681 >> 172.21.15.50:0/2852240681 conn(0x7f04640b2140 msgr2=0x7f0464157c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.733+0000 7f046a405700 1 -- 172.21.15.50:0/2852240681 shutdown_connections 2023-11-28T11:59:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.733+0000 7f046a405700 1 -- 172.21.15.50:0/2852240681 wait complete. 2023-11-28T11:59:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 32 2023-11-28T11:59:16.747 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T11:59:16.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3f49a5700 1 Processor -- start 2023-11-28T11:59:16.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3f49a5700 1 -- start start 2023-11-28T11:59:16.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3f49a5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3f0145120 0x7fa3f01454f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:16.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3f49a5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f0069ce0 con 0x7fa3f006cd50 2023-11-28T11:59:16.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3f49a5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f0069fc0 con 0x7fa3f00ab850 2023-11-28T11:59:16.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3f49a5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f006a2a0 con 0x7fa3f0145120 2023-11-28T11:59:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3ef7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3f0145120 0x7fa3f01454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3effff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa3f006cd50 0x7fa3f006ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58702/0 (socket says 172.21.15.50:58702) 2023-11-28T11:59:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3ef7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3f0145120 0x7fa3f01454f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44166/0 (socket says 172.21.15.50:44166) 2023-11-28T11:59:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3effff700 1 -- 172.21.15.50:0/2301947388 learned_addr learned my addr 172.21.15.50:0/2301947388 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3ef7fe700 1 -- 172.21.15.50:0/2301947388 >> v1:172.21.15.192:6789/0 conn(0x7fa3f00ab850 legacy=0x7fa3f006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3ef7fe700 1 -- 172.21.15.50:0/2301947388 >> v1:172.21.15.50:6789/0 conn(0x7fa3f006cd50 legacy=0x7fa3f006ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3ef7fe700 1 -- 172.21.15.50:0/2301947388 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f006a580 con 0x7fa3f0145120 2023-11-28T11:59:16.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3ef7fe700 1 --2- 172.21.15.50:0/2301947388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f0145120 0x7fa3f01454f0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009850 tx=0x7fa3e0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2baed8a11965b1a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:16.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3ee7fc700 1 -- 172.21.15.50:0/2301947388 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0004230 con 0x7fa3f0145120 2023-11-28T11:59:16.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3ee7fc700 1 -- 172.21.15.50:0/2301947388 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e0004390 con 0x7fa3f0145120 2023-11-28T11:59:16.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3ee7fc700 1 -- 172.21.15.50:0/2301947388 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e00036c0 con 0x7fa3f0145120 2023-11-28T11:59:16.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3f49a5700 1 -- 172.21.15.50:0/2301947388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f0145120 msgr2=0x7fa3f01454f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3f49a5700 1 --2- 172.21.15.50:0/2301947388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f0145120 0x7fa3f01454f0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009850 tx=0x7fa3e0009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3f49a5700 1 -- 172.21.15.50:0/2301947388 shutdown_connections 2023-11-28T11:59:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3f49a5700 1 --2- 172.21.15.50:0/2301947388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f0145120 0x7fa3f01454f0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3f49a5700 1 -- 172.21.15.50:0/2301947388 >> 172.21.15.50:0/2301947388 conn(0x7fa3f006e000 msgr2=0x7fa3f00b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.861+0000 7fa3f49a5700 1 -- 172.21.15.50:0/2301947388 shutdown_connections 2023-11-28T11:59:16.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.865+0000 7fa3f49a5700 1 -- 172.21.15.50:0/2301947388 wait complete. 2023-11-28T11:59:16.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.865+0000 7fa3f49a5700 1 Processor -- start 2023-11-28T11:59:16.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.865+0000 7fa3f49a5700 1 -- start start 2023-11-28T11:59:16.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3f49a5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3f006cd50 0x7fa3f00b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3f49a5700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f00ab850 0x7fa3f01386c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3f49a5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3f0145120 0x7fa3f0138c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3f49a5700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f013b440 con 0x7fa3f00ab850 2023-11-28T11:59:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3f49a5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f014edc0 con 0x7fa3f0145120 2023-11-28T11:59:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3f49a5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f013aaa0 con 0x7fa3f006cd50 2023-11-28T11:59:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3eeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f00ab850 0x7fa3f01386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3eeffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f00ab850 0x7fa3f01386c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44174/0 (socket says 172.21.15.50:44174) 2023-11-28T11:59:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3eeffd700 1 -- 172.21.15.50:0/1066264102 learned_addr learned my addr 172.21.15.50:0/1066264102 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3ef7fe700 1 --2- 172.21.15.50:0/1066264102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3f006cd50 0x7fa3f00b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3effff700 1 --2- 172.21.15.50:0/1066264102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3f0145120 0x7fa3f0138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:16.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3eeffd700 1 -- 172.21.15.50:0/1066264102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3f006cd50 msgr2=0x7fa3f00b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3eeffd700 1 --2- 172.21.15.50:0/1066264102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3f006cd50 0x7fa3f00b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3eeffd700 1 -- 172.21.15.50:0/1066264102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3f0145120 msgr2=0x7fa3f0138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:16.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3eeffd700 1 --2- 172.21.15.50:0/1066264102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3f0145120 0x7fa3f0138c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:16.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3eeffd700 1 -- 172.21.15.50:0/1066264102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e00094b0 con 0x7fa3f00ab850 2023-11-28T11:59:16.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3eeffd700 1 --2- 172.21.15.50:0/1066264102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f00ab850 0x7fa3f01386c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400c4e0 tx=0x7fa3e400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:16.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3d7fff700 1 -- 172.21.15.50:0/1066264102 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4011790 con 0x7fa3f00ab850 2023-11-28T11:59:16.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3d7fff700 1 -- 172.21.15.50:0/1066264102 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e4011910 con 0x7fa3f00ab850 2023-11-28T11:59:16.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3f49a5700 1 -- 172.21.15.50:0/1066264102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f00b2880 con 0x7fa3f00ab850 2023-11-28T11:59:16.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3d7fff700 1 -- 172.21.15.50:0/1066264102 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4011cc0 con 0x7fa3f00ab850 2023-11-28T11:59:16.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3f49a5700 1 -- 172.21.15.50:0/1066264102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f006a860 con 0x7fa3f00ab850 2023-11-28T11:59:16.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.869+0000 7fa3f49a5700 1 -- 172.21.15.50:0/1066264102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f00b2a10 con 0x7fa3f00ab850 2023-11-28T11:59:16.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.873+0000 7fa3d7fff700 1 -- 172.21.15.50:0/1066264102 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa3e4010050 con 0x7fa3f00ab850 2023-11-28T11:59:16.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.873+0000 7fa3d7fff700 1 --2- 172.21.15.50:0/1066264102 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa3dc064f10 0x7fa3dc0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:16.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.873+0000 7fa3d7fff700 1 -- 172.21.15.50:0/1066264102 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fa3e4081cb0 con 0x7fa3f00ab850 2023-11-28T11:59:16.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.873+0000 7fa3ef7fe700 1 --2- 172.21.15.50:0/1066264102 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa3dc064f10 0x7fa3dc0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:16.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.873+0000 7fa3ef7fe700 1 --2- 172.21.15.50:0/1066264102 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa3dc064f10 0x7fa3dc0673c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009850 tx=0x7fa3e0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:16.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:16.881+0000 7fa3d7fff700 1 -- 172.21.15.50:0/1066264102 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa3e404fbe0 con 0x7fa3f00ab850 2023-11-28T11:59:17.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.081+0000 7fa3f49a5700 1 -- 172.21.15.50:0/1066264102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3f013b580 con 0x7fa3f00ab850 2023-11-28T11:59:17.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.081+0000 7fa3d7fff700 1 -- 172.21.15.50:0/1066264102 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4653 (secure 0 0 0) 0x7fa3f013b580 con 0x7fa3f00ab850 2023-11-28T11:59:17.084 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:59:17.085 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1573599194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1573599194},{"type":"v1","addr":"172.21.15.192:6836","nonce":1573599194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6445,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/983935617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":983935617},{"type":"v1","addr":"172.21.15.192:6837","nonce":983935617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2516263109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2516263109},{"type":"v1","addr":"172.21.15.50:6833","nonce":2516263109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T11:56:40.385672+0000","modified":"2023-11-28T11:56:56.456234+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6510":{"gid":6510,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":7,"addr":"172.21.15.50:6835/3894924751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3894924751},{"type":"v1","addr":"172.21.15.50:6835","nonce":3894924751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T11:59:17.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.081+0000 7fa3f49a5700 1 -- 172.21.15.50:0/1066264102 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa3dc064f10 msgr2=0x7fa3dc0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:17.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.081+0000 7fa3f49a5700 1 --2- 172.21.15.50:0/1066264102 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa3dc064f10 0x7fa3dc0673c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009850 tx=0x7fa3e0008030 comp rx=0 tx=0).stop 2023-11-28T11:59:17.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.085+0000 7fa3f49a5700 1 -- 172.21.15.50:0/1066264102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f00ab850 msgr2=0x7fa3f01386c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:17.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.085+0000 7fa3f49a5700 1 --2- 172.21.15.50:0/1066264102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f00ab850 0x7fa3f01386c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400c4e0 tx=0x7fa3e400c7f0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.085+0000 7fa3f49a5700 1 -- 172.21.15.50:0/1066264102 shutdown_connections 2023-11-28T11:59:17.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.085+0000 7fa3f49a5700 1 --2- 172.21.15.50:0/1066264102 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fa3dc064f10 0x7fa3dc0673c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.085+0000 7fa3f49a5700 1 --2- 172.21.15.50:0/1066264102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3f0145120 0x7fa3f0138c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.085+0000 7fa3f49a5700 1 --2- 172.21.15.50:0/1066264102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f00ab850 0x7fa3f01386c0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.085+0000 7fa3f49a5700 1 --2- 172.21.15.50:0/1066264102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3f006cd50 0x7fa3f00b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.085+0000 7fa3f49a5700 1 -- 172.21.15.50:0/1066264102 >> 172.21.15.50:0/1066264102 conn(0x7fa3f006e000 msgr2=0x7fa3f00cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:17.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.085+0000 7fa3f49a5700 1 -- 172.21.15.50:0/1066264102 shutdown_connections 2023-11-28T11:59:17.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.085+0000 7fa3f49a5700 1 -- 172.21.15.50:0/1066264102 wait complete. 2023-11-28T11:59:17.088 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 32 2023-11-28T11:59:17.100 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:59:17.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc359e700 1 Processor -- start 2023-11-28T11:59:17.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc359e700 1 -- start start 2023-11-28T11:59:17.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc359e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc40cb470 0x7f5fc4164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc359e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc406ace0 con 0x7f5fc4069c40 2023-11-28T11:59:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc359e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc406a0d0 con 0x7f5fc4159e70 2023-11-28T11:59:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc359e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc406a3b0 con 0x7f5fc40cb470 2023-11-28T11:59:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc1d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5fc4069c40 0x7f5fc40cad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58706/0 (socket says 172.21.15.50:58706) 2023-11-28T11:59:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc1d9b700 1 -- 172.21.15.50:0/2242952344 learned_addr learned my addr 172.21.15.50:0/2242952344 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc2d9d700 1 --2- 172.21.15.50:0/2242952344 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc40cb470 0x7f5fc4164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc159a700 1 -- 172.21.15.50:0/2242952344 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436008262 0 0) 0x7f5fc406ace0 con 0x7f5fc4069c40 2023-11-28T11:59:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc159a700 1 -- 172.21.15.50:0/2242952344 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fb00035d0 con 0x7f5fc4069c40 2023-11-28T11:59:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc159a700 1 -- 172.21.15.50:0/2242952344 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792261410 0 0) 0x7f5fc406a0d0 con 0x7f5fc4159e70 2023-11-28T11:59:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc159a700 1 -- 172.21.15.50:0/2242952344 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc406ace0 con 0x7f5fc4159e70 2023-11-28T11:59:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc159a700 1 -- 172.21.15.50:0/2242952344 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1362909931 0 0) 0x7f5fb00035d0 con 0x7f5fc4069c40 2023-11-28T11:59:17.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc159a700 1 -- 172.21.15.50:0/2242952344 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc40cb470 msgr2=0x7f5fc4164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc159a700 1 --2- 172.21.15.50:0/2242952344 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc40cb470 0x7f5fc4164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc159a700 1 -- 172.21.15.50:0/2242952344 >> v1:172.21.15.192:6789/0 conn(0x7f5fc4159e70 legacy=0x7f5fc406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc159a700 1 -- 172.21.15.50:0/2242952344 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc406a690 con 0x7f5fc4069c40 2023-11-28T11:59:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc159a700 1 -- 172.21.15.50:0/2242952344 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f5fac001670 con 0x7f5fc4069c40 2023-11-28T11:59:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc159a700 1 -- 172.21.15.50:0/2242952344 >> v1:172.21.15.50:6789/0 conn(0x7f5fc4069c40 legacy=0x7f5fc40cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc159a700 1 --2- 172.21.15.50:0/2242952344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fb0003be0 0x7f5fb0003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc159a700 1 --2- 172.21.15.50:0/2242952344 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc40cb470 0x7f5fb0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc159a700 1 --2- 172.21.15.50:0/2242952344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb0004db0 0x7f5fb0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc159a700 1 -- 172.21.15.50:0/2242952344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc406a3b0 con 0x7f5fb0004db0 2023-11-28T11:59:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc159a700 1 -- 172.21.15.50:0/2242952344 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb000bae0 con 0x7f5fb0003be0 2023-11-28T11:59:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc159a700 1 -- 172.21.15.50:0/2242952344 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb000bc50 con 0x7f5fc40cb470 2023-11-28T11:59:17.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc2d9d700 1 --2- 172.21.15.50:0/2242952344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb0004db0 0x7f5fb0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc1d9b700 1 --2- 172.21.15.50:0/2242952344 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc40cb470 0x7f5fb0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc259c700 1 --2- 172.21.15.50:0/2242952344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fb0003be0 0x7f5fb0003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc2d9d700 1 -- 172.21.15.50:0/2242952344 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc40cb470 msgr2=0x7f5fb0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc2d9d700 1 --2- 172.21.15.50:0/2242952344 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc40cb470 0x7f5fb0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc2d9d700 1 -- 172.21.15.50:0/2242952344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fb0003be0 msgr2=0x7f5fb0003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc2d9d700 1 --2- 172.21.15.50:0/2242952344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fb0003be0 0x7f5fb0003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc2d9d700 1 -- 172.21.15.50:0/2242952344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb00035d0 con 0x7f5fb0004db0 2023-11-28T11:59:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.213+0000 7f5fc2d9d700 1 --2- 172.21.15.50:0/2242952344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb0004db0 0x7f5fb0005220 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40c1ee0 tx=0x7f5fb00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c74392b32db2e82 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc159a700 1 -- 172.21.15.50:0/2242952344 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc00e660 con 0x7f5fb0004db0 2023-11-28T11:59:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc159a700 1 -- 172.21.15.50:0/2242952344 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc00e7c0 con 0x7f5fb0004db0 2023-11-28T11:59:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc159a700 1 -- 172.21.15.50:0/2242952344 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc00eb30 con 0x7f5fb0004db0 2023-11-28T11:59:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc359e700 1 -- 172.21.15.50:0/2242952344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb0004db0 msgr2=0x7f5fb0005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc359e700 1 --2- 172.21.15.50:0/2242952344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fb0004db0 0x7f5fb0005220 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40c1ee0 tx=0x7f5fb00058a0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc2d9d700 1 -- 172.21.15.50:0/2242952344 reap_dead start 2023-11-28T11:59:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc359e700 1 -- 172.21.15.50:0/2242952344 shutdown_connections 2023-11-28T11:59:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc359e700 1 -- 172.21.15.50:0/2242952344 >> 172.21.15.50:0/2242952344 conn(0x7f5fc40ce3e0 msgr2=0x7f5fc40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc359e700 1 -- 172.21.15.50:0/2242952344 shutdown_connections 2023-11-28T11:59:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc359e700 1 -- 172.21.15.50:0/2242952344 wait complete. 2023-11-28T11:59:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc359e700 1 Processor -- start 2023-11-28T11:59:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc359e700 1 -- start start 2023-11-28T11:59:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc359e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fb0004db0 0x7f5fc40cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc414bda0 0x7f5fc40c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc359e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc40ae680 0x7f5fc40aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc415c190 con 0x7f5fc414bda0 2023-11-28T11:59:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc359e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40af030 con 0x7f5fc40ae680 2023-11-28T11:59:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.217+0000 7f5fc359e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc415c3a0 con 0x7f5fb0004db0 2023-11-28T11:59:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fc1d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc414bda0 0x7f5fc40c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fc1d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc414bda0 0x7f5fc40c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44184/0 (socket says 172.21.15.50:44184) 2023-11-28T11:59:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fc1d9b700 1 -- 172.21.15.50:0/525202482 learned_addr learned my addr 172.21.15.50:0/525202482 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fc2d9d700 1 --2- 172.21.15.50:0/525202482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc40ae680 0x7f5fc40aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fc259c700 1 --2- 172.21.15.50:0/525202482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fb0004db0 0x7f5fc40cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fc1d9b700 1 -- 172.21.15.50:0/525202482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fb0004db0 msgr2=0x7f5fc40cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fc1d9b700 1 --2- 172.21.15.50:0/525202482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fb0004db0 0x7f5fc40cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fc1d9b700 1 -- 172.21.15.50:0/525202482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc40ae680 msgr2=0x7f5fc40aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fc1d9b700 1 --2- 172.21.15.50:0/525202482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc40ae680 0x7f5fc40aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fc1d9b700 1 -- 172.21.15.50:0/525202482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc406d0b0 con 0x7f5fc414bda0 2023-11-28T11:59:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fc1d9b700 1 --2- 172.21.15.50:0/525202482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc414bda0 0x7f5fc40c4670 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f5fac007370 tx=0x7f5fac007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fbaffd700 1 -- 172.21.15.50:0/525202482 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00f6c0 con 0x7f5fc414bda0 2023-11-28T11:59:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fbaffd700 1 -- 172.21.15.50:0/525202482 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fac00f820 con 0x7f5fc414bda0 2023-11-28T11:59:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fc359e700 1 -- 172.21.15.50:0/525202482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc406a970 con 0x7f5fc414bda0 2023-11-28T11:59:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fbaffd700 1 -- 172.21.15.50:0/525202482 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00fbd0 con 0x7f5fc414bda0 2023-11-28T11:59:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fc359e700 1 -- 172.21.15.50:0/525202482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc415a240 con 0x7f5fc414bda0 2023-11-28T11:59:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fc359e700 1 -- 172.21.15.50:0/525202482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc40b0e20 con 0x7f5fc414bda0 2023-11-28T11:59:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.221+0000 7f5fbaffd700 1 -- 172.21.15.50:0/525202482 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5fac00fd30 con 0x7f5fc414bda0 2023-11-28T11:59:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.225+0000 7f5fbaffd700 1 --2- 172.21.15.50:0/525202482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5fa4064ee0 0x7f5fa4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.225+0000 7f5fbaffd700 1 -- 172.21.15.50:0/525202482 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f5fac0820a0 con 0x7f5fc414bda0 2023-11-28T11:59:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.225+0000 7f5fc259c700 1 --2- 172.21.15.50:0/525202482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5fa4064ee0 0x7f5fa4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.225+0000 7f5fc259c700 1 --2- 172.21.15.50:0/525202482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5fa4064ee0 0x7f5fa4067390 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4001a50 tx=0x7f5fb4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:17.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.233+0000 7f5fbaffd700 1 -- 172.21.15.50:0/525202482 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5fac0500c0 con 0x7f5fc414bda0 2023-11-28T11:59:17.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.397+0000 7f5fc359e700 1 -- 172.21.15.50:0/525202482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fc4072500 con 0x7f5fc414bda0 2023-11-28T11:59:17.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.401+0000 7f5fbaffd700 1 -- 172.21.15.50:0/525202482 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+18126 (secure 0 0 0) 0x7f5fac0536e0 con 0x7f5fc414bda0 2023-11-28T11:59:17.405 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:59:17.405 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":68,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:57:31.028964+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-28T11:56:38.943405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-28T11:56:39.374123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.14","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:59:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.405+0000 7f5fc359e700 1 -- 172.21.15.50:0/525202482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5fa4064ee0 msgr2=0x7f5fa4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.405+0000 7f5fc359e700 1 --2- 172.21.15.50:0/525202482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5fa4064ee0 0x7f5fa4067390 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4001a50 tx=0x7f5fb4009040 comp rx=0 tx=0).stop 2023-11-28T11:59:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.405+0000 7f5fc359e700 1 -- 172.21.15.50:0/525202482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc414bda0 msgr2=0x7f5fc40c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.405+0000 7f5fc359e700 1 --2- 172.21.15.50:0/525202482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc414bda0 0x7f5fc40c4670 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f5fac007370 tx=0x7f5fac007680 comp rx=0 tx=0).stop 2023-11-28T11:59:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.405+0000 7f5fc359e700 1 -- 172.21.15.50:0/525202482 shutdown_connections 2023-11-28T11:59:17.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.405+0000 7f5fc359e700 1 --2- 172.21.15.50:0/525202482 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5fa4064ee0 0x7f5fa4067390 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.405+0000 7f5fc359e700 1 --2- 172.21.15.50:0/525202482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc40ae680 0x7f5fc40aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.405+0000 7f5fc359e700 1 --2- 172.21.15.50:0/525202482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc414bda0 0x7f5fc40c4670 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.405+0000 7f5fc359e700 1 --2- 172.21.15.50:0/525202482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fb0004db0 0x7f5fc40cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.405+0000 7f5fc359e700 1 -- 172.21.15.50:0/525202482 >> 172.21.15.50:0/525202482 conn(0x7f5fc40ce3e0 msgr2=0x7f5fc40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:17.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.405+0000 7f5fc359e700 1 -- 172.21.15.50:0/525202482 shutdown_connections 2023-11-28T11:59:17.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.405+0000 7f5fc359e700 1 -- 172.21.15.50:0/525202482 wait complete. 2023-11-28T11:59:17.425 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T11:59:17.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.537+0000 7fe7056bd700 1 Processor -- start 2023-11-28T11:59:17.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.537+0000 7fe7056bd700 1 -- start start 2023-11-28T11:59:17.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe7056bd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe700158e60 0x7fe7000c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:17.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe7056bd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe7000cb460 0x7fe7000cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:17.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe7056bd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7000cd8f0 con 0x7fe7000ad490 2023-11-28T11:59:17.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe7056bd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7000add00 con 0x7fe700158e60 2023-11-28T11:59:17.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe7056bd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7000cc4f0 con 0x7fe7000cb460 2023-11-28T11:59:17.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe6fffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe700158e60 0x7fe7000c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe6fffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe700158e60 0x7fe7000c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44192/0 (socket says 172.21.15.50:44192) 2023-11-28T11:59:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe6fffff700 1 -- 172.21.15.50:0/1607751206 learned_addr learned my addr 172.21.15.50:0/1607751206 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe704ebc700 1 --2- 172.21.15.50:0/1607751206 >> v2:172.21.15.192:3300/0 conn(0x7fe7000cb460 0x7fe7000cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe6fffff700 1 -- 172.21.15.50:0/1607751206 >> v2:172.21.15.192:3300/0 conn(0x7fe7000cb460 msgr2=0x7fe7000cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe6fffff700 1 --2- 172.21.15.50:0/1607751206 >> v2:172.21.15.192:3300/0 conn(0x7fe7000cb460 0x7fe7000cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe6fffff700 1 -- 172.21.15.50:0/1607751206 >> v1:172.21.15.192:6789/0 conn(0x7fe7000ad490 legacy=0x7fe7000cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe6fffff700 1 -- 172.21.15.50:0/1607751206 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70006dc60 con 0x7fe700158e60 2023-11-28T11:59:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe6fffff700 1 --2- 172.21.15.50:0/1607751206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe700158e60 0x7fe7000c8a30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe70006b820 tx=0x7fe6f4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912e71c43ba6d0c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe6feffd700 1 -- 172.21.15.50:0/1607751206 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4011830 con 0x7fe700158e60 2023-11-28T11:59:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe6feffd700 1 -- 172.21.15.50:0/1607751206 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f4011990 con 0x7fe700158e60 2023-11-28T11:59:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe6feffd700 1 -- 172.21.15.50:0/1607751206 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4011d40 con 0x7fe700158e60 2023-11-28T11:59:17.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe7056bd700 1 -- 172.21.15.50:0/1607751206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe700158e60 msgr2=0x7fe7000c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:17.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.541+0000 7fe7056bd700 1 --2- 172.21.15.50:0/1607751206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe700158e60 0x7fe7000c8a30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe70006b820 tx=0x7fe6f4009c20 comp rx=0 tx=0).stop 2023-11-28T11:59:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe7056bd700 1 -- 172.21.15.50:0/1607751206 shutdown_connections 2023-11-28T11:59:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe7056bd700 1 --2- 172.21.15.50:0/1607751206 >> v2:172.21.15.192:3300/0 conn(0x7fe7000cb460 0x7fe7000cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe7056bd700 1 --2- 172.21.15.50:0/1607751206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe700158e60 0x7fe7000c8a30 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe7056bd700 1 -- 172.21.15.50:0/1607751206 >> 172.21.15.50:0/1607751206 conn(0x7fe7000ce3e0 msgr2=0x7fe7000ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe7056bd700 1 -- 172.21.15.50:0/1607751206 shutdown_connections 2023-11-28T11:59:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe7056bd700 1 -- 172.21.15.50:0/1607751206 wait complete. 2023-11-28T11:59:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe7056bd700 1 Processor -- start 2023-11-28T11:59:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe7056bd700 1 -- start start 2023-11-28T11:59:17.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe7056bd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7000ad490 0x7fe7000b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:17.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe7056bd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7000cb460 0x7fe7001f1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:17.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe7056bd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe700158e60 0x7fe7000ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:17.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe7056bd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7001f1990 con 0x7fe7000ad490 2023-11-28T11:59:17.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe7056bd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7001e4120 con 0x7fe700158e60 2023-11-28T11:59:17.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe7056bd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe700071e80 con 0x7fe7000cb460 2023-11-28T11:59:17.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe6fffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7000ad490 0x7fe7000b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:17.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe704ebc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe700158e60 0x7fe7000ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:17.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe6fffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7000ad490 0x7fe7000b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44202/0 (socket says 172.21.15.50:44202) 2023-11-28T11:59:17.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe6ff7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7000cb460 0x7fe7001f1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:17.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe6fffff700 1 -- 172.21.15.50:0/3189982393 learned_addr learned my addr 172.21.15.50:0/3189982393 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:17.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe6fffff700 1 -- 172.21.15.50:0/3189982393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7000cb460 msgr2=0x7fe7001f1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:17.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe6fffff700 1 --2- 172.21.15.50:0/3189982393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7000cb460 0x7fe7001f1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe6fffff700 1 -- 172.21.15.50:0/3189982393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe700158e60 msgr2=0x7fe7000ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:17.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe6fffff700 1 --2- 172.21.15.50:0/3189982393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe700158e60 0x7fe7000ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:17.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe6fffff700 1 -- 172.21.15.50:0/3189982393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f4009570 con 0x7fe7000ad490 2023-11-28T11:59:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.545+0000 7fe704ebc700 1 --2- 172.21.15.50:0/3189982393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe700158e60 0x7fe7000ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.549+0000 7fe6fffff700 1 --2- 172.21.15.50:0/3189982393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7000ad490 0x7fe7000b0840 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4000c00 tx=0x7fe6f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.549+0000 7fe6fcff9700 1 -- 172.21.15.50:0/3189982393 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4004590 con 0x7fe7000ad490 2023-11-28T11:59:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.549+0000 7fe6fcff9700 1 -- 172.21.15.50:0/3189982393 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f401e070 con 0x7fe7000ad490 2023-11-28T11:59:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.549+0000 7fe6fcff9700 1 -- 172.21.15.50:0/3189982393 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4003900 con 0x7fe7000ad490 2023-11-28T11:59:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.549+0000 7fe7056bd700 1 -- 172.21.15.50:0/3189982393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe700159230 con 0x7fe7000ad490 2023-11-28T11:59:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.549+0000 7fe7056bd700 1 -- 172.21.15.50:0/3189982393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7000cde90 con 0x7fe7000ad490 2023-11-28T11:59:17.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.549+0000 7fe6fcff9700 1 -- 172.21.15.50:0/3189982393 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe6f402a020 con 0x7fe7000ad490 2023-11-28T11:59:17.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.549+0000 7fe7056bd700 1 -- 172.21.15.50:0/3189982393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70006d6a0 con 0x7fe7000ad490 2023-11-28T11:59:17.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.549+0000 7fe6fcff9700 1 --2- 172.21.15.50:0/3189982393 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe6ec064ee0 0x7fe6ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:17.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.553+0000 7fe6fcff9700 1 -- 172.21.15.50:0/3189982393 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fe6f4082e40 con 0x7fe7000ad490 2023-11-28T11:59:17.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.553+0000 7fe6ff7fe700 1 --2- 172.21.15.50:0/3189982393 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe6ec064ee0 0x7fe6ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:17.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.553+0000 7fe6ff7fe700 1 --2- 172.21.15.50:0/3189982393 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe6ec064ee0 0x7fe6ec067390 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe70009c4a0 tx=0x7fe6f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:17.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.557+0000 7fe6fcff9700 1 -- 172.21.15.50:0/3189982393 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe6f4050f20 con 0x7fe7000ad490 2023-11-28T11:59:17.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:17.757+0000 7fe7056bd700 1 -- 172.21.15.50:0/3189982393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe700072500 con 0x7fe7000ad490 2023-11-28T11:59:18.099 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-11-28T11:59:18.097+0000 7f6bcfbc1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T11:59:18.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.109+0000 7fe6fcff9700 1 -- 172.21.15.50:0/3189982393 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe6f4054540 con 0x7fe7000ad490 2023-11-28T11:59:18.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.113+0000 7fe7056bd700 1 -- 172.21.15.50:0/3189982393 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe6ec064ee0 msgr2=0x7fe6ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:18.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.113+0000 7fe7056bd700 1 --2- 172.21.15.50:0/3189982393 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe6ec064ee0 0x7fe6ec067390 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe70009c4a0 tx=0x7fe6f0009040 comp rx=0 tx=0).stop 2023-11-28T11:59:18.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.113+0000 7fe7056bd700 1 -- 172.21.15.50:0/3189982393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7000ad490 msgr2=0x7fe7000b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:18.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.113+0000 7fe7056bd700 1 --2- 172.21.15.50:0/3189982393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7000ad490 0x7fe7000b0840 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4000c00 tx=0x7fe6f4004770 comp rx=0 tx=0).stop 2023-11-28T11:59:18.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.113+0000 7fe7056bd700 1 -- 172.21.15.50:0/3189982393 shutdown_connections 2023-11-28T11:59:18.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.113+0000 7fe7056bd700 1 --2- 172.21.15.50:0/3189982393 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe6ec064ee0 0x7fe6ec067390 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:18.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.113+0000 7fe7056bd700 1 --2- 172.21.15.50:0/3189982393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe700158e60 0x7fe7000ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:18.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.113+0000 7fe7056bd700 1 --2- 172.21.15.50:0/3189982393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7000cb460 0x7fe7001f1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:18.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.113+0000 7fe7056bd700 1 --2- 172.21.15.50:0/3189982393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7000ad490 0x7fe7000b0840 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:18.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.113+0000 7fe7056bd700 1 -- 172.21.15.50:0/3189982393 >> 172.21.15.50:0/3189982393 conn(0x7fe7000ce3e0 msgr2=0x7fe7000ca060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:18.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.113+0000 7fe7056bd700 1 -- 172.21.15.50:0/3189982393 shutdown_connections 2023-11-28T11:59:18.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.113+0000 7fe7056bd700 1 -- 172.21.15.50:0/3189982393 wait complete. 2023-11-28T11:59:18.119 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T11:59:18.123 INFO:tasks.ceph.mds.a.smithi050.stderr: -8442> 2023-11-28T11:56:46.277+0000 7f67446b6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T11:59:18.125 INFO:tasks.ceph.mds.a.smithi050.stderr: -6856> 2023-11-28T11:56:53.136+0000 7f6740eaf700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6687=0-4194304@1} caps={6687=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6687 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55b088681b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(11)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T11:59:18.136 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T11:59:18.166 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-11-28T11:59:18.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.253+0000 7f3b8b59e700 1 Processor -- start 2023-11-28T11:59:18.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.253+0000 7f3b8b59e700 1 -- start start 2023-11-28T11:59:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8b59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3b8c0b00e0 0x7f3b8c15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b8c0cbb30 0x7f3b8c06bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8b59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8c0b2db0 con 0x7f3b8c09bdb0 2023-11-28T11:59:18.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8b59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8c0b3240 con 0x7f3b8c0b00e0 2023-11-28T11:59:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8b59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c06d840 con 0x7f3b8c0cbb30 2023-11-28T11:59:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b81d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3b8c09bdb0 0x7f3b8c15d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58722/0 (socket says 172.21.15.50:58722) 2023-11-28T11:59:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8a59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3b8c0b00e0 0x7f3b8c15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b81d9b700 1 -- 172.21.15.50:0/924754614 learned_addr learned my addr 172.21.15.50:0/924754614 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8ad9d700 1 --2- 172.21.15.50:0/924754614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b8c0cbb30 0x7f3b8c06bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b89d9b700 1 -- 172.21.15.50:0/924754614 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219117832 0 0) 0x7f3b8c0b2db0 con 0x7f3b8c09bdb0 2023-11-28T11:59:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b89d9b700 1 -- 172.21.15.50:0/924754614 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b780057e0 con 0x7f3b8c09bdb0 2023-11-28T11:59:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8a59c700 1 -- 172.21.15.50:0/924754614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b8c0cbb30 msgr2=0x7f3b8c06bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8a59c700 1 --2- 172.21.15.50:0/924754614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b8c0cbb30 0x7f3b8c06bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8a59c700 1 -- 172.21.15.50:0/924754614 >> v1:172.21.15.50:6789/0 conn(0x7f3b8c09bdb0 legacy=0x7f3b8c15d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8a59c700 1 -- 172.21.15.50:0/924754614 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8c06d560 con 0x7f3b8c0b00e0 2023-11-28T11:59:18.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8a59c700 1 --2- 172.21.15.50:0/924754614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0b00e0 0x7f3b8c15d2e0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009850 tx=0x7f3b7c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f077343a84c768 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:18.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b89d9b700 1 -- 172.21.15.50:0/924754614 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c011830 con 0x7f3b8c0b00e0 2023-11-28T11:59:18.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b89d9b700 1 -- 172.21.15.50:0/924754614 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7c011990 con 0x7f3b8c0b00e0 2023-11-28T11:59:18.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b89d9b700 1 -- 172.21.15.50:0/924754614 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c011d40 con 0x7f3b8c0b00e0 2023-11-28T11:59:18.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8b59e700 1 -- 172.21.15.50:0/924754614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0b00e0 msgr2=0x7f3b8c15d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:18.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8b59e700 1 --2- 172.21.15.50:0/924754614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0b00e0 0x7f3b8c15d2e0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009850 tx=0x7f3b7c009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:18.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8b59e700 1 -- 172.21.15.50:0/924754614 shutdown_connections 2023-11-28T11:59:18.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8b59e700 1 --2- 172.21.15.50:0/924754614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b8c0cbb30 0x7f3b8c06bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:18.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8b59e700 1 --2- 172.21.15.50:0/924754614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0b00e0 0x7f3b8c15d2e0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:18.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8b59e700 1 -- 172.21.15.50:0/924754614 >> 172.21.15.50:0/924754614 conn(0x7f3b8c0cae70 msgr2=0x7f3b8c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:18.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8b59e700 1 -- 172.21.15.50:0/924754614 shutdown_connections 2023-11-28T11:59:18.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.257+0000 7f3b8b59e700 1 -- 172.21.15.50:0/924754614 wait complete. 2023-11-28T11:59:18.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.261+0000 7f3b8b59e700 1 Processor -- start 2023-11-28T11:59:18.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.261+0000 7f3b8b59e700 1 -- start start 2023-11-28T11:59:18.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.261+0000 7f3b8b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b8c09bdb0 0x7f3b8c14f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:18.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.261+0000 7f3b8b59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b8c0b00e0 0x7f3b8c09a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:18.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.261+0000 7f3b8b59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0cbb30 0x7f3b8c09a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.261+0000 7f3b8b59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c14f760 con 0x7f3b8c0cbb30 2023-11-28T11:59:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.261+0000 7f3b8b59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c09b0d0 con 0x7f3b8c0b00e0 2023-11-28T11:59:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.261+0000 7f3b8b59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c09b3b0 con 0x7f3b8c09bdb0 2023-11-28T11:59:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.261+0000 7f3b8ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0cbb30 0x7f3b8c09a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.261+0000 7f3b8ad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0cbb30 0x7f3b8c09a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44234/0 (socket says 172.21.15.50:44234) 2023-11-28T11:59:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.261+0000 7f3b8ad9d700 1 -- 172.21.15.50:0/1040110256 learned_addr learned my addr 172.21.15.50:0/1040110256 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.261+0000 7f3b81d9b700 1 --2- 172.21.15.50:0/1040110256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b8c0b00e0 0x7f3b8c09a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.261+0000 7f3b8a59c700 1 --2- 172.21.15.50:0/1040110256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b8c09bdb0 0x7f3b8c14f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.265+0000 7f3b8ad9d700 1 -- 172.21.15.50:0/1040110256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b8c09bdb0 msgr2=0x7f3b8c14f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.265+0000 7f3b8ad9d700 1 --2- 172.21.15.50:0/1040110256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b8c09bdb0 0x7f3b8c14f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.265+0000 7f3b8ad9d700 1 -- 172.21.15.50:0/1040110256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b8c0b00e0 msgr2=0x7f3b8c09a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:18.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.265+0000 7f3b8ad9d700 1 --2- 172.21.15.50:0/1040110256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b8c0b00e0 0x7f3b8c09a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.265+0000 7f3b8ad9d700 1 -- 172.21.15.50:0/1040110256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c0094b0 con 0x7f3b8c0cbb30 2023-11-28T11:59:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.265+0000 7f3b8ad9d700 1 --2- 172.21.15.50:0/1040110256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0cbb30 0x7f3b8c09a700 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400efc0 tx=0x7f3b8400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.265+0000 7f3b837fe700 1 -- 172.21.15.50:0/1040110256 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400cad0 con 0x7f3b8c0cbb30 2023-11-28T11:59:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.265+0000 7f3b837fe700 1 -- 172.21.15.50:0/1040110256 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8400f040 con 0x7f3b8c0cbb30 2023-11-28T11:59:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.265+0000 7f3b8b59e700 1 -- 172.21.15.50:0/1040110256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8c0ac3d0 con 0x7f3b8c0cbb30 2023-11-28T11:59:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.265+0000 7f3b837fe700 1 -- 172.21.15.50:0/1040110256 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400ce70 con 0x7f3b8c0cbb30 2023-11-28T11:59:18.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.265+0000 7f3b8b59e700 1 -- 172.21.15.50:0/1040110256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8c0ac0f0 con 0x7f3b8c0cbb30 2023-11-28T11:59:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.265+0000 7f3b8b59e700 1 -- 172.21.15.50:0/1040110256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8c0cc9f0 con 0x7f3b8c0cbb30 2023-11-28T11:59:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.265+0000 7f3b837fe700 1 -- 172.21.15.50:0/1040110256 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3b84014480 con 0x7f3b8c0cbb30 2023-11-28T11:59:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.265+0000 7f3b837fe700 1 --2- 172.21.15.50:0/1040110256 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3b6c064ee0 0x7f3b6c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.269+0000 7f3b837fe700 1 -- 172.21.15.50:0/1040110256 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f3b84082ba0 con 0x7f3b8c0cbb30 2023-11-28T11:59:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.269+0000 7f3b8a59c700 1 --2- 172.21.15.50:0/1040110256 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3b6c064ee0 0x7f3b6c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:18.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.269+0000 7f3b8a59c700 1 --2- 172.21.15.50:0/1040110256 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3b6c064ee0 0x7f3b6c067390 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0090b0 tx=0x7f3b7c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:18.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.273+0000 7f3b837fe700 1 -- 172.21.15.50:0/1040110256 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3b84050b10 con 0x7f3b8c0cbb30 2023-11-28T11:59:18.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:18.473+0000 7f3b8b59e700 1 -- 172.21.15.50:0/1040110256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3b8c072500 con 0x7f3b8c0cbb30 2023-11-28T11:59:19.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.121+0000 7f3b837fe700 1 -- 172.21.15.50:0/1040110256 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3b84054130 con 0x7f3b8c0cbb30 2023-11-28T11:59:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.125+0000 7f3b8b59e700 1 -- 172.21.15.50:0/1040110256 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3b6c064ee0 msgr2=0x7f3b6c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.125+0000 7f3b8b59e700 1 --2- 172.21.15.50:0/1040110256 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3b6c064ee0 0x7f3b6c067390 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0090b0 tx=0x7f3b7c008030 comp rx=0 tx=0).stop 2023-11-28T11:59:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.125+0000 7f3b8b59e700 1 -- 172.21.15.50:0/1040110256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0cbb30 msgr2=0x7f3b8c09a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.125+0000 7f3b8b59e700 1 --2- 172.21.15.50:0/1040110256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0cbb30 0x7f3b8c09a700 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400efc0 tx=0x7f3b8400c0c0 comp rx=0 tx=0).stop 2023-11-28T11:59:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.125+0000 7f3b8b59e700 1 -- 172.21.15.50:0/1040110256 shutdown_connections 2023-11-28T11:59:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.125+0000 7f3b8b59e700 1 --2- 172.21.15.50:0/1040110256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b8c0cbb30 0x7f3b8c09a700 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.125+0000 7f3b8b59e700 1 --2- 172.21.15.50:0/1040110256 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3b6c064ee0 0x7f3b6c067390 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.125+0000 7f3b8b59e700 1 --2- 172.21.15.50:0/1040110256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b8c0b00e0 0x7f3b8c09a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.125+0000 7f3b8b59e700 1 --2- 172.21.15.50:0/1040110256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b8c09bdb0 0x7f3b8c14f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:19.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.125+0000 7f3b8b59e700 1 -- 172.21.15.50:0/1040110256 >> 172.21.15.50:0/1040110256 conn(0x7f3b8c0cae70 msgr2=0x7f3b8c0aaf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.125+0000 7f3b8b59e700 1 -- 172.21.15.50:0/1040110256 shutdown_connections 2023-11-28T11:59:19.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.125+0000 7f3b8b59e700 1 -- 172.21.15.50:0/1040110256 wait complete. 2023-11-28T11:59:19.144 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T11:59:19.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f67789da700 1 Processor -- start 2023-11-28T11:59:19.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f67789da700 1 -- start start 2023-11-28T11:59:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f67789da700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6774160420 0x7f67740cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f67789da700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67740b39d0 0x7f6774164880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f67789da700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677406b420 con 0x7f67740c13d0 2023-11-28T11:59:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f67789da700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67741607f0 con 0x7f67740b39d0 2023-11-28T11:59:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f67789da700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677406aef0 con 0x7f6774160420 2023-11-28T11:59:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f6772ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f67740b39d0 0x7f6774164880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f6773fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f67740c13d0 0x7f67740cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58724/0 (socket says 172.21.15.50:58724) 2023-11-28T11:59:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f6773fff700 1 -- 172.21.15.50:0/331955047 learned_addr learned my addr 172.21.15.50:0/331955047 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:19.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f67737fe700 1 --2- 172.21.15.50:0/331955047 >> v2:172.21.15.192:3300/0 conn(0x7f6774160420 0x7f67740cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:19.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f6772ffd700 1 -- 172.21.15.50:0/331955047 >> v2:172.21.15.192:3300/0 conn(0x7f6774160420 msgr2=0x7f67740cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f6772ffd700 1 --2- 172.21.15.50:0/331955047 >> v2:172.21.15.192:3300/0 conn(0x7f6774160420 0x7f67740cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f6772ffd700 1 -- 172.21.15.50:0/331955047 >> v1:172.21.15.50:6789/0 conn(0x7f67740c13d0 legacy=0x7f67740cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f67727fc700 1 -- 172.21.15.50:0/331955047 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964933275 0 0) 0x7f677406b420 con 0x7f67740c13d0 2023-11-28T11:59:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f6772ffd700 1 -- 172.21.15.50:0/331955047 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6774164dc0 con 0x7f67740b39d0 2023-11-28T11:59:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f6772ffd700 1 --2- 172.21.15.50:0/331955047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67740b39d0 0x7f6774164880 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6764009850 tx=0x7f6764009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9f0038a3139a7d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f67727fc700 1 -- 172.21.15.50:0/331955047 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6764011830 con 0x7f67740b39d0 2023-11-28T11:59:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f67727fc700 1 -- 172.21.15.50:0/331955047 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6764011990 con 0x7f67740b39d0 2023-11-28T11:59:19.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.273+0000 7f67727fc700 1 -- 172.21.15.50:0/331955047 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6764011d20 con 0x7f67740b39d0 2023-11-28T11:59:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.277+0000 7f67789da700 1 -- 172.21.15.50:0/331955047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67740b39d0 msgr2=0x7f6774164880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.277+0000 7f67789da700 1 --2- 172.21.15.50:0/331955047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67740b39d0 0x7f6774164880 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6764009850 tx=0x7f6764009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.277+0000 7f67789da700 1 -- 172.21.15.50:0/331955047 shutdown_connections 2023-11-28T11:59:19.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.277+0000 7f67789da700 1 --2- 172.21.15.50:0/331955047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f67740b39d0 0x7f6774164880 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.277+0000 7f67789da700 1 --2- 172.21.15.50:0/331955047 >> v2:172.21.15.192:3300/0 conn(0x7f6774160420 0x7f67740cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.277+0000 7f67789da700 1 -- 172.21.15.50:0/331955047 >> 172.21.15.50:0/331955047 conn(0x7f67740ce400 msgr2=0x7f67740ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.277+0000 7f67789da700 1 -- 172.21.15.50:0/331955047 shutdown_connections 2023-11-28T11:59:19.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.277+0000 7f67789da700 1 -- 172.21.15.50:0/331955047 wait complete. 2023-11-28T11:59:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.277+0000 7f67789da700 1 Processor -- start 2023-11-28T11:59:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.277+0000 7f67789da700 1 -- start start 2023-11-28T11:59:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f67789da700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67740b39d0 0x7f67741f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f67789da700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67740c13d0 0x7f67740cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f67789da700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6774160420 0x7f67740cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f67789da700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67740c4db0 con 0x7f6774160420 2023-11-28T11:59:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f67789da700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67741f5860 con 0x7f67740c13d0 2023-11-28T11:59:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f67789da700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67740c3ff0 con 0x7f67740b39d0 2023-11-28T11:59:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f6773fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6774160420 0x7f67740cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f6772ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67740c13d0 0x7f67740cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f67737fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67740b39d0 0x7f67741f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f6773fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6774160420 0x7f67740cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44244/0 (socket says 172.21.15.50:44244) 2023-11-28T11:59:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f6773fff700 1 -- 172.21.15.50:0/901584963 learned_addr learned my addr 172.21.15.50:0/901584963 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f67737fe700 1 -- 172.21.15.50:0/901584963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67740c13d0 msgr2=0x7f67740cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f67737fe700 1 --2- 172.21.15.50:0/901584963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67740c13d0 0x7f67740cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f67737fe700 1 -- 172.21.15.50:0/901584963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6774160420 msgr2=0x7f67740cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f67737fe700 1 --2- 172.21.15.50:0/901584963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6774160420 0x7f67740cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f67737fe700 1 -- 172.21.15.50:0/901584963 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67640094b0 con 0x7f67740b39d0 2023-11-28T11:59:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f6773fff700 1 --2- 172.21.15.50:0/901584963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6774160420 0x7f67740cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f67737fe700 1 --2- 172.21.15.50:0/901584963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67740b39d0 0x7f67741f5320 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f675c00e870 tx=0x7f675c00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f676bfff700 1 -- 172.21.15.50:0/901584963 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c013680 con 0x7f67740b39d0 2023-11-28T11:59:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f676bfff700 1 -- 172.21.15.50:0/901584963 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c0137e0 con 0x7f67740b39d0 2023-11-28T11:59:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f67789da700 1 -- 172.21.15.50:0/901584963 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6774164080 con 0x7f67740b39d0 2023-11-28T11:59:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f676bfff700 1 -- 172.21.15.50:0/901584963 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c013b70 con 0x7f67740b39d0 2023-11-28T11:59:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.281+0000 7f67789da700 1 -- 172.21.15.50:0/901584963 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677406b140 con 0x7f67740b39d0 2023-11-28T11:59:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.285+0000 7f67789da700 1 -- 172.21.15.50:0/901584963 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6774164360 con 0x7f67740b39d0 2023-11-28T11:59:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.285+0000 7f676bfff700 1 -- 172.21.15.50:0/901584963 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f675c019030 con 0x7f67740b39d0 2023-11-28T11:59:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.285+0000 7f676bfff700 1 --2- 172.21.15.50:0/901584963 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6754064ee0 0x7f6754067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.285+0000 7f676bfff700 1 -- 172.21.15.50:0/901584963 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f675c081e10 con 0x7f67740b39d0 2023-11-28T11:59:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.285+0000 7f6772ffd700 1 --2- 172.21.15.50:0/901584963 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6754064ee0 0x7f6754067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.285+0000 7f6772ffd700 1 --2- 172.21.15.50:0/901584963 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6754064ee0 0x7f6754067390 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f67640090b0 tx=0x7f6764008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.297+0000 7f676bfff700 1 -- 172.21.15.50:0/901584963 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f675c04fcf0 con 0x7f67740b39d0 2023-11-28T11:59:19.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:19.469+0000 7f67789da700 1 -- 172.21.15.50:0/901584963 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f67740c4130 con 0x7f67740b39d0 2023-11-28T11:59:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.213+0000 7f676bfff700 1 -- 172.21.15.50:0/901584963 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v70) v1 ==== 181+0+0 (secure 0 0 0) 0x7f67740c4130 con 0x7f67740b39d0 2023-11-28T11:59:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.221+0000 7f67789da700 1 -- 172.21.15.50:0/901584963 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6754064ee0 msgr2=0x7f6754067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.221+0000 7f67789da700 1 --2- 172.21.15.50:0/901584963 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6754064ee0 0x7f6754067390 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f67640090b0 tx=0x7f6764008030 comp rx=0 tx=0).stop 2023-11-28T11:59:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.221+0000 7f67789da700 1 -- 172.21.15.50:0/901584963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67740b39d0 msgr2=0x7f67741f5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.221+0000 7f67789da700 1 --2- 172.21.15.50:0/901584963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67740b39d0 0x7f67741f5320 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f675c00e870 tx=0x7f675c00eb80 comp rx=0 tx=0).stop 2023-11-28T11:59:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.221+0000 7f67789da700 1 -- 172.21.15.50:0/901584963 shutdown_connections 2023-11-28T11:59:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.221+0000 7f67789da700 1 --2- 172.21.15.50:0/901584963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6774160420 0x7f67740cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.221+0000 7f67789da700 1 --2- 172.21.15.50:0/901584963 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6754064ee0 0x7f6754067390 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.221+0000 7f67789da700 1 --2- 172.21.15.50:0/901584963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67740c13d0 0x7f67740cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.221+0000 7f67789da700 1 --2- 172.21.15.50:0/901584963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67740b39d0 0x7f67741f5320 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.221+0000 7f67789da700 1 -- 172.21.15.50:0/901584963 >> 172.21.15.50:0/901584963 conn(0x7f67740ce400 msgr2=0x7f677406a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.221+0000 7f67789da700 1 -- 172.21.15.50:0/901584963 shutdown_connections 2023-11-28T11:59:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.221+0000 7f67789da700 1 -- 172.21.15.50:0/901584963 wait complete. 2023-11-28T11:59:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-11-28T11:59:20.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T11:59:20.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.361+0000 7fcee27d9700 1 Processor -- start 2023-11-28T11:59:20.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.361+0000 7fcee27d9700 1 -- start start 2023-11-28T11:59:20.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fcee27d9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcedc0b1ae0 0x7fcedc06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:20.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fcee27d9700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcedc06a9c0 con 0x7fcedc06a4c0 2023-11-28T11:59:20.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fcee27d9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcedc06aca0 con 0x7fcedc0cf0e0 2023-11-28T11:59:20.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fcee27d9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc0d0ab0 con 0x7fcedc0b1ae0 2023-11-28T11:59:20.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fcee0fd6700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcedc06a4c0 0x7fcedc0d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58740/0 (socket says 172.21.15.50:58740) 2023-11-28T11:59:20.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fcee0fd6700 1 -- 172.21.15.50:0/1333204159 learned_addr learned my addr 172.21.15.50:0/1333204159 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:20.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fcee17d7700 1 --2- 172.21.15.50:0/1333204159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcedc0b1ae0 0x7fcedc06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fced3fff700 1 -- 172.21.15.50:0/1333204159 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155989937 0 0) 0x7fcedc06a9c0 con 0x7fcedc06a4c0 2023-11-28T11:59:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fced3fff700 1 -- 172.21.15.50:0/1333204159 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcec80035d0 con 0x7fcedc06a4c0 2023-11-28T11:59:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fced3fff700 1 -- 172.21.15.50:0/1333204159 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593937632 0 0) 0x7fcedc06aca0 con 0x7fcedc0cf0e0 2023-11-28T11:59:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fced3fff700 1 -- 172.21.15.50:0/1333204159 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcedc06a9c0 con 0x7fcedc0cf0e0 2023-11-28T11:59:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fcee17d7700 1 -- 172.21.15.50:0/1333204159 >> v1:172.21.15.192:6789/0 conn(0x7fcedc0cf0e0 legacy=0x7fcedc0b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fcee17d7700 1 -- 172.21.15.50:0/1333204159 >> v1:172.21.15.50:6789/0 conn(0x7fcedc06a4c0 legacy=0x7fcedc0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fcee17d7700 1 -- 172.21.15.50:0/1333204159 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc06af80 con 0x7fcedc0b1ae0 2023-11-28T11:59:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fcee17d7700 1 --2- 172.21.15.50:0/1333204159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcedc0b1ae0 0x7fcedc06d8e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fced8009880 tx=0x7fced8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=337d8ff7a2f7fc28 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:20.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fced3fff700 1 -- 172.21.15.50:0/1333204159 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced8011830 con 0x7fcedc0b1ae0 2023-11-28T11:59:20.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fced3fff700 1 -- 172.21.15.50:0/1333204159 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced8011990 con 0x7fcedc0b1ae0 2023-11-28T11:59:20.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.365+0000 7fced3fff700 1 -- 172.21.15.50:0/1333204159 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced8011d00 con 0x7fcedc0b1ae0 2023-11-28T11:59:20.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.369+0000 7fcee27d9700 1 -- 172.21.15.50:0/1333204159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcedc0b1ae0 msgr2=0x7fcedc06d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:20.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.369+0000 7fcee27d9700 1 --2- 172.21.15.50:0/1333204159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcedc0b1ae0 0x7fcedc06d8e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fced8009880 tx=0x7fced8009b90 comp rx=0 tx=0).stop 2023-11-28T11:59:20.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.369+0000 7fcee27d9700 1 -- 172.21.15.50:0/1333204159 shutdown_connections 2023-11-28T11:59:20.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.369+0000 7fcee27d9700 1 --2- 172.21.15.50:0/1333204159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcedc0b1ae0 0x7fcedc06d8e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:20.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.369+0000 7fcee27d9700 1 -- 172.21.15.50:0/1333204159 >> 172.21.15.50:0/1333204159 conn(0x7fcedc09bbd0 msgr2=0x7fcedc0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:20.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.369+0000 7fcee27d9700 1 -- 172.21.15.50:0/1333204159 shutdown_connections 2023-11-28T11:59:20.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.369+0000 7fcee27d9700 1 -- 172.21.15.50:0/1333204159 wait complete. 2023-11-28T11:59:20.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.369+0000 7fcee27d9700 1 Processor -- start 2023-11-28T11:59:20.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.369+0000 7fcee27d9700 1 -- start start 2023-11-28T11:59:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.369+0000 7fcee27d9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcedc06a4c0 0x7fcedc152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.369+0000 7fcee27d9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcedc0b1ae0 0x7fcedc0d1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.369+0000 7fcee27d9700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcedc0cf0e0 0x7fcedc158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.369+0000 7fcee27d9700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc152650 con 0x7fcedc0cf0e0 2023-11-28T11:59:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.369+0000 7fcee27d9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc0c66e0 con 0x7fcedc06a4c0 2023-11-28T11:59:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.369+0000 7fcee27d9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc0c69c0 con 0x7fcedc0b1ae0 2023-11-28T11:59:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fcee1fd8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcedc0cf0e0 0x7fcedc158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fcee17d7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcedc06a4c0 0x7fcedc152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fcee0fd6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcedc0b1ae0 0x7fcedc0d1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fcee17d7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcedc06a4c0 0x7fcedc152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:58248/0 (socket says 172.21.15.50:58248) 2023-11-28T11:59:20.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fcee1fd8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcedc0cf0e0 0x7fcedc158780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44258/0 (socket says 172.21.15.50:44258) 2023-11-28T11:59:20.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fcee17d7700 1 -- 172.21.15.50:0/1672618065 learned_addr learned my addr 172.21.15.50:0/1672618065 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:20.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fcee0fd6700 1 -- 172.21.15.50:0/1672618065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcedc06a4c0 msgr2=0x7fcedc152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:20.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fcee0fd6700 1 --2- 172.21.15.50:0/1672618065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcedc06a4c0 0x7fcedc152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:20.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fcee0fd6700 1 -- 172.21.15.50:0/1672618065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcedc0cf0e0 msgr2=0x7fcedc158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:20.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fcee0fd6700 1 --2- 172.21.15.50:0/1672618065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcedc0cf0e0 0x7fcedc158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:20.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fcee0fd6700 1 -- 172.21.15.50:0/1672618065 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced80094b0 con 0x7fcedc0b1ae0 2023-11-28T11:59:20.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fcee17d7700 1 --2- 172.21.15.50:0/1672618065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcedc06a4c0 0x7fcedc152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:20.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fcee1fd8700 1 --2- 172.21.15.50:0/1672618065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcedc0cf0e0 0x7fcedc158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:20.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fcee0fd6700 1 --2- 172.21.15.50:0/1672618065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcedc0b1ae0 0x7fcedc0d1340 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0011e0 tx=0x7fcecc00c700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:20.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fced1ffb700 1 -- 172.21.15.50:0/1672618065 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc005b40 con 0x7fcedc0b1ae0 2023-11-28T11:59:20.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fced1ffb700 1 -- 172.21.15.50:0/1672618065 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc005ca0 con 0x7fcedc0b1ae0 2023-11-28T11:59:20.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fced1ffb700 1 -- 172.21.15.50:0/1672618065 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc0072d0 con 0x7fcedc0b1ae0 2023-11-28T11:59:20.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fcee27d9700 1 -- 172.21.15.50:0/1672618065 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcedc0b1eb0 con 0x7fcedc0b1ae0 2023-11-28T11:59:20.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fcee27d9700 1 -- 172.21.15.50:0/1672618065 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcedc0b4380 con 0x7fcedc0b1ae0 2023-11-28T11:59:20.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.373+0000 7fcee27d9700 1 -- 172.21.15.50:0/1672618065 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcedc0b60e0 con 0x7fcedc0b1ae0 2023-11-28T11:59:20.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.377+0000 7fced1ffb700 1 -- 172.21.15.50:0/1672618065 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcecc019030 con 0x7fcedc0b1ae0 2023-11-28T11:59:20.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.377+0000 7fced1ffb700 1 --2- 172.21.15.50:0/1672618065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcec0064ee0 0x7fcec0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:20.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.377+0000 7fced1ffb700 1 -- 172.21.15.50:0/1672618065 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6088+0+0 (secure 0 0 0) 0x7fcecc080ff0 con 0x7fcedc0b1ae0 2023-11-28T11:59:20.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.377+0000 7fcee17d7700 1 --2- 172.21.15.50:0/1672618065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcec0064ee0 0x7fcec0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:20.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.377+0000 7fcee17d7700 1 --2- 172.21.15.50:0/1672618065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcec0064ee0 0x7fcec0067390 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fced8009bd0 tx=0x7fced8010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:20.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.385+0000 7fced1ffb700 1 -- 172.21.15.50:0/1672618065 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcecc04a400 con 0x7fcedc0b1ae0 2023-11-28T11:59:20.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:20.553+0000 7fcee27d9700 1 -- 172.21.15.50:0/1672618065 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcedc0c6b00 con 0x7fcedc0b1ae0 2023-11-28T11:59:21.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.225+0000 7fced1ffb700 1 -- 172.21.15.50:0/1672618065 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v71) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcedc0c6b00 con 0x7fcedc0b1ae0 2023-11-28T11:59:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.229+0000 7fcee27d9700 1 -- 172.21.15.50:0/1672618065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcec0064ee0 msgr2=0x7fcec0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.229+0000 7fcee27d9700 1 --2- 172.21.15.50:0/1672618065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcec0064ee0 0x7fcec0067390 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fced8009bd0 tx=0x7fced8010000 comp rx=0 tx=0).stop 2023-11-28T11:59:21.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.229+0000 7fcee27d9700 1 -- 172.21.15.50:0/1672618065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcedc0b1ae0 msgr2=0x7fcedc0d1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.229+0000 7fcee27d9700 1 --2- 172.21.15.50:0/1672618065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcedc0b1ae0 0x7fcedc0d1340 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0011e0 tx=0x7fcecc00c700 comp rx=0 tx=0).stop 2023-11-28T11:59:21.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.229+0000 7fcee27d9700 1 -- 172.21.15.50:0/1672618065 shutdown_connections 2023-11-28T11:59:21.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.229+0000 7fcee27d9700 1 --2- 172.21.15.50:0/1672618065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcedc0cf0e0 0x7fcedc158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.229+0000 7fcee27d9700 1 --2- 172.21.15.50:0/1672618065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcedc0b1ae0 0x7fcedc0d1340 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.229+0000 7fcee27d9700 1 --2- 172.21.15.50:0/1672618065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcec0064ee0 0x7fcec0067390 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.229+0000 7fcee27d9700 1 --2- 172.21.15.50:0/1672618065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcedc06a4c0 0x7fcedc152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.229+0000 7fcee27d9700 1 -- 172.21.15.50:0/1672618065 >> 172.21.15.50:0/1672618065 conn(0x7fcedc09bbd0 msgr2=0x7fcedc0b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:21.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.229+0000 7fcee27d9700 1 -- 172.21.15.50:0/1672618065 shutdown_connections 2023-11-28T11:59:21.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.229+0000 7fcee27d9700 1 -- 172.21.15.50:0/1672618065 wait complete. 2023-11-28T11:59:21.235 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-11-28T11:59:21.248 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T11:59:21.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb96aa700 1 Processor -- start 2023-11-28T11:59:21.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb96aa700 1 -- start start 2023-11-28T11:59:21.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb96aa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efeb40cf7f0 0x7efeb406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb96aa700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb406a9c0 con 0x7efeb40b1ae0 2023-11-28T11:59:21.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb96aa700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb406aca0 con 0x7efeb406a4c0 2023-11-28T11:59:21.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb96aa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb40d0ab0 con 0x7efeb40cf7f0 2023-11-28T11:59:21.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb3fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efeb40b1ae0 0x7efeb40d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58744/0 (socket says 172.21.15.50:58744) 2023-11-28T11:59:21.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb3fff700 1 -- 172.21.15.50:0/1048826850 learned_addr learned my addr 172.21.15.50:0/1048826850 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:21.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb8ea9700 1 --2- 172.21.15.50:0/1048826850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efeb40cf7f0 0x7efeb406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb2ffd700 1 -- 172.21.15.50:0/1048826850 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637585454 0 0) 0x7efeb406a9c0 con 0x7efeb40b1ae0 2023-11-28T11:59:21.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb2ffd700 1 -- 172.21.15.50:0/1048826850 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe9c0035d0 con 0x7efeb40b1ae0 2023-11-28T11:59:21.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb8ea9700 1 -- 172.21.15.50:0/1048826850 >> v1:172.21.15.192:6789/0 conn(0x7efeb406a4c0 legacy=0x7efeb40cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb8ea9700 1 -- 172.21.15.50:0/1048826850 >> v1:172.21.15.50:6789/0 conn(0x7efeb40b1ae0 legacy=0x7efeb40d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb8ea9700 1 -- 172.21.15.50:0/1048826850 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb406af80 con 0x7efeb40cf7f0 2023-11-28T11:59:21.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb8ea9700 1 --2- 172.21.15.50:0/1048826850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efeb40cf7f0 0x7efeb406d8e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efeac009dc0 tx=0x7efeac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76f8ba302b2e65cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:21.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb2ffd700 1 -- 172.21.15.50:0/1048826850 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac00e070 con 0x7efeb40cf7f0 2023-11-28T11:59:21.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb2ffd700 1 -- 172.21.15.50:0/1048826850 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac00bb20 con 0x7efeb40cf7f0 2023-11-28T11:59:21.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.365+0000 7efeb2ffd700 1 -- 172.21.15.50:0/1048826850 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac012430 con 0x7efeb40cf7f0 2023-11-28T11:59:21.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.369+0000 7efeb96aa700 1 -- 172.21.15.50:0/1048826850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efeb40cf7f0 msgr2=0x7efeb406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.369+0000 7efeb96aa700 1 --2- 172.21.15.50:0/1048826850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efeb40cf7f0 0x7efeb406d8e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efeac009dc0 tx=0x7efeac00b330 comp rx=0 tx=0).stop 2023-11-28T11:59:21.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.369+0000 7efeb96aa700 1 -- 172.21.15.50:0/1048826850 shutdown_connections 2023-11-28T11:59:21.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.369+0000 7efeb96aa700 1 --2- 172.21.15.50:0/1048826850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efeb40cf7f0 0x7efeb406d8e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.369+0000 7efeb96aa700 1 -- 172.21.15.50:0/1048826850 >> 172.21.15.50:0/1048826850 conn(0x7efeb409bbd0 msgr2=0x7efeb40b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:21.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.369+0000 7efeb96aa700 1 -- 172.21.15.50:0/1048826850 shutdown_connections 2023-11-28T11:59:21.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.369+0000 7efeb96aa700 1 -- 172.21.15.50:0/1048826850 wait complete. 2023-11-28T11:59:21.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.369+0000 7efeb96aa700 1 Processor -- start 2023-11-28T11:59:21.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.369+0000 7efeb96aa700 1 -- start start 2023-11-28T11:59:21.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb96aa700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb406a4c0 0x7efeb40c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb96aa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efeb40b1ae0 0x7efeb40c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb96aa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efeb40cf7f0 0x7efeb4150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb96aa700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb40c7fd0 con 0x7efeb406a4c0 2023-11-28T11:59:21.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb96aa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb40c82b0 con 0x7efeb40cf7f0 2023-11-28T11:59:21.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb96aa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb40c8590 con 0x7efeb40b1ae0 2023-11-28T11:59:21.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb406a4c0 0x7efeb40c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb406a4c0 0x7efeb40c78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44262/0 (socket says 172.21.15.50:44262) 2023-11-28T11:59:21.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb3fff700 1 -- 172.21.15.50:0/2454627885 learned_addr learned my addr 172.21.15.50:0/2454627885 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:21.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb8ea9700 1 --2- 172.21.15.50:0/2454627885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efeb40cf7f0 0x7efeb4150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb37fe700 1 --2- 172.21.15.50:0/2454627885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efeb40b1ae0 0x7efeb40c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb3fff700 1 -- 172.21.15.50:0/2454627885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efeb40b1ae0 msgr2=0x7efeb40c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb3fff700 1 --2- 172.21.15.50:0/2454627885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efeb40b1ae0 0x7efeb40c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb3fff700 1 -- 172.21.15.50:0/2454627885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efeb40cf7f0 msgr2=0x7efeb4150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb3fff700 1 --2- 172.21.15.50:0/2454627885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efeb40cf7f0 0x7efeb4150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb3fff700 1 -- 172.21.15.50:0/2454627885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac009a70 con 0x7efeb406a4c0 2023-11-28T11:59:21.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb37fe700 1 --2- 172.21.15.50:0/2454627885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efeb40b1ae0 0x7efeb40c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:21.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb3fff700 1 --2- 172.21.15.50:0/2454627885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb406a4c0 0x7efeb40c78f0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7efea400c700 tx=0x7efea400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:21.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb0ff9700 1 -- 172.21.15.50:0/2454627885 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4005d90 con 0x7efeb406a4c0 2023-11-28T11:59:21.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb96aa700 1 -- 172.21.15.50:0/2454627885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb40b1eb0 con 0x7efeb406a4c0 2023-11-28T11:59:21.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb0ff9700 1 -- 172.21.15.50:0/2454627885 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea40070d0 con 0x7efeb406a4c0 2023-11-28T11:59:21.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb0ff9700 1 -- 172.21.15.50:0/2454627885 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4007480 con 0x7efeb406a4c0 2023-11-28T11:59:21.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb96aa700 1 -- 172.21.15.50:0/2454627885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb40b4380 con 0x7efeb406a4c0 2023-11-28T11:59:21.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.373+0000 7efeb96aa700 1 -- 172.21.15.50:0/2454627885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb40b60e0 con 0x7efeb406a4c0 2023-11-28T11:59:21.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.377+0000 7efeb0ff9700 1 -- 172.21.15.50:0/2454627885 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efea4019030 con 0x7efeb406a4c0 2023-11-28T11:59:21.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.377+0000 7efeb0ff9700 1 --2- 172.21.15.50:0/2454627885 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efea0064ee0 0x7efea0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.377+0000 7efeb0ff9700 1 -- 172.21.15.50:0/2454627885 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7efea4081120 con 0x7efeb406a4c0 2023-11-28T11:59:21.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.377+0000 7efeb37fe700 1 --2- 172.21.15.50:0/2454627885 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efea0064ee0 0x7efea0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.377+0000 7efeb37fe700 1 --2- 172.21.15.50:0/2454627885 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efea0064ee0 0x7efea0067390 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7efeb41e6c10 tx=0x7efea8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:21.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.385+0000 7efeb0ff9700 1 -- 172.21.15.50:0/2454627885 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efea404f400 con 0x7efeb406a4c0 2023-11-28T11:59:21.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.549+0000 7efeb96aa700 1 -- 172.21.15.50:0/2454627885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7efeb4072500 con 0x7efeb406a4c0 2023-11-28T11:59:21.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.557+0000 7efeb0ff9700 1 -- 172.21.15.50:0/2454627885 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7efea4052a20 con 0x7efeb406a4c0 2023-11-28T11:59:21.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.557+0000 7efeb96aa700 1 -- 172.21.15.50:0/2454627885 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efea0064ee0 msgr2=0x7efea0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.557+0000 7efeb96aa700 1 --2- 172.21.15.50:0/2454627885 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efea0064ee0 0x7efea0067390 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7efeb41e6c10 tx=0x7efea8009040 comp rx=0 tx=0).stop 2023-11-28T11:59:21.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.557+0000 7efeb96aa700 1 -- 172.21.15.50:0/2454627885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb406a4c0 msgr2=0x7efeb40c78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.557+0000 7efeb96aa700 1 --2- 172.21.15.50:0/2454627885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb406a4c0 0x7efeb40c78f0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7efea400c700 tx=0x7efea400ca10 comp rx=0 tx=0).stop 2023-11-28T11:59:21.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.557+0000 7efeb96aa700 1 -- 172.21.15.50:0/2454627885 shutdown_connections 2023-11-28T11:59:21.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.557+0000 7efeb96aa700 1 --2- 172.21.15.50:0/2454627885 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7efea0064ee0 0x7efea0067390 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.557+0000 7efeb96aa700 1 --2- 172.21.15.50:0/2454627885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efeb40cf7f0 0x7efeb4150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.557+0000 7efeb96aa700 1 --2- 172.21.15.50:0/2454627885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efeb40b1ae0 0x7efeb40c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.557+0000 7efeb96aa700 1 --2- 172.21.15.50:0/2454627885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb406a4c0 0x7efeb40c78f0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.557+0000 7efeb96aa700 1 -- 172.21.15.50:0/2454627885 >> 172.21.15.50:0/2454627885 conn(0x7efeb409bbd0 msgr2=0x7efeb406d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:21.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.557+0000 7efeb96aa700 1 -- 172.21.15.50:0/2454627885 shutdown_connections 2023-11-28T11:59:21.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.557+0000 7efeb96aa700 1 -- 172.21.15.50:0/2454627885 wait complete. 2023-11-28T11:59:21.575 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2023-11-28T11:59:21.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.681+0000 7f91d1d3e700 1 Processor -- start 2023-11-28T11:59:21.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.681+0000 7f91d1d3e700 1 -- start start 2023-11-28T11:59:21.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91d1d3e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f91cc0b32e0 0x7f91cc0b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91d1d3e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91cc0cbe00 con 0x7f91cc069cd0 2023-11-28T11:59:21.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91d1d3e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91cc0b3c60 con 0x7f91cc1584c0 2023-11-28T11:59:21.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91d1d3e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91cc06dbd0 con 0x7f91cc0b32e0 2023-11-28T11:59:21.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91d153d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f91cc069cd0 0x7f91cc06a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50482/0 (socket says 172.21.15.50:50482) 2023-11-28T11:59:21.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91d153d700 1 -- 172.21.15.50:0/733777852 learned_addr learned my addr 172.21.15.50:0/733777852 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:21.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91cbfff700 1 --2- 172.21.15.50:0/733777852 >> v2:172.21.15.192:3300/0 conn(0x7f91cc0b32e0 0x7f91cc0b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91cb7fe700 1 -- 172.21.15.50:0/733777852 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463120918 0 0) 0x7f91cc0cbe00 con 0x7f91cc069cd0 2023-11-28T11:59:21.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91cb7fe700 1 -- 172.21.15.50:0/733777852 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91bc0046e0 con 0x7f91cc069cd0 2023-11-28T11:59:21.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91cb7fe700 1 -- 172.21.15.50:0/733777852 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291941552 0 0) 0x7f91cc0b3c60 con 0x7f91cc1584c0 2023-11-28T11:59:21.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91cb7fe700 1 -- 172.21.15.50:0/733777852 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91cc0cbe00 con 0x7f91cc1584c0 2023-11-28T11:59:21.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91cbfff700 1 -- 172.21.15.50:0/733777852 >> v1:172.21.15.192:6789/0 conn(0x7f91cc1584c0 legacy=0x7f91cc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91cbfff700 1 -- 172.21.15.50:0/733777852 >> v1:172.21.15.50:6789/0 conn(0x7f91cc069cd0 legacy=0x7f91cc06a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91cbfff700 1 -- 172.21.15.50:0/733777852 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc0cd0f0 con 0x7f91cc0b32e0 2023-11-28T11:59:21.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91cbfff700 1 --2- 172.21.15.50:0/733777852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91cc0b32e0 0x7f91cc0b3720 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009850 tx=0x7f91b8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1661d62c88e106f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:21.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91cb7fe700 1 -- 172.21.15.50:0/733777852 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b8011830 con 0x7f91cc0b32e0 2023-11-28T11:59:21.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91cb7fe700 1 -- 172.21.15.50:0/733777852 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b8011990 con 0x7f91cc0b32e0 2023-11-28T11:59:21.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91cb7fe700 1 -- 172.21.15.50:0/733777852 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b8011d40 con 0x7f91cc0b32e0 2023-11-28T11:59:21.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91d1d3e700 1 -- 172.21.15.50:0/733777852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91cc0b32e0 msgr2=0x7f91cc0b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91d1d3e700 1 --2- 172.21.15.50:0/733777852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91cc0b32e0 0x7f91cc0b3720 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009850 tx=0x7f91b8009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:21.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91d1d3e700 1 -- 172.21.15.50:0/733777852 shutdown_connections 2023-11-28T11:59:21.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91d1d3e700 1 --2- 172.21.15.50:0/733777852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91cc0b32e0 0x7f91cc0b3720 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91d1d3e700 1 -- 172.21.15.50:0/733777852 >> 172.21.15.50:0/733777852 conn(0x7f91cc0ce3e0 msgr2=0x7f91cc0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:21.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91d1d3e700 1 -- 172.21.15.50:0/733777852 shutdown_connections 2023-11-28T11:59:21.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.685+0000 7f91d1d3e700 1 -- 172.21.15.50:0/733777852 wait complete. 2023-11-28T11:59:21.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91d1d3e700 1 Processor -- start 2023-11-28T11:59:21.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91d1d3e700 1 -- start start 2023-11-28T11:59:21.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91d1d3e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91cc069cd0 0x7f91cc071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91d1d3e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91cc0b32e0 0x7f91cc06bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91d1d3e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91cc1584c0 0x7f91cc1f1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91d1d3e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0c54b0 con 0x7f91cc0b32e0 2023-11-28T11:59:21.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91d1d3e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0c5790 con 0x7f91cc1584c0 2023-11-28T11:59:21.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91d1d3e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0c5a70 con 0x7f91cc069cd0 2023-11-28T11:59:21.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91cbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91cc0b32e0 0x7f91cc06bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91cbfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91cc0b32e0 0x7f91cc06bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34446/0 (socket says 172.21.15.50:34446) 2023-11-28T11:59:21.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91cbfff700 1 -- 172.21.15.50:0/1602897854 learned_addr learned my addr 172.21.15.50:0/1602897854 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:21.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91d153d700 1 --2- 172.21.15.50:0/1602897854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91cc1584c0 0x7f91cc1f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91d0d3c700 1 --2- 172.21.15.50:0/1602897854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91cc069cd0 0x7f91cc071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91cbfff700 1 -- 172.21.15.50:0/1602897854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91cc069cd0 msgr2=0x7f91cc071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91cbfff700 1 --2- 172.21.15.50:0/1602897854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91cc069cd0 0x7f91cc071a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91cbfff700 1 -- 172.21.15.50:0/1602897854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91cc1584c0 msgr2=0x7f91cc1f1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91cbfff700 1 --2- 172.21.15.50:0/1602897854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91cc1584c0 0x7f91cc1f1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91cbfff700 1 -- 172.21.15.50:0/1602897854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80094b0 con 0x7f91cc0b32e0 2023-11-28T11:59:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91d0d3c700 1 --2- 172.21.15.50:0/1602897854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91cc069cd0 0x7f91cc071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.689+0000 7f91cbfff700 1 --2- 172.21.15.50:0/1602897854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91cc0b32e0 0x7f91cc06bef0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f91cc06f880 tx=0x7f91b8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.693+0000 7f91c97fa700 1 -- 172.21.15.50:0/1602897854 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b801aa10 con 0x7f91cc0b32e0 2023-11-28T11:59:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.693+0000 7f91c97fa700 1 -- 172.21.15.50:0/1602897854 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b801f070 con 0x7f91cc0b32e0 2023-11-28T11:59:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.693+0000 7f91d1d3e700 1 -- 172.21.15.50:0/1602897854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91cc0cd6b0 con 0x7f91cc0b32e0 2023-11-28T11:59:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.693+0000 7f91c97fa700 1 -- 172.21.15.50:0/1602897854 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b801adb0 con 0x7f91cc0b32e0 2023-11-28T11:59:21.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.693+0000 7f91d1d3e700 1 -- 172.21.15.50:0/1602897854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91cc0cd3d0 con 0x7f91cc0b32e0 2023-11-28T11:59:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.693+0000 7f91d1d3e700 1 -- 172.21.15.50:0/1602897854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91cc0cd990 con 0x7f91cc0b32e0 2023-11-28T11:59:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.693+0000 7f91c97fa700 1 -- 172.21.15.50:0/1602897854 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f91b800f050 con 0x7f91cc0b32e0 2023-11-28T11:59:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.697+0000 7f91c97fa700 1 --2- 172.21.15.50:0/1602897854 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f91b0064ee0 0x7f91b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.697+0000 7f91c97fa700 1 -- 172.21.15.50:0/1602897854 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f91b8082e90 con 0x7f91cc0b32e0 2023-11-28T11:59:21.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.697+0000 7f91d0d3c700 1 --2- 172.21.15.50:0/1602897854 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f91b0064ee0 0x7f91b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:21.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.697+0000 7f91d0d3c700 1 --2- 172.21.15.50:0/1602897854 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f91b0064ee0 0x7f91b0067390 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f91c00011e0 tx=0x7f91c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:21.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.705+0000 7f91c97fa700 1 -- 172.21.15.50:0/1602897854 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f91b80510a0 con 0x7f91cc0b32e0 2023-11-28T11:59:21.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:21.925+0000 7f91d1d3e700 1 -- 172.21.15.50:0/1602897854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f91cc0cc3f0 con 0x7f91cc0b32e0 2023-11-28T11:59:22.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:22.221+0000 7f91c97fa700 1 -- 172.21.15.50:0/1602897854 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v278) v1 ==== 169+0+0 (secure 0 0 0) 0x7f91b80150f0 con 0x7f91cc0b32e0 2023-11-28T11:59:22.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:22.225+0000 7f91d1d3e700 1 -- 172.21.15.50:0/1602897854 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f91b0064ee0 msgr2=0x7f91b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:22.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:22.225+0000 7f91d1d3e700 1 --2- 172.21.15.50:0/1602897854 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f91b0064ee0 0x7f91b0067390 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f91c00011e0 tx=0x7f91c0009040 comp rx=0 tx=0).stop 2023-11-28T11:59:22.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:22.225+0000 7f91d1d3e700 1 -- 172.21.15.50:0/1602897854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91cc0b32e0 msgr2=0x7f91cc06bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:22.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:22.225+0000 7f91d1d3e700 1 --2- 172.21.15.50:0/1602897854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91cc0b32e0 0x7f91cc06bef0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f91cc06f880 tx=0x7f91b8004770 comp rx=0 tx=0).stop 2023-11-28T11:59:22.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:22.225+0000 7f91d1d3e700 1 -- 172.21.15.50:0/1602897854 shutdown_connections 2023-11-28T11:59:22.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:22.225+0000 7f91d1d3e700 1 --2- 172.21.15.50:0/1602897854 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f91b0064ee0 0x7f91b0067390 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:22.225+0000 7f91d1d3e700 1 --2- 172.21.15.50:0/1602897854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91cc1584c0 0x7f91cc1f1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:22.225+0000 7f91d1d3e700 1 --2- 172.21.15.50:0/1602897854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91cc0b32e0 0x7f91cc06bef0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:22.225+0000 7f91d1d3e700 1 --2- 172.21.15.50:0/1602897854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91cc069cd0 0x7f91cc071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:22.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:22.225+0000 7f91d1d3e700 1 -- 172.21.15.50:0/1602897854 >> 172.21.15.50:0/1602897854 conn(0x7f91cc0ce3e0 msgr2=0x7f91cc157470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:22.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:22.225+0000 7f91d1d3e700 1 -- 172.21.15.50:0/1602897854 shutdown_connections 2023-11-28T11:59:22.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:22.229+0000 7f91d1d3e700 1 -- 172.21.15.50:0/1602897854 wait complete. 2023-11-28T11:59:22.249 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ERROR 2023-11-28T11:59:22.249 INFO:tasks.cephfs_test_runner: 2023-11-28T11:59:22.249 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T11:59:22.249 INFO:tasks.cephfs_test_runner:ERROR: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T11:59:22.249 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared 2023-11-28T11:59:22.249 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T11:59:22.250 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T11:59:22.250 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/cephfs/test_forward_scrub.py", line 500, in test_health_status_after_backtrace_repair 2023-11-28T11:59:22.250 INFO:tasks.cephfs_test_runner: self.wait_until_true(lambda: self._check_for_presence_of_MDS_damage(), timeout=100) 2023-11-28T11:59:22.250 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/ceph_test_case.py", line 212, in wait_until_true 2023-11-28T11:59:22.250 INFO:tasks.cephfs_test_runner: raise TestTimeoutError("Timed out after {0}s and {1} retries".format(elapsed, retry_count)) 2023-11-28T11:59:22.250 INFO:tasks.cephfs_test_runner:tasks.ceph_test_case.TestTimeoutError: Timed out after 100s and 0 retries 2023-11-28T11:59:22.250 INFO:tasks.cephfs_test_runner: 2023-11-28T11:59:22.250 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T11:59:22.250 INFO:tasks.cephfs_test_runner:Ran 3 tests in 292.596s 2023-11-28T11:59:22.250 INFO:tasks.cephfs_test_runner: 2023-11-28T11:59:22.250 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-28T11:59:22.250 INFO:tasks.cephfs_test_runner: 2023-11-28T11:59:22.250 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T11:59:22.251 INFO:tasks.cephfs_test_runner:ERROR: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T11:59:22.251 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared 2023-11-28T11:59:22.251 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T11:59:22.251 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T11:59:22.251 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/cephfs/test_forward_scrub.py", line 500, in test_health_status_after_backtrace_repair 2023-11-28T11:59:22.251 INFO:tasks.cephfs_test_runner: self.wait_until_true(lambda: self._check_for_presence_of_MDS_damage(), timeout=100) 2023-11-28T11:59:22.251 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/ceph_test_case.py", line 212, in wait_until_true 2023-11-28T11:59:22.251 INFO:tasks.cephfs_test_runner: raise TestTimeoutError("Timed out after {0}s and {1} retries".format(elapsed, retry_count)) 2023-11-28T11:59:22.251 INFO:tasks.cephfs_test_runner:tasks.ceph_test_case.TestTimeoutError: Timed out after 100s and 0 retries 2023-11-28T11:59:22.251 INFO:tasks.cephfs_test_runner: 2023-11-28T11:59:22.251 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T11:59:22.371 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=8e83051c5fae442c9e93301c80f26499 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T11:59:22.372 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-28T11:59:22.382 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-28T11:59:22.400 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-28T11:59:22.400 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:59:22.400 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:22.419 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349436k,nr_inodes=4087359,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20953 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276116k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:59:22.419 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-11-28T11:59:22.419 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:22.427 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349436k,nr_inodes=4087359,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20953 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276116k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276120k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T11:59:22.427 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:59:22.427 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:22.436 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17871 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:59:22.437 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-28T11:59:22.437 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T11:59:22.484 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346292k,nr_inodes=4086573,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17871 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275488k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275492k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T11:59:22.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:22.485 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-11-28T11:59:22.491 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-28T11:59:22.492 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T11:59:22.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:22.492 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T11:59:22.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:22.508 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T11:59:22.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:22.521 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2023-11-28T11:59:22.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:22.655 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-11-28T11:59:22.662 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T11:59:22.662 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T11:59:22.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:22.663 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T11:59:22.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:22.681 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T11:59:22.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T11:59:22.744 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-11-28T11:59:22.885 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-28T11:59:22.897 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T11:59:22.897 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:59:23.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.021+0000 7f789f59e700 1 Processor -- start 2023-11-28T11:59:23.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.021+0000 7f789f59e700 1 -- start start 2023-11-28T11:59:23.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.021+0000 7f789f59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78a00cfdd0 0x7f78a006ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.021+0000 7f789f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a00cda80 0x7f78a00cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.021+0000 7f789f59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a00ce520 con 0x7f78a00b25b0 2023-11-28T11:59:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.021+0000 7f789f59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a00b2fe0 con 0x7f78a00cfdd0 2023-11-28T11:59:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.021+0000 7f789f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a006ba70 con 0x7f78a00cda80 2023-11-28T11:59:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.021+0000 7f789e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78a00cfdd0 0x7f78a006ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.021+0000 7f789e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f78a00cfdd0 0x7f78a006ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34454/0 (socket says 172.21.15.50:34454) 2023-11-28T11:59:23.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.021+0000 7f789e59c700 1 -- 172.21.15.50:0/2353197967 learned_addr learned my addr 172.21.15.50:0/2353197967 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:23.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.021+0000 7f789ed9d700 1 --2- 172.21.15.50:0/2353197967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a00cda80 0x7f78a00cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.021+0000 7f789d59a700 1 -- 172.21.15.50:0/2353197967 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904256117 0 0) 0x7f78a00ce520 con 0x7f78a00b25b0 2023-11-28T11:59:23.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.021+0000 7f789d59a700 1 -- 172.21.15.50:0/2353197967 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78880035d0 con 0x7f78a00b25b0 2023-11-28T11:59:23.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.021+0000 7f789e59c700 1 -- 172.21.15.50:0/2353197967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a00cda80 msgr2=0x7f78a00cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:23.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.021+0000 7f789e59c700 1 --2- 172.21.15.50:0/2353197967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a00cda80 0x7f78a00cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.021+0000 7f789e59c700 1 -- 172.21.15.50:0/2353197967 >> v1:172.21.15.192:6789/0 conn(0x7f78a00b25b0 legacy=0x7f78a00cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.021+0000 7f789e59c700 1 -- 172.21.15.50:0/2353197967 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a00cb180 con 0x7f78a00cfdd0 2023-11-28T11:59:23.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789e59c700 1 --2- 172.21.15.50:0/2353197967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a00cfdd0 0x7f78a006ce60 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f7894009910 tx=0x7f7894009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375305df7a01cd27 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:23.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789d59a700 1 -- 172.21.15.50:0/2353197967 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7894011830 con 0x7f78a00cfdd0 2023-11-28T11:59:23.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789d59a700 1 -- 172.21.15.50:0/2353197967 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7894011990 con 0x7f78a00cfdd0 2023-11-28T11:59:23.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789d59a700 1 -- 172.21.15.50:0/2353197967 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7894011d40 con 0x7f78a00cfdd0 2023-11-28T11:59:23.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789f59e700 1 -- 172.21.15.50:0/2353197967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a00cfdd0 msgr2=0x7f78a006ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789f59e700 1 --2- 172.21.15.50:0/2353197967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a00cfdd0 0x7f78a006ce60 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f7894009910 tx=0x7f7894009c20 comp rx=0 tx=0).stop 2023-11-28T11:59:23.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789f59e700 1 -- 172.21.15.50:0/2353197967 shutdown_connections 2023-11-28T11:59:23.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789f59e700 1 --2- 172.21.15.50:0/2353197967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a00cda80 0x7f78a00cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789f59e700 1 --2- 172.21.15.50:0/2353197967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a00cfdd0 0x7f78a006ce60 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789f59e700 1 -- 172.21.15.50:0/2353197967 >> 172.21.15.50:0/2353197967 conn(0x7f78a0069c40 msgr2=0x7f78a006a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:23.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789f59e700 1 -- 172.21.15.50:0/2353197967 shutdown_connections 2023-11-28T11:59:23.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789f59e700 1 -- 172.21.15.50:0/2353197967 wait complete. 2023-11-28T11:59:23.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789f59e700 1 Processor -- start 2023-11-28T11:59:23.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789f59e700 1 -- start start 2023-11-28T11:59:23.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789f59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a00b25b0 0x7f78a015a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a00cda80 0x7f78a00ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78a00cfdd0 0x7f78a00b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789f59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00adff0 con 0x7f78a00b25b0 2023-11-28T11:59:23.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789f59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00ae2d0 con 0x7f78a00cfdd0 2023-11-28T11:59:23.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.025+0000 7f789f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00ae5b0 con 0x7f78a00cda80 2023-11-28T11:59:23.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f789e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a00b25b0 0x7f78a015a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f789e59c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a00b25b0 0x7f78a015a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34462/0 (socket says 172.21.15.50:34462) 2023-11-28T11:59:23.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f789e59c700 1 -- 172.21.15.50:0/3792283308 learned_addr learned my addr 172.21.15.50:0/3792283308 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:23.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f789dd9b700 1 --2- 172.21.15.50:0/3792283308 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a00cda80 0x7f78a00ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f789ed9d700 1 --2- 172.21.15.50:0/3792283308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78a00cfdd0 0x7f78a00b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f789e59c700 1 -- 172.21.15.50:0/3792283308 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a00cda80 msgr2=0x7f78a00ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f789e59c700 1 --2- 172.21.15.50:0/3792283308 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a00cda80 0x7f78a00ac270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f789e59c700 1 -- 172.21.15.50:0/3792283308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78a00cfdd0 msgr2=0x7f78a00b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f789e59c700 1 --2- 172.21.15.50:0/3792283308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78a00cfdd0 0x7f78a00b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f789e59c700 1 -- 172.21.15.50:0/3792283308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7894009570 con 0x7f78a00b25b0 2023-11-28T11:59:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f789e59c700 1 --2- 172.21.15.50:0/3792283308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a00b25b0 0x7f78a015a8c0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f7894000c00 tx=0x7f7894004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f788effd700 1 -- 172.21.15.50:0/3792283308 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7894004510 con 0x7f78a00b25b0 2023-11-28T11:59:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f788effd700 1 -- 172.21.15.50:0/3792283308 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78940036c0 con 0x7f78a00b25b0 2023-11-28T11:59:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f789f59e700 1 -- 172.21.15.50:0/3792283308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a00cae10 con 0x7f78a00b25b0 2023-11-28T11:59:23.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f788effd700 1 -- 172.21.15.50:0/3792283308 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7894003a70 con 0x7f78a00b25b0 2023-11-28T11:59:23.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f789f59e700 1 -- 172.21.15.50:0/3792283308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a00b2d00 con 0x7f78a00b25b0 2023-11-28T11:59:23.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f789f59e700 1 -- 172.21.15.50:0/3792283308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a0072c20 con 0x7f78a00b25b0 2023-11-28T11:59:23.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f788effd700 1 -- 172.21.15.50:0/3792283308 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f789402d070 con 0x7f78a00b25b0 2023-11-28T11:59:23.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f788effd700 1 --2- 172.21.15.50:0/3792283308 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7880064ee0 0x7f7880067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f788effd700 1 -- 172.21.15.50:0/3792283308 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f7894021030 con 0x7f78a00b25b0 2023-11-28T11:59:23.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.029+0000 7f789dd9b700 1 --2- 172.21.15.50:0/3792283308 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7880064ee0 0x7f7880067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.033+0000 7f789dd9b700 1 --2- 172.21.15.50:0/3792283308 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7880064ee0 0x7f7880067390 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f78a00cf0a0 tx=0x7f7890009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:23.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.037+0000 7f788effd700 1 -- 172.21.15.50:0/3792283308 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7894051560 con 0x7f78a00b25b0 2023-11-28T11:59:23.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.193+0000 7f789f59e700 1 -- 172.21.15.50:0/3792283308 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f78a00ae440 con 0x7f7880064ee0 2023-11-28T11:59:23.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.201+0000 7f788effd700 1 -- 172.21.15.50:0/3792283308 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71391 (secure 0 0 0) 0x7f78a00ae440 con 0x7f7880064ee0 2023-11-28T11:59:23.204 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:59:23.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.201+0000 7f789f59e700 1 -- 172.21.15.50:0/3792283308 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7880064ee0 msgr2=0x7f7880067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.201+0000 7f789f59e700 1 --2- 172.21.15.50:0/3792283308 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7880064ee0 0x7f7880067390 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f78a00cf0a0 tx=0x7f7890009040 comp rx=0 tx=0).stop 2023-11-28T11:59:23.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.201+0000 7f789f59e700 1 -- 172.21.15.50:0/3792283308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a00b25b0 msgr2=0x7f78a015a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.201+0000 7f789f59e700 1 --2- 172.21.15.50:0/3792283308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a00b25b0 0x7f78a015a8c0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f7894000c00 tx=0x7f7894004770 comp rx=0 tx=0).stop 2023-11-28T11:59:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.201+0000 7f789f59e700 1 -- 172.21.15.50:0/3792283308 shutdown_connections 2023-11-28T11:59:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.201+0000 7f789f59e700 1 --2- 172.21.15.50:0/3792283308 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f7880064ee0 0x7f7880067390 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.201+0000 7f789f59e700 1 --2- 172.21.15.50:0/3792283308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78a00cfdd0 0x7f78a00b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.201+0000 7f789f59e700 1 --2- 172.21.15.50:0/3792283308 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a00cda80 0x7f78a00ac270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.201+0000 7f789f59e700 1 --2- 172.21.15.50:0/3792283308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a00b25b0 0x7f78a015a8c0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.201+0000 7f789f59e700 1 -- 172.21.15.50:0/3792283308 >> 172.21.15.50:0/3792283308 conn(0x7f78a0069c40 msgr2=0x7f78a00cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.201+0000 7f789f59e700 1 -- 172.21.15.50:0/3792283308 shutdown_connections 2023-11-28T11:59:23.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.201+0000 7f789f59e700 1 -- 172.21.15.50:0/3792283308 wait complete. 2023-11-28T11:59:23.207 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:59:23.220 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2023-11-28T11:59:22.994314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":97752,"kb_used_data":7704,"kb_used_omap":0,"kb_used_meta":89984,"kb_avail":754876968,"statfs":{"total":773094113280,"available":772994015232,"internally_reserved":0,"allocated":7888896,"data_stored":4339928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":92143616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12288,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-6,"num_read_kb":-5,"num_write":-74,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001996"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":56,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:31.050143+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:57:31.050143+0000","last_peered":"2023-11-28T11:57:31.050143+0000","last_clean":"2023-11-28T11:57:31.050143+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:57:31.050143+0000","last_undegraded":"2023-11-28T11:57:31.050143+0000","last_fullsized":"2023-11-28T11:57:31.050143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":56,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:31.049823+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:57:31.049823+0000","last_peered":"2023-11-28T11:57:31.049823+0000","last_clean":"2023-11-28T11:57:31.049823+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:57:31.049823+0000","last_undegraded":"2023-11-28T11:57:31.049823+0000","last_fullsized":"2023-11-28T11:57:31.049823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":62,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:48.981817+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:57:48.981817+0000","last_peered":"2023-11-28T11:57:48.981817+0000","last_clean":"2023-11-28T11:57:48.981817+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:57:48.981817+0000","last_undegraded":"2023-11-28T11:57:48.981817+0000","last_fullsized":"2023-11-28T11:57:48.981817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":56,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:31.946604+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:57:31.946604+0000","last_peered":"2023-11-28T11:57:31.946604+0000","last_clean":"2023-11-28T11:57:31.946604+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:57:31.946604+0000","last_undegraded":"2023-11-28T11:57:31.946604+0000","last_fullsized":"2023-11-28T11:57:31.946604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":206,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:38.983983+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:57:38.983983+0000","last_peered":"2023-11-28T11:57:38.983983+0000","last_clean":"2023-11-28T11:57:38.983983+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:57:38.983983+0000","last_undegraded":"2023-11-28T11:57:38.983983+0000","last_fullsized":"2023-11-28T11:57:38.983983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":55,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:48.979074+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:57:48.979074+0000","last_peered":"2023-11-28T11:57:48.979074+0000","last_clean":"2023-11-28T11:57:48.979074+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:57:48.979074+0000","last_undegraded":"2023-11-28T11:57:48.979074+0000","last_fullsized":"2023-11-28T11:57:48.979074+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":57,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:48.985794+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:57:48.985794+0000","last_peered":"2023-11-28T11:57:48.985794+0000","last_clean":"2023-11-28T11:57:48.985794+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:57:48.985794+0000","last_undegraded":"2023-11-28T11:57:48.985794+0000","last_fullsized":"2023-11-28T11:57:48.985794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":65,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:48.980903+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:57:48.980903+0000","last_peered":"2023-11-28T11:57:48.980903+0000","last_clean":"2023-11-28T11:57:48.980903+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:57:48.980903+0000","last_undegraded":"2023-11-28T11:57:48.980903+0000","last_fullsized":"2023-11-28T11:57:48.980903+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":57,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:38.984019+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:57:38.984019+0000","last_peered":"2023-11-28T11:57:38.984019+0000","last_clean":"2023-11-28T11:57:38.984019+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:57:38.984019+0000","last_undegraded":"2023-11-28T11:57:38.984019+0000","last_fullsized":"2023-11-28T11:57:38.984019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574920,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11008,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":94360832,"statfs":{"total":96636764160,"available":96625491968,"internally_reserved":0,"allocated":1433600,"data_stored":985737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89600000000000002,"15min":0.91400000000000003},"min":{"1min":0.53900000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1180000000000001,"5min":1.413,"15min":1.413},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.98699999999999999,"15min":0.97599999999999998},"min":{"1min":0.76800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.258,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.68100000000000005}]},{"osd":1,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.86899999999999999,"15min":0.84199999999999997},"min":{"1min":0.63700000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.165,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.85899999999999999,"15min":0.83399999999999996},"min":{"1min":0.61599999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3720000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.7929999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.83299999999999996,"15min":0.81299999999999994},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1619999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.93100000000000005,"15min":0.92500000000000004},"min":{"1min":0.67300000000000004,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.159,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.121}]},{"osd":3,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91400000000000003,"15min":0.87},"min":{"1min":0.73399999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1799999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.244},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.97499999999999998,"15min":1},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2170000000000001,"5min":1.665,"15min":1.665},"last":0.93000000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.874,"15min":0.874},"min":{"1min":0.66100000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1619999999999999,"5min":1.264,"15min":1.264},"last":1.6890000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.98699999999999999,"15min":1.01},"min":{"1min":0.70799999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.177,"5min":1.621,"15min":1.621},"last":1.325}]},{"osd":5,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.01,"15min":1.012},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.004},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0740000000000001,"15min":1.0880000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.8540000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.91400000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.115,"15min":1.115},"min":{"1min":0.94099999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2769999999999999,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.5800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9776,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362064,"statfs":{"total":96636764160,"available":96626753536,"internally_reserved":0,"allocated":827392,"data_stored":387991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.55200000000000005,"5min":0.497,"15min":0.497},"max":{"1min":2.802,"5min":2.802,"15min":2.802},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81999999999999995,"15min":0.82899999999999996},"min":{"1min":0.66400000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.165,"5min":1.498,"15min":1.498},"last":0.72599999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.82399999999999995,"15min":0.85099999999999998},"min":{"1min":0.69099999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.145,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.93200000000000005,"15min":0.97299999999999998},"min":{"1min":0.64200000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.76300000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94799999999999995,"15min":0.95899999999999996},"min":{"1min":0.64300000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.91800000000000004,"15min":0.90800000000000003},"min":{"1min":0.63500000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.137,"5min":1.204,"15min":1.204},"last":0.81100000000000005}]},{"osd":3,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.92900000000000005,"15min":0.89600000000000002},"min":{"1min":0.68400000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1910000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89200000000000002,"15min":0.86599999999999999},"min":{"1min":0.59999999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.157,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.88900000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94399999999999995,"15min":0.95199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97699999999999998,"15min":1.0009999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.212,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.77600000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.97499999999999998,"15min":1.016},"min":{"1min":0.66200000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.079},{"interface":"front","average":{"1min":1.089,"5min":1.099,"15min":1.131},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.84899999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0549999999999999,"15min":1.0760000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2490000000000001,"5min":1.575,"15min":1.575},"last":1.107},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.054,"15min":1.0580000000000001},"min":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.127}]}]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9852,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361988,"statfs":{"total":96636764160,"available":96626675712,"internally_reserved":0,"allocated":839680,"data_stored":395845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.84899999999999998,"15min":0.84699999999999998},"min":{"1min":0.55200000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.872,"15min":0.86399999999999999},"min":{"1min":0.70099999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1299999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.01}]},{"osd":1,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90300000000000002,"15min":0.85499999999999998},"min":{"1min":0.65700000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2869999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.90300000000000002,"15min":0.91700000000000004},"min":{"1min":0.67000000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.212,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.82899999999999996}]},{"osd":2,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89600000000000002,"15min":0.85299999999999998},"min":{"1min":0.66900000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.177,"5min":1.208,"15min":1.208},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.89000000000000001,"15min":0.84999999999999998},"min":{"1min":0.748,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1970000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.751}]},{"osd":3,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.92700000000000005,"15min":0.91100000000000003},"min":{"1min":0.70999999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.274,"5min":1.403,"15min":1.403},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.995,"15min":0.99099999999999999},"min":{"1min":0.77000000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.238,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.153}]},{"osd":4,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.874,"15min":0.92100000000000004},"min":{"1min":0.65900000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1950000000000001,"5min":1.968,"15min":1.968},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.99299999999999999,"15min":1.0309999999999999},"min":{"1min":0.73399999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.171,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.0429999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.99299999999999999,"15min":1.0049999999999999},"min":{"1min":0.69199999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.373,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.008,"5min":1.0009999999999999,"15min":1.0029999999999999},"min":{"1min":0.67500000000000004,"5min":0.433,"15min":0.433},"max":{"1min":1.3520000000000001,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.871}]},{"osd":7,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.046,"15min":1.0669999999999999},"min":{"1min":0.67000000000000004,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.24,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.091,"15min":1.0940000000000001},"min":{"1min":1.018,"5min":0.623,"15min":0.623},"max":{"1min":1.3420000000000001,"5min":1.605,"15min":1.605},"last":1.2190000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10044,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361796,"statfs":{"total":96636764160,"available":96626479104,"internally_reserved":0,"allocated":839680,"data_stored":395825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.83199999999999996,"15min":0.84199999999999997},"min":{"1min":0.64800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1859999999999999,"5min":1.647,"15min":1.647},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.86599999999999999,"15min":0.85499999999999998},"min":{"1min":0.58399999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.139,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.0069999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.86299999999999999,"15min":0.86199999999999999},"min":{"1min":0.61399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.226,"5min":1.331,"15min":1.331},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.89200000000000002,"15min":0.93300000000000005},"min":{"1min":0.622,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.145,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.81599999999999995}]},{"osd":2,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.92300000000000004,"15min":0.93100000000000005},"min":{"1min":0.61499999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2909999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.91200000000000003,"15min":0.95899999999999996},"min":{"1min":0.70599999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.125,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.92000000000000004,"15min":0.93600000000000005},"min":{"1min":0.66600000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.1799999999999999,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.002,"15min":1.052},"min":{"1min":0.77600000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1759999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0509999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.96199999999999997,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.169,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.99399999999999999,"15min":1.032},"min":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1919999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.119}]},{"osd":6,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.98299999999999998,"15min":1.056},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2629999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.145},{"interface":"front","average":{"1min":1.008,"5min":1.077,"15min":1.135},"min":{"1min":0.77500000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.2330000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.091}]},{"osd":7,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.0700000000000001,"15min":1.1359999999999999},"min":{"1min":0.68300000000000005,"5min":0.502,"15min":0.502},"max":{"1min":1.3069999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1220000000000001,"15min":1.1759999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.3580000000000001,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.212}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14000,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":13184,"kb_avail":94357840,"statfs":{"total":96636764160,"available":96622428160,"internally_reserved":0,"allocated":827392,"data_stored":388011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13500416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.879,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.90800000000000003,"5min":21.122,"15min":21.122},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.95699999999999996,"15min":0.78700000000000003},"min":{"1min":0.40400000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.204,"5min":21.288,"15min":21.288},"last":0.54300000000000004}]},{"osd":1,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74199999999999999,"15min":0.64700000000000002},"min":{"1min":0.48399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.133,"5min":6.3090000000000002,"15min":6.3090000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1,"15min":0.83599999999999997},"min":{"1min":0.54500000000000004,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.91400000000000003,"5min":21.151,"15min":21.151},"last":0.89300000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76400000000000001,"15min":0.78800000000000003},"min":{"1min":0.49099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.1459999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.88600000000000001,"15min":0.879},"min":{"1min":0.63,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95099999999999996,"5min":6.5149999999999997,"15min":6.5149999999999997},"last":0.78000000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.2549999999999999,"15min":1.1040000000000001},"min":{"1min":0.61099999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.169,"5min":21.347999999999999,"15min":21.347999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.998,"5min":1.292,"15min":1.1279999999999999},"min":{"1min":0.78500000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1850000000000001,"5min":21.129999999999999,"15min":21.129999999999999},"last":0.91500000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.2749999999999999,"15min":1.165},"min":{"1min":0.70799999999999996,"5min":0.626,"15min":0.626},"max":{"1min":1.2070000000000001,"5min":21.210999999999999,"15min":21.210999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.3340000000000001,"15min":1.216},"min":{"1min":0.68799999999999994,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.331,"5min":21.32,"15min":21.32},"last":1.04}]},{"osd":6,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0669999999999999,"15min":1.103},"min":{"1min":0.75700000000000001,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2569999999999999,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.014,"5min":1.323,"15min":1.1870000000000001},"min":{"1min":0.748,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1890000000000001,"5min":21.077999999999999,"15min":21.077999999999999},"last":1.1579999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.115,"15min":1.147},"min":{"1min":0.78700000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4259999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.081},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.2170000000000001,"15min":1.1890000000000001},"min":{"1min":0.90900000000000003,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.2430000000000001,"5min":6.5750000000000002,"15min":6.5750000000000002},"last":0.85499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13896,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94357944,"statfs":{"total":96636764160,"available":96622534656,"internally_reserved":0,"allocated":851968,"data_stored":406275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63,"15min":0.59999999999999998},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90800000000000003,"5min":1.123,"15min":1.123},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71899999999999997,"15min":0.755},"min":{"1min":0.41699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.147,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.65800000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.75900000000000001},"min":{"1min":0.53100000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91500000000000004,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.623},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.64300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96099999999999997,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.875}]},{"osd":3,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68799999999999994,"15min":0.69599999999999995},"min":{"1min":0.56100000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.234,"5min":1.254,"15min":1.254},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.84399999999999997,"15min":0.82799999999999996},"min":{"1min":0.36699999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1080000000000001,"5min":1.968,"15min":1.968},"last":0.94499999999999995}]},{"osd":4,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.999,"15min":1.0329999999999999},"min":{"1min":0.74399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.177,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.014,"15min":1.0649999999999999},"min":{"1min":0.63900000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.157,"5min":2.181,"15min":2.181},"last":0.96999999999999997}]},{"osd":5,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.96099999999999997,"15min":0.97499999999999998},"min":{"1min":0.69099999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.2889999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.054},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0780000000000001,"15min":1.123},"min":{"1min":0.82599999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3660000000000001,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.1859999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.079,"15min":1.157},"min":{"1min":0.72799999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.302,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.083,"15min":1.1279999999999999},"min":{"1min":0.80600000000000005,"5min":0.621,"15min":0.621},"max":{"1min":1.3140000000000001,"5min":1.867,"15min":1.867},"last":1.232}]},{"osd":7,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1220000000000001,"15min":1.1699999999999999},"min":{"1min":0.88600000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.238,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.097,"15min":1.131},"min":{"1min":0.76800000000000002,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3720000000000001,"5min":1.675,"15min":1.675},"last":1.018}]}]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15052,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":13632,"kb_avail":94356788,"statfs":{"total":96636764160,"available":96621350912,"internally_reserved":0,"allocated":1445888,"data_stored":991359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13959168},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46600000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.98099999999999998,"5min":1.387,"15min":1.387},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.73899999999999999,"15min":0.70099999999999996},"min":{"1min":0.62,"5min":0.375,"15min":0.375},"max":{"1min":0.97899999999999998,"5min":1.252,"15min":1.252},"last":0.73799999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.52800000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.85199999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.57599999999999996,"5min":0.31,"15min":0.31},"max":{"1min":1.123,"5min":1.175,"15min":1.175},"last":0.79900000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.86599999999999999,"15min":0.872},"min":{"1min":0.57199999999999995,"5min":0.317,"15min":0.317},"max":{"1min":1.2549999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77300000000000002,"15min":0.749},"min":{"1min":0.56000000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.62}]},{"osd":4,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.91700000000000004,"15min":0.91100000000000003},"min":{"1min":0.68999999999999995,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0960000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.089},{"interface":"front","average":{"1min":1.004,"5min":1.0209999999999999,"15min":1.0629999999999999},"min":{"1min":0.79000000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5409999999999999,"5min":2.29,"15min":2.29},"last":1.3069999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0149999999999999,"15min":1.018},"min":{"1min":0.77500000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2909999999999999,"5min":1.47,"15min":1.47},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.04,"5min":1.0409999999999999,"15min":1.0449999999999999},"min":{"1min":0.80800000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.331,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.155}]},{"osd":6,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.075,"15min":1.0600000000000001},"min":{"1min":0.86799999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.365,"5min":1.581,"15min":1.581},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0720000000000001,"15min":1.0800000000000001},"min":{"1min":0.69999999999999996,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3740000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.86299999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.145,"15min":1.1930000000000001},"min":{"1min":0.93200000000000005,"5min":0.747,"15min":0.747},"max":{"1min":1.627,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.125},{"interface":"front","average":{"1min":1.155,"5min":1.1259999999999999,"15min":1.1100000000000001},"min":{"1min":0.89900000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.4079999999999999,"5min":1.647,"15min":1.647},"last":1.179}]}]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14124,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357716,"statfs":{"total":96636764160,"available":96622301184,"internally_reserved":0,"allocated":823296,"data_stored":388885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63200000000000001,"15min":0.66700000000000004},"min":{"1min":0.48999999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89200000000000002,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72899999999999998,"15min":0.68400000000000005},"min":{"1min":0.53800000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.58099999999999996}]},{"osd":2,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.503,"5min":0.435,"15min":0.435},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.76500000000000001,"15min":0.71899999999999997},"min":{"1min":0.65400000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.042,"5min":1.175,"15min":1.175},"last":0.76200000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.69699999999999995},"min":{"1min":0.53100000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.117,"5min":1.159,"15min":1.159},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90200000000000002,"15min":0.92200000000000004},"min":{"1min":0.61199999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.575,"5min":1.96,"15min":1.96},"last":0.73299999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.90700000000000003,"15min":0.879},"min":{"1min":0.73399999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0249999999999999,"15min":1.093},"min":{"1min":0.81899999999999995,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.8049999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.0569999999999999,"15min":1.069},"min":{"1min":0.78700000000000003,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.478,"5min":1.649,"15min":1.649},"last":1.081},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.75600000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3080000000000001,"5min":1.339,"15min":1.339},"last":1.151}]},{"osd":6,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.127,"15min":1.173},"min":{"1min":0.93200000000000005,"5min":0.755,"15min":0.755},"max":{"1min":1.8819999999999999,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.143,"15min":1.1419999999999999},"min":{"1min":0.93000000000000005,"5min":0.749,"15min":0.749},"max":{"1min":1.468,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.1890000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1619999999999999,"15min":1.1639999999999999},"min":{"1min":0.86699999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.125},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.107,"15min":1.087},"min":{"1min":0.998,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.367,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.242}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:59:23.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:59:23.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25bcd9b700 1 Processor -- start 2023-11-28T11:59:23.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25bcd9b700 1 -- start start 2023-11-28T11:59:23.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25bcd9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b80ad490 0x7f25b80c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25bcd9b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b80cd8f0 con 0x7f25b8158e60 2023-11-28T11:59:23.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25bcd9b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b806dc60 con 0x7f25b80cb460 2023-11-28T11:59:23.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25bcd9b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80add00 con 0x7f25b80ad490 2023-11-28T11:59:23.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b77fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f25b8158e60 0x7f25b80cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50484/0 (socket says 172.21.15.50:50484) 2023-11-28T11:59:23.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b77fe700 1 -- 172.21.15.50:0/3656320872 learned_addr learned my addr 172.21.15.50:0/3656320872 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:23.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b7fff700 1 --2- 172.21.15.50:0/3656320872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b80ad490 0x7f25b80c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 -- 172.21.15.50:0/3656320872 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839010295 0 0) 0x7f25b80cd8f0 con 0x7f25b8158e60 2023-11-28T11:59:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 -- 172.21.15.50:0/3656320872 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25a00057e0 con 0x7f25b8158e60 2023-11-28T11:59:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 -- 172.21.15.50:0/3656320872 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497966028 0 0) 0x7f25b806dc60 con 0x7f25b80cb460 2023-11-28T11:59:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 -- 172.21.15.50:0/3656320872 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25b80cd8f0 con 0x7f25b80cb460 2023-11-28T11:59:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 -- 172.21.15.50:0/3656320872 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1587477370 0 0) 0x7f25a00057e0 con 0x7f25b8158e60 2023-11-28T11:59:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 -- 172.21.15.50:0/3656320872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b80ad490 msgr2=0x7f25b80c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 --2- 172.21.15.50:0/3656320872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b80ad490 0x7f25b80c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 -- 172.21.15.50:0/3656320872 >> v1:172.21.15.192:6789/0 conn(0x7f25b80cb460 legacy=0x7f25b806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 -- 172.21.15.50:0/3656320872 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b80cde90 con 0x7f25b8158e60 2023-11-28T11:59:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 -- 172.21.15.50:0/3656320872 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7f25a8001670 con 0x7f25b8158e60 2023-11-28T11:59:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 -- 172.21.15.50:0/3656320872 >> v1:172.21.15.50:6789/0 conn(0x7f25b8158e60 legacy=0x7f25b80cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 --2- 172.21.15.50:0/3656320872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25a0005df0 0x7f25a00061e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 --2- 172.21.15.50:0/3656320872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25a0006a80 0x7f25a0006ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 --2- 172.21.15.50:0/3656320872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b80ad490 0x7f25a0007430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 -- 172.21.15.50:0/3656320872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80add00 con 0x7f25a0006a80 2023-11-28T11:59:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 -- 172.21.15.50:0/3656320872 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a000dd50 con 0x7f25a0005df0 2023-11-28T11:59:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 -- 172.21.15.50:0/3656320872 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a000df10 con 0x7f25b80ad490 2023-11-28T11:59:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b6ffd700 1 --2- 172.21.15.50:0/3656320872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25a0006a80 0x7f25a0006ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b77fe700 1 --2- 172.21.15.50:0/3656320872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25a0005df0 0x7f25a00061e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b7fff700 1 --2- 172.21.15.50:0/3656320872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b80ad490 0x7f25a0007430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b6ffd700 1 -- 172.21.15.50:0/3656320872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b80ad490 msgr2=0x7f25a0007430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b6ffd700 1 --2- 172.21.15.50:0/3656320872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b80ad490 0x7f25a0007430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b6ffd700 1 -- 172.21.15.50:0/3656320872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25a0005df0 msgr2=0x7f25a00061e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b6ffd700 1 --2- 172.21.15.50:0/3656320872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25a0005df0 0x7f25a00061e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b6ffd700 1 -- 172.21.15.50:0/3656320872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a00057e0 con 0x7f25a0006a80 2023-11-28T11:59:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b7fff700 1 --2- 172.21.15.50:0/3656320872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b80ad490 0x7f25a0007430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:59:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b6ffd700 1 --2- 172.21.15.50:0/3656320872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25a0006a80 0x7f25a0006ef0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f25b80cb850 tx=0x7f25a0007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51525924a56d911 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 -- 172.21.15.50:0/3656320872 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac001450 con 0x7f25a0006a80 2023-11-28T11:59:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 -- 172.21.15.50:0/3656320872 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac0052f0 con 0x7f25a0006a80 2023-11-28T11:59:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.337+0000 7f25b67fc700 1 -- 172.21.15.50:0/3656320872 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac001d60 con 0x7f25a0006a80 2023-11-28T11:59:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.341+0000 7f25bcd9b700 1 -- 172.21.15.50:0/3656320872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25a0006a80 msgr2=0x7f25a0006ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.341+0000 7f25bcd9b700 1 --2- 172.21.15.50:0/3656320872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25a0006a80 0x7f25a0006ef0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f25b80cb850 tx=0x7f25a0007ab0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.341+0000 7f25b7fff700 1 -- 172.21.15.50:0/3656320872 reap_dead start 2023-11-28T11:59:23.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.341+0000 7f25bcd9b700 1 -- 172.21.15.50:0/3656320872 shutdown_connections 2023-11-28T11:59:23.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.341+0000 7f25bcd9b700 1 -- 172.21.15.50:0/3656320872 >> 172.21.15.50:0/3656320872 conn(0x7f25b80ce3e0 msgr2=0x7f25b80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:23.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.341+0000 7f25bcd9b700 1 -- 172.21.15.50:0/3656320872 shutdown_connections 2023-11-28T11:59:23.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.341+0000 7f25bcd9b700 1 -- 172.21.15.50:0/3656320872 wait complete. 2023-11-28T11:59:23.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.341+0000 7f25bcd9b700 1 Processor -- start 2023-11-28T11:59:23.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.341+0000 7f25bcd9b700 1 -- start start 2023-11-28T11:59:23.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25bcd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25a0006a80 0x7f25b8157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25bcd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25b80c4c90 0x7f25b81ecf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25bcd9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b8071390 0x7f25b8071800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25bcd9b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b8071d40 con 0x7f25a0006a80 2023-11-28T11:59:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25bcd9b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b8156340 con 0x7f25b80c4c90 2023-11-28T11:59:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25bcd9b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b8156600 con 0x7f25b8071390 2023-11-28T11:59:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25b77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25a0006a80 0x7f25b8157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25b77fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25a0006a80 0x7f25b8157920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34482/0 (socket says 172.21.15.50:34482) 2023-11-28T11:59:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25b77fe700 1 -- 172.21.15.50:0/578035772 learned_addr learned my addr 172.21.15.50:0/578035772 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25b6ffd700 1 --2- 172.21.15.50:0/578035772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25b80c4c90 0x7f25b81ecf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25b7fff700 1 --2- 172.21.15.50:0/578035772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b8071390 0x7f25b8071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25b77fe700 1 -- 172.21.15.50:0/578035772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b8071390 msgr2=0x7f25b8071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25b77fe700 1 --2- 172.21.15.50:0/578035772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b8071390 0x7f25b8071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25b77fe700 1 -- 172.21.15.50:0/578035772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25b80c4c90 msgr2=0x7f25b81ecf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25b77fe700 1 --2- 172.21.15.50:0/578035772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25b80c4c90 0x7f25b81ecf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25b77fe700 1 -- 172.21.15.50:0/578035772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b806d6a0 con 0x7f25a0006a80 2023-11-28T11:59:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25b77fe700 1 --2- 172.21.15.50:0/578035772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25a0006a80 0x7f25b8157920 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f25a800eb20 tx=0x7f25a800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f259ffff700 1 -- 172.21.15.50:0/578035772 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a800c550 con 0x7f25a0006a80 2023-11-28T11:59:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f259ffff700 1 -- 172.21.15.50:0/578035772 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a800c6b0 con 0x7f25a0006a80 2023-11-28T11:59:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f259ffff700 1 -- 172.21.15.50:0/578035772 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a800ca40 con 0x7f25a0006a80 2023-11-28T11:59:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25bcd9b700 1 -- 172.21.15.50:0/578035772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b8159230 con 0x7f25a0006a80 2023-11-28T11:59:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25bcd9b700 1 -- 172.21.15.50:0/578035772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b806d980 con 0x7f25a0006a80 2023-11-28T11:59:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.345+0000 7f25bcd9b700 1 -- 172.21.15.50:0/578035772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b8072500 con 0x7f25a0006a80 2023-11-28T11:59:23.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.349+0000 7f259ffff700 1 -- 172.21.15.50:0/578035772 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f25a800cba0 con 0x7f25a0006a80 2023-11-28T11:59:23.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.349+0000 7f259ffff700 1 --2- 172.21.15.50:0/578035772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f25a4064f10 0x7f25a40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.349+0000 7f259ffff700 1 -- 172.21.15.50:0/578035772 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f25a8081b60 con 0x7f25a0006a80 2023-11-28T11:59:23.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.349+0000 7f25b6ffd700 1 --2- 172.21.15.50:0/578035772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f25a4064f10 0x7f25a40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.349+0000 7f25b6ffd700 1 --2- 172.21.15.50:0/578035772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f25a4064f10 0x7f25a40673c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f25b80cdcb0 tx=0x7f25ac00a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.357+0000 7f259ffff700 1 -- 172.21.15.50:0/578035772 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f25a804fec0 con 0x7f25a0006a80 2023-11-28T11:59:23.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.509+0000 7f25bcd9b700 1 -- 172.21.15.50:0/578035772 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25b80b36d0 con 0x7f25a4064f10 2023-11-28T11:59:23.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.517+0000 7f259ffff700 1 -- 172.21.15.50:0/578035772 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71391 (secure 0 0 0) 0x7f25b80b36d0 con 0x7f25a4064f10 2023-11-28T11:59:23.522 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:59:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.521+0000 7f25bcd9b700 1 -- 172.21.15.50:0/578035772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f25a4064f10 msgr2=0x7f25a40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.521+0000 7f25bcd9b700 1 --2- 172.21.15.50:0/578035772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f25a4064f10 0x7f25a40673c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f25b80cdcb0 tx=0x7f25ac00a000 comp rx=0 tx=0).stop 2023-11-28T11:59:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.521+0000 7f25bcd9b700 1 -- 172.21.15.50:0/578035772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25a0006a80 msgr2=0x7f25b8157920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.521+0000 7f25bcd9b700 1 --2- 172.21.15.50:0/578035772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25a0006a80 0x7f25b8157920 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f25a800eb20 tx=0x7f25a800eee0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.521+0000 7f25bcd9b700 1 -- 172.21.15.50:0/578035772 shutdown_connections 2023-11-28T11:59:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.521+0000 7f25bcd9b700 1 --2- 172.21.15.50:0/578035772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25b8071390 0x7f25b8071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.521+0000 7f25bcd9b700 1 --2- 172.21.15.50:0/578035772 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f25a4064f10 0x7f25a40673c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.521+0000 7f25bcd9b700 1 --2- 172.21.15.50:0/578035772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25b80c4c90 0x7f25b81ecf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.521+0000 7f25bcd9b700 1 --2- 172.21.15.50:0/578035772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25a0006a80 0x7f25b8157920 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.521+0000 7f25bcd9b700 1 -- 172.21.15.50:0/578035772 >> 172.21.15.50:0/578035772 conn(0x7f25b80ce3e0 msgr2=0x7f25b806a200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.521+0000 7f25bcd9b700 1 -- 172.21.15.50:0/578035772 shutdown_connections 2023-11-28T11:59:23.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.521+0000 7f25bcd9b700 1 -- 172.21.15.50:0/578035772 wait complete. 2023-11-28T11:59:23.526 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:59:23.537 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2023-11-28T11:59:22.994314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":97752,"kb_used_data":7704,"kb_used_omap":0,"kb_used_meta":89984,"kb_avail":754876968,"statfs":{"total":773094113280,"available":772994015232,"internally_reserved":0,"allocated":7888896,"data_stored":4339928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":92143616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12288,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-6,"num_read_kb":-5,"num_write":-74,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001996"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":56,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:31.050143+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:57:31.050143+0000","last_peered":"2023-11-28T11:57:31.050143+0000","last_clean":"2023-11-28T11:57:31.050143+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:57:31.050143+0000","last_undegraded":"2023-11-28T11:57:31.050143+0000","last_fullsized":"2023-11-28T11:57:31.050143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":56,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:31.049823+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:57:31.049823+0000","last_peered":"2023-11-28T11:57:31.049823+0000","last_clean":"2023-11-28T11:57:31.049823+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:57:31.049823+0000","last_undegraded":"2023-11-28T11:57:31.049823+0000","last_fullsized":"2023-11-28T11:57:31.049823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":62,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:48.981817+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:57:48.981817+0000","last_peered":"2023-11-28T11:57:48.981817+0000","last_clean":"2023-11-28T11:57:48.981817+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:57:48.981817+0000","last_undegraded":"2023-11-28T11:57:48.981817+0000","last_fullsized":"2023-11-28T11:57:48.981817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":56,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:31.946604+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:57:31.946604+0000","last_peered":"2023-11-28T11:57:31.946604+0000","last_clean":"2023-11-28T11:57:31.946604+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:57:31.946604+0000","last_undegraded":"2023-11-28T11:57:31.946604+0000","last_fullsized":"2023-11-28T11:57:31.946604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":206,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:38.983983+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:57:38.983983+0000","last_peered":"2023-11-28T11:57:38.983983+0000","last_clean":"2023-11-28T11:57:38.983983+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:57:38.983983+0000","last_undegraded":"2023-11-28T11:57:38.983983+0000","last_fullsized":"2023-11-28T11:57:38.983983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":55,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:48.979074+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:57:48.979074+0000","last_peered":"2023-11-28T11:57:48.979074+0000","last_clean":"2023-11-28T11:57:48.979074+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:57:48.979074+0000","last_undegraded":"2023-11-28T11:57:48.979074+0000","last_fullsized":"2023-11-28T11:57:48.979074+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":57,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:48.985794+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:57:48.985794+0000","last_peered":"2023-11-28T11:57:48.985794+0000","last_clean":"2023-11-28T11:57:48.985794+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:57:48.985794+0000","last_undegraded":"2023-11-28T11:57:48.985794+0000","last_fullsized":"2023-11-28T11:57:48.985794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":65,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:48.980903+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:57:48.980903+0000","last_peered":"2023-11-28T11:57:48.980903+0000","last_clean":"2023-11-28T11:57:48.980903+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:57:48.980903+0000","last_undegraded":"2023-11-28T11:57:48.980903+0000","last_fullsized":"2023-11-28T11:57:48.980903+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":57,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:38.984019+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:57:38.984019+0000","last_peered":"2023-11-28T11:57:38.984019+0000","last_clean":"2023-11-28T11:57:38.984019+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:57:38.984019+0000","last_undegraded":"2023-11-28T11:57:38.984019+0000","last_fullsized":"2023-11-28T11:57:38.984019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574920,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11008,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":94360832,"statfs":{"total":96636764160,"available":96625491968,"internally_reserved":0,"allocated":1433600,"data_stored":985737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89600000000000002,"15min":0.91400000000000003},"min":{"1min":0.53900000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1180000000000001,"5min":1.413,"15min":1.413},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.98699999999999999,"15min":0.97599999999999998},"min":{"1min":0.76800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.258,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.68100000000000005}]},{"osd":1,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.86899999999999999,"15min":0.84199999999999997},"min":{"1min":0.63700000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.165,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.85899999999999999,"15min":0.83399999999999996},"min":{"1min":0.61599999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3720000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.7929999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.83299999999999996,"15min":0.81299999999999994},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1619999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.93100000000000005,"15min":0.92500000000000004},"min":{"1min":0.67300000000000004,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.159,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.121}]},{"osd":3,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91400000000000003,"15min":0.87},"min":{"1min":0.73399999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1799999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.244},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.97499999999999998,"15min":1},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2170000000000001,"5min":1.665,"15min":1.665},"last":0.93000000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.874,"15min":0.874},"min":{"1min":0.66100000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1619999999999999,"5min":1.264,"15min":1.264},"last":1.6890000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.98699999999999999,"15min":1.01},"min":{"1min":0.70799999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.177,"5min":1.621,"15min":1.621},"last":1.325}]},{"osd":5,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.01,"15min":1.012},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.004},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0740000000000001,"15min":1.0880000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.8540000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.91400000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.115,"15min":1.115},"min":{"1min":0.94099999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2769999999999999,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.5800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9776,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362064,"statfs":{"total":96636764160,"available":96626753536,"internally_reserved":0,"allocated":827392,"data_stored":387991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.55200000000000005,"5min":0.497,"15min":0.497},"max":{"1min":2.802,"5min":2.802,"15min":2.802},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81999999999999995,"15min":0.82899999999999996},"min":{"1min":0.66400000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.165,"5min":1.498,"15min":1.498},"last":0.72599999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.82399999999999995,"15min":0.85099999999999998},"min":{"1min":0.69099999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.145,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.93200000000000005,"15min":0.97299999999999998},"min":{"1min":0.64200000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.76300000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94799999999999995,"15min":0.95899999999999996},"min":{"1min":0.64300000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.91800000000000004,"15min":0.90800000000000003},"min":{"1min":0.63500000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.137,"5min":1.204,"15min":1.204},"last":0.81100000000000005}]},{"osd":3,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.92900000000000005,"15min":0.89600000000000002},"min":{"1min":0.68400000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1910000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89200000000000002,"15min":0.86599999999999999},"min":{"1min":0.59999999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.157,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.88900000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94399999999999995,"15min":0.95199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97699999999999998,"15min":1.0009999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.212,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.77600000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.97499999999999998,"15min":1.016},"min":{"1min":0.66200000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.079},{"interface":"front","average":{"1min":1.089,"5min":1.099,"15min":1.131},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.84899999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0549999999999999,"15min":1.0760000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2490000000000001,"5min":1.575,"15min":1.575},"last":1.107},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.054,"15min":1.0580000000000001},"min":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.127}]}]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9852,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361988,"statfs":{"total":96636764160,"available":96626675712,"internally_reserved":0,"allocated":839680,"data_stored":395845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.84899999999999998,"15min":0.84699999999999998},"min":{"1min":0.55200000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.872,"15min":0.86399999999999999},"min":{"1min":0.70099999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1299999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.01}]},{"osd":1,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90300000000000002,"15min":0.85499999999999998},"min":{"1min":0.65700000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2869999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.90300000000000002,"15min":0.91700000000000004},"min":{"1min":0.67000000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.212,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.82899999999999996}]},{"osd":2,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89600000000000002,"15min":0.85299999999999998},"min":{"1min":0.66900000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.177,"5min":1.208,"15min":1.208},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.89000000000000001,"15min":0.84999999999999998},"min":{"1min":0.748,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1970000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.751}]},{"osd":3,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.92700000000000005,"15min":0.91100000000000003},"min":{"1min":0.70999999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.274,"5min":1.403,"15min":1.403},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.995,"15min":0.99099999999999999},"min":{"1min":0.77000000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.238,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.153}]},{"osd":4,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.874,"15min":0.92100000000000004},"min":{"1min":0.65900000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1950000000000001,"5min":1.968,"15min":1.968},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.99299999999999999,"15min":1.0309999999999999},"min":{"1min":0.73399999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.171,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.0429999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.99299999999999999,"15min":1.0049999999999999},"min":{"1min":0.69199999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.373,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.008,"5min":1.0009999999999999,"15min":1.0029999999999999},"min":{"1min":0.67500000000000004,"5min":0.433,"15min":0.433},"max":{"1min":1.3520000000000001,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.871}]},{"osd":7,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.046,"15min":1.0669999999999999},"min":{"1min":0.67000000000000004,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.24,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.091,"15min":1.0940000000000001},"min":{"1min":1.018,"5min":0.623,"15min":0.623},"max":{"1min":1.3420000000000001,"5min":1.605,"15min":1.605},"last":1.2190000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10044,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361796,"statfs":{"total":96636764160,"available":96626479104,"internally_reserved":0,"allocated":839680,"data_stored":395825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.83199999999999996,"15min":0.84199999999999997},"min":{"1min":0.64800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1859999999999999,"5min":1.647,"15min":1.647},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.86599999999999999,"15min":0.85499999999999998},"min":{"1min":0.58399999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.139,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.0069999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.86299999999999999,"15min":0.86199999999999999},"min":{"1min":0.61399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.226,"5min":1.331,"15min":1.331},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.89200000000000002,"15min":0.93300000000000005},"min":{"1min":0.622,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.145,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.81599999999999995}]},{"osd":2,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.92300000000000004,"15min":0.93100000000000005},"min":{"1min":0.61499999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2909999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.91200000000000003,"15min":0.95899999999999996},"min":{"1min":0.70599999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.125,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.92000000000000004,"15min":0.93600000000000005},"min":{"1min":0.66600000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.1799999999999999,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.002,"15min":1.052},"min":{"1min":0.77600000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1759999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0509999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.96199999999999997,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.169,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.99399999999999999,"15min":1.032},"min":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1919999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.119}]},{"osd":6,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.98299999999999998,"15min":1.056},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2629999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.145},{"interface":"front","average":{"1min":1.008,"5min":1.077,"15min":1.135},"min":{"1min":0.77500000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.2330000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.091}]},{"osd":7,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.0700000000000001,"15min":1.1359999999999999},"min":{"1min":0.68300000000000005,"5min":0.502,"15min":0.502},"max":{"1min":1.3069999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1220000000000001,"15min":1.1759999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.3580000000000001,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.212}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14000,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":13184,"kb_avail":94357840,"statfs":{"total":96636764160,"available":96622428160,"internally_reserved":0,"allocated":827392,"data_stored":388011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13500416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.879,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.90800000000000003,"5min":21.122,"15min":21.122},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.95699999999999996,"15min":0.78700000000000003},"min":{"1min":0.40400000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.204,"5min":21.288,"15min":21.288},"last":0.54300000000000004}]},{"osd":1,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74199999999999999,"15min":0.64700000000000002},"min":{"1min":0.48399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.133,"5min":6.3090000000000002,"15min":6.3090000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1,"15min":0.83599999999999997},"min":{"1min":0.54500000000000004,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.91400000000000003,"5min":21.151,"15min":21.151},"last":0.89300000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76400000000000001,"15min":0.78800000000000003},"min":{"1min":0.49099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.1459999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.88600000000000001,"15min":0.879},"min":{"1min":0.63,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95099999999999996,"5min":6.5149999999999997,"15min":6.5149999999999997},"last":0.78000000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.2549999999999999,"15min":1.1040000000000001},"min":{"1min":0.61099999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.169,"5min":21.347999999999999,"15min":21.347999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.998,"5min":1.292,"15min":1.1279999999999999},"min":{"1min":0.78500000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1850000000000001,"5min":21.129999999999999,"15min":21.129999999999999},"last":0.91500000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.2749999999999999,"15min":1.165},"min":{"1min":0.70799999999999996,"5min":0.626,"15min":0.626},"max":{"1min":1.2070000000000001,"5min":21.210999999999999,"15min":21.210999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.3340000000000001,"15min":1.216},"min":{"1min":0.68799999999999994,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.331,"5min":21.32,"15min":21.32},"last":1.04}]},{"osd":6,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0669999999999999,"15min":1.103},"min":{"1min":0.75700000000000001,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2569999999999999,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.014,"5min":1.323,"15min":1.1870000000000001},"min":{"1min":0.748,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1890000000000001,"5min":21.077999999999999,"15min":21.077999999999999},"last":1.1579999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.115,"15min":1.147},"min":{"1min":0.78700000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4259999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.081},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.2170000000000001,"15min":1.1890000000000001},"min":{"1min":0.90900000000000003,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.2430000000000001,"5min":6.5750000000000002,"15min":6.5750000000000002},"last":0.85499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13896,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94357944,"statfs":{"total":96636764160,"available":96622534656,"internally_reserved":0,"allocated":851968,"data_stored":406275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63,"15min":0.59999999999999998},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90800000000000003,"5min":1.123,"15min":1.123},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71899999999999997,"15min":0.755},"min":{"1min":0.41699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.147,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.65800000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.75900000000000001},"min":{"1min":0.53100000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91500000000000004,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.623},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.64300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96099999999999997,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.875}]},{"osd":3,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68799999999999994,"15min":0.69599999999999995},"min":{"1min":0.56100000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.234,"5min":1.254,"15min":1.254},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.84399999999999997,"15min":0.82799999999999996},"min":{"1min":0.36699999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1080000000000001,"5min":1.968,"15min":1.968},"last":0.94499999999999995}]},{"osd":4,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.999,"15min":1.0329999999999999},"min":{"1min":0.74399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.177,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.014,"15min":1.0649999999999999},"min":{"1min":0.63900000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.157,"5min":2.181,"15min":2.181},"last":0.96999999999999997}]},{"osd":5,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.96099999999999997,"15min":0.97499999999999998},"min":{"1min":0.69099999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.2889999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.054},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0780000000000001,"15min":1.123},"min":{"1min":0.82599999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3660000000000001,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.1859999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.079,"15min":1.157},"min":{"1min":0.72799999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.302,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.083,"15min":1.1279999999999999},"min":{"1min":0.80600000000000005,"5min":0.621,"15min":0.621},"max":{"1min":1.3140000000000001,"5min":1.867,"15min":1.867},"last":1.232}]},{"osd":7,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1220000000000001,"15min":1.1699999999999999},"min":{"1min":0.88600000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.238,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.097,"15min":1.131},"min":{"1min":0.76800000000000002,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3720000000000001,"5min":1.675,"15min":1.675},"last":1.018}]}]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15052,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":13632,"kb_avail":94356788,"statfs":{"total":96636764160,"available":96621350912,"internally_reserved":0,"allocated":1445888,"data_stored":991359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13959168},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46600000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.98099999999999998,"5min":1.387,"15min":1.387},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.73899999999999999,"15min":0.70099999999999996},"min":{"1min":0.62,"5min":0.375,"15min":0.375},"max":{"1min":0.97899999999999998,"5min":1.252,"15min":1.252},"last":0.73799999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.52800000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.85199999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.57599999999999996,"5min":0.31,"15min":0.31},"max":{"1min":1.123,"5min":1.175,"15min":1.175},"last":0.79900000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.86599999999999999,"15min":0.872},"min":{"1min":0.57199999999999995,"5min":0.317,"15min":0.317},"max":{"1min":1.2549999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77300000000000002,"15min":0.749},"min":{"1min":0.56000000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.62}]},{"osd":4,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.91700000000000004,"15min":0.91100000000000003},"min":{"1min":0.68999999999999995,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0960000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.089},{"interface":"front","average":{"1min":1.004,"5min":1.0209999999999999,"15min":1.0629999999999999},"min":{"1min":0.79000000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5409999999999999,"5min":2.29,"15min":2.29},"last":1.3069999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0149999999999999,"15min":1.018},"min":{"1min":0.77500000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2909999999999999,"5min":1.47,"15min":1.47},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.04,"5min":1.0409999999999999,"15min":1.0449999999999999},"min":{"1min":0.80800000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.331,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.155}]},{"osd":6,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.075,"15min":1.0600000000000001},"min":{"1min":0.86799999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.365,"5min":1.581,"15min":1.581},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0720000000000001,"15min":1.0800000000000001},"min":{"1min":0.69999999999999996,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3740000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.86299999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.145,"15min":1.1930000000000001},"min":{"1min":0.93200000000000005,"5min":0.747,"15min":0.747},"max":{"1min":1.627,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.125},{"interface":"front","average":{"1min":1.155,"5min":1.1259999999999999,"15min":1.1100000000000001},"min":{"1min":0.89900000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.4079999999999999,"5min":1.647,"15min":1.647},"last":1.179}]}]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14124,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357716,"statfs":{"total":96636764160,"available":96622301184,"internally_reserved":0,"allocated":823296,"data_stored":388885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63200000000000001,"15min":0.66700000000000004},"min":{"1min":0.48999999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89200000000000002,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72899999999999998,"15min":0.68400000000000005},"min":{"1min":0.53800000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.58099999999999996}]},{"osd":2,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.503,"5min":0.435,"15min":0.435},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.76500000000000001,"15min":0.71899999999999997},"min":{"1min":0.65400000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.042,"5min":1.175,"15min":1.175},"last":0.76200000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.69699999999999995},"min":{"1min":0.53100000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.117,"5min":1.159,"15min":1.159},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90200000000000002,"15min":0.92200000000000004},"min":{"1min":0.61199999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.575,"5min":1.96,"15min":1.96},"last":0.73299999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.90700000000000003,"15min":0.879},"min":{"1min":0.73399999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0249999999999999,"15min":1.093},"min":{"1min":0.81899999999999995,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.8049999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.0569999999999999,"15min":1.069},"min":{"1min":0.78700000000000003,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.478,"5min":1.649,"15min":1.649},"last":1.081},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.75600000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3080000000000001,"5min":1.339,"15min":1.339},"last":1.151}]},{"osd":6,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.127,"15min":1.173},"min":{"1min":0.93200000000000005,"5min":0.755,"15min":0.755},"max":{"1min":1.8819999999999999,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.143,"15min":1.1419999999999999},"min":{"1min":0.93000000000000005,"5min":0.749,"15min":0.749},"max":{"1min":1.468,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.1890000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1619999999999999,"15min":1.1639999999999999},"min":{"1min":0.86699999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.125},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.107,"15min":1.087},"min":{"1min":0.998,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.367,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.242}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:59:23.544 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T11:59:23.545 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:59:23.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.657+0000 7f679a291700 1 Processor -- start 2023-11-28T11:59:23.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.657+0000 7f679a291700 1 -- start start 2023-11-28T11:59:23.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f679a291700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f679413d130 0x7f679415da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f679a291700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f679415dfd0 0x7f679406c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f679a291700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f679415a4a0 con 0x7f679413cd60 2023-11-28T11:59:23.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f679a291700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679415e550 con 0x7f679415dfd0 2023-11-28T11:59:23.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f679a291700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679415e830 con 0x7f679413d130 2023-11-28T11:59:23.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f6799a90700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f679415dfd0 0x7f679406c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f6799a90700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f679415dfd0 0x7f679406c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34498/0 (socket says 172.21.15.50:34498) 2023-11-28T11:59:23.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f6799a90700 1 -- 172.21.15.50:0/2422830532 learned_addr learned my addr 172.21.15.50:0/2422830532 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:23.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f6798a8e700 1 --2- 172.21.15.50:0/2422830532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f679413d130 0x7f679415da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f6799a90700 1 -- 172.21.15.50:0/2422830532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f679413d130 msgr2=0x7f679415da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:23.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f6799a90700 1 --2- 172.21.15.50:0/2422830532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f679413d130 0x7f679415da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f6799a90700 1 -- 172.21.15.50:0/2422830532 >> v1:172.21.15.192:6789/0 conn(0x7f679413cd60 legacy=0x7f679415af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f6799a90700 1 -- 172.21.15.50:0/2422830532 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679415a720 con 0x7f679415dfd0 2023-11-28T11:59:23.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f6799a90700 1 --2- 172.21.15.50:0/2422830532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679415dfd0 0x7f679406c640 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f678c009e50 tx=0x7f678c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dac1a936559ebb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:23.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f678bfff700 1 -- 172.21.15.50:0/2422830532 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c00e070 con 0x7f679415dfd0 2023-11-28T11:59:23.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f678bfff700 1 -- 172.21.15.50:0/2422830532 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c00b9c0 con 0x7f679415dfd0 2023-11-28T11:59:23.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f678bfff700 1 -- 172.21.15.50:0/2422830532 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c00bd70 con 0x7f679415dfd0 2023-11-28T11:59:23.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f679a291700 1 -- 172.21.15.50:0/2422830532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679415dfd0 msgr2=0x7f679406c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f679a291700 1 --2- 172.21.15.50:0/2422830532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679415dfd0 0x7f679406c640 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f678c009e50 tx=0x7f678c00b330 comp rx=0 tx=0).stop 2023-11-28T11:59:23.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f679a291700 1 -- 172.21.15.50:0/2422830532 shutdown_connections 2023-11-28T11:59:23.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f679a291700 1 --2- 172.21.15.50:0/2422830532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679415dfd0 0x7f679406c640 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f679a291700 1 --2- 172.21.15.50:0/2422830532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f679413d130 0x7f679415da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.661+0000 7f679a291700 1 -- 172.21.15.50:0/2422830532 >> 172.21.15.50:0/2422830532 conn(0x7f679406e000 msgr2=0x7f67940b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:23.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f679a291700 1 -- 172.21.15.50:0/2422830532 shutdown_connections 2023-11-28T11:59:23.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f679a291700 1 -- 172.21.15.50:0/2422830532 wait complete. 2023-11-28T11:59:23.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f679a291700 1 Processor -- start 2023-11-28T11:59:23.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f679a291700 1 -- start start 2023-11-28T11:59:23.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f679a291700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679413cd60 0x7f6794140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f679a291700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f679415dfd0 0x7f67941f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f679a291700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679415c380 0x7f679415c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f679a291700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679415cd60 con 0x7f679415c380 2023-11-28T11:59:23.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f679a291700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6794156fe0 con 0x7f679413cd60 2023-11-28T11:59:23.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f679a291700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679413f8f0 con 0x7f679415dfd0 2023-11-28T11:59:23.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f6799a90700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679415c380 0x7f679415c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f6799a90700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679415c380 0x7f679415c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34500/0 (socket says 172.21.15.50:34500) 2023-11-28T11:59:23.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f6799a90700 1 -- 172.21.15.50:0/477153327 learned_addr learned my addr 172.21.15.50:0/477153327 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:23.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f6798a8e700 1 --2- 172.21.15.50:0/477153327 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f679415dfd0 0x7f67941f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f679928f700 1 --2- 172.21.15.50:0/477153327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679413cd60 0x7f6794140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f6799a90700 1 -- 172.21.15.50:0/477153327 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f679415dfd0 msgr2=0x7f67941f21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f6799a90700 1 --2- 172.21.15.50:0/477153327 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f679415dfd0 0x7f67941f21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f6799a90700 1 -- 172.21.15.50:0/477153327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679413cd60 msgr2=0x7f6794140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f6799a90700 1 --2- 172.21.15.50:0/477153327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679413cd60 0x7f6794140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f6799a90700 1 -- 172.21.15.50:0/477153327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c009b30 con 0x7f679415c380 2023-11-28T11:59:23.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f679928f700 1 --2- 172.21.15.50:0/477153327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679413cd60 0x7f6794140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:23.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.665+0000 7f6799a90700 1 --2- 172.21.15.50:0/477153327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679415c380 0x7f679415c820 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f678c00b730 tx=0x7f678c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:23.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.669+0000 7f6789ffb700 1 -- 172.21.15.50:0/477153327 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c0048e0 con 0x7f679415c380 2023-11-28T11:59:23.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.669+0000 7f6789ffb700 1 -- 172.21.15.50:0/477153327 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c0099b0 con 0x7f679415c380 2023-11-28T11:59:23.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.669+0000 7f6789ffb700 1 -- 172.21.15.50:0/477153327 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c01b670 con 0x7f679415c380 2023-11-28T11:59:23.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.669+0000 7f679a291700 1 -- 172.21.15.50:0/477153327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6794143830 con 0x7f679415c380 2023-11-28T11:59:23.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.669+0000 7f679a291700 1 -- 172.21.15.50:0/477153327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679415aa00 con 0x7f679415c380 2023-11-28T11:59:23.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.669+0000 7f679a291700 1 -- 172.21.15.50:0/477153327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679406cb80 con 0x7f679415c380 2023-11-28T11:59:23.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.669+0000 7f6789ffb700 1 -- 172.21.15.50:0/477153327 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f678c021030 con 0x7f679415c380 2023-11-28T11:59:23.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.669+0000 7f6789ffb700 1 --2- 172.21.15.50:0/477153327 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6778064f10 0x7f67780673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.669+0000 7f6789ffb700 1 -- 172.21.15.50:0/477153327 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f678c083030 con 0x7f679415c380 2023-11-28T11:59:23.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.669+0000 7f679928f700 1 --2- 172.21.15.50:0/477153327 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6778064f10 0x7f67780673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.673+0000 7f679928f700 1 --2- 172.21.15.50:0/477153327 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6778064f10 0x7f67780673c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6790000f60 tx=0x7f6790009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:23.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.677+0000 7f6789ffb700 1 -- 172.21.15.50:0/477153327 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f678c051390 con 0x7f679415c380 2023-11-28T11:59:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.837+0000 7f679a291700 1 -- 172.21.15.50:0/477153327 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67940b15d0 con 0x7f6778064f10 2023-11-28T11:59:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.845+0000 7f6789ffb700 1 -- 172.21.15.50:0/477153327 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71391 (secure 0 0 0) 0x7f67940b15d0 con 0x7f6778064f10 2023-11-28T11:59:23.848 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:59:23.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.845+0000 7f679a291700 1 -- 172.21.15.50:0/477153327 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6778064f10 msgr2=0x7f67780673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.845+0000 7f679a291700 1 --2- 172.21.15.50:0/477153327 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6778064f10 0x7f67780673c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6790000f60 tx=0x7f6790009040 comp rx=0 tx=0).stop 2023-11-28T11:59:23.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.845+0000 7f679a291700 1 -- 172.21.15.50:0/477153327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679415c380 msgr2=0x7f679415c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.845+0000 7f679a291700 1 --2- 172.21.15.50:0/477153327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679415c380 0x7f679415c820 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f678c00b730 tx=0x7f678c004af0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.845+0000 7f679a291700 1 -- 172.21.15.50:0/477153327 shutdown_connections 2023-11-28T11:59:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.845+0000 7f679a291700 1 --2- 172.21.15.50:0/477153327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f679415c380 0x7f679415c820 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.845+0000 7f679a291700 1 --2- 172.21.15.50:0/477153327 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f679415dfd0 0x7f67941f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.845+0000 7f679a291700 1 --2- 172.21.15.50:0/477153327 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6778064f10 0x7f67780673c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.845+0000 7f679a291700 1 --2- 172.21.15.50:0/477153327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679413cd60 0x7f6794140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.845+0000 7f679a291700 1 -- 172.21.15.50:0/477153327 >> 172.21.15.50:0/477153327 conn(0x7f679406e000 msgr2=0x7f67940706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.845+0000 7f679a291700 1 -- 172.21.15.50:0/477153327 shutdown_connections 2023-11-28T11:59:23.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.845+0000 7f679a291700 1 -- 172.21.15.50:0/477153327 wait complete. 2023-11-28T11:59:23.852 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:59:23.863 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2023-11-28T11:59:22.994314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":97752,"kb_used_data":7704,"kb_used_omap":0,"kb_used_meta":89984,"kb_avail":754876968,"statfs":{"total":773094113280,"available":772994015232,"internally_reserved":0,"allocated":7888896,"data_stored":4339928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":92143616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12288,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-6,"num_read_kb":-5,"num_write":-74,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001996"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":56,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:31.050143+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:57:31.050143+0000","last_peered":"2023-11-28T11:57:31.050143+0000","last_clean":"2023-11-28T11:57:31.050143+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:57:31.050143+0000","last_undegraded":"2023-11-28T11:57:31.050143+0000","last_fullsized":"2023-11-28T11:57:31.050143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":56,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:31.049823+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:57:31.049823+0000","last_peered":"2023-11-28T11:57:31.049823+0000","last_clean":"2023-11-28T11:57:31.049823+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:57:31.049823+0000","last_undegraded":"2023-11-28T11:57:31.049823+0000","last_fullsized":"2023-11-28T11:57:31.049823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":62,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:48.981817+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:57:48.981817+0000","last_peered":"2023-11-28T11:57:48.981817+0000","last_clean":"2023-11-28T11:57:48.981817+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:57:48.981817+0000","last_undegraded":"2023-11-28T11:57:48.981817+0000","last_fullsized":"2023-11-28T11:57:48.981817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":56,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:31.946604+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:57:31.946604+0000","last_peered":"2023-11-28T11:57:31.946604+0000","last_clean":"2023-11-28T11:57:31.946604+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:57:31.946604+0000","last_undegraded":"2023-11-28T11:57:31.946604+0000","last_fullsized":"2023-11-28T11:57:31.946604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":206,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:38.983983+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:57:38.983983+0000","last_peered":"2023-11-28T11:57:38.983983+0000","last_clean":"2023-11-28T11:57:38.983983+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:57:38.983983+0000","last_undegraded":"2023-11-28T11:57:38.983983+0000","last_fullsized":"2023-11-28T11:57:38.983983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":55,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:48.979074+0000","last_change":"2023-11-28T11:53:35.378941+0000","last_active":"2023-11-28T11:57:48.979074+0000","last_peered":"2023-11-28T11:57:48.979074+0000","last_clean":"2023-11-28T11:57:48.979074+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:57:48.979074+0000","last_undegraded":"2023-11-28T11:57:48.979074+0000","last_fullsized":"2023-11-28T11:57:48.979074+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":57,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:48.985794+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:57:48.985794+0000","last_peered":"2023-11-28T11:57:48.985794+0000","last_clean":"2023-11-28T11:57:48.985794+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:57:48.985794+0000","last_undegraded":"2023-11-28T11:57:48.985794+0000","last_fullsized":"2023-11-28T11:57:48.985794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":65,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:48.980903+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:57:48.980903+0000","last_peered":"2023-11-28T11:57:48.980903+0000","last_clean":"2023-11-28T11:57:48.980903+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:57:48.980903+0000","last_undegraded":"2023-11-28T11:57:48.980903+0000","last_fullsized":"2023-11-28T11:57:48.980903+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":57,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-28T11:57:38.984019+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:57:38.984019+0000","last_peered":"2023-11-28T11:57:38.984019+0000","last_clean":"2023-11-28T11:57:38.984019+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:57:38.984019+0000","last_undegraded":"2023-11-28T11:57:38.984019+0000","last_fullsized":"2023-11-28T11:57:38.984019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574920,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11008,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":94360832,"statfs":{"total":96636764160,"available":96625491968,"internally_reserved":0,"allocated":1433600,"data_stored":985737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89600000000000002,"15min":0.91400000000000003},"min":{"1min":0.53900000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1180000000000001,"5min":1.413,"15min":1.413},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.98699999999999999,"15min":0.97599999999999998},"min":{"1min":0.76800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.258,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.68100000000000005}]},{"osd":1,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.86899999999999999,"15min":0.84199999999999997},"min":{"1min":0.63700000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.165,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.85899999999999999,"15min":0.83399999999999996},"min":{"1min":0.61599999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3720000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.7929999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.83299999999999996,"15min":0.81299999999999994},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1619999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.93100000000000005,"15min":0.92500000000000004},"min":{"1min":0.67300000000000004,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.159,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.121}]},{"osd":3,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91400000000000003,"15min":0.87},"min":{"1min":0.73399999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1799999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.244},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.97499999999999998,"15min":1},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2170000000000001,"5min":1.665,"15min":1.665},"last":0.93000000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.874,"15min":0.874},"min":{"1min":0.66100000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1619999999999999,"5min":1.264,"15min":1.264},"last":1.6890000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.98699999999999999,"15min":1.01},"min":{"1min":0.70799999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.177,"5min":1.621,"15min":1.621},"last":1.325}]},{"osd":5,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.01,"15min":1.012},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.004},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0740000000000001,"15min":1.0880000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.8540000000000001}]},{"osd":6,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.91400000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.115,"15min":1.115},"min":{"1min":0.94099999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2769999999999999,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.5800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9776,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362064,"statfs":{"total":96636764160,"available":96626753536,"internally_reserved":0,"allocated":827392,"data_stored":387991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.55200000000000005,"5min":0.497,"15min":0.497},"max":{"1min":2.802,"5min":2.802,"15min":2.802},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81999999999999995,"15min":0.82899999999999996},"min":{"1min":0.66400000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.165,"5min":1.498,"15min":1.498},"last":0.72599999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.82399999999999995,"15min":0.85099999999999998},"min":{"1min":0.69099999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.145,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.93200000000000005,"15min":0.97299999999999998},"min":{"1min":0.64200000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.76300000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94799999999999995,"15min":0.95899999999999996},"min":{"1min":0.64300000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.91800000000000004,"15min":0.90800000000000003},"min":{"1min":0.63500000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.137,"5min":1.204,"15min":1.204},"last":0.81100000000000005}]},{"osd":3,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.92900000000000005,"15min":0.89600000000000002},"min":{"1min":0.68400000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1910000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89200000000000002,"15min":0.86599999999999999},"min":{"1min":0.59999999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.157,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.88900000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94399999999999995,"15min":0.95199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97699999999999998,"15min":1.0009999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.212,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.77600000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.97499999999999998,"15min":1.016},"min":{"1min":0.66200000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.079},{"interface":"front","average":{"1min":1.089,"5min":1.099,"15min":1.131},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":0.84899999999999998}]},{"osd":7,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0549999999999999,"15min":1.0760000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2490000000000001,"5min":1.575,"15min":1.575},"last":1.107},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.054,"15min":1.0580000000000001},"min":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.127}]}]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9852,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361988,"statfs":{"total":96636764160,"available":96626675712,"internally_reserved":0,"allocated":839680,"data_stored":395845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.84899999999999998,"15min":0.84699999999999998},"min":{"1min":0.55200000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.872,"15min":0.86399999999999999},"min":{"1min":0.70099999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1299999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.01}]},{"osd":1,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90300000000000002,"15min":0.85499999999999998},"min":{"1min":0.65700000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2869999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.90300000000000002,"15min":0.91700000000000004},"min":{"1min":0.67000000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.212,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.82899999999999996}]},{"osd":2,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89600000000000002,"15min":0.85299999999999998},"min":{"1min":0.66900000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.177,"5min":1.208,"15min":1.208},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.89000000000000001,"15min":0.84999999999999998},"min":{"1min":0.748,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1970000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.751}]},{"osd":3,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.92700000000000005,"15min":0.91100000000000003},"min":{"1min":0.70999999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.274,"5min":1.403,"15min":1.403},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.995,"15min":0.99099999999999999},"min":{"1min":0.77000000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.238,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.153}]},{"osd":4,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.874,"15min":0.92100000000000004},"min":{"1min":0.65900000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1950000000000001,"5min":1.968,"15min":1.968},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.99299999999999999,"15min":1.0309999999999999},"min":{"1min":0.73399999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.171,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.0429999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.99299999999999999,"15min":1.0049999999999999},"min":{"1min":0.69199999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.373,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.008,"5min":1.0009999999999999,"15min":1.0029999999999999},"min":{"1min":0.67500000000000004,"5min":0.433,"15min":0.433},"max":{"1min":1.3520000000000001,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.871}]},{"osd":7,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.046,"15min":1.0669999999999999},"min":{"1min":0.67000000000000004,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.24,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.091,"15min":1.0940000000000001},"min":{"1min":1.018,"5min":0.623,"15min":0.623},"max":{"1min":1.3420000000000001,"5min":1.605,"15min":1.605},"last":1.2190000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10044,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361796,"statfs":{"total":96636764160,"available":96626479104,"internally_reserved":0,"allocated":839680,"data_stored":395825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.83199999999999996,"15min":0.84199999999999997},"min":{"1min":0.64800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1859999999999999,"5min":1.647,"15min":1.647},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.86599999999999999,"15min":0.85499999999999998},"min":{"1min":0.58399999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.139,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.0069999999999999}]},{"osd":1,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.86299999999999999,"15min":0.86199999999999999},"min":{"1min":0.61399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.226,"5min":1.331,"15min":1.331},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.89200000000000002,"15min":0.93300000000000005},"min":{"1min":0.622,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.145,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.81599999999999995}]},{"osd":2,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.92300000000000004,"15min":0.93100000000000005},"min":{"1min":0.61499999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2909999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.91200000000000003,"15min":0.95899999999999996},"min":{"1min":0.70599999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.125,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.92000000000000004,"15min":0.93600000000000005},"min":{"1min":0.66600000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.1799999999999999,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.002,"15min":1.052},"min":{"1min":0.77600000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1759999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0509999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.96199999999999997,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.169,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.99399999999999999,"15min":1.032},"min":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1919999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.119}]},{"osd":6,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.98299999999999998,"15min":1.056},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2629999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.145},{"interface":"front","average":{"1min":1.008,"5min":1.077,"15min":1.135},"min":{"1min":0.77500000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.2330000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.091}]},{"osd":7,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.0700000000000001,"15min":1.1359999999999999},"min":{"1min":0.68300000000000005,"5min":0.502,"15min":0.502},"max":{"1min":1.3069999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1220000000000001,"15min":1.1759999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.3580000000000001,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.212}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14000,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":13184,"kb_avail":94357840,"statfs":{"total":96636764160,"available":96622428160,"internally_reserved":0,"allocated":827392,"data_stored":388011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13500416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.879,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.90800000000000003,"5min":21.122,"15min":21.122},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.95699999999999996,"15min":0.78700000000000003},"min":{"1min":0.40400000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.204,"5min":21.288,"15min":21.288},"last":0.54300000000000004}]},{"osd":1,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74199999999999999,"15min":0.64700000000000002},"min":{"1min":0.48399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.133,"5min":6.3090000000000002,"15min":6.3090000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1,"15min":0.83599999999999997},"min":{"1min":0.54500000000000004,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.91400000000000003,"5min":21.151,"15min":21.151},"last":0.89300000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76400000000000001,"15min":0.78800000000000003},"min":{"1min":0.49099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.1459999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.88600000000000001,"15min":0.879},"min":{"1min":0.63,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95099999999999996,"5min":6.5149999999999997,"15min":6.5149999999999997},"last":0.78000000000000003}]},{"osd":4,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.2549999999999999,"15min":1.1040000000000001},"min":{"1min":0.61099999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.169,"5min":21.347999999999999,"15min":21.347999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.998,"5min":1.292,"15min":1.1279999999999999},"min":{"1min":0.78500000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1850000000000001,"5min":21.129999999999999,"15min":21.129999999999999},"last":0.91500000000000004}]},{"osd":5,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.2749999999999999,"15min":1.165},"min":{"1min":0.70799999999999996,"5min":0.626,"15min":0.626},"max":{"1min":1.2070000000000001,"5min":21.210999999999999,"15min":21.210999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.3340000000000001,"15min":1.216},"min":{"1min":0.68799999999999994,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.331,"5min":21.32,"15min":21.32},"last":1.04}]},{"osd":6,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0669999999999999,"15min":1.103},"min":{"1min":0.75700000000000001,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2569999999999999,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.014,"5min":1.323,"15min":1.1870000000000001},"min":{"1min":0.748,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1890000000000001,"5min":21.077999999999999,"15min":21.077999999999999},"last":1.1579999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.115,"15min":1.147},"min":{"1min":0.78700000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4259999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.081},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.2170000000000001,"15min":1.1890000000000001},"min":{"1min":0.90900000000000003,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.2430000000000001,"5min":6.5750000000000002,"15min":6.5750000000000002},"last":0.85499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13896,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94357944,"statfs":{"total":96636764160,"available":96622534656,"internally_reserved":0,"allocated":851968,"data_stored":406275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63,"15min":0.59999999999999998},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90800000000000003,"5min":1.123,"15min":1.123},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71899999999999997,"15min":0.755},"min":{"1min":0.41699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.147,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.65800000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.75900000000000001},"min":{"1min":0.53100000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91500000000000004,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.623},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.64300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96099999999999997,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.875}]},{"osd":3,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68799999999999994,"15min":0.69599999999999995},"min":{"1min":0.56100000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.234,"5min":1.254,"15min":1.254},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.84399999999999997,"15min":0.82799999999999996},"min":{"1min":0.36699999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1080000000000001,"5min":1.968,"15min":1.968},"last":0.94499999999999995}]},{"osd":4,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.999,"15min":1.0329999999999999},"min":{"1min":0.74399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.177,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.014,"15min":1.0649999999999999},"min":{"1min":0.63900000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.157,"5min":2.181,"15min":2.181},"last":0.96999999999999997}]},{"osd":5,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.96099999999999997,"15min":0.97499999999999998},"min":{"1min":0.69099999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.2889999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.054},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0780000000000001,"15min":1.123},"min":{"1min":0.82599999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3660000000000001,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.1859999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.079,"15min":1.157},"min":{"1min":0.72799999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.302,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.083,"15min":1.1279999999999999},"min":{"1min":0.80600000000000005,"5min":0.621,"15min":0.621},"max":{"1min":1.3140000000000001,"5min":1.867,"15min":1.867},"last":1.232}]},{"osd":7,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1220000000000001,"15min":1.1699999999999999},"min":{"1min":0.88600000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.238,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.097,"15min":1.131},"min":{"1min":0.76800000000000002,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3720000000000001,"5min":1.675,"15min":1.675},"last":1.018}]}]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15052,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":13632,"kb_avail":94356788,"statfs":{"total":96636764160,"available":96621350912,"internally_reserved":0,"allocated":1445888,"data_stored":991359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13959168},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46600000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.98099999999999998,"5min":1.387,"15min":1.387},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.73899999999999999,"15min":0.70099999999999996},"min":{"1min":0.62,"5min":0.375,"15min":0.375},"max":{"1min":0.97899999999999998,"5min":1.252,"15min":1.252},"last":0.73799999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.52800000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.85199999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.57599999999999996,"5min":0.31,"15min":0.31},"max":{"1min":1.123,"5min":1.175,"15min":1.175},"last":0.79900000000000004}]},{"osd":3,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.86599999999999999,"15min":0.872},"min":{"1min":0.57199999999999995,"5min":0.317,"15min":0.317},"max":{"1min":1.2549999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77300000000000002,"15min":0.749},"min":{"1min":0.56000000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.62}]},{"osd":4,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.91700000000000004,"15min":0.91100000000000003},"min":{"1min":0.68999999999999995,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0960000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.089},{"interface":"front","average":{"1min":1.004,"5min":1.0209999999999999,"15min":1.0629999999999999},"min":{"1min":0.79000000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5409999999999999,"5min":2.29,"15min":2.29},"last":1.3069999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0149999999999999,"15min":1.018},"min":{"1min":0.77500000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2909999999999999,"5min":1.47,"15min":1.47},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.04,"5min":1.0409999999999999,"15min":1.0449999999999999},"min":{"1min":0.80800000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.331,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.155}]},{"osd":6,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.075,"15min":1.0600000000000001},"min":{"1min":0.86799999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.365,"5min":1.581,"15min":1.581},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0720000000000001,"15min":1.0800000000000001},"min":{"1min":0.69999999999999996,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3740000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.86299999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.145,"15min":1.1930000000000001},"min":{"1min":0.93200000000000005,"5min":0.747,"15min":0.747},"max":{"1min":1.627,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.125},{"interface":"front","average":{"1min":1.155,"5min":1.1259999999999999,"15min":1.1100000000000001},"min":{"1min":0.89900000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.4079999999999999,"5min":1.647,"15min":1.647},"last":1.179}]}]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14124,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357716,"statfs":{"total":96636764160,"available":96622301184,"internally_reserved":0,"allocated":823296,"data_stored":388885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63200000000000001,"15min":0.66700000000000004},"min":{"1min":0.48999999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89200000000000002,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72899999999999998,"15min":0.68400000000000005},"min":{"1min":0.53800000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.58099999999999996}]},{"osd":2,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.503,"5min":0.435,"15min":0.435},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.76500000000000001,"15min":0.71899999999999997},"min":{"1min":0.65400000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.042,"5min":1.175,"15min":1.175},"last":0.76200000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.69699999999999995},"min":{"1min":0.53100000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.117,"5min":1.159,"15min":1.159},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90200000000000002,"15min":0.92200000000000004},"min":{"1min":0.61199999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.575,"5min":1.96,"15min":1.96},"last":0.73299999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.90700000000000003,"15min":0.879},"min":{"1min":0.73399999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0249999999999999,"15min":1.093},"min":{"1min":0.81899999999999995,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.8049999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.0569999999999999,"15min":1.069},"min":{"1min":0.78700000000000003,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.478,"5min":1.649,"15min":1.649},"last":1.081},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.75600000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3080000000000001,"5min":1.339,"15min":1.339},"last":1.151}]},{"osd":6,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.127,"15min":1.173},"min":{"1min":0.93200000000000005,"5min":0.755,"15min":0.755},"max":{"1min":1.8819999999999999,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.143,"15min":1.1419999999999999},"min":{"1min":0.93000000000000005,"5min":0.749,"15min":0.749},"max":{"1min":1.468,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.1890000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1619999999999999,"15min":1.1639999999999999},"min":{"1min":0.86699999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.125},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.107,"15min":1.087},"min":{"1min":0.998,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.367,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.242}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:59:23.865 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T11:59:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.977+0000 7f1c4db4f700 1 Processor -- start 2023-11-28T11:59:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.977+0000 7f1c4db4f700 1 -- start start 2023-11-28T11:59:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4db4f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1c48158e60 0x7f1c480c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4db4f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c480cb460 0x7f1c480cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4db4f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c480cd8f0 con 0x7f1c480ad490 2023-11-28T11:59:23.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4db4f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c480add00 con 0x7f1c480cb460 2023-11-28T11:59:23.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4db4f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c480cc4f0 con 0x7f1c48158e60 2023-11-28T11:59:23.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4d34e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1c480cb460 0x7f1c480cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c47fff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f1c480ad490 0x7f1c480cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:47956/0 (socket says 172.21.15.50:47956) 2023-11-28T11:59:23.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c47fff700 1 -- 172.21.15.50:0/797702325 learned_addr learned my addr 172.21.15.50:0/797702325 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:23.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4cb4d700 1 --2- 172.21.15.50:0/797702325 >> v2:172.21.15.192:3300/0 conn(0x7f1c48158e60 0x7f1c480c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c477fe700 1 -- 172.21.15.50:0/797702325 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638919007 0 0) 0x7f1c480cd8f0 con 0x7f1c480ad490 2023-11-28T11:59:23.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c477fe700 1 -- 172.21.15.50:0/797702325 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c300035d0 con 0x7f1c480ad490 2023-11-28T11:59:23.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4d34e700 1 -- 172.21.15.50:0/797702325 >> v2:172.21.15.192:3300/0 conn(0x7f1c48158e60 msgr2=0x7f1c480c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:23.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4d34e700 1 --2- 172.21.15.50:0/797702325 >> v2:172.21.15.192:3300/0 conn(0x7f1c48158e60 0x7f1c480c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4d34e700 1 -- 172.21.15.50:0/797702325 >> v1:172.21.15.192:6789/0 conn(0x7f1c480ad490 legacy=0x7f1c480cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4d34e700 1 -- 172.21.15.50:0/797702325 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4806dc60 con 0x7f1c480cb460 2023-11-28T11:59:23.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4d34e700 1 --2- 172.21.15.50:0/797702325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c480cb460 0x7f1c480cbfb0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1c4806f4e0 tx=0x7f1c40009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc858b74d52595a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:23.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c477fe700 1 -- 172.21.15.50:0/797702325 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40011830 con 0x7f1c480cb460 2023-11-28T11:59:23.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c477fe700 1 -- 172.21.15.50:0/797702325 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c40011990 con 0x7f1c480cb460 2023-11-28T11:59:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c477fe700 1 -- 172.21.15.50:0/797702325 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40011d00 con 0x7f1c480cb460 2023-11-28T11:59:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4db4f700 1 -- 172.21.15.50:0/797702325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c480cb460 msgr2=0x7f1c480cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4db4f700 1 --2- 172.21.15.50:0/797702325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c480cb460 0x7f1c480cbfb0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1c4806f4e0 tx=0x7f1c40009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4db4f700 1 -- 172.21.15.50:0/797702325 shutdown_connections 2023-11-28T11:59:23.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4db4f700 1 --2- 172.21.15.50:0/797702325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c480cb460 0x7f1c480cbfb0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4db4f700 1 --2- 172.21.15.50:0/797702325 >> v2:172.21.15.192:3300/0 conn(0x7f1c48158e60 0x7f1c480c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4db4f700 1 -- 172.21.15.50:0/797702325 >> 172.21.15.50:0/797702325 conn(0x7f1c480ce3e0 msgr2=0x7f1c480ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.981+0000 7f1c4db4f700 1 -- 172.21.15.50:0/797702325 shutdown_connections 2023-11-28T11:59:23.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.985+0000 7f1c4db4f700 1 -- 172.21.15.50:0/797702325 wait complete. 2023-11-28T11:59:23.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.985+0000 7f1c4db4f700 1 Processor -- start 2023-11-28T11:59:23.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.985+0000 7f1c4db4f700 1 -- start start 2023-11-28T11:59:23.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4db4f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c480ad490 0x7f1c481e0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4db4f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c480cb460 0x7f1c48154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4db4f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c48158e60 0x7f1c481551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4db4f700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c480c3db0 con 0x7f1c480ad490 2023-11-28T11:59:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4db4f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c480c3510 con 0x7f1c48158e60 2023-11-28T11:59:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4db4f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c480c37f0 con 0x7f1c480cb460 2023-11-28T11:59:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4cb4d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c480ad490 0x7f1c481e0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4cb4d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c480ad490 0x7f1c481e0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34510/0 (socket says 172.21.15.50:34510) 2023-11-28T11:59:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4cb4d700 1 -- 172.21.15.50:0/1067093665 learned_addr learned my addr 172.21.15.50:0/1067093665 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4d34e700 1 --2- 172.21.15.50:0/1067093665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c48158e60 0x7f1c481551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c47fff700 1 --2- 172.21.15.50:0/1067093665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c480cb460 0x7f1c48154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4cb4d700 1 -- 172.21.15.50:0/1067093665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c480cb460 msgr2=0x7f1c48154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4cb4d700 1 --2- 172.21.15.50:0/1067093665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c480cb460 0x7f1c48154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4cb4d700 1 -- 172.21.15.50:0/1067093665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c48158e60 msgr2=0x7f1c481551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4cb4d700 1 --2- 172.21.15.50:0/1067093665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c48158e60 0x7f1c481551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4cb4d700 1 -- 172.21.15.50:0/1067093665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c400094b0 con 0x7f1c480ad490 2023-11-28T11:59:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c47fff700 1 --2- 172.21.15.50:0/1067093665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c480cb460 0x7f1c48154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:23.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4cb4d700 1 --2- 172.21.15.50:0/1067093665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c480ad490 0x7f1c481e0b70 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00e840 tx=0x7f1c3c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c457fa700 1 -- 172.21.15.50:0/1067093665 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0095a0 con 0x7f1c480ad490 2023-11-28T11:59:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c457fa700 1 -- 172.21.15.50:0/1067093665 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c013680 con 0x7f1c480ad490 2023-11-28T11:59:23.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c457fa700 1 -- 172.21.15.50:0/1067093665 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0139f0 con 0x7f1c480ad490 2023-11-28T11:59:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4db4f700 1 -- 172.21.15.50:0/1067093665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c48159230 con 0x7f1c480ad490 2023-11-28T11:59:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.989+0000 7f1c4db4f700 1 -- 172.21.15.50:0/1067093665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c480cde90 con 0x7f1c480ad490 2023-11-28T11:59:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.993+0000 7f1c4db4f700 1 -- 172.21.15.50:0/1067093665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c4806d6a0 con 0x7f1c480ad490 2023-11-28T11:59:23.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.993+0000 7f1c457fa700 1 -- 172.21.15.50:0/1067093665 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1c3c019030 con 0x7f1c480ad490 2023-11-28T11:59:23.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.993+0000 7f1c457fa700 1 --2- 172.21.15.50:0/1067093665 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c34064ee0 0x7f1c34067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:23.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.993+0000 7f1c457fa700 1 -- 172.21.15.50:0/1067093665 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f1c3c081bb0 con 0x7f1c480ad490 2023-11-28T11:59:23.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.993+0000 7f1c47fff700 1 --2- 172.21.15.50:0/1067093665 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c34064ee0 0x7f1c34067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:23.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:23.993+0000 7f1c47fff700 1 --2- 172.21.15.50:0/1067093665 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c34064ee0 0x7f1c34067390 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1c4806b260 tx=0x7f1c38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:24.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:24.001+0000 7f1c457fa700 1 -- 172.21.15.50:0/1067093665 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1c3c04fe30 con 0x7f1c480ad490 2023-11-28T11:59:24.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:24.169+0000 7f1c4db4f700 1 -- 172.21.15.50:0/1067093665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c48072500 con 0x7f1c480ad490 2023-11-28T11:59:24.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:24.173+0000 7f1c457fa700 1 -- 172.21.15.50:0/1067093665 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+14448 (secure 0 0 0) 0x7f1c3c053450 con 0x7f1c480ad490 2023-11-28T11:59:24.176 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:59:24.176 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":71,"fsid":"cfe07b6e-9334-49cb-bc97-5dba7caa4ff8","created":"2023-11-28T11:53:23.050649+0000","modified":"2023-11-28T11:59:21.209156+0000","last_up_change":"2023-11-28T11:53:33.346012+0000","last_in_change":"2023-11-28T11:53:25.170780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T11:53:33.953532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T11:53:34.923315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b53ba5d-4fef-45d8-aab4-cd6ee5697c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":36462},{"type":"v1","addr":"172.21.15.50:6801","nonce":36462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":36462},{"type":"v1","addr":"172.21.15.50:6803","nonce":36462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":36462},{"type":"v1","addr":"172.21.15.50:6807","nonce":36462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":36462},{"type":"v1","addr":"172.21.15.50:6805","nonce":36462}]},"public_addr":"172.21.15.50:6801/36462","cluster_addr":"172.21.15.50:6803/36462","heartbeat_back_addr":"172.21.15.50:6807/36462","heartbeat_front_addr":"172.21.15.50:6805/36462","state":["exists","up"]},{"osd":1,"uuid":"d92f7604-4150-41e8-8401-f6a2a8f2ad5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":36464},{"type":"v1","addr":"172.21.15.50:6817","nonce":36464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":36464},{"type":"v1","addr":"172.21.15.50:6819","nonce":36464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":36464},{"type":"v1","addr":"172.21.15.50:6823","nonce":36464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":36464},{"type":"v1","addr":"172.21.15.50:6821","nonce":36464}]},"public_addr":"172.21.15.50:6817/36464","cluster_addr":"172.21.15.50:6819/36464","heartbeat_back_addr":"172.21.15.50:6823/36464","heartbeat_front_addr":"172.21.15.50:6821/36464","state":["exists","up"]},{"osd":2,"uuid":"a9920662-94e8-483e-b324-fb59403d4961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":36469},{"type":"v1","addr":"172.21.15.50:6825","nonce":36469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":36469},{"type":"v1","addr":"172.21.15.50:6827","nonce":36469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":36469},{"type":"v1","addr":"172.21.15.50:6831","nonce":36469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":36469},{"type":"v1","addr":"172.21.15.50:6829","nonce":36469}]},"public_addr":"172.21.15.50:6825/36469","cluster_addr":"172.21.15.50:6827/36469","heartbeat_back_addr":"172.21.15.50:6831/36469","heartbeat_front_addr":"172.21.15.50:6829/36469","state":["exists","up"]},{"osd":3,"uuid":"7a446fd9-2055-4277-a9c4-be3f0f64dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":36466},{"type":"v1","addr":"172.21.15.50:6809","nonce":36466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":36466},{"type":"v1","addr":"172.21.15.50:6811","nonce":36466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":36466},{"type":"v1","addr":"172.21.15.50:6815","nonce":36466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":36466},{"type":"v1","addr":"172.21.15.50:6813","nonce":36466}]},"public_addr":"172.21.15.50:6809/36466","cluster_addr":"172.21.15.50:6811/36466","heartbeat_back_addr":"172.21.15.50:6815/36466","heartbeat_front_addr":"172.21.15.50:6813/36466","state":["exists","up"]},{"osd":4,"uuid":"e89c0dfe-09e0-45ac-acaf-e20e49031624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":36819},{"type":"v1","addr":"172.21.15.192:6817","nonce":36819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":36819},{"type":"v1","addr":"172.21.15.192:6819","nonce":36819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":36819},{"type":"v1","addr":"172.21.15.192:6823","nonce":36819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":36819},{"type":"v1","addr":"172.21.15.192:6821","nonce":36819}]},"public_addr":"172.21.15.192:6817/36819","cluster_addr":"172.21.15.192:6819/36819","heartbeat_back_addr":"172.21.15.192:6823/36819","heartbeat_front_addr":"172.21.15.192:6821/36819","state":["exists","up"]},{"osd":5,"uuid":"24415425-6f2e-476b-ac4f-2070288bf4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":36817},{"type":"v1","addr":"172.21.15.192:6804","nonce":36817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":36817},{"type":"v1","addr":"172.21.15.192:6808","nonce":36817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":36817},{"type":"v1","addr":"172.21.15.192:6815","nonce":36817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":36817},{"type":"v1","addr":"172.21.15.192:6812","nonce":36817}]},"public_addr":"172.21.15.192:6804/36817","cluster_addr":"172.21.15.192:6808/36817","heartbeat_back_addr":"172.21.15.192:6815/36817","heartbeat_front_addr":"172.21.15.192:6812/36817","state":["exists","up"]},{"osd":6,"uuid":"3cf7e094-dd62-4b18-ac4b-5341e17e2e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":36820},{"type":"v1","addr":"172.21.15.192:6825","nonce":36820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":36820},{"type":"v1","addr":"172.21.15.192:6827","nonce":36820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":36820},{"type":"v1","addr":"172.21.15.192:6831","nonce":36820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":36820},{"type":"v1","addr":"172.21.15.192:6829","nonce":36820}]},"public_addr":"172.21.15.192:6825/36820","cluster_addr":"172.21.15.192:6827/36820","heartbeat_back_addr":"172.21.15.192:6831/36820","heartbeat_front_addr":"172.21.15.192:6829/36820","state":["exists","up"]},{"osd":7,"uuid":"034395d2-d57d-4f96-bbef-f26ceb8ebc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":36818},{"type":"v1","addr":"172.21.15.192:6801","nonce":36818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":36818},{"type":"v1","addr":"172.21.15.192:6805","nonce":36818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":36818},{"type":"v1","addr":"172.21.15.192:6813","nonce":36818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":36818},{"type":"v1","addr":"172.21.15.192:6809","nonce":36818}]},"public_addr":"172.21.15.192:6801/36818","cluster_addr":"172.21.15.192:6805/36818","heartbeat_back_addr":"172.21.15.192:6813/36818","heartbeat_front_addr":"172.21.15.192:6809/36818","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.255008+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.759551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.491865+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.995109+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.958084+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.021570+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:30.430710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T11:53:29.969781+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/3894924751":"2023-11-29T11:59:17.761740+0000","172.21.15.50:6834/3894924751":"2023-11-29T11:59:17.761740+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T11:59:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:24.173+0000 7f1c4db4f700 1 -- 172.21.15.50:0/1067093665 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c34064ee0 msgr2=0x7f1c34067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:24.173+0000 7f1c4db4f700 1 --2- 172.21.15.50:0/1067093665 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c34064ee0 0x7f1c34067390 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1c4806b260 tx=0x7f1c38009040 comp rx=0 tx=0).stop 2023-11-28T11:59:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:24.173+0000 7f1c4db4f700 1 -- 172.21.15.50:0/1067093665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c480ad490 msgr2=0x7f1c481e0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:24.173+0000 7f1c4db4f700 1 --2- 172.21.15.50:0/1067093665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c480ad490 0x7f1c481e0b70 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00e840 tx=0x7f1c3c00eb50 comp rx=0 tx=0).stop 2023-11-28T11:59:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:24.173+0000 7f1c4db4f700 1 -- 172.21.15.50:0/1067093665 shutdown_connections 2023-11-28T11:59:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:24.173+0000 7f1c4db4f700 1 --2- 172.21.15.50:0/1067093665 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1c34064ee0 0x7f1c34067390 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:24.177+0000 7f1c4db4f700 1 --2- 172.21.15.50:0/1067093665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c48158e60 0x7f1c481551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:24.177+0000 7f1c4db4f700 1 --2- 172.21.15.50:0/1067093665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c480cb460 0x7f1c48154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:24.177+0000 7f1c4db4f700 1 --2- 172.21.15.50:0/1067093665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c480ad490 0x7f1c481e0b70 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:24.177+0000 7f1c4db4f700 1 -- 172.21.15.50:0/1067093665 >> 172.21.15.50:0/1067093665 conn(0x7f1c480ce3e0 msgr2=0x7f1c48158330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:24.177+0000 7f1c4db4f700 1 -- 172.21.15.50:0/1067093665 shutdown_connections 2023-11-28T11:59:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:24.177+0000 7f1c4db4f700 1 -- 172.21.15.50:0/1067093665 wait complete. 2023-11-28T11:59:25.193 INFO:tasks.ceph:Scrubbing osd.0 2023-11-28T11:59:25.193 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-28T11:59:25.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.321+0000 7f0dff59e700 1 Processor -- start 2023-11-28T11:59:25.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.321+0000 7f0dff59e700 1 -- start start 2023-11-28T11:59:25.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dff59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e0006a4c0 0x7f0e0006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dff59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e000cf0e0 0x7f0e000cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dff59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e000cfa80 con 0x7f0e000b1ae0 2023-11-28T11:59:25.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dff59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e000d0ab0 con 0x7f0e000cf0e0 2023-11-28T11:59:25.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dff59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0006a9c0 con 0x7f0e0006a4c0 2023-11-28T11:59:25.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dfed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e000cf0e0 0x7f0e000cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dfed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e000cf0e0 0x7f0e000cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34518/0 (socket says 172.21.15.50:34518) 2023-11-28T11:59:25.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dfed9d700 1 -- 172.21.15.50:0/1620310754 learned_addr learned my addr 172.21.15.50:0/1620310754 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:25.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dfdd9b700 1 --2- 172.21.15.50:0/1620310754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e0006a4c0 0x7f0e0006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dfed9d700 1 -- 172.21.15.50:0/1620310754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e0006a4c0 msgr2=0x7f0e0006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:25.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dfed9d700 1 --2- 172.21.15.50:0/1620310754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e0006a4c0 0x7f0e0006d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dfed9d700 1 -- 172.21.15.50:0/1620310754 >> v1:172.21.15.192:6789/0 conn(0x7f0e000b1ae0 legacy=0x7f0e000d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:25.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dfed9d700 1 -- 172.21.15.50:0/1620310754 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0006aca0 con 0x7f0e000cf0e0 2023-11-28T11:59:25.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dfed9d700 1 --2- 172.21.15.50:0/1620310754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e000cf0e0 0x7f0e000cf540 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009e50 tx=0x7f0df800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1856b46767617709 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dfd59a700 1 -- 172.21.15.50:0/1620310754 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df800e070 con 0x7f0e000cf0e0 2023-11-28T11:59:25.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dfd59a700 1 -- 172.21.15.50:0/1620310754 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df8003a40 con 0x7f0e000cf0e0 2023-11-28T11:59:25.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dfd59a700 1 -- 172.21.15.50:0/1620310754 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df8003df0 con 0x7f0e000cf0e0 2023-11-28T11:59:25.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dff59e700 1 -- 172.21.15.50:0/1620310754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e000cf0e0 msgr2=0x7f0e000cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dff59e700 1 --2- 172.21.15.50:0/1620310754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e000cf0e0 0x7f0e000cf540 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009e50 tx=0x7f0df800b330 comp rx=0 tx=0).stop 2023-11-28T11:59:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dff59e700 1 -- 172.21.15.50:0/1620310754 shutdown_connections 2023-11-28T11:59:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dff59e700 1 --2- 172.21.15.50:0/1620310754 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e000cf0e0 0x7f0e000cf540 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dff59e700 1 --2- 172.21.15.50:0/1620310754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e0006a4c0 0x7f0e0006d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dff59e700 1 -- 172.21.15.50:0/1620310754 >> 172.21.15.50:0/1620310754 conn(0x7f0e0009bbd0 msgr2=0x7f0e000b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dff59e700 1 -- 172.21.15.50:0/1620310754 shutdown_connections 2023-11-28T11:59:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.325+0000 7f0dff59e700 1 -- 172.21.15.50:0/1620310754 wait complete. 2023-11-28T11:59:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dff59e700 1 Processor -- start 2023-11-28T11:59:25.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dff59e700 1 -- start start 2023-11-28T11:59:25.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dff59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e0006a4c0 0x7f0e0015d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dff59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e000b1ae0 0x7f0e001f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dff59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e000cf0e0 0x7f0e001f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dff59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e001f3190 con 0x7f0e000b1ae0 2023-11-28T11:59:25.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dff59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e001f2b80 con 0x7f0e000cf0e0 2023-11-28T11:59:25.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dff59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0015ddd0 con 0x7f0e0006a4c0 2023-11-28T11:59:25.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dfdd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e000b1ae0 0x7f0e001f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dfdd9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e000b1ae0 0x7f0e001f1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34528/0 (socket says 172.21.15.50:34528) 2023-11-28T11:59:25.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dfdd9b700 1 -- 172.21.15.50:0/3862496938 learned_addr learned my addr 172.21.15.50:0/3862496938 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:25.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dfe59c700 1 --2- 172.21.15.50:0/3862496938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e0006a4c0 0x7f0e0015d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dfed9d700 1 --2- 172.21.15.50:0/3862496938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e000cf0e0 0x7f0e001f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dfdd9b700 1 -- 172.21.15.50:0/3862496938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e0006a4c0 msgr2=0x7f0e0015d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dfdd9b700 1 --2- 172.21.15.50:0/3862496938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e0006a4c0 0x7f0e0015d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dfdd9b700 1 -- 172.21.15.50:0/3862496938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e000cf0e0 msgr2=0x7f0e001f1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dfdd9b700 1 --2- 172.21.15.50:0/3862496938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e000cf0e0 0x7f0e001f1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dfdd9b700 1 -- 172.21.15.50:0/3862496938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df8009b30 con 0x7f0e000b1ae0 2023-11-28T11:59:25.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dfdd9b700 1 --2- 172.21.15.50:0/3862496938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e000b1ae0 0x7f0e001f1920 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f0df000d7d0 tx=0x7f0df000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0df6ffd700 1 -- 172.21.15.50:0/3862496938 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df00125f0 con 0x7f0e000b1ae0 2023-11-28T11:59:25.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0df6ffd700 1 -- 172.21.15.50:0/3862496938 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df0012750 con 0x7f0e000b1ae0 2023-11-28T11:59:25.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0dff59e700 1 -- 172.21.15.50:0/3862496938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e000b4380 con 0x7f0e000b1ae0 2023-11-28T11:59:25.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.329+0000 7f0df6ffd700 1 -- 172.21.15.50:0/3862496938 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0012ae0 con 0x7f0e000b1ae0 2023-11-28T11:59:25.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.333+0000 7f0dff59e700 1 -- 172.21.15.50:0/3862496938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0006af80 con 0x7f0e000b1ae0 2023-11-28T11:59:25.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.333+0000 7f0dff59e700 1 -- 172.21.15.50:0/3862496938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0e000b1eb0 con 0x7f0e000b1ae0 2023-11-28T11:59:25.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.333+0000 7f0df6ffd700 1 -- 172.21.15.50:0/3862496938 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0df0012c40 con 0x7f0e000b1ae0 2023-11-28T11:59:25.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.333+0000 7f0df6ffd700 1 --2- 172.21.15.50:0/3862496938 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0de0064ee0 0x7f0de0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.333+0000 7f0df6ffd700 1 -- 172.21.15.50:0/3862496938 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0df0081ea0 con 0x7f0e000b1ae0 2023-11-28T11:59:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.337+0000 7f0df6ffd700 1 --2- 172.21.15.50:0/3862496938 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x7f0de006b7f0 0x7f0de006dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.337+0000 7f0dfe59c700 1 --2- 172.21.15.50:0/3862496938 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0de0064ee0 0x7f0de0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.337+0000 7f0df6ffd700 1 -- 172.21.15.50:0/3862496938 --> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0de006e2f0 con 0x7f0de006b7f0 2023-11-28T11:59:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.337+0000 7f0df6ffd700 1 -- 172.21.15.50:0/3862496938 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0df0084550 con 0x7f0e000b1ae0 2023-11-28T11:59:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.337+0000 7f0dfed9d700 1 --2- 172.21.15.50:0/3862496938 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x7f0de006b7f0 0x7f0de006dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.337+0000 7f0dfed9d700 1 --2- 172.21.15.50:0/3862496938 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x7f0de006b7f0 0x7f0de006dc20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.337+0000 7f0dfe59c700 1 --2- 172.21.15.50:0/3862496938 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0de0064ee0 0x7f0de0067390 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0e000b0fc0 tx=0x7f0de8007ee0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.337+0000 7f0df6ffd700 1 -- 172.21.15.50:0/3862496938 <== osd.0 v2:172.21.15.50:6800/36462 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0de006e2f0 con 0x7f0de006b7f0 2023-11-28T11:59:25.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.357+0000 7f0dff59e700 1 -- 172.21.15.50:0/3862496938 --> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0e00072500 con 0x7f0de006b7f0 2023-11-28T11:59:25.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.357+0000 7f0df6ffd700 1 -- 172.21.15.50:0/3862496938 <== osd.0 v2:172.21.15.50:6800/36462 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0e00072500 con 0x7f0de006b7f0 2023-11-28T11:59:25.361 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:59:25.361 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T11:59:25.361 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:59:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.357+0000 7f0dff59e700 1 -- 172.21.15.50:0/3862496938 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x7f0de006b7f0 msgr2=0x7f0de006dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.357+0000 7f0dff59e700 1 --2- 172.21.15.50:0/3862496938 >> [v2:172.21.15.50:6800/36462,v1:172.21.15.50:6801/36462] conn(0x7f0de006b7f0 0x7f0de006dc20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.357+0000 7f0dff59e700 1 -- 172.21.15.50:0/3862496938 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0de0064ee0 msgr2=0x7f0de0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.357+0000 7f0dff59e700 1 --2- 172.21.15.50:0/3862496938 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0de0064ee0 0x7f0de0067390 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0e000b0fc0 tx=0x7f0de8007ee0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.357+0000 7f0dff59e700 1 -- 172.21.15.50:0/3862496938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e000b1ae0 msgr2=0x7f0e001f1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.357+0000 7f0dff59e700 1 --2- 172.21.15.50:0/3862496938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e000b1ae0 0x7f0e001f1920 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f0df000d7d0 tx=0x7f0df000dae0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.357+0000 7f0dfed9d700 1 -- 172.21.15.50:0/3862496938 reap_dead start 2023-11-28T11:59:25.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.357+0000 7f0dff59e700 1 -- 172.21.15.50:0/3862496938 shutdown_connections 2023-11-28T11:59:25.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.357+0000 7f0dff59e700 1 -- 172.21.15.50:0/3862496938 >> 172.21.15.50:0/3862496938 conn(0x7f0e0009bbd0 msgr2=0x7f0e000d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:25.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.357+0000 7f0dff59e700 1 -- 172.21.15.50:0/3862496938 shutdown_connections 2023-11-28T11:59:25.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.357+0000 7f0dff59e700 1 -- 172.21.15.50:0/3862496938 wait complete. 2023-11-28T11:59:25.377 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-28T11:59:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fccab59e700 1 Processor -- start 2023-11-28T11:59:25.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fccab59e700 1 -- start start 2023-11-28T11:59:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fccab59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fccac1606b0 0x7fccac0c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fccab59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccac164e60 con 0x7fccac0ceef0 2023-11-28T11:59:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fccab59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccac0cae70 con 0x7fccac0ad610 2023-11-28T11:59:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fccab59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccac0cbc10 con 0x7fccac1606b0 2023-11-28T11:59:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fcca9d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fccac0ceef0 0x7fccac164040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50498/0 (socket says 172.21.15.50:50498) 2023-11-28T11:59:25.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fcca9d9b700 1 -- 172.21.15.50:0/1891126301 learned_addr learned my addr 172.21.15.50:0/1891126301 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fccaa59c700 1 --2- 172.21.15.50:0/1891126301 >> v2:172.21.15.192:3300/0 conn(0x7fccac1606b0 0x7fccac0c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fcca959a700 1 -- 172.21.15.50:0/1891126301 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496738981 0 0) 0x7fccac164e60 con 0x7fccac0ceef0 2023-11-28T11:59:25.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fcca959a700 1 -- 172.21.15.50:0/1891126301 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc8c0035d0 con 0x7fccac0ceef0 2023-11-28T11:59:25.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fccaa59c700 1 -- 172.21.15.50:0/1891126301 >> v1:172.21.15.192:6789/0 conn(0x7fccac0ad610 legacy=0x7fccac164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fccaa59c700 1 -- 172.21.15.50:0/1891126301 >> v1:172.21.15.50:6789/0 conn(0x7fccac0ceef0 legacy=0x7fccac164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fcca959a700 1 -- 172.21.15.50:0/1891126301 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 765600432 0 0) 0x7fcc8c0035d0 con 0x7fccac0ceef0 2023-11-28T11:59:25.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fccaa59c700 1 -- 172.21.15.50:0/1891126301 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac0cb130 con 0x7fccac1606b0 2023-11-28T11:59:25.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fccaa59c700 1 --2- 172.21.15.50:0/1891126301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccac1606b0 0x7fccac0c13b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c009d90 tx=0x7fcc9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b2df74040d08c36 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fcca959a700 1 -- 172.21.15.50:0/1891126301 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c00e070 con 0x7fccac1606b0 2023-11-28T11:59:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fcca959a700 1 -- 172.21.15.50:0/1891126301 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c00bb20 con 0x7fccac1606b0 2023-11-28T11:59:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.501+0000 7fcca959a700 1 -- 172.21.15.50:0/1891126301 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c00bed0 con 0x7fccac1606b0 2023-11-28T11:59:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccab59e700 1 -- 172.21.15.50:0/1891126301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccac1606b0 msgr2=0x7fccac0c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccab59e700 1 --2- 172.21.15.50:0/1891126301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccac1606b0 0x7fccac0c13b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c009d90 tx=0x7fcc9c00b330 comp rx=0 tx=0).stop 2023-11-28T11:59:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccab59e700 1 -- 172.21.15.50:0/1891126301 shutdown_connections 2023-11-28T11:59:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccab59e700 1 --2- 172.21.15.50:0/1891126301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccac1606b0 0x7fccac0c13b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccab59e700 1 -- 172.21.15.50:0/1891126301 >> 172.21.15.50:0/1891126301 conn(0x7fccac0ce3e0 msgr2=0x7fccac0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:25.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccab59e700 1 -- 172.21.15.50:0/1891126301 shutdown_connections 2023-11-28T11:59:25.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccab59e700 1 -- 172.21.15.50:0/1891126301 wait complete. 2023-11-28T11:59:25.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccab59e700 1 Processor -- start 2023-11-28T11:59:25.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccab59e700 1 -- start start 2023-11-28T11:59:25.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccab59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccac0ad610 0x7fccac15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccab59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccac0ceef0 0x7fccac15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccab59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccac1606b0 0x7fccac0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccab59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac15dcf0 con 0x7fccac1606b0 2023-11-28T11:59:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccab59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac15c920 con 0x7fccac0ceef0 2023-11-28T11:59:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccab59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac15d070 con 0x7fccac0ad610 2023-11-28T11:59:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccaad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccac1606b0 0x7fccac0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccaad9d700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccac1606b0 0x7fccac0aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34538/0 (socket says 172.21.15.50:34538) 2023-11-28T11:59:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccaad9d700 1 -- 172.21.15.50:0/259469239 learned_addr learned my addr 172.21.15.50:0/259469239 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.505+0000 7fccaa59c700 1 --2- 172.21.15.50:0/259469239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccac0ad610 0x7fccac15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fcca9d9b700 1 --2- 172.21.15.50:0/259469239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccac0ceef0 0x7fccac15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fccaad9d700 1 -- 172.21.15.50:0/259469239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccac0ad610 msgr2=0x7fccac15ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fccaad9d700 1 --2- 172.21.15.50:0/259469239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccac0ad610 0x7fccac15ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fccaad9d700 1 -- 172.21.15.50:0/259469239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccac0ceef0 msgr2=0x7fccac15c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fccaad9d700 1 --2- 172.21.15.50:0/259469239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccac0ceef0 0x7fccac15c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fccaad9d700 1 -- 172.21.15.50:0/259469239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c009a70 con 0x7fccac1606b0 2023-11-28T11:59:25.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fccaa59c700 1 --2- 172.21.15.50:0/259469239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccac0ad610 0x7fccac15ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:25.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fccaad9d700 1 --2- 172.21.15.50:0/259469239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccac1606b0 0x7fccac0aee90 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fcca400c430 tx=0x7fcca400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fcca2ffd700 1 -- 172.21.15.50:0/259469239 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca40052d0 con 0x7fccac1606b0 2023-11-28T11:59:25.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fcca2ffd700 1 -- 172.21.15.50:0/259469239 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca400ce90 con 0x7fccac1606b0 2023-11-28T11:59:25.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fccab59e700 1 -- 172.21.15.50:0/259469239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccac0cb6f0 con 0x7fccac1606b0 2023-11-28T11:59:25.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fcca2ffd700 1 -- 172.21.15.50:0/259469239 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca40036a0 con 0x7fccac1606b0 2023-11-28T11:59:25.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fccab59e700 1 -- 172.21.15.50:0/259469239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccac0cb410 con 0x7fccac1606b0 2023-11-28T11:59:25.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fccab59e700 1 -- 172.21.15.50:0/259469239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccac06ac50 con 0x7fccac1606b0 2023-11-28T11:59:25.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fcca2ffd700 1 -- 172.21.15.50:0/259469239 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcca4019030 con 0x7fccac1606b0 2023-11-28T11:59:25.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fcca2ffd700 1 --2- 172.21.15.50:0/259469239 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcc90064ee0 0x7fcc90067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fcca2ffd700 1 -- 172.21.15.50:0/259469239 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fcca4080f10 con 0x7fccac1606b0 2023-11-28T11:59:25.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.509+0000 7fccaa59c700 1 --2- 172.21.15.50:0/259469239 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcc90064ee0 0x7fcc90067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.513+0000 7fccaa59c700 1 --2- 172.21.15.50:0/259469239 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcc90064ee0 0x7fcc90067390 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c014040 tx=0x7fcc9c01d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.517+0000 7fcca2ffd700 1 -- 172.21.15.50:0/259469239 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcca404f190 con 0x7fccac1606b0 2023-11-28T11:59:25.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.677+0000 7fccab59e700 1 -- 172.21.15.50:0/259469239 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fccac15de30 con 0x7fcc90064ee0 2023-11-28T11:59:25.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.677+0000 7fcca2ffd700 1 -- 172.21.15.50:0/259469239 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fccac15de30 con 0x7fcc90064ee0 2023-11-28T11:59:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.681+0000 7fccab59e700 1 -- 172.21.15.50:0/259469239 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcc90064ee0 msgr2=0x7fcc90067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.681+0000 7fccab59e700 1 --2- 172.21.15.50:0/259469239 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcc90064ee0 0x7fcc90067390 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c014040 tx=0x7fcc9c01d040 comp rx=0 tx=0).stop 2023-11-28T11:59:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.681+0000 7fccab59e700 1 -- 172.21.15.50:0/259469239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccac1606b0 msgr2=0x7fccac0aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.681+0000 7fccab59e700 1 --2- 172.21.15.50:0/259469239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccac1606b0 0x7fccac0aee90 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fcca400c430 tx=0x7fcca400c740 comp rx=0 tx=0).stop 2023-11-28T11:59:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.681+0000 7fccab59e700 1 -- 172.21.15.50:0/259469239 shutdown_connections 2023-11-28T11:59:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.681+0000 7fccab59e700 1 --2- 172.21.15.50:0/259469239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccac1606b0 0x7fccac0aee90 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.681+0000 7fccab59e700 1 --2- 172.21.15.50:0/259469239 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fcc90064ee0 0x7fcc90067390 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.681+0000 7fccab59e700 1 --2- 172.21.15.50:0/259469239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccac0ceef0 0x7fccac15c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.681+0000 7fccab59e700 1 --2- 172.21.15.50:0/259469239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccac0ad610 0x7fccac15ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.681+0000 7fccab59e700 1 -- 172.21.15.50:0/259469239 >> 172.21.15.50:0/259469239 conn(0x7fccac0ce3e0 msgr2=0x7fccac0cd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.681+0000 7fccab59e700 1 -- 172.21.15.50:0/259469239 shutdown_connections 2023-11-28T11:59:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.681+0000 7fccab59e700 1 -- 172.21.15.50:0/259469239 wait complete. 2023-11-28T11:59:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 0 to deep-scrub 2023-11-28T11:59:25.703 INFO:tasks.ceph:Scrubbing osd.1 2023-11-28T11:59:25.703 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-28T11:59:25.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.821+0000 7f5a91ad4700 1 Processor -- start 2023-11-28T11:59:25.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.821+0000 7f5a91ad4700 1 -- start start 2023-11-28T11:59:25.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a91ad4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5a8c06b250 0x7f5a8c0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a91ad4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a8c0cb350 0x7f5a8c162b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a91ad4700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8c0ce040 con 0x7f5a8c158f10 2023-11-28T11:59:25.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a91ad4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8c0cb7d0 con 0x7f5a8c06b250 2023-11-28T11:59:25.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a91ad4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c0c9460 con 0x7f5a8c0cb350 2023-11-28T11:59:25.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a8bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5a8c06b250 0x7f5a8c0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a8bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5a8c06b250 0x7f5a8c0cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34552/0 (socket says 172.21.15.50:34552) 2023-11-28T11:59:25.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a90ad2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5a8c158f10 0x7f5a8c0cd930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50510/0 (socket says 172.21.15.50:50510) 2023-11-28T11:59:25.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a8bfff700 1 -- 172.21.15.50:0/2938421003 learned_addr learned my addr 172.21.15.50:0/2938421003 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:25.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a912d3700 1 --2- 172.21.15.50:0/2938421003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a8c0cb350 0x7f5a8c162b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a8bfff700 1 -- 172.21.15.50:0/2938421003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a8c0cb350 msgr2=0x7f5a8c162b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:25.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a8bfff700 1 --2- 172.21.15.50:0/2938421003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a8c0cb350 0x7f5a8c162b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a8bfff700 1 -- 172.21.15.50:0/2938421003 >> v1:172.21.15.50:6789/0 conn(0x7f5a8c158f10 legacy=0x7f5a8c0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a8bfff700 1 -- 172.21.15.50:0/2938421003 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c0c9fe0 con 0x7f5a8c06b250 2023-11-28T11:59:25.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a8b7fe700 1 -- 172.21.15.50:0/2938421003 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237398428 0 0) 0x7f5a80001110 con 0x7f5a8c158f10 2023-11-28T11:59:25.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a8bfff700 1 --2- 172.21.15.50:0/2938421003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c06b250 0x7f5a8c0cae10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009910 tx=0x7f5a7c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98db2df2d7e10994 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a8b7fe700 1 -- 172.21.15.50:0/2938421003 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c011830 con 0x7f5a8c06b250 2023-11-28T11:59:25.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a8b7fe700 1 -- 172.21.15.50:0/2938421003 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c011990 con 0x7f5a8c06b250 2023-11-28T11:59:25.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a8b7fe700 1 -- 172.21.15.50:0/2938421003 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c011d40 con 0x7f5a8c06b250 2023-11-28T11:59:25.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a91ad4700 1 -- 172.21.15.50:0/2938421003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c06b250 msgr2=0x7f5a8c0cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a91ad4700 1 --2- 172.21.15.50:0/2938421003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c06b250 0x7f5a8c0cae10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009910 tx=0x7f5a7c009c20 comp rx=0 tx=0).stop 2023-11-28T11:59:25.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a91ad4700 1 -- 172.21.15.50:0/2938421003 shutdown_connections 2023-11-28T11:59:25.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a91ad4700 1 --2- 172.21.15.50:0/2938421003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a8c0cb350 0x7f5a8c162b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a91ad4700 1 --2- 172.21.15.50:0/2938421003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c06b250 0x7f5a8c0cae10 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a91ad4700 1 -- 172.21.15.50:0/2938421003 >> 172.21.15.50:0/2938421003 conn(0x7f5a8c0ce400 msgr2=0x7f5a8c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:25.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a91ad4700 1 -- 172.21.15.50:0/2938421003 shutdown_connections 2023-11-28T11:59:25.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.825+0000 7f5a91ad4700 1 -- 172.21.15.50:0/2938421003 wait complete. 2023-11-28T11:59:25.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.829+0000 7f5a91ad4700 1 Processor -- start 2023-11-28T11:59:25.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.829+0000 7f5a91ad4700 1 -- start start 2023-11-28T11:59:25.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a91ad4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a8c06b250 0x7f5a8c0c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a91ad4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a8c0cb350 0x7f5a8c0ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a91ad4700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c158f10 0x7f5a8c1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a91ad4700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c0c86e0 con 0x7f5a8c158f10 2023-11-28T11:59:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a91ad4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c06be20 con 0x7f5a8c0cb350 2023-11-28T11:59:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a91ad4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c0c7e40 con 0x7f5a8c06b250 2023-11-28T11:59:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a912d3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c158f10 0x7f5a8c1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a912d3700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c158f10 0x7f5a8c1551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34566/0 (socket says 172.21.15.50:34566) 2023-11-28T11:59:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a912d3700 1 -- 172.21.15.50:0/2443821773 learned_addr learned my addr 172.21.15.50:0/2443821773 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a90ad2700 1 --2- 172.21.15.50:0/2443821773 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a8c06b250 0x7f5a8c0c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a8bfff700 1 --2- 172.21.15.50:0/2443821773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a8c0cb350 0x7f5a8c0ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a912d3700 1 -- 172.21.15.50:0/2443821773 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a8c06b250 msgr2=0x7f5a8c0c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a912d3700 1 --2- 172.21.15.50:0/2443821773 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a8c06b250 0x7f5a8c0c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a912d3700 1 -- 172.21.15.50:0/2443821773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a8c0cb350 msgr2=0x7f5a8c0ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a912d3700 1 --2- 172.21.15.50:0/2443821773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a8c0cb350 0x7f5a8c0ac810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a912d3700 1 -- 172.21.15.50:0/2443821773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c009570 con 0x7f5a8c158f10 2023-11-28T11:59:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a912d3700 1 --2- 172.21.15.50:0/2443821773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c158f10 0x7f5a8c1551e0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400efc0 tx=0x7f5a8400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a897fa700 1 -- 172.21.15.50:0/2443821773 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a84009ea0 con 0x7f5a8c158f10 2023-11-28T11:59:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a897fa700 1 -- 172.21.15.50:0/2443821773 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8400f040 con 0x7f5a8c158f10 2023-11-28T11:59:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a91ad4700 1 -- 172.21.15.50:0/2443821773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8c0c96b0 con 0x7f5a8c158f10 2023-11-28T11:59:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a897fa700 1 -- 172.21.15.50:0/2443821773 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8400ced0 con 0x7f5a8c158f10 2023-11-28T11:59:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a91ad4700 1 -- 172.21.15.50:0/2443821773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8c06dc90 con 0x7f5a8c158f10 2023-11-28T11:59:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.833+0000 7f5a91ad4700 1 -- 172.21.15.50:0/2443821773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5a8c0c9990 con 0x7f5a8c158f10 2023-11-28T11:59:25.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.837+0000 7f5a897fa700 1 -- 172.21.15.50:0/2443821773 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5a84014480 con 0x7f5a8c158f10 2023-11-28T11:59:25.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.837+0000 7f5a897fa700 1 --2- 172.21.15.50:0/2443821773 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5a78064ee0 0x7f5a78067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.837+0000 7f5a897fa700 1 -- 172.21.15.50:0/2443821773 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f5a840828d0 con 0x7f5a8c158f10 2023-11-28T11:59:25.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.837+0000 7f5a897fa700 1 --2- 172.21.15.50:0/2443821773 >> [v2:172.21.15.50:6816/36464,v1:172.21.15.50:6817/36464] conn(0x7f5a7806b680 0x7f5a7806dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.837+0000 7f5a897fa700 1 -- 172.21.15.50:0/2443821773 --> [v2:172.21.15.50:6816/36464,v1:172.21.15.50:6817/36464] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a7806e180 con 0x7f5a7806b680 2023-11-28T11:59:25.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.837+0000 7f5a897fa700 1 -- 172.21.15.50:0/2443821773 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a840872a0 con 0x7f5a8c158f10 2023-11-28T11:59:25.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.837+0000 7f5a90ad2700 1 --2- 172.21.15.50:0/2443821773 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5a78064ee0 0x7f5a78067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.837+0000 7f5a8bfff700 1 --2- 172.21.15.50:0/2443821773 >> [v2:172.21.15.50:6816/36464,v1:172.21.15.50:6817/36464] conn(0x7f5a7806b680 0x7f5a7806dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.837+0000 7f5a8bfff700 1 --2- 172.21.15.50:0/2443821773 >> [v2:172.21.15.50:6816/36464,v1:172.21.15.50:6817/36464] conn(0x7f5a7806b680 0x7f5a7806dab0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.837+0000 7f5a90ad2700 1 --2- 172.21.15.50:0/2443821773 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5a78064ee0 0x7f5a78067390 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5a80000f60 tx=0x7f5a80007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.837+0000 7f5a897fa700 1 -- 172.21.15.50:0/2443821773 <== osd.1 v2:172.21.15.50:6816/36464 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5a7806e180 con 0x7f5a7806b680 2023-11-28T11:59:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.857+0000 7f5a91ad4700 1 -- 172.21.15.50:0/2443821773 --> [v2:172.21.15.50:6816/36464,v1:172.21.15.50:6817/36464] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5a8c06bff0 con 0x7f5a7806b680 2023-11-28T11:59:25.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.857+0000 7f5a897fa700 1 -- 172.21.15.50:0/2443821773 <== osd.1 v2:172.21.15.50:6816/36464 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5a8c06bff0 con 0x7f5a7806b680 2023-11-28T11:59:25.862 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:59:25.862 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T11:59:25.862 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:59:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.857+0000 7f5a91ad4700 1 -- 172.21.15.50:0/2443821773 >> [v2:172.21.15.50:6816/36464,v1:172.21.15.50:6817/36464] conn(0x7f5a7806b680 msgr2=0x7f5a7806dab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.857+0000 7f5a91ad4700 1 --2- 172.21.15.50:0/2443821773 >> [v2:172.21.15.50:6816/36464,v1:172.21.15.50:6817/36464] conn(0x7f5a7806b680 0x7f5a7806dab0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.861+0000 7f5a91ad4700 1 -- 172.21.15.50:0/2443821773 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5a78064ee0 msgr2=0x7f5a78067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.861+0000 7f5a91ad4700 1 --2- 172.21.15.50:0/2443821773 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f5a78064ee0 0x7f5a78067390 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5a80000f60 tx=0x7f5a80007e90 comp rx=0 tx=0).stop 2023-11-28T11:59:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.861+0000 7f5a91ad4700 1 -- 172.21.15.50:0/2443821773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c158f10 msgr2=0x7f5a8c1551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.861+0000 7f5a91ad4700 1 --2- 172.21.15.50:0/2443821773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a8c158f10 0x7f5a8c1551e0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400efc0 tx=0x7f5a8400c3a0 comp rx=0 tx=0).stop 2023-11-28T11:59:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.861+0000 7f5a912d3700 1 -- 172.21.15.50:0/2443821773 reap_dead start 2023-11-28T11:59:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.861+0000 7f5a91ad4700 1 -- 172.21.15.50:0/2443821773 shutdown_connections 2023-11-28T11:59:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.861+0000 7f5a91ad4700 1 -- 172.21.15.50:0/2443821773 >> 172.21.15.50:0/2443821773 conn(0x7f5a8c0ce400 msgr2=0x7f5a8c0ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.861+0000 7f5a91ad4700 1 -- 172.21.15.50:0/2443821773 shutdown_connections 2023-11-28T11:59:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.861+0000 7f5a91ad4700 1 -- 172.21.15.50:0/2443821773 wait complete. 2023-11-28T11:59:25.875 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-28T11:59:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feefffff700 1 Processor -- start 2023-11-28T11:59:25.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feefffff700 1 -- start start 2023-11-28T11:59:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feefffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fef0006cae0 0x7fef000b2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feefffff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef00152f80 con 0x7fef0006c640 2023-11-28T11:59:25.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feefffff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef00159a30 con 0x7fef00152bb0 2023-11-28T11:59:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feefffff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef0006cf40 con 0x7fef0006cae0 2023-11-28T11:59:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feefe7fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fef0006c640 0x7fef000b2020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50526/0 (socket says 172.21.15.50:50526) 2023-11-28T11:59:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feefe7fc700 1 -- 172.21.15.50:0/3162618645 learned_addr learned my addr 172.21.15.50:0/3162618645 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:25.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feeff7fe700 1 --2- 172.21.15.50:0/3162618645 >> v2:172.21.15.50:3300/0 conn(0x7fef0006cae0 0x7fef000b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feefdffb700 1 -- 172.21.15.50:0/3162618645 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995679717 0 0) 0x7fef00152f80 con 0x7fef0006c640 2023-11-28T11:59:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feefdffb700 1 -- 172.21.15.50:0/3162618645 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeec0035d0 con 0x7fef0006c640 2023-11-28T11:59:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feeff7fe700 1 -- 172.21.15.50:0/3162618645 >> v1:172.21.15.192:6789/0 conn(0x7fef00152bb0 legacy=0x7fef0015caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feeff7fe700 1 -- 172.21.15.50:0/3162618645 >> v1:172.21.15.50:6789/0 conn(0x7fef0006c640 legacy=0x7fef000b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feeff7fe700 1 -- 172.21.15.50:0/3162618645 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef00158eb0 con 0x7fef0006cae0 2023-11-28T11:59:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feeff7fe700 1 --2- 172.21.15.50:0/3162618645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef0006cae0 0x7fef000b2730 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7feef00097d0 tx=0x7feef0009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd55d1ea4574b62 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feefdffb700 1 -- 172.21.15.50:0/3162618645 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0004230 con 0x7fef0006cae0 2023-11-28T11:59:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feefdffb700 1 -- 172.21.15.50:0/3162618645 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef0004390 con 0x7fef0006cae0 2023-11-28T11:59:25.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.993+0000 7feefdffb700 1 -- 172.21.15.50:0/3162618645 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef00036c0 con 0x7fef0006cae0 2023-11-28T11:59:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feefffff700 1 -- 172.21.15.50:0/3162618645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef0006cae0 msgr2=0x7fef000b2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feefffff700 1 --2- 172.21.15.50:0/3162618645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef0006cae0 0x7fef000b2730 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7feef00097d0 tx=0x7feef0009ae0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feefffff700 1 -- 172.21.15.50:0/3162618645 shutdown_connections 2023-11-28T11:59:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feefffff700 1 --2- 172.21.15.50:0/3162618645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef0006cae0 0x7fef000b2730 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feefffff700 1 -- 172.21.15.50:0/3162618645 >> 172.21.15.50:0/3162618645 conn(0x7fef0006e000 msgr2=0x7fef000b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feefffff700 1 -- 172.21.15.50:0/3162618645 shutdown_connections 2023-11-28T11:59:26.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feefffff700 1 -- 172.21.15.50:0/3162618645 wait complete. 2023-11-28T11:59:26.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feefffff700 1 Processor -- start 2023-11-28T11:59:26.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feefffff700 1 -- start start 2023-11-28T11:59:26.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feefffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef0006c640 0x7fef00148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feefffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef0006cae0 0x7fef000b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feefffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef00152bb0 0x7fef0014f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feefffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef001491e0 con 0x7fef00152bb0 2023-11-28T11:59:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feefffff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef00149d70 con 0x7fef0006cae0 2023-11-28T11:59:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feefffff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef00149fc0 con 0x7fef0006c640 2023-11-28T11:59:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feeff7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef00152bb0 0x7fef0014f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feeff7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef00152bb0 0x7fef0014f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34592/0 (socket says 172.21.15.50:34592) 2023-11-28T11:59:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feeff7fe700 1 -- 172.21.15.50:0/3606035628 learned_addr learned my addr 172.21.15.50:0/3606035628 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:25.997+0000 7feefe7fc700 1 --2- 172.21.15.50:0/3606035628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef0006cae0 0x7fef000b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feefeffd700 1 --2- 172.21.15.50:0/3606035628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef0006c640 0x7fef00148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feeff7fe700 1 -- 172.21.15.50:0/3606035628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef0006c640 msgr2=0x7fef00148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feeff7fe700 1 --2- 172.21.15.50:0/3606035628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef0006c640 0x7fef00148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feeff7fe700 1 -- 172.21.15.50:0/3606035628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef0006cae0 msgr2=0x7fef000b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feeff7fe700 1 --2- 172.21.15.50:0/3606035628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef0006cae0 0x7fef000b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feeff7fe700 1 -- 172.21.15.50:0/3606035628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef00094b0 con 0x7fef00152bb0 2023-11-28T11:59:26.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feefe7fc700 1 --2- 172.21.15.50:0/3606035628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef0006cae0 0x7fef000b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:26.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feefeffd700 1 --2- 172.21.15.50:0/3606035628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef0006c640 0x7fef00148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T11:59:26.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feeff7fe700 1 --2- 172.21.15.50:0/3606035628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef00152bb0 0x7fef0014f380 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7feef0004000 tx=0x7feef0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feef77fe700 1 -- 172.21.15.50:0/3606035628 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0011630 con 0x7fef00152bb0 2023-11-28T11:59:26.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feef77fe700 1 -- 172.21.15.50:0/3606035628 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef001f070 con 0x7fef00152bb0 2023-11-28T11:59:26.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feefffff700 1 -- 172.21.15.50:0/3606035628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef00159470 con 0x7fef00152bb0 2023-11-28T11:59:26.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feef77fe700 1 -- 172.21.15.50:0/3606035628 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef00119f0 con 0x7fef00152bb0 2023-11-28T11:59:26.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feefffff700 1 -- 172.21.15.50:0/3606035628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef00159190 con 0x7fef00152bb0 2023-11-28T11:59:26.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feefffff700 1 -- 172.21.15.50:0/3606035628 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef00159750 con 0x7fef00152bb0 2023-11-28T11:59:26.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feef77fe700 1 -- 172.21.15.50:0/3606035628 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feef0017020 con 0x7fef00152bb0 2023-11-28T11:59:26.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feef77fe700 1 --2- 172.21.15.50:0/3606035628 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7feee0064ee0 0x7feee0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feef77fe700 1 -- 172.21.15.50:0/3606035628 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7feef0021070 con 0x7fef00152bb0 2023-11-28T11:59:26.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.001+0000 7feefeffd700 1 --2- 172.21.15.50:0/3606035628 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7feee0064ee0 0x7feee0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.005+0000 7feefeffd700 1 --2- 172.21.15.50:0/3606035628 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7feee0064ee0 0x7feee0067390 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fef000b3310 tx=0x7feee8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.009+0000 7feef77fe700 1 -- 172.21.15.50:0/3606035628 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feef0051a30 con 0x7fef00152bb0 2023-11-28T11:59:26.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.169+0000 7feefffff700 1 -- 172.21.15.50:0/3606035628 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fef00072c20 con 0x7feee0064ee0 2023-11-28T11:59:26.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.173+0000 7feef77fe700 1 -- 172.21.15.50:0/3606035628 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fef00072c20 con 0x7feee0064ee0 2023-11-28T11:59:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.177+0000 7feefffff700 1 -- 172.21.15.50:0/3606035628 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7feee0064ee0 msgr2=0x7feee0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.177+0000 7feefffff700 1 --2- 172.21.15.50:0/3606035628 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7feee0064ee0 0x7feee0067390 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fef000b3310 tx=0x7feee8009040 comp rx=0 tx=0).stop 2023-11-28T11:59:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.177+0000 7feefffff700 1 -- 172.21.15.50:0/3606035628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef00152bb0 msgr2=0x7fef0014f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.177+0000 7feefffff700 1 --2- 172.21.15.50:0/3606035628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef00152bb0 0x7fef0014f380 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7feef0004000 tx=0x7feef0004770 comp rx=0 tx=0).stop 2023-11-28T11:59:26.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.177+0000 7feefffff700 1 -- 172.21.15.50:0/3606035628 shutdown_connections 2023-11-28T11:59:26.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.177+0000 7feefffff700 1 --2- 172.21.15.50:0/3606035628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef00152bb0 0x7fef0014f380 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.177+0000 7feefffff700 1 --2- 172.21.15.50:0/3606035628 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7feee0064ee0 0x7feee0067390 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.177+0000 7feefffff700 1 --2- 172.21.15.50:0/3606035628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef0006cae0 0x7fef000b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.177+0000 7feefffff700 1 --2- 172.21.15.50:0/3606035628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef0006c640 0x7fef00148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.177+0000 7feefffff700 1 -- 172.21.15.50:0/3606035628 >> 172.21.15.50:0/3606035628 conn(0x7fef0006e000 msgr2=0x7fef00157f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:26.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.177+0000 7feefffff700 1 -- 172.21.15.50:0/3606035628 shutdown_connections 2023-11-28T11:59:26.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.177+0000 7feefffff700 1 -- 172.21.15.50:0/3606035628 wait complete. 2023-11-28T11:59:26.181 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 1 to deep-scrub 2023-11-28T11:59:26.194 INFO:tasks.ceph:Scrubbing osd.2 2023-11-28T11:59:26.194 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-28T11:59:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.309+0000 7fe767fff700 1 Processor -- start 2023-11-28T11:59:26.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.309+0000 7fe767fff700 1 -- start start 2023-11-28T11:59:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe767fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe76806ce60 0x7fe7680b8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe767fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7680cf110 0x7fe7680cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe767fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7680d0460 con 0x7fe7680d1e30 2023-11-28T11:59:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe767fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7680d3390 con 0x7fe7680cf110 2023-11-28T11:59:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe767fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7680d2380 con 0x7fe76806ce60 2023-11-28T11:59:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe7677fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7680cf110 0x7fe7680cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe75e7fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe7680d1e30 0x7fe76806d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50528/0 (socket says 172.21.15.50:50528) 2023-11-28T11:59:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe75e7fc700 1 -- 172.21.15.50:0/3424457972 learned_addr learned my addr 172.21.15.50:0/3424457972 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:26.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe766ffd700 1 --2- 172.21.15.50:0/3424457972 >> v2:172.21.15.192:3300/0 conn(0x7fe76806ce60 0x7fe7680b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe7677fe700 1 -- 172.21.15.50:0/3424457972 >> v2:172.21.15.192:3300/0 conn(0x7fe76806ce60 msgr2=0x7fe7680b8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe7677fe700 1 --2- 172.21.15.50:0/3424457972 >> v2:172.21.15.192:3300/0 conn(0x7fe76806ce60 0x7fe7680b8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe7677fe700 1 -- 172.21.15.50:0/3424457972 >> v1:172.21.15.50:6789/0 conn(0x7fe7680d1e30 legacy=0x7fe76806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe7677fe700 1 -- 172.21.15.50:0/3424457972 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7680d2f00 con 0x7fe7680cf110 2023-11-28T11:59:26.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe766ffd700 1 --2- 172.21.15.50:0/3424457972 >> v2:172.21.15.192:3300/0 conn(0x7fe76806ce60 0x7fe7680b8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe7677fe700 1 --2- 172.21.15.50:0/3424457972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7680cf110 0x7fe7680cf550 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe76808b820 tx=0x7fe76000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dde3cc37b564d5c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe7667fc700 1 -- 172.21.15.50:0/3424457972 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76000e070 con 0x7fe7680cf110 2023-11-28T11:59:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe7667fc700 1 -- 172.21.15.50:0/3424457972 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76000bbd0 con 0x7fe7680cf110 2023-11-28T11:59:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe7667fc700 1 -- 172.21.15.50:0/3424457972 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760012430 con 0x7fe7680cf110 2023-11-28T11:59:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe767fff700 1 -- 172.21.15.50:0/3424457972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7680cf110 msgr2=0x7fe7680cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe767fff700 1 --2- 172.21.15.50:0/3424457972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7680cf110 0x7fe7680cf550 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe76808b820 tx=0x7fe76000b330 comp rx=0 tx=0).stop 2023-11-28T11:59:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe767fff700 1 -- 172.21.15.50:0/3424457972 shutdown_connections 2023-11-28T11:59:26.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe767fff700 1 --2- 172.21.15.50:0/3424457972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7680cf110 0x7fe7680cf550 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe767fff700 1 --2- 172.21.15.50:0/3424457972 >> v2:172.21.15.192:3300/0 conn(0x7fe76806ce60 0x7fe7680b8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe767fff700 1 -- 172.21.15.50:0/3424457972 >> 172.21.15.50:0/3424457972 conn(0x7fe76809bbd0 msgr2=0x7fe7680b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe767fff700 1 -- 172.21.15.50:0/3424457972 shutdown_connections 2023-11-28T11:59:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.313+0000 7fe767fff700 1 -- 172.21.15.50:0/3424457972 wait complete. 2023-11-28T11:59:26.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.317+0000 7fe767fff700 1 Processor -- start 2023-11-28T11:59:26.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.317+0000 7fe767fff700 1 -- start start 2023-11-28T11:59:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe767fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe76806ce60 0x7fe7681f1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe767fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7680cf110 0x7fe7681e6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe767fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7680d1e30 0x7fe76815dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe767fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7681e6a80 con 0x7fe76806ce60 2023-11-28T11:59:26.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe767fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7681521b0 con 0x7fe7680cf110 2023-11-28T11:59:26.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe767fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe768152b40 con 0x7fe7680d1e30 2023-11-28T11:59:26.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe766ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe76806ce60 0x7fe7681f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe766ffd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe76806ce60 0x7fe7681f1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34614/0 (socket says 172.21.15.50:34614) 2023-11-28T11:59:26.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe766ffd700 1 -- 172.21.15.50:0/2596621713 learned_addr learned my addr 172.21.15.50:0/2596621713 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:26.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe75e7fc700 1 --2- 172.21.15.50:0/2596621713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7680cf110 0x7fe7681e6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe7677fe700 1 --2- 172.21.15.50:0/2596621713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7680d1e30 0x7fe76815dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe766ffd700 1 -- 172.21.15.50:0/2596621713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7680d1e30 msgr2=0x7fe76815dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe766ffd700 1 --2- 172.21.15.50:0/2596621713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7680d1e30 0x7fe76815dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe766ffd700 1 -- 172.21.15.50:0/2596621713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7680cf110 msgr2=0x7fe7681e6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe766ffd700 1 --2- 172.21.15.50:0/2596621713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7680cf110 0x7fe7681e6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe766ffd700 1 -- 172.21.15.50:0/2596621713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe760009a70 con 0x7fe76806ce60 2023-11-28T11:59:26.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe7677fe700 1 --2- 172.21.15.50:0/2596621713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7680d1e30 0x7fe76815dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:26.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe766ffd700 1 --2- 172.21.15.50:0/2596621713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe76806ce60 0x7fe7681f1780 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fe75800e810 tx=0x7fe75800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe764ff9700 1 -- 172.21.15.50:0/2596621713 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758004230 con 0x7fe76806ce60 2023-11-28T11:59:26.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe764ff9700 1 -- 172.21.15.50:0/2596621713 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7580043b0 con 0x7fe76806ce60 2023-11-28T11:59:26.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe767fff700 1 -- 172.21.15.50:0/2596621713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7680d25d0 con 0x7fe76806ce60 2023-11-28T11:59:26.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe764ff9700 1 -- 172.21.15.50:0/2596621713 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7580036c0 con 0x7fe76806ce60 2023-11-28T11:59:26.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe767fff700 1 -- 172.21.15.50:0/2596621713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76815c700 con 0x7fe76806ce60 2023-11-28T11:59:26.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.321+0000 7fe767fff700 1 -- 172.21.15.50:0/2596621713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe7680d28b0 con 0x7fe76806ce60 2023-11-28T11:59:26.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.325+0000 7fe764ff9700 1 -- 172.21.15.50:0/2596621713 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe758022070 con 0x7fe76806ce60 2023-11-28T11:59:26.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.325+0000 7fe764ff9700 1 --2- 172.21.15.50:0/2596621713 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe748064ee0 0x7fe748067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.325+0000 7fe764ff9700 1 -- 172.21.15.50:0/2596621713 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fe7580816b0 con 0x7fe76806ce60 2023-11-28T11:59:26.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.325+0000 7fe764ff9700 1 --2- 172.21.15.50:0/2596621713 >> [v2:172.21.15.50:6824/36469,v1:172.21.15.50:6825/36469] conn(0x7fe74806b7f0 0x7fe74806dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.325+0000 7fe764ff9700 1 -- 172.21.15.50:0/2596621713 --> [v2:172.21.15.50:6824/36469,v1:172.21.15.50:6825/36469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe74806e2f0 con 0x7fe74806b7f0 2023-11-28T11:59:26.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.325+0000 7fe764ff9700 1 -- 172.21.15.50:0/2596621713 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe758083d60 con 0x7fe76806ce60 2023-11-28T11:59:26.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.325+0000 7fe7677fe700 1 --2- 172.21.15.50:0/2596621713 >> [v2:172.21.15.50:6824/36469,v1:172.21.15.50:6825/36469] conn(0x7fe74806b7f0 0x7fe74806dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.325+0000 7fe75e7fc700 1 --2- 172.21.15.50:0/2596621713 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe748064ee0 0x7fe748067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.325+0000 7fe7677fe700 1 --2- 172.21.15.50:0/2596621713 >> [v2:172.21.15.50:6824/36469,v1:172.21.15.50:6825/36469] conn(0x7fe74806b7f0 0x7fe74806dc20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.325+0000 7fe75e7fc700 1 --2- 172.21.15.50:0/2596621713 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe748064ee0 0x7fe748067390 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe7680c9380 tx=0x7fe750009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.325+0000 7fe764ff9700 1 -- 172.21.15.50:0/2596621713 <== osd.2 v2:172.21.15.50:6824/36469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe74806e2f0 con 0x7fe74806b7f0 2023-11-28T11:59:26.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.345+0000 7fe767fff700 1 -- 172.21.15.50:0/2596621713 --> [v2:172.21.15.50:6824/36469,v1:172.21.15.50:6825/36469] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe768152320 con 0x7fe74806b7f0 2023-11-28T11:59:26.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.345+0000 7fe764ff9700 1 -- 172.21.15.50:0/2596621713 <== osd.2 v2:172.21.15.50:6824/36469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe768152320 con 0x7fe74806b7f0 2023-11-28T11:59:26.350 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:59:26.350 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T11:59:26.350 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:59:26.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.345+0000 7fe767fff700 1 -- 172.21.15.50:0/2596621713 >> [v2:172.21.15.50:6824/36469,v1:172.21.15.50:6825/36469] conn(0x7fe74806b7f0 msgr2=0x7fe74806dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.345+0000 7fe767fff700 1 --2- 172.21.15.50:0/2596621713 >> [v2:172.21.15.50:6824/36469,v1:172.21.15.50:6825/36469] conn(0x7fe74806b7f0 0x7fe74806dc20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.345+0000 7fe767fff700 1 -- 172.21.15.50:0/2596621713 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe748064ee0 msgr2=0x7fe748067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.345+0000 7fe767fff700 1 --2- 172.21.15.50:0/2596621713 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fe748064ee0 0x7fe748067390 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe7680c9380 tx=0x7fe750009040 comp rx=0 tx=0).stop 2023-11-28T11:59:26.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.345+0000 7fe767fff700 1 -- 172.21.15.50:0/2596621713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe76806ce60 msgr2=0x7fe7681f1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.345+0000 7fe767fff700 1 --2- 172.21.15.50:0/2596621713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe76806ce60 0x7fe7681f1780 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fe75800e810 tx=0x7fe75800eb20 comp rx=0 tx=0).stop 2023-11-28T11:59:26.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.345+0000 7fe7677fe700 1 -- 172.21.15.50:0/2596621713 reap_dead start 2023-11-28T11:59:26.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.345+0000 7fe767fff700 1 -- 172.21.15.50:0/2596621713 shutdown_connections 2023-11-28T11:59:26.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.345+0000 7fe767fff700 1 -- 172.21.15.50:0/2596621713 >> 172.21.15.50:0/2596621713 conn(0x7fe76809bbd0 msgr2=0x7fe7680b7830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:26.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.345+0000 7fe767fff700 1 -- 172.21.15.50:0/2596621713 shutdown_connections 2023-11-28T11:59:26.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.345+0000 7fe767fff700 1 -- 172.21.15.50:0/2596621713 wait complete. 2023-11-28T11:59:26.362 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-28T11:59:26.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38bcadd700 1 Processor -- start 2023-11-28T11:59:26.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38bcadd700 1 -- start start 2023-11-28T11:59:26.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38bcadd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f38b8158e60 0x7f38b80c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38bcadd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f38b80ad490 0x7f38b80cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38bcadd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b80cd8f0 con 0x7f38b80cad50 2023-11-28T11:59:26.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38bcadd700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b80add00 con 0x7f38b80ad490 2023-11-28T11:59:26.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38bcadd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b80cc4f0 con 0x7f38b8158e60 2023-11-28T11:59:26.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38b6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f38b80ad490 0x7f38b80cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38b6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f38b80ad490 0x7f38b80cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34620/0 (socket says 172.21.15.50:34620) 2023-11-28T11:59:26.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38b6ffd700 1 -- 172.21.15.50:0/2613638915 learned_addr learned my addr 172.21.15.50:0/2613638915 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:26.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38b77fe700 1 --2- 172.21.15.50:0/2613638915 >> v2:172.21.15.192:3300/0 conn(0x7f38b8158e60 0x7f38b80c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38b67fc700 1 -- 172.21.15.50:0/2613638915 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585773870 0 0) 0x7f38b80cd8f0 con 0x7f38b80cad50 2023-11-28T11:59:26.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38b6ffd700 1 -- 172.21.15.50:0/2613638915 >> v2:172.21.15.192:3300/0 conn(0x7f38b8158e60 msgr2=0x7f38b80c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:26.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38b6ffd700 1 --2- 172.21.15.50:0/2613638915 >> v2:172.21.15.192:3300/0 conn(0x7f38b8158e60 0x7f38b80c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38b6ffd700 1 -- 172.21.15.50:0/2613638915 >> v1:172.21.15.50:6789/0 conn(0x7f38b80cad50 legacy=0x7f38b806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38b6ffd700 1 -- 172.21.15.50:0/2613638915 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b806dc60 con 0x7f38b80ad490 2023-11-28T11:59:26.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38b6ffd700 1 --2- 172.21.15.50:0/2613638915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b80ad490 0x7f38b80cbfb0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f38b806f4e0 tx=0x7f38a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86204bef4c6ed20 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38b67fc700 1 -- 172.21.15.50:0/2613638915 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a800e070 con 0x7f38b80ad490 2023-11-28T11:59:26.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38b67fc700 1 -- 172.21.15.50:0/2613638915 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a800b980 con 0x7f38b80ad490 2023-11-28T11:59:26.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.481+0000 7f38b67fc700 1 -- 172.21.15.50:0/2613638915 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a800bd30 con 0x7f38b80ad490 2023-11-28T11:59:26.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.485+0000 7f38bcadd700 1 -- 172.21.15.50:0/2613638915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b80ad490 msgr2=0x7f38b80cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.485+0000 7f38bcadd700 1 --2- 172.21.15.50:0/2613638915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b80ad490 0x7f38b80cbfb0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f38b806f4e0 tx=0x7f38a800b330 comp rx=0 tx=0).stop 2023-11-28T11:59:26.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.485+0000 7f38bcadd700 1 -- 172.21.15.50:0/2613638915 shutdown_connections 2023-11-28T11:59:26.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.485+0000 7f38bcadd700 1 --2- 172.21.15.50:0/2613638915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b80ad490 0x7f38b80cbfb0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.485+0000 7f38bcadd700 1 --2- 172.21.15.50:0/2613638915 >> v2:172.21.15.192:3300/0 conn(0x7f38b8158e60 0x7f38b80c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.485+0000 7f38bcadd700 1 -- 172.21.15.50:0/2613638915 >> 172.21.15.50:0/2613638915 conn(0x7f38b80ce3e0 msgr2=0x7f38b80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:26.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.485+0000 7f38bcadd700 1 -- 172.21.15.50:0/2613638915 shutdown_connections 2023-11-28T11:59:26.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.485+0000 7f38bcadd700 1 -- 172.21.15.50:0/2613638915 wait complete. 2023-11-28T11:59:26.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.485+0000 7f38bcadd700 1 Processor -- start 2023-11-28T11:59:26.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.485+0000 7f38bcadd700 1 -- start start 2023-11-28T11:59:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38bcadd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b80ad490 0x7f38b806aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38bcadd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38b80cad50 0x7f38b80b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38bcadd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b8158e60 0x7f38b81eee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38bcadd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b80c54b0 con 0x7f38b8158e60 2023-11-28T11:59:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38bcadd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b809b5d0 con 0x7f38b80ad490 2023-11-28T11:59:26.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38bcadd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b809b8b0 con 0x7f38b80cad50 2023-11-28T11:59:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38b7fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b8158e60 0x7f38b81eee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38b77fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b80ad490 0x7f38b806aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38b77fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b80ad490 0x7f38b806aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:54400/0 (socket says 172.21.15.50:54400) 2023-11-28T11:59:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38b77fe700 1 -- 172.21.15.50:0/3734877065 learned_addr learned my addr 172.21.15.50:0/3734877065 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38b6ffd700 1 --2- 172.21.15.50:0/3734877065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38b80cad50 0x7f38b80b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38b7fff700 1 -- 172.21.15.50:0/3734877065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38b80cad50 msgr2=0x7f38b80b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38b7fff700 1 --2- 172.21.15.50:0/3734877065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38b80cad50 0x7f38b80b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38b7fff700 1 -- 172.21.15.50:0/3734877065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b80ad490 msgr2=0x7f38b806aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38b7fff700 1 --2- 172.21.15.50:0/3734877065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b80ad490 0x7f38b806aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38b7fff700 1 -- 172.21.15.50:0/3734877065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a8009b30 con 0x7f38b8158e60 2023-11-28T11:59:26.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38b7fff700 1 --2- 172.21.15.50:0/3734877065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b8158e60 0x7f38b81eee90 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f38b000c3e0 tx=0x7f38b000c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38affff700 1 -- 172.21.15.50:0/3734877065 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b00052d0 con 0x7f38b8158e60 2023-11-28T11:59:26.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38affff700 1 -- 172.21.15.50:0/3734877065 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b0005450 con 0x7f38b8158e60 2023-11-28T11:59:26.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38bcadd700 1 -- 172.21.15.50:0/3734877065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b8159230 con 0x7f38b8158e60 2023-11-28T11:59:26.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38affff700 1 -- 172.21.15.50:0/3734877065 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b00038e0 con 0x7f38b8158e60 2023-11-28T11:59:26.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.489+0000 7f38bcadd700 1 -- 172.21.15.50:0/3734877065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b80cde90 con 0x7f38b8158e60 2023-11-28T11:59:26.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.493+0000 7f38affff700 1 -- 172.21.15.50:0/3734877065 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f38b0019030 con 0x7f38b8158e60 2023-11-28T11:59:26.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.493+0000 7f38bcadd700 1 -- 172.21.15.50:0/3734877065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b806d6a0 con 0x7f38b8158e60 2023-11-28T11:59:26.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.493+0000 7f38affff700 1 --2- 172.21.15.50:0/3734877065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3898064ee0 0x7f3898067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.493+0000 7f38affff700 1 -- 172.21.15.50:0/3734877065 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f38b0080eb0 con 0x7f38b8158e60 2023-11-28T11:59:26.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.493+0000 7f38b77fe700 1 --2- 172.21.15.50:0/3734877065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3898064ee0 0x7f3898067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.493+0000 7f38b77fe700 1 --2- 172.21.15.50:0/3734877065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3898064ee0 0x7f3898067390 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f38a0007b10 tx=0x7f38a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.501+0000 7f38affff700 1 -- 172.21.15.50:0/3734877065 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f38b004f210 con 0x7f38b8158e60 2023-11-28T11:59:26.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.669+0000 7f38bcadd700 1 -- 172.21.15.50:0/3734877065 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f38b80ca3d0 con 0x7f3898064ee0 2023-11-28T11:59:26.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.669+0000 7f38affff700 1 -- 172.21.15.50:0/3734877065 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38b80ca3d0 con 0x7f3898064ee0 2023-11-28T11:59:26.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.669+0000 7f38bcadd700 1 -- 172.21.15.50:0/3734877065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3898064ee0 msgr2=0x7f3898067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.669+0000 7f38bcadd700 1 --2- 172.21.15.50:0/3734877065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3898064ee0 0x7f3898067390 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f38a0007b10 tx=0x7f38a0008040 comp rx=0 tx=0).stop 2023-11-28T11:59:26.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.669+0000 7f38bcadd700 1 -- 172.21.15.50:0/3734877065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b8158e60 msgr2=0x7f38b81eee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.669+0000 7f38bcadd700 1 --2- 172.21.15.50:0/3734877065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b8158e60 0x7f38b81eee90 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f38b000c3e0 tx=0x7f38b000c6f0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.669+0000 7f38bcadd700 1 -- 172.21.15.50:0/3734877065 shutdown_connections 2023-11-28T11:59:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.669+0000 7f38bcadd700 1 --2- 172.21.15.50:0/3734877065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b8158e60 0x7f38b81eee90 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.669+0000 7f38bcadd700 1 --2- 172.21.15.50:0/3734877065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38b80cad50 0x7f38b80b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.669+0000 7f38bcadd700 1 --2- 172.21.15.50:0/3734877065 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f3898064ee0 0x7f3898067390 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.669+0000 7f38bcadd700 1 --2- 172.21.15.50:0/3734877065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b80ad490 0x7f38b806aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.669+0000 7f38bcadd700 1 -- 172.21.15.50:0/3734877065 >> 172.21.15.50:0/3734877065 conn(0x7f38b80ce3e0 msgr2=0x7f38b80ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.669+0000 7f38bcadd700 1 -- 172.21.15.50:0/3734877065 shutdown_connections 2023-11-28T11:59:26.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.669+0000 7f38bcadd700 1 -- 172.21.15.50:0/3734877065 wait complete. 2023-11-28T11:59:26.676 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 2 to deep-scrub 2023-11-28T11:59:26.687 INFO:tasks.ceph:Scrubbing osd.3 2023-11-28T11:59:26.687 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-28T11:59:26.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.801+0000 7f6939075700 1 Processor -- start 2023-11-28T11:59:26.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.801+0000 7f6939075700 1 -- start start 2023-11-28T11:59:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f6939075700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f69340b1ae0 0x7f693406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f6939075700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693406a9c0 con 0x7f693406a4c0 2023-11-28T11:59:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f6939075700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693406aca0 con 0x7f69340cf0e0 2023-11-28T11:59:26.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f6939075700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69340d0ab0 con 0x7f69340b1ae0 2023-11-28T11:59:26.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f6933fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f69340b1ae0 0x7f693406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f692bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f693406a4c0 0x7f69340d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50548/0 (socket says 172.21.15.50:50548) 2023-11-28T11:59:26.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f692bfff700 1 -- 172.21.15.50:0/2004045551 learned_addr learned my addr 172.21.15.50:0/2004045551 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:26.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f6933fff700 1 -- 172.21.15.50:0/2004045551 >> v1:172.21.15.192:6789/0 conn(0x7f69340cf0e0 legacy=0x7f69340cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f6933fff700 1 -- 172.21.15.50:0/2004045551 >> v1:172.21.15.50:6789/0 conn(0x7f693406a4c0 legacy=0x7f69340d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f6933fff700 1 -- 172.21.15.50:0/2004045551 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693406af80 con 0x7f69340b1ae0 2023-11-28T11:59:26.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f69337fe700 1 -- 172.21.15.50:0/2004045551 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280742011 0 0) 0x7f693406a9c0 con 0x7f693406a4c0 2023-11-28T11:59:26.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f6933fff700 1 --2- 172.21.15.50:0/2004045551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69340b1ae0 0x7f693406d8e0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f6924009850 tx=0x7f6924009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282c9a446fd651cf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f69337fe700 1 -- 172.21.15.50:0/2004045551 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924011830 con 0x7f69340b1ae0 2023-11-28T11:59:26.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f69337fe700 1 -- 172.21.15.50:0/2004045551 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6924011990 con 0x7f69340b1ae0 2023-11-28T11:59:26.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f69337fe700 1 -- 172.21.15.50:0/2004045551 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924011d20 con 0x7f69340b1ae0 2023-11-28T11:59:26.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f6939075700 1 -- 172.21.15.50:0/2004045551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69340b1ae0 msgr2=0x7f693406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f6939075700 1 --2- 172.21.15.50:0/2004045551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69340b1ae0 0x7f693406d8e0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f6924009850 tx=0x7f6924009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:26.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f6939075700 1 -- 172.21.15.50:0/2004045551 shutdown_connections 2023-11-28T11:59:26.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f6939075700 1 --2- 172.21.15.50:0/2004045551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69340b1ae0 0x7f693406d8e0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f6939075700 1 -- 172.21.15.50:0/2004045551 >> 172.21.15.50:0/2004045551 conn(0x7f693409bbd0 msgr2=0x7f69340b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:26.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f6939075700 1 -- 172.21.15.50:0/2004045551 shutdown_connections 2023-11-28T11:59:26.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.805+0000 7f6939075700 1 -- 172.21.15.50:0/2004045551 wait complete. 2023-11-28T11:59:26.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.809+0000 7f6939075700 1 Processor -- start 2023-11-28T11:59:26.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.809+0000 7f6939075700 1 -- start start 2023-11-28T11:59:26.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.809+0000 7f6939075700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f693406a4c0 0x7f6934159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.809+0000 7f6939075700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69340b1ae0 0x7f693415d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.809+0000 7f6939075700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69340cf0e0 0x7f69341f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.809+0000 7f6939075700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6934159760 con 0x7f69340b1ae0 2023-11-28T11:59:26.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.809+0000 7f6939075700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69340c6150 con 0x7f69340cf0e0 2023-11-28T11:59:26.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.809+0000 7f6939075700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69340c6fb0 con 0x7f693406a4c0 2023-11-28T11:59:26.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.809+0000 7f692bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69340b1ae0 0x7f693415d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.809+0000 7f692bfff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69340b1ae0 0x7f693415d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34658/0 (socket says 172.21.15.50:34658) 2023-11-28T11:59:26.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.809+0000 7f692bfff700 1 -- 172.21.15.50:0/4000568589 learned_addr learned my addr 172.21.15.50:0/4000568589 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:26.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.809+0000 7f6938874700 1 --2- 172.21.15.50:0/4000568589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69340cf0e0 0x7f69341f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.809+0000 7f6933fff700 1 --2- 172.21.15.50:0/4000568589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f693406a4c0 0x7f6934159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.809+0000 7f692bfff700 1 -- 172.21.15.50:0/4000568589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f693406a4c0 msgr2=0x7f6934159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.809+0000 7f692bfff700 1 --2- 172.21.15.50:0/4000568589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f693406a4c0 0x7f6934159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.809+0000 7f692bfff700 1 -- 172.21.15.50:0/4000568589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69340cf0e0 msgr2=0x7f69341f2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.813+0000 7f692bfff700 1 --2- 172.21.15.50:0/4000568589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69340cf0e0 0x7f69341f2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.813+0000 7f692bfff700 1 -- 172.21.15.50:0/4000568589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240094b0 con 0x7f69340b1ae0 2023-11-28T11:59:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.813+0000 7f692bfff700 1 --2- 172.21.15.50:0/4000568589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69340b1ae0 0x7f693415d0e0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f691c00c4a0 tx=0x7f691c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.813+0000 7f69317fa700 1 -- 172.21.15.50:0/4000568589 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c004ca0 con 0x7f69340b1ae0 2023-11-28T11:59:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.813+0000 7f69317fa700 1 -- 172.21.15.50:0/4000568589 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c004e00 con 0x7f69340b1ae0 2023-11-28T11:59:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.813+0000 7f69317fa700 1 -- 172.21.15.50:0/4000568589 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c007310 con 0x7f69340b1ae0 2023-11-28T11:59:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.813+0000 7f6939075700 1 -- 172.21.15.50:0/4000568589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69340b1eb0 con 0x7f69340b1ae0 2023-11-28T11:59:26.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.813+0000 7f6939075700 1 -- 172.21.15.50:0/4000568589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69340b4380 con 0x7f69340b1ae0 2023-11-28T11:59:26.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.813+0000 7f6939075700 1 -- 172.21.15.50:0/4000568589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f69340b60e0 con 0x7f69340b1ae0 2023-11-28T11:59:26.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.813+0000 7f69317fa700 1 -- 172.21.15.50:0/4000568589 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f691c01a020 con 0x7f69340b1ae0 2023-11-28T11:59:26.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.813+0000 7f69317fa700 1 --2- 172.21.15.50:0/4000568589 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6914064ee0 0x7f6914067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.817+0000 7f69317fa700 1 -- 172.21.15.50:0/4000568589 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f691c0817c0 con 0x7f69340b1ae0 2023-11-28T11:59:26.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.817+0000 7f69317fa700 1 --2- 172.21.15.50:0/4000568589 >> [v2:172.21.15.50:6808/36466,v1:172.21.15.50:6809/36466] conn(0x7f691406b7f0 0x7f691406dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.817+0000 7f69317fa700 1 -- 172.21.15.50:0/4000568589 --> [v2:172.21.15.50:6808/36466,v1:172.21.15.50:6809/36466] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f691406e2f0 con 0x7f691406b7f0 2023-11-28T11:59:26.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.817+0000 7f69317fa700 1 -- 172.21.15.50:0/4000568589 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f691c083da0 con 0x7f69340b1ae0 2023-11-28T11:59:26.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.817+0000 7f6933fff700 1 --2- 172.21.15.50:0/4000568589 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6914064ee0 0x7f6914067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.817+0000 7f6938874700 1 --2- 172.21.15.50:0/4000568589 >> [v2:172.21.15.50:6808/36466,v1:172.21.15.50:6809/36466] conn(0x7f691406b7f0 0x7f691406dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.817+0000 7f6938874700 1 --2- 172.21.15.50:0/4000568589 >> [v2:172.21.15.50:6808/36466,v1:172.21.15.50:6809/36466] conn(0x7f691406b7f0 0x7f691406dc20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.817+0000 7f6933fff700 1 --2- 172.21.15.50:0/4000568589 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6914064ee0 0x7f6914067390 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6924014040 tx=0x7f6924008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.817+0000 7f69317fa700 1 -- 172.21.15.50:0/4000568589 <== osd.3 v2:172.21.15.50:6808/36466 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f691406e2f0 con 0x7f691406b7f0 2023-11-28T11:59:26.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.833+0000 7f6939075700 1 -- 172.21.15.50:0/4000568589 --> [v2:172.21.15.50:6808/36466,v1:172.21.15.50:6809/36466] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6934072500 con 0x7f691406b7f0 2023-11-28T11:59:26.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.833+0000 7f69317fa700 1 -- 172.21.15.50:0/4000568589 <== osd.3 v2:172.21.15.50:6808/36466 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6934072500 con 0x7f691406b7f0 2023-11-28T11:59:26.837 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:59:26.837 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T11:59:26.837 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:59:26.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.833+0000 7f6939075700 1 -- 172.21.15.50:0/4000568589 >> [v2:172.21.15.50:6808/36466,v1:172.21.15.50:6809/36466] conn(0x7f691406b7f0 msgr2=0x7f691406dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.833+0000 7f6939075700 1 --2- 172.21.15.50:0/4000568589 >> [v2:172.21.15.50:6808/36466,v1:172.21.15.50:6809/36466] conn(0x7f691406b7f0 0x7f691406dc20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.833+0000 7f6939075700 1 -- 172.21.15.50:0/4000568589 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6914064ee0 msgr2=0x7f6914067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.833+0000 7f6939075700 1 --2- 172.21.15.50:0/4000568589 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f6914064ee0 0x7f6914067390 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6924014040 tx=0x7f6924008030 comp rx=0 tx=0).stop 2023-11-28T11:59:26.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.833+0000 7f6939075700 1 -- 172.21.15.50:0/4000568589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69340b1ae0 msgr2=0x7f693415d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.833+0000 7f6939075700 1 --2- 172.21.15.50:0/4000568589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69340b1ae0 0x7f693415d0e0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f691c00c4a0 tx=0x7f691c00c7b0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.833+0000 7f6938874700 1 -- 172.21.15.50:0/4000568589 reap_dead start 2023-11-28T11:59:26.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.833+0000 7f6939075700 1 -- 172.21.15.50:0/4000568589 shutdown_connections 2023-11-28T11:59:26.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.833+0000 7f6939075700 1 -- 172.21.15.50:0/4000568589 >> 172.21.15.50:0/4000568589 conn(0x7f693409bbd0 msgr2=0x7f693406cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:26.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.833+0000 7f6939075700 1 -- 172.21.15.50:0/4000568589 shutdown_connections 2023-11-28T11:59:26.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.833+0000 7f6939075700 1 -- 172.21.15.50:0/4000568589 wait complete. 2023-11-28T11:59:26.849 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-28T11:59:26.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fcb59e700 1 Processor -- start 2023-11-28T11:59:26.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fcb59e700 1 -- start start 2023-11-28T11:59:26.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fcb59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fcc0b2470 0x7f1fcc069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fcb59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1fcc06cd50 0x7f1fcc1643e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fcb59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fcc146c80 con 0x7f1fcc149d20 2023-11-28T11:59:26.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fcb59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fcc146100 con 0x7f1fcc06cd50 2023-11-28T11:59:26.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fcb59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc1463e0 con 0x7f1fcc0b2470 2023-11-28T11:59:26.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fc9d9b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1fcc149d20 0x7f1fcc06c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50558/0 (socket says 172.21.15.50:50558) 2023-11-28T11:59:26.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fc9d9b700 1 -- 172.21.15.50:0/4062233495 learned_addr learned my addr 172.21.15.50:0/4062233495 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:26.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fca59c700 1 --2- 172.21.15.50:0/4062233495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fcc0b2470 0x7f1fcc069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fcad9d700 1 --2- 172.21.15.50:0/4062233495 >> v2:172.21.15.192:3300/0 conn(0x7f1fcc06cd50 0x7f1fcc1643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fc959a700 1 -- 172.21.15.50:0/4062233495 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980271787 0 0) 0x7f1fcc146c80 con 0x7f1fcc149d20 2023-11-28T11:59:26.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fc959a700 1 -- 172.21.15.50:0/4062233495 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fb80035d0 con 0x7f1fcc149d20 2023-11-28T11:59:26.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fc959a700 1 -- 172.21.15.50:0/4062233495 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 970840060 0 0) 0x7f1fb80035d0 con 0x7f1fcc149d20 2023-11-28T11:59:26.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fcad9d700 1 -- 172.21.15.50:0/4062233495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fcc0b2470 msgr2=0x7f1fcc069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:26.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fcad9d700 1 --2- 172.21.15.50:0/4062233495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fcc0b2470 0x7f1fcc069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fcad9d700 1 -- 172.21.15.50:0/4062233495 >> v1:172.21.15.50:6789/0 conn(0x7f1fcc149d20 legacy=0x7f1fcc06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fcad9d700 1 -- 172.21.15.50:0/4062233495 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc1466c0 con 0x7f1fcc06cd50 2023-11-28T11:59:26.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fca59c700 1 --2- 172.21.15.50:0/4062233495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fcc0b2470 0x7f1fcc069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:26.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fcad9d700 1 --2- 172.21.15.50:0/4062233495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fcc06cd50 0x7f1fcc1643e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009850 tx=0x7f1fbc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88dc47ca486b7651 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fc959a700 1 -- 172.21.15.50:0/4062233495 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc40019f0 con 0x7f1fcc06cd50 2023-11-28T11:59:26.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fc959a700 1 -- 172.21.15.50:0/4062233495 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fbc004030 con 0x7f1fcc06cd50 2023-11-28T11:59:26.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fc959a700 1 -- 172.21.15.50:0/4062233495 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc0043a0 con 0x7f1fcc06cd50 2023-11-28T11:59:26.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fcb59e700 1 -- 172.21.15.50:0/4062233495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fcc06cd50 msgr2=0x7f1fcc1643e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fcb59e700 1 --2- 172.21.15.50:0/4062233495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fcc06cd50 0x7f1fcc1643e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009850 tx=0x7f1fbc009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:26.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fcb59e700 1 -- 172.21.15.50:0/4062233495 shutdown_connections 2023-11-28T11:59:26.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.969+0000 7f1fcb59e700 1 --2- 172.21.15.50:0/4062233495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fcc06cd50 0x7f1fcc1643e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fcb59e700 1 --2- 172.21.15.50:0/4062233495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fcc0b2470 0x7f1fcc069c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fcb59e700 1 -- 172.21.15.50:0/4062233495 >> 172.21.15.50:0/4062233495 conn(0x7f1fcc06e000 msgr2=0x7f1fcc0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:26.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fcb59e700 1 -- 172.21.15.50:0/4062233495 shutdown_connections 2023-11-28T11:59:26.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fcb59e700 1 -- 172.21.15.50:0/4062233495 wait complete. 2023-11-28T11:59:26.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fcb59e700 1 Processor -- start 2023-11-28T11:59:26.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fcb59e700 1 -- start start 2023-11-28T11:59:26.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fcb59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fcc06cd50 0x7f1fcc135e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fcb59e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fcc0b2470 0x7f1fcc0b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fcb59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fcc149d20 0x7f1fcc1f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fcb59e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc136370 con 0x7f1fcc0b2470 2023-11-28T11:59:26.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fcb59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc1627c0 con 0x7f1fcc149d20 2023-11-28T11:59:26.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fcb59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc161bb0 con 0x7f1fcc06cd50 2023-11-28T11:59:26.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fc9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fcc0b2470 0x7f1fcc0b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fc9d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fcc0b2470 0x7f1fcc0b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34668/0 (socket says 172.21.15.50:34668) 2023-11-28T11:59:26.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fc9d9b700 1 -- 172.21.15.50:0/3814120627 learned_addr learned my addr 172.21.15.50:0/3814120627 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:26.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fcad9d700 1 --2- 172.21.15.50:0/3814120627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fcc149d20 0x7f1fcc1f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fca59c700 1 --2- 172.21.15.50:0/3814120627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fcc06cd50 0x7f1fcc135e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fc9d9b700 1 -- 172.21.15.50:0/3814120627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fcc06cd50 msgr2=0x7f1fcc135e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fc9d9b700 1 --2- 172.21.15.50:0/3814120627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fcc06cd50 0x7f1fcc135e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fc9d9b700 1 -- 172.21.15.50:0/3814120627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fcc149d20 msgr2=0x7f1fcc1f5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:26.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fc9d9b700 1 --2- 172.21.15.50:0/3814120627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fcc149d20 0x7f1fcc1f5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:26.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fc9d9b700 1 -- 172.21.15.50:0/3814120627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb40094b0 con 0x7f1fcc0b2470 2023-11-28T11:59:26.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.973+0000 7f1fca59c700 1 --2- 172.21.15.50:0/3814120627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fcc06cd50 0x7f1fcc135e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:26.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.977+0000 7f1fc9d9b700 1 --2- 172.21.15.50:0/3814120627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fcc0b2470 0x7f1fcc0b1250 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4001940 tx=0x7f1fc400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.977+0000 7f1fc2ffd700 1 -- 172.21.15.50:0/3814120627 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc400ad80 con 0x7f1fcc0b2470 2023-11-28T11:59:26.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.977+0000 7f1fc2ffd700 1 -- 172.21.15.50:0/3814120627 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc40070d0 con 0x7f1fcc0b2470 2023-11-28T11:59:26.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.977+0000 7f1fcb59e700 1 -- 172.21.15.50:0/3814120627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fbc0094b0 con 0x7f1fcc0b2470 2023-11-28T11:59:26.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.977+0000 7f1fc2ffd700 1 -- 172.21.15.50:0/3814120627 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4007480 con 0x7f1fcc0b2470 2023-11-28T11:59:26.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.977+0000 7f1fcb59e700 1 -- 172.21.15.50:0/3814120627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fcc145db0 con 0x7f1fcc0b2470 2023-11-28T11:59:26.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.977+0000 7f1fcb59e700 1 -- 172.21.15.50:0/3814120627 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fcc1469a0 con 0x7f1fcc0b2470 2023-11-28T11:59:26.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.981+0000 7f1fc2ffd700 1 -- 172.21.15.50:0/3814120627 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1fc4010070 con 0x7f1fcc0b2470 2023-11-28T11:59:26.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.981+0000 7f1fc2ffd700 1 --2- 172.21.15.50:0/3814120627 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1fac064ee0 0x7f1fac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:26.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.981+0000 7f1fc2ffd700 1 -- 172.21.15.50:0/3814120627 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f1fc4081b80 con 0x7f1fcc0b2470 2023-11-28T11:59:26.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.981+0000 7f1fca59c700 1 --2- 172.21.15.50:0/3814120627 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1fac064ee0 0x7f1fac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:26.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.981+0000 7f1fca59c700 1 --2- 172.21.15.50:0/3814120627 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1fac064ee0 0x7f1fac067390 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009dd0 tx=0x7f1fb4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:26.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:26.985+0000 7f1fc2ffd700 1 -- 172.21.15.50:0/3814120627 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1fc404fee0 con 0x7f1fcc0b2470 2023-11-28T11:59:27.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.153+0000 7f1fcb59e700 1 -- 172.21.15.50:0/3814120627 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fcc0b2840 con 0x7f1fac064ee0 2023-11-28T11:59:27.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.157+0000 7f1fc2ffd700 1 -- 172.21.15.50:0/3814120627 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1fcc0b2840 con 0x7f1fac064ee0 2023-11-28T11:59:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.157+0000 7f1fcb59e700 1 -- 172.21.15.50:0/3814120627 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1fac064ee0 msgr2=0x7f1fac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.157+0000 7f1fcb59e700 1 --2- 172.21.15.50:0/3814120627 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1fac064ee0 0x7f1fac067390 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009dd0 tx=0x7f1fb4008040 comp rx=0 tx=0).stop 2023-11-28T11:59:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.157+0000 7f1fcb59e700 1 -- 172.21.15.50:0/3814120627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fcc0b2470 msgr2=0x7f1fcc0b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.157+0000 7f1fcb59e700 1 --2- 172.21.15.50:0/3814120627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fcc0b2470 0x7f1fcc0b1250 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4001940 tx=0x7f1fc400a340 comp rx=0 tx=0).stop 2023-11-28T11:59:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.157+0000 7f1fcb59e700 1 -- 172.21.15.50:0/3814120627 shutdown_connections 2023-11-28T11:59:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.157+0000 7f1fcb59e700 1 --2- 172.21.15.50:0/3814120627 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1fac064ee0 0x7f1fac067390 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.157+0000 7f1fcb59e700 1 --2- 172.21.15.50:0/3814120627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fcc149d20 0x7f1fcc1f5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.157+0000 7f1fcb59e700 1 --2- 172.21.15.50:0/3814120627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fcc0b2470 0x7f1fcc0b1250 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.157+0000 7f1fcb59e700 1 --2- 172.21.15.50:0/3814120627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fcc06cd50 0x7f1fcc135e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.157+0000 7f1fcb59e700 1 -- 172.21.15.50:0/3814120627 >> 172.21.15.50:0/3814120627 conn(0x7f1fcc06e000 msgr2=0x7f1fcc1470c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.161+0000 7f1fcb59e700 1 -- 172.21.15.50:0/3814120627 shutdown_connections 2023-11-28T11:59:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.161+0000 7f1fcb59e700 1 -- 172.21.15.50:0/3814120627 wait complete. 2023-11-28T11:59:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 3 to deep-scrub 2023-11-28T11:59:27.180 INFO:tasks.ceph:Scrubbing osd.4 2023-11-28T11:59:27.181 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-28T11:59:27.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.301+0000 7ff380b13700 1 Processor -- start 2023-11-28T11:59:27.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.301+0000 7ff380b13700 1 -- start start 2023-11-28T11:59:27.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.301+0000 7ff380b13700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff37c158f10 0x7ff37c06b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.301+0000 7ff380b13700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff37c0cd930 0x7ff37c0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.301+0000 7ff380b13700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37c0c9460 con 0x7ff37c0cdd40 2023-11-28T11:59:27.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.301+0000 7ff380b13700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37c0c9fe0 con 0x7ff37c0cd930 2023-11-28T11:59:27.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.301+0000 7ff380b13700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37c06dc90 con 0x7ff37c158f10 2023-11-28T11:59:27.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.301+0000 7ff37bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff37c0cdd40 0x7ff37c069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50574/0 (socket says 172.21.15.50:50574) 2023-11-28T11:59:27.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.301+0000 7ff37bfff700 1 -- 172.21.15.50:0/433322596 learned_addr learned my addr 172.21.15.50:0/433322596 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:27.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.301+0000 7ff37affd700 1 --2- 172.21.15.50:0/433322596 >> v2:172.21.15.50:3300/0 conn(0x7ff37c0cd930 0x7ff37c0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff37b7fe700 1 --2- 172.21.15.50:0/433322596 >> v2:172.21.15.192:3300/0 conn(0x7ff37c158f10 0x7ff37c06b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff37a7fc700 1 -- 172.21.15.50:0/433322596 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481186175 0 0) 0x7ff37c0c9460 con 0x7ff37c0cdd40 2023-11-28T11:59:27.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff37a7fc700 1 -- 172.21.15.50:0/433322596 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3640035d0 con 0x7ff37c0cdd40 2023-11-28T11:59:27.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff37affd700 1 -- 172.21.15.50:0/433322596 >> v2:172.21.15.192:3300/0 conn(0x7ff37c158f10 msgr2=0x7ff37c06b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:27.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff37affd700 1 --2- 172.21.15.50:0/433322596 >> v2:172.21.15.192:3300/0 conn(0x7ff37c158f10 0x7ff37c06b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff37affd700 1 -- 172.21.15.50:0/433322596 >> v1:172.21.15.50:6789/0 conn(0x7ff37c0cdd40 legacy=0x7ff37c069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff37affd700 1 -- 172.21.15.50:0/433322596 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c0c96b0 con 0x7ff37c0cd930 2023-11-28T11:59:27.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff37affd700 1 --2- 172.21.15.50:0/433322596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff37c0cd930 0x7ff37c0cae10 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ff37c06e420 tx=0x7ff36c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ad85fb67bb0fe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff37a7fc700 1 -- 172.21.15.50:0/433322596 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c011830 con 0x7ff37c0cd930 2023-11-28T11:59:27.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff37a7fc700 1 -- 172.21.15.50:0/433322596 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c011990 con 0x7ff37c0cd930 2023-11-28T11:59:27.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff37a7fc700 1 -- 172.21.15.50:0/433322596 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c011d20 con 0x7ff37c0cd930 2023-11-28T11:59:27.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff380b13700 1 -- 172.21.15.50:0/433322596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff37c0cd930 msgr2=0x7ff37c0cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff380b13700 1 --2- 172.21.15.50:0/433322596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff37c0cd930 0x7ff37c0cae10 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ff37c06e420 tx=0x7ff36c009b30 comp rx=0 tx=0).stop 2023-11-28T11:59:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff380b13700 1 -- 172.21.15.50:0/433322596 shutdown_connections 2023-11-28T11:59:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff380b13700 1 --2- 172.21.15.50:0/433322596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff37c0cd930 0x7ff37c0cae10 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff380b13700 1 --2- 172.21.15.50:0/433322596 >> v2:172.21.15.192:3300/0 conn(0x7ff37c158f10 0x7ff37c06b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff380b13700 1 -- 172.21.15.50:0/433322596 >> 172.21.15.50:0/433322596 conn(0x7ff37c0ce400 msgr2=0x7ff37c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff380b13700 1 -- 172.21.15.50:0/433322596 shutdown_connections 2023-11-28T11:59:27.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff380b13700 1 -- 172.21.15.50:0/433322596 wait complete. 2023-11-28T11:59:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff380b13700 1 Processor -- start 2023-11-28T11:59:27.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.305+0000 7ff380b13700 1 -- start start 2023-11-28T11:59:27.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff380b13700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37c0cd930 0x7ff37c0c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff380b13700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff37c0cdd40 0x7ff37c0ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff380b13700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37c158f10 0x7ff37c0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff380b13700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c1f28a0 con 0x7ff37c0cdd40 2023-11-28T11:59:27.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff380b13700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c15c530 con 0x7ff37c158f10 2023-11-28T11:59:27.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff380b13700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c1f2000 con 0x7ff37c0cd930 2023-11-28T11:59:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff37affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff37c0cdd40 0x7ff37c0ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff37affd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff37c0cdd40 0x7ff37c0ab810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34696/0 (socket says 172.21.15.50:34696) 2023-11-28T11:59:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff37affd700 1 -- 172.21.15.50:0/2644274535 learned_addr learned my addr 172.21.15.50:0/2644274535 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff37b7fe700 1 --2- 172.21.15.50:0/2644274535 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37c0cd930 0x7ff37c0c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff37bfff700 1 --2- 172.21.15.50:0/2644274535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37c158f10 0x7ff37c0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff37affd700 1 -- 172.21.15.50:0/2644274535 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37c0cd930 msgr2=0x7ff37c0c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff37affd700 1 --2- 172.21.15.50:0/2644274535 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37c0cd930 0x7ff37c0c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff37affd700 1 -- 172.21.15.50:0/2644274535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37c158f10 msgr2=0x7ff37c0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff37affd700 1 --2- 172.21.15.50:0/2644274535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37c158f10 0x7ff37c0cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff37affd700 1 -- 172.21.15.50:0/2644274535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c0094b0 con 0x7ff37c0cdd40 2023-11-28T11:59:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff37affd700 1 --2- 172.21.15.50:0/2644274535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff37c0cdd40 0x7ff37c0ab810 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ff36c014040 tx=0x7ff36c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff363fff700 1 -- 172.21.15.50:0/2644274535 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c004510 con 0x7ff37c0cdd40 2023-11-28T11:59:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff380b13700 1 -- 172.21.15.50:0/2644274535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37c0c9c70 con 0x7ff37c0cdd40 2023-11-28T11:59:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff363fff700 1 -- 172.21.15.50:0/2644274535 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c01e070 con 0x7ff37c0cdd40 2023-11-28T11:59:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff380b13700 1 -- 172.21.15.50:0/2644274535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37c0c9990 con 0x7ff37c0cdd40 2023-11-28T11:59:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff363fff700 1 -- 172.21.15.50:0/2644274535 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c0038c0 con 0x7ff37c0cdd40 2023-11-28T11:59:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.309+0000 7ff380b13700 1 -- 172.21.15.50:0/2644274535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff37c1592e0 con 0x7ff37c0cdd40 2023-11-28T11:59:27.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.313+0000 7ff363fff700 1 -- 172.21.15.50:0/2644274535 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff36c00f050 con 0x7ff37c0cdd40 2023-11-28T11:59:27.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.313+0000 7ff363fff700 1 --2- 172.21.15.50:0/2644274535 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff368064ee0 0x7ff368067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.313+0000 7ff363fff700 1 -- 172.21.15.50:0/2644274535 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7ff36c082c20 con 0x7ff37c0cdd40 2023-11-28T11:59:27.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.313+0000 7ff363fff700 1 --2- 172.21.15.50:0/2644274535 >> [v2:172.21.15.192:6816/36819,v1:172.21.15.192:6817/36819] conn(0x7ff36806b7f0 0x7ff36806dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.313+0000 7ff363fff700 1 -- 172.21.15.50:0/2644274535 --> [v2:172.21.15.192:6816/36819,v1:172.21.15.192:6817/36819] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff36806e2f0 con 0x7ff36806b7f0 2023-11-28T11:59:27.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.313+0000 7ff363fff700 1 -- 172.21.15.50:0/2644274535 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff36c087220 con 0x7ff37c0cdd40 2023-11-28T11:59:27.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.313+0000 7ff37b7fe700 1 --2- 172.21.15.50:0/2644274535 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff368064ee0 0x7ff368067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.313+0000 7ff37bfff700 1 --2- 172.21.15.50:0/2644274535 >> [v2:172.21.15.192:6816/36819,v1:172.21.15.192:6817/36819] conn(0x7ff36806b7f0 0x7ff36806dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.313+0000 7ff37b7fe700 1 --2- 172.21.15.50:0/2644274535 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff368064ee0 0x7ff368067390 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0c84d0 tx=0x7ff370009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.313+0000 7ff37bfff700 1 --2- 172.21.15.50:0/2644274535 >> [v2:172.21.15.192:6816/36819,v1:172.21.15.192:6817/36819] conn(0x7ff36806b7f0 0x7ff36806dc20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.317+0000 7ff363fff700 1 -- 172.21.15.50:0/2644274535 <== osd.4 v2:172.21.15.192:6816/36819 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff36806e2f0 con 0x7ff36806b7f0 2023-11-28T11:59:27.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.333+0000 7ff380b13700 1 -- 172.21.15.50:0/2644274535 --> [v2:172.21.15.192:6816/36819,v1:172.21.15.192:6817/36819] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff37c072500 con 0x7ff36806b7f0 2023-11-28T11:59:27.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.337+0000 7ff363fff700 1 -- 172.21.15.50:0/2644274535 <== osd.4 v2:172.21.15.192:6816/36819 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff37c072500 con 0x7ff36806b7f0 2023-11-28T11:59:27.339 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:59:27.340 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T11:59:27.340 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:59:27.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.337+0000 7ff380b13700 1 -- 172.21.15.50:0/2644274535 >> [v2:172.21.15.192:6816/36819,v1:172.21.15.192:6817/36819] conn(0x7ff36806b7f0 msgr2=0x7ff36806dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.337+0000 7ff380b13700 1 --2- 172.21.15.50:0/2644274535 >> [v2:172.21.15.192:6816/36819,v1:172.21.15.192:6817/36819] conn(0x7ff36806b7f0 0x7ff36806dc20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.337+0000 7ff380b13700 1 -- 172.21.15.50:0/2644274535 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff368064ee0 msgr2=0x7ff368067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.337+0000 7ff380b13700 1 --2- 172.21.15.50:0/2644274535 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7ff368064ee0 0x7ff368067390 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0c84d0 tx=0x7ff370009240 comp rx=0 tx=0).stop 2023-11-28T11:59:27.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.337+0000 7ff380b13700 1 -- 172.21.15.50:0/2644274535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff37c0cdd40 msgr2=0x7ff37c0ab810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.337+0000 7ff380b13700 1 --2- 172.21.15.50:0/2644274535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff37c0cdd40 0x7ff37c0ab810 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ff36c014040 tx=0x7ff36c004770 comp rx=0 tx=0).stop 2023-11-28T11:59:27.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.337+0000 7ff37bfff700 1 -- 172.21.15.50:0/2644274535 reap_dead start 2023-11-28T11:59:27.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.337+0000 7ff380b13700 1 -- 172.21.15.50:0/2644274535 shutdown_connections 2023-11-28T11:59:27.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.337+0000 7ff380b13700 1 -- 172.21.15.50:0/2644274535 >> 172.21.15.50:0/2644274535 conn(0x7ff37c0ce400 msgr2=0x7ff37c158140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:27.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.337+0000 7ff380b13700 1 -- 172.21.15.50:0/2644274535 shutdown_connections 2023-11-28T11:59:27.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.337+0000 7ff380b13700 1 -- 172.21.15.50:0/2644274535 wait complete. 2023-11-28T11:59:27.353 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-28T11:59:27.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f255359e700 1 Processor -- start 2023-11-28T11:59:27.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f255359e700 1 -- start start 2023-11-28T11:59:27.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f255359e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25540c1ac0 0x7f2554069c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f255359e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f25540ceef0 0x7f255406a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f255359e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25540cae70 con 0x7f25541606b0 2023-11-28T11:59:27.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f255359e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25540cbc10 con 0x7f25540ceef0 2023-11-28T11:59:27.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f255359e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25540cb130 con 0x7f25540c1ac0 2023-11-28T11:59:27.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f2551d9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25540c1ac0 0x7f2554069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f2552d9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f25540ceef0 0x7f255406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f2551d9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25540c1ac0 0x7f2554069c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:47818/0 (socket says 172.21.15.50:47818) 2023-11-28T11:59:27.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f2551d9b700 1 -- 172.21.15.50:0/4004873371 learned_addr learned my addr 172.21.15.50:0/4004873371 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:27.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f255259c700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f25541606b0 0x7f25540c13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:47976/0 (socket says 172.21.15.50:47976) 2023-11-28T11:59:27.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f2551d9b700 1 -- 172.21.15.50:0/4004873371 >> v2:172.21.15.192:3300/0 conn(0x7f25540ceef0 msgr2=0x7f255406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:27.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f2551d9b700 1 --2- 172.21.15.50:0/4004873371 >> v2:172.21.15.192:3300/0 conn(0x7f25540ceef0 0x7f255406a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f2551d9b700 1 -- 172.21.15.50:0/4004873371 >> v1:172.21.15.192:6789/0 conn(0x7f25541606b0 legacy=0x7f25540c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f2551d9b700 1 -- 172.21.15.50:0/4004873371 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25540cb410 con 0x7f25540c1ac0 2023-11-28T11:59:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f2551d9b700 1 --2- 172.21.15.50:0/4004873371 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25540c1ac0 0x7f2554069c40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2544009e50 tx=0x7f254400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79c25e6928810c23 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f255159a700 1 -- 172.21.15.50:0/4004873371 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400e070 con 0x7f25540c1ac0 2023-11-28T11:59:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f255159a700 1 -- 172.21.15.50:0/4004873371 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254400b910 con 0x7f25540c1ac0 2023-11-28T11:59:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.469+0000 7f255159a700 1 -- 172.21.15.50:0/4004873371 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400bcc0 con 0x7f25540c1ac0 2023-11-28T11:59:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.473+0000 7f255359e700 1 -- 172.21.15.50:0/4004873371 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25540c1ac0 msgr2=0x7f2554069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.473+0000 7f255359e700 1 --2- 172.21.15.50:0/4004873371 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25540c1ac0 0x7f2554069c40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2544009e50 tx=0x7f254400b330 comp rx=0 tx=0).stop 2023-11-28T11:59:27.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.473+0000 7f255359e700 1 -- 172.21.15.50:0/4004873371 shutdown_connections 2023-11-28T11:59:27.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.473+0000 7f255359e700 1 --2- 172.21.15.50:0/4004873371 >> v2:172.21.15.192:3300/0 conn(0x7f25540ceef0 0x7f255406a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.473+0000 7f255359e700 1 --2- 172.21.15.50:0/4004873371 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25540c1ac0 0x7f2554069c40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.473+0000 7f255359e700 1 -- 172.21.15.50:0/4004873371 >> 172.21.15.50:0/4004873371 conn(0x7f25540ce3e0 msgr2=0x7f25540ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:27.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.473+0000 7f255359e700 1 -- 172.21.15.50:0/4004873371 shutdown_connections 2023-11-28T11:59:27.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.473+0000 7f255359e700 1 -- 172.21.15.50:0/4004873371 wait complete. 2023-11-28T11:59:27.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.473+0000 7f255359e700 1 Processor -- start 2023-11-28T11:59:27.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.473+0000 7f255359e700 1 -- start start 2023-11-28T11:59:27.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.473+0000 7f255359e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25540c1ac0 0x7f2554157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.473+0000 7f255359e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25540ceef0 0x7f2554163410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.473+0000 7f255359e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25541606b0 0x7f2554070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.473+0000 7f255359e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2554070690 con 0x7f25540ceef0 2023-11-28T11:59:27.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.473+0000 7f255359e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25540acaa0 con 0x7f25540c1ac0 2023-11-28T11:59:27.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.473+0000 7f255359e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25540abce0 con 0x7f25541606b0 2023-11-28T11:59:27.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f2551d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25540ceef0 0x7f2554163410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f2551d9b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25540ceef0 0x7f2554163410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34704/0 (socket says 172.21.15.50:34704) 2023-11-28T11:59:27.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f2551d9b700 1 -- 172.21.15.50:0/1765967184 learned_addr learned my addr 172.21.15.50:0/1765967184 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:27.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f2552d9d700 1 --2- 172.21.15.50:0/1765967184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25541606b0 0x7f2554070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f255259c700 1 --2- 172.21.15.50:0/1765967184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25540c1ac0 0x7f2554157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f2551d9b700 1 -- 172.21.15.50:0/1765967184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25541606b0 msgr2=0x7f2554070150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f2551d9b700 1 --2- 172.21.15.50:0/1765967184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25541606b0 0x7f2554070150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f2551d9b700 1 -- 172.21.15.50:0/1765967184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25540c1ac0 msgr2=0x7f2554157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f2551d9b700 1 --2- 172.21.15.50:0/1765967184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25540c1ac0 0x7f2554157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f2551d9b700 1 -- 172.21.15.50:0/1765967184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2544009b30 con 0x7f25540ceef0 2023-11-28T11:59:27.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f2551d9b700 1 --2- 172.21.15.50:0/1765967184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25540ceef0 0x7f2554163410 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f254400b370 tx=0x7f2544004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f254affd700 1 -- 172.21.15.50:0/1765967184 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544004800 con 0x7f25540ceef0 2023-11-28T11:59:27.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f255359e700 1 -- 172.21.15.50:0/1765967184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25540b36c0 con 0x7f25540ceef0 2023-11-28T11:59:27.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f255359e700 1 -- 172.21.15.50:0/1765967184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25540cb6f0 con 0x7f25540ceef0 2023-11-28T11:59:27.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f254affd700 1 -- 172.21.15.50:0/1765967184 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25440092e0 con 0x7f25540ceef0 2023-11-28T11:59:27.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f254affd700 1 -- 172.21.15.50:0/1765967184 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544025650 con 0x7f25540ceef0 2023-11-28T11:59:27.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f255359e700 1 -- 172.21.15.50:0/1765967184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252c005310 con 0x7f25540ceef0 2023-11-28T11:59:27.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.477+0000 7f254affd700 1 -- 172.21.15.50:0/1765967184 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2544022030 con 0x7f25540ceef0 2023-11-28T11:59:27.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.481+0000 7f254affd700 1 --2- 172.21.15.50:0/1765967184 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2538064ee0 0x7f2538067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.481+0000 7f254affd700 1 -- 172.21.15.50:0/1765967184 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f2544083150 con 0x7f25540ceef0 2023-11-28T11:59:27.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.481+0000 7f255259c700 1 --2- 172.21.15.50:0/1765967184 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2538064ee0 0x7f2538067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.481+0000 7f255259c700 1 --2- 172.21.15.50:0/1765967184 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2538064ee0 0x7f2538067390 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f253c000f60 tx=0x7f253c007ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.485+0000 7f254affd700 1 -- 172.21.15.50:0/1765967184 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2544051430 con 0x7f25540ceef0 2023-11-28T11:59:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.649+0000 7f255359e700 1 -- 172.21.15.50:0/1765967184 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f252c000bc0 con 0x7f2538064ee0 2023-11-28T11:59:27.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.649+0000 7f254affd700 1 -- 172.21.15.50:0/1765967184 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f252c000bc0 con 0x7f2538064ee0 2023-11-28T11:59:27.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.653+0000 7f255359e700 1 -- 172.21.15.50:0/1765967184 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2538064ee0 msgr2=0x7f2538067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.656 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.653+0000 7f255359e700 1 --2- 172.21.15.50:0/1765967184 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2538064ee0 0x7f2538067390 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f253c000f60 tx=0x7f253c007ef0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.653+0000 7f255359e700 1 -- 172.21.15.50:0/1765967184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25540ceef0 msgr2=0x7f2554163410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.653+0000 7f255359e700 1 --2- 172.21.15.50:0/1765967184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25540ceef0 0x7f2554163410 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f254400b370 tx=0x7f2544004af0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.653+0000 7f255359e700 1 -- 172.21.15.50:0/1765967184 shutdown_connections 2023-11-28T11:59:27.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.653+0000 7f255359e700 1 --2- 172.21.15.50:0/1765967184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25541606b0 0x7f2554070150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.653+0000 7f255359e700 1 --2- 172.21.15.50:0/1765967184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25540ceef0 0x7f2554163410 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.653+0000 7f255359e700 1 --2- 172.21.15.50:0/1765967184 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2538064ee0 0x7f2538067390 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.653+0000 7f255359e700 1 --2- 172.21.15.50:0/1765967184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25540c1ac0 0x7f2554157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.653+0000 7f255359e700 1 -- 172.21.15.50:0/1765967184 >> 172.21.15.50:0/1765967184 conn(0x7f25540ce3e0 msgr2=0x7f25540ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:27.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.653+0000 7f255359e700 1 -- 172.21.15.50:0/1765967184 shutdown_connections 2023-11-28T11:59:27.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.653+0000 7f255359e700 1 -- 172.21.15.50:0/1765967184 wait complete. 2023-11-28T11:59:27.658 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 4 to deep-scrub 2023-11-28T11:59:27.668 INFO:tasks.ceph:Scrubbing osd.5 2023-11-28T11:59:27.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-28T11:59:27.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.789+0000 7faa5ffff700 1 Processor -- start 2023-11-28T11:59:27.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.789+0000 7faa5ffff700 1 -- start start 2023-11-28T11:59:27.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa6006d8e0 0x7faa600d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faa600d2eb0 0x7faa6006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5ffff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa600cf0b0 con 0x7faa600b1eb0 2023-11-28T11:59:27.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5ffff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa6015c6a0 con 0x7faa600d2eb0 2023-11-28T11:59:27.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5ffff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa600d00c0 con 0x7faa6006d8e0 2023-11-28T11:59:27.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5e7fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa6006d8e0 0x7faa600d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faa600d2eb0 0x7faa6006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5e7fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa6006d8e0 0x7faa600d1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:47842/0 (socket says 172.21.15.50:47842) 2023-11-28T11:59:27.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5e7fc700 1 -- 172.21.15.50:0/652629079 learned_addr learned my addr 172.21.15.50:0/652629079 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:27.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5f7fe700 1 -- 172.21.15.50:0/652629079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa6006d8e0 msgr2=0x7faa600d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:27.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5f7fe700 1 --2- 172.21.15.50:0/652629079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa6006d8e0 0x7faa600d1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5f7fe700 1 -- 172.21.15.50:0/652629079 >> v1:172.21.15.192:6789/0 conn(0x7faa600b1eb0 legacy=0x7faa600d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5f7fe700 1 -- 172.21.15.50:0/652629079 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa600cfc30 con 0x7faa600d2eb0 2023-11-28T11:59:27.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5dffb700 1 -- 172.21.15.50:0/652629079 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446074175 0 0) 0x7faa600cf0b0 con 0x7faa600b1eb0 2023-11-28T11:59:27.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5f7fe700 1 --2- 172.21.15.50:0/652629079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa600d2eb0 0x7faa6006a2a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7faa58009dc0 tx=0x7faa5800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec171cf092813353 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5dffb700 1 -- 172.21.15.50:0/652629079 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5800e070 con 0x7faa600d2eb0 2023-11-28T11:59:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5dffb700 1 -- 172.21.15.50:0/652629079 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5800bae0 con 0x7faa600d2eb0 2023-11-28T11:59:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5dffb700 1 -- 172.21.15.50:0/652629079 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5800be90 con 0x7faa600d2eb0 2023-11-28T11:59:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5ffff700 1 -- 172.21.15.50:0/652629079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa600d2eb0 msgr2=0x7faa6006a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5ffff700 1 --2- 172.21.15.50:0/652629079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa600d2eb0 0x7faa6006a2a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7faa58009dc0 tx=0x7faa5800b330 comp rx=0 tx=0).stop 2023-11-28T11:59:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5ffff700 1 -- 172.21.15.50:0/652629079 shutdown_connections 2023-11-28T11:59:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5ffff700 1 --2- 172.21.15.50:0/652629079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa600d2eb0 0x7faa6006a2a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5ffff700 1 --2- 172.21.15.50:0/652629079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa6006d8e0 0x7faa600d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5ffff700 1 -- 172.21.15.50:0/652629079 >> 172.21.15.50:0/652629079 conn(0x7faa6009bbb0 msgr2=0x7faa600b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:27.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5ffff700 1 -- 172.21.15.50:0/652629079 shutdown_connections 2023-11-28T11:59:27.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.793+0000 7faa5ffff700 1 -- 172.21.15.50:0/652629079 wait complete. 2023-11-28T11:59:27.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.797+0000 7faa5ffff700 1 Processor -- start 2023-11-28T11:59:27.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.797+0000 7faa5ffff700 1 -- start start 2023-11-28T11:59:27.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.797+0000 7faa5ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa6006d8e0 0x7faa60151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.797+0000 7faa5ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa600d2eb0 0x7faa6015d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.797+0000 7faa5ffff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa601f25c0 0x7faa600b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.797+0000 7faa5ffff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa600c7d10 con 0x7faa601f25c0 2023-11-28T11:59:27.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.797+0000 7faa5ffff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6015d9b0 con 0x7faa6006d8e0 2023-11-28T11:59:27.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.797+0000 7faa5ffff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6015dc90 con 0x7faa600d2eb0 2023-11-28T11:59:27.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.797+0000 7faa5f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa601f25c0 0x7faa600b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.797+0000 7faa5effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa6006d8e0 0x7faa60151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.797+0000 7faa5e7fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa600d2eb0 0x7faa6015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.797+0000 7faa5effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa6006d8e0 0x7faa60151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.50:54470/0 (socket says 172.21.15.50:54470) 2023-11-28T11:59:27.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.797+0000 7faa5effd700 1 -- 172.21.15.50:0/3771061769 learned_addr learned my addr 172.21.15.50:0/3771061769 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:27.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.797+0000 7faa5f7fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa601f25c0 0x7faa600b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34712/0 (socket says 172.21.15.50:34712) 2023-11-28T11:59:27.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.801+0000 7faa5effd700 1 -- 172.21.15.50:0/3771061769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa600d2eb0 msgr2=0x7faa6015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.801+0000 7faa5effd700 1 --2- 172.21.15.50:0/3771061769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa600d2eb0 0x7faa6015d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.801+0000 7faa5effd700 1 -- 172.21.15.50:0/3771061769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa601f25c0 msgr2=0x7faa600b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.801+0000 7faa5effd700 1 --2- 172.21.15.50:0/3771061769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa601f25c0 0x7faa600b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.801+0000 7faa5effd700 1 -- 172.21.15.50:0/3771061769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa58009a70 con 0x7faa6006d8e0 2023-11-28T11:59:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.801+0000 7faa5f7fe700 1 --2- 172.21.15.50:0/3771061769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa601f25c0 0x7faa600b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:27.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.801+0000 7faa5effd700 1 --2- 172.21.15.50:0/3771061769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa6006d8e0 0x7faa60151f70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faa480011e0 tx=0x7faa4800ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.801+0000 7faa57fff700 1 -- 172.21.15.50:0/3771061769 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480054e0 con 0x7faa6006d8e0 2023-11-28T11:59:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.801+0000 7faa57fff700 1 -- 172.21.15.50:0/3771061769 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa480036a0 con 0x7faa6006d8e0 2023-11-28T11:59:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.801+0000 7faa57fff700 1 -- 172.21.15.50:0/3771061769 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48003a50 con 0x7faa6006d8e0 2023-11-28T11:59:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.801+0000 7faa5ffff700 1 -- 172.21.15.50:0/3771061769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa600cf5e0 con 0x7faa6006d8e0 2023-11-28T11:59:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.801+0000 7faa5ffff700 1 -- 172.21.15.50:0/3771061769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa600cf300 con 0x7faa6006d8e0 2023-11-28T11:59:27.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.801+0000 7faa5ffff700 1 -- 172.21.15.50:0/3771061769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa600cf8c0 con 0x7faa6006d8e0 2023-11-28T11:59:27.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.805+0000 7faa57fff700 1 -- 172.21.15.50:0/3771061769 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faa48019030 con 0x7faa6006d8e0 2023-11-28T11:59:27.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.805+0000 7faa57fff700 1 --2- 172.21.15.50:0/3771061769 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa40064ee0 0x7faa40067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.805+0000 7faa57fff700 1 -- 172.21.15.50:0/3771061769 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7faa48081750 con 0x7faa6006d8e0 2023-11-28T11:59:27.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.805+0000 7faa57fff700 1 --2- 172.21.15.50:0/3771061769 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x7faa4006b7f0 0x7faa4006dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.805+0000 7faa57fff700 1 -- 172.21.15.50:0/3771061769 --> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa4006e2f0 con 0x7faa4006b7f0 2023-11-28T11:59:27.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.805+0000 7faa5e7fc700 1 --2- 172.21.15.50:0/3771061769 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa40064ee0 0x7faa40067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.805+0000 7faa57fff700 1 -- 172.21.15.50:0/3771061769 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa48081b90 con 0x7faa6006d8e0 2023-11-28T11:59:27.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.805+0000 7faa5f7fe700 1 --2- 172.21.15.50:0/3771061769 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x7faa4006b7f0 0x7faa4006dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.805+0000 7faa5e7fc700 1 --2- 172.21.15.50:0/3771061769 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa40064ee0 0x7faa40067390 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7faa601524b0 tx=0x7faa500092e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.805+0000 7faa5f7fe700 1 --2- 172.21.15.50:0/3771061769 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x7faa4006b7f0 0x7faa4006dc20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.809+0000 7faa57fff700 1 -- 172.21.15.50:0/3771061769 <== osd.5 v2:172.21.15.192:6802/36817 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7faa4006e2f0 con 0x7faa4006b7f0 2023-11-28T11:59:27.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.829+0000 7faa5ffff700 1 -- 172.21.15.50:0/3771061769 --> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faa600c7e50 con 0x7faa4006b7f0 2023-11-28T11:59:27.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.829+0000 7faa57fff700 1 -- 172.21.15.50:0/3771061769 <== osd.5 v2:172.21.15.192:6802/36817 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7faa580098f0 con 0x7faa4006b7f0 2023-11-28T11:59:27.832 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:59:27.833 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T11:59:27.833 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:59:27.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.829+0000 7faa5ffff700 1 -- 172.21.15.50:0/3771061769 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x7faa4006b7f0 msgr2=0x7faa4006dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.829+0000 7faa5ffff700 1 --2- 172.21.15.50:0/3771061769 >> [v2:172.21.15.192:6802/36817,v1:172.21.15.192:6804/36817] conn(0x7faa4006b7f0 0x7faa4006dc20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.829+0000 7faa5ffff700 1 -- 172.21.15.50:0/3771061769 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa40064ee0 msgr2=0x7faa40067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.829+0000 7faa5ffff700 1 --2- 172.21.15.50:0/3771061769 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7faa40064ee0 0x7faa40067390 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7faa601524b0 tx=0x7faa500092e0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.829+0000 7faa5ffff700 1 -- 172.21.15.50:0/3771061769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa6006d8e0 msgr2=0x7faa60151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.829+0000 7faa5ffff700 1 --2- 172.21.15.50:0/3771061769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa6006d8e0 0x7faa60151f70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faa480011e0 tx=0x7faa4800ca30 comp rx=0 tx=0).stop 2023-11-28T11:59:27.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.829+0000 7faa5f7fe700 1 -- 172.21.15.50:0/3771061769 reap_dead start 2023-11-28T11:59:27.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.829+0000 7faa5ffff700 1 -- 172.21.15.50:0/3771061769 shutdown_connections 2023-11-28T11:59:27.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.829+0000 7faa5ffff700 1 -- 172.21.15.50:0/3771061769 >> 172.21.15.50:0/3771061769 conn(0x7faa6009bbb0 msgr2=0x7faa600d2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:27.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.829+0000 7faa5ffff700 1 -- 172.21.15.50:0/3771061769 shutdown_connections 2023-11-28T11:59:27.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.829+0000 7faa5ffff700 1 -- 172.21.15.50:0/3771061769 wait complete. 2023-11-28T11:59:27.845 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-28T11:59:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.961+0000 7f067d0a6700 1 Processor -- start 2023-11-28T11:59:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.961+0000 7f067d0a6700 1 -- start start 2023-11-28T11:59:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.961+0000 7f067d0a6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f067806cae0 0x7f06780b2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.961+0000 7f067d0a6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0678152f80 con 0x7f0678152bb0 2023-11-28T11:59:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.961+0000 7f067d0a6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0678159a30 con 0x7f067806c640 2023-11-28T11:59:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.961+0000 7f067d0a6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067806cf60 con 0x7f067806cae0 2023-11-28T11:59:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.961+0000 7f0677fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0678152bb0 0x7f067815caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50590/0 (socket says 172.21.15.50:50590) 2023-11-28T11:59:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.961+0000 7f0677fff700 1 -- 172.21.15.50:0/3676842873 learned_addr learned my addr 172.21.15.50:0/3676842873 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.961+0000 7f067c8a5700 1 --2- 172.21.15.50:0/3676842873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f067806cae0 0x7f06780b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.961+0000 7f0676ffd700 1 -- 172.21.15.50:0/3676842873 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433018448 0 0) 0x7f0678152f80 con 0x7f0678152bb0 2023-11-28T11:59:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.961+0000 7f0676ffd700 1 -- 172.21.15.50:0/3676842873 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06600046e0 con 0x7f0678152bb0 2023-11-28T11:59:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f0676ffd700 1 -- 172.21.15.50:0/3676842873 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755729843 0 0) 0x7f0678159a30 con 0x7f067806c640 2023-11-28T11:59:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f0676ffd700 1 -- 172.21.15.50:0/3676842873 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0678152f80 con 0x7f067806c640 2023-11-28T11:59:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f067c8a5700 1 -- 172.21.15.50:0/3676842873 >> v1:172.21.15.192:6789/0 conn(0x7f067806c640 legacy=0x7f06780b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f067c8a5700 1 -- 172.21.15.50:0/3676842873 >> v1:172.21.15.50:6789/0 conn(0x7f0678152bb0 legacy=0x7f067815caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f067c8a5700 1 -- 172.21.15.50:0/3676842873 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0678158eb0 con 0x7f067806cae0 2023-11-28T11:59:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f067c8a5700 1 --2- 172.21.15.50:0/3676842873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f067806cae0 0x7f06780b2730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0670009dc0 tx=0x7f067000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f61811e2741fe18a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f0676ffd700 1 -- 172.21.15.50:0/3676842873 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067000e070 con 0x7f067806cae0 2023-11-28T11:59:27.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f0676ffd700 1 -- 172.21.15.50:0/3676842873 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067000bae0 con 0x7f067806cae0 2023-11-28T11:59:27.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f0676ffd700 1 -- 172.21.15.50:0/3676842873 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067000be90 con 0x7f067806cae0 2023-11-28T11:59:27.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f067d0a6700 1 -- 172.21.15.50:0/3676842873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f067806cae0 msgr2=0x7f06780b2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f067d0a6700 1 --2- 172.21.15.50:0/3676842873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f067806cae0 0x7f06780b2730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0670009dc0 tx=0x7f067000b330 comp rx=0 tx=0).stop 2023-11-28T11:59:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f067d0a6700 1 -- 172.21.15.50:0/3676842873 shutdown_connections 2023-11-28T11:59:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f067d0a6700 1 --2- 172.21.15.50:0/3676842873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f067806cae0 0x7f06780b2730 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f067d0a6700 1 -- 172.21.15.50:0/3676842873 >> 172.21.15.50:0/3676842873 conn(0x7f067806e000 msgr2=0x7f06780b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f067d0a6700 1 -- 172.21.15.50:0/3676842873 shutdown_connections 2023-11-28T11:59:27.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f067d0a6700 1 -- 172.21.15.50:0/3676842873 wait complete. 2023-11-28T11:59:27.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f067d0a6700 1 Processor -- start 2023-11-28T11:59:27.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.965+0000 7f067d0a6700 1 -- start start 2023-11-28T11:59:27.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f067d0a6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f067806c640 0x7f067814b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f067d0a6700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f067806cae0 0x7f067814c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f067d0a6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0678152bb0 0x7f067813c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f067d0a6700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06781e23e0 con 0x7f067806cae0 2023-11-28T11:59:27.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f067d0a6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06781e26c0 con 0x7f0678152bb0 2023-11-28T11:59:27.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f067d0a6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06781e29a0 con 0x7f067806c640 2023-11-28T11:59:27.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f06777fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f067806cae0 0x7f067814c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f06777fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f067806cae0 0x7f067814c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34724/0 (socket says 172.21.15.50:34724) 2023-11-28T11:59:27.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f0677fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f067806c640 0x7f067814b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f06777fe700 1 -- 172.21.15.50:0/3107109634 learned_addr learned my addr 172.21.15.50:0/3107109634 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:27.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f067c8a5700 1 --2- 172.21.15.50:0/3107109634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0678152bb0 0x7f067813c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f06777fe700 1 -- 172.21.15.50:0/3107109634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f067806c640 msgr2=0x7f067814b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f06777fe700 1 --2- 172.21.15.50:0/3107109634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f067806c640 0x7f067814b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f06777fe700 1 -- 172.21.15.50:0/3107109634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0678152bb0 msgr2=0x7f067813c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:27.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f06777fe700 1 --2- 172.21.15.50:0/3107109634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0678152bb0 0x7f067813c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:27.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f06777fe700 1 -- 172.21.15.50:0/3107109634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0670009a70 con 0x7f067806cae0 2023-11-28T11:59:27.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f067c8a5700 1 --2- 172.21.15.50:0/3107109634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0678152bb0 0x7f067813c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:27.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f06777fe700 1 --2- 172.21.15.50:0/3107109634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f067806cae0 0x7f067814c840 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f066c00c520 tx=0x7f066c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f0674ff9700 1 -- 172.21.15.50:0/3107109634 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c0054e0 con 0x7f067806cae0 2023-11-28T11:59:27.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f0674ff9700 1 -- 172.21.15.50:0/3107109634 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066c0036a0 con 0x7f067806cae0 2023-11-28T11:59:27.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f067d0a6700 1 -- 172.21.15.50:0/3107109634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0678159470 con 0x7f067806cae0 2023-11-28T11:59:27.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f0674ff9700 1 -- 172.21.15.50:0/3107109634 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c003a10 con 0x7f067806cae0 2023-11-28T11:59:27.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.969+0000 7f067d0a6700 1 -- 172.21.15.50:0/3107109634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0678159190 con 0x7f067806cae0 2023-11-28T11:59:27.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.973+0000 7f067d0a6700 1 -- 172.21.15.50:0/3107109634 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0678159750 con 0x7f067806cae0 2023-11-28T11:59:27.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.973+0000 7f0674ff9700 1 -- 172.21.15.50:0/3107109634 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f066c019030 con 0x7f067806cae0 2023-11-28T11:59:27.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.973+0000 7f0674ff9700 1 --2- 172.21.15.50:0/3107109634 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0664064ee0 0x7f0664067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:27.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.973+0000 7f0674ff9700 1 -- 172.21.15.50:0/3107109634 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f066c080f20 con 0x7f067806cae0 2023-11-28T11:59:27.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.973+0000 7f0677fff700 1 --2- 172.21.15.50:0/3107109634 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0664064ee0 0x7f0664067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:27.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.973+0000 7f0677fff700 1 --2- 172.21.15.50:0/3107109634 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0664064ee0 0x7f0664067390 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0668007fd0 tx=0x7f0668007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:27.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:27.981+0000 7f0674ff9700 1 -- 172.21.15.50:0/3107109634 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f066c04a400 con 0x7f067806cae0 2023-11-28T11:59:28.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.141+0000 7f067d0a6700 1 -- 172.21.15.50:0/3107109634 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f0678066f50 con 0x7f0664064ee0 2023-11-28T11:59:28.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.141+0000 7f0674ff9700 1 -- 172.21.15.50:0/3107109634 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0678066f50 con 0x7f0664064ee0 2023-11-28T11:59:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.145+0000 7f067d0a6700 1 -- 172.21.15.50:0/3107109634 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0664064ee0 msgr2=0x7f0664067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.145+0000 7f067d0a6700 1 --2- 172.21.15.50:0/3107109634 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0664064ee0 0x7f0664067390 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0668007fd0 tx=0x7f0668007de0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.145+0000 7f067d0a6700 1 -- 172.21.15.50:0/3107109634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f067806cae0 msgr2=0x7f067814c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.145+0000 7f067d0a6700 1 --2- 172.21.15.50:0/3107109634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f067806cae0 0x7f067814c840 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f066c00c520 tx=0x7f066c00c830 comp rx=0 tx=0).stop 2023-11-28T11:59:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.145+0000 7f067d0a6700 1 -- 172.21.15.50:0/3107109634 shutdown_connections 2023-11-28T11:59:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.145+0000 7f067d0a6700 1 --2- 172.21.15.50:0/3107109634 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f0664064ee0 0x7f0664067390 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.145+0000 7f067d0a6700 1 --2- 172.21.15.50:0/3107109634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0678152bb0 0x7f067813c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.145+0000 7f067d0a6700 1 --2- 172.21.15.50:0/3107109634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f067806cae0 0x7f067814c840 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.145+0000 7f067d0a6700 1 --2- 172.21.15.50:0/3107109634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f067806c640 0x7f067814b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.145+0000 7f067d0a6700 1 -- 172.21.15.50:0/3107109634 >> 172.21.15.50:0/3107109634 conn(0x7f067806e000 msgr2=0x7f06780cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.145+0000 7f067d0a6700 1 -- 172.21.15.50:0/3107109634 shutdown_connections 2023-11-28T11:59:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.145+0000 7f067d0a6700 1 -- 172.21.15.50:0/3107109634 wait complete. 2023-11-28T11:59:28.150 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 5 to deep-scrub 2023-11-28T11:59:28.161 INFO:tasks.ceph:Scrubbing osd.6 2023-11-28T11:59:28.161 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-28T11:59:28.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f9825c8b700 1 Processor -- start 2023-11-28T11:59:28.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f9825c8b700 1 -- start start 2023-11-28T11:59:28.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f9825c8b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f982006a4c0 0x7f982006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f9825c8b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98200cf0e0 0x7f98200cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f9825c8b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98200cfa80 con 0x7f98200b1ae0 2023-11-28T11:59:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f9825c8b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98200d0ab0 con 0x7f982006a4c0 2023-11-28T11:59:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f9825c8b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982006a9c0 con 0x7f98200cf0e0 2023-11-28T11:59:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f9817fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f982006a4c0 0x7f982006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f9817fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f982006a4c0 0x7f982006d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34738/0 (socket says 172.21.15.50:34738) 2023-11-28T11:59:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f9817fff700 1 -- 172.21.15.50:0/2171439280 learned_addr learned my addr 172.21.15.50:0/2171439280 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f982548a700 1 --2- 172.21.15.50:0/2171439280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98200cf0e0 0x7f98200cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f9817fff700 1 -- 172.21.15.50:0/2171439280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98200cf0e0 msgr2=0x7f98200cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f9817fff700 1 --2- 172.21.15.50:0/2171439280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98200cf0e0 0x7f98200cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f9817fff700 1 -- 172.21.15.50:0/2171439280 >> v1:172.21.15.192:6789/0 conn(0x7f98200b1ae0 legacy=0x7f98200d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f9817fff700 1 -- 172.21.15.50:0/2171439280 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982006aca0 con 0x7f982006a4c0 2023-11-28T11:59:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f9817fff700 1 --2- 172.21.15.50:0/2171439280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f982006a4c0 0x7f982006d8e0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f9810009910 tx=0x7f9810009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8f00af0cb2d2ea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f98177fe700 1 -- 172.21.15.50:0/2171439280 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810011830 con 0x7f982006a4c0 2023-11-28T11:59:28.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f98177fe700 1 -- 172.21.15.50:0/2171439280 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9810011990 con 0x7f982006a4c0 2023-11-28T11:59:28.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.277+0000 7f98177fe700 1 -- 172.21.15.50:0/2171439280 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810011d40 con 0x7f982006a4c0 2023-11-28T11:59:28.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9825c8b700 1 -- 172.21.15.50:0/2171439280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f982006a4c0 msgr2=0x7f982006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9825c8b700 1 --2- 172.21.15.50:0/2171439280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f982006a4c0 0x7f982006d8e0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f9810009910 tx=0x7f9810009c20 comp rx=0 tx=0).stop 2023-11-28T11:59:28.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9825c8b700 1 -- 172.21.15.50:0/2171439280 shutdown_connections 2023-11-28T11:59:28.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9825c8b700 1 --2- 172.21.15.50:0/2171439280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98200cf0e0 0x7f98200cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9825c8b700 1 --2- 172.21.15.50:0/2171439280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f982006a4c0 0x7f982006d8e0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9825c8b700 1 -- 172.21.15.50:0/2171439280 >> 172.21.15.50:0/2171439280 conn(0x7f982009bbd0 msgr2=0x7f98200b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:28.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9825c8b700 1 -- 172.21.15.50:0/2171439280 shutdown_connections 2023-11-28T11:59:28.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9825c8b700 1 -- 172.21.15.50:0/2171439280 wait complete. 2023-11-28T11:59:28.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9825c8b700 1 Processor -- start 2023-11-28T11:59:28.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9825c8b700 1 -- start start 2023-11-28T11:59:28.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9825c8b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f982006a4c0 0x7f98200c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9825c8b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98200b1ae0 0x7f9820159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9825c8b700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98200cf0e0 0x7f98201f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9825c8b700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98200c8980 con 0x7f98200cf0e0 2023-11-28T11:59:28.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9825c8b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98200c8eb0 con 0x7f98200b1ae0 2023-11-28T11:59:28.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9825c8b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9820159760 con 0x7f982006a4c0 2023-11-28T11:59:28.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f982548a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98200cf0e0 0x7f98201f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9824c89700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f982006a4c0 0x7f98200c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9824c89700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f982006a4c0 0x7f98200c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.50:47902/0 (socket says 172.21.15.50:47902) 2023-11-28T11:59:28.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9824c89700 1 -- 172.21.15.50:0/2652781728 learned_addr learned my addr 172.21.15.50:0/2652781728 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:28.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f982548a700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98200cf0e0 0x7f98201f4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34752/0 (socket says 172.21.15.50:34752) 2023-11-28T11:59:28.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9817fff700 1 --2- 172.21.15.50:0/2652781728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98200b1ae0 0x7f9820159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f982548a700 1 -- 172.21.15.50:0/2652781728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f982006a4c0 msgr2=0x7f98200c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f982548a700 1 --2- 172.21.15.50:0/2652781728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f982006a4c0 0x7f98200c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f982548a700 1 -- 172.21.15.50:0/2652781728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98200b1ae0 msgr2=0x7f9820159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f982548a700 1 --2- 172.21.15.50:0/2652781728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98200b1ae0 0x7f9820159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f982548a700 1 -- 172.21.15.50:0/2652781728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810009570 con 0x7f98200cf0e0 2023-11-28T11:59:28.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9824c89700 1 --2- 172.21.15.50:0/2652781728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f982006a4c0 0x7f98200c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:28.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f982548a700 1 --2- 172.21.15.50:0/2652781728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98200cf0e0 0x7f98201f4d10 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f981800efc0 tx=0x7f981800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f98157fa700 1 -- 172.21.15.50:0/2652781728 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981800cc90 con 0x7f98200cf0e0 2023-11-28T11:59:28.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f98157fa700 1 -- 172.21.15.50:0/2652781728 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981800f040 con 0x7f98200cf0e0 2023-11-28T11:59:28.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.281+0000 7f9825c8b700 1 -- 172.21.15.50:0/2652781728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98200b4380 con 0x7f98200cf0e0 2023-11-28T11:59:28.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.285+0000 7f98157fa700 1 -- 172.21.15.50:0/2652781728 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98180146c0 con 0x7f98200cf0e0 2023-11-28T11:59:28.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.285+0000 7f9825c8b700 1 -- 172.21.15.50:0/2652781728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982006af80 con 0x7f98200cf0e0 2023-11-28T11:59:28.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.285+0000 7f9825c8b700 1 -- 172.21.15.50:0/2652781728 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98200b1eb0 con 0x7f98200cf0e0 2023-11-28T11:59:28.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.285+0000 7f98157fa700 1 -- 172.21.15.50:0/2652781728 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9818014820 con 0x7f98200cf0e0 2023-11-28T11:59:28.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.285+0000 7f98157fa700 1 --2- 172.21.15.50:0/2652781728 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f980c064f10 0x7f980c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.289+0000 7f98157fa700 1 -- 172.21.15.50:0/2652781728 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f98180832d0 con 0x7f98200cf0e0 2023-11-28T11:59:28.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.289+0000 7f98157fa700 1 --2- 172.21.15.50:0/2652781728 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x7f980c06b820 0x7f980c06dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.289+0000 7f98157fa700 1 -- 172.21.15.50:0/2652781728 --> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f980c06e320 con 0x7f980c06b820 2023-11-28T11:59:28.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.289+0000 7f98157fa700 1 -- 172.21.15.50:0/2652781728 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9818083710 con 0x7f98200cf0e0 2023-11-28T11:59:28.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.289+0000 7f9824c89700 1 --2- 172.21.15.50:0/2652781728 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f980c064f10 0x7f980c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.289+0000 7f9817fff700 1 --2- 172.21.15.50:0/2652781728 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x7f980c06b820 0x7f980c06dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.289+0000 7f9824c89700 1 --2- 172.21.15.50:0/2652781728 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f980c064f10 0x7f980c0673c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f981c001d30 tx=0x7f981c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.289+0000 7f9817fff700 1 --2- 172.21.15.50:0/2652781728 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x7f980c06b820 0x7f980c06dc50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.289+0000 7f98157fa700 1 -- 172.21.15.50:0/2652781728 <== osd.6 v2:172.21.15.192:6824/36820 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f980c06e320 con 0x7f980c06b820 2023-11-28T11:59:28.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.309+0000 7f9825c8b700 1 -- 172.21.15.50:0/2652781728 --> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9820072500 con 0x7f980c06b820 2023-11-28T11:59:28.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.309+0000 7f98157fa700 1 -- 172.21.15.50:0/2652781728 <== osd.6 v2:172.21.15.192:6824/36820 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9820072500 con 0x7f980c06b820 2023-11-28T11:59:28.313 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:59:28.314 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T11:59:28.314 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:59:28.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.309+0000 7f9825c8b700 1 -- 172.21.15.50:0/2652781728 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x7f980c06b820 msgr2=0x7f980c06dc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.309+0000 7f9825c8b700 1 --2- 172.21.15.50:0/2652781728 >> [v2:172.21.15.192:6824/36820,v1:172.21.15.192:6825/36820] conn(0x7f980c06b820 0x7f980c06dc50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.309+0000 7f9825c8b700 1 -- 172.21.15.50:0/2652781728 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f980c064f10 msgr2=0x7f980c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.309+0000 7f9825c8b700 1 --2- 172.21.15.50:0/2652781728 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f980c064f10 0x7f980c0673c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f981c001d30 tx=0x7f981c009040 comp rx=0 tx=0).stop 2023-11-28T11:59:28.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.309+0000 7f9825c8b700 1 -- 172.21.15.50:0/2652781728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98200cf0e0 msgr2=0x7f98201f4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.309+0000 7f9825c8b700 1 --2- 172.21.15.50:0/2652781728 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98200cf0e0 0x7f98201f4d10 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f981800efc0 tx=0x7f981800c3a0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.309+0000 7f982548a700 1 -- 172.21.15.50:0/2652781728 reap_dead start 2023-11-28T11:59:28.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.309+0000 7f9825c8b700 1 -- 172.21.15.50:0/2652781728 shutdown_connections 2023-11-28T11:59:28.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.309+0000 7f9825c8b700 1 -- 172.21.15.50:0/2652781728 >> 172.21.15.50:0/2652781728 conn(0x7f982009bbd0 msgr2=0x7f982006d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:28.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.313+0000 7f9825c8b700 1 -- 172.21.15.50:0/2652781728 shutdown_connections 2023-11-28T11:59:28.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.313+0000 7f9825c8b700 1 -- 172.21.15.50:0/2652781728 wait complete. 2023-11-28T11:59:28.329 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-28T11:59:28.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.449+0000 7f211d0fe700 1 Processor -- start 2023-11-28T11:59:28.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.449+0000 7f211d0fe700 1 -- start start 2023-11-28T11:59:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.449+0000 7f211d0fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f211815d650 0x7f21180ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.449+0000 7f211d0fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2118159c00 0x7f21180cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.449+0000 7f211d0fe700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21180cc9b0 con 0x7f21180cc020 2023-11-28T11:59:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.449+0000 7f211d0fe700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21180cd720 con 0x7f2118159c00 2023-11-28T11:59:28.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.449+0000 7f211d0fe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21180cd990 con 0x7f211815d650 2023-11-28T11:59:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.449+0000 7f211c8fd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2118159c00 0x7f21180cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.449+0000 7f21177fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f21180cc020 0x7f21181594f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50602/0 (socket says 172.21.15.50:50602) 2023-11-28T11:59:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.449+0000 7f21177fe700 1 -- 172.21.15.50:0/410193248 learned_addr learned my addr 172.21.15.50:0/410193248 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:28.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.449+0000 7f2117fff700 1 --2- 172.21.15.50:0/410193248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f211815d650 0x7f21180ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.449+0000 7f211c8fd700 1 -- 172.21.15.50:0/410193248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f211815d650 msgr2=0x7f21180ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:28.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.449+0000 7f211c8fd700 1 --2- 172.21.15.50:0/410193248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f211815d650 0x7f21180ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.449+0000 7f211c8fd700 1 -- 172.21.15.50:0/410193248 >> v1:172.21.15.50:6789/0 conn(0x7f21180cc020 legacy=0x7f21181594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.449+0000 7f2116ffd700 1 -- 172.21.15.50:0/410193248 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791861011 0 0) 0x7f210c001110 con 0x7f21180cc020 2023-11-28T11:59:28.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.453+0000 7f211c8fd700 1 -- 172.21.15.50:0/410193248 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21180cdc70 con 0x7f2118159c00 2023-11-28T11:59:28.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.453+0000 7f211c8fd700 1 --2- 172.21.15.50:0/410193248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2118159c00 0x7f21180cc470 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f2110009d90 tx=0x7f211000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21081a4bb1cce181 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.453+0000 7f2116ffd700 1 -- 172.21.15.50:0/410193248 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211000e070 con 0x7f2118159c00 2023-11-28T11:59:28.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.453+0000 7f2116ffd700 1 -- 172.21.15.50:0/410193248 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211000bb20 con 0x7f2118159c00 2023-11-28T11:59:28.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.453+0000 7f2116ffd700 1 -- 172.21.15.50:0/410193248 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2110012430 con 0x7f2118159c00 2023-11-28T11:59:28.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.453+0000 7f211d0fe700 1 -- 172.21.15.50:0/410193248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2118159c00 msgr2=0x7f21180cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.453+0000 7f211d0fe700 1 --2- 172.21.15.50:0/410193248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2118159c00 0x7f21180cc470 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f2110009d90 tx=0x7f211000b330 comp rx=0 tx=0).stop 2023-11-28T11:59:28.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.453+0000 7f211d0fe700 1 -- 172.21.15.50:0/410193248 shutdown_connections 2023-11-28T11:59:28.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.453+0000 7f211d0fe700 1 --2- 172.21.15.50:0/410193248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2118159c00 0x7f21180cc470 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.453+0000 7f211d0fe700 1 --2- 172.21.15.50:0/410193248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f211815d650 0x7f21180ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.453+0000 7f211d0fe700 1 -- 172.21.15.50:0/410193248 >> 172.21.15.50:0/410193248 conn(0x7f211806ec40 msgr2=0x7f21180b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:28.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.453+0000 7f211d0fe700 1 -- 172.21.15.50:0/410193248 shutdown_connections 2023-11-28T11:59:28.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.453+0000 7f211d0fe700 1 -- 172.21.15.50:0/410193248 wait complete. 2023-11-28T11:59:28.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.453+0000 7f211d0fe700 1 Processor -- start 2023-11-28T11:59:28.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.453+0000 7f211d0fe700 1 -- start start 2023-11-28T11:59:28.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f211d0fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21180cc020 0x7f211806a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f211d0fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2118159c00 0x7f21180afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f211d0fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f211815d650 0x7f21181500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f211d0fe700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21180ad420 con 0x7f2118159c00 2023-11-28T11:59:28.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f211d0fe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21180ac380 con 0x7f211815d650 2023-11-28T11:59:28.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f211d0fe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21180ac660 con 0x7f21180cc020 2023-11-28T11:59:28.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f21177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2118159c00 0x7f21180afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f21177fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2118159c00 0x7f21180afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34778/0 (socket says 172.21.15.50:34778) 2023-11-28T11:59:28.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f21177fe700 1 -- 172.21.15.50:0/3734028803 learned_addr learned my addr 172.21.15.50:0/3734028803 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:28.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f211c8fd700 1 --2- 172.21.15.50:0/3734028803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f211815d650 0x7f21181500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f2117fff700 1 --2- 172.21.15.50:0/3734028803 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21180cc020 0x7f211806a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f21177fe700 1 -- 172.21.15.50:0/3734028803 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21180cc020 msgr2=0x7f211806a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f21177fe700 1 --2- 172.21.15.50:0/3734028803 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21180cc020 0x7f211806a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f21177fe700 1 -- 172.21.15.50:0/3734028803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f211815d650 msgr2=0x7f21181500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f21177fe700 1 --2- 172.21.15.50:0/3734028803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f211815d650 0x7f21181500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f21177fe700 1 -- 172.21.15.50:0/3734028803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2110009a70 con 0x7f2118159c00 2023-11-28T11:59:28.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f21177fe700 1 --2- 172.21.15.50:0/3734028803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2118159c00 0x7f21180afc90 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f210c00c750 tx=0x7f210c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f2114ff9700 1 -- 172.21.15.50:0/3734028803 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c004ca0 con 0x7f2118159c00 2023-11-28T11:59:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f2114ff9700 1 -- 172.21.15.50:0/3734028803 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c004e00 con 0x7f2118159c00 2023-11-28T11:59:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f211d0fe700 1 -- 172.21.15.50:0/3734028803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211815a250 con 0x7f2118159c00 2023-11-28T11:59:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f2114ff9700 1 -- 172.21.15.50:0/3734028803 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c007310 con 0x7f2118159c00 2023-11-28T11:59:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.457+0000 7f211d0fe700 1 -- 172.21.15.50:0/3734028803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21180cdf50 con 0x7f2118159c00 2023-11-28T11:59:28.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.461+0000 7f211d0fe700 1 -- 172.21.15.50:0/3734028803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211806bb80 con 0x7f2118159c00 2023-11-28T11:59:28.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.461+0000 7f2114ff9700 1 -- 172.21.15.50:0/3734028803 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f210c01a020 con 0x7f2118159c00 2023-11-28T11:59:28.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.461+0000 7f2114ff9700 1 --2- 172.21.15.50:0/3734028803 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2104064ee0 0x7f2104067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.461+0000 7f2114ff9700 1 -- 172.21.15.50:0/3734028803 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f210c0816c0 con 0x7f2118159c00 2023-11-28T11:59:28.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.461+0000 7f2117fff700 1 --2- 172.21.15.50:0/3734028803 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2104064ee0 0x7f2104067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.461+0000 7f2117fff700 1 --2- 172.21.15.50:0/3734028803 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2104064ee0 0x7f2104067390 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2108009b50 tx=0x7f2108009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.465+0000 7f2114ff9700 1 -- 172.21.15.50:0/3734028803 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f210c04f9a0 con 0x7f2118159c00 2023-11-28T11:59:28.635 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.633+0000 7f211d0fe700 1 -- 172.21.15.50:0/3734028803 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f21180cc9b0 con 0x7f2104064ee0 2023-11-28T11:59:28.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.633+0000 7f2114ff9700 1 -- 172.21.15.50:0/3734028803 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f21180cc9b0 con 0x7f2104064ee0 2023-11-28T11:59:28.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.633+0000 7f211d0fe700 1 -- 172.21.15.50:0/3734028803 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2104064ee0 msgr2=0x7f2104067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.633+0000 7f211d0fe700 1 --2- 172.21.15.50:0/3734028803 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2104064ee0 0x7f2104067390 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2108009b50 tx=0x7f2108009240 comp rx=0 tx=0).stop 2023-11-28T11:59:28.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.633+0000 7f211d0fe700 1 -- 172.21.15.50:0/3734028803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2118159c00 msgr2=0x7f21180afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.633+0000 7f211d0fe700 1 --2- 172.21.15.50:0/3734028803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2118159c00 0x7f21180afc90 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f210c00c750 tx=0x7f210c00ca60 comp rx=0 tx=0).stop 2023-11-28T11:59:28.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.633+0000 7f211d0fe700 1 -- 172.21.15.50:0/3734028803 shutdown_connections 2023-11-28T11:59:28.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.633+0000 7f211d0fe700 1 --2- 172.21.15.50:0/3734028803 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2104064ee0 0x7f2104067390 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.633+0000 7f211d0fe700 1 --2- 172.21.15.50:0/3734028803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f211815d650 0x7f21181500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.633+0000 7f211d0fe700 1 --2- 172.21.15.50:0/3734028803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2118159c00 0x7f21180afc90 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.633+0000 7f211d0fe700 1 --2- 172.21.15.50:0/3734028803 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21180cc020 0x7f211806a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.633+0000 7f211d0fe700 1 -- 172.21.15.50:0/3734028803 >> 172.21.15.50:0/3734028803 conn(0x7f211806ec40 msgr2=0x7f21180ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:28.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.633+0000 7f211d0fe700 1 -- 172.21.15.50:0/3734028803 shutdown_connections 2023-11-28T11:59:28.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.637+0000 7f211d0fe700 1 -- 172.21.15.50:0/3734028803 wait complete. 2023-11-28T11:59:28.641 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 6 to deep-scrub 2023-11-28T11:59:28.650 INFO:tasks.ceph:Scrubbing osd.7 2023-11-28T11:59:28.651 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-28T11:59:28.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.773+0000 7f9b63fff700 1 Processor -- start 2023-11-28T11:59:28.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.773+0000 7f9b63fff700 1 -- start start 2023-11-28T11:59:28.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b63fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9b640b1ae0 0x7f9b6406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b63fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b640cf0e0 0x7f9b640cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b63fff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b640cfa40 con 0x7f9b6406a4c0 2023-11-28T11:59:28.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b63fff700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b640d0ab0 con 0x7f9b640cf0e0 2023-11-28T11:59:28.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b63fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b6406a9c0 con 0x7f9b640b1ae0 2023-11-28T11:59:28.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b637fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9b640cf0e0 0x7f9b640cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b627fc700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9b6406a4c0 0x7f9b640d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50618/0 (socket says 172.21.15.50:50618) 2023-11-28T11:59:28.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b627fc700 1 -- 172.21.15.50:0/4285080954 learned_addr learned my addr 172.21.15.50:0/4285080954 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:28.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b62ffd700 1 --2- 172.21.15.50:0/4285080954 >> v2:172.21.15.192:3300/0 conn(0x7f9b640b1ae0 0x7f9b6406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b637fe700 1 -- 172.21.15.50:0/4285080954 >> v2:172.21.15.192:3300/0 conn(0x7f9b640b1ae0 msgr2=0x7f9b6406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:28.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b637fe700 1 --2- 172.21.15.50:0/4285080954 >> v2:172.21.15.192:3300/0 conn(0x7f9b640b1ae0 0x7f9b6406d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b637fe700 1 -- 172.21.15.50:0/4285080954 >> v1:172.21.15.50:6789/0 conn(0x7f9b6406a4c0 legacy=0x7f9b640d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b637fe700 1 -- 172.21.15.50:0/4285080954 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6406aca0 con 0x7f9b640cf0e0 2023-11-28T11:59:28.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b61ffb700 1 -- 172.21.15.50:0/4285080954 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884649884 0 0) 0x7f9b640cfa40 con 0x7f9b6406a4c0 2023-11-28T11:59:28.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b637fe700 1 --2- 172.21.15.50:0/4285080954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b640cf0e0 0x7f9b640cf500 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f9b640b8870 tx=0x7f9b5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c6763d79e25d83 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b61ffb700 1 -- 172.21.15.50:0/4285080954 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c00e070 con 0x7f9b640cf0e0 2023-11-28T11:59:28.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b61ffb700 1 -- 172.21.15.50:0/4285080954 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5c00bb20 con 0x7f9b640cf0e0 2023-11-28T11:59:28.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b61ffb700 1 -- 172.21.15.50:0/4285080954 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c012430 con 0x7f9b640cf0e0 2023-11-28T11:59:28.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b63fff700 1 -- 172.21.15.50:0/4285080954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b640cf0e0 msgr2=0x7f9b640cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b63fff700 1 --2- 172.21.15.50:0/4285080954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b640cf0e0 0x7f9b640cf500 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f9b640b8870 tx=0x7f9b5c00b330 comp rx=0 tx=0).stop 2023-11-28T11:59:28.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b63fff700 1 -- 172.21.15.50:0/4285080954 shutdown_connections 2023-11-28T11:59:28.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b63fff700 1 --2- 172.21.15.50:0/4285080954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b640cf0e0 0x7f9b640cf500 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b63fff700 1 --2- 172.21.15.50:0/4285080954 >> v2:172.21.15.192:3300/0 conn(0x7f9b640b1ae0 0x7f9b6406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b63fff700 1 -- 172.21.15.50:0/4285080954 >> 172.21.15.50:0/4285080954 conn(0x7f9b6409bbd0 msgr2=0x7f9b640b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:28.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b63fff700 1 -- 172.21.15.50:0/4285080954 shutdown_connections 2023-11-28T11:59:28.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.777+0000 7f9b63fff700 1 -- 172.21.15.50:0/4285080954 wait complete. 2023-11-28T11:59:28.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b63fff700 1 Processor -- start 2023-11-28T11:59:28.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b63fff700 1 -- start start 2023-11-28T11:59:28.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b63fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b6406a4c0 0x7f9b64159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b63fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b640b1ae0 0x7f9b6409c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b63fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b640cf0e0 0x7f9b641583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b63fff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6415a410 con 0x7f9b640cf0e0 2023-11-28T11:59:28.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b63fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6409ca80 con 0x7f9b640b1ae0 2023-11-28T11:59:28.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b63fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6409eca0 con 0x7f9b6406a4c0 2023-11-28T11:59:28.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b637fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b640cf0e0 0x7f9b641583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b637fe700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b640cf0e0 0x7f9b641583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34798/0 (socket says 172.21.15.50:34798) 2023-11-28T11:59:28.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b637fe700 1 -- 172.21.15.50:0/1314591553 learned_addr learned my addr 172.21.15.50:0/1314591553 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:28.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b62ffd700 1 --2- 172.21.15.50:0/1314591553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b6406a4c0 0x7f9b64159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b627fc700 1 --2- 172.21.15.50:0/1314591553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b640b1ae0 0x7f9b6409c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b637fe700 1 -- 172.21.15.50:0/1314591553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b6406a4c0 msgr2=0x7f9b64159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b637fe700 1 --2- 172.21.15.50:0/1314591553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b6406a4c0 0x7f9b64159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b637fe700 1 -- 172.21.15.50:0/1314591553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b640b1ae0 msgr2=0x7f9b6409c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b637fe700 1 --2- 172.21.15.50:0/1314591553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b640b1ae0 0x7f9b6409c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b637fe700 1 -- 172.21.15.50:0/1314591553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c009a70 con 0x7f9b640cf0e0 2023-11-28T11:59:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b627fc700 1 --2- 172.21.15.50:0/1314591553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b640b1ae0 0x7f9b6409c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T11:59:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b637fe700 1 --2- 172.21.15.50:0/1314591553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b640cf0e0 0x7f9b641583a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c014040 tx=0x7f9b5c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b5b7fe700 1 -- 172.21.15.50:0/1314591553 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c012430 con 0x7f9b640cf0e0 2023-11-28T11:59:28.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b5b7fe700 1 -- 172.21.15.50:0/1314591553 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5c020070 con 0x7f9b640cf0e0 2023-11-28T11:59:28.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b63fff700 1 -- 172.21.15.50:0/1314591553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b640b4380 con 0x7f9b640cf0e0 2023-11-28T11:59:28.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.781+0000 7f9b5b7fe700 1 -- 172.21.15.50:0/1314591553 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c004280 con 0x7f9b640cf0e0 2023-11-28T11:59:28.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.785+0000 7f9b63fff700 1 -- 172.21.15.50:0/1314591553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6406af80 con 0x7f9b640cf0e0 2023-11-28T11:59:28.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.785+0000 7f9b63fff700 1 -- 172.21.15.50:0/1314591553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9b640b1eb0 con 0x7f9b640cf0e0 2023-11-28T11:59:28.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.785+0000 7f9b5b7fe700 1 -- 172.21.15.50:0/1314591553 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9b5c0043e0 con 0x7f9b640cf0e0 2023-11-28T11:59:28.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.785+0000 7f9b5b7fe700 1 --2- 172.21.15.50:0/1314591553 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9b44064ee0 0x7f9b44067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.785+0000 7f9b5b7fe700 1 -- 172.21.15.50:0/1314591553 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f9b5c022070 con 0x7f9b640cf0e0 2023-11-28T11:59:28.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.785+0000 7f9b5b7fe700 1 --2- 172.21.15.50:0/1314591553 >> [v2:172.21.15.192:6800/36818,v1:172.21.15.192:6801/36818] conn(0x7f9b4406b7f0 0x7f9b4406dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.785+0000 7f9b5b7fe700 1 -- 172.21.15.50:0/1314591553 --> [v2:172.21.15.192:6800/36818,v1:172.21.15.192:6801/36818] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b4406e2f0 con 0x7f9b4406b7f0 2023-11-28T11:59:28.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.785+0000 7f9b62ffd700 1 --2- 172.21.15.50:0/1314591553 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9b44064ee0 0x7f9b44067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.785+0000 7f9b5b7fe700 1 -- 172.21.15.50:0/1314591553 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b5c086500 con 0x7f9b640cf0e0 2023-11-28T11:59:28.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.785+0000 7f9b627fc700 1 --2- 172.21.15.50:0/1314591553 >> [v2:172.21.15.192:6800/36818,v1:172.21.15.192:6801/36818] conn(0x7f9b4406b7f0 0x7f9b4406dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.789+0000 7f9b62ffd700 1 --2- 172.21.15.50:0/1314591553 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9b44064ee0 0x7f9b44067390 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009bf0 tx=0x7f9b4c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.789+0000 7f9b627fc700 1 --2- 172.21.15.50:0/1314591553 >> [v2:172.21.15.192:6800/36818,v1:172.21.15.192:6801/36818] conn(0x7f9b4406b7f0 0x7f9b4406dc20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.789+0000 7f9b5b7fe700 1 -- 172.21.15.50:0/1314591553 <== osd.7 v2:172.21.15.192:6800/36818 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9b4406e2f0 con 0x7f9b4406b7f0 2023-11-28T11:59:28.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.809+0000 7f9b63fff700 1 -- 172.21.15.50:0/1314591553 --> [v2:172.21.15.192:6800/36818,v1:172.21.15.192:6801/36818] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9b64072500 con 0x7f9b4406b7f0 2023-11-28T11:59:28.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.809+0000 7f9b5b7fe700 1 -- 172.21.15.50:0/1314591553 <== osd.7 v2:172.21.15.192:6800/36818 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9b64072500 con 0x7f9b4406b7f0 2023-11-28T11:59:28.812 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-11-28T11:59:28.813 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T11:59:28.813 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-11-28T11:59:28.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.809+0000 7f9b63fff700 1 -- 172.21.15.50:0/1314591553 >> [v2:172.21.15.192:6800/36818,v1:172.21.15.192:6801/36818] conn(0x7f9b4406b7f0 msgr2=0x7f9b4406dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.809+0000 7f9b63fff700 1 --2- 172.21.15.50:0/1314591553 >> [v2:172.21.15.192:6800/36818,v1:172.21.15.192:6801/36818] conn(0x7f9b4406b7f0 0x7f9b4406dc20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.809+0000 7f9b63fff700 1 -- 172.21.15.50:0/1314591553 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9b44064ee0 msgr2=0x7f9b44067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.809+0000 7f9b63fff700 1 --2- 172.21.15.50:0/1314591553 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f9b44064ee0 0x7f9b44067390 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009bf0 tx=0x7f9b4c009240 comp rx=0 tx=0).stop 2023-11-28T11:59:28.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.809+0000 7f9b63fff700 1 -- 172.21.15.50:0/1314591553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b640cf0e0 msgr2=0x7f9b641583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.809+0000 7f9b63fff700 1 --2- 172.21.15.50:0/1314591553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b640cf0e0 0x7f9b641583a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c014040 tx=0x7f9b5c004af0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.809+0000 7f9b637fe700 1 -- 172.21.15.50:0/1314591553 reap_dead start 2023-11-28T11:59:28.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.809+0000 7f9b63fff700 1 -- 172.21.15.50:0/1314591553 shutdown_connections 2023-11-28T11:59:28.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.809+0000 7f9b63fff700 1 -- 172.21.15.50:0/1314591553 >> 172.21.15.50:0/1314591553 conn(0x7f9b6409bbd0 msgr2=0x7f9b6415bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:28.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.809+0000 7f9b63fff700 1 -- 172.21.15.50:0/1314591553 shutdown_connections 2023-11-28T11:59:28.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.809+0000 7f9b63fff700 1 -- 172.21.15.50:0/1314591553 wait complete. 2023-11-28T11:59:28.831 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-28T11:59:28.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.949+0000 7f18589f8700 1 Processor -- start 2023-11-28T11:59:28.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.949+0000 7f18589f8700 1 -- start start 2023-11-28T11:59:28.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.949+0000 7f18589f8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185415d650 0x7f18540ce470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.949+0000 7f18589f8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1854159c00 0x7f18540cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.949+0000 7f18589f8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18540cc9b0 con 0x7f18540cc020 2023-11-28T11:59:28.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.949+0000 7f18589f8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18540cd720 con 0x7f1854159c00 2023-11-28T11:59:28.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.949+0000 7f18589f8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18540cd990 con 0x7f185415d650 2023-11-28T11:59:28.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.949+0000 7f1853fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1854159c00 0x7f18540cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.949+0000 7f18537fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185415d650 0x7f18540ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.949+0000 7f1852ffd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f18540cc020 0x7f18541594f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.50:48006/0 (socket says 172.21.15.50:48006) 2023-11-28T11:59:28.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.949+0000 7f1852ffd700 1 -- 172.21.15.50:0/470219616 learned_addr learned my addr 172.21.15.50:0/470219616 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:28.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18527fc700 1 -- 172.21.15.50:0/470219616 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583769352 0 0) 0x7f183c001110 con 0x7f18540cc020 2023-11-28T11:59:28.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18527fc700 1 -- 172.21.15.50:0/470219616 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18400035d0 con 0x7f18540cc020 2023-11-28T11:59:28.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18537fe700 1 -- 172.21.15.50:0/470219616 >> v2:172.21.15.192:3300/0 conn(0x7f1854159c00 msgr2=0x7f18540cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:28.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18537fe700 1 --2- 172.21.15.50:0/470219616 >> v2:172.21.15.192:3300/0 conn(0x7f1854159c00 0x7f18540cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18537fe700 1 -- 172.21.15.50:0/470219616 >> v1:172.21.15.192:6789/0 conn(0x7f18540cc020 legacy=0x7f18541594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18537fe700 1 -- 172.21.15.50:0/470219616 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18540cdc70 con 0x7f185415d650 2023-11-28T11:59:28.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18537fe700 1 --2- 172.21.15.50:0/470219616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185415d650 0x7f18540ce470 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1844009850 tx=0x7f1844009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2f75d9e506bf015 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18527fc700 1 -- 172.21.15.50:0/470219616 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844011830 con 0x7f185415d650 2023-11-28T11:59:28.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18527fc700 1 -- 172.21.15.50:0/470219616 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1844011990 con 0x7f185415d650 2023-11-28T11:59:28.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18527fc700 1 -- 172.21.15.50:0/470219616 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844011d40 con 0x7f185415d650 2023-11-28T11:59:28.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18589f8700 1 -- 172.21.15.50:0/470219616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185415d650 msgr2=0x7f18540ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18589f8700 1 --2- 172.21.15.50:0/470219616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185415d650 0x7f18540ce470 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1844009850 tx=0x7f1844009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18589f8700 1 -- 172.21.15.50:0/470219616 shutdown_connections 2023-11-28T11:59:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18589f8700 1 --2- 172.21.15.50:0/470219616 >> v2:172.21.15.192:3300/0 conn(0x7f1854159c00 0x7f18540cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18589f8700 1 --2- 172.21.15.50:0/470219616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185415d650 0x7f18540ce470 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18589f8700 1 -- 172.21.15.50:0/470219616 >> 172.21.15.50:0/470219616 conn(0x7f185406ec40 msgr2=0x7f18540b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18589f8700 1 -- 172.21.15.50:0/470219616 shutdown_connections 2023-11-28T11:59:28.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.953+0000 7f18589f8700 1 -- 172.21.15.50:0/470219616 wait complete. 2023-11-28T11:59:28.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.957+0000 7f18589f8700 1 Processor -- start 2023-11-28T11:59:28.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.957+0000 7f18589f8700 1 -- start start 2023-11-28T11:59:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f18589f8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18540cc020 0x7f18540c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f18589f8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1854159c00 0x7f18540c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f18589f8700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185415d650 0x7f185406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f18589f8700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18541f3870 con 0x7f185415d650 2023-11-28T11:59:28.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f18589f8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18540c9600 con 0x7f1854159c00 2023-11-28T11:59:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f18589f8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18540c6990 con 0x7f18540cc020 2023-11-28T11:59:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f1853fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185415d650 0x7f185406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f1853fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185415d650 0x7f185406a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34814/0 (socket says 172.21.15.50:34814) 2023-11-28T11:59:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f1853fff700 1 -- 172.21.15.50:0/2444794726 learned_addr learned my addr 172.21.15.50:0/2444794726 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f18537fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18540cc020 0x7f18540c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f1852ffd700 1 --2- 172.21.15.50:0/2444794726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1854159c00 0x7f18540c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f1853fff700 1 -- 172.21.15.50:0/2444794726 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18540cc020 msgr2=0x7f18540c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f1853fff700 1 --2- 172.21.15.50:0/2444794726 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18540cc020 0x7f18540c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f1853fff700 1 -- 172.21.15.50:0/2444794726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1854159c00 msgr2=0x7f18540c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f1853fff700 1 --2- 172.21.15.50:0/2444794726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1854159c00 0x7f18540c6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f1853fff700 1 -- 172.21.15.50:0/2444794726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18440094b0 con 0x7f185415d650 2023-11-28T11:59:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f1853fff700 1 --2- 172.21.15.50:0/2444794726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185415d650 0x7f185406a4d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f184c00efc0 tx=0x7f184c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f184bfff700 1 -- 172.21.15.50:0/2444794726 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c009ea0 con 0x7f185415d650 2023-11-28T11:59:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f184bfff700 1 -- 172.21.15.50:0/2444794726 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184c00f040 con 0x7f185415d650 2023-11-28T11:59:28.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f18589f8700 1 -- 172.21.15.50:0/2444794726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185415a250 con 0x7f185415d650 2023-11-28T11:59:28.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f184bfff700 1 -- 172.21.15.50:0/2444794726 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c00ced0 con 0x7f185415d650 2023-11-28T11:59:28.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f18589f8700 1 -- 172.21.15.50:0/2444794726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18540cdf50 con 0x7f185415d650 2023-11-28T11:59:28.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.961+0000 7f18589f8700 1 -- 172.21.15.50:0/2444794726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185406bb80 con 0x7f185415d650 2023-11-28T11:59:28.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.965+0000 7f184bfff700 1 -- 172.21.15.50:0/2444794726 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f184c014480 con 0x7f185415d650 2023-11-28T11:59:28.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.965+0000 7f184bfff700 1 --2- 172.21.15.50:0/2444794726 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1834064ee0 0x7f1834067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:28.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.965+0000 7f184bfff700 1 -- 172.21.15.50:0/2444794726 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f184c082960 con 0x7f185415d650 2023-11-28T11:59:28.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.965+0000 7f18537fe700 1 --2- 172.21.15.50:0/2444794726 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1834064ee0 0x7f1834067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:28.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.965+0000 7f18537fe700 1 --2- 172.21.15.50:0/2444794726 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1834064ee0 0x7f1834067390 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f18440090b0 tx=0x7f184401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:28.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:28.973+0000 7f184bfff700 1 -- 172.21.15.50:0/2444794726 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f184c050b90 con 0x7f185415d650 2023-11-28T11:59:29.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.137+0000 7f18589f8700 1 -- 172.21.15.50:0/2444794726 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f1854072c20 con 0x7f1834064ee0 2023-11-28T11:59:29.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.137+0000 7f184bfff700 1 -- 172.21.15.50:0/2444794726 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1854072c20 con 0x7f1834064ee0 2023-11-28T11:59:29.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.137+0000 7f18589f8700 1 -- 172.21.15.50:0/2444794726 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1834064ee0 msgr2=0x7f1834067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.137+0000 7f18589f8700 1 --2- 172.21.15.50:0/2444794726 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1834064ee0 0x7f1834067390 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f18440090b0 tx=0x7f184401c040 comp rx=0 tx=0).stop 2023-11-28T11:59:29.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.137+0000 7f18589f8700 1 -- 172.21.15.50:0/2444794726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185415d650 msgr2=0x7f185406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.137+0000 7f18589f8700 1 --2- 172.21.15.50:0/2444794726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185415d650 0x7f185406a4d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f184c00efc0 tx=0x7f184c00c3a0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.137+0000 7f18589f8700 1 -- 172.21.15.50:0/2444794726 shutdown_connections 2023-11-28T11:59:29.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.137+0000 7f18589f8700 1 --2- 172.21.15.50:0/2444794726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f185415d650 0x7f185406a4d0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.137+0000 7f18589f8700 1 --2- 172.21.15.50:0/2444794726 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f1834064ee0 0x7f1834067390 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.137+0000 7f18589f8700 1 --2- 172.21.15.50:0/2444794726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1854159c00 0x7f18540c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.137+0000 7f18589f8700 1 --2- 172.21.15.50:0/2444794726 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18540cc020 0x7f18540c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.137+0000 7f18589f8700 1 -- 172.21.15.50:0/2444794726 >> 172.21.15.50:0/2444794726 conn(0x7f185406ec40 msgr2=0x7f18541587f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:29.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.141+0000 7f18589f8700 1 -- 172.21.15.50:0/2444794726 shutdown_connections 2023-11-28T11:59:29.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.141+0000 7f18589f8700 1 -- 172.21.15.50:0/2444794726 wait complete. 2023-11-28T11:59:29.144 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 7 to deep-scrub 2023-11-28T11:59:29.156 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:59:29.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.269+0000 7f4fc759e700 1 Processor -- start 2023-11-28T11:59:29.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.269+0000 7f4fc759e700 1 -- start start 2023-11-28T11:59:29.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.269+0000 7f4fc759e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4fc0050760 0x7f4fc0036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.269+0000 7f4fc759e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc0052bf0 con 0x7f4fc00dd280 2023-11-28T11:59:29.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.269+0000 7f4fc759e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc00528c0 con 0x7f4fc0036cb0 2023-11-28T11:59:29.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.269+0000 7f4fc759e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc00dd650 con 0x7f4fc0050760 2023-11-28T11:59:29.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.269+0000 7f4fc5d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4fc0050760 0x7f4fc0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.269+0000 7f4fc659c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4fc00dd280 0x7f4fc00dfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50626/0 (socket says 172.21.15.50:50626) 2023-11-28T11:59:29.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.269+0000 7f4fc5d9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4fc0050760 0x7f4fc0036770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34828/0 (socket says 172.21.15.50:34828) 2023-11-28T11:59:29.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.269+0000 7f4fc659c700 1 -- 172.21.15.50:0/2174402529 learned_addr learned my addr 172.21.15.50:0/2174402529 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T11:59:29.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.269+0000 7f4fc5d9b700 1 -- 172.21.15.50:0/2174402529 >> v1:172.21.15.192:6789/0 conn(0x7f4fc0036cb0 legacy=0x7f4fc0053080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.269+0000 7f4fc5d9b700 1 -- 172.21.15.50:0/2174402529 >> v1:172.21.15.50:6789/0 conn(0x7f4fc00dd280 legacy=0x7f4fc00dfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.269+0000 7f4fc5d9b700 1 -- 172.21.15.50:0/2174402529 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc00e0430 con 0x7f4fc0050760 2023-11-28T11:59:29.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.269+0000 7f4fc5d9b700 1 --2- 172.21.15.50:0/2174402529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc0050760 0x7f4fc0036770 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009850 tx=0x7f4fb8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bced80ca276d5b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:29.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.273+0000 7f4fc559a700 1 -- 172.21.15.50:0/2174402529 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8011830 con 0x7f4fc0050760 2023-11-28T11:59:29.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.273+0000 7f4fc559a700 1 -- 172.21.15.50:0/2174402529 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb8011990 con 0x7f4fc0050760 2023-11-28T11:59:29.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.273+0000 7f4fc559a700 1 -- 172.21.15.50:0/2174402529 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8011d20 con 0x7f4fc0050760 2023-11-28T11:59:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.273+0000 7f4fc759e700 1 -- 172.21.15.50:0/2174402529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc0050760 msgr2=0x7f4fc0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.273+0000 7f4fc759e700 1 --2- 172.21.15.50:0/2174402529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc0050760 0x7f4fc0036770 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009850 tx=0x7f4fb8009b60 comp rx=0 tx=0).stop 2023-11-28T11:59:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.273+0000 7f4fc759e700 1 -- 172.21.15.50:0/2174402529 shutdown_connections 2023-11-28T11:59:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.273+0000 7f4fc759e700 1 --2- 172.21.15.50:0/2174402529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc0050760 0x7f4fc0036770 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.273+0000 7f4fc759e700 1 -- 172.21.15.50:0/2174402529 >> 172.21.15.50:0/2174402529 conn(0x7f4fc0051770 msgr2=0x7f4fc0051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:29.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.273+0000 7f4fc759e700 1 -- 172.21.15.50:0/2174402529 shutdown_connections 2023-11-28T11:59:29.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.273+0000 7f4fc759e700 1 -- 172.21.15.50:0/2174402529 wait complete. 2023-11-28T11:59:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.273+0000 7f4fc759e700 1 Processor -- start 2023-11-28T11:59:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.273+0000 7f4fc759e700 1 -- start start 2023-11-28T11:59:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc759e700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc0036cb0 0x7f4fc00496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fc0050760 0x7f4fc00ddbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fc00dd280 0x7f4fc00de120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc759e700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc004b750 con 0x7f4fc0036cb0 2023-11-28T11:59:29.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc759e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0049d90 con 0x7f4fc0050760 2023-11-28T11:59:29.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0175c90 con 0x7f4fc00dd280 2023-11-28T11:59:29.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc0036cb0 0x7f4fc00496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc659c700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc0036cb0 0x7f4fc00496d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34838/0 (socket says 172.21.15.50:34838) 2023-11-28T11:59:29.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc5d9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fc0050760 0x7f4fc00ddbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc659c700 1 -- 172.21.15.50:0/4189068133 learned_addr learned my addr 172.21.15.50:0/4189068133 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:29.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc6d9d700 1 --2- 172.21.15.50:0/4189068133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fc00dd280 0x7f4fc00de120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc5d9b700 1 -- 172.21.15.50:0/4189068133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fc00dd280 msgr2=0x7f4fc00de120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc5d9b700 1 --2- 172.21.15.50:0/4189068133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fc00dd280 0x7f4fc00de120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc5d9b700 1 -- 172.21.15.50:0/4189068133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc0036cb0 msgr2=0x7f4fc00496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc5d9b700 1 --2- 172.21.15.50:0/4189068133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc0036cb0 0x7f4fc00496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc5d9b700 1 -- 172.21.15.50:0/4189068133 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb80094b0 con 0x7f4fc0050760 2023-11-28T11:59:29.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc659c700 1 --2- 172.21.15.50:0/4189068133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc0036cb0 0x7f4fc00496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:29.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc5d9b700 1 --2- 172.21.15.50:0/4189068133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fc0050760 0x7f4fc00ddbe0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8016000 tx=0x7f4fb8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:29.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fb6ffd700 1 -- 172.21.15.50:0/4189068133 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb80036c0 con 0x7f4fc0050760 2023-11-28T11:59:29.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fb6ffd700 1 -- 172.21.15.50:0/4189068133 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb801f070 con 0x7f4fc0050760 2023-11-28T11:59:29.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fb6ffd700 1 -- 172.21.15.50:0/4189068133 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8003a60 con 0x7f4fc0050760 2023-11-28T11:59:29.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc759e700 1 -- 172.21.15.50:0/4189068133 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc00e09f0 con 0x7f4fc0050760 2023-11-28T11:59:29.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc759e700 1 -- 172.21.15.50:0/4189068133 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc00e0710 con 0x7f4fc0050760 2023-11-28T11:59:29.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.277+0000 7f4fc759e700 1 -- 172.21.15.50:0/4189068133 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc0053790 con 0x7f4fc0050760 2023-11-28T11:59:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.281+0000 7f4fb6ffd700 1 -- 172.21.15.50:0/4189068133 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4fb802c070 con 0x7f4fc0050760 2023-11-28T11:59:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.281+0000 7f4fb6ffd700 1 --2- 172.21.15.50:0/4189068133 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4fa8064ee0 0x7f4fa8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.281+0000 7f4fb6ffd700 1 -- 172.21.15.50:0/4189068133 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f4fb8021070 con 0x7f4fc0050760 2023-11-28T11:59:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.281+0000 7f4fc659c700 1 --2- 172.21.15.50:0/4189068133 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4fa8064ee0 0x7f4fa8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:29.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.281+0000 7f4fc659c700 1 --2- 172.21.15.50:0/4189068133 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4fa8064ee0 0x7f4fa8067390 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00daa40 tx=0x7f4fbc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:29.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.289+0000 7f4fb6ffd700 1 -- 172.21.15.50:0/4189068133 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4fb80519e0 con 0x7f4fc0050760 2023-11-28T11:59:29.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.445+0000 7f4fc759e700 1 -- 172.21.15.50:0/4189068133 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4fc0005570 con 0x7f4fa8064ee0 2023-11-28T11:59:29.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.457+0000 7f4fb6ffd700 1 -- 172.21.15.50:0/4189068133 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71395 (secure 0 0 0) 0x7f4fc0005570 con 0x7f4fa8064ee0 2023-11-28T11:59:29.461 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:59:29.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.457+0000 7f4fc759e700 1 -- 172.21.15.50:0/4189068133 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4fa8064ee0 msgr2=0x7f4fa8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.457+0000 7f4fc759e700 1 --2- 172.21.15.50:0/4189068133 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4fa8064ee0 0x7f4fa8067390 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00daa40 tx=0x7f4fbc009040 comp rx=0 tx=0).stop 2023-11-28T11:59:29.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.457+0000 7f4fc759e700 1 -- 172.21.15.50:0/4189068133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fc0050760 msgr2=0x7f4fc00ddbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:29.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.457+0000 7f4fc759e700 1 --2- 172.21.15.50:0/4189068133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fc0050760 0x7f4fc00ddbe0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8016000 tx=0x7f4fb8004770 comp rx=0 tx=0).stop 2023-11-28T11:59:29.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.457+0000 7f4fc759e700 1 -- 172.21.15.50:0/4189068133 shutdown_connections 2023-11-28T11:59:29.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.457+0000 7f4fc759e700 1 --2- 172.21.15.50:0/4189068133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fc00dd280 0x7f4fc00de120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.457+0000 7f4fc759e700 1 --2- 172.21.15.50:0/4189068133 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f4fa8064ee0 0x7f4fa8067390 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.457+0000 7f4fc759e700 1 --2- 172.21.15.50:0/4189068133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fc0050760 0x7f4fc00ddbe0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.457+0000 7f4fc759e700 1 --2- 172.21.15.50:0/4189068133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc0036cb0 0x7f4fc00496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:29.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.457+0000 7f4fc759e700 1 -- 172.21.15.50:0/4189068133 >> 172.21.15.50:0/4189068133 conn(0x7f4fc0051770 msgr2=0x7f4fc0004df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:29.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.457+0000 7f4fc759e700 1 -- 172.21.15.50:0/4189068133 shutdown_connections 2023-11-28T11:59:29.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:29.457+0000 7f4fc759e700 1 -- 172.21.15.50:0/4189068133 wait complete. 2023-11-28T11:59:29.464 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:59:29.475 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2023-11-28T11:59:28.996011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":98744,"kb_used_data":7928,"kb_used_omap":0,"kb_used_meta":90752,"kb_avail":754875976,"statfs":{"total":773094113280,"available":772992999424,"internally_reserved":0,"allocated":8118272,"data_stored":4447344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":92930048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.788808"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":59,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:20.701227+0000","last_change":"2023-11-28T11:53:35.378985+0000","last_active":"2023-11-28T11:59:20.701227+0000","last_peered":"2023-11-28T11:59:20.701227+0000","last_clean":"2023-11-28T11:59:20.701227+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:59:20.701227+0000","last_undegraded":"2023-11-28T11:59:20.701227+0000","last_fullsized":"2023-11-28T11:59:20.701227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":59,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:20.699859+0000","last_change":"2023-11-28T11:53:35.568826+0000","last_active":"2023-11-28T11:59:20.699859+0000","last_peered":"2023-11-28T11:59:20.699859+0000","last_clean":"2023-11-28T11:59:20.699859+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:59:20.699859+0000","last_undegraded":"2023-11-28T11:59:20.699859+0000","last_fullsized":"2023-11-28T11:59:20.699859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:32.237992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":64,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:20.219224+0000","last_change":"2023-11-28T11:53:35.535423+0000","last_active":"2023-11-28T11:59:20.219224+0000","last_peered":"2023-11-28T11:59:20.219224+0000","last_clean":"2023-11-28T11:59:20.219224+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:59:20.219224+0000","last_undegraded":"2023-11-28T11:59:20.219224+0000","last_fullsized":"2023-11-28T11:59:20.219224+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":59,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:20.641339+0000","last_change":"2023-11-28T11:53:35.376360+0000","last_active":"2023-11-28T11:59:20.641339+0000","last_peered":"2023-11-28T11:59:20.641339+0000","last_clean":"2023-11-28T11:59:20.641339+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:59:20.641339+0000","last_undegraded":"2023-11-28T11:59:20.641339+0000","last_fullsized":"2023-11-28T11:59:20.641339+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:29:06.057917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":208,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:20.689446+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:59:20.689446+0000","last_peered":"2023-11-28T11:59:20.689446+0000","last_clean":"2023-11-28T11:59:20.689446+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:59:20.689446+0000","last_undegraded":"2023-11-28T11:59:20.689446+0000","last_fullsized":"2023-11-28T11:59:20.689446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:14:41.371496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":72,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:27.979343+0000","last_change":"2023-11-28T11:59:27.979280+0000","last_active":"2023-11-28T11:59:27.979343+0000","last_peered":"2023-11-28T11:59:27.979343+0000","last_clean":"2023-11-28T11:59:27.979343+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:59:27.979343+0000","last_undegraded":"2023-11-28T11:59:27.979343+0000","last_fullsized":"2023-11-28T11:59:27.979343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:27.979093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:27.979093+0000","last_clean_scrub_stamp":"2023-11-28T11:59:27.979093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:19:03.786251+0000","scrub_duration":0.0057893570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":59,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:20.689046+0000","last_change":"2023-11-28T11:53:35.570941+0000","last_active":"2023-11-28T11:59:20.689046+0000","last_peered":"2023-11-28T11:59:20.689046+0000","last_clean":"2023-11-28T11:59:20.689046+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:59:20.689046+0000","last_undegraded":"2023-11-28T11:59:20.689046+0000","last_fullsized":"2023-11-28T11:59:20.689046+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:20.215804+0000","last_change":"2023-11-28T11:53:35.570701+0000","last_active":"2023-11-28T11:59:20.215804+0000","last_peered":"2023-11-28T11:59:20.215804+0000","last_clean":"2023-11-28T11:59:20.215804+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:59:20.215804+0000","last_undegraded":"2023-11-28T11:59:20.215804+0000","last_fullsized":"2023-11-28T11:59:20.215804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:20.900392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":59,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-28T11:59:20.689668+0000","last_change":"2023-11-28T11:53:35.570758+0000","last_active":"2023-11-28T11:59:20.689668+0000","last_peered":"2023-11-28T11:59:20.689668+0000","last_clean":"2023-11-28T11:59:20.689668+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:59:20.689668+0000","last_undegraded":"2023-11-28T11:59:20.689668+0000","last_fullsized":"2023-11-28T11:59:20.689668+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:34.349919+0000","last_clean_scrub_stamp":"2023-11-28T11:53:34.349919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:48.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11096,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":9664,"kb_avail":94360744,"statfs":{"total":96636764160,"available":96625401856,"internally_reserved":0,"allocated":1458176,"data_stored":998201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9895936},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89600000000000002,"15min":0.91400000000000003},"min":{"1min":0.53900000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1180000000000001,"5min":1.413,"15min":1.413},"last":1.03},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.98699999999999999,"15min":0.97599999999999998},"min":{"1min":0.76800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.258,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.159}]},{"osd":1,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.86899999999999999,"15min":0.84199999999999997},"min":{"1min":0.63700000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.165,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.85899999999999999,"15min":0.83399999999999996},"min":{"1min":0.61599999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3720000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.95599999999999996}]},{"osd":2,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.83299999999999996,"15min":0.81299999999999994},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1619999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.93100000000000005,"15min":0.92500000000000004},"min":{"1min":0.67300000000000004,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.159,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.85899999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91400000000000003,"15min":0.87},"min":{"1min":0.73399999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1799999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.97499999999999998,"15min":1},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2170000000000001,"5min":1.665,"15min":1.665},"last":1.1299999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.874,"15min":0.874},"min":{"1min":0.66100000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1619999999999999,"5min":1.264,"15min":1.264},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.98699999999999999,"15min":1.01},"min":{"1min":0.70799999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.177,"5min":1.621,"15min":1.621},"last":1.1020000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.01,"15min":1.012},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0740000000000001,"15min":1.0880000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.0649999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.91400000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.216},{"interface":"front","average":{"1min":1.113,"5min":1.115,"15min":1.115},"min":{"1min":0.94099999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2769999999999999,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.90600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9940,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361900,"statfs":{"total":96636764160,"available":96626585600,"internally_reserved":0,"allocated":864256,"data_stored":407833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.55200000000000005,"5min":0.497,"15min":0.497},"max":{"1min":2.802,"5min":2.802,"15min":2.802},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81999999999999995,"15min":0.82899999999999996},"min":{"1min":0.66400000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.165,"5min":1.498,"15min":1.498},"last":0.879}]},{"osd":1,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.82399999999999995,"15min":0.85099999999999998},"min":{"1min":0.69099999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.145,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.018},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.93200000000000005,"15min":0.97299999999999998},"min":{"1min":0.64200000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.621}]},{"osd":2,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94799999999999995,"15min":0.95899999999999996},"min":{"1min":0.64300000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.91800000000000004,"15min":0.90800000000000003},"min":{"1min":0.63500000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.137,"5min":1.204,"15min":1.204},"last":0.78400000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.92900000000000005,"15min":0.89600000000000002},"min":{"1min":0.68400000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1910000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89200000000000002,"15min":0.86599999999999999},"min":{"1min":0.59999999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.157,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.196}]},{"osd":4,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94399999999999995,"15min":0.95199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97699999999999998,"15min":1.0009999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.212,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.077}]},{"osd":5,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.97499999999999998,"15min":1.016},"min":{"1min":0.66200000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.272},{"interface":"front","average":{"1min":1.089,"5min":1.099,"15min":1.131},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.002}]},{"osd":7,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0549999999999999,"15min":1.0760000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2490000000000001,"5min":1.575,"15min":1.575},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.054,"15min":1.0580000000000001},"min":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.3420000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9944,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361896,"statfs":{"total":96636764160,"available":96626581504,"internally_reserved":0,"allocated":868352,"data_stored":408819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.84899999999999998,"15min":0.84699999999999998},"min":{"1min":0.55200000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.872,"15min":0.86399999999999999},"min":{"1min":0.70099999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1299999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.85599999999999998}]},{"osd":1,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90300000000000002,"15min":0.85499999999999998},"min":{"1min":0.65700000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2869999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.90300000000000002,"15min":0.91700000000000004},"min":{"1min":0.67000000000000004,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.212,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.77200000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89600000000000002,"15min":0.85299999999999998},"min":{"1min":0.66900000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.177,"5min":1.208,"15min":1.208},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.89000000000000001,"15min":0.84999999999999998},"min":{"1min":0.748,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1970000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.81999999999999995}]},{"osd":3,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.92700000000000005,"15min":0.91100000000000003},"min":{"1min":0.70999999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.274,"5min":1.403,"15min":1.403},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.995,"15min":0.99099999999999999},"min":{"1min":0.77000000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.238,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.1619999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.874,"15min":0.92100000000000004},"min":{"1min":0.65900000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1950000000000001,"5min":1.968,"15min":1.968},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.99299999999999999,"15min":1.0309999999999999},"min":{"1min":0.73399999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.171,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.995}]},{"osd":6,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.99299999999999999,"15min":1.0049999999999999},"min":{"1min":0.69199999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.373,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.0009999999999999,"15min":1.0029999999999999},"min":{"1min":0.67500000000000004,"5min":0.433,"15min":0.433},"max":{"1min":1.3520000000000001,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.97099999999999997}]},{"osd":7,"last update":"Tue Nov 28 11:58:42 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.046,"15min":1.0669999999999999},"min":{"1min":0.67000000000000004,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.24,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.091,"15min":1.0940000000000001},"min":{"1min":1.018,"5min":0.623,"15min":0.623},"max":{"1min":1.3420000000000001,"5min":1.605,"15min":1.605},"last":1.208}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10200,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":9344,"kb_avail":94361640,"statfs":{"total":96636764160,"available":96626319360,"internally_reserved":0,"allocated":868352,"data_stored":408819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9568256},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.83199999999999996,"15min":0.84199999999999997},"min":{"1min":0.64800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1859999999999999,"5min":1.647,"15min":1.647},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.86599999999999999,"15min":0.85499999999999998},"min":{"1min":0.58399999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.139,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.92100000000000004}]},{"osd":1,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.86299999999999999,"15min":0.86199999999999999},"min":{"1min":0.61399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.226,"5min":1.331,"15min":1.331},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.89200000000000002,"15min":0.93300000000000005},"min":{"1min":0.622,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.145,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.81000000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.92300000000000004,"15min":0.93100000000000005},"min":{"1min":0.61499999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2909999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.012},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.91200000000000003,"15min":0.95899999999999996},"min":{"1min":0.70599999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.125,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.74299999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.92000000000000004,"15min":0.93600000000000005},"min":{"1min":0.66600000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.1799999999999999,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.002,"15min":1.052},"min":{"1min":0.77600000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1759999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.83899999999999997}]},{"osd":5,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.96199999999999997,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.169,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.99399999999999999,"15min":1.032},"min":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1919999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.038}]},{"osd":6,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.98299999999999998,"15min":1.056},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2629999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.073},{"interface":"front","average":{"1min":1.008,"5min":1.077,"15min":1.135},"min":{"1min":0.77500000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.2330000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.879}]},{"osd":7,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.0700000000000001,"15min":1.1359999999999999},"min":{"1min":0.68300000000000005,"5min":0.502,"15min":0.502},"max":{"1min":1.3069999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1220000000000001,"15min":1.1759999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.3580000000000001,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.1379999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14164,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357676,"statfs":{"total":96636764160,"available":96622260224,"internally_reserved":0,"allocated":864256,"data_stored":407833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.879,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.90800000000000003,"5min":21.122,"15min":21.122},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.95699999999999996,"15min":0.78700000000000003},"min":{"1min":0.40400000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.204,"5min":21.288,"15min":21.288},"last":0.67300000000000004}]},{"osd":1,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74199999999999999,"15min":0.64700000000000002},"min":{"1min":0.48399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.133,"5min":6.3090000000000002,"15min":6.3090000000000002},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1,"15min":0.83599999999999997},"min":{"1min":0.54500000000000004,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.91400000000000003,"5min":21.151,"15min":21.151},"last":0.88700000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76400000000000001,"15min":0.78800000000000003},"min":{"1min":0.49099999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.1459999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.379},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.88600000000000001,"15min":0.879},"min":{"1min":0.63,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95099999999999996,"5min":6.5149999999999997,"15min":6.5149999999999997},"last":0.98899999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.2549999999999999,"15min":1.1040000000000001},"min":{"1min":0.61099999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.169,"5min":21.347999999999999,"15min":21.347999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.998,"5min":1.292,"15min":1.1279999999999999},"min":{"1min":0.78500000000000003,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1850000000000001,"5min":21.129999999999999,"15min":21.129999999999999},"last":1.1739999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.2749999999999999,"15min":1.165},"min":{"1min":0.70799999999999996,"5min":0.626,"15min":0.626},"max":{"1min":1.2070000000000001,"5min":21.210999999999999,"15min":21.210999999999999},"last":1.05},{"interface":"front","average":{"1min":1.044,"5min":1.3340000000000001,"15min":1.216},"min":{"1min":0.68799999999999994,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.331,"5min":21.32,"15min":21.32},"last":1.079}]},{"osd":6,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0669999999999999,"15min":1.103},"min":{"1min":0.75700000000000001,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2569999999999999,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.425},{"interface":"front","average":{"1min":1.014,"5min":1.323,"15min":1.1870000000000001},"min":{"1min":0.748,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1890000000000001,"5min":21.077999999999999,"15min":21.077999999999999},"last":1.212}]},{"osd":7,"last update":"Tue Nov 28 11:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.115,"15min":1.147},"min":{"1min":0.78700000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4259999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.252},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.2170000000000001,"15min":1.1890000000000001},"min":{"1min":0.90900000000000003,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.2430000000000001,"5min":6.5750000000000002,"15min":6.5750000000000002},"last":1.5189999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14036,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":13184,"kb_avail":94357804,"statfs":{"total":96636764160,"available":96622391296,"internally_reserved":0,"allocated":864256,"data_stored":407833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13500416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63,"15min":0.59999999999999998},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90800000000000003,"5min":1.123,"15min":1.123},"last":0.503},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71899999999999997,"15min":0.755},"min":{"1min":0.41699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.147,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.624}]},{"osd":1,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.75900000000000001},"min":{"1min":0.53100000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91500000000000004,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.64300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96099999999999997,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.69199999999999995}]},{"osd":3,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68799999999999994,"15min":0.69599999999999995},"min":{"1min":0.56100000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.234,"5min":1.254,"15min":1.254},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.84399999999999997,"15min":0.82799999999999996},"min":{"1min":0.36699999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1080000000000001,"5min":1.968,"15min":1.968},"last":0.56699999999999995}]},{"osd":4,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.999,"15min":1.0329999999999999},"min":{"1min":0.74399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.177,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.014,"15min":1.0649999999999999},"min":{"1min":0.63900000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.157,"5min":2.181,"15min":2.181},"last":0.83199999999999996}]},{"osd":5,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.96099999999999997,"15min":0.97499999999999998},"min":{"1min":0.69099999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.2889999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0780000000000001,"15min":1.123},"min":{"1min":0.82599999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3660000000000001,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":0.89500000000000002}]},{"osd":6,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.079,"15min":1.157},"min":{"1min":0.72799999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.302,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.083,"15min":1.1279999999999999},"min":{"1min":0.80600000000000005,"5min":0.621,"15min":0.621},"max":{"1min":1.3140000000000001,"5min":1.867,"15min":1.867},"last":0.873}]},{"osd":7,"last update":"Tue Nov 28 11:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1220000000000001,"15min":1.1699999999999999},"min":{"1min":0.88600000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.238,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.038},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.097,"15min":1.131},"min":{"1min":0.76800000000000002,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3720000000000001,"5min":1.675,"15min":1.675},"last":0.92800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15132,"kb_used_data":1428,"kb_used_omap":0,"kb_used_meta":13696,"kb_avail":94356708,"statfs":{"total":96636764160,"available":96621268992,"internally_reserved":0,"allocated":1462272,"data_stored":999187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14024704},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46600000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.98099999999999998,"5min":1.387,"15min":1.387},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.73899999999999999,"15min":0.70099999999999996},"min":{"1min":0.62,"5min":0.375,"15min":0.375},"max":{"1min":0.97899999999999998,"5min":1.252,"15min":1.252},"last":0.78500000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.52800000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.85199999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.624},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.57599999999999996,"5min":0.31,"15min":0.31},"max":{"1min":1.123,"5min":1.175,"15min":1.175},"last":0.66100000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.86599999999999999,"15min":0.872},"min":{"1min":0.57199999999999995,"5min":0.317,"15min":0.317},"max":{"1min":1.2549999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.181},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77300000000000002,"15min":0.749},"min":{"1min":0.56000000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.97799999999999998}]},{"osd":4,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.91700000000000004,"15min":0.91100000000000003},"min":{"1min":0.68999999999999995,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0960000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.004,"5min":1.0209999999999999,"15min":1.0629999999999999},"min":{"1min":0.79000000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5409999999999999,"5min":2.29,"15min":2.29},"last":1.25}]},{"osd":5,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0149999999999999,"15min":1.018},"min":{"1min":0.77500000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2909999999999999,"5min":1.47,"15min":1.47},"last":1.079},{"interface":"front","average":{"1min":1.04,"5min":1.0409999999999999,"15min":1.0449999999999999},"min":{"1min":0.80800000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.331,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.006}]},{"osd":6,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.075,"15min":1.0600000000000001},"min":{"1min":0.86799999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.365,"5min":1.581,"15min":1.581},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0720000000000001,"15min":1.0800000000000001},"min":{"1min":0.69999999999999996,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3740000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":1.1319999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.145,"15min":1.1930000000000001},"min":{"1min":0.93200000000000005,"5min":0.747,"15min":0.747},"max":{"1min":1.627,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.1259999999999999,"15min":1.1100000000000001},"min":{"1min":0.89900000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.4079999999999999,"5min":1.647,"15min":1.647},"last":1.2250000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14232,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":13376,"kb_avail":94357608,"statfs":{"total":96636764160,"available":96622190592,"internally_reserved":0,"allocated":868352,"data_stored":408819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13697024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63200000000000001,"15min":0.66700000000000004},"min":{"1min":0.48999999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89200000000000002,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72899999999999998,"15min":0.68400000000000005},"min":{"1min":0.53800000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.83599999999999997}]},{"osd":2,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.503,"5min":0.435,"15min":0.435},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.76500000000000001,"15min":0.71899999999999997},"min":{"1min":0.65400000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.042,"5min":1.175,"15min":1.175},"last":0.56299999999999994}]},{"osd":3,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.69699999999999995},"min":{"1min":0.53100000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.117,"5min":1.159,"15min":1.159},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90200000000000002,"15min":0.92200000000000004},"min":{"1min":0.61199999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.575,"5min":1.96,"15min":1.96},"last":0.79600000000000004}]},{"osd":4,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.90700000000000003,"15min":0.879},"min":{"1min":0.73399999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0249999999999999,"15min":1.093},"min":{"1min":0.81899999999999995,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.8049999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.97699999999999998}]},{"osd":5,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.0569999999999999,"15min":1.069},"min":{"1min":0.78700000000000003,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.478,"5min":1.649,"15min":1.649},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.75600000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3080000000000001,"5min":1.339,"15min":1.339},"last":0.86599999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.127,"15min":1.173},"min":{"1min":0.93200000000000005,"5min":0.755,"15min":0.755},"max":{"1min":1.8819999999999999,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.226,"5min":1.143,"15min":1.1419999999999999},"min":{"1min":0.93000000000000005,"5min":0.749,"15min":0.749},"max":{"1min":1.468,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.111}]},{"osd":7,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1619999999999999,"15min":1.1639999999999999},"min":{"1min":0.86699999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.107,"15min":1.087},"min":{"1min":0.998,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.367,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.0900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:59:29.479 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-11-28T11:53:34.349919+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=53, tm_sec=34, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=59, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T11:59:29.479 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-11-28T11:53:34.349919+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=53, tm_sec=34, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=59, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T11:59:29.479 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-11-28T11:53:34.349919+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=53, tm_sec=34, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=59, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T11:59:29.479 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-11-28T11:53:34.349919+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=53, tm_sec=34, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=59, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T11:59:29.480 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-28T11:53:35.353843+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=53, tm_sec=35, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=59, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T11:59:29.480 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-11-28T11:53:34.349919+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=53, tm_sec=34, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=59, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T11:59:29.480 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-11-28T11:53:34.349919+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=53, tm_sec=34, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=59, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T11:59:29.480 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-28T11:53:34.349919+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=53, tm_sec=34, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=59, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T11:59:29.480 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-28T11:59:36.634 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:59:36.637 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T11:59:49.481 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T11:59:49.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2de6388700 1 Processor -- start 2023-11-28T11:59:49.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2de6388700 1 -- start start 2023-11-28T11:59:49.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2de6388700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2de0160680 0x7f2de0071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2de6388700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2de00cd5e0 0x7f2de00c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2de6388700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de00cc420 con 0x7f2de0069c40 2023-11-28T11:59:49.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2de6388700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de00cc6c0 con 0x7f2de00cd5e0 2023-11-28T11:59:49.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2de6388700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de00cc9a0 con 0x7f2de0160680 2023-11-28T11:59:49.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2de4925700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2de00cd5e0 0x7f2de00c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2de4925700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2de00cd5e0 0x7f2de00c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54592/0 (socket says 172.21.15.50:54592) 2023-11-28T11:59:49.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2ddffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2de0160680 0x7f2de0071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2de4925700 1 -- 172.21.15.50:0/4155061248 learned_addr learned my addr 172.21.15.50:0/4155061248 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:49.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2ddeffd700 1 -- 172.21.15.50:0/4155061248 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606082761 0 0) 0x7f2de00cc420 con 0x7f2de0069c40 2023-11-28T11:59:49.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2de4925700 1 -- 172.21.15.50:0/4155061248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2de0160680 msgr2=0x7f2de0071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T11:59:49.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2de4925700 1 --2- 172.21.15.50:0/4155061248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2de0160680 0x7f2de0071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2de4925700 1 -- 172.21.15.50:0/4155061248 >> v1:172.21.15.192:6789/0 conn(0x7f2de0069c40 legacy=0x7f2de00cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2de4925700 1 -- 172.21.15.50:0/4155061248 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de00705c0 con 0x7f2de00cd5e0 2023-11-28T11:59:49.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2ddffff700 1 --2- 172.21.15.50:0/4155061248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2de0160680 0x7f2de0071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:49.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2de4925700 1 --2- 172.21.15.50:0/4155061248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2de00cd5e0 0x7f2de00c9ce0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009910 tx=0x7f2dd8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87e7826ec0e70e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:49.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2ddeffd700 1 -- 172.21.15.50:0/4155061248 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8011830 con 0x7f2de00cd5e0 2023-11-28T11:59:49.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2ddeffd700 1 -- 172.21.15.50:0/4155061248 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd8011990 con 0x7f2de00cd5e0 2023-11-28T11:59:49.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2ddeffd700 1 -- 172.21.15.50:0/4155061248 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8011d40 con 0x7f2de00cd5e0 2023-11-28T11:59:49.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2de6388700 1 -- 172.21.15.50:0/4155061248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2de00cd5e0 msgr2=0x7f2de00c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.608+0000 7f2de6388700 1 --2- 172.21.15.50:0/4155061248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2de00cd5e0 0x7f2de00c9ce0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009910 tx=0x7f2dd8009c20 comp rx=0 tx=0).stop 2023-11-28T11:59:49.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.612+0000 7f2de6388700 1 -- 172.21.15.50:0/4155061248 shutdown_connections 2023-11-28T11:59:49.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.612+0000 7f2de6388700 1 --2- 172.21.15.50:0/4155061248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2de00cd5e0 0x7f2de00c9ce0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.612+0000 7f2de6388700 1 --2- 172.21.15.50:0/4155061248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2de0160680 0x7f2de0071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.612+0000 7f2de6388700 1 -- 172.21.15.50:0/4155061248 >> 172.21.15.50:0/4155061248 conn(0x7f2de006caf0 msgr2=0x7f2de00ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.612+0000 7f2de6388700 1 -- 172.21.15.50:0/4155061248 shutdown_connections 2023-11-28T11:59:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.612+0000 7f2de6388700 1 -- 172.21.15.50:0/4155061248 wait complete. 2023-11-28T11:59:49.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.612+0000 7f2de6388700 1 Processor -- start 2023-11-28T11:59:49.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.612+0000 7f2de6388700 1 -- start start 2023-11-28T11:59:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.612+0000 7f2de6388700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2de0069c40 0x7f2de00b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.612+0000 7f2de6388700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2de00cd5e0 0x7f2de01569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2de6388700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2de0160680 0x7f2de00c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2de6388700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de0156ef0 con 0x7f2de0160680 2023-11-28T11:59:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2de6388700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de015aa40 con 0x7f2de00cd5e0 2023-11-28T11:59:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2de6388700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de015ad20 con 0x7f2de0069c40 2023-11-28T11:59:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2de4925700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2de0160680 0x7f2de00c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2ddf7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2de00cd5e0 0x7f2de01569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2ddffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2de0069c40 0x7f2de00b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2de4925700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2de0160680 0x7f2de00c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54606/0 (socket says 172.21.15.50:54606) 2023-11-28T11:59:49.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2de4925700 1 -- 172.21.15.50:0/3797440206 learned_addr learned my addr 172.21.15.50:0/3797440206 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T11:59:49.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2de4925700 1 -- 172.21.15.50:0/3797440206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2de0069c40 msgr2=0x7f2de00b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2de4925700 1 --2- 172.21.15.50:0/3797440206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2de0069c40 0x7f2de00b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2de4925700 1 -- 172.21.15.50:0/3797440206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2de00cd5e0 msgr2=0x7f2de01569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2de4925700 1 --2- 172.21.15.50:0/3797440206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2de00cd5e0 0x7f2de01569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2de4925700 1 -- 172.21.15.50:0/3797440206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc80094b0 con 0x7f2de0160680 2023-11-28T11:59:49.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2ddf7fe700 1 --2- 172.21.15.50:0/3797440206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2de00cd5e0 0x7f2de01569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T11:59:49.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2de4925700 1 --2- 172.21.15.50:0/3797440206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2de0160680 0x7f2de00c9b80 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f2de006fa00 tx=0x7f2dd8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:49.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2ddcff9700 1 -- 172.21.15.50:0/3797440206 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd801a900 con 0x7f2de0160680 2023-11-28T11:59:49.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2ddcff9700 1 -- 172.21.15.50:0/3797440206 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd801f070 con 0x7f2de0160680 2023-11-28T11:59:49.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2ddcff9700 1 -- 172.21.15.50:0/3797440206 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd801acc0 con 0x7f2de0160680 2023-11-28T11:59:49.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2de6388700 1 -- 172.21.15.50:0/3797440206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd8009570 con 0x7f2de0160680 2023-11-28T11:59:49.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2de6388700 1 -- 172.21.15.50:0/3797440206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de00c9750 con 0x7f2de0160680 2023-11-28T11:59:49.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.616+0000 7f2de6388700 1 -- 172.21.15.50:0/3797440206 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de0071940 con 0x7f2de0160680 2023-11-28T11:59:49.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.620+0000 7f2ddcff9700 1 -- 172.21.15.50:0/3797440206 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2dd800f050 con 0x7f2de0160680 2023-11-28T11:59:49.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.620+0000 7f2ddcff9700 1 --2- 172.21.15.50:0/3797440206 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2dc0064ee0 0x7f2dc0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T11:59:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.620+0000 7f2ddcff9700 1 -- 172.21.15.50:0/3797440206 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f2dd8021070 con 0x7f2de0160680 2023-11-28T11:59:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.620+0000 7f2ddffff700 1 --2- 172.21.15.50:0/3797440206 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2dc0064ee0 0x7f2dc0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T11:59:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.620+0000 7f2ddffff700 1 --2- 172.21.15.50:0/3797440206 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2dc0064ee0 0x7f2dc0067390 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8009ce0 tx=0x7f2dc8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T11:59:49.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.628+0000 7f2ddcff9700 1 -- 172.21.15.50:0/3797440206 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2dd8051730 con 0x7f2de0160680 2023-11-28T11:59:49.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.792+0000 7f2de6388700 1 -- 172.21.15.50:0/3797440206 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2de0160a50 con 0x7f2dc0064ee0 2023-11-28T11:59:49.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.800+0000 7f2ddcff9700 1 -- 172.21.15.50:0/3797440206 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71237 (secure 0 0 0) 0x7f2de0160a50 con 0x7f2dc0064ee0 2023-11-28T11:59:49.804 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T11:59:49.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.800+0000 7f2de6388700 1 -- 172.21.15.50:0/3797440206 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2dc0064ee0 msgr2=0x7f2dc0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.800+0000 7f2de6388700 1 --2- 172.21.15.50:0/3797440206 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2dc0064ee0 0x7f2dc0067390 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8009ce0 tx=0x7f2dc8009240 comp rx=0 tx=0).stop 2023-11-28T11:59:49.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.800+0000 7f2de6388700 1 -- 172.21.15.50:0/3797440206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2de0160680 msgr2=0x7f2de00c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T11:59:49.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.800+0000 7f2de6388700 1 --2- 172.21.15.50:0/3797440206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2de0160680 0x7f2de00c9b80 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f2de006fa00 tx=0x7f2dd8004770 comp rx=0 tx=0).stop 2023-11-28T11:59:49.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.800+0000 7f2de6388700 1 -- 172.21.15.50:0/3797440206 shutdown_connections 2023-11-28T11:59:49.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.800+0000 7f2de6388700 1 --2- 172.21.15.50:0/3797440206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2de0160680 0x7f2de00c9b80 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.800+0000 7f2de6388700 1 --2- 172.21.15.50:0/3797440206 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f2dc0064ee0 0x7f2dc0067390 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.800+0000 7f2de6388700 1 --2- 172.21.15.50:0/3797440206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2de00cd5e0 0x7f2de01569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.800+0000 7f2de6388700 1 --2- 172.21.15.50:0/3797440206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2de0069c40 0x7f2de00b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T11:59:49.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.800+0000 7f2de6388700 1 -- 172.21.15.50:0/3797440206 >> 172.21.15.50:0/3797440206 conn(0x7f2de006caf0 msgr2=0x7f2de00b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T11:59:49.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.800+0000 7f2de6388700 1 -- 172.21.15.50:0/3797440206 shutdown_connections 2023-11-28T11:59:49.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T11:59:49.800+0000 7f2de6388700 1 -- 172.21.15.50:0/3797440206 wait complete. 2023-11-28T11:59:49.807 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T11:59:49.820 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2023-11-28T11:59:49.001653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":98744,"kb_used_data":7928,"kb_used_omap":0,"kb_used_meta":90752,"kb_avail":754875976,"statfs":{"total":773094113280,"available":772992999424,"internally_reserved":0,"allocated":8118272,"data_stored":4447344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":92930048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003399"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":74,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:33.602550+0000","last_change":"2023-11-28T11:59:33.602488+0000","last_active":"2023-11-28T11:59:33.602550+0000","last_peered":"2023-11-28T11:59:33.602550+0000","last_clean":"2023-11-28T11:59:33.602550+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:59:33.602550+0000","last_undegraded":"2023-11-28T11:59:33.602550+0000","last_fullsized":"2023-11-28T11:59:33.602550+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:33.602263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:33.602263+0000","last_clean_scrub_stamp":"2023-11-28T11:59:33.602263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:39:34.219987+0000","scrub_duration":0.006117239,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":74,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:38.598838+0000","last_change":"2023-11-28T11:59:38.598787+0000","last_active":"2023-11-28T11:59:38.598838+0000","last_peered":"2023-11-28T11:59:38.598838+0000","last_clean":"2023-11-28T11:59:38.598838+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:59:38.598838+0000","last_undegraded":"2023-11-28T11:59:38.598838+0000","last_fullsized":"2023-11-28T11:59:38.598838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:38.598553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:38.598553+0000","last_clean_scrub_stamp":"2023-11-28T11:59:38.598553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:47:47.640756+0000","scrub_duration":0.0058130969999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":79,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:29.125505+0000","last_change":"2023-11-28T11:59:29.125443+0000","last_active":"2023-11-28T11:59:29.125505+0000","last_peered":"2023-11-28T11:59:29.125505+0000","last_clean":"2023-11-28T11:59:29.125505+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:59:29.125505+0000","last_undegraded":"2023-11-28T11:59:29.125505+0000","last_fullsized":"2023-11-28T11:59:29.125505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:29.125205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:29.125205+0000","last_clean_scrub_stamp":"2023-11-28T11:59:29.125205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:49:57.423707+0000","scrub_duration":0.0060665160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":74,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:32.431373+0000","last_change":"2023-11-28T11:59:32.431315+0000","last_active":"2023-11-28T11:59:32.431373+0000","last_peered":"2023-11-28T11:59:32.431373+0000","last_clean":"2023-11-28T11:59:32.431373+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:59:32.431373+0000","last_undegraded":"2023-11-28T11:59:32.431373+0000","last_fullsized":"2023-11-28T11:59:32.431373+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:32.431073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:32.431073+0000","last_clean_scrub_stamp":"2023-11-28T11:59:32.431073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:10:41.886324+0000","scrub_duration":0.0063483899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":210,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:29.139733+0000","last_change":"2023-11-28T11:53:36.388722+0000","last_active":"2023-11-28T11:59:29.139733+0000","last_peered":"2023-11-28T11:59:29.139733+0000","last_clean":"2023-11-28T11:59:29.139733+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:59:29.139733+0000","last_undegraded":"2023-11-28T11:59:29.139733+0000","last_fullsized":"2023-11-28T11:59:29.139733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:53:35.353843+0000","last_clean_scrub_stamp":"2023-11-28T11:53:35.353843+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":72,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:27.979343+0000","last_change":"2023-11-28T11:59:27.979280+0000","last_active":"2023-11-28T11:59:27.979343+0000","last_peered":"2023-11-28T11:59:27.979343+0000","last_clean":"2023-11-28T11:59:27.979343+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:59:27.979343+0000","last_undegraded":"2023-11-28T11:59:27.979343+0000","last_fullsized":"2023-11-28T11:59:27.979343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:27.979093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:27.979093+0000","last_clean_scrub_stamp":"2023-11-28T11:59:27.979093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:19:03.786251+0000","scrub_duration":0.0057893570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":74,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:34.708020+0000","last_change":"2023-11-28T11:59:34.707925+0000","last_active":"2023-11-28T11:59:34.708020+0000","last_peered":"2023-11-28T11:59:34.708020+0000","last_clean":"2023-11-28T11:59:34.708020+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:59:34.708020+0000","last_undegraded":"2023-11-28T11:59:34.708020+0000","last_fullsized":"2023-11-28T11:59:34.708020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:34.707690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:34.707690+0000","last_clean_scrub_stamp":"2023-11-28T11:59:34.707690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:21.289581+0000","scrub_duration":0.006210836,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":82,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:28.308112+0000","last_change":"2023-11-28T11:59:28.308045+0000","last_active":"2023-11-28T11:59:28.308112+0000","last_peered":"2023-11-28T11:59:28.308112+0000","last_clean":"2023-11-28T11:59:28.308112+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:59:28.308112+0000","last_undegraded":"2023-11-28T11:59:28.308112+0000","last_fullsized":"2023-11-28T11:59:28.308112+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:28.307799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:28.307799+0000","last_clean_scrub_stamp":"2023-11-28T11:59:28.307799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:02.250765+0000","scrub_duration":0.0059409450000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":75,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:33.748832+0000","last_change":"2023-11-28T11:59:33.748742+0000","last_active":"2023-11-28T11:59:33.748832+0000","last_peered":"2023-11-28T11:59:33.748832+0000","last_clean":"2023-11-28T11:59:33.748832+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:59:33.748832+0000","last_undegraded":"2023-11-28T11:59:33.748832+0000","last_fullsized":"2023-11-28T11:59:33.748832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:33.748539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:33.748539+0000","last_clean_scrub_stamp":"2023-11-28T11:59:33.748539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:47:42.790743+0000","scrub_duration":0.0058196680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11096,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":9664,"kb_avail":94360744,"statfs":{"total":96636764160,"available":96625401856,"internally_reserved":0,"allocated":1458176,"data_stored":998201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9895936},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89600000000000002,"15min":0.91400000000000003},"min":{"1min":0.53900000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1180000000000001,"5min":1.413,"15min":1.413},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.98699999999999999,"15min":0.97599999999999998},"min":{"1min":0.76800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.258,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.90900000000000003}]},{"osd":1,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.86899999999999999,"15min":0.84199999999999997},"min":{"1min":0.63700000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.165,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.85899999999999999,"15min":0.83399999999999996},"min":{"1min":0.61599999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3720000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.1020000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.83299999999999996,"15min":0.81299999999999994},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1619999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.93100000000000005,"15min":0.92500000000000004},"min":{"1min":0.67300000000000004,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.159,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0049999999999999}]},{"osd":3,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91400000000000003,"15min":0.87},"min":{"1min":0.73399999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1799999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.97499999999999998,"15min":1},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2170000000000001,"5min":1.665,"15min":1.665},"last":0.82999999999999996}]},{"osd":4,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.874,"15min":0.874},"min":{"1min":0.66100000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1619999999999999,"5min":1.264,"15min":1.264},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.98699999999999999,"15min":1.01},"min":{"1min":0.70799999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.177,"5min":1.621,"15min":1.621},"last":0.86399999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.01,"15min":1.012},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0740000000000001,"15min":1.0880000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.032}]},{"osd":6,"last update":"Tue Nov 28 11:58:44 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.91400000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.151},{"interface":"front","average":{"1min":1.113,"5min":1.115,"15min":1.115},"min":{"1min":0.94099999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2769999999999999,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.0720000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9940,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361900,"statfs":{"total":96636764160,"available":96626585600,"internally_reserved":0,"allocated":864256,"data_stored":407833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.875,"15min":0.89900000000000002},"min":{"1min":0.53100000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.083,"5min":2.802,"15min":2.802},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82299999999999995,"15min":0.82999999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.47699999999999998},"max":{"1min":1.1040000000000001,"5min":1.2030000000000001,"15min":1.498},"last":1.1040000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.82199999999999995,"15min":0.84999999999999998},"min":{"1min":0.58999999999999997,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1399999999999999,"5min":1.145,"15min":1.4059999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.90300000000000002,"15min":0.96299999999999997},"min":{"1min":0.61099999999999999,"5min":0.53500000000000003,"15min":0.52700000000000002},"max":{"1min":1.177,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.99299999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.93700000000000006,"15min":0.95499999999999996},"min":{"1min":0.67300000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1919999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.135},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.91800000000000004,"15min":0.90800000000000003},"min":{"1min":0.69899999999999995,"5min":0.59399999999999997,"15min":0.51900000000000002},"max":{"1min":1.173,"5min":1.204,"15min":1.204},"last":0.71299999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.92800000000000005,"15min":0.89600000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1599999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.90700000000000003,"15min":0.871},"min":{"1min":0.73099999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.196,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.755}]},{"osd":4,"last update":"Tue Nov 28 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93999999999999995,"15min":0.95099999999999996},"min":{"1min":0.61699999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1799999999999999,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.95799999999999996,"15min":0.995},"min":{"1min":0.69299999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.3220000000000001},"last":0.89900000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.95499999999999996,"15min":1.0089999999999999},"min":{"1min":0.65300000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.306,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.032,"5min":1.0760000000000001,"15min":1.123},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2549999999999999,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.0600000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.032,"15min":1.0680000000000001},"min":{"1min":0.77400000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2509999999999999,"5min":1.2929999999999999,"15min":1.575},"last":1.024},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.056,"15min":1.0580000000000001},"min":{"1min":0.877,"5min":0.57599999999999996,"15min":0.55800000000000005},"max":{"1min":1.3420000000000001,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":0.97199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9944,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361896,"statfs":{"total":96636764160,"available":96626581504,"internally_reserved":0,"allocated":868352,"data_stored":408819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.84299999999999997,"15min":0.84499999999999997},"min":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2150000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.87,"15min":0.86399999999999999},"min":{"1min":0.61899999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.3180000000000001},"last":0.64100000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.91400000000000003,"15min":0.85799999999999998},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60099999999999998},"max":{"1min":1.258,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.88600000000000001,"15min":0.91100000000000003},"min":{"1min":0.58599999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.169,"5min":1.212,"15min":1.2509999999999999},"last":0.749}]},{"osd":2,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.91800000000000004,"15min":0.85999999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1910000000000001,"5min":1.208,"15min":1.208},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.91600000000000004,"15min":0.85799999999999998},"min":{"1min":0.751,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.78600000000000003}]},{"osd":3,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.92800000000000005,"15min":0.91100000000000003},"min":{"1min":0.58199999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.129,"5min":1.403,"15min":1.403},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.995,"15min":0.99099999999999999},"min":{"1min":0.66500000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.325,"5min":1.3360000000000001,"15min":1.3740000000000001},"last":0.98399999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.87,"15min":0.92000000000000004},"min":{"1min":0.74099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.212,"5min":1.325,"15min":1.968},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.97499999999999998,"15min":1.0249999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3480000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.0309999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.98199999999999998,"15min":1.002},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.55500000000000005},"max":{"1min":1.149,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.052,"5min":1.01,"15min":1.006},"min":{"1min":0.76900000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.345,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.88800000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.05,"15min":1.0680000000000001},"min":{"1min":0.93899999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.345,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.085},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1040000000000001,"15min":1.0980000000000001},"min":{"1min":0.94299999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.3700000000000001,"5min":1.605,"15min":1.605},"last":1.099}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10200,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":9344,"kb_avail":94361640,"statfs":{"total":96636764160,"available":96626319360,"internally_reserved":0,"allocated":868352,"data_stored":408819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9568256},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.83199999999999996,"15min":0.84199999999999997},"min":{"1min":0.64800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1859999999999999,"5min":1.647,"15min":1.647},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.86599999999999999,"15min":0.85499999999999998},"min":{"1min":0.58399999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.139,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.77300000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.86299999999999999,"15min":0.86199999999999999},"min":{"1min":0.61399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.226,"5min":1.331,"15min":1.331},"last":1.022},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.89200000000000002,"15min":0.93300000000000005},"min":{"1min":0.622,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.145,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.752}]},{"osd":2,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.92300000000000004,"15min":0.93100000000000005},"min":{"1min":0.61499999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2909999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.91200000000000003,"15min":0.95899999999999996},"min":{"1min":0.70599999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.125,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.94799999999999995}]},{"osd":3,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.92000000000000004,"15min":0.93600000000000005},"min":{"1min":0.66600000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.1799999999999999,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.002,"15min":1.052},"min":{"1min":0.77600000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1759999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.97399999999999998}]},{"osd":5,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.96199999999999997,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.169,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.99399999999999999,"15min":1.032},"min":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1919999999999999,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.99399999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.98299999999999998,"15min":1.056},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2629999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.008,"5min":1.077,"15min":1.135},"min":{"1min":0.77500000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.2330000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.88500000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.0700000000000001,"15min":1.1359999999999999},"min":{"1min":0.68300000000000005,"5min":0.502,"15min":0.502},"max":{"1min":1.3069999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.048},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1220000000000001,"15min":1.1759999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.3580000000000001,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.0580000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14164,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357676,"statfs":{"total":96636764160,"available":96622260224,"internally_reserved":0,"allocated":864256,"data_stored":407833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.89000000000000001,"15min":0.70599999999999996},"min":{"1min":0.48799999999999999,"5min":0.39000000000000001,"15min":0.28100000000000003},"max":{"1min":1.139,"5min":21.122,"15min":21.122},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.95399999999999996,"15min":0.78600000000000003},"min":{"1min":0.48999999999999999,"5min":0.40400000000000003,"15min":0.29999999999999999},"max":{"1min":1.115,"5min":21.288,"15min":21.288},"last":0.58599999999999997}]},{"osd":1,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.75600000000000001,"15min":0.65200000000000002},"min":{"1min":0.50900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83099999999999996,"5min":6.3090000000000002,"15min":6.3090000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":1.006,"15min":0.83799999999999997},"min":{"1min":0.51900000000000002,"5min":0.41199999999999998,"15min":0.28299999999999997},"max":{"1min":0.96399999999999997,"5min":21.151,"15min":21.151},"last":0.80500000000000005}]},{"osd":2,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.76400000000000001,"15min":0.78800000000000003},"min":{"1min":0.56399999999999995,"5min":0.38600000000000001,"15min":0.376},"max":{"1min":1.379,"5min":1.379,"15min":1.6919999999999999},"last":1},{"interface":"front","average":{"1min":0.871,"5min":0.88500000000000001,"15min":0.879},"min":{"1min":0.49399999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.145,"5min":6.5149999999999997,"15min":6.5149999999999997},"last":0.95099999999999996}]},{"osd":4,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.248,"15min":1.1020000000000001},"min":{"1min":0.72899999999999998,"5min":0.61099999999999999,"15min":0.505},"max":{"1min":1.4279999999999999,"5min":21.347999999999999,"15min":21.347999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.028,"5min":1.288,"15min":1.1259999999999999},"min":{"1min":0.86099999999999999,"5min":0.73799999999999999,"15min":0.60899999999999999},"max":{"1min":1.1739999999999999,"5min":21.129999999999999,"15min":21.129999999999999},"last":1.268}]},{"osd":5,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.2569999999999999,"15min":1.159},"min":{"1min":0.81299999999999994,"5min":0.68200000000000005,"15min":0.626},"max":{"1min":1.2789999999999999,"5min":21.210999999999999,"15min":21.210999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.3169999999999999,"15min":1.21},"min":{"1min":0.82099999999999995,"5min":0.68100000000000005,"15min":0.54100000000000004},"max":{"1min":1.3440000000000001,"5min":21.32,"15min":21.32},"last":0.877}]},{"osd":6,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.052,"15min":1.0980000000000001},"min":{"1min":0.71799999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.425,"5min":1.5209999999999999,"15min":1.9590000000000001},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.319,"15min":1.1850000000000001},"min":{"1min":0.81699999999999995,"5min":0.74299999999999999,"15min":0.60199999999999998},"max":{"1min":1.349,"5min":21.077999999999999,"15min":21.077999999999999},"last":1.157}]},{"osd":7,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1080000000000001,"15min":1.145},"min":{"1min":0.83799999999999997,"5min":0.78300000000000003,"15min":0.64200000000000002},"max":{"1min":1.5,"5min":1.7410000000000001,"15min":2.0449999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2150000000000001,"15min":1.1879999999999999},"min":{"1min":0.76300000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5189999999999999,"5min":6.5750000000000002,"15min":6.5750000000000002},"last":1.345}]}]},{"osd":2,"up_from":13,"seq":55834574925,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14036,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":13184,"kb_avail":94357804,"statfs":{"total":96636764160,"available":96622391296,"internally_reserved":0,"allocated":864256,"data_stored":407833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13500416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64000000000000001,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.41999999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.751},"min":{"1min":0.55100000000000005,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.276,"5min":1.276,"15min":1.3460000000000001},"last":0.626}]},{"osd":1,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73399999999999999,"15min":0.754},"min":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.38800000000000001},"max":{"1min":0.86099999999999999,"5min":1.1850000000000001,"15min":1.4079999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.82299999999999995,"15min":0.85899999999999999},"min":{"1min":0.69199999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":2.0920000000000001},"last":0.71499999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68799999999999994,"15min":0.69599999999999995},"min":{"1min":0.48899999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88300000000000001,"5min":1.234,"15min":1.254},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.85299999999999998,"15min":0.83099999999999996},"min":{"1min":0.56699999999999995,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.111,"5min":1.409,"15min":1.968},"last":0.67800000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.98099999999999998,"15min":1.0269999999999999},"min":{"1min":0.60299999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.204,"5min":1.5089999999999999,"15min":2.2320000000000002},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.002,"15min":1.0609999999999999},"min":{"1min":0.751,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.863,"5min":1.863,"15min":2.181},"last":0.91300000000000003}]},{"osd":5,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.95899999999999996,"15min":0.97499999999999998},"min":{"1min":0.78300000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.224,"5min":1.3819999999999999,"15min":1.5640000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.054,"15min":1.115},"min":{"1min":0.79100000000000004,"5min":0.60499999999999998,"15min":0.58499999999999996},"max":{"1min":1.278,"5min":1.5600000000000001,"15min":2.3719999999999999},"last":0.98999999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0580000000000001,"15min":1.1499999999999999},"min":{"1min":0.90500000000000003,"5min":0.72799999999999998,"15min":0.66300000000000003},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":2.2789999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.073,"15min":1.125},"min":{"1min":0.873,"5min":0.621,"15min":0.621},"max":{"1min":1.3140000000000001,"5min":1.466,"15min":1.867},"last":0.95999999999999996}]},{"osd":7,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1160000000000001,"15min":1.1679999999999999},"min":{"1min":1.002,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.913,"5min":1.913,"15min":2.5699999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.113,"5min":1.0900000000000001,"15min":1.129},"min":{"1min":0.92800000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.357,"5min":1.482,"15min":1.675},"last":1.052}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15132,"kb_used_data":1428,"kb_used_omap":0,"kb_used_meta":13696,"kb_avail":94356708,"statfs":{"total":96636764160,"available":96621268992,"internally_reserved":0,"allocated":1462272,"data_stored":999187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14024704},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.69999999999999996,"15min":0.69299999999999995},"min":{"1min":0.48799999999999999,"5min":0.46600000000000003,"15min":0.29199999999999998},"max":{"1min":1.0669999999999999,"5min":1.296,"15min":1.387},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76400000000000001,"15min":0.70999999999999996},"min":{"1min":0.63800000000000001,"5min":0.46100000000000002,"15min":0.375},"max":{"1min":1.087,"5min":1.252,"15min":1.252},"last":1.087}]},{"osd":2,"last update":"Tue Nov 28 11:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67900000000000005,"15min":0.66200000000000003},"min":{"1min":0.52400000000000002,"5min":0.46400000000000002,"15min":0.26900000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.52200000000000002,"5min":0.44900000000000001,"15min":0.31},"max":{"1min":1.115,"5min":1.153,"15min":1.175},"last":1.115}]},{"osd":3,"last update":"Tue Nov 28 11:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.872,"15min":0.874},"min":{"1min":0.69099999999999995,"5min":0.51300000000000001,"15min":0.317},"max":{"1min":1.181,"5min":1.2549999999999999,"15min":1.5269999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.79400000000000004,"15min":0.75600000000000001},"min":{"1min":0.58199999999999996,"5min":0.51100000000000001,"15min":0.42799999999999999},"max":{"1min":1.1519999999999999,"5min":1.159,"15min":1.159},"last":0.92800000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.91900000000000004,"15min":0.91100000000000003},"min":{"1min":0.66900000000000004,"5min":0.60999999999999999,"15min":0.46100000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.4930000000000001},"last":0.877},{"interface":"front","average":{"1min":1.016,"5min":1.0069999999999999,"15min":1.0580000000000001},"min":{"1min":0.74299999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3069999999999999,"5min":1.5409999999999999,"15min":2.29},"last":0.74299999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:47 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.022,"15min":1.02},"min":{"1min":0.72299999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.355,"5min":1.47,"15min":1.47},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0429999999999999,"15min":1.046},"min":{"1min":0.83299999999999996,"5min":0.65900000000000003,"15min":0.56299999999999994},"max":{"1min":1.506,"5min":1.506,"15min":1.6799999999999999},"last":1.0569999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:59:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0760000000000001,"15min":1.0600000000000001},"min":{"1min":0.78100000000000003,"5min":0.72099999999999997,"15min":0.71799999999999997},"max":{"1min":1.518,"5min":1.581,"15min":1.581},"last":1.026},{"interface":"front","average":{"1min":1.101,"5min":1.075,"15min":1.081},"min":{"1min":0.80000000000000004,"5min":0.69999999999999996,"15min":0.64800000000000002},"max":{"1min":1.55,"5min":1.55,"15min":1.8140000000000001},"last":1.0029999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:59:47 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.129,"15min":1.1870000000000001},"min":{"1min":0.94599999999999995,"5min":0.82099999999999995,"15min":0.747},"max":{"1min":1.361,"5min":1.627,"15min":3.0209999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.147,"15min":1.117},"min":{"1min":0.96399999999999997,"5min":0.79200000000000004,"15min":0.629},"max":{"1min":1.464,"5min":1.635,"15min":1.647},"last":1.2090000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14232,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":13376,"kb_avail":94357608,"statfs":{"total":96636764160,"available":96622190592,"internally_reserved":0,"allocated":868352,"data_stored":408819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13697024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63200000000000001,"15min":0.66700000000000004},"min":{"1min":0.48999999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89200000000000002,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72899999999999998,"15min":0.68400000000000005},"min":{"1min":0.53800000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.58699999999999997}]},{"osd":2,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.503,"5min":0.435,"15min":0.435},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.76500000000000001,"15min":0.71899999999999997},"min":{"1min":0.65400000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.042,"5min":1.175,"15min":1.175},"last":0.75700000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.69699999999999995},"min":{"1min":0.53100000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.117,"5min":1.159,"15min":1.159},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90200000000000002,"15min":0.92200000000000004},"min":{"1min":0.61199999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.575,"5min":1.96,"15min":1.96},"last":0.79200000000000004}]},{"osd":4,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.90700000000000003,"15min":0.879},"min":{"1min":0.73399999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.129},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0249999999999999,"15min":1.093},"min":{"1min":0.81899999999999995,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.8049999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.88600000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.0569999999999999,"15min":1.069},"min":{"1min":0.78700000000000003,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.478,"5min":1.649,"15min":1.649},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.75600000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3080000000000001,"5min":1.339,"15min":1.339},"last":1.0489999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.127,"15min":1.173},"min":{"1min":0.93200000000000005,"5min":0.755,"15min":0.755},"max":{"1min":1.8819999999999999,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.143,"15min":1.1419999999999999},"min":{"1min":0.93000000000000005,"5min":0.749,"15min":0.749},"max":{"1min":1.468,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.0820000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:58:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.1619999999999999,"15min":1.1639999999999999},"min":{"1min":0.86699999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.155},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.107,"15min":1.087},"min":{"1min":0.998,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.367,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.2589999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T11:59:49.822 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-28T11:53:35.353843+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=53, tm_sec=35, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=11, tm_min=59, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T11:59:49.822 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-28T12:00:06.689 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:00:06.692 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:00:09.823 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:00:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.948+0000 7fb2d8bbd700 1 Processor -- start 2023-11-28T12:00:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.948+0000 7fb2d8bbd700 1 -- start start 2023-11-28T12:00:09.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d8bbd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2cc0e6e60 0x7fb2cc04f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d8bbd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb2cc036e80 0x7fb2cc052de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d8bbd700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2cc033a80 con 0x7fb2cc0512b0 2023-11-28T12:00:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d8bbd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2cc0486b0 con 0x7fb2cc036e80 2023-11-28T12:00:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d8bbd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc033d60 con 0x7fb2cc0e6e60 2023-11-28T12:00:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d2ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb2cc0512b0 0x7fb2cc036770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43582/0 (socket says 172.21.15.50:43582) 2023-11-28T12:00:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d2ffd700 1 -- 172.21.15.50:0/1307003025 learned_addr learned my addr 172.21.15.50:0/1307003025 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T12:00:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d3fff700 1 --2- 172.21.15.50:0/1307003025 >> v2:172.21.15.192:3300/0 conn(0x7fb2cc036e80 0x7fb2cc052de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d37fe700 1 --2- 172.21.15.50:0/1307003025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2cc0e6e60 0x7fb2cc04f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 -- 172.21.15.50:0/1307003025 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685153696 0 0) 0x7fb2cc033a80 con 0x7fb2cc0512b0 2023-11-28T12:00:09.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 -- 172.21.15.50:0/1307003025 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c40035d0 con 0x7fb2cc0512b0 2023-11-28T12:00:09.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 -- 172.21.15.50:0/1307003025 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4278585650 0 0) 0x7fb2c40035d0 con 0x7fb2cc0512b0 2023-11-28T12:00:09.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 -- 172.21.15.50:0/1307003025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2cc0e6e60 msgr2=0x7fb2cc04f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:09.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 --2- 172.21.15.50:0/1307003025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2cc0e6e60 0x7fb2cc04f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 -- 172.21.15.50:0/1307003025 >> v2:172.21.15.192:3300/0 conn(0x7fb2cc036e80 msgr2=0x7fb2cc052de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 --2- 172.21.15.50:0/1307003025 >> v2:172.21.15.192:3300/0 conn(0x7fb2cc036e80 0x7fb2cc052de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 -- 172.21.15.50:0/1307003025 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc034040 con 0x7fb2cc0512b0 2023-11-28T12:00:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 -- 172.21.15.50:0/1307003025 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 302990834 0 0) 0x7fb2c0001670 con 0x7fb2cc0512b0 2023-11-28T12:00:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 -- 172.21.15.50:0/1307003025 >> v1:172.21.15.50:6789/0 conn(0x7fb2cc0512b0 legacy=0x7fb2cc036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 --2- 172.21.15.50:0/1307003025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2c4003a20 0x7fb2c4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 --2- 172.21.15.50:0/1307003025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c4004450 0x7fb2c4004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 --2- 172.21.15.50:0/1307003025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2cc0e6e60 0x7fb2c4004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 -- 172.21.15.50:0/1307003025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc0486b0 con 0x7fb2c4004450 2023-11-28T12:00:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 -- 172.21.15.50:0/1307003025 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc033d60 con 0x7fb2c4003a20 2023-11-28T12:00:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 -- 172.21.15.50:0/1307003025 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c400ba30 con 0x7fb2cc0e6e60 2023-11-28T12:00:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d2ffd700 1 --2- 172.21.15.50:0/1307003025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c4004450 0x7fb2c4004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d3fff700 1 --2- 172.21.15.50:0/1307003025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2cc0e6e60 0x7fb2c4004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d37fe700 1 --2- 172.21.15.50:0/1307003025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2c4003a20 0x7fb2c4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d2ffd700 1 -- 172.21.15.50:0/1307003025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2cc0e6e60 msgr2=0x7fb2c4004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:09.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d2ffd700 1 --2- 172.21.15.50:0/1307003025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2cc0e6e60 0x7fb2c4004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d2ffd700 1 -- 172.21.15.50:0/1307003025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2c4003a20 msgr2=0x7fb2c4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:09.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d2ffd700 1 --2- 172.21.15.50:0/1307003025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2c4003a20 0x7fb2c4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d2ffd700 1 -- 172.21.15.50:0/1307003025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c40035d0 con 0x7fb2c4004450 2023-11-28T12:00:09.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d3fff700 1 --2- 172.21.15.50:0/1307003025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2cc0e6e60 0x7fb2c4004fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:00:09.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d2ffd700 1 --2- 172.21.15.50:0/1307003025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c4004450 0x7fb2c4004910 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000c320 tx=0x7fb2c40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12cec3923dd8d4cb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:09.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 -- 172.21.15.50:0/1307003025 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c000ce60 con 0x7fb2c4004450 2023-11-28T12:00:09.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 -- 172.21.15.50:0/1307003025 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c0005980 con 0x7fb2c4004450 2023-11-28T12:00:09.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d27fc700 1 -- 172.21.15.50:0/1307003025 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0005d30 con 0x7fb2c4004450 2023-11-28T12:00:09.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d8bbd700 1 -- 172.21.15.50:0/1307003025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c4004450 msgr2=0x7fb2c4004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:09.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d8bbd700 1 --2- 172.21.15.50:0/1307003025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2c4004450 0x7fb2c4004910 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000c320 tx=0x7fb2c40058a0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.952+0000 7fb2d3fff700 1 -- 172.21.15.50:0/1307003025 reap_dead start 2023-11-28T12:00:09.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d8bbd700 1 -- 172.21.15.50:0/1307003025 shutdown_connections 2023-11-28T12:00:09.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d8bbd700 1 -- 172.21.15.50:0/1307003025 >> 172.21.15.50:0/1307003025 conn(0x7fb2cc051770 msgr2=0x7fb2cc051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:09.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d8bbd700 1 -- 172.21.15.50:0/1307003025 shutdown_connections 2023-11-28T12:00:09.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d8bbd700 1 -- 172.21.15.50:0/1307003025 wait complete. 2023-11-28T12:00:09.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d8bbd700 1 Processor -- start 2023-11-28T12:00:09.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d8bbd700 1 -- start start 2023-11-28T12:00:09.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d8bbd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2c4004450 0x7fb2cc04a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d8bbd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2cc17c070 0x7fb2cc0e2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d8bbd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2cc0e2ab0 0x7fb2cc0e0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d8bbd700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc0e3860 con 0x7fb2cc0e2ab0 2023-11-28T12:00:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d8bbd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc04abd0 con 0x7fb2cc17c070 2023-11-28T12:00:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d8bbd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc0e2fc0 con 0x7fb2c4004450 2023-11-28T12:00:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2cc0e2ab0 0x7fb2cc0e0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d3fff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2cc0e2ab0 0x7fb2cc0e0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48586/0 (socket says 172.21.15.50:48586) 2023-11-28T12:00:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d3fff700 1 -- 172.21.15.50:0/2799883652 learned_addr learned my addr 172.21.15.50:0/2799883652 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T12:00:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d37fe700 1 --2- 172.21.15.50:0/2799883652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2c4004450 0x7fb2cc04a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d2ffd700 1 --2- 172.21.15.50:0/2799883652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2cc17c070 0x7fb2cc0e2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d3fff700 1 -- 172.21.15.50:0/2799883652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2c4004450 msgr2=0x7fb2cc04a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d3fff700 1 --2- 172.21.15.50:0/2799883652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2c4004450 0x7fb2cc04a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d3fff700 1 -- 172.21.15.50:0/2799883652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2cc17c070 msgr2=0x7fb2cc0e2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d3fff700 1 --2- 172.21.15.50:0/2799883652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2cc17c070 0x7fb2cc0e2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d3fff700 1 -- 172.21.15.50:0/2799883652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc0528c0 con 0x7fb2cc0e2ab0 2023-11-28T12:00:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.956+0000 7fb2d3fff700 1 --2- 172.21.15.50:0/2799883652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2cc0e2ab0 0x7fb2cc0e0510 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40694f0 tx=0x7fb2d40723e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.960+0000 7fb2bffff700 1 -- 172.21.15.50:0/2799883652 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4066d20 con 0x7fb2cc0e2ab0 2023-11-28T12:00:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.960+0000 7fb2bffff700 1 -- 172.21.15.50:0/2799883652 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d408f040 con 0x7fb2cc0e2ab0 2023-11-28T12:00:09.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.960+0000 7fb2bffff700 1 -- 172.21.15.50:0/2799883652 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4000a10 con 0x7fb2cc0e2ab0 2023-11-28T12:00:09.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.960+0000 7fb2d8bbd700 1 -- 172.21.15.50:0/2799883652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2cc034320 con 0x7fb2cc0e2ab0 2023-11-28T12:00:09.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.960+0000 7fb2d8bbd700 1 -- 172.21.15.50:0/2799883652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2cc037b40 con 0x7fb2cc0e2ab0 2023-11-28T12:00:09.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.960+0000 7fb2d8bbd700 1 -- 172.21.15.50:0/2799883652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2cc005570 con 0x7fb2cc0e2ab0 2023-11-28T12:00:09.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.960+0000 7fb2bffff700 1 -- 172.21.15.50:0/2799883652 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb2d4067b20 con 0x7fb2cc0e2ab0 2023-11-28T12:00:09.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.960+0000 7fb2bffff700 1 --2- 172.21.15.50:0/2799883652 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb2b8064ee0 0x7fb2b8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:09.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.960+0000 7fb2bffff700 1 -- 172.21.15.50:0/2799883652 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fb2d40faaa0 con 0x7fb2cc0e2ab0 2023-11-28T12:00:09.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.960+0000 7fb2d37fe700 1 --2- 172.21.15.50:0/2799883652 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb2b8064ee0 0x7fb2b8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:09.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.964+0000 7fb2d37fe700 1 --2- 172.21.15.50:0/2799883652 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb2b8064ee0 0x7fb2b8067390 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009a90 tx=0x7fb2c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:09.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:09.968+0000 7fb2bffff700 1 -- 172.21.15.50:0/2799883652 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb2d40c8e00 con 0x7fb2cc0e2ab0 2023-11-28T12:00:10.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.128+0000 7fb2d8bbd700 1 -- 172.21.15.50:0/2799883652 --> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2cc035830 con 0x7fb2b8064ee0 2023-11-28T12:00:10.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.136+0000 7fb2bffff700 1 -- 172.21.15.50:0/2799883652 <== mgr.4107 v2:172.21.15.192:6832/36481 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71348 (secure 0 0 0) 0x7fb2cc035830 con 0x7fb2b8064ee0 2023-11-28T12:00:10.137 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T12:00:10.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.140+0000 7fb2d8bbd700 1 -- 172.21.15.50:0/2799883652 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb2b8064ee0 msgr2=0x7fb2b8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:10.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.140+0000 7fb2d8bbd700 1 --2- 172.21.15.50:0/2799883652 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb2b8064ee0 0x7fb2b8067390 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009a90 tx=0x7fb2c8008040 comp rx=0 tx=0).stop 2023-11-28T12:00:10.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.140+0000 7fb2d8bbd700 1 -- 172.21.15.50:0/2799883652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2cc0e2ab0 msgr2=0x7fb2cc0e0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:10.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.140+0000 7fb2d8bbd700 1 --2- 172.21.15.50:0/2799883652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2cc0e2ab0 0x7fb2cc0e0510 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40694f0 tx=0x7fb2d40723e0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.140+0000 7fb2d8bbd700 1 -- 172.21.15.50:0/2799883652 shutdown_connections 2023-11-28T12:00:10.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.140+0000 7fb2d8bbd700 1 --2- 172.21.15.50:0/2799883652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2cc0e2ab0 0x7fb2cc0e0510 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.140+0000 7fb2d8bbd700 1 --2- 172.21.15.50:0/2799883652 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fb2b8064ee0 0x7fb2b8067390 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.140+0000 7fb2d8bbd700 1 --2- 172.21.15.50:0/2799883652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2cc17c070 0x7fb2cc0e2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.140+0000 7fb2d8bbd700 1 --2- 172.21.15.50:0/2799883652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2c4004450 0x7fb2cc04a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.140+0000 7fb2d8bbd700 1 -- 172.21.15.50:0/2799883652 >> 172.21.15.50:0/2799883652 conn(0x7fb2cc051770 msgr2=0x7fb2cc051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:10.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.140+0000 7fb2d8bbd700 1 -- 172.21.15.50:0/2799883652 shutdown_connections 2023-11-28T12:00:10.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.140+0000 7fb2d8bbd700 1 -- 172.21.15.50:0/2799883652 wait complete. 2023-11-28T12:00:10.141 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-11-28T12:00:10.154 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2023-11-28T12:00:09.007522+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":98744,"kb_used_data":7928,"kb_used_omap":0,"kb_used_meta":90752,"kb_avail":754875976,"statfs":{"total":773094113280,"available":772992999424,"internally_reserved":0,"allocated":8118272,"data_stored":4447344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":92930048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003626"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":74,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:33.602550+0000","last_change":"2023-11-28T11:59:33.602488+0000","last_active":"2023-11-28T11:59:33.602550+0000","last_peered":"2023-11-28T11:59:33.602550+0000","last_clean":"2023-11-28T11:59:33.602550+0000","last_became_active":"2023-11-28T11:53:35.378575+0000","last_became_peered":"2023-11-28T11:53:35.378575+0000","last_unstale":"2023-11-28T11:59:33.602550+0000","last_undegraded":"2023-11-28T11:59:33.602550+0000","last_fullsized":"2023-11-28T11:59:33.602550+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:33.602263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:33.602263+0000","last_clean_scrub_stamp":"2023-11-28T11:59:33.602263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:39:34.219987+0000","scrub_duration":0.006117239,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":74,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:38.598838+0000","last_change":"2023-11-28T11:59:38.598787+0000","last_active":"2023-11-28T11:59:38.598838+0000","last_peered":"2023-11-28T11:59:38.598838+0000","last_clean":"2023-11-28T11:59:38.598838+0000","last_became_active":"2023-11-28T11:53:35.568167+0000","last_became_peered":"2023-11-28T11:53:35.568167+0000","last_unstale":"2023-11-28T11:59:38.598838+0000","last_undegraded":"2023-11-28T11:59:38.598838+0000","last_fullsized":"2023-11-28T11:59:38.598838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:38.598553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:38.598553+0000","last_clean_scrub_stamp":"2023-11-28T11:59:38.598553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:47:47.640756+0000","scrub_duration":0.0058130969999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":80,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:29.125531+0000","last_change":"2023-11-28T11:59:29.125443+0000","last_active":"2023-11-28T11:59:29.125531+0000","last_peered":"2023-11-28T11:59:29.125531+0000","last_clean":"2023-11-28T11:59:29.125531+0000","last_became_active":"2023-11-28T11:53:35.534449+0000","last_became_peered":"2023-11-28T11:53:35.534449+0000","last_unstale":"2023-11-28T11:59:29.125531+0000","last_undegraded":"2023-11-28T11:59:29.125531+0000","last_fullsized":"2023-11-28T11:59:29.125531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:29.125205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:29.125205+0000","last_clean_scrub_stamp":"2023-11-28T11:59:29.125205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:49:57.423707+0000","scrub_duration":0.0060665160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":75,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:32.431403+0000","last_change":"2023-11-28T11:59:32.431315+0000","last_active":"2023-11-28T11:59:32.431403+0000","last_peered":"2023-11-28T11:59:32.431403+0000","last_clean":"2023-11-28T11:59:32.431403+0000","last_became_active":"2023-11-28T11:53:35.375641+0000","last_became_peered":"2023-11-28T11:53:35.375641+0000","last_unstale":"2023-11-28T11:59:32.431403+0000","last_undegraded":"2023-11-28T11:59:32.431403+0000","last_fullsized":"2023-11-28T11:59:32.431403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:32.431073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:32.431073+0000","last_clean_scrub_stamp":"2023-11-28T11:59:32.431073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:10:41.886324+0000","scrub_duration":0.0063483899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"71'119","reported_seq":226,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:45.745670+0000","last_change":"2023-11-28T11:59:45.745633+0000","last_active":"2023-11-28T11:59:45.745670+0000","last_peered":"2023-11-28T11:59:45.745670+0000","last_clean":"2023-11-28T11:59:45.745670+0000","last_became_active":"2023-11-28T11:53:36.387564+0000","last_became_peered":"2023-11-28T11:53:36.387564+0000","last_unstale":"2023-11-28T11:59:45.745670+0000","last_undegraded":"2023-11-28T11:59:45.745670+0000","last_fullsized":"2023-11-28T11:59:45.745670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'119","last_scrub_stamp":"2023-11-28T11:59:45.745408+0000","last_deep_scrub":"71'119","last_deep_scrub_stamp":"2023-11-28T11:59:45.745408+0000","last_clean_scrub_stamp":"2023-11-28T11:59:45.745408+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:10:55.200659+0000","scrub_duration":0.012546659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":73,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:27.979377+0000","last_change":"2023-11-28T11:59:27.979280+0000","last_active":"2023-11-28T11:59:27.979377+0000","last_peered":"2023-11-28T11:59:27.979377+0000","last_clean":"2023-11-28T11:59:27.979377+0000","last_became_active":"2023-11-28T11:53:35.378579+0000","last_became_peered":"2023-11-28T11:53:35.378579+0000","last_unstale":"2023-11-28T11:59:27.979377+0000","last_undegraded":"2023-11-28T11:59:27.979377+0000","last_fullsized":"2023-11-28T11:59:27.979377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:27.979093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:27.979093+0000","last_clean_scrub_stamp":"2023-11-28T11:59:27.979093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:19:03.786251+0000","scrub_duration":0.0057893570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":75,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:34.708061+0000","last_change":"2023-11-28T11:59:34.707925+0000","last_active":"2023-11-28T11:59:34.708061+0000","last_peered":"2023-11-28T11:59:34.708061+0000","last_clean":"2023-11-28T11:59:34.708061+0000","last_became_active":"2023-11-28T11:53:35.570029+0000","last_became_peered":"2023-11-28T11:53:35.570029+0000","last_unstale":"2023-11-28T11:59:34.708061+0000","last_undegraded":"2023-11-28T11:59:34.708061+0000","last_fullsized":"2023-11-28T11:59:34.708061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:34.707690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:34.707690+0000","last_clean_scrub_stamp":"2023-11-28T11:59:34.707690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:59:21.289581+0000","scrub_duration":0.006210836,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":83,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:28.308137+0000","last_change":"2023-11-28T11:59:28.308045+0000","last_active":"2023-11-28T11:59:28.308137+0000","last_peered":"2023-11-28T11:59:28.308137+0000","last_clean":"2023-11-28T11:59:28.308137+0000","last_became_active":"2023-11-28T11:53:35.569910+0000","last_became_peered":"2023-11-28T11:53:35.569910+0000","last_unstale":"2023-11-28T11:59:28.308137+0000","last_undegraded":"2023-11-28T11:59:28.308137+0000","last_fullsized":"2023-11-28T11:59:28.308137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:28.307799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:28.307799+0000","last_clean_scrub_stamp":"2023-11-28T11:59:28.307799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:14:02.250765+0000","scrub_duration":0.0059409450000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":75,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-28T11:59:33.748832+0000","last_change":"2023-11-28T11:59:33.748742+0000","last_active":"2023-11-28T11:59:33.748832+0000","last_peered":"2023-11-28T11:59:33.748832+0000","last_clean":"2023-11-28T11:59:33.748832+0000","last_became_active":"2023-11-28T11:53:35.569938+0000","last_became_peered":"2023-11-28T11:53:35.569938+0000","last_unstale":"2023-11-28T11:59:33.748832+0000","last_undegraded":"2023-11-28T11:59:33.748832+0000","last_fullsized":"2023-11-28T11:59:33.748832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T11:59:33.748539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T11:59:33.748539+0000","last_clean_scrub_stamp":"2023-11-28T11:59:33.748539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:47:42.790743+0000","scrub_duration":0.0058196680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11096,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":9664,"kb_avail":94360744,"statfs":{"total":96636764160,"available":96625401856,"internally_reserved":0,"allocated":1458176,"data_stored":998201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9895936},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.91300000000000003,"15min":0.91900000000000004},"min":{"1min":0.53300000000000003,"5min":0.495,"15min":0.33300000000000002},"max":{"1min":3.0299999999999998,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.022,"15min":0.98799999999999999},"min":{"1min":0.68100000000000005,"5min":0.59799999999999998,"15min":0.45700000000000002},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":0.80000000000000004}]},{"osd":1,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":2.548,"5min":1.212,"15min":0.95599999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":29.149000000000001,"5min":29.149000000000001,"15min":29.149000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.05,"5min":0.90500000000000003,"15min":0.84899999999999998},"min":{"1min":0.68200000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.3439999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.98399999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":0.93500000000000005,"15min":0.84699999999999998},"min":{"1min":0.58699999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":8.8079999999999998,"5min":8.8079999999999998,"15min":8.8079999999999998},"last":1.0209999999999999},{"interface":"front","average":{"1min":2.601,"5min":1.2669999999999999,"15min":1.0369999999999999},"min":{"1min":0.69099999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":28.902999999999999,"5min":28.902999999999999,"15min":28.902999999999999},"last":0.84799999999999998}]},{"osd":3,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.94499999999999995,"15min":0.88100000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.55500000000000005},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.139},{"interface":"front","average":{"1min":2.5790000000000002,"5min":1.288,"15min":1.1040000000000001},"min":{"1min":0.70399999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":29.091000000000001,"5min":29.091000000000001,"15min":29.091000000000001},"last":0.94799999999999995}]},{"osd":4,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.0029999999999999,"15min":0.91700000000000004},"min":{"1min":0.65500000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":11.563000000000001,"5min":11.563000000000001,"15min":11.563000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.635,"5min":1.1100000000000001,"15min":1.0509999999999999},"min":{"1min":0.68799999999999994,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":11.464,"5min":11.464,"15min":11.464},"last":0.69199999999999995}]},{"osd":5,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":2.5979999999999999,"5min":1.327,"15min":1.1180000000000001},"min":{"1min":0.81200000000000006,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":27.745000000000001,"5min":27.745000000000001,"15min":27.745000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.0860000000000001,"15min":1.0920000000000001},"min":{"1min":0.78600000000000003,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.72699999999999998}]},{"osd":6,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.1850000000000001,"15min":1.127},"min":{"1min":0.89000000000000001,"5min":0.80900000000000005,"15min":0.80600000000000005},"max":{"1min":7.4960000000000004,"5min":7.4960000000000004,"15min":7.4960000000000004},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.7390000000000001,"5min":1.2390000000000001,"15min":1.157},"min":{"1min":0.85699999999999998,"5min":0.745,"15min":0.74099999999999999},"max":{"1min":11.500999999999999,"5min":11.500999999999999,"15min":11.500999999999999},"last":1.1020000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9940,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361900,"statfs":{"total":96636764160,"available":96626585600,"internally_reserved":0,"allocated":864256,"data_stored":407833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.875,"15min":0.89900000000000002},"min":{"1min":0.53100000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.083,"5min":2.802,"15min":2.802},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82299999999999995,"15min":0.82999999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.47699999999999998},"max":{"1min":1.1040000000000001,"5min":1.2030000000000001,"15min":1.498},"last":0.97099999999999997}]},{"osd":1,"last update":"Tue Nov 28 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.82199999999999995,"15min":0.84999999999999998},"min":{"1min":0.58999999999999997,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1399999999999999,"5min":1.145,"15min":1.4059999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.90300000000000002,"15min":0.96299999999999997},"min":{"1min":0.61099999999999999,"5min":0.53500000000000003,"15min":0.52700000000000002},"max":{"1min":1.177,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.65900000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.93700000000000006,"15min":0.95499999999999996},"min":{"1min":0.67300000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1919999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.91800000000000004,"15min":0.90800000000000003},"min":{"1min":0.69899999999999995,"5min":0.59399999999999997,"15min":0.51900000000000002},"max":{"1min":1.173,"5min":1.204,"15min":1.204},"last":0.75600000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.92800000000000005,"15min":0.89600000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1599999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.077},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.90700000000000003,"15min":0.871},"min":{"1min":0.73099999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.196,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.0489999999999999}]},{"osd":4,"last update":"Tue Nov 28 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93999999999999995,"15min":0.95099999999999996},"min":{"1min":0.61699999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1799999999999999,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.95799999999999996,"15min":0.995},"min":{"1min":0.69299999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.3220000000000001},"last":0.84699999999999998}]},{"osd":5,"last update":"Tue Nov 28 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.95499999999999996,"15min":1.0089999999999999},"min":{"1min":0.65300000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.306,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.032,"5min":1.0760000000000001,"15min":1.123},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2549999999999999,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.002}]},{"osd":7,"last update":"Tue Nov 28 11:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.032,"15min":1.0680000000000001},"min":{"1min":0.77400000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2509999999999999,"5min":1.2929999999999999,"15min":1.575},"last":1.123},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.056,"15min":1.0580000000000001},"min":{"1min":0.877,"5min":0.57599999999999996,"15min":0.55800000000000005},"max":{"1min":1.3420000000000001,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.1020000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574930,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9944,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361896,"statfs":{"total":96636764160,"available":96626581504,"internally_reserved":0,"allocated":868352,"data_stored":408819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.84299999999999997,"15min":0.84499999999999997},"min":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2150000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.87,"15min":0.86399999999999999},"min":{"1min":0.61899999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.3180000000000001},"last":0.70299999999999996}]},{"osd":1,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.91400000000000003,"15min":0.85799999999999998},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60099999999999998},"max":{"1min":1.258,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.88600000000000001,"15min":0.91100000000000003},"min":{"1min":0.58599999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.169,"5min":1.212,"15min":1.2509999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.91800000000000004,"15min":0.85999999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1910000000000001,"5min":1.208,"15min":1.208},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.91600000000000004,"15min":0.85799999999999998},"min":{"1min":0.751,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.89000000000000001}]},{"osd":3,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.92800000000000005,"15min":0.91100000000000003},"min":{"1min":0.58199999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.129,"5min":1.403,"15min":1.403},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.995,"15min":0.99099999999999999},"min":{"1min":0.66500000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.325,"5min":1.3360000000000001,"15min":1.3740000000000001},"last":0.93000000000000005}]},{"osd":4,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.87,"15min":0.92000000000000004},"min":{"1min":0.74099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.212,"5min":1.325,"15min":1.968},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.97499999999999998,"15min":1.0249999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3480000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.96399999999999997}]},{"osd":6,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.98199999999999998,"15min":1.002},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.55500000000000005},"max":{"1min":1.149,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.052,"5min":1.01,"15min":1.006},"min":{"1min":0.76900000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.345,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.3500000000000001}]},{"osd":7,"last update":"Tue Nov 28 11:59:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.05,"15min":1.0680000000000001},"min":{"1min":0.93899999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.345,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.054},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1040000000000001,"15min":1.0980000000000001},"min":{"1min":0.94299999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.3700000000000001,"5min":1.605,"15min":1.605},"last":1.03}]}]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10200,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":9344,"kb_avail":94361640,"statfs":{"total":96636764160,"available":96626319360,"internally_reserved":0,"allocated":868352,"data_stored":408819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9568256},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82699999999999996,"15min":0.84099999999999997},"min":{"1min":0.58099999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.321,"5min":1.647,"15min":1.647},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.89200000000000002,"15min":0.86399999999999999},"min":{"1min":0.77300000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.127,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.0620000000000001}]},{"osd":1,"last update":"Tue Nov 28 11:59:49 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.88200000000000001,"15min":0.86799999999999999},"min":{"1min":0.69299999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.167,"5min":1.331,"15min":1.331},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.88600000000000001,"15min":0.93100000000000005},"min":{"1min":0.56999999999999995,"5min":0.53600000000000003,"15min":0.52700000000000002},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.6679999999999999},"last":0.74099999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:59:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.68899999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.089,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.90500000000000003,"15min":0.95699999999999996},"min":{"1min":0.64900000000000002,"5min":0.57199999999999995,"15min":0.50600000000000001},"max":{"1min":1.196,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.089}]},{"osd":3,"last update":"Tue Nov 28 11:59:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.91800000000000004,"15min":0.93600000000000005},"min":{"1min":0.68799999999999994,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.2490000000000001,"5min":1.472,"15min":1.5920000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.01,"5min":0.98799999999999999,"15min":1.0469999999999999},"min":{"1min":0.79300000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2070000000000001,"5min":1.29,"15min":1.6419999999999999},"last":0.86799999999999999}]},{"osd":5,"last update":"Tue Nov 28 11:59:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.95099999999999996,"15min":0.97999999999999998},"min":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.264,"5min":1.7190000000000001,"15min":1.7450000000000001},"last":0.999},{"interface":"front","average":{"1min":1.014,"5min":0.98699999999999999,"15min":1.03},"min":{"1min":0.70299999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2210000000000001,"5min":1.619,"15min":1.7230000000000001},"last":0.80800000000000005}]},{"osd":6,"last update":"Tue Nov 28 11:59:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.97599999999999998,"15min":1.054},"min":{"1min":0.75900000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.288,"5min":1.294,"15min":1.7010000000000001},"last":1.181},{"interface":"front","average":{"1min":1.024,"5min":1.0489999999999999,"15min":1.125},"min":{"1min":0.78600000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3069999999999999,"5min":1.784,"15min":1.7929999999999999},"last":1.1599999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:59:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0449999999999999,"15min":1.1279999999999999},"min":{"1min":0.71099999999999997,"5min":0.502,"15min":0.502},"max":{"1min":1.266,"5min":1.6950000000000001,"15min":1.8109999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.099,"15min":1.169},"min":{"1min":0.79500000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.3,"5min":1.52,"15min":1.7669999999999999},"last":1.218}]}]},{"osd":3,"up_from":13,"seq":55834574929,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14164,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357676,"statfs":{"total":96636764160,"available":96622260224,"internally_reserved":0,"allocated":864256,"data_stored":407833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.89000000000000001,"15min":0.70599999999999996},"min":{"1min":0.48799999999999999,"5min":0.39000000000000001,"15min":0.28100000000000003},"max":{"1min":1.139,"5min":21.122,"15min":21.122},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.95399999999999996,"15min":0.78600000000000003},"min":{"1min":0.48999999999999999,"5min":0.40400000000000003,"15min":0.29999999999999999},"max":{"1min":1.115,"5min":21.288,"15min":21.288},"last":0.748}]},{"osd":1,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.75600000000000001,"15min":0.65200000000000002},"min":{"1min":0.50900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83099999999999996,"5min":6.3090000000000002,"15min":6.3090000000000002},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":1.006,"15min":0.83799999999999997},"min":{"1min":0.51900000000000002,"5min":0.41199999999999998,"15min":0.28299999999999997},"max":{"1min":0.96399999999999997,"5min":21.151,"15min":21.151},"last":0.88600000000000001}]},{"osd":2,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.76400000000000001,"15min":0.78800000000000003},"min":{"1min":0.56399999999999995,"5min":0.38600000000000001,"15min":0.376},"max":{"1min":1.379,"5min":1.379,"15min":1.6919999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.871,"5min":0.88500000000000001,"15min":0.879},"min":{"1min":0.49399999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.145,"5min":6.5149999999999997,"15min":6.5149999999999997},"last":1.014}]},{"osd":4,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.248,"15min":1.1020000000000001},"min":{"1min":0.72899999999999998,"5min":0.61099999999999999,"15min":0.505},"max":{"1min":1.4279999999999999,"5min":21.347999999999999,"15min":21.347999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.288,"15min":1.1259999999999999},"min":{"1min":0.86099999999999999,"5min":0.73799999999999999,"15min":0.60899999999999999},"max":{"1min":1.1739999999999999,"5min":21.129999999999999,"15min":21.129999999999999},"last":1.147}]},{"osd":5,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.2569999999999999,"15min":1.159},"min":{"1min":0.81299999999999994,"5min":0.68200000000000005,"15min":0.626},"max":{"1min":1.2789999999999999,"5min":21.210999999999999,"15min":21.210999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.3169999999999999,"15min":1.21},"min":{"1min":0.82099999999999995,"5min":0.68100000000000005,"15min":0.54100000000000004},"max":{"1min":1.3440000000000001,"5min":21.32,"15min":21.32},"last":1.0449999999999999}]},{"osd":6,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.052,"15min":1.0980000000000001},"min":{"1min":0.71799999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.425,"5min":1.5209999999999999,"15min":1.9590000000000001},"last":1.429},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.319,"15min":1.1850000000000001},"min":{"1min":0.81699999999999995,"5min":0.74299999999999999,"15min":0.60199999999999998},"max":{"1min":1.349,"5min":21.077999999999999,"15min":21.077999999999999},"last":1.081}]},{"osd":7,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1080000000000001,"15min":1.145},"min":{"1min":0.83799999999999997,"5min":0.78300000000000003,"15min":0.64200000000000002},"max":{"1min":1.5,"5min":1.7410000000000001,"15min":2.0449999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2150000000000001,"15min":1.1879999999999999},"min":{"1min":0.76300000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5189999999999999,"5min":6.5750000000000002,"15min":6.5750000000000002},"last":1.3819999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14036,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":13184,"kb_avail":94357804,"statfs":{"total":96636764160,"available":96622391296,"internally_reserved":0,"allocated":864256,"data_stored":407833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13500416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64000000000000001,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.41999999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.751},"min":{"1min":0.55100000000000005,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.276,"5min":1.276,"15min":1.3460000000000001},"last":0.65200000000000002}]},{"osd":1,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73399999999999999,"15min":0.754},"min":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.38800000000000001},"max":{"1min":0.86099999999999999,"5min":1.1850000000000001,"15min":1.4079999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.82299999999999995,"15min":0.85899999999999999},"min":{"1min":0.69199999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":2.0920000000000001},"last":0.96699999999999997}]},{"osd":3,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68799999999999994,"15min":0.69599999999999995},"min":{"1min":0.48899999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88300000000000001,"5min":1.234,"15min":1.254},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.85299999999999998,"15min":0.83099999999999996},"min":{"1min":0.56699999999999995,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.111,"5min":1.409,"15min":1.968},"last":0.75800000000000001}]},{"osd":4,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.98099999999999998,"15min":1.0269999999999999},"min":{"1min":0.60299999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.204,"5min":1.5089999999999999,"15min":2.2320000000000002},"last":1.026},{"interface":"front","average":{"1min":1.032,"5min":1.002,"15min":1.0609999999999999},"min":{"1min":0.751,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.863,"5min":1.863,"15min":2.181},"last":1.2370000000000001}]},{"osd":5,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.95899999999999996,"15min":0.97499999999999998},"min":{"1min":0.78300000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.224,"5min":1.3819999999999999,"15min":1.5640000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.054,"15min":1.115},"min":{"1min":0.79100000000000004,"5min":0.60499999999999998,"15min":0.58499999999999996},"max":{"1min":1.278,"5min":1.5600000000000001,"15min":2.3719999999999999},"last":1.292}]},{"osd":6,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0580000000000001,"15min":1.1499999999999999},"min":{"1min":0.90500000000000003,"5min":0.72799999999999998,"15min":0.66300000000000003},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":2.2789999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.073,"15min":1.125},"min":{"1min":0.873,"5min":0.621,"15min":0.621},"max":{"1min":1.3140000000000001,"5min":1.466,"15min":1.867},"last":1.091}]},{"osd":7,"last update":"Tue Nov 28 11:59:43 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1160000000000001,"15min":1.1679999999999999},"min":{"1min":1.002,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.913,"5min":1.913,"15min":2.5699999999999998},"last":1.147},{"interface":"front","average":{"1min":1.113,"5min":1.0900000000000001,"15min":1.129},"min":{"1min":0.92800000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.357,"5min":1.482,"15min":1.675},"last":1.1699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15132,"kb_used_data":1428,"kb_used_omap":0,"kb_used_meta":13696,"kb_avail":94356708,"statfs":{"total":96636764160,"available":96621268992,"internally_reserved":0,"allocated":1462272,"data_stored":999187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14024704},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 11:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.69999999999999996,"15min":0.69299999999999995},"min":{"1min":0.48799999999999999,"5min":0.46600000000000003,"15min":0.29199999999999998},"max":{"1min":1.0669999999999999,"5min":1.296,"15min":1.387},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76400000000000001,"15min":0.70999999999999996},"min":{"1min":0.63800000000000001,"5min":0.46100000000000002,"15min":0.375},"max":{"1min":1.087,"5min":1.252,"15min":1.252},"last":0.77400000000000002}]},{"osd":2,"last update":"Tue Nov 28 11:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67900000000000005,"15min":0.66200000000000003},"min":{"1min":0.52400000000000002,"5min":0.46400000000000002,"15min":0.26900000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.52200000000000002,"5min":0.44900000000000001,"15min":0.31},"max":{"1min":1.115,"5min":1.153,"15min":1.175},"last":0.68899999999999995}]},{"osd":3,"last update":"Tue Nov 28 11:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.872,"15min":0.874},"min":{"1min":0.69099999999999995,"5min":0.51300000000000001,"15min":0.317},"max":{"1min":1.181,"5min":1.2549999999999999,"15min":1.5269999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.79400000000000004,"15min":0.75600000000000001},"min":{"1min":0.58199999999999996,"5min":0.51100000000000001,"15min":0.42799999999999999},"max":{"1min":1.1519999999999999,"5min":1.159,"15min":1.159},"last":0.627}]},{"osd":4,"last update":"Tue Nov 28 11:59:47 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.91900000000000004,"15min":0.91100000000000003},"min":{"1min":0.66900000000000004,"5min":0.60999999999999999,"15min":0.46100000000000002},"max":{"1min":1.407,"5min":1.407,"15min":1.4930000000000001},"last":0.746},{"interface":"front","average":{"1min":1.016,"5min":1.0069999999999999,"15min":1.0580000000000001},"min":{"1min":0.74299999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3069999999999999,"5min":1.5409999999999999,"15min":2.29},"last":0.89400000000000002}]},{"osd":5,"last update":"Tue Nov 28 11:59:47 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.022,"15min":1.02},"min":{"1min":0.72299999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.355,"5min":1.47,"15min":1.47},"last":1.222},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0429999999999999,"15min":1.046},"min":{"1min":0.83299999999999996,"5min":0.65900000000000003,"15min":0.56299999999999994},"max":{"1min":1.506,"5min":1.506,"15min":1.6799999999999999},"last":0.96199999999999997}]},{"osd":6,"last update":"Tue Nov 28 11:59:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0760000000000001,"15min":1.0600000000000001},"min":{"1min":0.78100000000000003,"5min":0.72099999999999997,"15min":0.71799999999999997},"max":{"1min":1.518,"5min":1.581,"15min":1.581},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.075,"15min":1.081},"min":{"1min":0.80000000000000004,"5min":0.69999999999999996,"15min":0.64800000000000002},"max":{"1min":1.55,"5min":1.55,"15min":1.8140000000000001},"last":1.1339999999999999}]},{"osd":7,"last update":"Tue Nov 28 11:59:47 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.129,"15min":1.1870000000000001},"min":{"1min":0.94599999999999995,"5min":0.82099999999999995,"15min":0.747},"max":{"1min":1.361,"5min":1.627,"15min":3.0209999999999999},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.21,"5min":1.147,"15min":1.117},"min":{"1min":0.96399999999999997,"5min":0.79200000000000004,"15min":0.629},"max":{"1min":1.464,"5min":1.635,"15min":1.647},"last":1.052}]}]},{"osd":0,"up_from":13,"seq":55834574930,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14232,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":13376,"kb_avail":94357608,"statfs":{"total":96636764160,"available":96622190592,"internally_reserved":0,"allocated":868352,"data_stored":408819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13697024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 11:59:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63300000000000001,"15min":0.66700000000000004},"min":{"1min":0.52800000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0800000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73299999999999998,"15min":0.68500000000000005},"min":{"1min":0.52700000000000002,"5min":0.47099999999999997,"15min":0.32600000000000001},"max":{"1min":0.92000000000000004,"5min":1.196,"15min":1.196},"last":0.73899999999999999}]},{"osd":2,"last update":"Tue Nov 28 11:59:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.45300000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.117,"5min":1.304,"15min":1.304},"last":1.044},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78700000000000003,"15min":0.72699999999999998},"min":{"1min":0.56299999999999994,"5min":0.45500000000000002,"15min":0.38600000000000001},"max":{"1min":1.143,"5min":1.175,"15min":1.175},"last":0.81799999999999995}]},{"osd":3,"last update":"Tue Nov 28 11:59:51 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72699999999999998,"15min":0.70099999999999996},"min":{"1min":0.501,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0469999999999999,"5min":1.159,"15min":1.159},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.88900000000000001,"15min":0.91800000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.222,"5min":1.575,"15min":1.96},"last":0.92400000000000004}]},{"osd":4,"last update":"Tue Nov 28 11:59:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91600000000000004,"15min":0.88200000000000001},"min":{"1min":0.74099999999999999,"5min":0.59499999999999997,"15min":0.56200000000000006},"max":{"1min":1.129,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.054,"5min":1.01,"15min":1.0880000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.3220000000000001,"5min":1.8049999999999999,"15min":1.9039999999999999},"last":1.216}]},{"osd":5,"last update":"Tue Nov 28 11:59:51 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0509999999999999,"15min":1.0669999999999999},"min":{"1min":0.71599999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3100000000000001,"5min":1.478,"15min":1.649},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.98799999999999999,"15min":1.002},"min":{"1min":0.76700000000000002,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.171}]},{"osd":6,"last update":"Tue Nov 28 11:59:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.113,"15min":1.169},"min":{"1min":0.90800000000000003,"5min":0.755,"15min":0.755},"max":{"1min":1.7789999999999999,"5min":1.8819999999999999,"15min":1.9970000000000001},"last":1.321},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.86599999999999999,"5min":0.80400000000000005,"15min":0.749},"max":{"1min":1.4490000000000001,"5min":1.468,"15min":1.7270000000000001},"last":1.149}]},{"osd":7,"last update":"Tue Nov 28 11:59:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1679999999999999,"15min":1.1659999999999999},"min":{"1min":1.0169999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.464,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.123,"15min":1.093},"min":{"1min":0.95699999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.2669999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:00:10.158 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-28T12:00:10.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.272+0000 7fbc24cff700 1 Processor -- start 2023-11-28T12:00:10.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.272+0000 7fbc24cff700 1 -- start start 2023-11-28T12:00:10.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.272+0000 7fbc24cff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc2015a3e0 0x7fbc200ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:10.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.272+0000 7fbc24cff700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2009c0e0 con 0x7fbc200b2d30 2023-11-28T12:00:10.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.272+0000 7fbc24cff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc200b13e0 con 0x7fbc200cc2f0 2023-11-28T12:00:10.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.272+0000 7fbc24cff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200b16c0 con 0x7fbc2015a3e0 2023-11-28T12:00:10.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.272+0000 7fbc1ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbc200b2d30 0x7fbc20069c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:43590/0 (socket says 172.21.15.50:43590) 2023-11-28T12:00:10.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.272+0000 7fbc1ffff700 1 -- 172.21.15.50:0/2377385506 learned_addr learned my addr 172.21.15.50:0/2377385506 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-11-28T12:00:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.272+0000 7fbc1effd700 1 --2- 172.21.15.50:0/2377385506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc2015a3e0 0x7fbc200ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.276+0000 7fbc1e7fc700 1 -- 172.21.15.50:0/2377385506 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688523602 0 0) 0x7fbc2009c0e0 con 0x7fbc200b2d30 2023-11-28T12:00:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.276+0000 7fbc1e7fc700 1 -- 172.21.15.50:0/2377385506 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc080035d0 con 0x7fbc200b2d30 2023-11-28T12:00:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.276+0000 7fbc1effd700 1 -- 172.21.15.50:0/2377385506 >> v1:172.21.15.192:6789/0 conn(0x7fbc200cc2f0 legacy=0x7fbc200cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.276+0000 7fbc1e7fc700 1 -- 172.21.15.50:0/2377385506 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116360620 0 0) 0x7fbc200b13e0 con 0x7fbc200cc2f0 2023-11-28T12:00:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.276+0000 7fbc1effd700 1 -- 172.21.15.50:0/2377385506 >> v1:172.21.15.50:6789/0 conn(0x7fbc200b2d30 legacy=0x7fbc20069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.276+0000 7fbc1effd700 1 -- 172.21.15.50:0/2377385506 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc200b19a0 con 0x7fbc2015a3e0 2023-11-28T12:00:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.276+0000 7fbc1effd700 1 --2- 172.21.15.50:0/2377385506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc2015a3e0 0x7fbc200ac280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbc10009dc0 tx=0x7fbc1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8f210d6d49ab4a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.276+0000 7fbc1e7fc700 1 -- 172.21.15.50:0/2377385506 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000e070 con 0x7fbc2015a3e0 2023-11-28T12:00:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.276+0000 7fbc1e7fc700 1 -- 172.21.15.50:0/2377385506 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1000bb20 con 0x7fbc2015a3e0 2023-11-28T12:00:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.276+0000 7fbc1e7fc700 1 -- 172.21.15.50:0/2377385506 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000bed0 con 0x7fbc2015a3e0 2023-11-28T12:00:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.276+0000 7fbc24cff700 1 -- 172.21.15.50:0/2377385506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc2015a3e0 msgr2=0x7fbc200ac280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.276+0000 7fbc24cff700 1 --2- 172.21.15.50:0/2377385506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc2015a3e0 0x7fbc200ac280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbc10009dc0 tx=0x7fbc1000b330 comp rx=0 tx=0).stop 2023-11-28T12:00:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.276+0000 7fbc24cff700 1 -- 172.21.15.50:0/2377385506 shutdown_connections 2023-11-28T12:00:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.276+0000 7fbc24cff700 1 --2- 172.21.15.50:0/2377385506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc2015a3e0 0x7fbc200ac280 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.276+0000 7fbc24cff700 1 -- 172.21.15.50:0/2377385506 >> 172.21.15.50:0/2377385506 conn(0x7fbc200cae70 msgr2=0x7fbc200cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.276+0000 7fbc24cff700 1 -- 172.21.15.50:0/2377385506 shutdown_connections 2023-11-28T12:00:10.279 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.276+0000 7fbc24cff700 1 -- 172.21.15.50:0/2377385506 wait complete. 2023-11-28T12:00:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.280+0000 7fbc24cff700 1 Processor -- start 2023-11-28T12:00:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.280+0000 7fbc24cff700 1 -- start start 2023-11-28T12:00:10.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.280+0000 7fbc24cff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc200b2d30 0x7fbc2015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:10.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.280+0000 7fbc24cff700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc200cc2f0 0x7fbc200c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:10.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.280+0000 7fbc24cff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc2015a3e0 0x7fbc200c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:10.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.280+0000 7fbc24cff700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc201f3080 con 0x7fbc200cc2f0 2023-11-28T12:00:10.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.280+0000 7fbc24cff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200c82c0 con 0x7fbc2015a3e0 2023-11-28T12:00:10.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.280+0000 7fbc24cff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2015d500 con 0x7fbc200b2d30 2023-11-28T12:00:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.280+0000 7fbc1effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc200cc2f0 0x7fbc200c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.280+0000 7fbc1effd700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc200cc2f0 0x7fbc200c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48600/0 (socket says 172.21.15.50:48600) 2023-11-28T12:00:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.280+0000 7fbc1effd700 1 -- 172.21.15.50:0/1426911820 learned_addr learned my addr 172.21.15.50:0/1426911820 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T12:00:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.284+0000 7fbc1f7fe700 1 --2- 172.21.15.50:0/1426911820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc200b2d30 0x7fbc2015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.284+0000 7fbc1ffff700 1 --2- 172.21.15.50:0/1426911820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc2015a3e0 0x7fbc200c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.284+0000 7fbc1effd700 1 -- 172.21.15.50:0/1426911820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc200b2d30 msgr2=0x7fbc2015cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.284+0000 7fbc1effd700 1 --2- 172.21.15.50:0/1426911820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc200b2d30 0x7fbc2015cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.284+0000 7fbc1effd700 1 -- 172.21.15.50:0/1426911820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc2015a3e0 msgr2=0x7fbc200c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.284+0000 7fbc1effd700 1 --2- 172.21.15.50:0/1426911820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc2015a3e0 0x7fbc200c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.284+0000 7fbc1effd700 1 -- 172.21.15.50:0/1426911820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc10009a70 con 0x7fbc200cc2f0 2023-11-28T12:00:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.284+0000 7fbc1effd700 1 --2- 172.21.15.50:0/1426911820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc200cc2f0 0x7fbc200c74b0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fbc10013000 tx=0x7fbc10004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.284+0000 7fbc07fff700 1 -- 172.21.15.50:0/1426911820 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1001c8d0 con 0x7fbc200cc2f0 2023-11-28T12:00:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.284+0000 7fbc07fff700 1 -- 172.21.15.50:0/1426911820 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc10020070 con 0x7fbc200cc2f0 2023-11-28T12:00:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.284+0000 7fbc24cff700 1 -- 172.21.15.50:0/1426911820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2006a350 con 0x7fbc200cc2f0 2023-11-28T12:00:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.284+0000 7fbc07fff700 1 -- 172.21.15.50:0/1426911820 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1001cc50 con 0x7fbc200cc2f0 2023-11-28T12:00:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.284+0000 7fbc24cff700 1 -- 172.21.15.50:0/1426911820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc200b1c80 con 0x7fbc200cc2f0 2023-11-28T12:00:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.284+0000 7fbc24cff700 1 -- 172.21.15.50:0/1426911820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc200b21a0 con 0x7fbc200cc2f0 2023-11-28T12:00:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.284+0000 7fbc07fff700 1 -- 172.21.15.50:0/1426911820 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbc1001b400 con 0x7fbc200cc2f0 2023-11-28T12:00:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.288+0000 7fbc07fff700 1 --2- 172.21.15.50:0/1426911820 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc0c064ee0 0x7fbc0c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.288+0000 7fbc07fff700 1 -- 172.21.15.50:0/1426911820 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fbc10022070 con 0x7fbc200cc2f0 2023-11-28T12:00:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.288+0000 7fbc1f7fe700 1 --2- 172.21.15.50:0/1426911820 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc0c064ee0 0x7fbc0c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.288+0000 7fbc1f7fe700 1 --2- 172.21.15.50:0/1426911820 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc0c064ee0 0x7fbc0c067390 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbc14000f60 tx=0x7fbc14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:10.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.296+0000 7fbc07fff700 1 -- 172.21.15.50:0/1426911820 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbc10052780 con 0x7fbc200cc2f0 2023-11-28T12:00:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.460+0000 7fbc24cff700 1 -- 172.21.15.50:0/1426911820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fbc2015d640 con 0x7fbc200cc2f0 2023-11-28T12:00:10.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.472+0000 7fbc07fff700 1 -- 172.21.15.50:0/1426911820 <== mon.0 v2:172.21.15.50:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbc10052780 con 0x7fbc200cc2f0 2023-11-28T12:00:10.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.472+0000 7fbc07fff700 1 -- 172.21.15.50:0/1426911820 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7fbc2015d640 con 0x7fbc200cc2f0 2023-11-28T12:00:10.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.476+0000 7fbc24cff700 1 -- 172.21.15.50:0/1426911820 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc0c064ee0 msgr2=0x7fbc0c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:10.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.476+0000 7fbc24cff700 1 --2- 172.21.15.50:0/1426911820 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc0c064ee0 0x7fbc0c067390 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbc14000f60 tx=0x7fbc14009040 comp rx=0 tx=0).stop 2023-11-28T12:00:10.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.476+0000 7fbc24cff700 1 -- 172.21.15.50:0/1426911820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc200cc2f0 msgr2=0x7fbc200c74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:10.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.476+0000 7fbc24cff700 1 --2- 172.21.15.50:0/1426911820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc200cc2f0 0x7fbc200c74b0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fbc10013000 tx=0x7fbc10004af0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.476+0000 7fbc24cff700 1 -- 172.21.15.50:0/1426911820 shutdown_connections 2023-11-28T12:00:10.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.476+0000 7fbc24cff700 1 --2- 172.21.15.50:0/1426911820 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7fbc0c064ee0 0x7fbc0c067390 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.476+0000 7fbc24cff700 1 --2- 172.21.15.50:0/1426911820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc2015a3e0 0x7fbc200c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.476+0000 7fbc24cff700 1 --2- 172.21.15.50:0/1426911820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc200cc2f0 0x7fbc200c74b0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.476+0000 7fbc24cff700 1 --2- 172.21.15.50:0/1426911820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc200b2d30 0x7fbc2015cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.476+0000 7fbc24cff700 1 -- 172.21.15.50:0/1426911820 >> 172.21.15.50:0/1426911820 conn(0x7fbc200cae70 msgr2=0x7fbc20159710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:10.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.476+0000 7fbc24cff700 1 -- 172.21.15.50:0/1426911820 shutdown_connections 2023-11-28T12:00:10.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.476+0000 7fbc24cff700 1 -- 172.21.15.50:0/1426911820 wait complete. 2023-11-28T12:00:10.489 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T12:00:10.490 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:00:10.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69cdf20700 1 Processor -- start 2023-11-28T12:00:10.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69cdf20700 1 -- start start 2023-11-28T12:00:10.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69cdf20700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f69c815bfd0 0x7f69c80caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:10.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69cdf20700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f69c80cb480 0x7f69c80ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:10.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69cdf20700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c80c9a40 con 0x7f69c80cdcb0 2023-11-28T12:00:10.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69cdf20700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c80ccb90 con 0x7f69c80cb480 2023-11-28T12:00:10.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69cdf20700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c80c9480 con 0x7f69c815bfd0 2023-11-28T12:00:10.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69c7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f69c80cb480 0x7f69c80ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:10.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69c7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f69c80cb480 0x7f69c80ccfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48606/0 (socket says 172.21.15.50:48606) 2023-11-28T12:00:10.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69c7fff700 1 -- 172.21.15.50:0/4023012151 learned_addr learned my addr 172.21.15.50:0/4023012151 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T12:00:10.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69ccf1e700 1 --2- 172.21.15.50:0/4023012151 >> v2:172.21.15.192:3300/0 conn(0x7f69c815bfd0 0x7f69c80caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:10.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69c7fff700 1 -- 172.21.15.50:0/4023012151 >> v2:172.21.15.192:3300/0 conn(0x7f69c815bfd0 msgr2=0x7f69c80caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:00:10.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69c7fff700 1 --2- 172.21.15.50:0/4023012151 >> v2:172.21.15.192:3300/0 conn(0x7f69c815bfd0 0x7f69c80caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69c7fff700 1 -- 172.21.15.50:0/4023012151 >> v1:172.21.15.192:6789/0 conn(0x7f69c80cdcb0 legacy=0x7f69c806ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:10.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69c7fff700 1 -- 172.21.15.50:0/4023012151 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c80c9760 con 0x7f69c80cb480 2023-11-28T12:00:10.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69c7fff700 1 --2- 172.21.15.50:0/4023012151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c80cb480 0x7f69c80ccfb0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f69c80b18f0 tx=0x7f69b0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1737f5b958eb4d97 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:10.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69c77fe700 1 -- 172.21.15.50:0/4023012151 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b000b8a0 con 0x7f69c80cb480 2023-11-28T12:00:10.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69c77fe700 1 -- 172.21.15.50:0/4023012151 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f69b000ba00 con 0x7f69c80cb480 2023-11-28T12:00:10.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.608+0000 7f69c77fe700 1 -- 172.21.15.50:0/4023012151 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b000bdb0 con 0x7f69c80cb480 2023-11-28T12:00:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.612+0000 7f69cdf20700 1 -- 172.21.15.50:0/4023012151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c80cb480 msgr2=0x7f69c80ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.612+0000 7f69cdf20700 1 --2- 172.21.15.50:0/4023012151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c80cb480 0x7f69c80ccfb0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f69c80b18f0 tx=0x7f69b0009bf0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.612+0000 7f69cdf20700 1 -- 172.21.15.50:0/4023012151 shutdown_connections 2023-11-28T12:00:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.612+0000 7f69cdf20700 1 --2- 172.21.15.50:0/4023012151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c80cb480 0x7f69c80ccfb0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.612+0000 7f69cdf20700 1 --2- 172.21.15.50:0/4023012151 >> v2:172.21.15.192:3300/0 conn(0x7f69c815bfd0 0x7f69c80caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.612+0000 7f69cdf20700 1 -- 172.21.15.50:0/4023012151 >> 172.21.15.50:0/4023012151 conn(0x7f69c806c640 msgr2=0x7f69c806ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.612+0000 7f69cdf20700 1 -- 172.21.15.50:0/4023012151 shutdown_connections 2023-11-28T12:00:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.612+0000 7f69cdf20700 1 -- 172.21.15.50:0/4023012151 wait complete. 2023-11-28T12:00:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.612+0000 7f69cdf20700 1 Processor -- start 2023-11-28T12:00:10.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.612+0000 7f69cdf20700 1 -- start start 2023-11-28T12:00:10.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cdf20700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69c80cb480 0x7f69c80c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:10.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cdf20700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69c80cdcb0 0x7f69c815e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:10.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cdf20700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c815bfd0 0x7f69c815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:10.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cdf20700 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c815d8f0 con 0x7f69c815bfd0 2023-11-28T12:00:10.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cdf20700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c80b1bc0 con 0x7f69c80cdcb0 2023-11-28T12:00:10.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cdf20700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c80b06f0 con 0x7f69c80cb480 2023-11-28T12:00:10.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cd71f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c815bfd0 0x7f69c815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:10.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cd71f700 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c815bfd0 0x7f69c815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48610/0 (socket says 172.21.15.50:48610) 2023-11-28T12:00:10.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cd71f700 1 -- 172.21.15.50:0/3186059999 learned_addr learned my addr 172.21.15.50:0/3186059999 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-11-28T12:00:10.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69c7fff700 1 --2- 172.21.15.50:0/3186059999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69c80cdcb0 0x7f69c815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:10.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69ccf1e700 1 --2- 172.21.15.50:0/3186059999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69c80cb480 0x7f69c80c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:10.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cd71f700 1 -- 172.21.15.50:0/3186059999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69c80cb480 msgr2=0x7f69c80c1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:10.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cd71f700 1 --2- 172.21.15.50:0/3186059999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69c80cb480 0x7f69c80c1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cd71f700 1 -- 172.21.15.50:0/3186059999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69c80cdcb0 msgr2=0x7f69c815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:10.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cd71f700 1 --2- 172.21.15.50:0/3186059999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69c80cdcb0 0x7f69c815e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cd71f700 1 -- 172.21.15.50:0/3186059999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b0009570 con 0x7f69c815bfd0 2023-11-28T12:00:10.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cd71f700 1 --2- 172.21.15.50:0/3186059999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c815bfd0 0x7f69c815ec90 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f69c000cbf0 tx=0x7f69c000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:10.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69c57fa700 1 -- 172.21.15.50:0/3186059999 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c0003c20 con 0x7f69c815bfd0 2023-11-28T12:00:10.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69c57fa700 1 -- 172.21.15.50:0/3186059999 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f69c0003d80 con 0x7f69c815bfd0 2023-11-28T12:00:10.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69c57fa700 1 -- 172.21.15.50:0/3186059999 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c000ab80 con 0x7f69c815bfd0 2023-11-28T12:00:10.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cdf20700 1 -- 172.21.15.50:0/3186059999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c815c3a0 con 0x7f69c815bfd0 2023-11-28T12:00:10.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cdf20700 1 -- 172.21.15.50:0/3186059999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c80ceaa0 con 0x7f69c815bfd0 2023-11-28T12:00:10.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69cdf20700 1 -- 172.21.15.50:0/3186059999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c80ce6c0 con 0x7f69c815bfd0 2023-11-28T12:00:10.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.616+0000 7f69c57fa700 1 -- 172.21.15.50:0/3186059999 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f69c0010050 con 0x7f69c815bfd0 2023-11-28T12:00:10.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.620+0000 7f69c57fa700 1 --2- 172.21.15.50:0/3186059999 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f69a8064ee0 0x7f69a8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:00:10.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.620+0000 7f69c57fa700 1 -- 172.21.15.50:0/3186059999 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f69c0081c40 con 0x7f69c815bfd0 2023-11-28T12:00:10.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.620+0000 7f69ccf1e700 1 --2- 172.21.15.50:0/3186059999 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f69a8064ee0 0x7f69a8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:00:10.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.620+0000 7f69ccf1e700 1 --2- 172.21.15.50:0/3186059999 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f69a8064ee0 0x7f69a8067390 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f69c80b3f30 tx=0x7f69b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:00:10.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.624+0000 7f69c57fa700 1 -- 172.21.15.50:0/3186059999 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f69c004fed0 con 0x7f69c815bfd0 2023-11-28T12:00:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.836+0000 7f69cdf20700 1 -- 172.21.15.50:0/3186059999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69c8070ae0 con 0x7f69c815bfd0 2023-11-28T12:00:10.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.836+0000 7f69c57fa700 1 -- 172.21.15.50:0/3186059999 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f69c00534f0 con 0x7f69c815bfd0 2023-11-28T12:00:10.836 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-11-28T12:00:10.837 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1573599194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1573599194},{"type":"v1","addr":"172.21.15.192:6836","nonce":1573599194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6445,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/983935617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":983935617},{"type":"v1","addr":"172.21.15.192:6837","nonce":983935617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6498,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/2516263109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2516263109},{"type":"v1","addr":"172.21.15.50:6833","nonce":2516263109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":7038,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3745625801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3745625801},{"type":"v1","addr":"172.21.15.50:6835","nonce":3745625801}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[]} 2023-11-28T12:00:10.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.840+0000 7f69cdf20700 1 -- 172.21.15.50:0/3186059999 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f69a8064ee0 msgr2=0x7f69a8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:10.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.840+0000 7f69cdf20700 1 --2- 172.21.15.50:0/3186059999 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f69a8064ee0 0x7f69a8067390 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f69c80b3f30 tx=0x7f69b8008040 comp rx=0 tx=0).stop 2023-11-28T12:00:10.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.840+0000 7f69cdf20700 1 -- 172.21.15.50:0/3186059999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c815bfd0 msgr2=0x7f69c815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:00:10.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.840+0000 7f69cdf20700 1 --2- 172.21.15.50:0/3186059999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c815bfd0 0x7f69c815ec90 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f69c000cbf0 tx=0x7f69c000a060 comp rx=0 tx=0).stop 2023-11-28T12:00:10.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.840+0000 7f69cdf20700 1 -- 172.21.15.50:0/3186059999 shutdown_connections 2023-11-28T12:00:10.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.840+0000 7f69cdf20700 1 --2- 172.21.15.50:0/3186059999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69c815bfd0 0x7f69c815ec90 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.840+0000 7f69cdf20700 1 --2- 172.21.15.50:0/3186059999 >> [v2:172.21.15.192:6832/36481,v1:172.21.15.192:6833/36481] conn(0x7f69a8064ee0 0x7f69a8067390 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.840+0000 7f69cdf20700 1 --2- 172.21.15.50:0/3186059999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69c80cdcb0 0x7f69c815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.840+0000 7f69cdf20700 1 --2- 172.21.15.50:0/3186059999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69c80cb480 0x7f69c80c1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:00:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.840+0000 7f69cdf20700 1 -- 172.21.15.50:0/3186059999 >> 172.21.15.50:0/3186059999 conn(0x7f69c806c640 msgr2=0x7f69c8159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:00:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.840+0000 7f69cdf20700 1 -- 172.21.15.50:0/3186059999 shutdown_connections 2023-11-28T12:00:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-11-28T12:00:10.840+0000 7f69cdf20700 1 -- 172.21.15.50:0/3186059999 wait complete. 2023-11-28T12:00:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 34 2023-11-28T12:00:10.851 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-28T12:00:10.851 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-28T12:00:10.852 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T12:00:10.852 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:10.866 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T12:00:10.867 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T12:00:10.867 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:10.881 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T12:00:10.882 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T12:00:10.882 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:10.898 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T12:00:10.898 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T12:00:10.898 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:10.957 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T12:00:10.957 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-28T12:00:10.958 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-28T12:00:10.958 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:11.026 INFO:tasks.ceph.osd.0:Stopped 2023-11-28T12:00:11.027 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-28T12:00:11.027 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:11.097 INFO:tasks.ceph.osd.1:Stopped 2023-11-28T12:00:11.098 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-28T12:00:11.098 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:11.179 INFO:tasks.ceph.osd.2:Stopped 2023-11-28T12:00:11.180 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-28T12:00:11.180 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:11.258 INFO:tasks.ceph.osd.3:Stopped 2023-11-28T12:00:11.258 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-28T12:00:11.258 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:11.360 INFO:tasks.ceph.osd.4:Stopped 2023-11-28T12:00:11.360 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-28T12:00:11.360 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:11.425 INFO:tasks.ceph.osd.5:Stopped 2023-11-28T12:00:11.425 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-28T12:00:11.426 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:11.510 INFO:tasks.ceph.osd.6:Stopped 2023-11-28T12:00:11.511 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-28T12:00:11.511 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:11.577 INFO:tasks.ceph.osd.7:Stopped 2023-11-28T12:00:11.577 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-28T12:00:11.578 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-28T12:00:11.578 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:11.604 INFO:tasks.ceph.mgr.y:Stopped 2023-11-28T12:00:11.604 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-28T12:00:11.604 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:11.634 INFO:tasks.ceph.mgr.x:Stopped 2023-11-28T12:00:11.634 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-28T12:00:11.634 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T12:00:11.634 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:11.657 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T12:00:11.658 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T12:00:11.658 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:11.677 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T12:00:11.677 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T12:00:11.678 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:00:11.736 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T12:00:11.737 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-28T12:00:11.737 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2023-11-28T12:00:11.760 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T12:00:11.761 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-28T12:00:12.044 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T12:00:12.044 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-28T12:00:12.260 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T12:00:12.261 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-28T12:00:12.552 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T12:00:12.553 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-28T12:00:12.827 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T12:00:12.827 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-28T12:00:12.887 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T12:00:12.887 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-28T12:00:13.110 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T12:00:13.110 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-28T12:00:13.283 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T12:00:13.283 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-28T12:00:13.468 INFO:tasks.ceph:Archiving mon data... 2023-11-28T12:00:13.469 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469965/data/mon.a.tgz 2023-11-28T12:00:13.470 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-11-28T12:00:13.476 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.dBRUdMuHyx 2023-11-28T12:00:13.477 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.dBRUdMuHyx 2023-11-28T12:00:13.625 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.dBRUdMuHyx 2023-11-28T12:00:13.650 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.dBRUdMuHyx is 431KB 2023-11-28T12:00:13.716 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.dBRUdMuHyx 2023-11-28T12:00:13.723 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469965/data/mon.b.tgz 2023-11-28T12:00:13.723 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2023-11-28T12:00:13.730 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.LBUvVSdoL7 2023-11-28T12:00:13.730 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.LBUvVSdoL7 2023-11-28T12:00:13.866 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.LBUvVSdoL7 2023-11-28T12:00:13.891 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.LBUvVSdoL7 is 565KB 2023-11-28T12:00:13.957 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.LBUvVSdoL7 2023-11-28T12:00:13.964 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469965/data/mon.c.tgz 2023-11-28T12:00:13.965 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2023-11-28T12:00:13.971 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.vl02V9X347 2023-11-28T12:00:13.971 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.vl02V9X347 2023-11-28T12:00:14.104 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.vl02V9X347 2023-11-28T12:00:14.165 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.vl02V9X347 is 565KB 2023-11-28T12:00:14.228 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.vl02V9X347 2023-11-28T12:00:14.235 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-28T12:00:14.235 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T12:00:14.238 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T12:00:14.252 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-28T12:00:14.252 DEBUG:teuthology.orchestra.run.smithi050:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T12:00:14.296 DEBUG:teuthology.orchestra.run.smithi192:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T12:00:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T12:00:14.328 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T12:00:14.335 INFO:tasks.ceph:Archiving crash dumps... 2023-11-28T12:00:14.336 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469965/remote/smithi050/crash 2023-11-28T12:00:14.337 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T12:00:14.354 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469965/remote/smithi192/crash 2023-11-28T12:00:14.355 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T12:00:14.372 INFO:tasks.ceph:Shutting down logrotate 2023-11-28T12:00:14.373 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:00:14.375 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:00:14.461 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T12:00:14.478 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T12:00:14.494 INFO:tasks.ceph:Compressing logs... 2023-11-28T12:00:14.494 DEBUG:teuthology.orchestra.run.smithi050:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T12:00:14.497 DEBUG:teuthology.orchestra.run.smithi192:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T12:00:19.349 INFO:tasks.ceph:Archiving logs... 2023-11-28T12:00:19.350 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469965/remote/smithi050/log 2023-11-28T12:00:19.351 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T12:00:20.248 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469965/remote/smithi192/log 2023-11-28T12:00:20.249 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T12:00:20.784 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-28T12:00:20.796 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-28T12:00:20.797 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T12:00:20.799 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T12:00:20.882 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-28T12:00:20.913 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-28T12:00:20.913 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T12:00:20.915 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T12:00:20.938 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T12:00:20.939 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2023-11-28T12:00:20.939 INFO:teuthology.orchestra.run.smithi050.stdout:*hv01.front.sepi 44.4.53.2 2 u 58 64 377 0.076 -1.730 0.511 2023-11-28T12:00:20.939 INFO:teuthology.orchestra.run.smithi050.stdout:+hv02.front.sepi 63.231.80.2 3 u 61 64 377 0.059 -0.570 0.401 2023-11-28T12:00:20.939 INFO:teuthology.orchestra.run.smithi050.stdout:+hv03.front.sepi 74.6.168.72 3 u 64 64 377 0.074 -1.056 0.383 2023-11-28T12:00:20.939 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2023-11-28T12:00:20.940 INFO:teuthology.orchestra.run.smithi192.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T12:00:20.940 INFO:teuthology.orchestra.run.smithi192.stdout:============================================================================== 2023-11-28T12:00:20.940 INFO:teuthology.orchestra.run.smithi192.stdout:*hv01.front.sepi 44.4.53.2 2 u 60 64 377 0.068 0.262 0.652 2023-11-28T12:00:20.940 INFO:teuthology.orchestra.run.smithi192.stdout:+hv02.front.sepi 63.231.80.2 3 u 60 64 377 0.090 1.068 0.394 2023-11-28T12:00:20.940 INFO:teuthology.orchestra.run.smithi192.stdout:+hv03.front.sepi 74.6.168.72 3 u 57 64 377 0.088 1.356 0.749 2023-11-28T12:00:20.940 INFO:teuthology.orchestra.run.smithi192.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2023-11-28T12:00:20.942 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-28T12:00:20.956 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-28T12:00:20.957 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-28T12:00:20.971 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-28T12:00:20.985 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-28T12:00:20.999 INFO:teuthology.task.internal:Duration was 1014.192081 seconds 2023-11-28T12:00:21.000 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-28T12:00:21.012 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-28T12:00:21.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T12:00:21.014 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T12:00:21.066 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-28T12:00:21.066 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2023-11-28T12:00:21.067 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T12:00:21.079 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2023-11-28T12:00:21.080 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T12:00:21.092 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-28T12:00:21.092 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T12:00:21.095 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T12:00:21.171 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-28T12:00:21.172 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T12:00:21.175 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T12:00:21.254 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-28T12:00:21.265 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-28T12:00:21.265 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T12:00:21.281 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T12:00:21.297 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-28T12:00:21.308 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T12:00:21.310 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T12:00:21.323 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2023-11-28T12:00:21.356 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2023-11-28T12:00:21.373 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T12:00:21.387 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:00:21.387 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T12:00:21.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:00:21.393 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-28T12:00:21.404 INFO:teuthology.task.internal:Transferring archived files... 2023-11-28T12:00:21.404 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469965/remote/smithi050 2023-11-28T12:00:21.405 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T12:00:21.428 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469965/remote/smithi192 2023-11-28T12:00:21.429 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T12:00:21.457 INFO:teuthology.task.internal:Removing archive directory... 2023-11-28T12:00:21.458 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T12:00:21.468 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T12:00:21.473 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-28T12:00:21.484 INFO:teuthology.task.internal:Not uploading archives. 2023-11-28T12:00:21.485 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-28T12:00:21.502 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-28T12:00:21.502 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T12:00:21.504 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T12:00:21.510 INFO:teuthology.orchestra.run.smithi050.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 12:00 /home/ubuntu/cephtest 2023-11-28T12:00:21.512 INFO:teuthology.orchestra.run.smithi192.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 12:00 /home/ubuntu/cephtest 2023-11-28T12:00:21.514 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-28T12:00:21.524 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-28T12:00:21.550 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T12:00:21.576 DEBUG:teuthology.nuke:shortname: smithi050 2023-11-28T12:00:21.577 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T12:00:21.601 DEBUG:teuthology.nuke:shortname: smithi192 2023-11-28T12:00:21.601 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T12:00:21.604 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469965', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 11:34:29.431802', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-28T12:00:21.630 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469965', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 11:34:29.429743', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-28T12:00:21.651 INFO:teuthology.orchestra.console.smithi050:Power off 2023-11-28T12:00:21.652 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T12:00:21.677 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2023-11-28T12:00:21.677 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:00:21.697 INFO:teuthology.orchestra.console.smithi192:Power off 2023-11-28T12:00:21.697 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T12:00:21.707 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-11-28T12:00:21.719 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-11-28T12:00:21.719 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:00:21.747 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-11-28T12:00:25.708 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:00:25.749 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:00:25.819 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-11-28T12:00:25.860 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-11-28T12:00:29.821 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:00:29.861 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:00:29.931 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-11-28T12:00:29.973 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-11-28T12:00:30.033 INFO:teuthology.orchestra.console.smithi050:Power off completed 2023-11-28T12:00:30.074 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-11-28T12:00:30.179 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} duration: 1014.1920809745789 failure_reason: 'Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub)' flavor: default owner: scheduled_neesingh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=8e83051c5fae442c9e93301c80f26499 status: fail success: false 2023-11-28T12:00:30.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:00:30.264 INFO:teuthology.run:FAIL